[2025-10-01T17:00:01.765002] [INFO ] [MAIN ] Using last completed trading day: 2025-10-01 [2025-10-01T17:00:01.971086] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-01T17:00:01.971269] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-01T17:00:02.280978] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-01T17:00:02.281434] [WARN ] [STATE ] State set to: RUNNING [2025-10-01T17:00:02.281515] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-01T17:00:02.281564] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-01T17:00:02.281705] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-01T17:00:02.281764] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-01T17:00:03.350971] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-01T17:00:03.351144] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-01T17:00:03.351357] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-01T17:00:03.352108] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-01T17:00:03.352168] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-01T17:00:03.352205] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-01T17:00:03.352265] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-01T17:00:03.352299] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-01T17:00:03.352379] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-01T17:00:03.352885] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-01T17:00:03.352975] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-01T17:00:03.353159] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-01T17:00:03.353199] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-01T17:00:03.353231] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-01T17:00:03.353264] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-01T17:00:03.374281] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/GNTY.csv (symbol GNTY no longer active). [2025-10-01T17:00:03.382598] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-01T17:00:03.401334] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/GNTY.csv (symbol GNTY no longer active). [2025-10-01T17:00:03.409455] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-10-01T17:00:03.409601] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-01T17:00:03.409671] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-01T17:00:03.409731] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-01T17:00:03.409795] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-01T17:00:03.410158] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-01T17:00:03.410194] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-01T17:00:03.410227] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-10-01T17:00:03.410256] [INFO ] [MAIN ] Running in parallel mode [2025-10-01T17:00:03.410473] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-10-01T17:00:04.155458] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:04.270591] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:04.279407] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-01T17:00:04.271863] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:04.279699] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-01T17:00:04.280956] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-01T17:00:04.280843] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-01T17:00:04.303421] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:04.303712] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-01T17:00:04.303849] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-01T17:00:04.303795] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-01T17:00:04.304011] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-01T17:00:04.304152] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-01T17:00:04.304198] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-01T17:00:04.304674] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-01T17:00:04.304798] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-01T17:00:04.304940] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-01T17:00:04.304353] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-01T17:00:04.328243] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-01T17:00:04.364520] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-01T17:00:04.388611] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-01T17:00:04.430319] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-01T17:00:05.091110] [DEBUG] [LOCAL ] A: Loaded 50719 existing records from primary storage. [2025-10-01T17:00:05.135079] [INFO ] [MAIN ] A: Loaded 50719 existing records. [2025-10-01T17:00:05.662486] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:05.702247] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-01T17:00:05.745044] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:05.748495] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-01T17:00:05.748207] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:05.748814] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-01T17:00:05.835055] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:05.835249] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-01T17:00:05.835299] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-01T17:00:05.837012] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-01T17:00:05.837083] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-01T17:00:06.249982] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:06.250367] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-01T17:00:06.499600] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:00:06.499924] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-01T17:00:06.500011] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:00:06.500063] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-01T17:00:06.500105] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:00:06.500168] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-01T17:00:06.500281] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-01T17:00:06.500366] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-01T17:00:06.500430] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-01T17:00:06.500483] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 3.0s. Estimated remaining: 2h 2m 4s. Rate: 19.4 symbols/min [2025-10-01T17:00:06.685056] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:06.771617] [DEBUG] [LOCAL ] AAP: Loaded 51971 existing records from primary storage. [2025-10-01T17:00:06.772090] [INFO ] [MAIN ] AAP: Loaded 51971 existing records. [2025-10-01T17:00:06.971576] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:06.971869] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-01T17:00:06.971941] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-01T17:00:06.973606] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-01T17:00:06.973708] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-01T17:00:07.348802] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T17:00:07.370622] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-01T17:00:07.374840] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:07.376094] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-01T17:00:08.015587] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T17:00:08.016978] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-01T17:00:08.092762] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-01T17:00:08.103544] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-01T17:00:08.420034] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-01T17:00:08.421027] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-01T17:00:08.789408] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T17:00:08.792363] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-01T17:00:08.791023] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-01T17:00:08.806567] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-01T17:00:09.159743] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-01T17:00:09.160857] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-01T17:00:09.279032] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T17:00:09.289536] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-01T17:00:09.715623] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T17:00:09.726819] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-01T17:00:09.789166] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-01T17:00:09.790167] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-01T17:00:10.058401] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-01T17:00:10.059291] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-01T17:00:10.377370] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-01T17:00:10.378369] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-01T17:00:10.696451] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T17:00:10.697705] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-01T17:00:10.813184] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T17:00:10.823926] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-01T17:00:10.933239] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-01T17:00:10.943355] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-01T17:00:11.035139] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-01T17:00:11.036250] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-01T17:00:11.211405] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:00:11.221921] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-01T17:00:11.697465] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T17:00:11.698228] [INFO ] [REMOTE ] AAM: Full fetch complete (951 records). [2025-10-01T17:00:11.698304] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-01T17:00:11.906726] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-01T17:00:11.906934] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-01T17:00:11.907049] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-01T17:00:11.907127] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-01T17:00:11.907198] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-01T17:00:11.907238] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-01T17:00:11.907321] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-01T17:00:11.907420] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 8.5s. Estimated remaining: 2h 47m 45s. Rate: 14.1 symbols/min [2025-10-01T17:00:12.114741] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:12.114986] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-01T17:00:12.115045] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-01T17:00:12.115176] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-01T17:00:12.115230] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-01T17:00:12.115285] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-01T17:00:12.115323] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-01T17:00:12.539071] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:12.539712] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-01T17:00:12.587364] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T17:00:12.627515] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-01T17:00:12.630288] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T17:00:12.641039] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-01T17:00:13.275908] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T17:00:13.287691] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-01T17:00:13.478105] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T17:00:13.483866] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-01T17:00:13.889187] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T17:00:13.904909] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-01T17:00:14.581157] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T17:00:14.593083] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-01T17:00:14.846489] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T17:00:14.852432] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-01T17:00:15.030887] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T17:00:15.042986] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-01T17:00:15.773346] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T17:00:15.791360] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-01T17:00:15.813326] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T17:00:15.826027] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-01T17:00:16.571814] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T17:00:16.589118] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-01T17:00:17.250078] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-01T17:00:17.263380] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-01T17:00:17.361602] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:00:17.371471] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-01T17:00:17.478270] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T17:00:17.490275] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-01T17:00:18.390487] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T17:00:18.403276] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-01T17:00:18.991432] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T17:00:18.999312] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-01T17:00:19.377708] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-01T17:00:19.389672] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-01T17:00:19.419761] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-01T17:00:19.436260] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-01T17:00:19.798784] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T17:00:19.810635] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-01T17:00:20.366020] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:00:20.372833] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-01T17:00:20.960070] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T17:00:20.973446] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-01T17:00:21.583890] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-01T17:00:21.602116] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-01T17:00:21.708453] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T17:00:21.721080] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-01T17:00:21.775391] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T17:00:21.782785] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-01T17:00:22.665368] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T17:00:22.677182] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-01T17:00:22.832551] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T17:00:22.844808] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-01T17:00:22.907831] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T17:00:22.926093] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-01T17:00:23.319761] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T17:00:23.336438] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-01T17:00:23.739089] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T17:00:23.746274] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-01T17:00:24.115682] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T17:00:24.128887] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-01T17:00:24.866349] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T17:00:24.881005] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-01T17:00:24.925598] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T17:00:24.934299] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-01T17:00:24.965961] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-01T17:00:24.978159] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-01T17:00:26.443863] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T17:00:26.445303] [INFO ] [REMOTE ] AAT: Full fetch complete (42664 records). [2025-10-01T17:00:26.445417] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-01T17:00:26.771926] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-01T17:00:26.802374] [INFO ] [REMOTE ] AAP: Full fetch complete (75030 records). [2025-10-01T17:00:26.871772] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-01T17:00:26.831115] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-01T17:00:26.890319] [INFO ] [REMOTE ] A: Full fetch complete (73103 records). [2025-10-01T17:00:26.893199] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-01T17:00:26.893384] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-01T17:00:26.899453] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-01T17:00:26.908058] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-01T17:00:26.913705] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-01T17:00:27.071223] [DEBUG] [LOCAL ] AAT: Trimmed 42664 records to 30404 (keeping 200 days of data) [2025-10-01T17:00:27.292569] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-01T17:00:27.431257] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-10-01T17:00:27.523363] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-01T17:00:28.087866] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-01T17:00:28.134008] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-01T17:00:28.140933] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-01T17:00:28.201316] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-01T17:00:28.283991] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-01T17:00:28.301539] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-01T17:00:28.327839] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-01T17:00:28.348357] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-01T17:00:28.389539] [DEBUG] [LOCAL ] AAP: Trimmed 75030 records to 51944 (keeping 200 days of data) [2025-10-01T17:00:28.427185] [DEBUG] [LOCAL ] A: Trimmed 73103 records to 50727 (keeping 200 days of data) [2025-10-01T17:00:28.645263] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-01T17:00:28.701178] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-01T17:00:28.736133] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-01T17:00:28.740432] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-01T17:00:28.807080] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 53615 (keeping 200 days of data) [2025-10-01T17:00:28.960732] [DEBUG] [LOCAL ] AAT: Primary data saved (30404 records). [2025-10-01T17:00:28.966137] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-01T17:00:28.966613] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 17.1s. Estimated remaining: 5h 36m 12s. Rate: 7.0 symbols/min [2025-10-01T17:00:29.214686] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:29.219787] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-01T17:00:29.219978] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-01T17:00:29.222092] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-01T17:00:29.223230] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-01T17:00:29.224502] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-01T17:00:29.225189] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-01T17:00:30.233196] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:30.244163] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-01T17:00:30.271278] [DEBUG] [LOCAL ] AAP: Primary data saved (51944 records). [2025-10-01T17:00:30.279122] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-01T17:00:30.288204] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAP took 23.8s. Estimated remaining: 4h 25m 5s. Rate: 8.9 symbols/min [2025-10-01T17:00:30.355545] [DEBUG] [LOCAL ] AA: Primary data saved (53615 records). [2025-10-01T17:00:30.356701] [INFO ] [MAIN ] AA: Full history saved. [2025-10-01T17:00:30.368205] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AA took 27.0s. Estimated remaining: 3h 32m 36s. Rate: 11.1 symbols/min [2025-10-01T17:00:30.544093] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:00:30.605804] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-01T17:00:30.692544] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:00:30.692246] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:30.701426] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-01T17:00:30.708951] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:00:30.721029] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-01T17:00:30.731687] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-01T17:00:30.732084] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-01T17:00:30.760675] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-01T17:00:30.772202] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAUC took 1.8s. Estimated remaining: 2h 59m 45s. Rate: 13.2 symbols/min [2025-10-01T17:00:30.813246] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:30.834416] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-01T17:00:30.858832] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-01T17:00:30.895741] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-01T17:00:30.908169] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-01T17:00:30.913183] [DEBUG] [LOCAL ] A: Primary data saved (50727 records). [2025-10-01T17:00:30.918575] [INFO ] [MAIN ] A: Full history saved. [2025-10-01T17:00:30.913360] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-01T17:00:30.930018] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. A took 27.5s. Estimated remaining: 2h 34m 54s. Rate: 15.3 symbols/min [2025-10-01T17:00:30.930118] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-01T17:00:30.962821] [DEBUG] [LOCAL ] AB: Loaded 27540 existing records from primary storage. [2025-10-01T17:00:31.022744] [INFO ] [MAIN ] AB: Loaded 27540 existing records. [2025-10-01T17:00:31.242490] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:31.570779] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:31.747803] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:31.769325] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-01T17:00:31.807626] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-01T17:00:31.850751] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-01T17:00:31.864963] [DEBUG] [LOCAL ] ABCB: Loaded 30473 existing records from primary storage. [2025-10-01T17:00:31.863362] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-01T17:00:31.869276] [INFO ] [MAIN ] ABCB: Loaded 30473 existing records. [2025-10-01T17:00:32.141363] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:32.208276] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-01T17:00:32.246976] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-10-01T17:00:32.269318] [INFO ] [MAIN ] ABEV: Loaded 53278 existing records. [2025-10-01T17:00:32.639899] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:32.689770] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-01T17:00:32.709003] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-01T17:00:32.820352] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-01T17:00:32.826889] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:32.843815] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-01T17:00:32.849091] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-01T17:00:32.924963] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:32.970980] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-01T17:00:32.978723] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-01T17:00:32.984312] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-01T17:00:33.006425] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-01T17:00:33.680941] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:33.705463] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-01T17:00:33.752490] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:33.752856] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-01T17:00:34.239700] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-01T17:00:34.251874] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-01T17:00:34.425849] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T17:00:34.433399] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-01T17:00:35.144312] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T17:00:35.150846] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-01T17:00:35.274377] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T17:00:35.285606] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-01T17:00:35.922913] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T17:00:35.931156] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-01T17:00:35.983553] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T17:00:35.994930] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-01T17:00:36.517555] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T17:00:36.524426] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-01T17:00:37.073441] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T17:00:37.084789] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-01T17:00:37.164366] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T17:00:37.173295] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-01T17:00:37.377822] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T17:00:37.386830] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-01T17:00:37.976694] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T17:00:37.987680] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-01T17:00:38.480544] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T17:00:38.488429] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-01T17:00:38.542183] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T17:00:38.557284] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-01T17:00:38.804112] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T17:00:38.814934] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-01T17:00:39.731171] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T17:00:39.739955] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-01T17:00:39.950441] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T17:00:39.959844] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-01T17:00:40.055244] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-01T17:00:40.067033] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-01T17:00:40.304495] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T17:00:40.316399] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-01T17:00:40.766252] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-01T17:00:40.772914] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-01T17:00:41.067139] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T17:00:41.073917] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-01T17:00:41.623857] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T17:00:41.628855] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-01T17:00:41.824026] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-01T17:00:41.831459] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-01T17:00:41.874988] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T17:00:41.886300] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-01T17:00:42.106785] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T17:00:42.118475] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-01T17:00:42.474627] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-01T17:00:42.480635] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-01T17:00:42.902289] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T17:00:42.918819] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-01T17:00:43.238622] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T17:00:43.244440] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-01T17:00:43.376482] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T17:00:43.389107] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-01T17:00:44.066194] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T17:00:44.078571] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-01T17:00:44.145275] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T17:00:44.151908] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-01T17:00:44.229009] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T17:00:44.236474] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-01T17:00:44.917682] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T17:00:44.928729] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-01T17:00:45.365761] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T17:00:45.367151] [INFO ] [REMOTE ] AB: Full fetch complete (45591 records). [2025-10-01T17:00:45.367289] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-01T17:00:45.822349] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T17:00:45.848043] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-01T17:00:45.848783] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-01T17:00:45.849494] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-01T17:00:45.849662] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-01T17:00:45.850143] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-01T17:00:45.852157] [DEBUG] [LOCAL ] AB: Trimmed 45591 records to 27393 (keeping 200 days of data) [2025-10-01T17:00:46.066795] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T17:00:46.081132] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-01T17:00:46.092994] [DEBUG] [LOCAL ] AB: Primary data saved (27393 records). [2025-10-01T17:00:46.093193] [INFO ] [MAIN ] AB: Full history saved. [2025-10-01T17:00:46.093461] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 15.8s. Estimated remaining: 3h 30m 8s. Rate: 11.2 symbols/min [2025-10-01T17:00:46.288616] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:46.309760] [DEBUG] [LOCAL ] ABG: Loaded 18677 existing records from primary storage. [2025-10-01T17:00:46.310034] [INFO ] [MAIN ] ABG: Loaded 18677 existing records. [2025-10-01T17:00:46.515960] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:46.516275] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-01T17:00:46.516357] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-01T17:00:46.516725] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-01T17:00:46.516814] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-01T17:00:46.609555] [DEBUG] [REMOTE ] ABCB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:00:46.636358] [WARN ] [REMOTE ] ABCB: No data returned for month 2025-10 [2025-10-01T17:00:46.636591] [FATAL] [REMOTE ] ABCB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:00:46.637211] [FATAL] [MAIN ] ABCB: Failed to fetch primary data. [2025-10-01T17:00:46.638033] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:00:46.643757] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-01T17:00:46.649267] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-01T17:00:46.649372] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-01T17:00:46.665028] [DEBUG] [LOCAL ] ABCB: Deleted derivative data file. [2025-10-01T17:00:46.670534] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 15.9s. Estimated remaining: 3h 9m 13s. Rate: 12.5 symbols/min [2025-10-01T17:00:46.984268] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T17:00:47.111196] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:47.117851] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-01T17:00:47.203186] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:47.203838] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-01T17:00:47.238678] [DEBUG] [LOCAL ] ABM: Loaded 32024 existing records from primary storage. [2025-10-01T17:00:47.238969] [INFO ] [MAIN ] ABM: Loaded 32024 existing records. [2025-10-01T17:00:47.453512] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:47.453921] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-01T17:00:47.453980] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-01T17:00:47.454268] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-01T17:00:47.454327] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-01T17:00:47.902464] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:47.902847] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-01T17:00:47.939769] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T17:00:47.952936] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-01T17:00:47.962543] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-01T17:00:47.967340] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-01T17:00:48.594243] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T17:00:48.601222] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-01T17:00:48.773866] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T17:00:48.787228] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-01T17:00:48.936631] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T17:00:48.943247] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-01T17:00:49.463212] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T17:00:49.467194] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-01T17:00:49.889047] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T17:00:49.895238] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-01T17:00:50.080773] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-01T17:00:50.093242] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-01T17:00:50.163329] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T17:00:50.176706] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-01T17:00:50.498976] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T17:00:50.504093] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-01T17:00:51.018305] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T17:00:51.027133] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-01T17:00:51.774845] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T17:00:51.803259] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-01T17:00:51.804075] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T17:00:51.812901] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-01T17:00:52.280113] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T17:00:52.287202] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-01T17:00:52.491552] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-01T17:00:52.493847] [INFO ] [REMOTE ] ABEV: Full fetch complete (77209 records). [2025-10-01T17:00:52.493986] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-01T17:00:52.670543] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T17:00:52.703160] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-01T17:00:52.973341] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-01T17:00:52.973430] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-01T17:00:52.974212] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-01T17:00:52.974285] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-01T17:00:52.976051] [DEBUG] [LOCAL ] ABEV: Trimmed 77209 records to 53278 (keeping 200 days of data) [2025-10-01T17:00:53.268501] [DEBUG] [REMOTE ] ABBV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:00:53.274940] [WARN ] [REMOTE ] ABBV: No data returned for month 2025-10 [2025-10-01T17:00:53.297146] [FATAL] [REMOTE ] ABBV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:00:53.297782] [FATAL] [MAIN ] ABBV: Failed to fetch primary data. [2025-10-01T17:00:53.299794] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:00:53.300042] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-01T17:00:53.305855] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-01T17:00:53.310128] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-01T17:00:53.317971] [DEBUG] [LOCAL ] ABBV: No derivative data file found to delete. [2025-10-01T17:00:53.320035] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABBV took 22.9s. Estimated remaining: 3h 16m 24s. Rate: 12.0 symbols/min [2025-10-01T17:00:53.319879] [DEBUG] [LOCAL ] ABEV: Primary data saved (53278 records). [2025-10-01T17:00:53.325558] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-01T17:00:53.383890] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 22.4s. Estimated remaining: 2h 58m 42s. Rate: 13.2 symbols/min [2025-10-01T17:00:53.708804] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:53.756402] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:53.774282] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T17:00:53.781054] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-01T17:00:53.803309] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T17:00:53.812930] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-01T17:00:53.878869] [DEBUG] [LOCAL ] ABR: Loaded 52005 existing records from primary storage. [2025-10-01T17:00:53.879211] [INFO ] [MAIN ] ABR: Loaded 52005 existing records. [2025-10-01T17:00:54.025957] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-10-01T17:00:54.041831] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-10-01T17:00:54.178993] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:54.192801] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-01T17:00:54.210974] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-01T17:00:54.228716] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-01T17:00:54.233980] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-01T17:00:54.410307] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:54.428064] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-01T17:00:54.443255] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-01T17:00:54.452533] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-01T17:00:54.468573] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-01T17:00:55.031014] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:55.054176] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-01T17:00:55.150393] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T17:00:55.132917] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T17:00:55.192925] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-01T17:00:55.193415] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-01T17:00:55.235070] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:55.235420] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-01T17:00:56.027296] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T17:00:56.032256] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-01T17:00:56.410011] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T17:00:56.418060] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-01T17:00:56.550954] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T17:00:56.561520] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-01T17:00:56.989788] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T17:00:56.994577] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-01T17:00:57.045278] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T17:00:57.056844] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-01T17:00:57.869924] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T17:00:57.878165] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-01T17:00:58.048821] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T17:00:58.060685] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-01T17:00:58.247503] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T17:00:58.248919] [INFO ] [REMOTE ] ABG: Full fetch complete (26503 records). [2025-10-01T17:00:58.249024] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-01T17:00:58.686613] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-01T17:00:58.686822] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-01T17:00:58.687223] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-01T17:00:58.687332] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-01T17:00:58.688412] [DEBUG] [LOCAL ] ABG: Trimmed 26503 records to 18569 (keeping 200 days of data) [2025-10-01T17:00:58.847978] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T17:00:58.862692] [DEBUG] [LOCAL ] ABG: Primary data saved (18569 records). [2025-10-01T17:00:58.863361] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-01T17:00:58.864357] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-01T17:00:58.864709] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 12.8s. Estimated remaining: 3h 1m 41s. Rate: 13.0 symbols/min [2025-10-01T17:00:58.932856] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T17:00:58.987352] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-01T17:00:59.099767] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:00:59.123546] [DEBUG] [LOCAL ] ACA: Loaded 23379 existing records from primary storage. [2025-10-01T17:00:59.123851] [INFO ] [MAIN ] ACA: Loaded 23379 existing records. [2025-10-01T17:00:59.325562] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:00:59.325803] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-01T17:00:59.325854] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-01T17:00:59.326089] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-01T17:00:59.326240] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-01T17:00:59.744823] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:00:59.745265] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-01T17:00:59.786591] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T17:00:59.797321] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-01T17:01:00.292353] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T17:01:00.303533] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-01T17:01:00.628019] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T17:01:00.636781] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-01T17:01:01.203919] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T17:01:01.209576] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-01T17:01:01.535316] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T17:01:01.547623] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-01T17:01:01.928389] [DEBUG] [REMOTE ] ABM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:01:01.928813] [WARN ] [REMOTE ] ABM: No data returned for month 2025-10 [2025-10-01T17:01:01.928921] [FATAL] [REMOTE ] ABM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:01:01.929053] [FATAL] [MAIN ] ABM: Failed to fetch primary data. [2025-10-01T17:01:01.929138] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:01:01.929264] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-01T17:01:01.929391] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-01T17:01:01.929450] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-01T17:01:01.930025] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-01T17:01:01.930121] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 15.3s. Estimated remaining: 2h 56m 55s. Rate: 13.3 symbols/min [2025-10-01T17:01:02.179396] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:02.201889] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T17:01:02.208387] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-01T17:01:02.243914] [DEBUG] [LOCAL ] ACCO: Loaded 37420 existing records from primary storage. [2025-10-01T17:01:02.244322] [INFO ] [MAIN ] ACCO: Loaded 37420 existing records. [2025-10-01T17:01:02.476524] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:01:02.476983] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-01T17:01:02.477086] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-01T17:01:02.477457] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-01T17:01:02.477521] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-01T17:01:02.640465] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-01T17:01:02.673810] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-01T17:01:02.964166] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:02.964482] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-01T17:01:03.180415] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T17:01:03.189052] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-01T17:01:03.269389] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T17:01:03.281146] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-01T17:01:04.056966] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T17:01:04.064283] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-01T17:01:04.120455] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T17:01:04.128153] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-01T17:01:04.747618] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T17:01:04.759860] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-01T17:01:05.039618] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T17:01:05.051333] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-01T17:01:05.235083] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T17:01:05.243132] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-01T17:01:05.332292] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T17:01:05.339963] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-01T17:01:06.140260] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T17:01:06.152437] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-01T17:01:06.168574] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T17:01:06.174589] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-01T17:01:06.450836] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T17:01:06.462874] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-01T17:01:06.632609] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T17:01:06.644333] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-01T17:01:07.303789] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T17:01:07.310178] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-01T17:01:07.527851] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T17:01:07.540462] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-01T17:01:07.704118] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T17:01:07.714696] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-01T17:01:08.451267] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T17:01:08.463456] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-01T17:01:08.575905] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T17:01:08.902418] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-01T17:01:09.023557] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T17:01:09.702435] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-01T17:01:09.720211] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T17:01:09.828710] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-01T17:01:10.189754] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T17:01:10.502412] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-01T17:01:11.302385] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-01T17:01:11.349035] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T17:01:12.102400] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-01T17:01:12.253627] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T17:01:12.902421] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-01T17:01:13.204872] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T17:01:13.402802] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T17:01:13.702383] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-01T17:01:13.957468] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T17:01:14.502403] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-01T17:01:15.258510] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T17:01:15.302462] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-01T17:01:15.868713] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T17:01:16.065341] [DEBUG] [REMOTE ] ACA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:01:16.065779] [WARN ] [REMOTE ] ACA: No data returned for month 2025-10 [2025-10-01T17:01:16.065981] [FATAL] [REMOTE ] ACA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:01:16.066116] [FATAL] [MAIN ] ACA: Failed to fetch primary data. [2025-10-01T17:01:16.066192] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:01:16.066283] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-01T17:01:16.066423] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-01T17:01:16.066530] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-01T17:01:16.067133] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-01T17:01:16.067258] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 17.2s. Estimated remaining: 3h 23m 52s. Rate: 11.6 symbols/min [2025-10-01T17:01:16.108457] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-01T17:01:16.298257] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:16.334995] [DEBUG] [LOCAL ] ACEL: Loaded 26829 existing records from primary storage. [2025-10-01T17:01:16.335331] [INFO ] [MAIN ] ACEL: Loaded 26829 existing records. [2025-10-01T17:01:16.535238] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:01:16.535574] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-01T17:01:16.535682] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-01T17:01:16.535985] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-01T17:01:16.536046] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-01T17:01:16.902375] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-01T17:01:16.924911] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:17.225999] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T17:01:17.702394] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-01T17:01:18.502395] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-01T17:01:18.883878] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T17:01:19.302366] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-01T17:01:19.340454] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-01T17:01:19.342104] [INFO ] [REMOTE ] ABT: Full fetch complete (77594 records). [2025-10-01T17:01:19.342223] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-01T17:01:19.813091] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-01T17:01:19.813190] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-01T17:01:19.814021] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-01T17:01:19.814095] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-01T17:01:19.815962] [DEBUG] [LOCAL ] ABT: Trimmed 77594 records to 53620 (keeping 200 days of data) [2025-10-01T17:01:20.135718] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-01T17:01:20.188210] [DEBUG] [LOCAL ] ABT: Primary data saved (53620 records). [2025-10-01T17:01:20.188369] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-01T17:01:20.190375] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABT took 26.8s. Estimated remaining: 3h 20m 60s. Rate: 11.7 symbols/min [2025-10-01T17:01:20.383200] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:20.442068] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-01T17:01:20.442404] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-01T17:01:20.645719] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:01:20.646005] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-01T17:01:20.646061] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-01T17:01:20.646529] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-01T17:01:20.646591] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-01T17:01:21.049006] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-01T17:01:21.089808] [INFO ] [REMOTE ] ACCO: Full fetch complete (54071 records). [2025-10-01T17:01:21.094292] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:21.095049] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-01T17:01:21.095239] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-01T17:01:21.194516] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-01T17:01:21.233470] [INFO ] [REMOTE ] ABR: Full fetch complete (75196 records). [2025-10-01T17:01:21.260558] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-01T17:01:21.650204] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:01:21.711147] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-01T17:01:21.880710] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-01T17:01:21.908352] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-01T17:01:21.909221] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-01T17:01:21.918704] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-01T17:01:22.015181] [DEBUG] [LOCAL ] ACCO: Trimmed 54071 records to 37359 (keeping 200 days of data) [2025-10-01T17:01:22.138160] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-01T17:01:22.166170] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-01T17:01:22.172853] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-01T17:01:22.175619] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-01T17:01:22.191335] [DEBUG] [LOCAL ] ABR: Trimmed 75196 records to 51995 (keeping 200 days of data) [2025-10-01T17:01:22.543332] [DEBUG] [LOCAL ] ACCO: Primary data saved (37359 records). [2025-10-01T17:01:22.544209] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-01T17:01:22.547478] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ACCO took 20.6s. Estimated remaining: 3h 14m 8s. Rate: 12.1 symbols/min [2025-10-01T17:01:22.787074] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:22.789719] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-01T17:01:22.792396] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-01T17:01:22.797008] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-01T17:01:22.797098] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-01T17:01:22.828690] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-01T17:01:22.834399] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-01T17:01:22.975613] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T17:01:23.009324] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-01T17:01:23.202247] [DEBUG] [LOCAL ] ABR: Primary data saved (51995 records). [2025-10-01T17:01:23.235744] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-01T17:01:23.235993] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ABR took 29.9s. Estimated remaining: 3h 4m 14s. Rate: 12.8 symbols/min [2025-10-01T17:01:23.450112] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:23.456261] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-01T17:01:23.531423] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:23.584466] [DEBUG] [LOCAL ] ACM: Loaded 42987 existing records from primary storage. [2025-10-01T17:01:23.585096] [INFO ] [MAIN ] ACM: Loaded 42987 existing records. [2025-10-01T17:01:23.821578] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:01:23.822022] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-01T17:01:23.822100] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-01T17:01:23.822803] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-01T17:01:23.822886] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-01T17:01:24.199596] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (3.10 seconds). [2025-10-01T17:01:24.262680] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-01T17:01:24.262044] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T17:01:24.377617] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:24.902372] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-01T17:01:25.113746] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T17:01:25.702416] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-01T17:01:26.235862] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T17:01:26.502440] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-01T17:01:26.926739] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-01T17:01:26.967965] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T17:01:27.302425] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-01T17:01:27.491528] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T17:01:28.102466] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-01T17:01:28.522211] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T17:01:28.902406] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-01T17:01:29.702435] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-01T17:01:30.073844] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-01T17:01:30.447949] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T17:01:30.502379] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-01T17:01:31.224927] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T17:01:31.302374] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-01T17:01:31.347700] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T17:01:32.102395] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-01T17:01:32.841228] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T17:01:32.902412] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-01T17:01:33.036559] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T17:01:33.702416] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-01T17:01:34.464776] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T17:01:34.502491] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-01T17:01:34.918052] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T17:01:35.302447] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-01T17:01:36.102488] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-01T17:01:36.785685] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-01T17:01:36.902373] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-01T17:01:36.958389] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T17:01:36.989133] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T17:01:37.702456] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-01T17:01:38.502492] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-01T17:01:38.752463] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T17:01:39.229160] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T17:01:39.302426] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-01T17:01:40.102442] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-01T17:01:40.818795] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-01T17:01:40.900464] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T17:01:40.904480] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-01T17:01:41.284613] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T17:01:41.702404] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-01T17:01:42.150384] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T17:01:42.502397] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-01T17:01:43.232376] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T17:01:43.302452] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-01T17:01:43.950062] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T17:01:44.102426] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-01T17:01:44.902444] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-01T17:01:45.554974] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-01T17:01:45.624549] [DEBUG] [REMOTE ] ACEL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:01:45.624967] [WARN ] [REMOTE ] ACEL: No data returned for month 2025-10 [2025-10-01T17:01:45.625599] [FATAL] [REMOTE ] ACEL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:01:45.625809] [FATAL] [MAIN ] ACEL: Failed to fetch primary data. [2025-10-01T17:01:45.625903] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:01:45.626001] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-01T17:01:45.626092] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-01T17:01:45.626151] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-01T17:01:45.626535] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-10-01T17:01:45.626675] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 29.6s. Estimated remaining: 3h 42m 42s. Rate: 10.6 symbols/min [2025-10-01T17:01:45.707509] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-01T17:01:45.864717] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:45.912279] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T17:01:45.990698] [DEBUG] [LOCAL ] ACN: Loaded 53425 existing records from primary storage. [2025-10-01T17:01:45.991094] [INFO ] [MAIN ] ACN: Loaded 53425 existing records. [2025-10-01T17:01:46.206128] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:01:46.206386] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-01T17:01:46.206436] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-01T17:01:46.206814] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-01T17:01:46.206876] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-01T17:01:46.507558] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-01T17:01:46.610678] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:47.302388] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-01T17:01:48.102371] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-01T17:01:48.155491] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T17:01:48.238479] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-01T17:01:48.825919] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T17:01:48.902458] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-01T17:01:49.702389] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-01T17:01:49.846633] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T17:01:50.234571] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T17:01:50.502410] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-01T17:01:51.307508] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-01T17:01:51.326109] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T17:01:52.102400] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-01T17:01:52.902438] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-01T17:01:53.042767] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T17:01:53.169798] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-01T17:01:53.498870] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T17:01:53.702427] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-01T17:01:54.502419] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-01T17:01:55.012923] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-01T17:01:55.014830] [INFO ] [REMOTE ] ACI: Full fetch complete (77054 records). [2025-10-01T17:01:55.014952] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-01T17:01:55.314633] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-01T17:01:55.473522] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-01T17:01:55.473623] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-01T17:01:55.474739] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-01T17:01:55.474808] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-01T17:01:55.476582] [DEBUG] [LOCAL ] ACI: Trimmed 77054 records to 53259 (keeping 200 days of data) [2025-10-01T17:01:55.824843] [DEBUG] [LOCAL ] ACI: Primary data saved (53259 records). [2025-10-01T17:01:55.824997] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-01T17:01:55.825075] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACI took 33.3s. Estimated remaining: 3h 51m 56s. Rate: 10.1 symbols/min [2025-10-01T17:01:56.016106] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:56.048551] [DEBUG] [LOCAL ] ACP: Loaded 30970 existing records from primary storage. [2025-10-01T17:01:56.049085] [INFO ] [MAIN ] ACP: Loaded 30970 existing records. [2025-10-01T17:01:56.268613] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:01:56.269141] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-01T17:01:56.269201] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-01T17:01:56.269409] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-01T17:01:56.269468] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-01T17:01:56.470982] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-01T17:01:56.533392] [INFO ] [REMOTE ] ACM: Full fetch complete (62751 records). [2025-10-01T17:01:56.615054] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-01T17:01:56.657687] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-01T17:01:56.801180] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-01T17:01:56.839201] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:56.916917] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-01T17:01:57.210929] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-01T17:01:57.211145] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-01T17:01:57.211942] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-01T17:01:57.212019] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-01T17:01:57.213575] [DEBUG] [LOCAL ] ACM: Trimmed 62751 records to 43000 (keeping 200 days of data) [2025-10-01T17:01:57.379628] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-01T17:01:57.568406] [DEBUG] [LOCAL ] ACM: Primary data saved (43000 records). [2025-10-01T17:01:57.568604] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-01T17:01:57.568806] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 34.3s. Estimated remaining: 3h 43m 39s. Rate: 10.5 symbols/min [2025-10-01T17:01:57.707472] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-01T17:01:57.771116] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:01:57.771336] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-01T17:01:57.771383] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-01T17:01:57.771518] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-01T17:01:57.771568] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-01T17:01:57.771614] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-01T17:01:57.771691] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-01T17:01:58.171772] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:01:58.502400] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-01T17:01:58.599543] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T17:01:59.175930] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T17:01:59.302710] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-01T17:01:59.339139] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-01T17:01:59.889160] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-01T17:02:00.102439] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-01T17:02:00.457259] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T17:02:00.902404] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-01T17:02:01.702439] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-01T17:02:02.087355] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-01T17:02:02.469883] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-01T17:02:02.502440] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-01T17:02:03.302349] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-01T17:02:03.353990] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T17:02:03.610168] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T17:02:04.102392] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-01T17:02:04.902404] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-01T17:02:05.210237] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T17:02:05.702404] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-01T17:02:06.294944] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T17:02:06.502478] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-01T17:02:06.846325] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T17:02:06.895381] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-01T17:02:07.007252] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (3.70 seconds). [2025-10-01T17:02:07.009562] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-01T17:02:07.010043] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-01T17:02:07.309048] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-01T17:02:07.545065] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-01T17:02:07.545204] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-01T17:02:07.546348] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-01T17:02:07.546466] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-01T17:02:07.549916] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-01T17:02:07.967970] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-01T17:02:07.968135] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-01T17:02:07.968975] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 47.8s. Estimated remaining: 3h 52m 19s. Rate: 10.1 symbols/min [2025-10-01T17:02:08.107554] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-01T17:02:08.219369] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:02:08.256533] [DEBUG] [LOCAL ] ACRE: Loaded 33553 existing records from primary storage. [2025-10-01T17:02:08.256874] [INFO ] [MAIN ] ACRE: Loaded 33553 existing records. [2025-10-01T17:02:08.456620] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:02:08.456871] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-01T17:02:08.456920] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-01T17:02:08.457285] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-01T17:02:08.457348] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-01T17:02:08.881323] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:02:08.902488] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-01T17:02:08.903397] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T17:02:09.702431] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-01T17:02:09.801474] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T17:02:10.116617] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-01T17:02:10.502429] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-01T17:02:10.945218] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T17:02:11.302429] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-01T17:02:12.040728] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T17:02:12.102438] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-01T17:02:12.528390] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-01T17:02:12.902391] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-01T17:02:13.443081] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-01T17:02:13.591947] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T17:02:13.702400] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-01T17:02:14.502399] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-01T17:02:14.735951] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T17:02:15.302387] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-01T17:02:16.077737] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T17:02:16.102344] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-01T17:02:16.784438] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:02:16.902379] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-01T17:02:17.357553] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-01T17:02:17.702379] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-01T17:02:18.386036] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T17:02:18.502375] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-01T17:02:19.002407] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.90 seconds). [2025-10-01T17:02:19.004089] [INFO ] [REMOTE ] ACN: Full fetch complete (77121 records). [2025-10-01T17:02:19.004209] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-01T17:02:19.307433] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-01T17:02:19.449865] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-01T17:02:19.449977] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-01T17:02:19.450962] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-01T17:02:19.451047] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-01T17:02:19.452691] [DEBUG] [LOCAL ] ACN: Trimmed 77121 records to 53426 (keeping 200 days of data) [2025-10-01T17:02:19.735215] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T17:02:19.836666] [DEBUG] [LOCAL ] ACN: Primary data saved (53426 records). [2025-10-01T17:02:19.836822] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-01T17:02:19.838354] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 34.2s. Estimated remaining: 4h 2m 47s. Rate: 9.7 symbols/min [2025-10-01T17:02:20.036724] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:02:20.048880] [DEBUG] [LOCAL ] ACV: Loaded 7194 existing records from primary storage. [2025-10-01T17:02:20.049117] [INFO ] [MAIN ] ACV: Loaded 7194 existing records. [2025-10-01T17:02:20.111352] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-01T17:02:20.183073] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T17:02:20.271638] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:02:20.271929] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-01T17:02:20.271992] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-01T17:02:20.272221] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-01T17:02:20.272282] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-01T17:02:20.698314] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:02:20.902433] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-01T17:02:21.246773] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-01T17:02:21.476983] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T17:02:21.702441] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-01T17:02:22.502419] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-01T17:02:23.220345] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T17:02:23.233966] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-01T17:02:23.235080] [INFO ] [REMOTE ] ACR: Full fetch complete (8592 records). [2025-10-01T17:02:23.235175] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-01T17:02:23.307627] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-01T17:02:23.854296] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-01T17:02:23.854474] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-01T17:02:23.854827] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-01T17:02:23.854910] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-01T17:02:23.861964] [DEBUG] [LOCAL ] ACR: Trimmed 8592 records to 5949 (keeping 200 days of data) [2025-10-01T17:02:23.911560] [DEBUG] [LOCAL ] ACR: Primary data saved (5949 records). [2025-10-01T17:02:23.911749] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-01T17:02:23.911877] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACR took 26.3s. Estimated remaining: 3h 59m 3s. Rate: 9.8 symbols/min [2025-10-01T17:02:24.107629] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-01T17:02:24.222868] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:02:24.249969] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T17:02:24.320043] [DEBUG] [LOCAL ] ACVA: Loaded 49249 existing records from primary storage. [2025-10-01T17:02:24.320415] [INFO ] [MAIN ] ACVA: Loaded 49249 existing records. [2025-10-01T17:02:24.519817] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:02:24.520074] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-01T17:02:24.520125] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-01T17:02:24.520388] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-01T17:02:24.520448] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-01T17:02:24.908747] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-01T17:02:24.943575] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:02:25.213077] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T17:02:25.702430] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-01T17:02:26.333500] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T17:02:26.408781] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-01T17:02:26.410360] [INFO ] [REMOTE ] ACP: Full fetch complete (47408 records). [2025-10-01T17:02:26.410489] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-01T17:02:26.511923] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-01T17:02:26.868997] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-01T17:02:26.869087] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-01T17:02:26.869580] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-01T17:02:26.869630] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-01T17:02:26.870974] [DEBUG] [LOCAL ] ACP: Trimmed 47408 records to 30980 (keeping 200 days of data) [2025-10-01T17:02:27.062103] [DEBUG] [LOCAL ] ACP: Primary data saved (30980 records). [2025-10-01T17:02:27.062258] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-01T17:02:27.063487] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACP took 31.2s. Estimated remaining: 3h 54m 8s. Rate: 10.0 symbols/min [2025-10-01T17:02:27.257786] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:02:27.258005] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-01T17:02:27.258053] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-01T17:02:27.258168] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-01T17:02:27.258219] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-01T17:02:27.258309] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-01T17:02:27.258375] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-01T17:02:27.307498] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-01T17:02:27.662181] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:02:27.958315] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T17:02:28.101557] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T17:02:28.110963] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-01T17:02:28.575057] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T17:02:28.902378] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-01T17:02:29.703564] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-01T17:02:29.706156] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T17:02:30.502392] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-01T17:02:31.146449] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T17:02:31.302440] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-01T17:02:31.807792] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T17:02:32.102415] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-01T17:02:32.756025] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T17:02:32.902500] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-01T17:02:32.918869] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T17:02:33.063809] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:02:33.064121] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-01T17:02:33.064211] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:02:33.064261] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-01T17:02:33.064323] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:02:33.064397] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-01T17:02:33.064465] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-01T17:02:33.064540] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-01T17:02:33.064627] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-01T17:02:33.064724] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 6.0s. Estimated remaining: 3h 54m 4s. Rate: 10.0 symbols/min [2025-10-01T17:02:33.290030] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:02:33.341471] [DEBUG] [LOCAL ] ADC: Loaded 46153 existing records from primary storage. [2025-10-01T17:02:33.341814] [INFO ] [MAIN ] ADC: Loaded 46153 existing records. [2025-10-01T17:02:33.596833] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:02:33.597102] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-01T17:02:33.597154] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-01T17:02:33.598370] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-01T17:02:33.598451] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-01T17:02:33.707528] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-01T17:02:34.054053] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:02:34.428882] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T17:02:34.502386] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-01T17:02:35.302417] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-01T17:02:35.864306] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T17:02:36.102400] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-01T17:02:36.533553] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T17:02:36.902415] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-01T17:02:37.422727] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-01T17:02:37.702398] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-01T17:02:37.938188] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T17:02:38.502453] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-01T17:02:38.939103] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T17:02:39.302397] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-01T17:02:40.049766] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T17:02:40.102396] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-01T17:02:40.842740] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T17:02:40.902387] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-01T17:02:41.415823] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T17:02:41.702439] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-01T17:02:42.327070] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T17:02:42.502439] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-01T17:02:43.302380] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-01T17:02:43.368690] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T17:02:43.703747] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-01T17:02:43.779791] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T17:02:44.102401] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-01T17:02:44.902397] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-01T17:02:45.652037] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-01T17:02:45.653256] [INFO ] [REMOTE ] ACRE: Full fetch complete (50725 records). [2025-10-01T17:02:45.653342] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-01T17:02:45.707622] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-01T17:02:46.093973] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-01T17:02:46.094101] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-01T17:02:46.094633] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-01T17:02:46.094729] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-01T17:02:46.096021] [DEBUG] [LOCAL ] ACRE: Trimmed 50725 records to 33578 (keeping 200 days of data) [2025-10-01T17:02:46.324845] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T17:02:46.355491] [DEBUG] [LOCAL ] ACRE: Primary data saved (33578 records). [2025-10-01T17:02:46.355663] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-01T17:02:46.357407] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 38.4s. Estimated remaining: 4h 4m 57s. Rate: 9.6 symbols/min [2025-10-01T17:02:46.507476] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-01T17:02:46.568272] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:02:46.605399] [DEBUG] [LOCAL ] ADCT: Loaded 34480 existing records from primary storage. [2025-10-01T17:02:46.606012] [INFO ] [MAIN ] ADCT: Loaded 34480 existing records. [2025-10-01T17:02:46.838886] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:02:46.839233] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-01T17:02:46.839293] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-01T17:02:46.839627] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-01T17:02:46.839716] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-01T17:02:47.224862] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T17:02:47.267980] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:02:47.302356] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-01T17:02:47.572626] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T17:02:48.102433] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-01T17:02:48.808371] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T17:02:48.902352] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-01T17:02:48.936507] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T17:02:49.702417] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-01T17:02:50.498502] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T17:02:50.507681] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-01T17:02:51.302358] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-01T17:02:51.574068] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T17:02:51.867050] [DEBUG] [REMOTE ] ACV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:02:51.867369] [WARN ] [REMOTE ] ACV: No data returned for month 2025-10 [2025-10-01T17:02:51.867462] [FATAL] [REMOTE ] ACV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:02:51.867558] [FATAL] [MAIN ] ACV: Failed to fetch primary data. [2025-10-01T17:02:51.867665] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:02:51.867755] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-01T17:02:51.867855] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-01T17:02:51.867953] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-01T17:02:51.868566] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-10-01T17:02:51.868703] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 32.0s. Estimated remaining: 4h 3m 45s. Rate: 9.6 symbols/min [2025-10-01T17:02:52.074486] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:02:52.074857] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-01T17:02:52.074918] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-01T17:02:52.075031] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-01T17:02:52.075076] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-01T17:02:52.075202] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-01T17:02:52.075242] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-01T17:02:52.109297] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-01T17:02:52.538264] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:02:52.531358] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T17:02:52.902416] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-01T17:02:53.702375] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-01T17:02:53.736920] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T17:02:54.502390] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-01T17:02:55.028865] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-01T17:02:55.041667] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T17:02:55.302386] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-01T17:02:55.979888] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T17:02:56.102421] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-01T17:02:56.826307] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T17:02:56.902389] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-01T17:02:57.594585] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T17:02:57.702387] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-01T17:02:58.222959] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T17:02:58.502436] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-01T17:02:59.302402] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-01T17:02:59.373320] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T17:02:59.975383] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T17:03:00.102381] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-01T17:03:00.576693] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T17:03:00.902397] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-01T17:03:01.702384] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-01T17:03:01.755481] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T17:03:02.508810] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-01T17:03:02.526566] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T17:03:03.302421] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-01T17:03:03.574596] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T17:03:04.102405] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-01T17:03:04.125425] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-01T17:03:04.127067] [INFO ] [REMOTE ] ACVA: Full fetch complete (70374 records). [2025-10-01T17:03:04.127215] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-01T17:03:04.623908] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-01T17:03:04.624035] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-01T17:03:04.624880] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-01T17:03:04.624951] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-01T17:03:04.626415] [DEBUG] [LOCAL ] ACVA: Trimmed 70374 records to 49250 (keeping 200 days of data) [2025-10-01T17:03:04.906132] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-01T17:03:04.936971] [DEBUG] [LOCAL ] ACVA: Primary data saved (49250 records). [2025-10-01T17:03:04.937736] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-01T17:03:04.942872] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 41.0s. Estimated remaining: 4h 13m 10s. Rate: 9.3 symbols/min [2025-10-01T17:03:05.159287] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:03:05.195169] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T17:03:05.253338] [DEBUG] [LOCAL ] ADNT: Loaded 47238 existing records from primary storage. [2025-10-01T17:03:05.253693] [INFO ] [MAIN ] ADNT: Loaded 47238 existing records. [2025-10-01T17:03:05.456131] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:03:05.456438] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-01T17:03:05.456521] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-01T17:03:05.456988] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-01T17:03:05.457063] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-01T17:03:05.707563] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-01T17:03:05.915858] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:03:05.938730] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-01T17:03:06.205331] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T17:03:06.207201] [INFO ] [REMOTE ] ADC: Full fetch complete (66171 records). [2025-10-01T17:03:06.207334] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-01T17:03:06.515994] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-01T17:03:06.669439] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-01T17:03:06.669599] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-01T17:03:06.670461] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-01T17:03:06.670528] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-01T17:03:06.672139] [DEBUG] [LOCAL ] ADC: Trimmed 66171 records to 46164 (keeping 200 days of data) [2025-10-01T17:03:06.975485] [DEBUG] [LOCAL ] ADC: Primary data saved (46164 records). [2025-10-01T17:03:06.975631] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-01T17:03:06.977024] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 33.9s. Estimated remaining: 4h 7m 5s. Rate: 9.5 symbols/min [2025-10-01T17:03:07.205108] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:03:07.269921] [DEBUG] [LOCAL ] ADT: Loaded 53463 existing records from primary storage. [2025-10-01T17:03:07.270244] [INFO ] [MAIN ] ADT: Loaded 53463 existing records. [2025-10-01T17:03:07.307439] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-01T17:03:07.486242] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:03:07.486577] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-01T17:03:07.486770] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-01T17:03:07.487097] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-01T17:03:07.487169] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-01T17:03:07.884003] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-01T17:03:07.977543] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:03:08.102368] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-01T17:03:08.305685] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T17:03:08.903186] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-01T17:03:08.906664] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T17:03:09.702384] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-01T17:03:09.963729] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T17:03:10.502420] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-01T17:03:10.599820] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T17:03:10.863450] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T17:03:11.302393] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-01T17:03:12.067031] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T17:03:12.102367] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-01T17:03:12.911491] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-01T17:03:12.933043] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T17:03:13.702353] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-01T17:03:13.768877] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T17:03:14.027053] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T17:03:14.502379] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-01T17:03:15.005704] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T17:03:15.302408] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-01T17:03:16.022135] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T17:03:16.102476] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-01T17:03:16.902454] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-01T17:03:17.442838] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-01T17:03:17.468147] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T17:03:17.702435] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-01T17:03:18.502400] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-01T17:03:18.719318] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T17:03:19.160439] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T17:03:19.302374] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-01T17:03:20.025419] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T17:03:20.102429] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-01T17:03:20.902382] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-01T17:03:21.604271] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T17:03:21.606117] [INFO ] [REMOTE ] ADM: Full fetch complete (77241 records). [2025-10-01T17:03:21.606243] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-01T17:03:21.706580] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-01T17:03:22.060417] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-01T17:03:22.060547] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-01T17:03:22.061672] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-01T17:03:22.061845] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-01T17:03:22.100227] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T17:03:22.098269] [DEBUG] [LOCAL ] ADM: Trimmed 77241 records to 53394 (keeping 200 days of data) [2025-10-01T17:03:22.294003] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T17:03:22.511052] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-01T17:03:22.541190] [DEBUG] [LOCAL ] ADM: Primary data saved (53394 records). [2025-10-01T17:03:22.541550] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-01T17:03:22.541661] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADM took 30.7s. Estimated remaining: 4h 18m 59s. Rate: 9.0 symbols/min [2025-10-01T17:03:22.736444] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:03:22.764956] [DEBUG] [LOCAL ] ADX: Loaded 27514 existing records from primary storage. [2025-10-01T17:03:22.765225] [INFO ] [MAIN ] ADX: Loaded 27514 existing records. [2025-10-01T17:03:22.959599] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:03:22.959860] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-01T17:03:22.959919] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-01T17:03:22.960216] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-01T17:03:22.960276] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-01T17:03:23.308889] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-01T17:03:23.318609] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-01T17:03:23.327448] [INFO ] [REMOTE ] ADCT: Full fetch complete (51504 records). [2025-10-01T17:03:23.338098] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-01T17:03:23.518757] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:03:23.876548] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-01T17:03:23.876693] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-01T17:03:23.877327] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-01T17:03:23.877384] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-01T17:03:23.878543] [DEBUG] [LOCAL ] ADCT: Trimmed 51504 records to 34581 (keeping 200 days of data) [2025-10-01T17:03:24.093740] [DEBUG] [LOCAL ] ADCT: Primary data saved (34581 records). [2025-10-01T17:03:24.093895] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-01T17:03:24.094947] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADCT took 37.7s. Estimated remaining: 4h 12m 28s. Rate: 9.3 symbols/min [2025-10-01T17:03:24.111742] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-01T17:03:24.339064] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T17:03:24.342967] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:03:24.416480] [DEBUG] [LOCAL ] AEE: Loaded 50091 existing records from primary storage. [2025-10-01T17:03:24.416990] [INFO ] [MAIN ] AEE: Loaded 50091 existing records. [2025-10-01T17:03:24.652191] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:03:24.652413] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-01T17:03:24.652470] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-01T17:03:24.652833] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-01T17:03:24.652899] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-01T17:03:24.907691] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-01T17:03:25.070907] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:03:25.190061] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T17:03:25.255019] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T17:03:25.702392] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-01T17:03:26.502442] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-01T17:03:26.589363] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T17:03:27.302424] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-01T17:03:27.528496] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T17:03:27.919155] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:03:28.102433] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-01T17:03:28.409279] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T17:03:28.902463] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-01T17:03:29.182738] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T17:03:29.702426] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-01T17:03:30.215715] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T17:03:30.502385] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-01T17:03:30.880496] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-01T17:03:31.302420] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-01T17:03:32.106379] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-01T17:03:32.110678] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T17:03:32.402350] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T17:03:32.902433] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-01T17:03:33.508091] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T17:03:33.702404] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-01T17:03:33.871527] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T17:03:34.502376] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-01T17:03:35.302432] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-01T17:03:35.430340] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T17:03:35.995846] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T17:03:36.102403] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-01T17:03:36.346103] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T17:03:36.902395] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-01T17:03:37.491989] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T17:03:37.702407] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-01T17:03:38.502356] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-01T17:03:38.709336] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T17:03:39.286545] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T17:03:39.302336] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-01T17:03:39.646421] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T17:03:40.102437] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-01T17:03:40.868535] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T17:03:40.870554] [INFO ] [REMOTE ] ADNT: Full fetch complete (67936 records). [2025-10-01T17:03:40.870801] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-01T17:03:40.909552] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-01T17:03:41.334162] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-01T17:03:41.334335] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-01T17:03:41.335104] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-01T17:03:41.335184] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-01T17:03:41.337151] [DEBUG] [LOCAL ] ADNT: Trimmed 67936 records to 47202 (keeping 200 days of data) [2025-10-01T17:03:41.623726] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T17:03:41.702554] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-01T17:03:41.706301] [DEBUG] [LOCAL ] ADNT: Primary data saved (47202 records). [2025-10-01T17:03:41.706422] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-01T17:03:41.707563] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 36.8s. Estimated remaining: 4h 25m 56s. Rate: 8.8 symbols/min [2025-10-01T17:03:41.907624] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:03:41.920426] [DEBUG] [LOCAL ] AEFC: Loaded 8535 existing records from primary storage. [2025-10-01T17:03:41.920823] [INFO ] [MAIN ] AEFC: Loaded 8535 existing records. [2025-10-01T17:03:42.128719] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:03:42.129055] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-01T17:03:42.129193] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-01T17:03:42.129788] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-01T17:03:42.129860] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-01T17:03:42.359595] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T17:03:42.507482] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-01T17:03:42.585097] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:03:43.302358] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-01T17:03:43.468964] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T17:03:44.102414] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-01T17:03:44.481999] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T17:03:44.555013] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T17:03:44.908512] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-01T17:03:44.915252] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T17:03:45.702429] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-01T17:03:46.143181] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T17:03:46.502466] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-01T17:03:47.097825] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T17:03:47.302365] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-01T17:03:47.432102] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T17:03:48.023861] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T17:03:48.102428] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-01T17:03:48.902470] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-01T17:03:49.660870] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-01T17:03:49.702419] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-01T17:03:50.129289] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-01T17:03:50.135143] [INFO ] [REMOTE ] ADT: Full fetch complete (77194 records). [2025-10-01T17:03:50.135298] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-01T17:03:50.517963] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-01T17:03:50.606761] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T17:03:50.607293] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-01T17:03:50.611116] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-01T17:03:50.612624] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-01T17:03:50.612753] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-01T17:03:50.615025] [DEBUG] [LOCAL ] ADT: Trimmed 77194 records to 53455 (keeping 200 days of data) [2025-10-01T17:03:50.979778] [DEBUG] [LOCAL ] ADT: Primary data saved (53455 records). [2025-10-01T17:03:50.979932] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-01T17:03:50.981615] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADT took 44.0s. Estimated remaining: 4h 28m 43s. Rate: 8.7 symbols/min [2025-10-01T17:03:51.173431] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:03:51.229004] [DEBUG] [LOCAL ] AEG: Loaded 49547 existing records from primary storage. [2025-10-01T17:03:51.229398] [INFO ] [MAIN ] AEG: Loaded 49547 existing records. [2025-10-01T17:03:51.312227] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-01T17:03:51.438186] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:03:51.438427] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-01T17:03:51.438477] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-01T17:03:51.438910] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-01T17:03:51.438970] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-01T17:03:51.866605] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:03:51.894389] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T17:03:51.915361] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T17:03:52.102438] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-01T17:03:52.902395] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-01T17:03:53.037846] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T17:03:53.702421] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-01T17:03:54.263229] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T17:03:54.265678] [INFO ] [REMOTE ] ADX: Full fetch complete (42002 records). [2025-10-01T17:03:54.265834] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-01T17:03:54.507663] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-01T17:03:54.730013] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-01T17:03:54.730095] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-01T17:03:54.730820] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-01T17:03:54.730887] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-01T17:03:54.731944] [DEBUG] [LOCAL ] ADX: Trimmed 42002 records to 27468 (keeping 200 days of data) [2025-10-01T17:03:54.919787] [DEBUG] [LOCAL ] ADX: Primary data saved (27468 records). [2025-10-01T17:03:54.919984] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-01T17:03:54.920122] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADX took 32.4s. Estimated remaining: 4h 25m 13s. Rate: 8.8 symbols/min [2025-10-01T17:03:55.111268] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:03:55.175572] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-10-01T17:03:55.175944] [INFO ] [MAIN ] AEM: Loaded 53464 existing records. [2025-10-01T17:03:55.307580] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-01T17:03:55.381741] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:03:55.382086] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-01T17:03:55.382253] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-01T17:03:55.382779] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-01T17:03:55.382841] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-01T17:03:55.871026] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:03:55.873154] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-01T17:03:55.891127] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T17:03:55.923872] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:03:56.102405] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-01T17:03:56.669017] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T17:03:56.902387] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-01T17:03:57.702388] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-01T17:03:58.115869] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T17:03:58.339384] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T17:03:58.502431] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-01T17:03:59.302411] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-01T17:03:59.830168] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T17:04:00.102431] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-01T17:04:00.822277] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T17:04:00.902427] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-01T17:04:00.949588] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T17:04:00.950424] [INFO ] [REMOTE ] AEFC: Full fetch complete (12211 records). [2025-10-01T17:04:00.950501] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-01T17:04:01.420885] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-01T17:04:01.421031] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-01T17:04:01.421381] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-01T17:04:01.421457] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-01T17:04:01.422521] [DEBUG] [LOCAL ] AEFC: Trimmed 12211 records to 8514 (keeping 200 days of data) [2025-10-01T17:04:01.487143] [DEBUG] [LOCAL ] AEFC: Primary data saved (8514 records). [2025-10-01T17:04:01.487304] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-01T17:04:01.487393] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 19.8s. Estimated remaining: 4h 24m 50s. Rate: 8.8 symbols/min [2025-10-01T17:04:01.705097] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-01T17:04:01.733678] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:01.803243] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-10-01T17:04:01.803610] [INFO ] [MAIN ] AEO: Loaded 53557 existing records. [2025-10-01T17:04:02.011239] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:04:02.011488] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-01T17:04:02.011554] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-01T17:04:02.011991] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-01T17:04:02.012113] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-01T17:04:02.434928] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:02.502558] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-01T17:04:02.908749] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T17:04:03.025463] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-01T17:04:03.028418] [INFO ] [REMOTE ] AEE: Full fetch complete (72603 records). [2025-10-01T17:04:03.028590] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-01T17:04:03.307824] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-01T17:04:03.479302] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-01T17:04:03.479440] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-01T17:04:03.480220] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-01T17:04:03.480287] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-01T17:04:03.481871] [DEBUG] [LOCAL ] AEE: Trimmed 72603 records to 50091 (keeping 200 days of data) [2025-10-01T17:04:03.815568] [DEBUG] [LOCAL ] AEE: Primary data saved (50091 records). [2025-10-01T17:04:03.815727] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-01T17:04:03.816463] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 39.7s. Estimated remaining: 4h 19m 53s. Rate: 9.0 symbols/min [2025-10-01T17:04:04.014187] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:04.048161] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T17:04:04.106671] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-01T17:04:04.108406] [DEBUG] [LOCAL ] AER: Loaded 48382 existing records from primary storage. [2025-10-01T17:04:04.108767] [INFO ] [MAIN ] AER: Loaded 48382 existing records. [2025-10-01T17:04:04.320846] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:04:04.321123] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-01T17:04:04.321177] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-01T17:04:04.321743] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-01T17:04:04.321820] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-01T17:04:04.781233] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:04.902355] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-01T17:04:04.981505] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T17:04:05.702393] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-01T17:04:06.103719] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-01T17:04:06.502392] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-01T17:04:06.810729] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T17:04:06.953062] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T17:04:07.302379] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-01T17:04:08.029008] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T17:04:08.102463] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-01T17:04:08.824895] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T17:04:08.902429] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-01T17:04:09.601937] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T17:04:09.702398] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-01T17:04:10.502345] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T17:04:10.502425] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-01T17:04:11.302399] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-01T17:04:11.655447] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-01T17:04:12.010116] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T17:04:12.102418] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-01T17:04:12.870102] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T17:04:12.902367] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-01T17:04:13.702399] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-01T17:04:13.908856] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T17:04:14.395015] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T17:04:14.502383] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-01T17:04:15.114481] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T17:04:15.302435] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-01T17:04:16.102448] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-01T17:04:16.740412] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-01T17:04:16.902387] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-01T17:04:17.165583] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T17:04:17.702399] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-01T17:04:17.898128] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T17:04:18.502393] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-01T17:04:19.142181] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T17:04:19.184235] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-01T17:04:19.302427] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-01T17:04:20.102391] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-01T17:04:20.363916] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T17:04:20.901965] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T17:04:20.913374] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-01T17:04:21.702400] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-01T17:04:21.940009] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T17:04:22.502442] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-01T17:04:22.795238] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T17:04:23.016786] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T17:04:23.302384] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-01T17:04:23.926612] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T17:04:24.102439] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-01T17:04:24.902396] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-01T17:04:25.506582] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-01T17:04:25.508169] [INFO ] [REMOTE ] AEG: Full fetch complete (70341 records). [2025-10-01T17:04:25.508311] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-01T17:04:25.703689] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-01T17:04:25.903149] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T17:04:26.016403] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-01T17:04:26.016502] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-01T17:04:26.017227] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-01T17:04:26.017321] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-01T17:04:26.018968] [DEBUG] [LOCAL ] AEG: Trimmed 70341 records to 49557 (keeping 200 days of data) [2025-10-01T17:04:26.327435] [DEBUG] [LOCAL ] AEG: Primary data saved (49557 records). [2025-10-01T17:04:26.327591] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-01T17:04:26.328557] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 35.3s. Estimated remaining: 4h 36m 25s. Rate: 8.4 symbols/min [2025-10-01T17:04:26.502432] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-01T17:04:26.645919] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T17:04:27.302387] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-01T17:04:27.710342] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-01T17:04:27.908509] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T17:04:28.102391] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-01T17:04:28.902374] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-01T17:04:29.392663] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-01T17:04:29.702503] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-01T17:04:30.113992] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-01T17:04:30.306171] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T17:04:30.502413] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-01T17:04:31.302383] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-01T17:04:31.564434] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T17:04:32.102357] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-01T17:04:32.236063] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T17:04:32.902397] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-01T17:04:34.095239] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-01T17:04:34.097389] [INFO ] [REMOTE ] AEM: Full fetch complete (77154 records). [2025-10-01T17:04:34.097507] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-01T17:04:34.486320] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-01T17:04:34.553907] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-01T17:04:34.615803] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-01T17:04:34.615910] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-01T17:04:34.616684] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-01T17:04:34.616769] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-01T17:04:34.618394] [DEBUG] [LOCAL ] AEM: Trimmed 77154 records to 53463 (keeping 200 days of data) [2025-10-01T17:04:34.859151] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-01T17:04:34.865826] [INFO ] [REMOTE ] AER: Full fetch complete (69568 records). [2025-10-01T17:04:34.867072] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-01T17:04:35.348002] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-01T17:04:35.348417] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-01T17:04:35.350288] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-01T17:04:35.350388] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-01T17:04:35.356236] [DEBUG] [LOCAL ] AER: Trimmed 69568 records to 48362 (keeping 200 days of data) [2025-10-01T17:04:35.581102] [DEBUG] [LOCAL ] AEM: Primary data saved (53463 records). [2025-10-01T17:04:35.584977] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-01T17:04:35.586815] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 40.7s. Estimated remaining: 4h 38m 30s. Rate: 8.4 symbols/min [2025-10-01T17:04:35.790312] [DEBUG] [LOCAL ] AER: Primary data saved (48362 records). [2025-10-01T17:04:35.790468] [INFO ] [MAIN ] AER: Full history saved. [2025-10-01T17:04:35.791535] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 32.0s. Estimated remaining: 4h 31m 27s. Rate: 8.6 symbols/min [2025-10-01T17:04:37.310980] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-01T17:04:37.312696] [INFO ] [REMOTE ] AEO: Full fetch complete (77444 records). [2025-10-01T17:04:37.312823] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-01T17:04:37.775465] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-01T17:04:37.775567] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-01T17:04:37.776372] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-01T17:04:37.776441] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-01T17:04:37.778151] [DEBUG] [LOCAL ] AEO: Trimmed 77444 records to 53557 (keeping 200 days of data) [2025-10-01T17:04:38.147451] [DEBUG] [LOCAL ] AEO: Primary data saved (53557 records). [2025-10-01T17:04:38.147621] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-01T17:04:38.148761] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 36.7s. Estimated remaining: 4h 26m 50s. Rate: 8.7 symbols/min [2025-10-01T17:04:38.977966] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:38.970431] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:38.979192] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:39.003039] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-01T17:04:39.003360] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-01T17:04:39.003767] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-01T17:04:39.003950] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-01T17:04:39.004041] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-01T17:04:39.004109] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-01T17:04:39.002844] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:39.129554] [DEBUG] [LOCAL ] AFB: Loaded 11253 existing records from primary storage. [2025-10-01T17:04:39.146202] [INFO ] [MAIN ] AFB: Loaded 11253 existing records. [2025-10-01T17:04:39.581228] [DEBUG] [LOCAL ] AESI: Loaded 49451 existing records from primary storage. [2025-10-01T17:04:39.620891] [INFO ] [MAIN ] AESI: Loaded 49451 existing records. [2025-10-01T17:04:39.615524] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:04:39.632861] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-10-01T17:04:39.621321] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-01T17:04:39.681357] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-01T17:04:39.687995] [INFO ] [MAIN ] AES: Loaded 53670 existing records. [2025-10-01T17:04:39.701822] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-01T17:04:39.749065] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-01T17:04:39.742867] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:39.853591] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-01T17:04:40.160620] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:04:40.236002] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:04:40.310278] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-01T17:04:40.310529] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-01T17:04:40.304900] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:04:40.310727] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-01T17:04:40.323764] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-01T17:04:40.317926] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-01T17:04:40.317714] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:04:40.359459] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-01T17:04:40.359281] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-01T17:04:40.359718] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-01T17:04:40.384819] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-01T17:04:40.411994] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-01T17:04:40.412113] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:04:40.444605] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-01T17:04:40.501337] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-01T17:04:40.540531] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-01T17:04:40.571738] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-01T17:04:40.602864] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.4s. Estimated remaining: 4h 22m 33s. Rate: 8.9 symbols/min [2025-10-01T17:04:41.083505] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:41.208693] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-01T17:04:41.423397] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:41.584848] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:41.612131] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:41.612434] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-01T17:04:41.605127] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-01T17:04:41.643695] [DEBUG] [LOCAL ] AFG: Loaded 32433 existing records from primary storage. [2025-10-01T17:04:41.643990] [INFO ] [MAIN ] AFG: Loaded 32433 existing records. [2025-10-01T17:04:41.848836] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:04:41.849065] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-01T17:04:41.849116] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-01T17:04:41.849402] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-01T17:04:41.849462] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-01T17:04:42.256431] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:42.257269] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-01T17:04:42.272030] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T17:04:42.275155] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-01T17:04:42.824511] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T17:04:42.833913] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-01T17:04:43.117565] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T17:04:43.120750] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-01T17:04:43.296271] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T17:04:43.301891] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-01T17:04:43.553868] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T17:04:43.565192] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-01T17:04:43.605277] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T17:04:43.608327] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-01T17:04:44.413626] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T17:04:44.423778] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-01T17:04:44.441074] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T17:04:44.446770] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-01T17:04:44.481721] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T17:04:44.902402] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-01T17:04:45.160597] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T17:04:45.574311] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T17:04:45.702417] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-01T17:04:45.748720] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T17:04:45.874281] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T17:04:46.502430] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-01T17:04:47.172996] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T17:04:47.173309] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T17:04:47.302375] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-01T17:04:48.102416] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-01T17:04:48.157112] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T17:04:48.902405] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-01T17:04:49.528301] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T17:04:49.702359] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-01T17:04:50.300935] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T17:04:50.502362] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-01T17:04:50.700241] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T17:04:51.302423] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-01T17:04:51.417570] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T17:04:52.102419] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-01T17:04:52.902405] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-01T17:04:52.989409] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T17:04:53.702357] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-01T17:04:53.759257] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T17:04:53.803963] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T17:04:54.502380] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-01T17:04:55.302379] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-01T17:04:55.367411] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T17:04:55.812132] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T17:04:56.102385] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-01T17:04:56.159300] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T17:04:56.160253] [INFO ] [REMOTE ] AFB: Full fetch complete (16614 records). [2025-10-01T17:04:56.160330] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-01T17:04:56.567385] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-01T17:04:56.567491] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-01T17:04:56.567793] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-01T17:04:56.567866] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-01T17:04:56.568707] [DEBUG] [LOCAL ] AFB: Trimmed 16614 records to 11341 (keeping 200 days of data) [2025-10-01T17:04:56.643050] [DEBUG] [LOCAL ] AFB: Primary data saved (11341 records). [2025-10-01T17:04:56.643193] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-01T17:04:56.643289] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 18.5s. Estimated remaining: 4h 31m 0s. Rate: 8.6 symbols/min [2025-10-01T17:04:56.834637] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:04:56.834895] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-01T17:04:56.834941] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-01T17:04:56.835056] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-01T17:04:56.835099] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-01T17:04:56.835144] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-01T17:04:56.835177] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-01T17:04:56.913243] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-01T17:04:57.243831] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:04:57.479596] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T17:04:57.702376] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-01T17:04:58.502354] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-01T17:04:58.738846] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T17:04:58.781835] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T17:04:59.302389] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-01T17:04:59.805081] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T17:05:00.102470] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-01T17:05:00.902402] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-01T17:05:01.197149] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T17:05:01.394909] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T17:05:01.509011] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T17:05:01.702382] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-01T17:05:02.089297] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-01T17:05:02.502441] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-01T17:05:03.302427] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-01T17:05:04.025627] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T17:05:04.102403] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-01T17:05:04.902405] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-01T17:05:05.186239] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T17:05:05.265428] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-01T17:05:05.344322] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-01T17:05:05.702444] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-01T17:05:06.502429] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-01T17:05:06.944444] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-01T17:05:07.130787] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T17:05:07.302420] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-01T17:05:08.102431] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-01T17:05:08.450127] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-01T17:05:08.722260] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T17:05:08.902423] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-01T17:05:09.392387] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T17:05:09.702394] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-01T17:05:10.502433] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-01T17:05:11.302433] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-01T17:05:12.064370] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-01T17:05:12.065974] [INFO ] [REMOTE ] AESI: Full fetch complete (70418 records). [2025-10-01T17:05:12.066122] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-01T17:05:12.113837] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-01T17:05:12.386963] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-01T17:05:12.431344] [INFO ] [REMOTE ] AFG: Full fetch complete (45949 records). [2025-10-01T17:05:12.434626] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-01T17:05:12.703890] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T17:05:12.721833] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-01T17:05:12.744930] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-01T17:05:12.748290] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-01T17:05:12.763697] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-01T17:05:12.882180] [DEBUG] [LOCAL ] AESI: Trimmed 70418 records to 49476 (keeping 200 days of data) [2025-10-01T17:05:12.902363] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-01T17:05:13.101698] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-01T17:05:13.102187] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-01T17:05:13.103550] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-01T17:05:13.103960] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-01T17:05:13.108489] [DEBUG] [LOCAL ] AFG: Trimmed 45949 records to 32410 (keeping 200 days of data) [2025-10-01T17:05:13.325725] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-01T17:05:13.356131] [DEBUG] [LOCAL ] AFG: Primary data saved (32410 records). [2025-10-01T17:05:13.356745] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-01T17:05:13.357220] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AFG took 32.7s. Estimated remaining: 4h 39m 40s. Rate: 8.3 symbols/min [2025-10-01T17:05:13.484624] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-01T17:05:13.702382] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:05:13.702917] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-01T17:05:13.711182] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-10-01T17:05:13.715663] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-10-01T17:05:13.717523] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-01T17:05:13.718026] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-01T17:05:13.719789] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-01T17:05:13.720405] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-01T17:05:14.057689] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-01T17:05:14.154413] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:05:14.216044] [DEBUG] [LOCAL ] AESI: Primary data saved (49476 records). [2025-10-01T17:05:14.216221] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-01T17:05:14.216395] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AESI took 36.1s. Estimated remaining: 4h 33m 57s. Rate: 8.5 symbols/min [2025-10-01T17:05:14.412504] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:05:14.416588] [DEBUG] [LOCAL ] AFGD: Loaded 1830 existing records from primary storage. [2025-10-01T17:05:14.416830] [INFO ] [MAIN ] AFGD: Loaded 1830 existing records. [2025-10-01T17:05:14.507552] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-01T17:05:14.617022] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:05:14.617277] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-01T17:05:14.617334] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-01T17:05:14.617580] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-01T17:05:14.617675] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-01T17:05:15.003808] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:05:15.302399] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-01T17:05:15.699962] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-01T17:05:16.102424] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-01T17:05:16.636917] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-01T17:05:16.850153] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-01T17:05:16.902388] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-01T17:05:17.182716] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-01T17:05:17.702389] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-01T17:05:18.403468] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-01T17:05:18.502426] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-01T17:05:18.839602] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-01T17:05:19.302419] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-01T17:05:19.806193] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-01T17:05:20.102387] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-01T17:05:20.713784] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T17:05:20.902384] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-01T17:05:21.362361] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T17:05:21.702435] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-01T17:05:22.502411] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-01T17:05:22.966620] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T17:05:23.302416] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-01T17:05:23.611461] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T17:05:23.811995] [DEBUG] [REMOTE ] AFGB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:05:23.812399] [WARN ] [REMOTE ] AFGB: No data returned for month 2025-10 [2025-10-01T17:05:23.812992] [FATAL] [REMOTE ] AFGB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:05:23.813101] [FATAL] [MAIN ] AFGB: Failed to fetch primary data. [2025-10-01T17:05:23.813172] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:05:23.813247] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-01T17:05:23.813329] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-01T17:05:23.813387] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-01T17:05:23.813448] [DEBUG] [LOCAL ] AFGB: No derivative data file found to delete. [2025-10-01T17:05:23.813520] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFGB took 27.2s. Estimated remaining: 4h 36m 1s. Rate: 8.4 symbols/min [2025-10-01T17:05:24.008341] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:05:24.008574] [DEBUG] [LOCAL ] AFGE: No existing data file found in primary storage. [2025-10-01T17:05:24.008636] [WARN ] [MAIN ] AFGE: No existing data found, performing full refresh instead. [2025-10-01T17:05:24.008809] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-01T17:05:24.008885] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-01T17:05:24.008949] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-10-01T17:05:24.008987] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-01T17:05:24.107577] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-01T17:05:24.468559] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:05:24.902410] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-01T17:05:25.292415] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-01T17:05:25.702385] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-01T17:05:25.952886] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-01T17:05:26.080755] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-01T17:05:26.502426] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-01T17:05:26.806148] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-01T17:05:27.302388] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-01T17:05:27.668480] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-01T17:05:28.102431] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-01T17:05:28.902383] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-01T17:05:29.520147] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-01T17:05:29.702405] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-01T17:05:30.021983] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-01T17:05:30.502383] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-01T17:05:30.827733] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-01T17:05:30.829596] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-01T17:05:30.829772] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-01T17:05:31.031802] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T17:05:31.269899] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-01T17:05:31.269993] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-01T17:05:31.270793] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-01T17:05:31.270862] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-01T17:05:31.272434] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53670 (keeping 200 days of data) [2025-10-01T17:05:31.334149] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-01T17:05:31.640088] [DEBUG] [LOCAL ] AES: Primary data saved (53670 records). [2025-10-01T17:05:31.640258] [INFO ] [MAIN ] AES: Full history saved. [2025-10-01T17:05:31.643356] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AES took 53.5s. Estimated remaining: 4h 36m 30s. Rate: 8.4 symbols/min [2025-10-01T17:05:31.821447] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-01T17:05:31.860754] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:05:31.935737] [DEBUG] [LOCAL ] AFL: Loaded 53145 existing records from primary storage. [2025-10-01T17:05:31.936102] [INFO ] [MAIN ] AFL: Loaded 53145 existing records. [2025-10-01T17:05:32.107579] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-01T17:05:32.188675] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:05:32.188960] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-01T17:05:32.189048] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-01T17:05:32.189593] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-01T17:05:32.189727] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-01T17:05:32.619949] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:05:32.723953] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T17:05:32.902403] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-01T17:05:33.507262] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T17:05:33.702395] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-01T17:05:34.128968] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T17:05:34.502441] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-01T17:05:34.978820] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T17:05:35.302400] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-01T17:05:35.705060] [DEBUG] [REMOTE ] AFGD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:05:35.705368] [WARN ] [REMOTE ] AFGD: No data returned for month 2025-10 [2025-10-01T17:05:35.705462] [FATAL] [REMOTE ] AFGD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:05:35.705547] [FATAL] [MAIN ] AFGD: Failed to fetch primary data. [2025-10-01T17:05:35.705589] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:05:35.705673] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-01T17:05:35.705758] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-01T17:05:35.705798] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-01T17:05:35.706376] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-10-01T17:05:35.706465] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 21.5s. Estimated remaining: 4h 33m 51s. Rate: 8.5 symbols/min [2025-10-01T17:05:35.893010] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:05:35.893181] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-10-01T17:05:35.893223] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-10-01T17:05:35.893342] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-01T17:05:35.893388] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-01T17:05:35.893432] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-01T17:05:35.893467] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-01T17:05:36.107536] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-01T17:05:36.302140] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:05:36.734101] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T17:05:36.902390] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-01T17:05:37.702420] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-01T17:05:38.028898] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-01T17:05:38.502403] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-01T17:05:38.769917] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T17:05:38.995449] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T17:05:39.302408] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-01T17:05:40.102379] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-01T17:05:40.902407] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-01T17:05:40.943166] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T17:05:41.574959] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T17:05:41.577300] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T17:05:41.702361] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-01T17:05:42.502391] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-01T17:05:42.897762] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-01T17:05:43.302395] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-01T17:05:43.510778] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T17:05:44.102387] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-01T17:05:44.795045] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T17:05:44.902396] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-01T17:05:45.225122] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T17:05:45.702402] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-01T17:05:45.793200] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T17:05:46.098108] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-01T17:05:46.502396] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-01T17:05:47.088503] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-01T17:05:47.089232] [INFO ] [REMOTE ] AFGC: Full fetch complete (3740 records). [2025-10-01T17:05:47.089304] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-01T17:05:47.310746] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-01T17:05:47.496064] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-01T17:05:47.496164] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-01T17:05:47.496306] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-01T17:05:47.496348] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-01T17:05:47.496788] [DEBUG] [LOCAL ] AFGC: Trimmed 3740 records to 2555 (keeping 200 days of data) [2025-10-01T17:05:47.513916] [DEBUG] [LOCAL ] AFGC: Primary data saved (2555 records). [2025-10-01T17:05:47.514071] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-01T17:05:47.514196] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 34.2s. Estimated remaining: 4h 37m 33s. Rate: 8.4 symbols/min [2025-10-01T17:05:47.737562] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:05:47.782986] [DEBUG] [LOCAL ] AGCO: Loaded 42360 existing records from primary storage. [2025-10-01T17:05:47.783396] [INFO ] [MAIN ] AGCO: Loaded 42360 existing records. [2025-10-01T17:05:47.902127] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T17:05:47.988663] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:05:47.988941] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-01T17:05:47.988992] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-01T17:05:47.989684] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-01T17:05:47.989746] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-01T17:05:48.107464] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-01T17:05:48.384674] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:05:48.822531] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T17:05:48.902380] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-01T17:05:49.702393] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-01T17:05:50.502385] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-01T17:05:50.769789] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T17:05:50.923578] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T17:05:51.302376] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-01T17:05:51.755004] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T17:05:52.102391] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-01T17:05:52.831137] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-01T17:05:52.831851] [INFO ] [REMOTE ] AFGE: Full fetch complete (3478 records). [2025-10-01T17:05:52.831924] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-01T17:05:52.907466] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-01T17:05:53.252874] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-01T17:05:53.253013] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-01T17:05:53.253247] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-01T17:05:53.253948] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-01T17:05:53.254556] [DEBUG] [LOCAL ] AFGE: Trimmed 3478 records to 2457 (keeping 200 days of data) [2025-10-01T17:05:53.299323] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-01T17:05:53.311171] [DEBUG] [LOCAL ] AFGE: Primary data saved (2457 records). [2025-10-01T17:05:53.311307] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-01T17:05:53.311409] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 29.5s. Estimated remaining: 4h 36m 21s. Rate: 8.4 symbols/min [2025-10-01T17:05:53.505999] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:05:53.529733] [DEBUG] [LOCAL ] AGD: Loaded 17925 existing records from primary storage. [2025-10-01T17:05:53.530018] [INFO ] [MAIN ] AGD: Loaded 17925 existing records. [2025-10-01T17:05:53.707525] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-01T17:05:53.799274] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:05:53.799526] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-01T17:05:53.799586] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-01T17:05:53.799914] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-01T17:05:53.799987] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-01T17:05:54.253813] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:05:54.502345] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-01T17:05:54.564725] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T17:05:55.302357] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-01T17:05:55.405748] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T17:05:55.626930] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T17:05:56.102377] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-01T17:05:56.902357] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-01T17:05:57.102541] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T17:05:57.340428] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T17:05:57.702382] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-01T17:05:58.322166] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T17:05:58.350211] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T17:05:58.502382] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-01T17:05:59.219353] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T17:05:59.302380] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-01T17:06:00.102372] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-01T17:06:00.902369] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-01T17:06:01.106809] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T17:06:01.702388] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-01T17:06:01.971768] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T17:06:02.502403] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-01T17:06:02.742438] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T17:06:03.103857] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T17:06:03.302407] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-01T17:06:03.384255] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T17:06:04.102455] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-01T17:06:04.825084] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T17:06:04.902370] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-01T17:06:05.049967] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T17:06:05.702432] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-01T17:06:06.502472] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-01T17:06:07.109633] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-01T17:06:07.302430] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-01T17:06:07.619284] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T17:06:07.785749] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-01T17:06:08.102420] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-01T17:06:08.810384] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T17:06:08.902383] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-01T17:06:09.702425] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-01T17:06:09.963608] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T17:06:10.502441] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-01T17:06:10.849559] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T17:06:10.976379] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T17:06:11.302429] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-01T17:06:12.030926] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T17:06:12.102386] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-01T17:06:12.530154] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T17:06:12.902415] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-01T17:06:13.702391] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-01T17:06:14.273364] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T17:06:14.421589] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-01T17:06:14.423778] [INFO ] [REMOTE ] AFL: Full fetch complete (76915 records). [2025-10-01T17:06:14.423896] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-01T17:06:14.511495] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-01T17:06:14.882197] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-01T17:06:14.882295] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-01T17:06:14.883118] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-01T17:06:14.883188] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-01T17:06:14.885174] [DEBUG] [LOCAL ] AFL: Trimmed 76915 records to 53146 (keeping 200 days of data) [2025-10-01T17:06:15.239232] [DEBUG] [LOCAL ] AFL: Primary data saved (53146 records). [2025-10-01T17:06:15.239363] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-01T17:06:15.239450] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 43.6s. Estimated remaining: 4h 47m 40s. Rate: 8.1 symbols/min [2025-10-01T17:06:15.307523] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-01T17:06:15.442763] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:06:15.499007] [DEBUG] [LOCAL ] AGI: Loaded 53414 existing records from primary storage. [2025-10-01T17:06:15.499405] [INFO ] [MAIN ] AGI: Loaded 53414 existing records. [2025-10-01T17:06:15.712194] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:06:15.712469] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-01T17:06:15.712523] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-01T17:06:15.713215] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-01T17:06:15.713309] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-01T17:06:16.126469] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:06:16.126985] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-01T17:06:16.185018] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T17:06:16.418824] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T17:06:16.902408] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-01T17:06:17.073614] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (3.37 seconds). [2025-10-01T17:06:17.076484] [INFO ] [REMOTE ] AG: Full fetch complete (77605 records). [2025-10-01T17:06:17.076628] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-01T17:06:17.540720] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-01T17:06:17.540843] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-01T17:06:17.541707] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-01T17:06:17.541775] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-01T17:06:17.543639] [DEBUG] [LOCAL ] AG: Trimmed 77605 records to 53643 (keeping 200 days of data) [2025-10-01T17:06:17.742004] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-01T17:06:17.927534] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-01T17:06:17.961219] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-01T17:06:17.961362] [INFO ] [MAIN ] AG: Full history saved. [2025-10-01T17:06:17.961439] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AG took 42.3s. Estimated remaining: 4h 43m 58s. Rate: 8.2 symbols/min [2025-10-01T17:06:18.160376] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:06:18.160677] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-10-01T17:06:18.160929] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-10-01T17:06:18.161075] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-01T17:06:18.161146] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-01T17:06:18.161205] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-01T17:06:18.161242] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-01T17:06:18.515559] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-01T17:06:18.540972] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T17:06:18.640933] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:06:18.785449] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T17:06:19.302411] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-01T17:06:19.832542] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T17:06:20.102385] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-01T17:06:20.392596] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T17:06:20.902424] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-01T17:06:21.629622] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T17:06:21.702410] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-01T17:06:22.502370] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-01T17:06:22.503937] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T17:06:23.021438] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T17:06:23.302401] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-01T17:06:23.814840] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T17:06:23.816072] [INFO ] [REMOTE ] AGD: Full fetch complete (25555 records). [2025-10-01T17:06:23.816147] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-01T17:06:24.107573] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-01T17:06:24.220417] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-01T17:06:24.220500] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-01T17:06:24.220844] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-01T17:06:24.220906] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-01T17:06:24.221606] [DEBUG] [LOCAL ] AGD: Trimmed 25555 records to 18028 (keeping 200 days of data) [2025-10-01T17:06:24.348549] [DEBUG] [LOCAL ] AGD: Primary data saved (18028 records). [2025-10-01T17:06:24.348716] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-01T17:06:24.348809] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 31.0s. Estimated remaining: 4h 43m 8s. Rate: 8.2 symbols/min [2025-10-01T17:06:24.547106] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:06:24.558436] [DEBUG] [LOCAL ] AGM: Loaded 10121 existing records from primary storage. [2025-10-01T17:06:24.558696] [INFO ] [MAIN ] AGM: Loaded 10121 existing records. [2025-10-01T17:06:24.751750] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:06:24.751948] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-01T17:06:24.751995] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-01T17:06:24.752317] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-01T17:06:24.752376] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-01T17:06:24.910234] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-01T17:06:25.171597] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:06:25.201344] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T17:06:25.702417] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-01T17:06:26.203451] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T17:06:26.205034] [INFO ] [REMOTE ] AGCO: Full fetch complete (61874 records). [2025-10-01T17:06:26.205180] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-01T17:06:26.503286] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-01T17:06:26.562156] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T17:06:26.649295] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T17:06:26.700388] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-01T17:06:26.700884] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-01T17:06:26.701546] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-01T17:06:26.701611] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-01T17:06:26.703049] [DEBUG] [LOCAL ] AGCO: Trimmed 61874 records to 42377 (keeping 200 days of data) [2025-10-01T17:06:26.996738] [DEBUG] [LOCAL ] AGCO: Primary data saved (42377 records). [2025-10-01T17:06:26.996882] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-01T17:06:26.998249] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 39.5s. Estimated remaining: 4h 39m 37s. Rate: 8.3 symbols/min [2025-10-01T17:06:27.200024] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:06:27.232981] [DEBUG] [LOCAL ] AGO: Loaded 27896 existing records from primary storage. [2025-10-01T17:06:27.233255] [INFO ] [MAIN ] AGO: Loaded 27896 existing records. [2025-10-01T17:06:27.308966] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-01T17:06:27.444127] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:06:27.444468] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-01T17:06:27.444635] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-01T17:06:27.445015] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-01T17:06:27.445131] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-01T17:06:27.872506] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:06:27.878129] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T17:06:28.102395] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-01T17:06:28.594121] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T17:06:28.902373] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-01T17:06:29.077636] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T17:06:29.702491] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-01T17:06:30.502413] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-01T17:06:30.778638] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T17:06:30.854619] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T17:06:31.302418] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-01T17:06:31.766021] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T17:06:32.102456] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-01T17:06:32.777750] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T17:06:32.902382] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-01T17:06:33.240315] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T17:06:33.398213] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T17:06:33.702410] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-01T17:06:34.502421] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-01T17:06:35.020425] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-01T17:06:35.302393] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-01T17:06:35.453057] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T17:06:35.987093] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T17:06:36.102392] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-01T17:06:36.902393] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-01T17:06:37.071839] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T17:06:37.702447] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-01T17:06:38.269337] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-01T17:06:38.502366] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-01T17:06:38.625235] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T17:06:39.250296] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T17:06:39.302423] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-01T17:06:40.102392] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-01T17:06:40.528449] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T17:06:40.902420] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-01T17:06:41.702461] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-01T17:06:41.732630] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T17:06:41.862372] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T17:06:42.502405] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-01T17:06:43.228948] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T17:06:43.302347] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-01T17:06:43.901156] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-01T17:06:43.902016] [INFO ] [REMOTE ] AGM: Full fetch complete (12758 records). [2025-10-01T17:06:43.902086] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-01T17:06:44.107581] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-01T17:06:44.301664] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-01T17:06:44.301776] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-01T17:06:44.302028] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-01T17:06:44.302158] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-01T17:06:44.302910] [DEBUG] [LOCAL ] AGM: Trimmed 12758 records to 10179 (keeping 200 days of data) [2025-10-01T17:06:44.376817] [DEBUG] [LOCAL ] AGM: Primary data saved (10179 records). [2025-10-01T17:06:44.376998] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-01T17:06:44.377087] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 20.0s. Estimated remaining: 4h 46m 44s. Rate: 8.1 symbols/min [2025-10-01T17:06:44.573177] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:06:44.610320] [DEBUG] [LOCAL ] AGRO: Loaded 33600 existing records from primary storage. [2025-10-01T17:06:44.610668] [INFO ] [MAIN ] AGRO: Loaded 33600 existing records. [2025-10-01T17:06:44.810696] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:06:44.811090] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-01T17:06:44.811277] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-01T17:06:44.811796] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-01T17:06:44.811860] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-01T17:06:44.911421] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-01T17:06:45.202353] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T17:06:45.261232] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:06:45.295508] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T17:06:45.702397] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-01T17:06:46.414001] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T17:06:46.502480] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-01T17:06:47.302420] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-01T17:06:47.768338] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-01T17:06:47.831321] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T17:06:48.102396] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-01T17:06:48.902405] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-01T17:06:49.078573] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T17:06:49.198695] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T17:06:49.702376] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-01T17:06:49.916007] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T17:06:50.502375] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-01T17:06:51.301344] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T17:06:51.312464] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-01T17:06:51.863961] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T17:06:52.102383] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-01T17:06:52.902353] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-01T17:06:53.102346] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T17:06:53.304598] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T17:06:53.702428] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-01T17:06:54.337573] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T17:06:54.502417] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-01T17:06:55.246528] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T17:06:55.302399] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-01T17:06:56.102400] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-01T17:06:56.413984] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T17:06:56.781161] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-01T17:06:56.782755] [INFO ] [REMOTE ] AGL: Full fetch complete (75515 records). [2025-10-01T17:06:56.782879] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-01T17:06:56.907498] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-01T17:06:57.230823] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-01T17:06:57.230912] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-01T17:06:57.231676] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-01T17:06:57.231741] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-01T17:06:57.233640] [DEBUG] [LOCAL ] AGL: Trimmed 75515 records to 52447 (keeping 200 days of data) [2025-10-01T17:06:57.477279] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:06:57.582997] [DEBUG] [LOCAL ] AGL: Primary data saved (52447 records). [2025-10-01T17:06:57.583182] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-01T17:06:57.583306] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGL took 39.6s. Estimated remaining: 4h 50m 40s. Rate: 8.0 symbols/min [2025-10-01T17:06:57.704294] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-01T17:06:57.782949] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:06:57.820296] [DEBUG] [LOCAL ] AGX: Loaded 33204 existing records from primary storage. [2025-10-01T17:06:57.820661] [INFO ] [MAIN ] AGX: Loaded 33204 existing records. [2025-10-01T17:06:58.016004] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:06:58.016242] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-01T17:06:58.016320] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-01T17:06:58.016894] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-01T17:06:58.016956] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-01T17:06:58.365355] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T17:06:58.456961] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:06:58.502339] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-01T17:06:58.929346] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T17:06:59.302417] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-01T17:06:59.924326] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:07:00.102424] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-01T17:07:00.902412] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-01T17:07:01.434512] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T17:07:01.702450] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-01T17:07:02.083110] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-01T17:07:02.093205] [INFO ] [REMOTE ] AGI: Full fetch complete (76797 records). [2025-10-01T17:07:02.093420] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-01T17:07:02.382063] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T17:07:02.526995] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-01T17:07:02.798373] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-01T17:07:02.798526] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-01T17:07:02.799430] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-01T17:07:02.799534] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-01T17:07:02.819586] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T17:07:02.819728] [DEBUG] [LOCAL ] AGI: Trimmed 76797 records to 53416 (keeping 200 days of data) [2025-10-01T17:07:03.171376] [DEBUG] [LOCAL ] AGI: Primary data saved (53416 records). [2025-10-01T17:07:03.171522] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-01T17:07:03.171605] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGI took 47.9s. Estimated remaining: 4h 49m 13s. Rate: 8.0 symbols/min [2025-10-01T17:07:03.318690] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-01T17:07:03.353074] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:03.391305] [DEBUG] [LOCAL ] AHH: Loaded 41175 existing records from primary storage. [2025-10-01T17:07:03.391616] [INFO ] [MAIN ] AHH: Loaded 41175 existing records. [2025-10-01T17:07:03.587921] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:07:03.588182] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-01T17:07:03.588242] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-01T17:07:03.588596] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-01T17:07:03.588689] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-01T17:07:04.040242] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T17:07:04.044273] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:04.102376] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-01T17:07:04.347067] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T17:07:04.902384] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-01T17:07:05.654991] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T17:07:05.702426] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-01T17:07:06.386029] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-01T17:07:06.388098] [INFO ] [REMOTE ] AGO: Full fetch complete (39332 records). [2025-10-01T17:07:06.388185] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-01T17:07:06.507014] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-01T17:07:06.815193] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-01T17:07:06.815283] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-01T17:07:06.815753] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-01T17:07:06.815816] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-01T17:07:06.816772] [DEBUG] [LOCAL ] AGO: Trimmed 39332 records to 27914 (keeping 200 days of data) [2025-10-01T17:07:07.027762] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T17:07:07.046850] [DEBUG] [LOCAL ] AGO: Primary data saved (27914 records). [2025-10-01T17:07:07.047020] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-01T17:07:07.048674] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 40.1s. Estimated remaining: 4h 46m 38s. Rate: 8.1 symbols/min [2025-10-01T17:07:07.236029] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:07.236260] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-01T17:07:07.236366] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-01T17:07:07.236479] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-01T17:07:07.236524] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-01T17:07:07.236566] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-01T17:07:07.236604] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-01T17:07:07.307707] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-01T17:07:07.625923] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:08.037628] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T17:07:08.102398] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-01T17:07:08.447586] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T17:07:08.902425] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-01T17:07:09.156385] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:07:09.156737] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-01T17:07:09.156828] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:07:09.156876] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-01T17:07:09.156914] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:07:09.156979] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-01T17:07:09.157110] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-01T17:07:09.157164] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-01T17:07:09.157225] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-01T17:07:09.157295] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 2.1s. Estimated remaining: 4h 42m 58s. Rate: 8.2 symbols/min [2025-10-01T17:07:09.356759] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:09.404870] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T17:07:09.430045] [DEBUG] [LOCAL ] AHR: Loaded 49168 existing records from primary storage. [2025-10-01T17:07:09.430448] [INFO ] [MAIN ] AHR: Loaded 49168 existing records. [2025-10-01T17:07:09.641757] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:07:09.642016] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-01T17:07:09.642069] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-01T17:07:09.642480] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-01T17:07:09.642539] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-01T17:07:09.707585] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-01T17:07:10.039169] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:10.502433] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-01T17:07:11.259370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T17:07:11.302387] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-01T17:07:12.102402] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-01T17:07:12.209176] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T17:07:12.413463] [DEBUG] [REMOTE ] AGRO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:07:12.413814] [WARN ] [REMOTE ] AGRO: No data returned for month 2025-10 [2025-10-01T17:07:12.413901] [FATAL] [REMOTE ] AGRO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:07:12.413984] [FATAL] [MAIN ] AGRO: Failed to fetch primary data. [2025-10-01T17:07:12.414085] [WARN ] [MAIN ] AGRO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:07:12.414177] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-01T17:07:12.414247] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-01T17:07:12.414310] [INFO ] [LOCAL ] AGRO: Starting deletion of derivative data. [2025-10-01T17:07:12.414858] [DEBUG] [LOCAL ] AGRO: Deleted derivative data file. [2025-10-01T17:07:12.414946] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 28.0s. Estimated remaining: 4h 40m 11s. Rate: 8.3 symbols/min [2025-10-01T17:07:12.602184] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:12.610294] [DEBUG] [LOCAL ] AHT: Loaded 6106 existing records from primary storage. [2025-10-01T17:07:12.610520] [INFO ] [MAIN ] AHT: Loaded 6106 existing records. [2025-10-01T17:07:12.836939] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:07:12.837161] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-01T17:07:12.837211] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-01T17:07:12.837495] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-01T17:07:12.837577] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-01T17:07:12.908401] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-01T17:07:13.231225] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:13.342899] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T17:07:13.702405] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-01T17:07:14.502353] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-01T17:07:14.670906] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T17:07:14.916180] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T17:07:15.302400] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-01T17:07:15.410067] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T17:07:16.102396] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-01T17:07:16.902385] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-01T17:07:16.952325] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T17:07:16.982897] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T17:07:17.702378] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-01T17:07:17.965058] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T17:07:18.502403] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-01T17:07:19.262766] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T17:07:19.302370] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-01T17:07:19.650474] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T17:07:20.102391] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-01T17:07:20.483378] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T17:07:20.902379] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-01T17:07:21.409722] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T17:07:21.615827] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-01T17:07:21.702382] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-01T17:07:22.502388] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-01T17:07:22.885417] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-01T17:07:23.067093] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T17:07:23.302366] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-01T17:07:23.913871] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-01T17:07:24.102416] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-01T17:07:24.544772] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T17:07:24.902407] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-01T17:07:25.702392] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-01T17:07:26.193147] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T17:07:26.502451] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-01T17:07:26.535634] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T17:07:27.302376] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-01T17:07:27.754826] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T17:07:27.934140] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T17:07:28.102381] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-01T17:07:28.829254] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T17:07:28.902371] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-01T17:07:29.331905] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-01T17:07:29.702377] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-01T17:07:30.502387] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-01T17:07:31.302386] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-01T17:07:31.342632] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-01T17:07:31.343412] [INFO ] [REMOTE ] AHT: Full fetch complete (9333 records). [2025-10-01T17:07:31.343484] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-01T17:07:31.778367] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-01T17:07:31.804733] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-01T17:07:31.817029] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-01T17:07:31.817715] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-01T17:07:31.817836] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-01T17:07:31.819217] [DEBUG] [LOCAL ] AHT: Trimmed 9333 records to 6134 (keeping 200 days of data) [2025-10-01T17:07:31.860813] [DEBUG] [LOCAL ] AHT: Primary data saved (6134 records). [2025-10-01T17:07:31.860963] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-01T17:07:31.861078] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHT took 19.4s. Estimated remaining: 4h 47m 53s. Rate: 8.0 symbols/min [2025-10-01T17:07:32.045126] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:32.101361] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-10-01T17:07:32.101803] [INFO ] [MAIN ] AI: Loaded 53750 existing records. [2025-10-01T17:07:32.113368] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-01T17:07:32.300504] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:07:32.300798] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-01T17:07:32.300860] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-01T17:07:32.301257] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-01T17:07:32.301317] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-01T17:07:32.688413] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:32.902430] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-01T17:07:32.935978] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T17:07:33.702450] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-01T17:07:33.742476] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T17:07:34.502576] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-01T17:07:34.830695] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T17:07:35.302374] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-01T17:07:35.442572] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-01T17:07:35.875221] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T17:07:36.102382] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-01T17:07:36.902370] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-01T17:07:36.971589] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T17:07:37.702390] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-01T17:07:38.488788] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-01T17:07:38.502346] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-01T17:07:38.844117] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T17:07:38.845879] [INFO ] [REMOTE ] AGX: Full fetch complete (48813 records). [2025-10-01T17:07:38.846057] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-01T17:07:39.192509] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T17:07:39.307531] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-01T17:07:39.327369] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-01T17:07:39.327490] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-01T17:07:39.328265] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-01T17:07:39.328449] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-01T17:07:39.329839] [DEBUG] [LOCAL ] AGX: Trimmed 48813 records to 33195 (keeping 200 days of data) [2025-10-01T17:07:39.553570] [DEBUG] [LOCAL ] AGX: Primary data saved (33195 records). [2025-10-01T17:07:39.553757] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-01T17:07:39.553881] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AGX took 42.0s. Estimated remaining: 4h 47m 54s. Rate: 8.0 symbols/min [2025-10-01T17:07:39.737550] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:39.796784] [DEBUG] [LOCAL ] AIG: Loaded 53471 existing records from primary storage. [2025-10-01T17:07:39.797132] [INFO ] [MAIN ] AIG: Loaded 53471 existing records. [2025-10-01T17:07:39.988967] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:07:39.989212] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-01T17:07:39.989262] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-01T17:07:39.989806] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-01T17:07:39.989900] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-01T17:07:40.104319] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-01T17:07:40.364382] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T17:07:40.388862] [INFO ] [REMOTE ] AHH: Full fetch complete (60245 records). [2025-10-01T17:07:40.394333] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-01T17:07:40.401531] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:40.826158] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-01T17:07:40.826247] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-01T17:07:40.826942] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-01T17:07:40.827010] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-01T17:07:40.828435] [DEBUG] [LOCAL ] AHH: Trimmed 60245 records to 41122 (keeping 200 days of data) [2025-10-01T17:07:40.920461] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-01T17:07:41.089354] [DEBUG] [LOCAL ] AHH: Primary data saved (41122 records). [2025-10-01T17:07:41.089497] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-01T17:07:41.089587] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHH took 37.9s. Estimated remaining: 4h 44m 5s. Rate: 8.1 symbols/min [2025-10-01T17:07:41.285346] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:41.285621] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-01T17:07:41.285712] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-01T17:07:41.285835] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-01T17:07:41.285880] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-01T17:07:41.285931] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-01T17:07:41.285968] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-01T17:07:41.699681] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:41.711962] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-01T17:07:41.733466] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T17:07:41.776437] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-01T17:07:41.967805] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:07:41.968170] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-01T17:07:41.968293] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:07:41.968358] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-01T17:07:41.968423] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:07:41.968497] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-01T17:07:41.968564] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-01T17:07:41.968600] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-01T17:07:41.968665] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-01T17:07:41.968752] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 0.9s. Estimated remaining: 4h 39m 59s. Rate: 8.2 symbols/min [2025-10-01T17:07:42.152127] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:42.152290] [DEBUG] [LOCAL ] AIN: No existing data file found in primary storage. [2025-10-01T17:07:42.152413] [WARN ] [MAIN ] AIN: No existing data found, performing full refresh instead. [2025-10-01T17:07:42.152497] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-01T17:07:42.152534] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-01T17:07:42.152573] [DEBUG] [LOCAL ] AIN: No primary data file found to delete. [2025-10-01T17:07:42.152605] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-01T17:07:42.503997] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-01T17:07:42.551502] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:42.597771] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T17:07:43.302393] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-01T17:07:44.102369] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-01T17:07:44.140415] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T17:07:44.565696] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T17:07:44.902379] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-01T17:07:45.702355] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-01T17:07:45.981554] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T17:07:46.356708] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-01T17:07:46.502421] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-01T17:07:47.140602] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T17:07:47.289390] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T17:07:47.302336] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-01T17:07:48.102362] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-01T17:07:48.234048] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T17:07:48.902379] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-01T17:07:49.499303] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T17:07:49.702358] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-01T17:07:49.865537] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T17:07:50.502373] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-01T17:07:51.148495] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T17:07:51.302377] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-01T17:07:52.102393] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-01T17:07:52.324318] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T17:07:52.902391] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-01T17:07:53.605108] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-01T17:07:53.702429] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-01T17:07:54.092901] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T17:07:54.502479] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-01T17:07:54.952452] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T17:07:54.954573] [INFO ] [REMOTE ] AHR: Full fetch complete (70838 records). [2025-10-01T17:07:54.954779] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-01T17:07:55.312030] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-01T17:07:55.446535] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-01T17:07:55.446681] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-01T17:07:55.447924] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-01T17:07:55.448000] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-01T17:07:55.449773] [DEBUG] [LOCAL ] AHR: Trimmed 70838 records to 49165 (keeping 200 days of data) [2025-10-01T17:07:55.772923] [DEBUG] [LOCAL ] AHR: Primary data saved (49165 records). [2025-10-01T17:07:55.773069] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-01T17:07:55.774028] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AHR took 46.6s. Estimated remaining: 4h 43m 47s. Rate: 8.1 symbols/min [2025-10-01T17:07:55.986909] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:07:55.987158] [DEBUG] [LOCAL ] AIO: No existing data file found in primary storage. [2025-10-01T17:07:55.987281] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-10-01T17:07:55.987398] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-01T17:07:55.987443] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-01T17:07:55.987487] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-01T17:07:55.987522] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-01T17:07:56.401665] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-01T17:07:56.445417] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-01T17:07:56.540189] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-01T17:07:56.536992] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:07:56.574972] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T17:07:56.902391] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-01T17:07:57.702369] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-01T17:07:57.753553] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T17:07:58.502412] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-01T17:07:58.877281] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-01T17:07:59.307516] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-01T17:07:59.319115] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T17:07:59.503600] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T17:08:00.011499] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T17:08:00.102409] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-01T17:08:00.902383] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-01T17:08:01.702391] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-01T17:08:02.269747] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-01T17:08:02.502360] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-01T17:08:02.634716] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T17:08:02.972224] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-01T17:08:03.302382] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-01T17:08:04.102417] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-01T17:08:04.402593] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T17:08:04.902426] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-01T17:08:04.987631] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T17:08:05.539376] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T17:08:05.702352] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-01T17:08:05.903686] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-01T17:08:06.502385] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-01T17:08:07.157017] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T17:08:07.302404] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-01T17:08:07.499732] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T17:08:08.102423] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-01T17:08:08.629358] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-01T17:08:08.630588] [INFO ] [REMOTE ] AIN: Full fetch complete (33350 records). [2025-10-01T17:08:08.630715] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-01T17:08:08.912193] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-01T17:08:09.037374] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-01T17:08:09.037493] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-01T17:08:09.037941] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-01T17:08:09.038015] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-01T17:08:09.038952] [DEBUG] [LOCAL ] AIN: Trimmed 33350 records to 24554 (keeping 200 days of data) [2025-10-01T17:08:09.195935] [DEBUG] [LOCAL ] AIN: Primary data saved (24554 records). [2025-10-01T17:08:09.196069] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-01T17:08:09.196145] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIN took 27.2s. Estimated remaining: 4h 47m 14s. Rate: 8.0 symbols/min [2025-10-01T17:08:09.381900] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:08:09.410631] [DEBUG] [LOCAL ] AIR: Loaded 27931 existing records from primary storage. [2025-10-01T17:08:09.410975] [INFO ] [MAIN ] AIR: Loaded 27931 existing records. [2025-10-01T17:08:09.626779] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:08:09.627060] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-01T17:08:09.627191] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-01T17:08:09.627582] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-01T17:08:09.627681] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-01T17:08:09.702699] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-01T17:08:10.084262] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:08:10.087191] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-01T17:08:10.502434] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-01T17:08:10.684352] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T17:08:11.302386] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-01T17:08:11.534663] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-01T17:08:11.646939] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T17:08:12.102382] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-01T17:08:12.116483] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T17:08:12.902417] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-01T17:08:13.702406] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-01T17:08:13.762105] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T17:08:14.502443] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-01T17:08:15.302407] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-01T17:08:15.813325] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T17:08:15.839434] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-01T17:08:15.871517] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (3.77 seconds). [2025-10-01T17:08:15.873201] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-01T17:08:15.873321] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-01T17:08:16.013533] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-01T17:08:16.037407] [INFO ] [REMOTE ] AIG: Full fetch complete (77377 records). [2025-10-01T17:08:16.067020] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-01T17:08:16.108918] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-01T17:08:16.674585] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-01T17:08:16.691215] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-01T17:08:16.692205] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-01T17:08:16.699167] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-01T17:08:16.765098] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53750 (keeping 200 days of data) [2025-10-01T17:08:16.914044] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-01T17:08:16.914233] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-01T17:08:16.914575] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-01T17:08:16.942534] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-01T17:08:16.945298] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-01T17:08:16.951153] [DEBUG] [LOCAL ] AIG: Trimmed 77377 records to 53472 (keeping 200 days of data) [2025-10-01T17:08:17.110158] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T17:08:17.524196] [DEBUG] [LOCAL ] AIG: Primary data saved (53472 records). [2025-10-01T17:08:17.543362] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-01T17:08:17.543749] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIG took 38.0s. Estimated remaining: 4h 47m 37s. Rate: 8.0 symbols/min [2025-10-01T17:08:17.703870] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-01T17:08:17.779994] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:08:17.782795] [DEBUG] [LOCAL ] AI: Primary data saved (53750 records). [2025-10-01T17:08:17.782989] [INFO ] [MAIN ] AI: Full history saved. [2025-10-01T17:08:17.783080] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AI took 45.9s. Estimated remaining: 4h 43m 21s. Rate: 8.1 symbols/min [2025-10-01T17:08:17.978704] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:08:17.989291] [DEBUG] [LOCAL ] AIT: Loaded 27638 existing records from primary storage. [2025-10-01T17:08:17.989714] [INFO ] [MAIN ] AIT: Loaded 27638 existing records. [2025-10-01T17:08:18.145183] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T17:08:18.228525] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:08:18.229097] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-01T17:08:18.241466] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-01T17:08:18.242275] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-01T17:08:18.242229] [DEBUG] [LOCAL ] AIV: Loaded 40347 existing records from primary storage. [2025-10-01T17:08:18.242386] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-01T17:08:18.247838] [INFO ] [MAIN ] AIV: Loaded 40347 existing records. [2025-10-01T17:08:18.551023] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-01T17:08:18.595324] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T17:08:18.635409] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:08:18.662946] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-01T17:08:18.717975] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-01T17:08:18.771344] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-01T17:08:18.783265] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-01T17:08:18.991300] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:08:19.274830] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:08:19.302350] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-01T17:08:19.918462] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T17:08:20.102370] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-01T17:08:20.701889] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T17:08:20.902396] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-01T17:08:21.480232] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T17:08:21.702431] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-01T17:08:22.502385] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-01T17:08:22.582747] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T17:08:22.744265] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T17:08:23.232759] [DEBUG] [REMOTE ] AIO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:08:23.233116] [WARN ] [REMOTE ] AIO: No data returned for month 2025-10 [2025-10-01T17:08:23.233211] [FATAL] [REMOTE ] AIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:08:23.233299] [FATAL] [MAIN ] AIO: Failed to fetch primary data. [2025-10-01T17:08:23.233363] [WARN ] [MAIN ] AIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:08:23.233438] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-01T17:08:23.233503] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-01T17:08:23.233542] [INFO ] [LOCAL ] AIO: Starting deletion of derivative data. [2025-10-01T17:08:23.233584] [DEBUG] [LOCAL ] AIO: No derivative data file found to delete. [2025-10-01T17:08:23.233633] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 27.5s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-10-01T17:08:23.307473] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-01T17:08:23.441801] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:08:23.505801] [DEBUG] [LOCAL ] AIZ: Loaded 29883 existing records from primary storage. [2025-10-01T17:08:23.506143] [INFO ] [MAIN ] AIZ: Loaded 29883 existing records. [2025-10-01T17:08:23.714661] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:08:23.714896] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-01T17:08:23.714946] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-01T17:08:23.715236] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-01T17:08:23.715306] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-01T17:08:24.102902] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-01T17:08:24.127462] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:08:24.559741] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T17:08:24.902383] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-01T17:08:25.397828] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T17:08:25.626220] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T17:08:25.702413] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-01T17:08:26.502425] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-01T17:08:26.842061] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T17:08:27.302397] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-01T17:08:27.838366] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T17:08:28.102432] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-01T17:08:28.539013] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T17:08:28.902414] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-01T17:08:29.392000] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T17:08:29.702405] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-01T17:08:30.332868] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T17:08:30.502417] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-01T17:08:31.081074] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T17:08:31.302389] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-01T17:08:31.789264] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T17:08:32.102378] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-01T17:08:32.368606] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T17:08:32.902388] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-01T17:08:33.238699] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T17:08:33.702415] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-01T17:08:34.249519] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T17:08:34.502389] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-01T17:08:35.133429] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T17:08:35.302386] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-01T17:08:35.860207] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T17:08:36.102373] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-01T17:08:36.488130] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T17:08:36.902402] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-01T17:08:37.534043] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T17:08:37.702401] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-01T17:08:38.502405] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-01T17:08:38.661828] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-01T17:08:38.665211] [INFO ] [REMOTE ] AIR: Full fetch complete (38920 records). [2025-10-01T17:08:38.665310] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-01T17:08:39.093516] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-01T17:08:39.093619] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-01T17:08:39.094155] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-01T17:08:39.094226] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-01T17:08:39.095507] [DEBUG] [LOCAL ] AIR: Trimmed 38920 records to 28191 (keeping 200 days of data) [2025-10-01T17:08:39.233981] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T17:08:39.302588] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-01T17:08:39.309557] [DEBUG] [LOCAL ] AIR: Primary data saved (28191 records). [2025-10-01T17:08:39.309700] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-01T17:08:39.312925] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 30.1s. Estimated remaining: 4h 46m 52s. Rate: 8.0 symbols/min [2025-10-01T17:08:39.512133] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:08:39.519032] [DEBUG] [LOCAL ] AIZN: Loaded 4008 existing records from primary storage. [2025-10-01T17:08:39.519297] [INFO ] [MAIN ] AIZN: Loaded 4008 existing records. [2025-10-01T17:08:39.725208] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:08:39.725449] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-01T17:08:39.725500] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-01T17:08:39.725828] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-01T17:08:39.725889] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-01T17:08:40.102498] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-01T17:08:40.178511] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:08:40.199624] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T17:08:40.451625] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T17:08:40.902394] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-01T17:08:41.408066] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-01T17:08:41.427116] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T17:08:41.702387] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-01T17:08:42.502419] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-01T17:08:43.100879] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T17:08:43.302382] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-01T17:08:43.606867] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T17:08:43.883610] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T17:08:44.102378] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-01T17:08:44.902391] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-01T17:08:45.551277] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T17:08:45.702396] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-01T17:08:46.103311] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T17:08:46.502424] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-01T17:08:46.636775] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T17:08:46.863040] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-01T17:08:47.302384] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-01T17:08:48.094526] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T17:08:48.102328] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-01T17:08:48.902391] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-01T17:08:49.355733] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T17:08:49.356862] [INFO ] [REMOTE ] AIT: Full fetch complete (39436 records). [2025-10-01T17:08:49.356946] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-01T17:08:49.651111] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T17:08:49.707550] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-01T17:08:49.791418] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-01T17:08:49.791523] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-01T17:08:49.792055] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-01T17:08:49.792120] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-01T17:08:49.793166] [DEBUG] [LOCAL ] AIT: Trimmed 39436 records to 27516 (keeping 200 days of data) [2025-10-01T17:08:49.983437] [DEBUG] [LOCAL ] AIT: Primary data saved (27516 records). [2025-10-01T17:08:49.983599] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-01T17:08:49.983737] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 32.4s. Estimated remaining: 4h 48m 29s. Rate: 8.0 symbols/min [2025-10-01T17:08:50.169072] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:08:50.215926] [DEBUG] [LOCAL ] AJG: Loaded 46898 existing records from primary storage. [2025-10-01T17:08:50.216311] [INFO ] [MAIN ] AJG: Loaded 46898 existing records. [2025-10-01T17:08:50.420590] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:08:50.420830] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-01T17:08:50.420881] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-01T17:08:50.421274] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-01T17:08:50.421337] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-01T17:08:50.507488] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-01T17:08:50.838748] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:08:50.873681] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T17:08:51.302424] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-01T17:08:51.838548] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T17:08:51.893350] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T17:08:52.102370] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-01T17:08:52.902383] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-01T17:08:53.705604] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-01T17:08:53.715193] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T17:08:54.455813] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T17:08:54.502515] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-01T17:08:54.913973] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T17:08:55.302413] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-01T17:08:55.690580] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-01T17:08:56.102391] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-01T17:08:56.493748] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-01T17:08:56.495184] [INFO ] [REMOTE ] AIV: Full fetch complete (59671 records). [2025-10-01T17:08:56.495276] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-01T17:08:56.920486] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-01T17:08:56.939175] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-01T17:08:56.940310] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-01T17:08:56.941203] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-01T17:08:56.941404] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-01T17:08:56.946104] [DEBUG] [LOCAL ] AIV: Trimmed 59671 records to 40387 (keeping 200 days of data) [2025-10-01T17:08:57.050012] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T17:08:57.210404] [DEBUG] [LOCAL ] AIV: Primary data saved (40387 records). [2025-10-01T17:08:57.210544] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-01T17:08:57.210624] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 39.4s. Estimated remaining: 4h 48m 12s. Rate: 8.0 symbols/min [2025-10-01T17:08:57.405956] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:08:57.409969] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-01T17:08:57.410077] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-01T17:08:57.411816] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-01T17:08:57.412389] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-01T17:08:57.412464] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-01T17:08:57.412515] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-01T17:08:57.412550] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-01T17:08:57.707626] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-01T17:08:57.835333] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:08:58.502387] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-01T17:08:59.260485] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T17:08:59.302399] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-01T17:08:59.964291] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T17:08:59.965487] [INFO ] [REMOTE ] AIZ: Full fetch complete (42883 records). [2025-10-01T17:08:59.965590] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-01T17:09:00.107563] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-01T17:09:00.395603] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-01T17:09:00.395724] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-01T17:09:00.396317] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-01T17:09:00.396383] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-01T17:09:00.397578] [DEBUG] [LOCAL ] AIZ: Trimmed 42883 records to 29857 (keeping 200 days of data) [2025-10-01T17:09:00.641221] [DEBUG] [LOCAL ] AIZ: Primary data saved (29857 records). [2025-10-01T17:09:00.641410] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-01T17:09:00.642419] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZ took 37.4s. Estimated remaining: 4h 45m 54s. Rate: 8.0 symbols/min [2025-10-01T17:09:00.832435] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:09:00.885214] [DEBUG] [LOCAL ] AKR: Loaded 45732 existing records from primary storage. [2025-10-01T17:09:00.885553] [INFO ] [MAIN ] AKR: Loaded 45732 existing records. [2025-10-01T17:09:00.919034] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-01T17:09:01.059003] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T17:09:01.099851] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:09:01.101632] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-01T17:09:01.101727] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-01T17:09:01.102994] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-01T17:09:01.103057] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-01T17:09:01.519190] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:09:01.587520] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-01T17:09:01.588737] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T17:09:01.702388] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-01T17:09:02.502426] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-01T17:09:03.000329] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T17:09:03.302396] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-01T17:09:03.866134] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-01T17:09:03.913140] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-01T17:09:04.102370] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-01T17:09:04.742390] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T17:09:04.902427] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-01T17:09:05.702407] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-01T17:09:06.502427] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-01T17:09:06.829996] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T17:09:06.894840] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-01T17:09:07.076271] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T17:09:07.302392] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-01T17:09:07.619527] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-01T17:09:08.102390] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-01T17:09:08.902419] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-01T17:09:09.531581] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T17:09:09.613138] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T17:09:09.613916] [INFO ] [REMOTE ] AIZN: Full fetch complete (5885 records). [2025-10-01T17:09:09.613990] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-01T17:09:09.707546] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-01T17:09:10.025120] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-01T17:09:10.025228] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-01T17:09:10.025420] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-01T17:09:10.025465] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-01T17:09:10.025896] [DEBUG] [LOCAL ] AIZN: Trimmed 5885 records to 4025 (keeping 200 days of data) [2025-10-01T17:09:10.051322] [DEBUG] [LOCAL ] AIZN: Primary data saved (4025 records). [2025-10-01T17:09:10.051452] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-01T17:09:10.051538] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZN took 30.7s. Estimated remaining: 4h 46m 48s. Rate: 8.0 symbols/min [2025-10-01T17:09:10.243496] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:09:10.290937] [DEBUG] [LOCAL ] AL: Loaded 44215 existing records from primary storage. [2025-10-01T17:09:10.291259] [INFO ] [MAIN ] AL: Loaded 44215 existing records. [2025-10-01T17:09:10.480037] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:09:10.480269] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-01T17:09:10.480319] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-01T17:09:10.481315] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-01T17:09:10.481378] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-01T17:09:10.507573] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-01T17:09:10.875886] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:09:10.969505] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T17:09:11.302387] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-01T17:09:11.746470] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T17:09:12.102409] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-01T17:09:12.902365] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-01T17:09:12.934264] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T17:09:13.702366] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-01T17:09:13.870195] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T17:09:14.116276] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T17:09:14.502402] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-01T17:09:14.738140] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T17:09:15.302396] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-01T17:09:15.780455] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-01T17:09:16.084113] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T17:09:16.102351] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-01T17:09:16.902385] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-01T17:09:17.693633] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T17:09:17.702983] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-01T17:09:18.332493] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T17:09:18.502423] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-01T17:09:19.243238] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T17:09:19.302371] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-01T17:09:19.724005] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T17:09:20.102363] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-01T17:09:20.467284] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-01T17:09:20.902383] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-01T17:09:21.222084] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-01T17:09:21.434436] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-01T17:09:21.436156] [INFO ] [REMOTE ] AJG: Full fetch complete (69612 records). [2025-10-01T17:09:21.436315] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-01T17:09:21.707540] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-01T17:09:21.887108] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-01T17:09:21.887204] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-01T17:09:21.888072] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-01T17:09:21.888152] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-01T17:09:21.889903] [DEBUG] [LOCAL ] AJG: Trimmed 69612 records to 46880 (keeping 200 days of data) [2025-10-01T17:09:22.194471] [DEBUG] [LOCAL ] AJG: Primary data saved (46880 records). [2025-10-01T17:09:22.194602] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-01T17:09:22.194707] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 32.2s. Estimated remaining: 4h 49m 5s. Rate: 7.9 symbols/min [2025-10-01T17:09:22.386198] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:09:22.440851] [DEBUG] [LOCAL ] ALB: Loaded 53236 existing records from primary storage. [2025-10-01T17:09:22.441213] [INFO ] [MAIN ] ALB: Loaded 53236 existing records. [2025-10-01T17:09:22.510194] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-01T17:09:22.666200] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:09:22.666429] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-01T17:09:22.666477] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-01T17:09:22.666893] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-01T17:09:22.666953] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-01T17:09:23.054360] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:09:23.302413] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-01T17:09:23.368561] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T17:09:24.107523] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-01T17:09:24.127996] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T17:09:24.393731] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-01T17:09:24.902379] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-01T17:09:25.106187] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-01T17:09:25.702407] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-01T17:09:26.075075] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T17:09:26.502409] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-01T17:09:27.186601] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T17:09:27.219284] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T17:09:27.302389] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-01T17:09:28.102448] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-01T17:09:28.434336] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-01T17:09:28.799271] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T17:09:28.902387] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-01T17:09:29.702402] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-01T17:09:30.286220] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T17:09:30.286907] [INFO ] [REMOTE ] AKA: Full fetch complete (2421 records). [2025-10-01T17:09:30.286977] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-01T17:09:30.488412] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T17:09:30.488610] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-01T17:09:30.488711] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-01T17:09:30.488789] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-01T17:09:30.488858] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-01T17:09:30.488902] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-01T17:09:30.488942] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-01T17:09:30.489003] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKA took 33.3s. Estimated remaining: 4h 49m 20s. Rate: 7.9 symbols/min [2025-10-01T17:09:30.510744] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-01T17:09:30.675448] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:09:30.726968] [DEBUG] [LOCAL ] ALC: Loaded 50789 existing records from primary storage. [2025-10-01T17:09:30.727360] [INFO ] [MAIN ] ALC: Loaded 50789 existing records. [2025-10-01T17:09:30.928492] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:09:30.928962] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-01T17:09:30.929023] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-01T17:09:30.929415] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-01T17:09:30.929507] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-01T17:09:31.268780] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-01T17:09:31.305336] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-01T17:09:31.374749] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:09:31.877788] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T17:09:32.102381] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-01T17:09:32.902387] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-01T17:09:32.955109] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T17:09:33.387317] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T17:09:33.702381] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-01T17:09:34.502388] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-01T17:09:34.728191] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T17:09:35.302385] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-01T17:09:35.673543] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T17:09:35.763700] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T17:09:36.102374] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-01T17:09:36.697550] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T17:09:36.902387] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-01T17:09:37.702367] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-01T17:09:38.008575] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T17:09:38.502391] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-01T17:09:38.603854] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T17:09:39.302394] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-01T17:09:39.396868] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T17:09:40.102382] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-01T17:09:40.325037] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T17:09:40.902402] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-01T17:09:41.407972] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-01T17:09:41.409692] [INFO ] [REMOTE ] AL: Full fetch complete (62609 records). [2025-10-01T17:09:41.409797] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-01T17:09:41.707853] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-01T17:09:41.856128] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T17:09:41.888903] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-01T17:09:41.888999] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-01T17:09:41.889728] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-01T17:09:41.890219] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-01T17:09:41.891628] [DEBUG] [LOCAL ] AL: Trimmed 62609 records to 44286 (keeping 200 days of data) [2025-10-01T17:09:42.175767] [DEBUG] [LOCAL ] AL: Primary data saved (44286 records). [2025-10-01T17:09:42.175904] [INFO ] [MAIN ] AL: Full history saved. [2025-10-01T17:09:42.176860] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 32.1s. Estimated remaining: 4h 51m 17s. Rate: 7.9 symbols/min [2025-10-01T17:09:42.372846] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:09:42.373134] [DEBUG] [LOCAL ] ALE: No existing data file found in primary storage. [2025-10-01T17:09:42.373193] [WARN ] [MAIN ] ALE: No existing data found, performing full refresh instead. [2025-10-01T17:09:42.373308] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-01T17:09:42.373353] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-01T17:09:42.373399] [DEBUG] [LOCAL ] ALE: No primary data file found to delete. [2025-10-01T17:09:42.373434] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-01T17:09:42.504144] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-01T17:09:42.788084] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:09:42.818498] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T17:09:43.302382] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-01T17:09:43.590474] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T17:09:44.102373] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-01T17:09:44.502673] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T17:09:44.673799] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T17:09:44.675380] [INFO ] [REMOTE ] AKR: Full fetch complete (65461 records). [2025-10-01T17:09:44.675480] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-01T17:09:44.907581] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-01T17:09:45.119336] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-01T17:09:45.119424] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-01T17:09:45.120131] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-01T17:09:45.120198] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-01T17:09:45.121797] [DEBUG] [LOCAL ] AKR: Trimmed 65461 records to 45714 (keeping 200 days of data) [2025-10-01T17:09:45.420592] [DEBUG] [LOCAL ] AKR: Primary data saved (45714 records). [2025-10-01T17:09:45.420748] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-01T17:09:45.421741] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AKR took 44.8s. Estimated remaining: 4h 48m 59s. Rate: 7.9 symbols/min [2025-10-01T17:09:45.702384] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-01T17:09:46.117523] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-01T17:09:46.502483] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-01T17:09:46.536070] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T17:09:46.985255] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T17:09:47.302379] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-01T17:09:48.038075] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T17:09:48.102366] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-01T17:09:48.526688] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T17:09:48.902431] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-01T17:09:49.702424] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-01T17:09:49.932245] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T17:09:50.018424] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T17:09:50.502382] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-01T17:09:51.302424] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-01T17:09:51.536574] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T17:09:52.102368] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-01T17:09:52.437476] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T17:09:52.856176] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T17:09:52.902384] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-01T17:09:53.702439] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-01T17:09:54.102834] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-01T17:09:54.223565] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T17:09:54.502440] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-01T17:09:54.843388] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T17:09:55.302456] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-01T17:09:56.102383] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-01T17:09:57.128004] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T17:09:57.139334] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-01T17:09:57.247221] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T17:09:57.593037] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (3.09 seconds). [2025-10-01T17:09:57.594700] [INFO ] [REMOTE ] ALB: Full fetch complete (76821 records). [2025-10-01T17:09:57.594807] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-01T17:09:57.707517] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-01T17:09:58.046931] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-01T17:09:58.047026] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-01T17:09:58.047822] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-01T17:09:58.047919] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-01T17:09:58.049531] [DEBUG] [LOCAL ] ALB: Trimmed 76821 records to 53234 (keeping 200 days of data) [2025-10-01T17:09:58.399632] [DEBUG] [LOCAL ] ALB: Primary data saved (53234 records). [2025-10-01T17:09:58.399803] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-01T17:09:58.399897] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 36.2s. Estimated remaining: 4h 51m 31s. Rate: 7.9 symbols/min [2025-10-01T17:09:59.015308] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T17:09:59.027033] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-01T17:09:59.298473] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T17:09:59.309897] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-01T17:10:00.235445] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T17:10:00.247701] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-01T17:10:00.829402] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T17:10:00.902457] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-01T17:10:01.495833] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T17:10:01.702440] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-01T17:10:03.401161] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-01T17:10:03.402841] [INFO ] [REMOTE ] ALC: Full fetch complete (72948 records). [2025-10-01T17:10:03.402976] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-01T17:10:03.703444] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-01T17:10:03.740035] [INFO ] [REMOTE ] ALE: Full fetch complete (42804 records). [2025-10-01T17:10:03.743788] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-01T17:10:03.994841] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-01T17:10:04.012377] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-01T17:10:04.024863] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-01T17:10:04.035077] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-01T17:10:04.154941] [DEBUG] [LOCAL ] ALC: Trimmed 72948 records to 50825 (keeping 200 days of data) [2025-10-01T17:10:04.400022] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-01T17:10:04.400368] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-01T17:10:04.401150] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-01T17:10:04.401521] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-01T17:10:04.406711] [DEBUG] [LOCAL ] ALE: Trimmed 42804 records to 30653 (keeping 200 days of data) [2025-10-01T17:10:04.824077] [DEBUG] [LOCAL ] ALE: Primary data saved (30653 records). [2025-10-01T17:10:04.824784] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-01T17:10:04.825203] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 22.6s. Estimated remaining: 4h 50m 49s. Rate: 7.9 symbols/min [2025-10-01T17:10:04.828223] [DEBUG] [LOCAL ] ALC: Primary data saved (50825 records). [2025-10-01T17:10:04.828294] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-01T17:10:04.828363] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALC took 34.3s. Estimated remaining: 4h 47m 3s. Rate: 8.0 symbols/min [2025-10-01T17:10:05.535073] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:05.541506] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:05.618009] [DEBUG] [LOCAL ] ALIT: No existing data file found in primary storage. [2025-10-01T17:10:05.619750] [WARN ] [MAIN ] ALIT: No existing data found, performing full refresh instead. [2025-10-01T17:10:05.635534] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:05.642986] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:05.643447] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-01T17:10:05.644061] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-01T17:10:05.644136] [DEBUG] [LOCAL ] ALIT: No primary data file found to delete. [2025-10-01T17:10:05.644263] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-01T17:10:05.773288] [DEBUG] [LOCAL ] ALG: Loaded 10240 existing records from primary storage. [2025-10-01T17:10:05.778680] [INFO ] [MAIN ] ALG: Loaded 10240 existing records. [2025-10-01T17:10:06.023519] [DEBUG] [LOCAL ] ALEX: Loaded 31102 existing records from primary storage. [2025-10-01T17:10:06.069814] [INFO ] [MAIN ] ALEX: Loaded 31102 existing records. [2025-10-01T17:10:06.103528] [DEBUG] [LOCAL ] ALK: Loaded 53053 existing records from primary storage. [2025-10-01T17:10:06.139547] [INFO ] [MAIN ] ALK: Loaded 53053 existing records. [2025-10-01T17:10:06.350470] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:10:06.558057] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-01T17:10:06.618690] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:06.629096] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-01T17:10:06.634578] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-01T17:10:06.759435] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-01T17:10:06.759990] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-01T17:10:06.759330] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:10:06.771605] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:10:06.789639] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-01T17:10:06.820991] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-01T17:10:06.839804] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-01T17:10:06.829975] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-01T17:10:06.865193] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-01T17:10:06.872187] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-01T17:10:06.889900] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-01T17:10:06.940516] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-01T17:10:07.804694] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:07.849579] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-01T17:10:07.987016] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:08.026383] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-01T17:10:08.072741] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:08.073420] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-01T17:10:08.128399] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T17:10:08.140209] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-01T17:10:08.710746] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T17:10:08.713794] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-01T17:10:09.245293] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T17:10:09.252613] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-01T17:10:09.344533] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T17:10:09.355258] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-01T17:10:09.770724] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T17:10:09.774103] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-01T17:10:09.923119] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T17:10:09.934334] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-01T17:10:10.435860] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T17:10:10.453246] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T17:10:10.502446] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-01T17:10:11.016467] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T17:10:11.302355] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-01T17:10:11.421445] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T17:10:11.603310] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T17:10:12.102375] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-01T17:10:12.902408] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-01T17:10:13.205673] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T17:10:13.520488] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T17:10:13.702366] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-01T17:10:13.857580] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T17:10:14.502428] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-01T17:10:14.863010] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T17:10:15.302430] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-01T17:10:16.045230] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T17:10:16.102360] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-01T17:10:16.902372] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-01T17:10:17.125765] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T17:10:17.278540] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T17:10:17.702427] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-01T17:10:18.502365] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-01T17:10:18.560447] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T17:10:19.287132] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T17:10:19.302356] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-01T17:10:19.397718] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T17:10:20.102379] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-01T17:10:20.588520] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T17:10:20.902438] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-01T17:10:21.702415] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-01T17:10:22.288145] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-01T17:10:22.502404] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-01T17:10:22.527148] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T17:10:22.776903] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T17:10:23.302399] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-01T17:10:23.978178] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T17:10:24.102412] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-01T17:10:24.839162] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T17:10:24.902436] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-01T17:10:24.990863] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T17:10:25.702448] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-01T17:10:26.278578] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T17:10:26.502378] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-01T17:10:26.979550] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T17:10:27.302387] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-01T17:10:28.102358] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-01T17:10:28.138277] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T17:10:28.902469] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-01T17:10:28.953407] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T17:10:29.345549] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T17:10:29.649923] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-01T17:10:29.702403] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-01T17:10:30.502415] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-01T17:10:31.302437] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-01T17:10:31.606520] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T17:10:32.042423] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-01T17:10:32.044862] [INFO ] [REMOTE ] ALIT: Full fetch complete (76422 records). [2025-10-01T17:10:32.045032] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-01T17:10:32.112232] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-01T17:10:32.505793] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-01T17:10:32.505904] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-01T17:10:32.506760] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-01T17:10:32.506839] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-01T17:10:32.509778] [DEBUG] [LOCAL ] ALIT: Trimmed 76422 records to 52766 (keeping 200 days of data) [2025-10-01T17:10:32.850753] [DEBUG] [LOCAL ] ALIT: Primary data saved (52766 records). [2025-10-01T17:10:32.850908] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-01T17:10:32.851008] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALIT took 28.0s. Estimated remaining: 4h 56m 35s. Rate: 7.7 symbols/min [2025-10-01T17:10:32.910418] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-01T17:10:33.047686] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:33.105696] [DEBUG] [LOCAL ] ALL: Loaded 50072 existing records from primary storage. [2025-10-01T17:10:33.106036] [INFO ] [MAIN ] ALL: Loaded 50072 existing records. [2025-10-01T17:10:33.307078] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:10:33.307552] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-01T17:10:33.307705] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-01T17:10:33.309102] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-01T17:10:33.309177] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-01T17:10:33.521000] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-01T17:10:33.705096] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-01T17:10:33.756705] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-01T17:10:33.801673] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:33.807375] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-01T17:10:33.809198] [INFO ] [REMOTE ] ALEX: Full fetch complete (44611 records). [2025-10-01T17:10:33.809304] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-01T17:10:34.203184] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-01T17:10:34.203397] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-01T17:10:34.204060] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-01T17:10:34.204175] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-01T17:10:34.206110] [DEBUG] [LOCAL ] ALEX: Trimmed 44611 records to 31083 (keeping 200 days of data) [2025-10-01T17:10:34.414223] [DEBUG] [LOCAL ] ALEX: Primary data saved (31083 records). [2025-10-01T17:10:34.414414] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-01T17:10:34.414535] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 29.6s. Estimated remaining: 4h 53m 34s. Rate: 7.8 symbols/min [2025-10-01T17:10:34.507581] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-01T17:10:34.592508] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:34.641391] [DEBUG] [LOCAL ] ALLE: Loaded 44763 existing records from primary storage. [2025-10-01T17:10:34.641806] [INFO ] [MAIN ] ALLE: Loaded 44763 existing records. [2025-10-01T17:10:34.820734] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:10:34.820991] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-01T17:10:34.821042] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-01T17:10:34.823515] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-01T17:10:34.823581] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-01T17:10:35.195699] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:35.302364] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-01T17:10:35.428266] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T17:10:36.102446] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-01T17:10:36.190605] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T17:10:36.860710] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T17:10:36.902335] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-01T17:10:37.702376] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-01T17:10:38.441039] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T17:10:38.496848] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-01T17:10:38.499950] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T17:10:38.508868] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-01T17:10:38.509158] [INFO ] [REMOTE ] ALK: Full fetch complete (76834 records). [2025-10-01T17:10:38.510079] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-01T17:10:39.008680] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-01T17:10:39.008802] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-01T17:10:39.009603] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-01T17:10:39.009891] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-01T17:10:39.011791] [DEBUG] [LOCAL ] ALK: Trimmed 76834 records to 53054 (keeping 200 days of data) [2025-10-01T17:10:39.319132] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-01T17:10:39.343209] [DEBUG] [LOCAL ] ALK: Primary data saved (53054 records). [2025-10-01T17:10:39.343368] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-01T17:10:39.343501] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 34.5s. Estimated remaining: 4h 52m 10s. Rate: 7.8 symbols/min [2025-10-01T17:10:39.533780] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:39.589203] [DEBUG] [LOCAL ] ALLY: Loaded 53219 existing records from primary storage. [2025-10-01T17:10:39.589661] [INFO ] [MAIN ] ALLY: Loaded 53219 existing records. [2025-10-01T17:10:39.771513] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:10:39.771871] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-01T17:10:39.771926] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-01T17:10:39.773428] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-01T17:10:39.773508] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-01T17:10:40.111209] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-01T17:10:40.193333] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:40.200453] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T17:10:40.233977] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T17:10:40.902380] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-01T17:10:41.702374] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-01T17:10:41.831286] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T17:10:42.502348] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-01T17:10:42.557217] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T17:10:43.174353] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T17:10:43.302377] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-01T17:10:44.105162] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-01T17:10:44.111197] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T17:10:44.902348] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-01T17:10:45.103202] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T17:10:45.702404] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-01T17:10:45.932221] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T17:10:46.378879] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T17:10:46.502432] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-01T17:10:47.307607] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-01T17:10:47.339197] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T17:10:48.081988] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T17:10:48.102401] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-01T17:10:48.191109] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-01T17:10:48.192213] [INFO ] [REMOTE ] ALG: Full fetch complete (15893 records). [2025-10-01T17:10:48.192307] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-01T17:10:48.598377] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-01T17:10:48.598456] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-01T17:10:48.598721] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-01T17:10:48.598784] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-01T17:10:48.599328] [DEBUG] [LOCAL ] ALG: Trimmed 15893 records to 10239 (keeping 200 days of data) [2025-10-01T17:10:48.669932] [DEBUG] [LOCAL ] ALG: Primary data saved (10239 records). [2025-10-01T17:10:48.670119] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-01T17:10:48.670246] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALG took 43.8s. Estimated remaining: 4h 52m 48s. Rate: 7.8 symbols/min [2025-10-01T17:10:48.854444] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:10:48.902586] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-01T17:10:48.905086] [DEBUG] [LOCAL ] ALSN: Loaded 43237 existing records from primary storage. [2025-10-01T17:10:48.905633] [INFO ] [MAIN ] ALSN: Loaded 43237 existing records. [2025-10-01T17:10:49.102737] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:10:49.102970] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-01T17:10:49.103019] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-01T17:10:49.103822] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-01T17:10:49.103885] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-01T17:10:49.494342] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:10:49.702388] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-01T17:10:49.759054] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T17:10:50.198891] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:10:50.502442] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-01T17:10:51.302395] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-01T17:10:51.331300] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T17:10:51.716037] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T17:10:52.102421] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-01T17:10:52.902402] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-01T17:10:53.109279] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T17:10:53.616147] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T17:10:53.702420] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-01T17:10:54.473207] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T17:10:54.502358] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-01T17:10:55.004474] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T17:10:55.302396] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-01T17:10:56.102439] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-01T17:10:56.348667] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T17:10:56.902354] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-01T17:10:57.096151] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T17:10:57.708474] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-01T17:10:57.729226] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T17:10:58.366811] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T17:10:58.502406] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-01T17:10:58.957013] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T17:10:59.302391] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-01T17:11:00.102361] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-01T17:11:00.269219] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T17:11:00.902390] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-01T17:11:01.257631] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-01T17:11:01.702390] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-01T17:11:01.880333] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T17:11:02.110629] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T17:11:02.502391] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-01T17:11:03.163461] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T17:11:03.302393] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-01T17:11:04.102404] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-01T17:11:04.480624] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-01T17:11:04.482031] [INFO ] [REMOTE ] ALLE: Full fetch complete (64770 records). [2025-10-01T17:11:04.482131] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-01T17:11:04.902780] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-01T17:11:04.964091] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-01T17:11:04.964257] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-01T17:11:04.965040] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-01T17:11:04.965329] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-01T17:11:04.967582] [DEBUG] [LOCAL ] ALLE: Trimmed 64770 records to 44729 (keeping 200 days of data) [2025-10-01T17:11:05.250599] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T17:11:05.337366] [DEBUG] [LOCAL ] ALLE: Primary data saved (44729 records). [2025-10-01T17:11:05.337528] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-01T17:11:05.342497] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALLE took 30.9s. Estimated remaining: 4h 56m 42s. Rate: 7.7 symbols/min [2025-10-01T17:11:05.550987] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:05.574577] [DEBUG] [LOCAL ] ALTG: Loaded 23519 existing records from primary storage. [2025-10-01T17:11:05.574875] [INFO ] [MAIN ] ALTG: Loaded 23519 existing records. [2025-10-01T17:11:05.707490] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-01T17:11:05.775979] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:05.776295] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-01T17:11:05.776358] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-01T17:11:05.776805] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-01T17:11:05.776868] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-01T17:11:06.176768] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:06.202784] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:11:06.463211] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-01T17:11:06.464882] [INFO ] [REMOTE ] ALL: Full fetch complete (72466 records). [2025-10-01T17:11:06.465006] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-01T17:11:06.512131] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-01T17:11:06.891267] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-01T17:11:06.891350] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-01T17:11:06.892059] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-01T17:11:06.892127] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-01T17:11:06.893788] [DEBUG] [LOCAL ] ALL: Trimmed 72466 records to 50049 (keeping 200 days of data) [2025-10-01T17:11:07.231801] [DEBUG] [LOCAL ] ALL: Primary data saved (50049 records). [2025-10-01T17:11:07.232074] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-01T17:11:07.233796] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALL took 34.4s. Estimated remaining: 4h 53m 58s. Rate: 7.8 symbols/min [2025-10-01T17:11:07.305786] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-01T17:11:07.427088] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:07.440168] [DEBUG] [LOCAL ] ALUR: Loaded 10769 existing records from primary storage. [2025-10-01T17:11:07.440393] [INFO ] [MAIN ] ALUR: Loaded 10769 existing records. [2025-10-01T17:11:07.666548] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T17:11:07.684897] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:07.686044] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-01T17:11:07.686514] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-01T17:11:07.686914] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-01T17:11:07.686988] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-01T17:11:08.115389] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-01T17:11:08.122829] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:08.165280] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T17:11:08.366969] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T17:11:08.902390] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-01T17:11:09.497735] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T17:11:09.702416] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-01T17:11:10.494907] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T17:11:10.504384] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-01T17:11:10.702693] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T17:11:11.302392] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-01T17:11:11.977784] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T17:11:12.102432] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-01T17:11:12.786886] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T17:11:12.902396] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-01T17:11:13.702409] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-01T17:11:14.107061] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T17:11:14.418879] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-01T17:11:14.420795] [INFO ] [REMOTE ] ALLY: Full fetch complete (76907 records). [2025-10-01T17:11:14.420945] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-01T17:11:14.503767] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-01T17:11:14.829610] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T17:11:14.908502] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-01T17:11:14.908612] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-01T17:11:14.909487] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-01T17:11:14.909633] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-01T17:11:14.911473] [DEBUG] [LOCAL ] ALLY: Trimmed 76907 records to 53217 (keeping 200 days of data) [2025-10-01T17:11:15.250926] [DEBUG] [LOCAL ] ALLY: Primary data saved (53217 records). [2025-10-01T17:11:15.251067] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-01T17:11:15.251151] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 35.9s. Estimated remaining: 4h 53m 58s. Rate: 7.8 symbols/min [2025-10-01T17:11:15.313680] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-01T17:11:15.453768] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:15.502785] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T17:11:15.522009] [DEBUG] [LOCAL ] ALV: Loaded 42426 existing records from primary storage. [2025-10-01T17:11:15.522820] [INFO ] [MAIN ] ALV: Loaded 42426 existing records. [2025-10-01T17:11:15.724015] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:15.724324] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-01T17:11:15.724393] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-01T17:11:15.724939] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-01T17:11:15.725014] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-01T17:11:16.108071] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-01T17:11:16.143945] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:16.589510] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-01T17:11:16.902438] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-01T17:11:17.308309] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T17:11:17.702433] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-01T17:11:18.356116] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T17:11:18.502354] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-01T17:11:18.529735] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T17:11:19.302408] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-01T17:11:19.341839] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-01T17:11:20.102384] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-01T17:11:20.907463] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-01T17:11:20.925171] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T17:11:21.702397] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-01T17:11:21.943706] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T17:11:22.502406] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-01T17:11:23.123536] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T17:11:23.302391] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-01T17:11:23.554601] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T17:11:24.005862] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (3.90 seconds). [2025-10-01T17:11:24.102387] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-01T17:11:24.692866] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T17:11:24.817921] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T17:11:24.902444] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-01T17:11:25.702377] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-01T17:11:26.502372] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-01T17:11:26.671630] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T17:11:26.943303] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-01T17:11:26.944827] [INFO ] [REMOTE ] ALSN: Full fetch complete (62215 records). [2025-10-01T17:11:26.944984] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-01T17:11:27.304869] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-01T17:11:27.385571] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-01T17:11:27.385821] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-01T17:11:27.386492] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-01T17:11:27.386665] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-01T17:11:27.388457] [DEBUG] [LOCAL ] ALSN: Trimmed 62215 records to 43288 (keeping 200 days of data) [2025-10-01T17:11:27.513126] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T17:11:27.701834] [DEBUG] [LOCAL ] ALSN: Primary data saved (43288 records). [2025-10-01T17:11:27.701968] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-01T17:11:27.702064] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALSN took 39.0s. Estimated remaining: 4h 55m 53s. Rate: 7.7 symbols/min [2025-10-01T17:11:27.893376] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:27.902564] [DEBUG] [LOCAL ] ALX: Loaded 6175 existing records from primary storage. [2025-10-01T17:11:27.902859] [INFO ] [MAIN ] ALX: Loaded 6175 existing records. [2025-10-01T17:11:28.070197] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T17:11:28.110509] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-01T17:11:28.117663] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:28.118807] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-01T17:11:28.118877] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-01T17:11:28.119139] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-01T17:11:28.119209] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-01T17:11:28.534932] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:28.778134] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T17:11:28.902382] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-01T17:11:29.702380] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-01T17:11:30.162888] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T17:11:30.502381] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-01T17:11:30.533096] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-01T17:11:30.533932] [INFO ] [REMOTE ] ALUR: Full fetch complete (20398 records). [2025-10-01T17:11:30.534004] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-01T17:11:30.943773] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-01T17:11:30.943860] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-01T17:11:30.944139] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-01T17:11:30.944180] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-01T17:11:30.945039] [DEBUG] [LOCAL ] ALUR: Trimmed 20398 records to 10774 (keeping 200 days of data) [2025-10-01T17:11:31.015281] [DEBUG] [LOCAL ] ALUR: Primary data saved (10774 records). [2025-10-01T17:11:31.015430] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-01T17:11:31.015516] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALUR took 23.8s. Estimated remaining: 4h 53m 51s. Rate: 7.8 symbols/min [2025-10-01T17:11:31.200731] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:31.271596] [DEBUG] [LOCAL ] AM: Loaded 52080 existing records from primary storage. [2025-10-01T17:11:31.271970] [INFO ] [MAIN ] AM: Loaded 52080 existing records. [2025-10-01T17:11:31.307534] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-01T17:11:31.542621] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:31.542900] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-01T17:11:31.542951] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-01T17:11:31.543420] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-01T17:11:31.543482] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-01T17:11:31.854058] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T17:11:31.978193] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T17:11:31.984510] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:32.102410] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-01T17:11:32.609634] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-01T17:11:32.902378] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-01T17:11:33.702394] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-01T17:11:34.253225] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T17:11:34.327321] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T17:11:34.502397] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-01T17:11:35.302380] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-01T17:11:35.786792] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T17:11:36.102353] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-01T17:11:36.149597] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T17:11:36.902400] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-01T17:11:37.399087] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T17:11:37.400836] [INFO ] [REMOTE ] ALTG: Full fetch complete (33627 records). [2025-10-01T17:11:37.400939] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-01T17:11:37.711056] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-01T17:11:37.816748] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-01T17:11:37.816827] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-01T17:11:37.817216] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-01T17:11:37.817262] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-01T17:11:37.818235] [DEBUG] [LOCAL ] ALTG: Trimmed 33627 records to 23483 (keeping 200 days of data) [2025-10-01T17:11:37.967081] [DEBUG] [LOCAL ] ALTG: Primary data saved (23483 records). [2025-10-01T17:11:37.967225] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-01T17:11:37.967315] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALTG took 32.6s. Estimated remaining: 4h 53m 23s. Rate: 7.8 symbols/min [2025-10-01T17:11:38.156266] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:38.200293] [DEBUG] [LOCAL ] AMBC: Loaded 36609 existing records from primary storage. [2025-10-01T17:11:38.200823] [INFO ] [MAIN ] AMBC: Loaded 36609 existing records. [2025-10-01T17:11:38.291422] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T17:11:38.434042] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:38.434345] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-01T17:11:38.434395] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-01T17:11:38.434840] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-01T17:11:38.434902] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-01T17:11:38.504738] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-01T17:11:38.928219] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T17:11:38.991451] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:39.226455] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T17:11:39.302429] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-01T17:11:40.102387] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-01T17:11:40.310740] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T17:11:40.902404] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-01T17:11:41.605845] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T17:11:41.702357] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-01T17:11:41.745338] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T17:11:42.502422] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-01T17:11:43.183554] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T17:11:43.302397] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-01T17:11:43.730035] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T17:11:44.102398] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-01T17:11:44.558683] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T17:11:44.902397] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-01T17:11:45.573802] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T17:11:45.696786] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T17:11:45.702376] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-01T17:11:46.502390] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-01T17:11:47.302390] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-01T17:11:47.768578] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-01T17:11:48.053254] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T17:11:48.102361] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-01T17:11:48.195602] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T17:11:48.902425] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-01T17:11:49.332128] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T17:11:49.702387] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-01T17:11:50.273739] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T17:11:50.502401] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-01T17:11:50.980445] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-01T17:11:51.196878] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T17:11:51.302427] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-01T17:11:52.051622] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T17:11:52.102353] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-01T17:11:52.902379] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-01T17:11:53.702399] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-01T17:11:53.966700] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T17:11:53.969406] [INFO ] [REMOTE ] ALV: Full fetch complete (61813 records). [2025-10-01T17:11:53.969523] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-01T17:11:54.396709] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-01T17:11:54.397074] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-01T17:11:54.397946] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-01T17:11:54.398123] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-01T17:11:54.399633] [DEBUG] [LOCAL ] ALV: Trimmed 61813 records to 42369 (keeping 200 days of data) [2025-10-01T17:11:54.502774] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-01T17:11:54.676888] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T17:11:54.742565] [DEBUG] [LOCAL ] ALV: Primary data saved (42369 records). [2025-10-01T17:11:54.742729] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-01T17:11:54.742827] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALV took 39.5s. Estimated remaining: 4h 57m 2s. Rate: 7.7 symbols/min [2025-10-01T17:11:54.958104] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:55.002821] [DEBUG] [LOCAL ] AMBP: Loaded 45060 existing records from primary storage. [2025-10-01T17:11:55.003170] [INFO ] [MAIN ] AMBP: Loaded 45060 existing records. [2025-10-01T17:11:55.214993] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:55.215370] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-01T17:11:55.215435] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-01T17:11:55.216021] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-01T17:11:55.216090] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-01T17:11:55.305952] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-01T17:11:55.376948] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T17:11:55.524363] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T17:11:55.548185] [INFO ] [REMOTE ] ALX: Full fetch complete (7097 records). [2025-10-01T17:11:55.560945] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-01T17:11:55.846059] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:56.073355] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-01T17:11:56.073435] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-01T17:11:56.073601] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-01T17:11:56.073662] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-01T17:11:56.074094] [DEBUG] [LOCAL ] ALX: Trimmed 7097 records to 6227 (keeping 200 days of data) [2025-10-01T17:11:56.103110] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-01T17:11:56.116888] [DEBUG] [LOCAL ] ALX: Primary data saved (6227 records). [2025-10-01T17:11:56.117025] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-01T17:11:56.117112] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALX took 28.4s. Estimated remaining: 4h 54m 15s. Rate: 7.7 symbols/min [2025-10-01T17:11:56.301221] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:56.301413] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-01T17:11:56.301453] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-01T17:11:56.301566] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-01T17:11:56.301609] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-01T17:11:56.301683] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-01T17:11:56.301739] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-01T17:11:56.689030] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:56.902427] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-01T17:11:57.073071] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T17:11:57.256451] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:11:57.256785] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-01T17:11:57.256878] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:11:57.256957] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-01T17:11:57.257025] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:11:57.257098] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-01T17:11:57.257185] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-01T17:11:57.257279] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-01T17:11:57.257339] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-01T17:11:57.257392] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 1.1s. Estimated remaining: 4h 51m 25s. Rate: 7.8 symbols/min [2025-10-01T17:11:57.458479] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:11:57.511130] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-10-01T17:11:57.511474] [INFO ] [MAIN ] AMC: Loaded 53760 existing records. [2025-10-01T17:11:57.706521] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-01T17:11:57.724790] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:11:57.726304] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-01T17:11:57.726383] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-01T17:11:57.740931] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-01T17:11:57.766608] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-01T17:11:57.793485] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T17:11:58.186748] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:11:58.502427] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-01T17:11:59.221397] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T17:11:59.302386] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-01T17:11:59.978294] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T17:12:00.102406] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-01T17:12:00.728912] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T17:12:00.902391] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-01T17:12:01.089252] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T17:12:01.702406] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-01T17:12:02.502353] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-01T17:12:02.594308] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T17:12:03.238637] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T17:12:03.302396] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-01T17:12:03.671873] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-01T17:12:04.102392] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-01T17:12:04.902354] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-01T17:12:05.171516] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T17:12:05.702397] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-01T17:12:05.785185] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T17:12:06.246019] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T17:12:06.502394] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-01T17:12:07.240605] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T17:12:07.302401] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-01T17:12:07.832956] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T17:12:08.102388] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-01T17:12:08.595035] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T17:12:08.902417] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-01T17:12:09.702381] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-01T17:12:10.502422] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-01T17:12:10.757453] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-01T17:12:10.906356] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-01T17:12:10.909501] [INFO ] [REMOTE ] AM: Full fetch complete (75593 records). [2025-10-01T17:12:10.909636] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-01T17:12:11.310805] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-01T17:12:11.367636] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-01T17:12:11.367972] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-01T17:12:11.369508] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-01T17:12:11.370110] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-01T17:12:11.382910] [DEBUG] [LOCAL ] AM: Trimmed 75593 records to 52063 (keeping 200 days of data) [2025-10-01T17:12:11.403901] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T17:12:11.534861] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T17:12:11.777702] [DEBUG] [LOCAL ] AM: Primary data saved (52063 records). [2025-10-01T17:12:11.777858] [INFO ] [MAIN ] AM: Full history saved. [2025-10-01T17:12:11.778021] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AM took 40.8s. Estimated remaining: 4h 54m 4s. Rate: 7.7 symbols/min [2025-10-01T17:12:11.965747] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:12:12.019412] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-01T17:12:12.019762] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-01T17:12:12.107542] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-01T17:12:12.217768] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:12:12.218034] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-01T17:12:12.218086] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-01T17:12:12.218937] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-01T17:12:12.218998] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-01T17:12:12.599170] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:12:12.902389] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-01T17:12:13.702404] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-01T17:12:13.757048] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-01T17:12:13.846862] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-01T17:12:13.848404] [INFO ] [REMOTE ] AMBC: Full fetch complete (51272 records). [2025-10-01T17:12:13.848518] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-01T17:12:14.289336] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-01T17:12:14.289461] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-01T17:12:14.290090] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-01T17:12:14.290302] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-01T17:12:14.293212] [DEBUG] [LOCAL ] AMBC: Trimmed 51272 records to 36580 (keeping 200 days of data) [2025-10-01T17:12:14.415342] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:12:14.505063] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-01T17:12:14.558893] [DEBUG] [LOCAL ] AMBC: Primary data saved (36580 records). [2025-10-01T17:12:14.559081] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-01T17:12:14.560050] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBC took 36.6s. Estimated remaining: 4h 51m 57s. Rate: 7.8 symbols/min [2025-10-01T17:12:14.762393] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:12:14.788885] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T17:12:14.846282] [DEBUG] [LOCAL ] AME: Loaded 48527 existing records from primary storage. [2025-10-01T17:12:14.846599] [INFO ] [MAIN ] AME: Loaded 48527 existing records. [2025-10-01T17:12:15.047414] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:12:15.047629] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-01T17:12:15.047713] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-01T17:12:15.048129] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-01T17:12:15.048188] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-01T17:12:15.312733] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-01T17:12:15.452026] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:12:16.102425] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-01T17:12:16.781133] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-01T17:12:16.902388] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-01T17:12:17.013671] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T17:12:17.702434] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-01T17:12:17.786724] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T17:12:18.502389] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-01T17:12:19.137010] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T17:12:19.236045] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-01T17:12:19.302367] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-01T17:12:20.102400] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-01T17:12:20.454474] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-01T17:12:20.902381] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-01T17:12:21.132297] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T17:12:21.706684] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-01T17:12:21.719697] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-01T17:12:22.502400] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-01T17:12:22.555461] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T17:12:22.718184] [DEBUG] [REMOTE ] AMBP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:12:22.718674] [WARN ] [REMOTE ] AMBP: No data returned for month 2025-10 [2025-10-01T17:12:22.718827] [FATAL] [REMOTE ] AMBP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:12:22.718953] [FATAL] [MAIN ] AMBP: Failed to fetch primary data. [2025-10-01T17:12:22.719024] [WARN ] [MAIN ] AMBP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:12:22.719097] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-01T17:12:22.719184] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-10-01T17:12:22.719242] [INFO ] [LOCAL ] AMBP: Starting deletion of derivative data. [2025-10-01T17:12:22.720456] [DEBUG] [LOCAL ] AMBP: Deleted derivative data file. [2025-10-01T17:12:22.720574] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 28.0s. Estimated remaining: 4h 52m 0s. Rate: 7.8 symbols/min [2025-10-01T17:12:22.908573] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:12:22.930348] [DEBUG] [LOCAL ] AMG: Loaded 20444 existing records from primary storage. [2025-10-01T17:12:22.930621] [INFO ] [MAIN ] AMG: Loaded 20444 existing records. [2025-10-01T17:12:23.121849] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:12:23.122064] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-01T17:12:23.122164] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-01T17:12:23.122420] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-01T17:12:23.122480] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-01T17:12:23.309776] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-01T17:12:23.531063] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:12:24.102373] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-01T17:12:24.322518] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T17:12:24.902384] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-01T17:12:25.399548] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T17:12:25.702384] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-01T17:12:26.088219] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-01T17:12:26.502388] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-01T17:12:26.548944] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T17:12:27.302390] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-01T17:12:27.541326] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T17:12:28.102380] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-01T17:12:28.519412] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-01T17:12:28.902368] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-01T17:12:29.046735] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T17:12:29.702387] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-01T17:12:29.880110] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T17:12:29.903668] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T17:12:30.502390] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-01T17:12:31.205530] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T17:12:31.302416] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-01T17:12:31.774688] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-01T17:12:32.102402] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-01T17:12:32.463150] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T17:12:32.902432] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-01T17:12:33.696012] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T17:12:33.706295] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-01T17:12:34.358867] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T17:12:34.502376] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-01T17:12:35.302380] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-01T17:12:36.114308] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-01T17:12:36.129206] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T17:12:36.142383] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-01T17:12:36.651367] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T17:12:36.902381] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-01T17:12:37.702390] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-01T17:12:37.768732] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T17:12:38.033126] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T17:12:38.502384] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-01T17:12:39.302372] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-01T17:12:39.620003] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T17:12:39.905789] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T17:12:40.102417] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-01T17:12:40.902415] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-01T17:12:41.266804] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-01T17:12:41.702365] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-01T17:12:41.794135] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T17:12:42.463773] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T17:12:42.502357] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-01T17:12:43.302406] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-01T17:12:44.020586] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T17:12:44.102368] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-01T17:12:44.902374] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-01T17:12:44.971520] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T17:12:45.148894] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-01T17:12:45.150427] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-10-01T17:12:45.150529] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-01T17:12:45.598459] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-01T17:12:45.598670] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-01T17:12:45.599416] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-01T17:12:45.599464] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-01T17:12:45.601022] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53760 (keeping 200 days of data) [2025-10-01T17:12:45.706818] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-01T17:12:45.709118] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T17:12:45.943340] [DEBUG] [LOCAL ] AMC: Primary data saved (53760 records). [2025-10-01T17:12:45.943495] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-01T17:12:45.943592] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 48.7s. Estimated remaining: 4h 57m 56s. Rate: 7.6 symbols/min [2025-10-01T17:12:46.129167] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:12:46.181499] [DEBUG] [LOCAL ] AMH: Loaded 51702 existing records from primary storage. [2025-10-01T17:12:46.181938] [INFO ] [MAIN ] AMH: Loaded 51702 existing records. [2025-10-01T17:12:46.392049] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:12:46.392430] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-01T17:12:46.392492] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-01T17:12:46.395337] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-01T17:12:46.395408] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-01T17:12:46.507536] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-01T17:12:46.787011] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:12:46.830474] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-01T17:12:46.832294] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-10-01T17:12:46.832411] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-01T17:12:47.268792] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-01T17:12:47.268954] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-01T17:12:47.269820] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-01T17:12:47.269909] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-01T17:12:47.271673] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 53669 (keeping 200 days of data) [2025-10-01T17:12:47.326969] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-01T17:12:47.432351] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T17:12:47.577813] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T17:12:47.673985] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-01T17:12:47.674135] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-01T17:12:47.674221] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 35.9s. Estimated remaining: 4h 55m 26s. Rate: 7.7 symbols/min [2025-10-01T17:12:47.887790] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:12:47.928690] [DEBUG] [LOCAL ] AMN: Loaded 41757 existing records from primary storage. [2025-10-01T17:12:47.929023] [INFO ] [MAIN ] AMN: Loaded 41757 existing records. [2025-10-01T17:12:48.109587] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-01T17:12:48.134715] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:12:48.134927] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-01T17:12:48.134973] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-01T17:12:48.135441] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-01T17:12:48.135500] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-01T17:12:48.523072] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:12:48.902385] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-01T17:12:49.213601] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T17:12:49.702424] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-01T17:12:50.347371] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T17:12:50.349742] [INFO ] [REMOTE ] AME: Full fetch complete (69849 records). [2025-10-01T17:12:50.349919] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-01T17:12:50.505420] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-01T17:12:50.820973] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-01T17:12:50.821150] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-01T17:12:50.823139] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-01T17:12:50.823239] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-01T17:12:50.851428] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-01T17:12:50.860157] [DEBUG] [LOCAL ] AME: Trimmed 69849 records to 48490 (keeping 200 days of data) [2025-10-01T17:12:51.139066] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T17:12:51.235964] [DEBUG] [LOCAL ] AME: Primary data saved (48490 records). [2025-10-01T17:12:51.236110] [INFO ] [MAIN ] AME: Full history saved. [2025-10-01T17:12:51.241023] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 36.7s. Estimated remaining: 4h 53m 41s. Rate: 7.7 symbols/min [2025-10-01T17:12:51.307688] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-01T17:12:51.433283] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:12:51.433529] [DEBUG] [LOCAL ] AMP: No existing data file found in primary storage. [2025-10-01T17:12:51.433603] [WARN ] [MAIN ] AMP: No existing data found, performing full refresh instead. [2025-10-01T17:12:51.433797] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-01T17:12:51.433921] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-01T17:12:51.433993] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-10-01T17:12:51.434031] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-01T17:12:51.646734] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T17:12:51.861969] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:12:52.102383] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-01T17:12:52.779052] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T17:12:52.912349] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-01T17:12:52.920286] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T17:12:53.702419] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-01T17:12:54.328835] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:12:54.502422] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-01T17:12:55.125015] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-01T17:12:55.126145] [INFO ] [REMOTE ] AMG: Full fetch complete (29833 records). [2025-10-01T17:12:55.126308] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-01T17:12:55.316900] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-01T17:12:55.544269] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-01T17:12:55.544351] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-01T17:12:55.544717] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-01T17:12:55.544780] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-01T17:12:55.545538] [DEBUG] [LOCAL ] AMG: Trimmed 29833 records to 20419 (keeping 200 days of data) [2025-10-01T17:12:55.683683] [DEBUG] [LOCAL ] AMG: Primary data saved (20419 records). [2025-10-01T17:12:55.683884] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-01T17:12:55.684049] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 33.0s. Estimated remaining: 4h 52m 18s. Rate: 7.8 symbols/min [2025-10-01T17:12:55.824011] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T17:12:55.909167] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:12:55.967184] [DEBUG] [LOCAL ] AMPX: Loaded 52247 existing records from primary storage. [2025-10-01T17:12:55.967596] [INFO ] [MAIN ] AMPX: Loaded 52247 existing records. [2025-10-01T17:12:56.107467] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-01T17:12:56.177552] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:12:56.177858] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-01T17:12:56.177969] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-01T17:12:56.178730] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-01T17:12:56.178794] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-01T17:12:56.590529] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:12:56.882554] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:12:56.902386] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-01T17:12:57.177533] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T17:12:57.702432] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-01T17:12:58.211413] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T17:12:58.502421] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-01T17:12:59.302359] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-01T17:12:59.738973] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T17:13:00.102366] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-01T17:13:00.471434] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T17:13:00.902361] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-01T17:13:01.096072] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T17:13:01.707480] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-01T17:13:01.723102] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T17:13:02.502487] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-01T17:13:02.586309] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T17:13:03.048933] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T17:13:03.302403] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-01T17:13:03.694447] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T17:13:04.102397] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-01T17:13:04.876033] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T17:13:04.902407] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-01T17:13:05.391764] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T17:13:05.702391] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-01T17:13:06.502372] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-01T17:13:06.797879] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T17:13:06.868360] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T17:13:07.302395] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-01T17:13:07.904359] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T17:13:08.102377] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-01T17:13:08.512577] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T17:13:08.902396] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-01T17:13:09.543917] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T17:13:09.702403] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-01T17:13:10.502369] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-01T17:13:10.813332] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T17:13:11.124087] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T17:13:11.302414] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-01T17:13:12.102371] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-01T17:13:12.232919] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T17:13:12.397315] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T17:13:12.902401] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-01T17:13:13.702356] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-01T17:13:13.769740] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T17:13:14.502405] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-01T17:13:14.577591] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T17:13:15.302386] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-01T17:13:15.712725] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T17:13:16.102404] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-01T17:13:16.305210] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T17:13:16.306678] [INFO ] [REMOTE ] AMP: Full fetch complete (47674 records). [2025-10-01T17:13:16.306816] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-01T17:13:16.736804] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-01T17:13:16.736946] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-01T17:13:16.737586] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-01T17:13:16.737679] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-01T17:13:16.739279] [DEBUG] [LOCAL ] AMP: Trimmed 47674 records to 32225 (keeping 200 days of data) [2025-10-01T17:13:16.905529] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-01T17:13:16.959991] [DEBUG] [LOCAL ] AMP: Primary data saved (32225 records). [2025-10-01T17:13:16.960240] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-01T17:13:16.960395] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMP took 25.7s. Estimated remaining: 4h 57m 15s. Rate: 7.6 symbols/min [2025-10-01T17:13:17.159735] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:13:17.197209] [DEBUG] [LOCAL ] AMPY: Loaded 37712 existing records from primary storage. [2025-10-01T17:13:17.197517] [INFO ] [MAIN ] AMPY: Loaded 37712 existing records. [2025-10-01T17:13:17.398073] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:13:17.398559] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-01T17:13:17.398742] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-01T17:13:17.399570] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-01T17:13:17.399691] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-01T17:13:17.510619] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-01T17:13:17.562309] [INFO ] [REMOTE ] AMH: Full fetch complete (74791 records). [2025-10-01T17:13:17.583706] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-01T17:13:17.611307] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T17:13:17.717123] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-01T17:13:18.028421] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:13:18.287710] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-01T17:13:18.287821] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-01T17:13:18.288635] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-01T17:13:18.288725] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-01T17:13:18.290296] [DEBUG] [LOCAL ] AMH: Trimmed 74791 records to 51715 (keeping 200 days of data) [2025-10-01T17:13:18.511590] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-01T17:13:18.630505] [DEBUG] [LOCAL ] AMH: Primary data saved (51715 records). [2025-10-01T17:13:18.630746] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-01T17:13:18.630959] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 32.7s. Estimated remaining: 4h 54m 50s. Rate: 7.7 symbols/min [2025-10-01T17:13:18.820967] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:13:18.851928] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-01T17:13:18.887305] [DEBUG] [LOCAL ] AMR: Loaded 28930 existing records from primary storage. [2025-10-01T17:13:18.887592] [INFO ] [MAIN ] AMR: Loaded 28930 existing records. [2025-10-01T17:13:19.090542] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:13:19.090833] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-01T17:13:19.090885] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-01T17:13:19.091141] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-01T17:13:19.091209] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-01T17:13:19.287220] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T17:13:19.322633] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-01T17:13:19.539312] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:13:19.564799] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T17:13:20.102404] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-01T17:13:20.902419] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-01T17:13:21.007068] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T17:13:21.311061] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-01T17:13:21.702406] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-01T17:13:22.260031] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T17:13:22.502394] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-01T17:13:23.030966] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T17:13:23.302374] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-01T17:13:23.648063] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T17:13:24.102370] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-01T17:13:24.902366] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-01T17:13:24.933913] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T17:13:25.705283] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-01T17:13:25.708848] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T17:13:26.104559] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T17:13:26.502382] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-01T17:13:27.302388] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-01T17:13:27.572266] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-01T17:13:27.573740] [INFO ] [REMOTE ] AMN: Full fetch complete (60331 records). [2025-10-01T17:13:27.573843] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-01T17:13:28.007525] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-01T17:13:28.007612] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-01T17:13:28.008275] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-01T17:13:28.008339] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-01T17:13:28.009691] [DEBUG] [LOCAL ] AMN: Trimmed 60331 records to 41777 (keeping 200 days of data) [2025-10-01T17:13:28.103734] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-01T17:13:28.271563] [DEBUG] [LOCAL ] AMN: Primary data saved (41777 records). [2025-10-01T17:13:28.271717] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-01T17:13:28.271804] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMN took 40.6s. Estimated remaining: 4h 55m 23s. Rate: 7.7 symbols/min [2025-10-01T17:13:28.466293] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:13:28.509706] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T17:13:28.529357] [DEBUG] [LOCAL ] AMRC: Loaded 38174 existing records from primary storage. [2025-10-01T17:13:28.529634] [INFO ] [MAIN ] AMRC: Loaded 38174 existing records. [2025-10-01T17:13:28.752558] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:13:28.753008] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-01T17:13:28.753115] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-01T17:13:28.753632] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-01T17:13:28.753730] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-01T17:13:28.912233] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-01T17:13:29.067135] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-01T17:13:29.242139] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:13:29.254556] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T17:13:29.702397] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-01T17:13:30.463381] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T17:13:30.502353] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-01T17:13:30.749889] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T17:13:31.302384] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-01T17:13:32.102398] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-01T17:13:32.349218] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T17:13:32.776605] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-01T17:13:32.902367] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-01T17:13:33.080296] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T17:13:33.702380] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-01T17:13:34.502379] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-01T17:13:34.649390] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T17:13:35.168815] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-01T17:13:35.302342] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-01T17:13:35.709968] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T17:13:36.102403] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-01T17:13:36.902476] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-01T17:13:37.140151] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T17:13:37.702400] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-01T17:13:38.494680] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T17:13:38.506531] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-01T17:13:38.506684] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (3.20 seconds). [2025-10-01T17:13:38.509849] [INFO ] [REMOTE ] AMPX: Full fetch complete (74672 records). [2025-10-01T17:13:38.510004] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-01T17:13:39.031926] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-01T17:13:39.032175] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-01T17:13:39.033450] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-01T17:13:39.033613] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-01T17:13:39.035876] [DEBUG] [LOCAL ] AMPX: Trimmed 74672 records to 52297 (keeping 200 days of data) [2025-10-01T17:13:39.258385] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T17:13:39.363504] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-01T17:13:39.599055] [DEBUG] [LOCAL ] AMPX: Primary data saved (52297 records). [2025-10-01T17:13:39.599272] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-01T17:13:39.599422] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 43.9s. Estimated remaining: 4h 56m 31s. Rate: 7.6 symbols/min [2025-10-01T17:13:39.886521] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:13:39.886935] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-01T17:13:39.887064] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-01T17:13:39.887283] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-01T17:13:39.887633] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-01T17:13:39.887835] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-01T17:13:39.888101] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-01T17:13:40.021088] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T17:13:40.107560] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-01T17:13:40.385438] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:13:40.902395] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-01T17:13:40.964627] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T17:13:41.564516] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T17:13:41.702418] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-01T17:13:41.854226] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:13:41.854524] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-01T17:13:41.854632] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:13:41.854733] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-01T17:13:41.854803] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:13:41.854878] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-01T17:13:41.854977] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-01T17:13:41.855034] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-01T17:13:41.855139] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-01T17:13:41.855215] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 2.3s. Estimated remaining: 4h 54m 23s. Rate: 7.7 symbols/min [2025-10-01T17:13:42.051633] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:13:42.106550] [DEBUG] [LOCAL ] AMT: Loaded 52429 existing records from primary storage. [2025-10-01T17:13:42.106935] [INFO ] [MAIN ] AMT: Loaded 52429 existing records. [2025-10-01T17:13:42.329693] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:13:42.330508] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-01T17:13:42.330586] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-01T17:13:42.331311] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-01T17:13:42.331372] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-01T17:13:42.507064] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-01T17:13:42.646949] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T17:13:42.790468] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:13:43.302390] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-01T17:13:44.102357] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-01T17:13:44.189122] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T17:13:44.522821] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T17:13:44.902390] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-01T17:13:45.702356] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-01T17:13:45.965190] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T17:13:46.056809] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T17:13:46.502391] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-01T17:13:46.716126] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T17:13:47.302401] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-01T17:13:47.686490] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:13:48.102427] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-01T17:13:48.818036] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-01T17:13:48.819425] [INFO ] [REMOTE ] AMR: Full fetch complete (39985 records). [2025-10-01T17:13:48.819502] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-01T17:13:48.907510] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-01T17:13:49.227397] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-01T17:13:49.227493] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-01T17:13:49.228017] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-01T17:13:49.228083] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-01T17:13:49.229091] [DEBUG] [LOCAL ] AMR: Trimmed 39985 records to 28962 (keeping 200 days of data) [2025-10-01T17:13:49.408186] [DEBUG] [LOCAL ] AMR: Primary data saved (28962 records). [2025-10-01T17:13:49.408317] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-01T17:13:49.408399] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMR took 30.8s. Estimated remaining: 4h 54m 10s. Rate: 7.7 symbols/min [2025-10-01T17:13:49.595718] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:13:49.618831] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T17:13:49.644251] [DEBUG] [LOCAL ] AMTB: Loaded 20278 existing records from primary storage. [2025-10-01T17:13:49.644522] [INFO ] [MAIN ] AMTB: Loaded 20278 existing records. [2025-10-01T17:13:49.714454] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-01T17:13:49.854741] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:13:49.854954] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-01T17:13:49.855004] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-01T17:13:49.855276] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-01T17:13:49.855335] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-01T17:13:50.260311] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:13:50.502434] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-01T17:13:50.637967] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T17:13:51.062993] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T17:13:51.302388] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-01T17:13:51.935431] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T17:13:52.102419] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-01T17:13:52.902372] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-01T17:13:53.087487] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-01T17:13:53.252947] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T17:13:53.702395] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-01T17:13:54.240605] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T17:13:54.502396] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-01T17:13:55.302401] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-01T17:13:55.591915] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T17:13:55.616906] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T17:13:56.102387] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-01T17:13:56.902384] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-01T17:13:57.138633] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T17:13:57.189830] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T17:13:57.191259] [INFO ] [REMOTE ] AMRC: Full fetch complete (53010 records). [2025-10-01T17:13:57.191352] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-01T17:13:57.603038] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-01T17:13:57.603116] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-01T17:13:57.603639] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-01T17:13:57.603724] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-01T17:13:57.605702] [DEBUG] [LOCAL ] AMRC: Trimmed 53010 records to 38146 (keeping 200 days of data) [2025-10-01T17:13:57.702413] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-01T17:13:57.843723] [DEBUG] [LOCAL ] AMRC: Primary data saved (38146 records). [2025-10-01T17:13:57.843862] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-01T17:13:57.843946] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 29.6s. Estimated remaining: 4h 54m 16s. Rate: 7.7 symbols/min [2025-10-01T17:13:58.036136] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:13:58.060089] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T17:13:58.069929] [DEBUG] [LOCAL ] AMTD: Loaded 3603 existing records from primary storage. [2025-10-01T17:13:58.070460] [INFO ] [MAIN ] AMTD: Loaded 3603 existing records. [2025-10-01T17:13:58.258872] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:13:58.259109] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-01T17:13:58.259182] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-01T17:13:58.259428] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-01T17:13:58.259489] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-01T17:13:58.503155] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-01T17:13:58.653245] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:13:58.890113] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T17:13:59.302385] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-01T17:14:00.102431] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-01T17:14:00.405239] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T17:14:00.497000] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-01T17:14:00.498787] [INFO ] [REMOTE ] AMPY: Full fetch complete (51231 records). [2025-10-01T17:14:00.498919] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-01T17:14:00.914143] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-01T17:14:00.933542] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-01T17:14:00.933620] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-01T17:14:00.934220] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-01T17:14:00.934275] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-01T17:14:00.935412] [DEBUG] [LOCAL ] AMPY: Trimmed 51231 records to 37804 (keeping 200 days of data) [2025-10-01T17:14:01.178982] [DEBUG] [LOCAL ] AMPY: Primary data saved (37804 records). [2025-10-01T17:14:01.179134] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-01T17:14:01.180826] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMPY took 44.2s. Estimated remaining: 4h 52m 34s. Rate: 7.7 symbols/min [2025-10-01T17:14:01.382957] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:14:01.434314] [DEBUG] [LOCAL ] AMTM: Loaded 50639 existing records from primary storage. [2025-10-01T17:14:01.434622] [INFO ] [MAIN ] AMTM: Loaded 50639 existing records. [2025-10-01T17:14:01.639668] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:14:01.639877] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-01T17:14:01.639927] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-01T17:14:01.640472] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-01T17:14:01.640533] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-01T17:14:01.703612] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-01T17:14:02.001733] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T17:14:02.084210] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:14:02.118127] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-01T17:14:02.478065] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T17:14:02.502395] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-01T17:14:03.198082] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T17:14:03.302406] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-01T17:14:04.102394] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-01T17:14:04.261399] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T17:14:04.902390] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-01T17:14:05.549717] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T17:14:05.617767] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T17:14:05.702386] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-01T17:14:06.502455] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-01T17:14:07.302387] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-01T17:14:07.465534] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T17:14:07.667104] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-01T17:14:08.102393] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-01T17:14:08.460215] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-01T17:14:08.896790] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T17:14:08.902364] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-01T17:14:09.702441] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-01T17:14:09.864900] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T17:14:10.502382] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-01T17:14:11.308849] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-01T17:14:11.314988] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T17:14:11.623595] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T17:14:11.624796] [INFO ] [REMOTE ] AMTB: Full fetch complete (29987 records). [2025-10-01T17:14:11.624898] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-01T17:14:12.024873] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-01T17:14:12.024966] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-01T17:14:12.025516] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-01T17:14:12.025582] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-01T17:14:12.027220] [DEBUG] [LOCAL ] AMTB: Trimmed 29987 records to 20347 (keeping 200 days of data) [2025-10-01T17:14:12.114433] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-01T17:14:12.157034] [DEBUG] [LOCAL ] AMTB: Primary data saved (20347 records). [2025-10-01T17:14:12.157184] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-01T17:14:12.157275] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 22.7s. Estimated remaining: 4h 53m 33s. Rate: 7.7 symbols/min [2025-10-01T17:14:12.349453] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:14:12.360659] [DEBUG] [LOCAL ] AMWL: Loaded 8761 existing records from primary storage. [2025-10-01T17:14:12.360915] [INFO ] [MAIN ] AMWL: Loaded 8761 existing records. [2025-10-01T17:14:12.560939] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:14:12.561228] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-01T17:14:12.561324] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-01T17:14:12.561749] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-01T17:14:12.561822] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-01T17:14:12.880786] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T17:14:12.908995] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-01T17:14:13.009225] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:14:13.544733] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T17:14:13.702359] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-01T17:14:13.791988] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T17:14:14.026818] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-01T17:14:14.502389] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-01T17:14:15.302427] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-01T17:14:16.102389] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-01T17:14:16.159276] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T17:14:16.477588] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-01T17:14:16.907948] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-01T17:14:16.927944] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T17:14:17.581568] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T17:14:17.702384] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-01T17:14:18.502352] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-01T17:14:18.562700] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T17:14:19.302386] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-01T17:14:20.060714] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T17:14:20.102385] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-01T17:14:20.149319] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T17:14:20.902370] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-01T17:14:20.946136] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T17:14:21.621074] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T17:14:21.702422] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-01T17:14:22.502376] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-01T17:14:23.057033] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T17:14:23.302365] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-01T17:14:23.378444] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T17:14:23.900443] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T17:14:24.102406] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-01T17:14:24.902412] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-01T17:14:25.367567] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-01T17:14:25.702398] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-01T17:14:25.846631] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T17:14:26.502382] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-01T17:14:26.673155] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T17:14:26.674053] [INFO ] [REMOTE ] AMTD: Full fetch complete (5554 records). [2025-10-01T17:14:26.674156] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-01T17:14:27.089100] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-01T17:14:27.089293] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-01T17:14:27.089501] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-01T17:14:27.089608] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-01T17:14:27.096023] [DEBUG] [LOCAL ] AMTD: Trimmed 5554 records to 3610 (keeping 200 days of data) [2025-10-01T17:14:27.096808] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T17:14:27.121435] [DEBUG] [LOCAL ] AMTD: Primary data saved (3610 records). [2025-10-01T17:14:27.121553] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-01T17:14:27.121812] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 29.3s. Estimated remaining: 4h 55m 53s. Rate: 7.6 symbols/min [2025-10-01T17:14:27.313343] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-01T17:14:27.317921] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:14:27.374044] [DEBUG] [LOCAL ] AMX: Loaded 49110 existing records from primary storage. [2025-10-01T17:14:27.374386] [INFO ] [MAIN ] AMX: Loaded 49110 existing records. [2025-10-01T17:14:27.577090] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:14:27.577321] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-01T17:14:27.577373] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-01T17:14:27.578029] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-01T17:14:27.578094] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-01T17:14:27.987770] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T17:14:27.993178] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:14:28.102362] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-01T17:14:28.902379] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-01T17:14:29.597764] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T17:14:29.702361] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-01T17:14:29.851087] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T17:14:30.502399] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-01T17:14:31.302386] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-01T17:14:32.102419] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-01T17:14:32.391304] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-01T17:14:32.393979] [INFO ] [REMOTE ] AMT: Full fetch complete (76010 records). [2025-10-01T17:14:32.394181] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-01T17:14:32.632755] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T17:14:32.904956] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-01T17:14:32.917824] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-01T17:14:33.075915] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-01T17:14:33.076143] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-01T17:14:33.077048] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-01T17:14:33.077205] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-01T17:14:33.088570] [DEBUG] [LOCAL ] AMT: Trimmed 76010 records to 52425 (keeping 200 days of data) [2025-10-01T17:14:33.108553] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T17:14:33.480459] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T17:14:33.490358] [DEBUG] [LOCAL ] AMT: Primary data saved (52425 records). [2025-10-01T17:14:33.490517] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-01T17:14:33.490623] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMT took 51.6s. Estimated remaining: 4h 55m 15s. Rate: 7.7 symbols/min [2025-10-01T17:14:33.673628] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:14:33.707751] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-01T17:14:33.710355] [DEBUG] [LOCAL ] AN: Loaded 32016 existing records from primary storage. [2025-10-01T17:14:33.710693] [INFO ] [MAIN ] AN: Loaded 32016 existing records. [2025-10-01T17:14:33.903784] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:14:33.904012] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-01T17:14:33.904062] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-01T17:14:33.904453] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-01T17:14:33.904521] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-01T17:14:34.290677] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:14:34.502387] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-01T17:14:34.530247] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T17:14:35.302391] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-01T17:14:36.102385] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-01T17:14:36.127132] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T17:14:36.902380] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-01T17:14:37.109660] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T17:14:37.660141] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T17:14:37.702361] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-01T17:14:38.156519] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T17:14:38.157505] [INFO ] [REMOTE ] AMWL: Full fetch complete (14105 records). [2025-10-01T17:14:38.157576] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-01T17:14:38.507508] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-01T17:14:38.592950] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-01T17:14:38.593026] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-01T17:14:38.593298] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-01T17:14:38.593365] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-01T17:14:38.593996] [DEBUG] [LOCAL ] AMWL: Trimmed 14105 records to 8847 (keeping 200 days of data) [2025-10-01T17:14:38.649341] [DEBUG] [LOCAL ] AMWL: Primary data saved (8847 records). [2025-10-01T17:14:38.649495] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-01T17:14:38.649585] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMWL took 26.5s. Estimated remaining: 4h 54m 13s. Rate: 7.7 symbols/min [2025-10-01T17:14:38.844840] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:14:38.901860] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-01T17:14:38.902190] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-01T17:14:39.128209] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:14:39.128697] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-01T17:14:39.128861] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-01T17:14:39.129921] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-01T17:14:39.129990] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-01T17:14:39.299044] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T17:14:39.304408] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-01T17:14:39.596216] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:14:39.995856] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T17:14:40.102382] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-01T17:14:40.542074] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T17:14:40.902383] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-01T17:14:41.702421] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-01T17:14:42.194102] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T17:14:42.335561] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-01T17:14:42.502404] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-01T17:14:43.302622] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-01T17:14:43.630977] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T17:14:44.100837] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-01T17:14:44.102338] [INFO ] [REMOTE ] AMTM: Full fetch complete (73978 records). [2025-10-01T17:14:44.102678] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-01T17:14:44.102428] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-01T17:14:44.549416] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-01T17:14:44.549501] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-01T17:14:44.550267] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-01T17:14:44.550333] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-01T17:14:44.551879] [DEBUG] [LOCAL ] AMTM: Trimmed 73978 records to 50643 (keeping 200 days of data) [2025-10-01T17:14:44.867747] [DEBUG] [LOCAL ] AMTM: Primary data saved (50643 records). [2025-10-01T17:14:44.867979] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-01T17:14:44.869070] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 43.7s. Estimated remaining: 4h 53m 34s. Rate: 7.7 symbols/min [2025-10-01T17:14:44.915410] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-01T17:14:45.057442] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:14:45.109664] [DEBUG] [LOCAL ] ANF: Loaded 52136 existing records from primary storage. [2025-10-01T17:14:45.109979] [INFO ] [MAIN ] ANF: Loaded 52136 existing records. [2025-10-01T17:14:45.307857] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:14:45.308286] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-01T17:14:45.308356] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-01T17:14:45.309026] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-01T17:14:45.309208] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-01T17:14:45.474605] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T17:14:45.702574] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-01T17:14:45.807423] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:14:45.838468] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-01T17:14:46.390905] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T17:14:46.502391] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-01T17:14:47.302391] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-01T17:14:47.427158] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T17:14:48.102395] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-01T17:14:48.825541] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-01T17:14:48.902380] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-01T17:14:49.455248] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T17:14:49.553177] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-01T17:14:49.702388] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-01T17:14:50.504721] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-01T17:14:50.510010] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T17:14:51.235448] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T17:14:51.302367] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-01T17:14:52.102423] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-01T17:14:52.660291] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-01T17:14:52.902346] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-01T17:14:53.002918] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T17:14:53.459563] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T17:14:53.702431] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-01T17:14:54.457771] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:14:54.502411] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-01T17:14:54.616045] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T17:14:55.302460] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-01T17:14:56.102424] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-01T17:14:56.390277] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T17:14:56.902390] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-01T17:14:56.995192] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-01T17:14:57.702370] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-01T17:14:57.847545] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T17:14:58.157856] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T17:14:58.502389] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-01T17:14:59.302359] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-01T17:14:59.587852] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T17:14:59.907734] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-01T17:15:00.102383] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-01T17:15:00.902392] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-01T17:15:01.448741] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-01T17:15:01.702433] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-01T17:15:01.767862] [DEBUG] [REMOTE ] AN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:15:01.768294] [WARN ] [REMOTE ] AN: No data returned for month 2025-10 [2025-10-01T17:15:01.768407] [FATAL] [REMOTE ] AN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:15:01.768704] [FATAL] [MAIN ] AN: Failed to fetch primary data. [2025-10-01T17:15:01.768791] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:15:01.768878] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-01T17:15:01.768982] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-01T17:15:01.769056] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-10-01T17:15:01.769724] [DEBUG] [LOCAL ] AN: Deleted derivative data file. [2025-10-01T17:15:01.769829] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AN took 28.3s. Estimated remaining: 4h 56m 26s. Rate: 7.6 symbols/min [2025-10-01T17:15:01.999931] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:02.000279] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-01T17:15:02.000350] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-01T17:15:02.000532] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-01T17:15:02.000598] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-01T17:15:02.000805] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-01T17:15:02.000881] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-01T17:15:02.451481] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:02.470820] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-01T17:15:02.502380] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-01T17:15:02.794798] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:15:02.795101] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-01T17:15:02.795193] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:15:02.795241] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-01T17:15:02.795302] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:15:02.795350] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-01T17:15:02.795407] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-01T17:15:02.795441] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-01T17:15:02.795526] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-01T17:15:02.795603] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 1.0s. Estimated remaining: 4h 54m 4s. Rate: 7.7 symbols/min [2025-10-01T17:15:02.979687] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:02.999839] [DEBUG] [LOCAL ] ANRO: Loaded 18824 existing records from primary storage. [2025-10-01T17:15:03.000082] [INFO ] [MAIN ] ANRO: Loaded 18824 existing records. [2025-10-01T17:15:03.207115] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:15:03.207777] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-01T17:15:03.207857] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-01T17:15:03.208266] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-01T17:15:03.208327] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-01T17:15:03.305614] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-01T17:15:03.462662] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T17:15:03.677056] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:04.102370] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-01T17:15:04.902433] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-01T17:15:05.525060] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:15:05.702374] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-01T17:15:05.813502] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-01T17:15:06.480509] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T17:15:06.502346] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-01T17:15:07.302420] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-01T17:15:07.674091] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-01T17:15:07.675801] [INFO ] [REMOTE ] AMX: Full fetch complete (70722 records). [2025-10-01T17:15:07.675953] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-01T17:15:08.109571] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-01T17:15:08.144019] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-01T17:15:08.144132] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-01T17:15:08.144974] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-01T17:15:08.145178] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-01T17:15:08.147209] [DEBUG] [LOCAL ] AMX: Trimmed 70722 records to 49131 (keeping 200 days of data) [2025-10-01T17:15:08.282736] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T17:15:08.509335] [DEBUG] [LOCAL ] AMX: Primary data saved (49131 records). [2025-10-01T17:15:08.509484] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-01T17:15:08.509593] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AMX took 41.4s. Estimated remaining: 4h 53m 15s. Rate: 7.7 symbols/min [2025-10-01T17:15:08.706424] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:08.732325] [DEBUG] [LOCAL ] ANVS: Loaded 23170 existing records from primary storage. [2025-10-01T17:15:08.732616] [INFO ] [MAIN ] ANVS: Loaded 23170 existing records. [2025-10-01T17:15:08.905868] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-01T17:15:08.957036] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:15:08.957412] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-01T17:15:08.957475] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-01T17:15:08.957797] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-01T17:15:08.957929] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-01T17:15:09.087532] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T17:15:09.394933] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:09.582254] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-01T17:15:09.702407] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-01T17:15:10.502358] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-01T17:15:10.671408] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T17:15:10.802249] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T17:15:11.302406] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-01T17:15:12.102390] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-01T17:15:12.766481] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T17:15:12.831263] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-01T17:15:12.902402] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-01T17:15:13.085860] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T17:15:13.702441] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-01T17:15:14.502382] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-01T17:15:14.870339] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T17:15:15.302419] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-01T17:15:15.579288] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T17:15:16.102418] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-01T17:15:16.363157] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (3.46 seconds). [2025-10-01T17:15:16.364813] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-01T17:15:16.364937] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-01T17:15:16.844975] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-01T17:15:16.845123] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-01T17:15:16.846419] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-01T17:15:16.846531] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-01T17:15:16.869598] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 53766 (keeping 200 days of data) [2025-10-01T17:15:16.869437] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T17:15:16.939556] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-01T17:15:17.234856] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T17:15:17.282181] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-01T17:15:17.282336] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-01T17:15:17.282423] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 38.6s. Estimated remaining: 4h 53m 26s. Rate: 7.7 symbols/min [2025-10-01T17:15:17.702397] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-01T17:15:17.737955] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T17:15:18.502402] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-01T17:15:18.835417] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T17:15:19.302372] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-01T17:15:20.113501] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-01T17:15:20.135181] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T17:15:20.421920] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T17:15:20.902390] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-01T17:15:21.160806] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T17:15:21.702361] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-01T17:15:21.843295] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T17:15:22.349382] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T17:15:22.502396] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-01T17:15:23.302576] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-01T17:15:23.834776] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T17:15:23.952686] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T17:15:24.102393] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-01T17:15:24.902401] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-01T17:15:25.242344] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T17:15:25.702374] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-01T17:15:26.502356] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-01T17:15:26.587367] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T17:15:26.696236] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T17:15:27.302393] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-01T17:15:27.893884] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-01T17:15:27.894979] [INFO ] [REMOTE ] ANRO: Full fetch complete (29451 records). [2025-10-01T17:15:27.895075] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-01T17:15:28.104705] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-01T17:15:28.353401] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-01T17:15:28.353556] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-01T17:15:28.353966] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-01T17:15:28.354033] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-01T17:15:28.355339] [DEBUG] [LOCAL ] ANRO: Trimmed 29451 records to 18746 (keeping 200 days of data) [2025-10-01T17:15:28.466756] [DEBUG] [LOCAL ] ANRO: Primary data saved (18746 records). [2025-10-01T17:15:28.466900] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-01T17:15:28.467019] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 25.7s. Estimated remaining: 4h 54m 22s. Rate: 7.7 symbols/min [2025-10-01T17:15:29.127193] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T17:15:29.131924] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-01T17:15:29.562360] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-01T17:15:29.564082] [INFO ] [REMOTE ] ANF: Full fetch complete (75593 records). [2025-10-01T17:15:29.564245] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-01T17:15:30.002867] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-01T17:15:30.002999] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-01T17:15:30.003976] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-01T17:15:30.004270] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-01T17:15:30.005969] [DEBUG] [LOCAL ] ANF: Trimmed 75593 records to 52129 (keeping 200 days of data) [2025-10-01T17:15:30.126841] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T17:15:30.135120] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-01T17:15:30.372291] [DEBUG] [LOCAL ] ANF: Primary data saved (52129 records). [2025-10-01T17:15:30.372443] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-01T17:15:30.374449] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANF took 45.5s. Estimated remaining: 4h 52m 22s. Rate: 7.7 symbols/min [2025-10-01T17:15:31.410499] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T17:15:31.411545] [INFO ] [REMOTE ] ANVS: Full fetch complete (36387 records). [2025-10-01T17:15:31.411632] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-01T17:15:31.832630] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-01T17:15:31.832746] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-01T17:15:31.833158] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-01T17:15:31.833251] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-01T17:15:31.834156] [DEBUG] [LOCAL ] ANVS: Trimmed 36387 records to 23194 (keeping 200 days of data) [2025-10-01T17:15:31.970362] [DEBUG] [LOCAL ] ANVS: Primary data saved (23194 records). [2025-10-01T17:15:31.970526] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-01T17:15:31.970633] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 23.5s. Estimated remaining: 4h 50m 18s. Rate: 7.8 symbols/min [2025-10-01T17:15:32.687067] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:32.721682] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:32.757825] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-01T17:15:32.758316] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-01T17:15:32.818065] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-01T17:15:32.834462] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:32.858702] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:32.859210] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-01T17:15:32.860478] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-01T17:15:32.860712] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-01T17:15:33.010578] [DEBUG] [LOCAL ] AOD: Loaded 30085 existing records from primary storage. [2025-10-01T17:15:33.016755] [INFO ] [MAIN ] AOD: Loaded 30085 existing records. [2025-10-01T17:15:33.228137] [DEBUG] [LOCAL ] AOMR: Loaded 16575 existing records from primary storage. [2025-10-01T17:15:33.337594] [INFO ] [MAIN ] AOMR: Loaded 16575 existing records. [2025-10-01T17:15:33.327059] [DEBUG] [LOCAL ] AON: Loaded 45425 existing records from primary storage. [2025-10-01T17:15:33.414223] [INFO ] [MAIN ] AON: Loaded 45425 existing records. [2025-10-01T17:15:33.722955] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:15:33.850600] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-01T17:15:33.816354] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:33.877007] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-01T17:15:33.900403] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-01T17:15:33.964456] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-01T17:15:34.000668] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:15:33.977613] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-01T17:15:34.059891] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-01T17:15:34.035607] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:15:34.097053] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-01T17:15:34.126026] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-01T17:15:34.126143] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-01T17:15:34.137273] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-01T17:15:34.148578] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:15:34.159291] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-01T17:15:34.164918] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-01T17:15:34.196523] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:15:34.214402] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-01T17:15:34.230620] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-01T17:15:34.252614] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-01T17:15:34.337570] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:15:34.404576] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-01T17:15:34.456283] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-01T17:15:34.466396] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-01T17:15:34.557126] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-01T17:15:34.634173] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.7s. Estimated remaining: 4h 48m 36s. Rate: 7.8 symbols/min [2025-10-01T17:15:35.249097] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:35.286484] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-01T17:15:35.339448] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:15:35.479933] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:35.561552] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:35.525174] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-01T17:15:35.562255] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-01T17:15:35.577305] [DEBUG] [LOCAL ] AORT: Loaded 29478 existing records from primary storage. [2025-10-01T17:15:35.577592] [INFO ] [MAIN ] AORT: Loaded 29478 existing records. [2025-10-01T17:15:35.771539] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:15:35.771817] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-01T17:15:35.771868] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-01T17:15:35.772241] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-01T17:15:35.772300] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-01T17:15:36.174330] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:15:36.174799] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-01T17:15:36.368361] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T17:15:36.376260] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-01T17:15:36.536747] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T17:15:36.539933] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-01T17:15:37.105490] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T17:15:37.115131] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-01T17:15:37.123038] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T17:15:37.126079] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-01T17:15:37.481379] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T17:15:37.702373] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-01T17:15:37.783194] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T17:15:37.983567] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T17:15:38.502408] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-01T17:15:38.677508] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T17:15:38.738640] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T17:15:39.269106] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T17:15:39.302391] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-01T17:15:40.102360] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-01T17:15:40.489973] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T17:15:40.902466] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-01T17:15:41.636544] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T17:15:41.702389] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-01T17:15:42.057911] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T17:15:42.502409] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-01T17:15:43.210593] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T17:15:43.302402] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-01T17:15:43.482871] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T17:15:44.102407] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-01T17:15:44.237956] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-01T17:15:44.902401] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-01T17:15:45.702393] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-01T17:15:45.845140] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T17:15:45.879144] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T17:15:46.500265] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T17:15:46.504387] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-01T17:15:47.302400] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-01T17:15:48.014663] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T17:15:48.102397] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-01T17:15:48.394359] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T17:15:48.902436] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-01T17:15:49.312836] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T17:15:49.702388] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-01T17:15:50.045901] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T17:15:50.502474] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-01T17:15:51.245123] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T17:15:51.302360] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-01T17:15:51.347447] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T17:15:52.102368] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-01T17:15:52.255038] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T17:15:52.530460] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-01T17:15:52.902390] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-01T17:15:53.702359] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-01T17:15:53.877155] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T17:15:54.502420] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-01T17:15:54.806914] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T17:15:55.302426] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-01T17:15:55.724285] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-01T17:15:56.102401] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-01T17:15:56.534921] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T17:15:56.902402] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-01T17:15:57.173844] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T17:15:57.702392] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-01T17:15:58.502410] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-01T17:15:58.593535] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T17:15:58.810820] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T17:15:59.302428] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-01T17:15:59.458731] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T17:16:00.102544] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-01T17:16:00.391325] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T17:16:00.392696] [INFO ] [REMOTE ] AOMR: Full fetch complete (23168 records). [2025-10-01T17:16:00.392780] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-01T17:16:00.838041] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-01T17:16:00.838175] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-01T17:16:00.838518] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-01T17:16:00.838610] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-01T17:16:00.839448] [DEBUG] [LOCAL ] AOMR: Trimmed 23168 records to 16542 (keeping 200 days of data) [2025-10-01T17:16:00.914707] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-01T17:16:00.946074] [DEBUG] [LOCAL ] AOMR: Primary data saved (16542 records). [2025-10-01T17:16:00.946238] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-01T17:16:00.946375] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 29.0s. Estimated remaining: 4h 54m 12s. Rate: 7.6 symbols/min [2025-10-01T17:16:01.159328] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:01.214873] [DEBUG] [LOCAL ] AOS: Loaded 48866 existing records from primary storage. [2025-10-01T17:16:01.215312] [INFO ] [MAIN ] AOS: Loaded 48866 existing records. [2025-10-01T17:16:01.423941] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:16:01.424303] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-01T17:16:01.424413] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-01T17:16:01.425151] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-01T17:16:01.425261] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-01T17:16:01.706976] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-01T17:16:01.880920] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:01.914475] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T17:16:01.925525] [DEBUG] [REMOTE ] AORT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:16:01.925988] [WARN ] [REMOTE ] AORT: No data returned for month 2025-10 [2025-10-01T17:16:01.926091] [FATAL] [REMOTE ] AORT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:16:01.926229] [FATAL] [MAIN ] AORT: Failed to fetch primary data. [2025-10-01T17:16:01.926305] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:16:01.926388] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-01T17:16:01.926462] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-01T17:16:01.926501] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-10-01T17:16:01.927164] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-10-01T17:16:01.927260] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AORT took 27.2s. Estimated remaining: 4h 51m 58s. Rate: 7.7 symbols/min [2025-10-01T17:16:02.140717] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:02.142110] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-10-01T17:16:02.142165] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-10-01T17:16:02.142388] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-01T17:16:02.142450] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-01T17:16:02.142504] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-01T17:16:02.142546] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-01T17:16:02.517873] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-01T17:16:02.561338] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:02.946558] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T17:16:03.302393] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-01T17:16:04.032298] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:16:04.102424] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-01T17:16:04.902376] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-01T17:16:04.949697] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T17:16:05.388692] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T17:16:05.702384] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-01T17:16:05.863033] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T17:16:06.502406] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-01T17:16:06.783194] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T17:16:07.088425] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T17:16:07.302433] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-01T17:16:08.102406] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-01T17:16:08.537082] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T17:16:08.902382] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-01T17:16:09.434783] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T17:16:09.702397] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-01T17:16:10.502379] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-01T17:16:10.608057] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T17:16:11.302434] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-01T17:16:11.844050] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-01T17:16:11.848271] [INFO ] [REMOTE ] AON: Full fetch complete (64811 records). [2025-10-01T17:16:11.848390] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-01T17:16:12.068244] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T17:16:12.107538] [INFO ] [REMOTE ] AOD: Full fetch complete (44244 records). [2025-10-01T17:16:12.107379] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-01T17:16:12.113125] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-01T17:16:12.486820] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-01T17:16:12.493528] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-01T17:16:12.515156] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-01T17:16:12.539563] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-01T17:16:12.668093] [DEBUG] [LOCAL ] AON: Trimmed 64811 records to 45428 (keeping 200 days of data) [2025-10-01T17:16:12.798001] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T17:16:12.885832] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-01T17:16:12.887867] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-01T17:16:12.891302] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-01T17:16:12.891516] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-01T17:16:12.904529] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-01T17:16:12.907827] [DEBUG] [LOCAL ] AOD: Trimmed 44244 records to 30194 (keeping 200 days of data) [2025-10-01T17:16:13.070973] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T17:16:13.287143] [DEBUG] [LOCAL ] AOD: Primary data saved (30194 records). [2025-10-01T17:16:13.287836] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-01T17:16:13.288380] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOD took 41.3s. Estimated remaining: 4h 52m 55s. Rate: 7.7 symbols/min [2025-10-01T17:16:13.537384] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:13.552102] [DEBUG] [LOCAL ] AON: Primary data saved (45428 records). [2025-10-01T17:16:13.552290] [INFO ] [MAIN ] AON: Full history saved. [2025-10-01T17:16:13.552452] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 41.6s. Estimated remaining: 4h 50m 32s. Rate: 7.7 symbols/min [2025-10-01T17:16:13.631695] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T17:16:13.705161] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-01T17:16:13.728781] [DEBUG] [LOCAL ] APAM: Loaded 36128 existing records from primary storage. [2025-10-01T17:16:13.744699] [INFO ] [MAIN ] APAM: Loaded 36128 existing records. [2025-10-01T17:16:13.862751] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:13.889076] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-10-01T17:16:13.896223] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-10-01T17:16:13.910467] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-01T17:16:13.917260] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-01T17:16:13.931297] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-01T17:16:13.931438] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-01T17:16:14.191005] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:16:14.202970] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-01T17:16:14.203068] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-01T17:16:14.214354] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-01T17:16:14.230179] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-01T17:16:14.510300] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-01T17:16:14.615345] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:14.854442] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:15.139965] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T17:16:15.230367] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T17:16:15.302387] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-01T17:16:16.086438] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T17:16:16.102450] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-01T17:16:16.907583] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-01T17:16:16.924951] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-01T17:16:17.702388] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-01T17:16:18.502395] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-01T17:16:18.656237] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T17:16:18.731151] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T17:16:19.302394] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-01T17:16:20.103672] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-01T17:16:20.106699] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T17:16:20.151450] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T17:16:20.902382] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-01T17:16:21.495896] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T17:16:21.702392] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-01T17:16:21.896731] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T17:16:22.206866] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T17:16:22.502394] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-01T17:16:23.302402] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-01T17:16:23.971532] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T17:16:24.102383] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-01T17:16:24.762427] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T17:16:24.902386] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-01T17:16:25.507850] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T17:16:25.630114] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T17:16:25.702379] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-01T17:16:26.502379] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-01T17:16:26.685986] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T17:16:26.687031] [INFO ] [REMOTE ] AP: Full fetch complete (8946 records). [2025-10-01T17:16:26.687126] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-01T17:16:27.111241] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-01T17:16:27.111330] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-01T17:16:27.111551] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-01T17:16:27.111595] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-01T17:16:27.112139] [DEBUG] [LOCAL ] AP: Trimmed 8946 records to 7180 (keeping 200 days of data) [2025-10-01T17:16:27.155821] [DEBUG] [LOCAL ] AP: Primary data saved (7180 records). [2025-10-01T17:16:27.155967] [INFO ] [MAIN ] AP: Full history saved. [2025-10-01T17:16:27.156044] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 25.2s. Estimated remaining: 4h 52m 8s. Rate: 7.7 symbols/min [2025-10-01T17:16:27.309017] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-01T17:16:27.345034] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:27.409243] [DEBUG] [LOCAL ] APG: Loaded 50186 existing records from primary storage. [2025-10-01T17:16:27.409707] [INFO ] [MAIN ] APG: Loaded 50186 existing records. [2025-10-01T17:16:27.626897] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:16:27.627145] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-01T17:16:27.627200] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-01T17:16:27.627636] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-01T17:16:27.627730] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-01T17:16:28.042899] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:28.068260] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T17:16:28.102370] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-01T17:16:28.902626] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-01T17:16:28.905765] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T17:16:29.169617] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T17:16:29.702379] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-01T17:16:30.195160] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T17:16:30.502386] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-01T17:16:30.670507] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T17:16:31.302390] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-01T17:16:32.091118] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T17:16:32.102337] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-01T17:16:32.500236] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T17:16:32.902379] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-01T17:16:33.711771] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-01T17:16:33.716525] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T17:16:34.502381] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-01T17:16:34.712034] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T17:16:34.839042] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T17:16:35.302406] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-01T17:16:35.596881] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T17:16:36.102398] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-01T17:16:36.677444] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T17:16:36.902428] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-01T17:16:37.451544] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T17:16:37.702387] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-01T17:16:38.502934] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-01T17:16:38.508358] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T17:16:38.773363] [DEBUG] [REMOTE ] APAM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:16:38.773770] [WARN ] [REMOTE ] APAM: No data returned for month 2025-10 [2025-10-01T17:16:38.773870] [FATAL] [REMOTE ] APAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:16:38.773987] [FATAL] [MAIN ] APAM: Failed to fetch primary data. [2025-10-01T17:16:38.774069] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:16:38.774163] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-01T17:16:38.774247] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-01T17:16:38.774301] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-01T17:16:38.774926] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-01T17:16:38.775053] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. APAM took 25.5s. Estimated remaining: 4h 53m 7s. Rate: 7.7 symbols/min [2025-10-01T17:16:39.001043] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:39.066281] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-01T17:16:39.066749] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-01T17:16:39.271833] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:16:39.272139] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-01T17:16:39.272194] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-01T17:16:39.272866] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-01T17:16:39.272927] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-01T17:16:39.307500] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-01T17:16:39.703955] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:39.958064] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T17:16:40.102410] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-01T17:16:40.778585] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T17:16:40.902408] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-01T17:16:41.662781] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T17:16:41.702380] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-01T17:16:42.464345] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T17:16:42.502416] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-01T17:16:43.015778] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T17:16:43.302416] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-01T17:16:44.102393] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-01T17:16:44.274158] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T17:16:44.616716] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T17:16:44.902413] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-01T17:16:45.702363] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-01T17:16:45.812219] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T17:16:46.509777] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-01T17:16:46.532327] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T17:16:47.173961] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T17:16:47.302435] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-01T17:16:48.102413] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-01T17:16:48.441127] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T17:16:48.442795] [INFO ] [REMOTE ] AOS: Full fetch complete (70631 records). [2025-10-01T17:16:48.442952] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-01T17:16:48.869034] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-01T17:16:48.869213] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-01T17:16:48.870017] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-01T17:16:48.870091] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-01T17:16:48.871831] [DEBUG] [LOCAL ] AOS: Trimmed 70631 records to 48840 (keeping 200 days of data) [2025-10-01T17:16:48.929967] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-01T17:16:49.191044] [DEBUG] [LOCAL ] AOS: Primary data saved (48840 records). [2025-10-01T17:16:49.191366] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-01T17:16:49.192552] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. AOS took 48.2s. Estimated remaining: 4h 53m 45s. Rate: 7.6 symbols/min [2025-10-01T17:16:49.427624] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:49.464358] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-01T17:16:49.507843] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T17:16:49.563670] [DEBUG] [LOCAL ] APLE: Loaded 51941 existing records from primary storage. [2025-10-01T17:16:49.564000] [INFO ] [MAIN ] APLE: Loaded 51941 existing records. [2025-10-01T17:16:49.707500] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-01T17:16:49.778921] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:16:49.779135] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-01T17:16:49.779187] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-01T17:16:49.779762] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-01T17:16:49.779825] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-01T17:16:50.211552] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:50.391108] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T17:16:50.502374] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-01T17:16:51.068800] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T17:16:51.302417] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-01T17:16:52.102356] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-01T17:16:52.235260] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T17:16:52.675254] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T17:16:52.902405] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-01T17:16:53.383782] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T17:16:53.702379] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-01T17:16:53.938286] [DEBUG] [REMOTE ] APG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:16:53.938607] [WARN ] [REMOTE ] APG: No data returned for month 2025-10 [2025-10-01T17:16:53.938729] [FATAL] [REMOTE ] APG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:16:53.938817] [FATAL] [MAIN ] APG: Failed to fetch primary data. [2025-10-01T17:16:53.938884] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:16:53.938959] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-01T17:16:53.939026] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-01T17:16:53.939066] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-10-01T17:16:53.939593] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-10-01T17:16:53.939711] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APG took 26.8s. Estimated remaining: 4h 52m 43s. Rate: 7.7 symbols/min [2025-10-01T17:16:54.136599] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:54.202514] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-01T17:16:54.202878] [INFO ] [MAIN ] APO: Loaded 53383 existing records. [2025-10-01T17:16:54.404113] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:16:54.404372] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-01T17:16:54.404629] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-01T17:16:54.405742] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-01T17:16:54.405806] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-01T17:16:54.510036] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-01T17:16:54.836333] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:55.302413] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-01T17:16:55.666629] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T17:16:56.102432] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-01T17:16:56.522552] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-01T17:16:56.524152] [INFO ] [REMOTE ] APD: Full fetch complete (66748 records). [2025-10-01T17:16:56.524260] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-01T17:16:56.907496] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-01T17:16:56.958873] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-01T17:16:56.958959] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-01T17:16:56.959717] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-01T17:16:56.959827] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-01T17:16:56.961443] [DEBUG] [LOCAL ] APD: Trimmed 66748 records to 45389 (keeping 200 days of data) [2025-10-01T17:16:57.266789] [DEBUG] [LOCAL ] APD: Primary data saved (45389 records). [2025-10-01T17:16:57.266936] [INFO ] [MAIN ] APD: Full history saved. [2025-10-01T17:16:57.267017] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APD took 43.7s. Estimated remaining: 4h 51m 17s. Rate: 7.7 symbols/min [2025-10-01T17:16:57.479372] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:16:57.489409] [DEBUG] [LOCAL ] APOS: Loaded 7580 existing records from primary storage. [2025-10-01T17:16:57.489971] [INFO ] [MAIN ] APOS: Loaded 7580 existing records. [2025-10-01T17:16:57.631521] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-01T17:16:57.707478] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-01T17:16:57.751591] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:16:57.751841] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-01T17:16:57.751891] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-01T17:16:57.752108] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-01T17:16:57.752166] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-01T17:16:58.184152] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:16:58.222735] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T17:16:58.502359] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-01T17:16:58.603846] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T17:16:59.302353] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-01T17:16:59.344054] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T17:17:00.097183] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T17:17:00.102327] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-01T17:17:00.148726] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T17:17:00.826419] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-01T17:17:00.902374] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-01T17:17:01.645673] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T17:17:01.702404] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-01T17:17:02.502386] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-01T17:17:03.302386] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-01T17:17:03.710790] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-01T17:17:04.102402] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-01T17:17:04.249731] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T17:17:04.595772] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T17:17:04.902367] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-01T17:17:05.702401] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-01T17:17:05.982402] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T17:17:06.502391] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-01T17:17:06.643282] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T17:17:06.965387] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T17:17:07.133731] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T17:17:07.302383] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-01T17:17:08.102394] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-01T17:17:08.875746] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T17:17:08.902339] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-01T17:17:09.157171] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T17:17:09.296858] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-01T17:17:09.702411] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-01T17:17:10.487327] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T17:17:10.502350] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-01T17:17:10.963854] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T17:17:11.302383] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-01T17:17:11.940230] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-01T17:17:12.102427] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-01T17:17:12.902411] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-01T17:17:13.656487] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T17:17:13.702342] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-01T17:17:14.026183] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T17:17:14.160984] [DEBUG] [REMOTE ] APOS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:17:14.161308] [WARN ] [REMOTE ] APOS: No data returned for month 2025-10 [2025-10-01T17:17:14.161418] [FATAL] [REMOTE ] APOS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:17:14.161540] [FATAL] [MAIN ] APOS: Failed to fetch primary data. [2025-10-01T17:17:14.161630] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:17:14.161753] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-01T17:17:14.161837] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-01T17:17:14.161877] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-01T17:17:14.162167] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-01T17:17:14.162253] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APOS took 16.9s. Estimated remaining: 4h 53m 45s. Rate: 7.6 symbols/min [2025-10-01T17:17:14.372300] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:17:14.430002] [DEBUG] [LOCAL ] APTV: Loaded 52122 existing records from primary storage. [2025-10-01T17:17:14.430484] [INFO ] [MAIN ] APTV: Loaded 52122 existing records. [2025-10-01T17:17:14.507500] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-01T17:17:14.663713] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:17:14.663960] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-01T17:17:14.664013] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-01T17:17:14.665372] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-01T17:17:14.665441] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-01T17:17:15.104122] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:17:15.302403] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-01T17:17:16.102379] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-01T17:17:16.856068] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T17:17:16.898567] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-01T17:17:16.909290] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-01T17:17:17.695119] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T17:17:17.705574] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-01T17:17:18.502433] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-01T17:17:18.907530] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-01T17:17:19.302365] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-01T17:17:19.389995] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T17:17:20.102368] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-01T17:17:20.213832] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T17:17:20.767583] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T17:17:20.902384] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-01T17:17:21.702377] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-01T17:17:21.790675] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T17:17:22.310538] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T17:17:22.502374] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-01T17:17:23.302376] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-01T17:17:24.096186] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T17:17:24.108540] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-01T17:17:24.559371] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-01T17:17:24.561256] [INFO ] [REMOTE ] APH: Full fetch complete (77684 records). [2025-10-01T17:17:24.561418] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-01T17:17:24.905619] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-01T17:17:25.126965] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-01T17:17:25.127226] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-01T17:17:25.128209] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-01T17:17:25.128296] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-01T17:17:25.131042] [DEBUG] [LOCAL ] APH: Trimmed 77684 records to 53691 (keeping 200 days of data) [2025-10-01T17:17:25.264804] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-01T17:17:25.551531] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-01T17:17:25.551735] [INFO ] [MAIN ] APH: Full history saved. [2025-10-01T17:17:25.551882] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APH took 46.8s. Estimated remaining: 4h 54m 37s. Rate: 7.6 symbols/min [2025-10-01T17:17:25.712774] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-01T17:17:25.749346] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:17:25.802587] [DEBUG] [LOCAL ] AQN: Loaded 51903 existing records from primary storage. [2025-10-01T17:17:25.803006] [INFO ] [MAIN ] AQN: Loaded 51903 existing records. [2025-10-01T17:17:26.010466] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:17:26.010875] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-01T17:17:26.010957] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-01T17:17:26.021978] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-01T17:17:26.040155] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-01T17:17:26.101723] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T17:17:26.461853] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:17:26.502384] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-01T17:17:26.831303] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T17:17:26.854295] [DEBUG] [REMOTE ] APO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:17:26.854612] [WARN ] [REMOTE ] APO: No data returned for month 2025-10 [2025-10-01T17:17:26.854763] [FATAL] [REMOTE ] APO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:17:26.854883] [FATAL] [MAIN ] APO: Failed to fetch primary data. [2025-10-01T17:17:26.854970] [WARN ] [MAIN ] APO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:17:26.855066] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-01T17:17:26.855184] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-01T17:17:26.855249] [INFO ] [LOCAL ] APO: Starting deletion of derivative data. [2025-10-01T17:17:26.855768] [DEBUG] [LOCAL ] APO: Deleted derivative data file. [2025-10-01T17:17:26.855862] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 32.9s. Estimated remaining: 4h 52m 38s. Rate: 7.6 symbols/min [2025-10-01T17:17:27.060186] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:17:27.060404] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-10-01T17:17:27.060462] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-10-01T17:17:27.060582] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-01T17:17:27.060626] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-01T17:17:27.060711] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-10-01T17:17:27.060756] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-01T17:17:27.311258] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-01T17:17:27.479721] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:17:27.956007] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T17:17:28.102395] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-01T17:17:28.876968] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T17:17:28.902410] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-01T17:17:29.355814] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-01T17:17:29.702389] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-01T17:17:30.502446] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-01T17:17:31.119454] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-01T17:17:31.302407] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-01T17:17:31.432825] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T17:17:31.787739] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T17:17:31.853610] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T17:17:32.102424] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-01T17:17:32.902434] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-01T17:17:33.702379] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-01T17:17:33.813281] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T17:17:34.441507] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T17:17:34.502426] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-01T17:17:34.797916] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-01T17:17:35.312823] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-01T17:17:35.319131] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T17:17:35.780077] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T17:17:36.102384] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-01T17:17:36.493118] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-01T17:17:36.902395] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-01T17:17:37.702410] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-01T17:17:38.209490] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T17:17:38.502425] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-01T17:17:38.809296] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T17:17:39.059143] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T17:17:39.302368] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-01T17:17:39.690753] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-01T17:17:40.102385] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-01T17:17:40.455621] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-01T17:17:40.902413] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-01T17:17:41.702398] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-01T17:17:42.505027] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-01T17:17:42.511181] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T17:17:43.051351] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T17:17:43.235366] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T17:17:43.302398] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-01T17:17:44.102404] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-01T17:17:44.655615] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T17:17:44.902413] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-01T17:17:45.534140] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T17:17:45.534947] [INFO ] [REMOTE ] AQNB: Full fetch complete (5801 records). [2025-10-01T17:17:45.535023] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-01T17:17:45.707549] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-01T17:17:45.980062] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-01T17:17:45.980152] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-01T17:17:45.980320] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-01T17:17:45.980363] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-01T17:17:45.980813] [DEBUG] [LOCAL ] AQNB: Trimmed 5801 records to 4164 (keeping 200 days of data) [2025-10-01T17:17:46.009276] [DEBUG] [LOCAL ] AQNB: Primary data saved (4164 records). [2025-10-01T17:17:46.009384] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-01T17:17:46.009455] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. AQNB took 19.2s. Estimated remaining: 4h 55m 39s. Rate: 7.6 symbols/min [2025-10-01T17:17:46.191405] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:17:46.247844] [DEBUG] [LOCAL ] AR: Loaded 53584 existing records from primary storage. [2025-10-01T17:17:46.248224] [INFO ] [MAIN ] AR: Loaded 53584 existing records. [2025-10-01T17:17:46.444594] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-01T17:17:46.458220] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:17:46.458685] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-01T17:17:46.458794] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-01T17:17:46.458883] [INFO ] [REMOTE ] APLE: Full fetch complete (74284 records). [2025-10-01T17:17:46.459138] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-01T17:17:46.507216] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-01T17:17:46.465148] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-01T17:17:46.536392] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-01T17:17:47.240907] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-01T17:17:47.246373] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-01T17:17:47.260309] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-01T17:17:47.265678] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-01T17:17:47.306998] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:17:47.307718] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-01T17:17:47.309503] [DEBUG] [LOCAL ] APLE: Trimmed 74284 records to 51925 (keeping 200 days of data) [2025-10-01T17:17:47.461211] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T17:17:47.698992] [DEBUG] [LOCAL ] APLE: Primary data saved (51925 records). [2025-10-01T17:17:47.699142] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-01T17:17:47.702165] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. APLE took 58.5s. Estimated remaining: 4h 53m 48s. Rate: 7.6 symbols/min [2025-10-01T17:17:47.865856] [DEBUG] [REMOTE ] APTV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:17:47.882813] [WARN ] [REMOTE ] APTV: No data returned for month 2025-10 [2025-10-01T17:17:47.907590] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:17:47.907981] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-01T17:17:47.908055] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-01T17:17:47.907728] [FATAL] [REMOTE ] APTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:17:47.908395] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-01T17:17:47.908669] [FATAL] [MAIN ] APTV: Failed to fetch primary data. [2025-10-01T17:17:47.908816] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:17:47.908916] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-01T17:17:47.909031] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-01T17:17:47.909163] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-01T17:17:47.909298] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-01T17:17:47.909413] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-01T17:17:47.909495] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-01T17:17:47.964002] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-10-01T17:17:47.981804] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 33.8s. Estimated remaining: 4h 51m 35s. Rate: 7.7 symbols/min [2025-10-01T17:17:48.104923] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-01T17:17:48.433208] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:17:48.546444] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:17:48.559398] [DEBUG] [LOCAL ] ARDC: Loaded 14721 existing records from primary storage. [2025-10-01T17:17:48.559728] [INFO ] [MAIN ] ARDC: Loaded 14721 existing records. [2025-10-01T17:17:48.786994] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T17:17:48.792324] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:17:48.792597] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-01T17:17:48.803372] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-01T17:17:48.804242] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-01T17:17:48.804304] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-01T17:17:48.907679] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-01T17:17:49.190367] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:17:49.702447] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-01T17:17:50.089239] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-01T17:17:50.387731] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T17:17:50.502387] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-01T17:17:51.302383] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-01T17:17:51.445237] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T17:17:51.969714] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T17:17:52.102379] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-01T17:17:52.252344] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T17:17:52.585939] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T17:17:52.902385] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-01T17:17:53.702422] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-01T17:17:54.502354] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-01T17:17:54.536290] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T17:17:55.288968] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T17:17:55.302340] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-01T17:17:56.102438] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-01T17:17:56.569705] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-01T17:17:56.902353] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-01T17:17:57.048047] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T17:17:57.049794] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T17:17:57.702373] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-01T17:17:58.502416] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-01T17:17:58.591614] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T17:17:59.023875] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T17:17:59.302382] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-01T17:17:59.944867] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T17:17:59.994321] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T17:18:00.102360] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-01T17:18:00.902384] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-01T17:18:01.702399] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-01T17:18:01.973892] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T17:18:02.502401] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-01T17:18:02.560515] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T17:18:03.053955] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T17:18:03.302377] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-01T17:18:04.102391] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-01T17:18:04.534662] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-01T17:18:04.536159] [INFO ] [REMOTE ] AQN: Full fetch complete (75299 records). [2025-10-01T17:18:04.536263] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-01T17:18:04.913888] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-01T17:18:04.979924] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-01T17:18:04.980122] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-01T17:18:04.981036] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-01T17:18:04.981118] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-01T17:18:04.982973] [DEBUG] [LOCAL ] AQN: Trimmed 75299 records to 51909 (keeping 200 days of data) [2025-10-01T17:18:05.236864] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-01T17:18:05.357782] [DEBUG] [LOCAL ] AQN: Primary data saved (51909 records). [2025-10-01T17:18:05.358067] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-01T17:18:05.358235] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 39.8s. Estimated remaining: 4h 54m 3s. Rate: 7.6 symbols/min [2025-10-01T17:18:05.575987] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:18:05.581124] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T17:18:05.619448] [DEBUG] [LOCAL ] ARDT: Loaded 27698 existing records from primary storage. [2025-10-01T17:18:05.619792] [INFO ] [MAIN ] ARDT: Loaded 27698 existing records. [2025-10-01T17:18:05.707518] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-01T17:18:05.820896] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:18:05.821105] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-01T17:18:05.821154] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-01T17:18:05.821422] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-01T17:18:05.821483] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-01T17:18:06.229010] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:18:06.240739] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T17:18:06.502406] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-01T17:18:07.064955] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T17:18:07.302380] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-01T17:18:07.503796] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T17:18:08.102428] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-01T17:18:08.902399] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-01T17:18:08.991796] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T17:18:09.578851] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T17:18:09.702433] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-01T17:18:10.022722] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T17:18:10.212168] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T17:18:10.502394] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-01T17:18:11.302383] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-01T17:18:12.102365] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-01T17:18:12.351770] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T17:18:12.902357] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-01T17:18:13.104601] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T17:18:13.288587] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T17:18:13.702379] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-01T17:18:14.390105] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T17:18:14.502356] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-01T17:18:14.830254] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T17:18:15.302371] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-01T17:18:15.480509] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T17:18:16.102445] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-01T17:18:16.543419] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T17:18:16.902425] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-01T17:18:17.423947] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T17:18:17.494769] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T17:18:17.702378] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-01T17:18:18.502387] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-01T17:18:19.147269] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T17:18:19.302353] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-01T17:18:19.468211] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T17:18:20.102375] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-01T17:18:20.347999] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T17:18:20.902383] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-01T17:18:21.312149] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T17:18:21.313206] [INFO ] [REMOTE ] ARDC: Full fetch complete (20632 records). [2025-10-01T17:18:21.313284] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-01T17:18:21.707466] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-01T17:18:21.772571] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-01T17:18:21.772684] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-01T17:18:21.773037] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-01T17:18:21.773093] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-01T17:18:21.773745] [DEBUG] [LOCAL ] ARDC: Trimmed 20632 records to 14775 (keeping 200 days of data) [2025-10-01T17:18:21.870792] [DEBUG] [LOCAL ] ARDC: Primary data saved (14775 records). [2025-10-01T17:18:21.870941] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-01T17:18:21.871032] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. ARDC took 33.9s. Estimated remaining: 4h 56m 14s. Rate: 7.5 symbols/min [2025-10-01T17:18:22.068382] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:18:22.120449] [DEBUG] [LOCAL ] ARE: Loaded 50614 existing records from primary storage. [2025-10-01T17:18:22.120865] [INFO ] [MAIN ] ARE: Loaded 50614 existing records. [2025-10-01T17:18:22.332286] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:18:22.332534] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-01T17:18:22.332594] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-01T17:18:22.332870] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-01T17:18:22.332932] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-01T17:18:22.507572] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-01T17:18:22.816548] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:18:23.261425] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-01T17:18:23.263066] [INFO ] [REMOTE ] AR: Full fetch complete (77533 records). [2025-10-01T17:18:23.263179] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-01T17:18:23.307586] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-01T17:18:23.640077] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T17:18:23.757335] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-01T17:18:23.757470] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-01T17:18:23.758460] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-01T17:18:23.758534] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-01T17:18:23.760912] [DEBUG] [LOCAL ] AR: Trimmed 77533 records to 53583 (keeping 200 days of data) [2025-10-01T17:18:23.855886] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-01T17:18:23.861727] [INFO ] [REMOTE ] ARCO: Full fetch complete (65565 records). [2025-10-01T17:18:23.868258] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-01T17:18:24.130445] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-01T17:18:24.503749] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-01T17:18:24.504478] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-01T17:18:24.505563] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-01T17:18:24.505970] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-01T17:18:24.511548] [DEBUG] [LOCAL ] ARCO: Trimmed 65565 records to 44450 (keeping 200 days of data) [2025-10-01T17:18:24.817390] [DEBUG] [LOCAL ] AR: Primary data saved (53583 records). [2025-10-01T17:18:24.823114] [INFO ] [MAIN ] AR: Full history saved. [2025-10-01T17:18:24.823718] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. AR took 38.8s. Estimated remaining: 4h 54m 46s. Rate: 7.6 symbols/min [2025-10-01T17:18:25.047111] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:18:25.104058] [DEBUG] [LOCAL ] ARCO: Primary data saved (44450 records). [2025-10-01T17:18:25.104355] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-01T17:18:25.104639] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 37.4s. Estimated remaining: 4h 52m 36s. Rate: 7.6 symbols/min [2025-10-01T17:18:25.236532] [DEBUG] [LOCAL ] ARES: Loaded 49530 existing records from primary storage. [2025-10-01T17:18:25.237351] [INFO ] [MAIN ] ARES: Loaded 49530 existing records. [2025-10-01T17:18:25.388706] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:18:25.494224] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T17:18:25.582333] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-01T17:18:25.578582] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:18:25.575084] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-01T17:18:25.605528] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-01T17:18:25.608257] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-01T17:18:25.608752] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-01T17:18:25.608850] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-01T17:18:25.707354] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-01T17:18:25.753165] [DEBUG] [LOCAL ] ARI: Loaded 43459 existing records from primary storage. [2025-10-01T17:18:25.754069] [INFO ] [MAIN ] ARI: Loaded 43459 existing records. [2025-10-01T17:18:26.206025] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:18:26.228165] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-01T17:18:26.243707] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-01T17:18:26.266224] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-01T17:18:26.268772] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:18:26.269034] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-01T17:18:26.518179] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-01T17:18:26.720769] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:18:26.758025] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:18:27.227961] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T17:18:27.302394] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-01T17:18:28.102437] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-01T17:18:28.323822] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T17:18:28.373101] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T17:18:28.902421] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-01T17:18:29.359475] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T17:18:29.702414] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-01T17:18:30.502376] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-01T17:18:30.738759] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T17:18:31.158539] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T17:18:31.302407] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-01T17:18:32.102359] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-01T17:18:32.202072] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T17:18:32.781610] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T17:18:32.902393] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-01T17:18:33.615282] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T17:18:33.702414] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-01T17:18:34.379545] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:18:34.502433] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-01T17:18:35.302433] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-01T17:18:35.661165] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T17:18:35.662705] [INFO ] [REMOTE ] ARDT: Full fetch complete (41149 records). [2025-10-01T17:18:35.662887] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-01T17:18:35.891884] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-01T17:18:36.107540] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-01T17:18:36.162001] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-01T17:18:36.162177] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-01T17:18:36.162705] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-01T17:18:36.162768] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-01T17:18:36.163845] [DEBUG] [LOCAL ] ARDT: Trimmed 41149 records to 27653 (keeping 200 days of data) [2025-10-01T17:18:36.332020] [DEBUG] [LOCAL ] ARDT: Primary data saved (27653 records). [2025-10-01T17:18:36.332171] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-01T17:18:36.332260] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 31.0s. Estimated remaining: 4h 53m 22s. Rate: 7.6 symbols/min [2025-10-01T17:18:36.516618] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:18:36.559128] [DEBUG] [LOCAL ] ARIS: Loaded 42103 existing records from primary storage. [2025-10-01T17:18:36.559473] [INFO ] [MAIN ] ARIS: Loaded 42103 existing records. [2025-10-01T17:18:36.763516] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:18:36.763789] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-01T17:18:36.763840] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-01T17:18:36.764404] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-01T17:18:36.764464] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-01T17:18:36.918088] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-01T17:18:37.173197] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:18:37.235300] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T17:18:37.600024] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T17:18:37.702387] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-01T17:18:38.440758] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T17:18:38.502428] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-01T17:18:39.302377] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-01T17:18:39.837925] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-01T17:18:40.102371] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-01T17:18:40.319029] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T17:18:40.753050] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T17:18:40.902385] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-01T17:18:41.707467] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-01T17:18:41.723707] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T17:18:42.502381] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-01T17:18:42.575766] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T17:18:43.109925] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T17:18:43.302389] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-01T17:18:44.102358] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-01T17:18:44.166001] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T17:18:44.567802] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T17:18:44.902391] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-01T17:18:45.702369] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-01T17:18:45.806358] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T17:18:46.416848] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T17:18:46.502381] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-01T17:18:47.302357] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-01T17:18:47.570182] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T17:18:48.107469] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-01T17:18:48.124070] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T17:18:48.868825] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T17:18:48.902346] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-01T17:18:49.702417] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-01T17:18:49.933122] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T17:18:50.509151] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-01T17:18:50.515002] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T17:18:51.279349] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T17:18:51.302373] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-01T17:18:51.450540] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T17:18:52.102385] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-01T17:18:52.902403] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-01T17:18:53.122845] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T17:18:53.702423] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-01T17:18:53.773142] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T17:18:54.214881] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T17:18:54.502417] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-01T17:18:55.302391] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-01T17:18:55.712974] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-01T17:18:55.714682] [INFO ] [REMOTE ] ARE: Full fetch complete (72614 records). [2025-10-01T17:18:55.714814] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-01T17:18:56.112001] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-01T17:18:56.153359] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-01T17:18:56.167624] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-01T17:18:56.168596] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-01T17:18:56.175573] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-01T17:18:56.180533] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T17:18:56.190484] [DEBUG] [LOCAL ] ARE: Trimmed 72614 records to 50634 (keeping 200 days of data) [2025-10-01T17:18:56.393441] [DEBUG] [REMOTE ] ARES: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:18:56.427820] [WARN ] [REMOTE ] ARES: No data returned for month 2025-10 [2025-10-01T17:18:56.429834] [FATAL] [REMOTE ] ARES: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:18:56.430572] [FATAL] [MAIN ] ARES: Failed to fetch primary data. [2025-10-01T17:18:56.430983] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:18:56.432164] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-01T17:18:56.432504] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-01T17:18:56.432888] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-10-01T17:18:56.434300] [DEBUG] [LOCAL ] ARES: Deleted derivative data file. [2025-10-01T17:18:56.434893] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARES took 31.6s. Estimated remaining: 4h 56m 25s. Rate: 7.5 symbols/min [2025-10-01T17:18:56.631263] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:18:56.632881] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-01T17:18:56.633210] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-01T17:18:56.633687] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-01T17:18:56.633761] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-01T17:18:56.634099] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-01T17:18:56.634165] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-01T17:18:56.915005] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-01T17:18:57.123111] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:18:57.141942] [DEBUG] [LOCAL ] ARE: Primary data saved (50634 records). [2025-10-01T17:18:57.142119] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-01T17:18:57.142257] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARE took 35.3s. Estimated remaining: 4h 54m 24s. Rate: 7.6 symbols/min [2025-10-01T17:18:57.326878] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:18:57.327596] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-10-01T17:18:57.327681] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-10-01T17:18:57.327797] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-01T17:18:57.327840] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-01T17:18:57.327919] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-01T17:18:57.327982] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-01T17:18:57.726510] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-01T17:18:57.736544] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T17:18:57.770539] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:18:58.294216] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T17:18:58.502401] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-01T17:18:59.302366] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-01T17:18:59.434236] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T17:18:59.899411] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T17:19:00.102440] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-01T17:19:00.827420] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T17:19:00.902414] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-01T17:19:01.702405] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-01T17:19:01.756457] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T17:19:02.505825] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-01T17:19:02.508032] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T17:19:03.302363] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-01T17:19:03.461523] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T17:19:04.102405] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-01T17:19:04.262217] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T17:19:04.902416] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-01T17:19:05.024305] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T17:19:05.689210] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T17:19:05.702345] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-01T17:19:06.000244] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T17:19:06.502440] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-01T17:19:07.280695] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-01T17:19:07.282196] [INFO ] [REMOTE ] ARIS: Full fetch complete (60487 records). [2025-10-01T17:19:07.282310] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-01T17:19:07.307556] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-01T17:19:07.705382] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-01T17:19:07.705480] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-01T17:19:07.706151] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-01T17:19:07.706216] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-01T17:19:07.707503] [DEBUG] [LOCAL ] ARIS: Trimmed 60487 records to 42157 (keeping 200 days of data) [2025-10-01T17:19:08.033418] [DEBUG] [LOCAL ] ARIS: Primary data saved (42157 records). [2025-10-01T17:19:08.033823] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-01T17:19:08.033972] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARIS took 31.7s. Estimated remaining: 4h 55m 2s. Rate: 7.5 symbols/min [2025-10-01T17:19:08.107273] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-01T17:19:08.297693] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:19:08.298094] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-01T17:19:08.298247] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-01T17:19:08.298445] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-01T17:19:08.298585] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-01T17:19:08.298711] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-01T17:19:08.298837] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-01T17:19:08.461496] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-01T17:19:08.903364] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-01T17:19:08.934776] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:19:09.026982] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T17:19:09.702384] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-01T17:19:10.099890] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-01T17:19:10.101418] [INFO ] [REMOTE ] ARI: Full fetch complete (62848 records). [2025-10-01T17:19:10.101541] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-01T17:19:10.524245] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-01T17:19:10.527586] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-01T17:19:10.527980] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-01T17:19:10.544558] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-01T17:19:10.554444] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-01T17:19:10.556862] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T17:19:10.567383] [DEBUG] [LOCAL ] ARI: Trimmed 62848 records to 43522 (keeping 200 days of data) [2025-10-01T17:19:10.846163] [DEBUG] [LOCAL ] ARI: Primary data saved (43522 records). [2025-10-01T17:19:10.846317] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-01T17:19:10.846445] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARI took 45.7s. Estimated remaining: 4h 53m 35s. Rate: 7.6 symbols/min [2025-10-01T17:19:11.031354] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:19:11.063992] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T17:19:11.123290] [DEBUG] [LOCAL ] ARR: Loaded 52041 existing records from primary storage. [2025-10-01T17:19:11.123628] [INFO ] [MAIN ] ARR: Loaded 52041 existing records. [2025-10-01T17:19:11.302435] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-01T17:19:11.322740] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:19:11.322992] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-01T17:19:11.323047] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-01T17:19:11.323462] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-01T17:19:11.323524] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-01T17:19:11.713970] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:19:12.102372] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-01T17:19:12.244349] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T17:19:12.902393] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-01T17:19:13.123348] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T17:19:13.561609] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T17:19:13.702377] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-01T17:19:14.154432] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T17:19:14.502400] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-01T17:19:14.904108] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T17:19:15.302392] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-01T17:19:16.102347] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-01T17:19:16.312532] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T17:19:16.883855] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T17:19:16.902356] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-01T17:19:17.570718] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T17:19:17.702380] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-01T17:19:18.051606] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T17:19:18.502387] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-01T17:19:18.938958] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T17:19:19.302376] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-01T17:19:20.102354] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-01T17:19:20.174472] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T17:19:20.902374] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-01T17:19:21.600892] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-01T17:19:21.702355] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-01T17:19:21.960821] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T17:19:22.504252] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-01T17:19:22.510071] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T17:19:22.910323] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T17:19:23.302390] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-01T17:19:24.102358] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-01T17:19:24.210821] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T17:19:24.902381] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-01T17:19:24.935607] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T17:19:25.333725] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T17:19:25.702383] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-01T17:19:26.502415] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-01T17:19:26.944884] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-01T17:19:26.946397] [INFO ] [REMOTE ] ARLO: Full fetch complete (62676 records). [2025-10-01T17:19:26.946503] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-01T17:19:27.307515] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-01T17:19:27.383559] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-01T17:19:27.383698] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-01T17:19:27.384384] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-01T17:19:27.384433] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-01T17:19:27.388222] [DEBUG] [LOCAL ] ARLO: Trimmed 62676 records to 43792 (keeping 200 days of data) [2025-10-01T17:19:27.660826] [DEBUG] [LOCAL ] ARLO: Primary data saved (43792 records). [2025-10-01T17:19:27.660966] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-01T17:19:27.661043] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 31.2s. Estimated remaining: 4h 55m 43s. Rate: 7.5 symbols/min [2025-10-01T17:19:27.880844] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T17:19:27.882590] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:19:27.929000] [DEBUG] [LOCAL ] ARW: Loaded 33054 existing records from primary storage. [2025-10-01T17:19:27.929308] [INFO ] [MAIN ] ARW: Loaded 33054 existing records. [2025-10-01T17:19:28.045362] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-01T17:19:28.062989] [INFO ] [REMOTE ] ARMK: Full fetch complete (72584 records). [2025-10-01T17:19:28.078698] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-01T17:19:28.106255] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-01T17:19:28.166365] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:19:28.221484] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-01T17:19:28.232962] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-01T17:19:28.258713] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-01T17:19:28.258839] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-01T17:19:28.964001] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-01T17:19:28.999660] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:19:28.999775] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-01T17:19:29.000970] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-01T17:19:29.001398] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-01T17:19:29.001074] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-01T17:19:29.003885] [DEBUG] [LOCAL ] ARMK: Trimmed 72584 records to 50366 (keeping 200 days of data) [2025-10-01T17:19:29.349948] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T17:19:29.373756] [DEBUG] [LOCAL ] ARMK: Primary data saved (50366 records). [2025-10-01T17:19:29.373918] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-01T17:19:29.374005] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 32.2s. Estimated remaining: 4h 54m 0s. Rate: 7.6 symbols/min [2025-10-01T17:19:29.561436] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:19:29.561796] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-01T17:19:29.561956] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-01T17:19:29.562078] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-01T17:19:29.562122] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-01T17:19:29.562174] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-01T17:19:29.562219] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-01T17:19:29.702789] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-01T17:19:30.005973] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:19:30.009552] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T17:19:30.124701] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T17:19:30.502365] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-01T17:19:31.302367] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-01T17:19:31.530419] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T17:19:31.542562] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:19:31.543543] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-01T17:19:31.544284] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:19:31.544359] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-01T17:19:31.544428] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:19:31.544513] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-01T17:19:31.544589] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-01T17:19:31.544629] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-01T17:19:31.544730] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-01T17:19:31.544789] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 2.2s. Estimated remaining: 4h 52m 26s. Rate: 7.6 symbols/min [2025-10-01T17:19:31.684187] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T17:19:31.764574] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:19:31.818981] [DEBUG] [LOCAL ] AS: Loaded 53084 existing records from primary storage. [2025-10-01T17:19:31.819349] [INFO ] [MAIN ] AS: Loaded 53084 existing records. [2025-10-01T17:19:32.012672] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:19:32.012980] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-01T17:19:32.013052] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-01T17:19:32.013590] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-01T17:19:32.013689] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-01T17:19:32.107553] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-01T17:19:32.406699] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:19:32.902409] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-01T17:19:33.632425] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T17:19:33.702410] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-01T17:19:34.502399] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-01T17:19:34.723964] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T17:19:34.918584] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T17:19:35.302385] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-01T17:19:36.102400] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-01T17:19:36.141762] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T17:19:36.902387] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-01T17:19:37.121094] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T17:19:37.548482] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T17:19:37.702387] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-01T17:19:38.502399] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-01T17:19:38.721136] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T17:19:39.214798] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T17:19:39.302407] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-01T17:19:40.102385] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-01T17:19:40.461571] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T17:19:40.597517] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T17:19:40.902415] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-01T17:19:41.702357] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-01T17:19:41.811277] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T17:19:42.502383] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-01T17:19:42.633122] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T17:19:43.302381] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-01T17:19:43.414120] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T17:19:43.695439] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T17:19:44.102419] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-01T17:19:44.902364] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-01T17:19:45.009770] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T17:19:45.702391] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-01T17:19:46.156498] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T17:19:46.158130] [INFO ] [REMOTE ] AROC: Full fetch complete (70782 records). [2025-10-01T17:19:46.158270] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-01T17:19:46.504262] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-01T17:19:46.597348] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-01T17:19:46.597917] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-01T17:19:46.599043] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-01T17:19:46.599238] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-01T17:19:46.601596] [DEBUG] [LOCAL ] AROC: Trimmed 70782 records to 48961 (keeping 200 days of data) [2025-10-01T17:19:46.731256] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T17:19:46.954611] [DEBUG] [LOCAL ] AROC: Primary data saved (48961 records). [2025-10-01T17:19:46.954774] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-01T17:19:46.954993] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 38.9s. Estimated remaining: 4h 54m 10s. Rate: 7.6 symbols/min [2025-10-01T17:19:47.140323] [DEBUG] [REMOTE ] ARR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:19:47.144164] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:19:47.144632] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-01T17:19:47.144784] [WARN ] [REMOTE ] ARR: No data returned for month 2025-10 [2025-10-01T17:19:47.144959] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-01T17:19:47.145019] [FATAL] [REMOTE ] ARR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:19:47.145325] [FATAL] [MAIN ] ARR: Failed to fetch primary data. [2025-10-01T17:19:47.145408] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-01T17:19:47.145670] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-01T17:19:47.145518] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:19:47.145782] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-01T17:19:47.145917] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-01T17:19:47.146104] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-01T17:19:47.151441] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-01T17:19:47.184514] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-01T17:19:47.238704] [DEBUG] [LOCAL ] ARR: Deleted derivative data file. [2025-10-01T17:19:47.254927] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARR took 36.4s. Estimated remaining: 4h 52m 9s. Rate: 7.6 symbols/min [2025-10-01T17:19:47.308440] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-01T17:19:47.656980] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:19:47.678157] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-01T17:19:47.692818] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-01T17:19:47.726165] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-01T17:19:47.726405] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-01T17:19:47.742700] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-01T17:19:47.748014] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-01T17:19:47.815312] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:19:47.958313] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T17:19:48.107528] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-01T17:19:48.261928] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:19:48.743084] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T17:19:48.902356] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-01T17:19:48.998777] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T17:19:49.702403] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-01T17:19:50.502399] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-01T17:19:50.847187] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T17:19:51.297714] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-01T17:19:51.308117] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-01T17:19:51.910581] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T17:19:52.102407] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-01T17:19:52.477217] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T17:19:52.902380] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-01T17:19:53.702371] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-01T17:19:53.809500] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T17:19:53.891603] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T17:19:54.502383] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-01T17:19:55.302387] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-01T17:19:55.358528] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T17:19:56.102379] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-01T17:19:56.327910] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T17:19:56.387933] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T17:19:56.899622] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T17:19:56.902461] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-01T17:19:57.702386] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-01T17:19:58.001044] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T17:19:58.498255] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T17:19:58.502327] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-01T17:19:59.302387] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-01T17:19:59.564363] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T17:20:00.102453] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-01T17:20:00.902437] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-01T17:20:00.954425] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-01T17:20:00.956202] [INFO ] [REMOTE ] ARW: Full fetch complete (47954 records). [2025-10-01T17:20:00.956385] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-01T17:20:01.300758] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T17:20:01.527169] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-01T17:20:01.527265] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-01T17:20:01.527919] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-01T17:20:01.527997] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-01T17:20:01.529528] [DEBUG] [LOCAL ] ARW: Trimmed 47954 records to 33095 (keeping 200 days of data) [2025-10-01T17:20:01.719264] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-01T17:20:01.745933] [DEBUG] [LOCAL ] ARW: Primary data saved (33095 records). [2025-10-01T17:20:01.746095] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-01T17:20:01.746186] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARW took 34.1s. Estimated remaining: 4h 53m 38s. Rate: 7.6 symbols/min [2025-10-01T17:20:01.944728] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:20:01.944905] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-10-01T17:20:01.944945] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-10-01T17:20:01.945087] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-01T17:20:01.945163] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-01T17:20:01.945224] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-01T17:20:01.945312] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-01T17:20:02.339249] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:20:02.502376] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-01T17:20:02.580939] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T17:20:03.302355] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-01T17:20:03.630951] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-01T17:20:03.906822] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T17:20:04.102390] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-01T17:20:04.272363] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T17:20:04.902414] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-01T17:20:05.702389] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-01T17:20:05.807109] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T17:20:06.502355] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-01T17:20:06.652691] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T17:20:06.702424] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T17:20:07.302385] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-01T17:20:08.102363] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-01T17:20:08.310891] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T17:20:08.352726] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T17:20:08.902387] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-01T17:20:09.702389] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-01T17:20:09.939832] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T17:20:10.421737] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-01T17:20:10.422729] [INFO ] [REMOTE ] ASA: Full fetch complete (18842 records). [2025-10-01T17:20:10.422809] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-01T17:20:10.507496] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-01T17:20:10.842269] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-01T17:20:10.842374] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-01T17:20:10.842711] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-01T17:20:10.842774] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-01T17:20:10.843375] [DEBUG] [LOCAL ] ASA: Trimmed 18842 records to 14164 (keeping 200 days of data) [2025-10-01T17:20:10.928024] [DEBUG] [LOCAL ] ASA: Primary data saved (14164 records). [2025-10-01T17:20:10.928179] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-01T17:20:10.928258] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ASA took 24.0s. Estimated remaining: 4h 53m 48s. Rate: 7.6 symbols/min [2025-10-01T17:20:11.113393] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:20:11.118480] [DEBUG] [LOCAL ] ASBA: Loaded 3450 existing records from primary storage. [2025-10-01T17:20:11.118683] [INFO ] [MAIN ] ASBA: Loaded 3450 existing records. [2025-10-01T17:20:11.319597] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-01T17:20:11.326138] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:20:11.327580] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-01T17:20:11.327676] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-01T17:20:11.327944] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-01T17:20:11.328003] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-01T17:20:11.779763] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T17:20:11.839955] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:20:12.102396] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-01T17:20:12.568400] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T17:20:12.796003] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T17:20:12.902349] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-01T17:20:12.950690] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T17:20:13.436828] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-01T17:20:13.702397] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-01T17:20:14.266084] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T17:20:14.502375] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-01T17:20:15.061054] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-01T17:20:15.302392] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-01T17:20:16.102379] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-01T17:20:16.902349] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-01T17:20:16.944610] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T17:20:17.253110] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-01T17:20:17.702373] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-01T17:20:18.248463] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T17:20:18.343127] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T17:20:18.344957] [INFO ] [REMOTE ] AS: Full fetch complete (76552 records). [2025-10-01T17:20:18.345140] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-01T17:20:18.507478] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-01T17:20:18.800063] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-01T17:20:18.800164] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-01T17:20:18.801078] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-01T17:20:18.801171] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-01T17:20:18.802808] [DEBUG] [LOCAL ] AS: Trimmed 76552 records to 53087 (keeping 200 days of data) [2025-10-01T17:20:18.926205] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-01T17:20:19.133665] [DEBUG] [LOCAL ] AS: Primary data saved (53087 records). [2025-10-01T17:20:19.133886] [INFO ] [MAIN ] AS: Full history saved. [2025-10-01T17:20:19.134002] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. AS took 47.6s. Estimated remaining: 4h 53m 44s. Rate: 7.6 symbols/min [2025-10-01T17:20:19.302516] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-01T17:20:19.321336] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:20:19.360472] [DEBUG] [LOCAL ] ASC: Loaded 37479 existing records from primary storage. [2025-10-01T17:20:19.360822] [INFO ] [MAIN ] ASC: Loaded 37479 existing records. [2025-10-01T17:20:19.554822] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:20:19.555058] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-01T17:20:19.555106] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-01T17:20:19.555331] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-01T17:20:19.555390] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-01T17:20:19.965486] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:20:20.102384] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-01T17:20:20.902411] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-01T17:20:21.443803] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-01T17:20:21.539606] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-01T17:20:21.582307] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T17:20:21.702443] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-01T17:20:22.502425] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-01T17:20:23.133981] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T17:20:23.302420] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-01T17:20:23.765724] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T17:20:23.871998] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T17:20:24.102405] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-01T17:20:24.902427] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-01T17:20:25.702410] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-01T17:20:25.775492] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T17:20:26.227976] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T17:20:26.502384] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-01T17:20:26.504419] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T17:20:27.302436] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-01T17:20:28.102405] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-01T17:20:28.507170] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-01T17:20:28.528547] [DEBUG] [REMOTE ] ASBA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:20:28.528863] [WARN ] [REMOTE ] ASBA: No data returned for month 2025-10 [2025-10-01T17:20:28.528954] [FATAL] [REMOTE ] ASBA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:20:28.529035] [FATAL] [MAIN ] ASBA: Failed to fetch primary data. [2025-10-01T17:20:28.529115] [WARN ] [MAIN ] ASBA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:20:28.529195] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-01T17:20:28.529260] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-10-01T17:20:28.529302] [INFO ] [LOCAL ] ASBA: Starting deletion of derivative data. [2025-10-01T17:20:28.529600] [DEBUG] [LOCAL ] ASBA: Deleted derivative data file. [2025-10-01T17:20:28.529712] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASBA took 17.6s. Estimated remaining: 4h 53m 57s. Rate: 7.5 symbols/min [2025-10-01T17:20:28.727262] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:20:28.727441] [DEBUG] [LOCAL ] ASG: No existing data file found in primary storage. [2025-10-01T17:20:28.727484] [WARN ] [MAIN ] ASG: No existing data found, performing full refresh instead. [2025-10-01T17:20:28.727606] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-01T17:20:28.727677] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-01T17:20:28.727742] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-10-01T17:20:28.727780] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-01T17:20:28.906289] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-01T17:20:29.132025] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:20:29.169327] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T17:20:29.702401] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-01T17:20:30.507516] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-01T17:20:30.527170] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T17:20:31.302434] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-01T17:20:31.342712] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T17:20:31.666621] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T17:20:32.102410] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-01T17:20:32.902400] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-01T17:20:33.551925] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T17:20:33.702396] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-01T17:20:34.063912] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T17:20:34.502439] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-01T17:20:35.006510] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (3.70 seconds). [2025-10-01T17:20:35.013059] [INFO ] [REMOTE ] ASAN: Full fetch complete (76530 records). [2025-10-01T17:20:35.013301] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-01T17:20:35.322492] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-01T17:20:35.389762] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T17:20:35.539063] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T17:20:35.537225] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-01T17:20:35.548609] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-01T17:20:35.549677] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-01T17:20:35.549874] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-01T17:20:35.552054] [DEBUG] [LOCAL ] ASAN: Trimmed 76530 records to 52722 (keeping 200 days of data) [2025-10-01T17:20:35.887409] [DEBUG] [LOCAL ] ASAN: Primary data saved (52722 records). [2025-10-01T17:20:35.887568] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-01T17:20:35.887678] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASAN took 48.6s. Estimated remaining: 4h 53m 40s. Rate: 7.5 symbols/min [2025-10-01T17:20:36.072920] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:20:36.096128] [DEBUG] [LOCAL ] ASGI: Loaded 22639 existing records from primary storage. [2025-10-01T17:20:36.096404] [INFO ] [MAIN ] ASGI: Loaded 22639 existing records. [2025-10-01T17:20:36.108301] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-01T17:20:36.297621] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:20:36.297945] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-01T17:20:36.298059] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-01T17:20:36.298307] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-01T17:20:36.298365] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-01T17:20:36.714849] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:20:36.767388] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T17:20:36.902392] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-01T17:20:37.607505] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T17:20:37.702431] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-01T17:20:38.145690] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T17:20:38.502421] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-01T17:20:39.233904] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T17:20:39.302429] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-01T17:20:39.971190] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T17:20:39.973384] [INFO ] [REMOTE ] ASB: Full fetch complete (71629 records). [2025-10-01T17:20:39.973519] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-01T17:20:40.108284] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-01T17:20:40.410383] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T17:20:40.458123] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-01T17:20:40.458210] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-01T17:20:40.459007] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-01T17:20:40.459121] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-01T17:20:40.460727] [DEBUG] [LOCAL ] ASB: Trimmed 71629 records to 49511 (keeping 200 days of data) [2025-10-01T17:20:40.776821] [DEBUG] [LOCAL ] ASB: Primary data saved (49511 records). [2025-10-01T17:20:40.776962] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-01T17:20:40.777040] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASB took 39.0s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-01T17:20:40.907544] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-01T17:20:40.975964] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:20:41.010879] [DEBUG] [LOCAL ] ASGN: Loaded 35994 existing records from primary storage. [2025-10-01T17:20:41.011182] [INFO ] [MAIN ] ASGN: Loaded 35994 existing records. [2025-10-01T17:20:41.219741] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:20:41.237123] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T17:20:41.236341] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-01T17:20:41.242809] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-01T17:20:41.244060] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-01T17:20:41.244139] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-01T17:20:41.670511] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:20:41.702413] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-01T17:20:42.262975] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T17:20:42.502393] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-01T17:20:42.868311] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T17:20:43.302384] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-01T17:20:43.604810] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T17:20:44.102379] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-01T17:20:44.535610] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T17:20:44.902447] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-01T17:20:45.610899] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T17:20:45.702372] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-01T17:20:45.895977] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T17:20:46.502380] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-01T17:20:46.709935] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T17:20:47.244348] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-01T17:20:47.302390] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-01T17:20:48.102400] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-01T17:20:48.176799] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T17:20:48.903323] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-01T17:20:48.907539] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T17:20:49.702390] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-01T17:20:50.080958] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T17:20:50.502403] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-01T17:20:50.569834] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T17:20:51.302590] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-01T17:20:51.937146] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T17:20:52.102407] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-01T17:20:52.688136] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T17:20:52.902384] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-01T17:20:53.673137] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:20:53.702371] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-01T17:20:54.140993] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T17:20:54.142033] [INFO ] [REMOTE ] ASG: Full fetch complete (31309 records). [2025-10-01T17:20:54.142131] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-01T17:20:54.507563] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-01T17:20:54.625779] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-01T17:20:54.625900] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-01T17:20:54.626410] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-01T17:20:54.626458] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-01T17:20:54.627541] [DEBUG] [LOCAL ] ASG: Trimmed 31309 records to 19882 (keeping 200 days of data) [2025-10-01T17:20:54.754059] [DEBUG] [LOCAL ] ASG: Primary data saved (19882 records). [2025-10-01T17:20:54.754241] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-01T17:20:54.754362] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASG took 26.2s. Estimated remaining: 4h 54m 6s. Rate: 7.5 symbols/min [2025-10-01T17:20:55.117287] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T17:20:55.302441] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-01T17:20:56.102450] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-01T17:20:56.151840] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T17:20:56.369322] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T17:20:56.902380] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-01T17:20:57.476054] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:20:57.702381] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-01T17:20:57.920805] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T17:20:58.502440] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-01T17:20:59.112040] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T17:20:59.302431] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-01T17:20:59.811308] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T17:21:00.102383] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-01T17:21:00.445278] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T17:21:00.902375] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-01T17:21:01.702395] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-01T17:21:01.932260] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-01T17:21:01.933541] [INFO ] [REMOTE ] ASC: Full fetch complete (56626 records). [2025-10-01T17:21:01.933677] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-01T17:21:02.394542] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-01T17:21:02.394755] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-01T17:21:02.395358] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-01T17:21:02.395438] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-01T17:21:02.396685] [DEBUG] [LOCAL ] ASC: Trimmed 56626 records to 37387 (keeping 200 days of data) [2025-10-01T17:21:02.518736] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T17:21:02.531152] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-01T17:21:02.683948] [DEBUG] [LOCAL ] ASC: Primary data saved (37387 records). [2025-10-01T17:21:02.684162] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-01T17:21:02.684261] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASC took 43.6s. Estimated remaining: 4h 53m 58s. Rate: 7.5 symbols/min [2025-10-01T17:21:02.821344] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T17:21:03.302423] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-01T17:21:03.754938] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T17:21:04.102421] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-01T17:21:04.467795] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T17:21:04.902389] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-01T17:21:05.291776] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T17:21:05.702436] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-01T17:21:06.295381] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-01T17:21:06.296514] [INFO ] [REMOTE ] ASGI: Full fetch complete (33583 records). [2025-10-01T17:21:06.296602] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-01T17:21:06.727676] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-01T17:21:06.727816] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-01T17:21:06.728305] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-01T17:21:06.728374] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-01T17:21:06.729524] [DEBUG] [LOCAL ] ASGI: Trimmed 33583 records to 22690 (keeping 200 days of data) [2025-10-01T17:21:06.876214] [DEBUG] [LOCAL ] ASGI: Primary data saved (22690 records). [2025-10-01T17:21:06.876358] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-01T17:21:06.876464] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 31.0s. Estimated remaining: 4h 52m 57s. Rate: 7.6 symbols/min [2025-10-01T17:21:07.644580] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T17:21:07.647259] [INFO ] [REMOTE ] ASGN: Full fetch complete (52298 records). [2025-10-01T17:21:07.647407] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-01T17:21:08.066464] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-01T17:21:08.066593] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-01T17:21:08.067206] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-01T17:21:08.067271] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-01T17:21:08.068706] [DEBUG] [LOCAL ] ASGN: Trimmed 52298 records to 36096 (keeping 200 days of data) [2025-10-01T17:21:08.319511] [DEBUG] [LOCAL ] ASGN: Primary data saved (36096 records). [2025-10-01T17:21:08.319865] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-01T17:21:08.320128] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 27.5s. Estimated remaining: 4h 51m 19s. Rate: 7.6 symbols/min [2025-10-01T17:21:09.409460] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:09.418924] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:09.400285] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:09.449666] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:09.473465] [DEBUG] [LOCAL ] ASR: Loaded 9385 existing records from primary storage. [2025-10-01T17:21:09.474254] [INFO ] [MAIN ] ASR: Loaded 9385 existing records. [2025-10-01T17:21:09.549579] [DEBUG] [LOCAL ] ASIX: Loaded 22624 existing records from primary storage. [2025-10-01T17:21:09.569601] [INFO ] [MAIN ] ASIX: Loaded 22624 existing records. [2025-10-01T17:21:09.753872] [DEBUG] [LOCAL ] ASH: Loaded 37777 existing records from primary storage. [2025-10-01T17:21:09.722158] [DEBUG] [LOCAL ] ASPN: Loaded 49569 existing records from primary storage. [2025-10-01T17:21:09.790431] [INFO ] [MAIN ] ASPN: Loaded 49569 existing records. [2025-10-01T17:21:09.815478] [INFO ] [MAIN ] ASH: Loaded 37777 existing records. [2025-10-01T17:21:09.945043] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:21:09.990772] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-01T17:21:10.031010] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-01T17:21:10.214988] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-01T17:21:10.231366] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:21:10.271887] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-01T17:21:10.303726] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-01T17:21:10.371363] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-01T17:21:10.481173] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:21:10.488006] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-01T17:21:10.537741] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-01T17:21:10.556368] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-01T17:21:10.568913] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:21:10.584748] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-01T17:21:10.630059] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-01T17:21:10.670348] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-01T17:21:10.670492] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-01T17:21:10.670617] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-01T17:21:10.890319] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-01T17:21:10.954423] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-01T17:21:11.837519] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:11.881093] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-01T17:21:12.179177] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:12.201589] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-01T17:21:12.201259] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:12.202886] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-01T17:21:12.303337] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:12.303689] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-01T17:21:12.850569] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T17:21:12.852999] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-01T17:21:13.312820] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T17:21:13.316808] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-01T17:21:13.326493] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-01T17:21:13.330096] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-01T17:21:13.525699] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T17:21:13.532910] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-01T17:21:13.937067] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T17:21:13.941312] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-01T17:21:14.005733] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-01T17:21:14.016427] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-01T17:21:14.036841] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-01T17:21:14.502451] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-01T17:21:14.731152] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T17:21:14.765001] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T17:21:15.302362] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-01T17:21:15.331120] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T17:21:16.102361] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-01T17:21:16.200230] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-01T17:21:16.241282] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-01T17:21:16.902401] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-01T17:21:17.034136] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-01T17:21:17.702434] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-01T17:21:18.459190] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:21:18.502405] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-01T17:21:18.520563] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T17:21:19.285631] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T17:21:19.302330] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-01T17:21:19.829600] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T17:21:20.102425] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-01T17:21:20.902391] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-01T17:21:21.515422] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T17:21:21.702452] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-01T17:21:22.191161] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T17:21:22.451815] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T17:21:22.502415] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-01T17:21:23.302426] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-01T17:21:23.922871] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T17:21:24.102369] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-01T17:21:24.196531] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T17:21:24.902422] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-01T17:21:25.370632] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T17:21:25.702406] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-01T17:21:25.786323] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T17:21:26.502420] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-01T17:21:27.278438] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T17:21:27.302342] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-01T17:21:27.479446] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T17:21:28.102413] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-01T17:21:28.902435] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-01T17:21:28.946928] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T17:21:29.041394] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T17:21:29.702411] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-01T17:21:30.475808] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T17:21:30.502389] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-01T17:21:30.607936] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T17:21:31.302389] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-01T17:21:32.008491] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T17:21:32.102356] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-01T17:21:32.342735] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T17:21:32.902403] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-01T17:21:33.079776] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T17:21:33.080609] [INFO ] [REMOTE ] ASR: Full fetch complete (12517 records). [2025-10-01T17:21:33.080713] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-01T17:21:33.475968] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-01T17:21:33.476071] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-01T17:21:33.476346] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-01T17:21:33.476392] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-01T17:21:33.477044] [DEBUG] [LOCAL ] ASR: Trimmed 12517 records to 9345 (keeping 200 days of data) [2025-10-01T17:21:33.538213] [DEBUG] [LOCAL ] ASR: Primary data saved (9345 records). [2025-10-01T17:21:33.538347] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-01T17:21:33.538473] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 25.2s. Estimated remaining: 4h 55m 9s. Rate: 7.5 symbols/min [2025-10-01T17:21:33.708332] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-01T17:21:33.730536] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:33.790515] [DEBUG] [LOCAL ] ASX: Loaded 52849 existing records from primary storage. [2025-10-01T17:21:33.790955] [INFO ] [MAIN ] ASX: Loaded 52849 existing records. [2025-10-01T17:21:34.000194] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:21:34.000680] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-01T17:21:34.000856] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-01T17:21:34.010392] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-01T17:21:34.024150] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-01T17:21:34.074682] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T17:21:34.426994] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:34.502434] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-01T17:21:35.302363] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-01T17:21:35.430071] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T17:21:35.532401] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T17:21:36.102370] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-01T17:21:36.758981] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T17:21:36.902423] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-01T17:21:37.388427] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-01T17:21:37.389445] [INFO ] [REMOTE ] ASIX: Full fetch complete (30121 records). [2025-10-01T17:21:37.389522] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-01T17:21:37.708712] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-01T17:21:37.831392] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-01T17:21:37.831511] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-01T17:21:37.831936] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-01T17:21:37.831997] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-01T17:21:37.832740] [DEBUG] [LOCAL ] ASIX: Trimmed 30121 records to 22665 (keeping 200 days of data) [2025-10-01T17:21:37.978211] [DEBUG] [LOCAL ] ASIX: Primary data saved (22665 records). [2025-10-01T17:21:37.978339] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-01T17:21:37.978420] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 29.6s. Estimated remaining: 4h 54m 12s. Rate: 7.5 symbols/min [2025-10-01T17:21:38.173065] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:38.213437] [DEBUG] [LOCAL ] ATEN: Loaded 39539 existing records from primary storage. [2025-10-01T17:21:38.213758] [INFO ] [MAIN ] ATEN: Loaded 39539 existing records. [2025-10-01T17:21:38.424055] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:21:38.424345] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-01T17:21:38.424408] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-01T17:21:38.424702] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-01T17:21:38.424761] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-01T17:21:38.505421] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-01T17:21:38.845627] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:38.889005] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T17:21:39.302433] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-01T17:21:39.419486] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T17:21:39.420966] [INFO ] [REMOTE ] ASH: Full fetch complete (55097 records). [2025-10-01T17:21:39.421104] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-01T17:21:39.855242] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-01T17:21:39.855369] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-01T17:21:39.856244] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-01T17:21:39.856310] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-01T17:21:39.857495] [DEBUG] [LOCAL ] ASH: Trimmed 55097 records to 37770 (keeping 200 days of data) [2025-10-01T17:21:40.102888] [DEBUG] [LOCAL ] ASH: Primary data saved (37770 records). [2025-10-01T17:21:40.102794] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-01T17:21:40.103917] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-01T17:21:40.104026] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 31.8s. Estimated remaining: 4h 52m 45s. Rate: 7.5 symbols/min [2025-10-01T17:21:40.293686] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:40.339996] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-01T17:21:40.360418] [DEBUG] [LOCAL ] ATGE: Loaded 31544 existing records from primary storage. [2025-10-01T17:21:40.361030] [INFO ] [MAIN ] ATGE: Loaded 31544 existing records. [2025-10-01T17:21:40.553194] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:21:40.553486] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-01T17:21:40.553547] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-01T17:21:40.553926] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-01T17:21:40.553987] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-01T17:21:40.904325] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-01T17:21:40.955200] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:40.986312] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T17:21:41.586260] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T17:21:41.702391] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-01T17:21:42.502448] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-01T17:21:42.732316] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T17:21:43.021926] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T17:21:43.302377] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-01T17:21:43.535261] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T17:21:44.102402] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-01T17:21:44.902342] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-01T17:21:44.994751] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T17:21:45.557753] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T17:21:45.702431] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-01T17:21:46.287068] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T17:21:46.502413] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-01T17:21:47.302389] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-01T17:21:47.439536] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T17:21:48.073943] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:21:48.102339] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-01T17:21:48.697474] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T17:21:48.902568] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-01T17:21:49.471201] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T17:21:49.702426] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-01T17:21:50.502448] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-01T17:21:50.815915] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T17:21:51.302403] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-01T17:21:51.934032] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T17:21:51.938208] [INFO ] [REMOTE ] ASPN: Full fetch complete (72305 records). [2025-10-01T17:21:51.938401] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-01T17:21:52.106624] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-01T17:21:52.141590] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T17:21:52.426406] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-01T17:21:52.426630] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-01T17:21:52.427515] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-01T17:21:52.427670] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-01T17:21:52.451471] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T17:21:52.451677] [DEBUG] [LOCAL ] ASPN: Trimmed 72305 records to 49592 (keeping 200 days of data) [2025-10-01T17:21:52.759209] [DEBUG] [LOCAL ] ASPN: Primary data saved (49592 records). [2025-10-01T17:21:52.759389] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-01T17:21:52.762342] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 44.4s. Estimated remaining: 4h 53m 40s. Rate: 7.5 symbols/min [2025-10-01T17:21:52.917489] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-01T17:21:52.953734] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:21:52.953898] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-10-01T17:21:52.953937] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-10-01T17:21:52.954086] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-01T17:21:52.954129] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-01T17:21:52.954175] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-01T17:21:52.954222] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-01T17:21:53.349113] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:21:53.702399] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-01T17:21:53.993693] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T17:21:54.469156] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T17:21:54.502411] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-01T17:21:54.829999] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T17:21:55.302397] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-01T17:21:56.060945] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T17:21:56.102362] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-01T17:21:56.774117] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T17:21:56.902402] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-01T17:21:57.254278] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T17:21:57.702392] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-01T17:21:58.164046] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T17:21:58.502405] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-01T17:21:59.068580] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:21:59.302386] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-01T17:21:59.709277] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T17:22:00.102406] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-01T17:22:00.526916] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T17:22:00.902454] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-01T17:22:01.702467] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-01T17:22:01.966019] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T17:22:02.296480] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T17:22:02.502381] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-01T17:22:03.222994] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T17:22:03.302411] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-01T17:22:04.102391] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-01T17:22:04.233104] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T17:22:04.666376] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T17:22:04.902372] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-01T17:22:05.702383] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-01T17:22:05.811288] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T17:22:05.813926] [INFO ] [REMOTE ] ATEN: Full fetch complete (57414 records). [2025-10-01T17:22:05.814050] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-01T17:22:06.261301] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-01T17:22:06.261419] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-01T17:22:06.262201] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-01T17:22:06.262353] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-01T17:22:06.281333] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T17:22:06.291089] [DEBUG] [LOCAL ] ATEN: Trimmed 57414 records to 39400 (keeping 200 days of data) [2025-10-01T17:22:06.510190] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-01T17:22:06.554136] [DEBUG] [LOCAL ] ATEN: Primary data saved (39400 records). [2025-10-01T17:22:06.554312] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-01T17:22:06.554467] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 28.6s. Estimated remaining: 4h 54m 50s. Rate: 7.5 symbols/min [2025-10-01T17:22:06.761108] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:22:06.770574] [DEBUG] [LOCAL ] ATHS: Loaded 6995 existing records from primary storage. [2025-10-01T17:22:06.770802] [INFO ] [MAIN ] ATHS: Loaded 6995 existing records. [2025-10-01T17:22:06.973973] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:22:06.974217] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-01T17:22:06.974268] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-01T17:22:06.974673] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-01T17:22:06.974738] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-01T17:22:07.307102] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-01T17:22:07.405752] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:22:07.502670] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T17:22:07.998802] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T17:22:08.102383] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-01T17:22:08.902365] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-01T17:22:08.904218] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T17:22:09.089178] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T17:22:09.702391] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-01T17:22:10.295272] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T17:22:10.502387] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-01T17:22:10.651168] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T17:22:11.302355] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-01T17:22:11.487298] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T17:22:12.102384] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-01T17:22:12.598124] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:22:12.902403] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-01T17:22:13.702362] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-01T17:22:13.878874] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T17:22:14.011085] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T17:22:14.502445] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-01T17:22:15.071597] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T17:22:15.258104] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-01T17:22:15.259315] [INFO ] [REMOTE ] ATGE: Full fetch complete (46266 records). [2025-10-01T17:22:15.259394] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-01T17:22:15.307603] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-01T17:22:15.695188] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-01T17:22:15.695273] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-01T17:22:15.695813] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-01T17:22:15.695877] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-01T17:22:15.696907] [DEBUG] [LOCAL ] ATGE: Trimmed 46266 records to 31426 (keeping 200 days of data) [2025-10-01T17:22:15.902308] [DEBUG] [LOCAL ] ATGE: Primary data saved (31426 records). [2025-10-01T17:22:15.902503] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-01T17:22:15.902597] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATGE took 35.8s. Estimated remaining: 4h 54m 60s. Rate: 7.5 symbols/min [2025-10-01T17:22:16.100973] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:22:16.102359] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-01T17:22:16.142106] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T17:22:16.164822] [DEBUG] [LOCAL ] ATI: Loaded 51513 existing records from primary storage. [2025-10-01T17:22:16.165157] [INFO ] [MAIN ] ATI: Loaded 51513 existing records. [2025-10-01T17:22:16.362231] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:22:16.362431] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-01T17:22:16.362480] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-01T17:22:16.362770] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-01T17:22:16.362837] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-01T17:22:16.764516] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:22:16.902407] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-01T17:22:17.702388] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-01T17:22:18.502365] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-01T17:22:18.595808] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-01T17:22:18.600025] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T17:22:18.612197] [INFO ] [REMOTE ] ASX: Full fetch complete (76593 records). [2025-10-01T17:22:18.612975] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-01T17:22:19.086374] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T17:22:19.092773] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T17:22:19.085275] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-01T17:22:19.094983] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-01T17:22:19.097087] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-01T17:22:19.097467] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-01T17:22:19.098948] [DEBUG] [LOCAL ] ASX: Trimmed 76593 records to 52844 (keeping 200 days of data) [2025-10-01T17:22:19.315739] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-01T17:22:19.435755] [DEBUG] [LOCAL ] ASX: Primary data saved (52844 records). [2025-10-01T17:22:19.435909] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-01T17:22:19.435992] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ASX took 45.9s. Estimated remaining: 4h 53m 52s. Rate: 7.5 symbols/min [2025-10-01T17:22:19.622563] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:22:19.659270] [DEBUG] [LOCAL ] ATKR: Loaded 35629 existing records from primary storage. [2025-10-01T17:22:19.659673] [INFO ] [MAIN ] ATKR: Loaded 35629 existing records. [2025-10-01T17:22:19.860951] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:22:19.861217] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-01T17:22:19.861268] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-01T17:22:19.861584] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-01T17:22:19.861685] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-01T17:22:20.110552] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-01T17:22:20.266968] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:22:20.636250] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T17:22:20.902425] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-01T17:22:21.700484] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T17:22:21.702448] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-01T17:22:22.066413] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T17:22:22.502419] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-01T17:22:22.895638] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T17:22:22.926012] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-01T17:22:23.302386] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-01T17:22:24.102415] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-01T17:22:24.582909] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T17:22:24.584271] [INFO ] [REMOTE ] ATHM: Full fetch complete (51182 records). [2025-10-01T17:22:24.584389] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-01T17:22:24.907536] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-01T17:22:25.039994] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-01T17:22:25.040078] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-01T17:22:25.040665] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-01T17:22:25.040729] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-01T17:22:25.041907] [DEBUG] [LOCAL ] ATHM: Trimmed 51182 records to 32173 (keeping 200 days of data) [2025-10-01T17:22:25.249054] [DEBUG] [LOCAL ] ATHM: Primary data saved (32173 records). [2025-10-01T17:22:25.249199] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-01T17:22:25.249276] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHM took 32.5s. Estimated remaining: 4h 53m 16s. Rate: 7.5 symbols/min [2025-10-01T17:22:25.447675] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:22:25.490143] [DEBUG] [LOCAL ] ATMU: Loaded 39448 existing records from primary storage. [2025-10-01T17:22:25.490487] [INFO ] [MAIN ] ATMU: Loaded 39448 existing records. [2025-10-01T17:22:25.686441] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T17:22:25.706901] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-01T17:22:25.741583] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:22:25.741980] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-01T17:22:25.742205] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-01T17:22:25.742587] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-01T17:22:25.742707] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-01T17:22:25.852623] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T17:22:26.198053] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:22:26.502416] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-01T17:22:27.279005] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T17:22:27.302358] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-01T17:22:28.062712] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:22:28.102385] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-01T17:22:28.551439] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T17:22:28.894599] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T17:22:28.902755] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-01T17:22:29.651516] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T17:22:29.702356] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-01T17:22:30.502428] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-01T17:22:31.051512] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T17:22:31.075807] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T17:22:31.302434] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-01T17:22:32.102447] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-01T17:22:32.798549] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T17:22:32.902353] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-01T17:22:32.970316] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T17:22:32.971159] [INFO ] [REMOTE ] ATHS: Full fetch complete (10048 records). [2025-10-01T17:22:32.971234] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-01T17:22:33.372903] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-01T17:22:33.372995] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-01T17:22:33.373300] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-01T17:22:33.373377] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-01T17:22:33.374017] [DEBUG] [LOCAL ] ATHS: Trimmed 10048 records to 6972 (keeping 200 days of data) [2025-10-01T17:22:33.423676] [DEBUG] [LOCAL ] ATHS: Primary data saved (6972 records). [2025-10-01T17:22:33.423845] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-01T17:22:33.423938] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 26.9s. Estimated remaining: 4h 53m 10s. Rate: 7.5 symbols/min [2025-10-01T17:22:33.624438] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:22:33.673572] [DEBUG] [LOCAL ] ATO: Loaded 41879 existing records from primary storage. [2025-10-01T17:22:33.673934] [INFO ] [MAIN ] ATO: Loaded 41879 existing records. [2025-10-01T17:22:33.707539] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-01T17:22:33.876792] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:22:33.877010] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-01T17:22:33.877060] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-01T17:22:33.878151] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-01T17:22:33.878213] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-01T17:22:34.289198] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:22:34.502371] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-01T17:22:34.682984] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T17:22:35.189280] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:22:35.302374] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-01T17:22:36.102378] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-01T17:22:36.206934] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T17:22:36.619299] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T17:22:36.902389] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-01T17:22:37.524334] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:22:37.702415] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-01T17:22:38.502362] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-01T17:22:38.607873] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T17:22:39.139039] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T17:22:39.302433] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-01T17:22:39.590956] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T17:22:40.102415] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-01T17:22:40.912728] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-01T17:22:40.940025] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T17:22:41.460018] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T17:22:41.702433] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-01T17:22:41.997245] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T17:22:42.502430] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-01T17:22:43.123447] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T17:22:43.302437] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-01T17:22:44.102354] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-01T17:22:44.299510] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T17:22:44.487973] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T17:22:44.902381] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-01T17:22:45.435052] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T17:22:45.702382] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-01T17:22:46.502380] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-01T17:22:46.873861] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T17:22:46.920356] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T17:22:47.302408] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-01T17:22:47.842105] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T17:22:48.102427] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-01T17:22:48.902398] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-01T17:22:49.098678] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T17:22:49.702407] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-01T17:22:49.824199] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T17:22:50.502381] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-01T17:22:50.580040] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T17:22:51.271602] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:22:51.302396] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-01T17:22:52.062892] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T17:22:52.102343] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-01T17:22:52.902459] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-01T17:22:53.702449] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-01T17:23:06.423894] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (12.72 seconds). [2025-10-01T17:23:06.425460] [INFO ] [REMOTE ] ATI: Full fetch complete (73940 records). [2025-10-01T17:23:06.425586] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-01T17:23:06.890322] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-01T17:23:06.890469] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-01T17:23:06.891292] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-01T17:23:06.891377] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-01T17:23:06.912906] [DEBUG] [LOCAL ] ATI: Trimmed 73940 records to 51502 (keeping 200 days of data) [2025-10-01T17:23:06.927480] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (14.03 seconds). [2025-10-01T17:23:06.993715] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-01T17:23:07.253623] [DEBUG] [LOCAL ] ATI: Primary data saved (51502 records). [2025-10-01T17:23:07.253840] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-01T17:23:07.253933] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATI took 51.4s. Estimated remaining: 4h 58m 37s. Rate: 7.4 symbols/min [2025-10-01T17:23:07.470461] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:07.504831] [DEBUG] [LOCAL ] ATR: Loaded 30427 existing records from primary storage. [2025-10-01T17:23:07.505140] [INFO ] [MAIN ] ATR: Loaded 30427 existing records. [2025-10-01T17:23:07.720174] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:07.720469] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-01T17:23:07.720540] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-01T17:23:07.720952] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-01T17:23:07.721013] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-01T17:23:08.151062] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:08.151536] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-01T17:23:08.181103] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (16.08 seconds). [2025-10-01T17:23:08.191889] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-01T17:23:09.050075] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-01T17:23:09.051922] [INFO ] [REMOTE ] ATKR: Full fetch complete (53850 records). [2025-10-01T17:23:09.052022] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-01T17:23:09.494799] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-01T17:23:09.495009] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-01T17:23:09.496004] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-01T17:23:09.496091] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-01T17:23:09.497602] [DEBUG] [LOCAL ] ATKR: Trimmed 53850 records to 35682 (keeping 200 days of data) [2025-10-01T17:23:09.616486] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T17:23:09.623688] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-01T17:23:09.754193] [DEBUG] [LOCAL ] ATKR: Primary data saved (35682 records). [2025-10-01T17:23:09.754338] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-01T17:23:09.754429] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 50.3s. Estimated remaining: 4h 57m 16s. Rate: 7.4 symbols/min [2025-10-01T17:23:09.945999] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:09.978568] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T17:23:09.994002] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-01T17:23:10.002529] [DEBUG] [LOCAL ] ATS: Loaded 17824 existing records from primary storage. [2025-10-01T17:23:10.027766] [INFO ] [MAIN ] ATS: Loaded 17824 existing records. [2025-10-01T17:23:10.043327] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (18.74 seconds). [2025-10-01T17:23:10.151315] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-01T17:23:10.268424] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:10.269036] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-01T17:23:10.269108] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-01T17:23:10.269388] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-01T17:23:10.269461] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-01T17:23:10.743163] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:10.743834] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-01T17:23:10.763327] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T17:23:10.769397] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-01T17:23:11.662685] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T17:23:11.672349] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-01T17:23:11.948280] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-01T17:23:11.955499] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-01T17:23:12.059637] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T17:23:12.060843] [INFO ] [REMOTE ] ATMU: Full fetch complete (56752 records). [2025-10-01T17:23:12.060923] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-01T17:23:12.496966] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-01T17:23:12.497063] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-01T17:23:12.497998] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-01T17:23:12.498077] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-01T17:23:12.499667] [DEBUG] [LOCAL ] ATMU: Trimmed 56752 records to 39344 (keeping 200 days of data) [2025-10-01T17:23:12.765723] [DEBUG] [LOCAL ] ATMU: Primary data saved (39344 records). [2025-10-01T17:23:12.765891] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-01T17:23:12.768088] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 47.5s. Estimated remaining: 4h 56m 3s. Rate: 7.4 symbols/min [2025-10-01T17:23:12.985808] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:13.042365] [DEBUG] [LOCAL ] ATUS: Loaded 49257 existing records from primary storage. [2025-10-01T17:23:13.042748] [INFO ] [MAIN ] ATUS: Loaded 49257 existing records. [2025-10-01T17:23:13.263569] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:13.264009] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-01T17:23:13.264432] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-01T17:23:13.265310] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-01T17:23:13.265383] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-01T17:23:13.427409] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T17:23:13.493216] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-01T17:23:13.751445] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:13.751904] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-01T17:23:13.777592] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-01T17:23:13.786319] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-01T17:23:14.120704] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (3.38 seconds). [2025-10-01T17:23:14.124847] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-01T17:23:14.977060] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T17:23:14.984283] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-01T17:23:15.025461] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T17:23:15.030579] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-01T17:23:15.315963] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T17:23:15.326057] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-01T17:23:15.445052] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T17:23:15.454450] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-01T17:23:16.029387] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T17:23:16.034035] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-01T17:23:16.087227] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T17:23:16.094407] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-01T17:23:16.606356] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T17:23:16.617074] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-01T17:23:16.710107] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T17:23:16.714636] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-01T17:23:16.879888] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T17:23:16.889755] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-01T17:23:17.383171] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T17:23:17.390979] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-01T17:23:18.147188] [DEBUG] [REMOTE ] ATO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:23:18.147527] [WARN ] [REMOTE ] ATO: No data returned for month 2025-10 [2025-10-01T17:23:18.147663] [FATAL] [REMOTE ] ATO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:23:18.147777] [FATAL] [MAIN ] ATO: Failed to fetch primary data. [2025-10-01T17:23:18.147846] [WARN ] [MAIN ] ATO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:23:18.147951] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-01T17:23:18.148016] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-01T17:23:18.148053] [INFO ] [LOCAL ] ATO: Starting deletion of derivative data. [2025-10-01T17:23:18.148613] [DEBUG] [LOCAL ] ATO: Deleted derivative data file. [2025-10-01T17:23:18.148742] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 44.7s. Estimated remaining: 4h 55m 20s. Rate: 7.4 symbols/min [2025-10-01T17:23:18.385813] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:18.388571] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T17:23:18.400920] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-01T17:23:18.476503] [DEBUG] [LOCAL ] AU: Loaded 52991 existing records from primary storage. [2025-10-01T17:23:18.477254] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T17:23:18.477815] [INFO ] [MAIN ] AU: Loaded 52991 existing records. [2025-10-01T17:23:18.539537] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-01T17:23:18.697733] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:18.718847] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-01T17:23:18.719511] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-01T17:23:18.720751] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T17:23:18.728450] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-01T17:23:18.729074] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-01T17:23:18.734815] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-01T17:23:19.138188] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:19.138511] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-01T17:23:19.625850] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T17:23:19.631023] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-01T17:23:19.748046] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T17:23:19.755727] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-01T17:23:19.980783] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T17:23:19.990884] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-01T17:23:20.331588] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T17:23:20.335792] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-01T17:23:20.663262] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T17:23:20.670868] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-01T17:23:20.795360] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T17:23:20.902448] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-01T17:23:21.443987] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T17:23:21.621363] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T17:23:21.702419] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-01T17:23:22.306718] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T17:23:22.308595] [INFO ] [REMOTE ] ATR: Full fetch complete (43451 records). [2025-10-01T17:23:22.308726] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-01T17:23:22.523160] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-01T17:23:22.656053] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T17:23:22.789343] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-01T17:23:22.789557] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-01T17:23:22.790221] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-01T17:23:22.790313] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-01T17:23:22.821614] [DEBUG] [LOCAL ] ATR: Trimmed 43451 records to 30432 (keeping 200 days of data) [2025-10-01T17:23:22.823520] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T17:23:23.041349] [DEBUG] [LOCAL ] ATR: Primary data saved (30432 records). [2025-10-01T17:23:23.041501] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-01T17:23:23.041603] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 15.8s. Estimated remaining: 4h 54m 32s. Rate: 7.5 symbols/min [2025-10-01T17:23:23.230348] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:23.278347] [DEBUG] [LOCAL ] AUB: Loaded 46327 existing records from primary storage. [2025-10-01T17:23:23.278709] [INFO ] [MAIN ] AUB: Loaded 46327 existing records. [2025-10-01T17:23:23.311683] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-01T17:23:23.479108] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:23.479329] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-01T17:23:23.479379] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-01T17:23:23.479798] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-01T17:23:23.479860] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-01T17:23:23.906123] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:23.943903] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T17:23:24.102415] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-01T17:23:24.294532] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T17:23:24.902411] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-01T17:23:25.702380] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-01T17:23:25.850596] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T17:23:26.502419] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-01T17:23:26.612963] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T17:23:27.236039] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T17:23:27.302385] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-01T17:23:27.476932] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T17:23:27.479004] [INFO ] [REMOTE ] ATS: Full fetch complete (25685 records). [2025-10-01T17:23:27.479118] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-01T17:23:27.902965] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-01T17:23:27.903056] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-01T17:23:27.903472] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-01T17:23:27.903519] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-01T17:23:27.904349] [DEBUG] [LOCAL ] ATS: Trimmed 25685 records to 17831 (keeping 200 days of data) [2025-10-01T17:23:28.014005] [DEBUG] [LOCAL ] ATS: Primary data saved (17831 records). [2025-10-01T17:23:28.014149] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-01T17:23:28.014233] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 18.3s. Estimated remaining: 4h 53m 46s. Rate: 7.5 symbols/min [2025-10-01T17:23:28.107508] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-01T17:23:28.226597] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:28.235037] [DEBUG] [LOCAL ] AUNA: Loaded 4917 existing records from primary storage. [2025-10-01T17:23:28.235491] [INFO ] [MAIN ] AUNA: Loaded 4917 existing records. [2025-10-01T17:23:28.450100] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:28.450412] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-01T17:23:28.450494] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-01T17:23:28.450816] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-01T17:23:28.450887] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-01T17:23:28.882715] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:28.902413] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-01T17:23:29.262303] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-01T17:23:29.502011] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T17:23:29.656101] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T17:23:29.702342] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-01T17:23:30.403215] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T17:23:30.502391] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-01T17:23:31.302431] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-01T17:23:31.894682] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T17:23:32.102404] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-01T17:23:32.679357] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-01T17:23:32.681802] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-01T17:23:32.902413] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-01T17:23:33.702403] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-01T17:23:34.113794] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-01T17:23:34.352778] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T17:23:34.502422] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-01T17:23:35.302369] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-01T17:23:36.102359] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-01T17:23:36.126693] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T17:23:36.902383] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-01T17:23:37.226872] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T17:23:37.547418] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T17:23:37.702380] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-01T17:23:38.028780] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T17:23:38.502400] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-01T17:23:39.251253] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T17:23:39.302422] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-01T17:23:39.926997] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T17:23:40.006080] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T17:23:40.102412] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-01T17:23:40.902423] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-01T17:23:41.702422] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-01T17:23:41.996093] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T17:23:42.144515] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-01T17:23:42.502445] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-01T17:23:42.752859] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T17:23:43.046495] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T17:23:43.302396] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-01T17:23:44.102423] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-01T17:23:44.809603] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T17:23:44.902494] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-01T17:23:45.702449] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-01T17:23:46.338284] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-01T17:23:46.414570] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T17:23:46.502362] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-01T17:23:47.295497] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-01T17:23:47.297067] [INFO ] [REMOTE ] ATUS: Full fetch complete (70981 records). [2025-10-01T17:23:47.297164] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-01T17:23:47.309712] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-01T17:23:47.736754] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-01T17:23:47.736855] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-01T17:23:47.737634] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-01T17:23:47.737773] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-01T17:23:47.742484] [DEBUG] [LOCAL ] ATUS: Trimmed 70981 records to 49261 (keeping 200 days of data) [2025-10-01T17:23:48.028211] [DEBUG] [LOCAL ] ATUS: Primary data saved (49261 records). [2025-10-01T17:23:48.028394] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-01T17:23:48.030320] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 35.3s. Estimated remaining: 4h 56m 7s. Rate: 7.4 symbols/min [2025-10-01T17:23:48.111576] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-01T17:23:48.227758] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:48.274813] [DEBUG] [LOCAL ] AVA: Loaded 39426 existing records from primary storage. [2025-10-01T17:23:48.275099] [INFO ] [MAIN ] AVA: Loaded 39426 existing records. [2025-10-01T17:23:48.472827] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:48.473122] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-01T17:23:48.473192] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-01T17:23:48.474056] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-01T17:23:48.474118] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-01T17:23:48.900677] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-01T17:23:48.934297] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:48.945282] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-01T17:23:48.977898] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T17:23:49.075012] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T17:23:49.075909] [INFO ] [REMOTE ] AUNA: Full fetch complete (7738 records). [2025-10-01T17:23:49.075984] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-01T17:23:49.500486] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-01T17:23:49.500566] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-01T17:23:49.500804] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-01T17:23:49.500868] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-01T17:23:49.501286] [DEBUG] [LOCAL ] AUNA: Trimmed 7738 records to 4886 (keeping 200 days of data) [2025-10-01T17:23:49.532588] [DEBUG] [LOCAL ] AUNA: Primary data saved (4886 records). [2025-10-01T17:23:49.532770] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-01T17:23:49.532869] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUNA took 21.5s. Estimated remaining: 4h 54m 37s. Rate: 7.4 symbols/min [2025-10-01T17:23:49.707486] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-01T17:23:49.736494] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:49.747303] [DEBUG] [LOCAL ] AVAL: Loaded 8759 existing records from primary storage. [2025-10-01T17:23:49.747526] [INFO ] [MAIN ] AVAL: Loaded 8759 existing records. [2025-10-01T17:23:49.942512] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:23:49.942779] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-01T17:23:49.942848] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-01T17:23:49.943113] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-01T17:23:49.943188] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-01T17:23:50.355251] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:50.502404] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-01T17:23:50.542080] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T17:23:51.302370] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-01T17:23:51.840111] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-01T17:23:52.098590] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T17:23:52.108032] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-01T17:23:52.116914] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T17:23:52.902429] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-01T17:23:53.702438] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-01T17:23:53.836387] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T17:23:54.502431] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-01T17:23:54.845530] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T17:23:54.912756] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.80 seconds). [2025-10-01T17:23:54.914349] [INFO ] [REMOTE ] AU: Full fetch complete (76275 records). [2025-10-01T17:23:54.914452] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-01T17:23:55.309331] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-01T17:23:55.335515] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-01T17:23:55.335697] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-01T17:23:55.336570] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-01T17:23:55.336629] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-01T17:23:55.338339] [DEBUG] [LOCAL ] AU: Trimmed 76275 records to 52993 (keeping 200 days of data) [2025-10-01T17:23:55.413948] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T17:23:55.693348] [DEBUG] [LOCAL ] AU: Primary data saved (52993 records). [2025-10-01T17:23:55.693516] [INFO ] [MAIN ] AU: Full history saved. [2025-10-01T17:23:55.693623] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AU took 37.5s. Estimated remaining: 4h 54m 6s. Rate: 7.5 symbols/min [2025-10-01T17:23:55.895483] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:23:55.895713] [DEBUG] [LOCAL ] AVB: No existing data file found in primary storage. [2025-10-01T17:23:55.895808] [WARN ] [MAIN ] AVB: No existing data found, performing full refresh instead. [2025-10-01T17:23:55.895933] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-01T17:23:55.895977] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-01T17:23:55.896020] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-01T17:23:55.896056] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-01T17:23:56.107529] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-01T17:23:56.314702] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:23:56.586032] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T17:23:56.902379] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-01T17:23:57.702380] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-01T17:23:57.837445] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T17:23:58.027078] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T17:23:58.502384] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-01T17:23:58.745784] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T17:23:59.302380] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-01T17:24:00.002488] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T17:24:00.102390] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-01T17:24:00.314241] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T17:24:00.902374] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-01T17:24:01.586805] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T17:24:01.702429] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-01T17:24:02.199756] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T17:24:02.204734] [INFO ] [REMOTE ] AUB: Full fetch complete (65711 records). [2025-10-01T17:24:02.204897] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-01T17:24:02.509972] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-01T17:24:02.564155] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T17:24:02.706211] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-01T17:24:02.706294] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-01T17:24:02.706971] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-01T17:24:02.707036] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-01T17:24:02.708412] [DEBUG] [LOCAL ] AUB: Trimmed 65711 records to 46326 (keeping 200 days of data) [2025-10-01T17:24:03.003200] [DEBUG] [LOCAL ] AUB: Primary data saved (46326 records). [2025-10-01T17:24:03.003347] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-01T17:24:03.003438] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUB took 40.0s. Estimated remaining: 4h 53m 49s. Rate: 7.5 symbols/min [2025-10-01T17:24:03.189964] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:24:03.190151] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-01T17:24:03.190190] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-01T17:24:03.190367] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-01T17:24:03.190410] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-01T17:24:03.190453] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-01T17:24:03.190485] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-01T17:24:03.307499] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-01T17:24:03.591298] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:24:04.102467] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-01T17:24:04.102348] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T17:24:04.144026] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T17:24:04.902431] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-01T17:24:05.113869] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:24:05.114168] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-01T17:24:05.114264] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:24:05.114357] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-01T17:24:05.114426] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:24:05.114499] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-01T17:24:05.114564] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-01T17:24:05.114602] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-01T17:24:05.114691] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-01T17:24:05.114762] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 2.1s. Estimated remaining: 4h 52m 29s. Rate: 7.5 symbols/min [2025-10-01T17:24:05.314477] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:24:05.338027] [DEBUG] [LOCAL ] AVD: Loaded 22636 existing records from primary storage. [2025-10-01T17:24:05.338310] [INFO ] [MAIN ] AVD: Loaded 22636 existing records. [2025-10-01T17:24:05.540791] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:24:05.541339] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-01T17:24:05.541404] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-01T17:24:05.541895] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-01T17:24:05.541967] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-01T17:24:05.707625] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-01T17:24:05.972867] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:24:06.049434] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-01T17:24:06.502435] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-01T17:24:06.832780] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T17:24:07.262271] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-01T17:24:07.302366] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-01T17:24:08.047339] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T17:24:08.102414] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-01T17:24:08.902390] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-01T17:24:09.702357] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-01T17:24:09.726049] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T17:24:09.839630] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T17:24:10.502398] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-01T17:24:10.939011] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T17:24:10.998890] [DEBUG] [REMOTE ] AVAL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:24:10.999232] [WARN ] [REMOTE ] AVAL: No data returned for month 2025-10 [2025-10-01T17:24:10.999329] [FATAL] [REMOTE ] AVAL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:24:10.999409] [FATAL] [MAIN ] AVAL: Failed to fetch primary data. [2025-10-01T17:24:10.999484] [WARN ] [MAIN ] AVAL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:24:10.999602] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-01T17:24:10.999720] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-01T17:24:10.999774] [INFO ] [LOCAL ] AVAL: Starting deletion of derivative data. [2025-10-01T17:24:11.000337] [DEBUG] [LOCAL ] AVAL: Deleted derivative data file. [2025-10-01T17:24:11.000433] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVAL took 21.5s. Estimated remaining: 4h 51m 55s. Rate: 7.5 symbols/min [2025-10-01T17:24:11.200592] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:24:11.220915] [DEBUG] [LOCAL ] AVK: Loaded 17882 existing records from primary storage. [2025-10-01T17:24:11.221156] [INFO ] [MAIN ] AVK: Loaded 17882 existing records. [2025-10-01T17:24:11.307542] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-01T17:24:11.433615] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:24:11.433844] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-01T17:24:11.433895] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-01T17:24:11.434127] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-01T17:24:11.434187] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-01T17:24:11.826254] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:24:12.102405] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-01T17:24:12.902377] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-01T17:24:13.035779] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T17:24:13.557315] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T17:24:13.702411] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-01T17:24:14.112747] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T17:24:14.502365] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-01T17:24:14.591468] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T17:24:15.302347] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-01T17:24:15.539191] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T17:24:16.102388] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-01T17:24:16.902443] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-01T17:24:16.940179] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T17:24:16.993414] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T17:24:17.702356] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-01T17:24:17.988231] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T17:24:18.502418] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-01T17:24:19.109607] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T17:24:19.302368] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-01T17:24:19.570398] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T17:24:20.102392] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-01T17:24:20.795406] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T17:24:20.902440] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-01T17:24:21.152282] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T17:24:21.702400] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-01T17:24:22.050833] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T17:24:22.502391] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-01T17:24:23.068012] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:24:23.302375] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-01T17:24:23.481177] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T17:24:24.102421] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-01T17:24:24.815385] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T17:24:24.902362] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-01T17:24:25.264837] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T17:24:25.702474] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-01T17:24:26.108734] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T17:24:26.502403] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-01T17:24:27.311123] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-01T17:24:27.327351] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T17:24:27.575178] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T17:24:28.102394] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-01T17:24:28.455536] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T17:24:28.902415] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-01T17:24:29.702381] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-01T17:24:29.810379] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T17:24:29.881203] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-01T17:24:29.882776] [INFO ] [REMOTE ] AVA: Full fetch complete (55799 records). [2025-10-01T17:24:29.882934] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-01T17:24:30.304137] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-01T17:24:30.304237] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-01T17:24:30.304918] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-01T17:24:30.304984] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-01T17:24:30.306287] [DEBUG] [LOCAL ] AVA: Trimmed 55799 records to 39411 (keeping 200 days of data) [2025-10-01T17:24:30.439186] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T17:24:30.513423] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-01T17:24:30.583088] [DEBUG] [LOCAL ] AVA: Primary data saved (39411 records). [2025-10-01T17:24:30.583219] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-01T17:24:30.584353] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVA took 42.6s. Estimated remaining: 4h 54m 6s. Rate: 7.4 symbols/min [2025-10-01T17:24:30.780848] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:24:30.818972] [DEBUG] [LOCAL ] AVNS: Loaded 33665 existing records from primary storage. [2025-10-01T17:24:30.819308] [INFO ] [MAIN ] AVNS: Loaded 33665 existing records. [2025-10-01T17:24:31.014220] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:24:31.014468] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-01T17:24:31.014526] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-01T17:24:31.014969] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-01T17:24:31.015047] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-01T17:24:31.307496] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-01T17:24:31.410099] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:24:31.930768] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T17:24:32.102407] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-01T17:24:32.764442] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T17:24:32.902390] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-01T17:24:32.971747] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T17:24:33.702359] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-01T17:24:33.917638] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T17:24:34.502393] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-01T17:24:35.129588] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-01T17:24:35.131150] [INFO ] [REMOTE ] AVK: Full fetch complete (26650 records). [2025-10-01T17:24:35.131255] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-01T17:24:35.304193] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-01T17:24:35.563683] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-01T17:24:35.563825] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-01T17:24:35.564277] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-01T17:24:35.564356] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-01T17:24:35.565583] [DEBUG] [LOCAL ] AVK: Trimmed 26650 records to 17956 (keeping 200 days of data) [2025-10-01T17:24:35.664632] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T17:24:35.706875] [DEBUG] [LOCAL ] AVK: Primary data saved (17956 records). [2025-10-01T17:24:35.707025] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-01T17:24:35.707124] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVK took 24.7s. Estimated remaining: 4h 53m 23s. Rate: 7.5 symbols/min [2025-10-01T17:24:35.912732] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:24:35.959725] [DEBUG] [LOCAL ] AVNT: Loaded 39241 existing records from primary storage. [2025-10-01T17:24:35.960041] [INFO ] [MAIN ] AVNT: Loaded 39241 existing records. [2025-10-01T17:24:36.107492] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-01T17:24:36.170229] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:24:36.170619] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-01T17:24:36.170707] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-01T17:24:36.171142] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-01T17:24:36.171204] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-01T17:24:36.564129] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:24:36.902388] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-01T17:24:37.111879] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T17:24:37.359907] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T17:24:37.702378] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-01T17:24:37.988011] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T17:24:38.502366] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-01T17:24:38.832023] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T17:24:39.302354] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-01T17:24:39.486915] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T17:24:40.102413] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-01T17:24:40.572932] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-01T17:24:40.574017] [INFO ] [REMOTE ] AVD: Full fetch complete (33704 records). [2025-10-01T17:24:40.574094] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-01T17:24:40.903359] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-01T17:24:40.999674] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-01T17:24:40.999803] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-01T17:24:41.000275] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-01T17:24:41.000327] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-01T17:24:41.001289] [DEBUG] [LOCAL ] AVD: Trimmed 33704 records to 22593 (keeping 200 days of data) [2025-10-01T17:24:41.135538] [DEBUG] [LOCAL ] AVD: Primary data saved (22593 records). [2025-10-01T17:24:41.135708] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-01T17:24:41.135810] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 36.0s. Estimated remaining: 4h 52m 44s. Rate: 7.5 symbols/min [2025-10-01T17:24:41.337875] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:24:41.355515] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T17:24:41.412760] [DEBUG] [LOCAL ] AVTR: Loaded 53562 existing records from primary storage. [2025-10-01T17:24:41.413123] [INFO ] [MAIN ] AVTR: Loaded 53562 existing records. [2025-10-01T17:24:41.606759] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:24:41.606971] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-01T17:24:41.607021] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-01T17:24:41.607392] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-01T17:24:41.607453] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-01T17:24:41.712029] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-01T17:24:41.999446] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:24:42.502392] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-01T17:24:42.899906] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T17:24:43.182017] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-01T17:24:43.186664] [INFO ] [REMOTE ] AVB: Full fetch complete (58578 records). [2025-10-01T17:24:43.186793] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-01T17:24:43.309151] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-01T17:24:43.638821] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-01T17:24:43.638909] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-01T17:24:43.639564] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-01T17:24:43.639608] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-01T17:24:43.641311] [DEBUG] [LOCAL ] AVB: Trimmed 58578 records to 41937 (keeping 200 days of data) [2025-10-01T17:24:43.926493] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T17:24:43.964857] [DEBUG] [LOCAL ] AVB: Primary data saved (41937 records). [2025-10-01T17:24:43.965004] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-01T17:24:43.965085] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVB took 48.3s. Estimated remaining: 4h 51m 35s. Rate: 7.5 symbols/min [2025-10-01T17:24:44.115151] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-01T17:24:44.149876] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:24:44.188580] [DEBUG] [LOCAL ] AVY: Loaded 37441 existing records from primary storage. [2025-10-01T17:24:44.188932] [INFO ] [MAIN ] AVY: Loaded 37441 existing records. [2025-10-01T17:24:44.396078] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:24:44.396317] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-01T17:24:44.396366] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-01T17:24:44.396877] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-01T17:24:44.396938] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-01T17:24:44.804854] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:24:44.852293] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T17:24:44.902401] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-01T17:24:45.004733] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T17:24:45.702386] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-01T17:24:46.502377] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-01T17:24:46.575107] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T17:24:46.703947] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T17:24:47.302379] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-01T17:24:47.531548] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T17:24:48.102381] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-01T17:24:48.837040] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T17:24:48.902419] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-01T17:24:49.307144] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T17:24:49.702385] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-01T17:24:50.350594] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T17:24:50.502378] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-01T17:24:50.915892] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T17:24:51.302378] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-01T17:24:51.949933] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T17:24:52.102472] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-01T17:24:52.723068] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T17:24:52.902395] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-01T17:24:53.694038] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T17:24:53.703024] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-01T17:24:54.333890] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T17:24:54.502435] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-01T17:24:55.302407] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-01T17:24:55.579800] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T17:24:55.626783] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T17:24:56.102388] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-01T17:24:56.630809] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T17:24:56.902380] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-01T17:24:57.465412] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T17:24:57.702435] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-01T17:24:58.198229] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T17:24:58.502401] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-01T17:24:58.972484] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T17:24:59.302377] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-01T17:25:00.102354] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-01T17:25:00.229952] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T17:25:00.896463] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T17:25:00.904566] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-01T17:25:01.702415] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-01T17:25:01.822346] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T17:25:02.502362] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-01T17:25:02.714786] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T17:25:03.172807] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T17:25:03.302387] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-01T17:25:03.733175] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T17:25:04.102452] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-01T17:25:04.874521] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T17:25:04.875991] [INFO ] [REMOTE ] AVNT: Full fetch complete (56333 records). [2025-10-01T17:25:04.876100] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-01T17:25:04.910085] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-01T17:25:05.301479] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-01T17:25:05.301609] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-01T17:25:05.302308] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-01T17:25:05.302368] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-01T17:25:05.303812] [DEBUG] [LOCAL ] AVNT: Trimmed 56333 records to 39175 (keeping 200 days of data) [2025-10-01T17:25:05.581883] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T17:25:05.606103] [DEBUG] [LOCAL ] AVNT: Primary data saved (39175 records). [2025-10-01T17:25:05.606262] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-01T17:25:05.606385] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNT took 29.9s. Estimated remaining: 4h 54m 7s. Rate: 7.4 symbols/min [2025-10-01T17:25:05.709887] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-01T17:25:05.825534] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:25:05.826193] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-10-01T17:25:05.826250] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-10-01T17:25:05.826365] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-01T17:25:05.826409] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-01T17:25:05.826452] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-01T17:25:05.826485] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-01T17:25:06.241084] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:25:06.265335] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T17:25:06.502375] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-01T17:25:07.238385] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T17:25:07.302421] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-01T17:25:08.102440] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-01T17:25:08.543493] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T17:25:08.594482] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T17:25:08.596017] [INFO ] [REMOTE ] AVNS: Full fetch complete (48259 records). [2025-10-01T17:25:08.596111] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-01T17:25:08.907550] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-01T17:25:09.030035] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-01T17:25:09.030123] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-01T17:25:09.030727] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-01T17:25:09.030814] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-01T17:25:09.032145] [DEBUG] [LOCAL ] AVNS: Trimmed 48259 records to 33718 (keeping 200 days of data) [2025-10-01T17:25:09.248324] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T17:25:09.279980] [DEBUG] [LOCAL ] AVNS: Primary data saved (33718 records). [2025-10-01T17:25:09.280120] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-01T17:25:09.281394] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNS took 38.7s. Estimated remaining: 4h 53m 7s. Rate: 7.5 symbols/min [2025-10-01T17:25:09.461969] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:25:09.462158] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-10-01T17:25:09.462221] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-10-01T17:25:09.462396] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-01T17:25:09.462468] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-01T17:25:09.462528] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-01T17:25:09.462565] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-01T17:25:09.707532] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-01T17:25:09.866999] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:25:09.883092] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T17:25:10.502392] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-01T17:25:10.997011] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T17:25:11.302408] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-01T17:25:12.102472] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-01T17:25:12.572983] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-01T17:25:12.761925] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T17:25:12.902399] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-01T17:25:13.047417] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-01T17:25:13.702459] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-01T17:25:14.502379] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-01T17:25:14.708893] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T17:25:14.825979] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T17:25:15.302421] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-01T17:25:15.654003] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T17:25:16.102398] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-01T17:25:16.487044] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T17:25:16.808817] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T17:25:16.902406] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-01T17:25:17.702408] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-01T17:25:18.176776] [DEBUG] [REMOTE ] AVTR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:25:18.177089] [WARN ] [REMOTE ] AVTR: No data returned for month 2025-10 [2025-10-01T17:25:18.177189] [FATAL] [REMOTE ] AVTR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:25:18.177300] [FATAL] [MAIN ] AVTR: Failed to fetch primary data. [2025-10-01T17:25:18.177382] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:25:18.177471] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-01T17:25:18.177554] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-01T17:25:18.177607] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-10-01T17:25:18.178282] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-10-01T17:25:18.178387] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 37.0s. Estimated remaining: 4h 53m 9s. Rate: 7.4 symbols/min [2025-10-01T17:25:18.385394] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:25:18.438529] [DEBUG] [LOCAL ] AWK: Loaded 48708 existing records from primary storage. [2025-10-01T17:25:18.438945] [INFO ] [MAIN ] AWK: Loaded 48708 existing records. [2025-10-01T17:25:18.507483] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-01T17:25:18.631563] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:25:18.631813] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-01T17:25:18.631870] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-01T17:25:18.632151] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-01T17:25:18.632217] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-01T17:25:19.037431] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:25:19.185368] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T17:25:19.302385] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-01T17:25:19.700801] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T17:25:20.102390] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-01T17:25:20.907462] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-01T17:25:20.923915] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T17:25:21.702379] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-01T17:25:22.043192] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T17:25:22.052442] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-01T17:25:22.054632] [INFO ] [REMOTE ] AVY: Full fetch complete (56281 records). [2025-10-01T17:25:22.054768] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-01T17:25:22.485492] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-01T17:25:22.485597] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-01T17:25:22.486223] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-01T17:25:22.486333] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-01T17:25:22.487702] [DEBUG] [LOCAL ] AVY: Trimmed 56281 records to 37474 (keeping 200 days of data) [2025-10-01T17:25:22.546835] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-01T17:25:22.743080] [DEBUG] [LOCAL ] AVY: Primary data saved (37474 records). [2025-10-01T17:25:22.743225] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-01T17:25:22.743321] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVY took 38.8s. Estimated remaining: 4h 52m 21s. Rate: 7.5 symbols/min [2025-10-01T17:25:22.930343] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:25:22.951192] [DEBUG] [LOCAL ] AWP: Loaded 21576 existing records from primary storage. [2025-10-01T17:25:22.951448] [INFO ] [MAIN ] AWP: Loaded 21576 existing records. [2025-10-01T17:25:23.158038] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:25:23.158352] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-01T17:25:23.158413] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-01T17:25:23.158761] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-01T17:25:23.158885] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-01T17:25:23.305857] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-01T17:25:23.542635] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T17:25:23.617954] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:25:23.636127] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T17:25:24.102412] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-01T17:25:24.275859] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T17:25:24.902429] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-01T17:25:25.702434] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-01T17:25:25.757484] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T17:25:26.261756] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T17:25:26.502419] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-01T17:25:26.755611] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T17:25:27.302385] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-01T17:25:27.537512] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T17:25:28.102417] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-01T17:25:28.552534] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T17:25:28.902425] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-01T17:25:29.702391] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-01T17:25:30.057057] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T17:25:30.086667] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:25:30.502379] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-01T17:25:30.685397] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T17:25:31.302387] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-01T17:25:31.625828] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T17:25:32.102345] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-01T17:25:32.204556] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T17:25:32.902380] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-01T17:25:33.133534] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T17:25:33.702370] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-01T17:25:33.827246] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T17:25:34.502397] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-01T17:25:34.880230] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:25:35.302433] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-01T17:25:35.551880] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T17:25:36.102396] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-01T17:25:36.610190] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T17:25:36.611308] [INFO ] [REMOTE ] AWF: Full fetch complete (36207 records). [2025-10-01T17:25:36.611395] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-01T17:25:36.911528] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-01T17:25:37.045758] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-01T17:25:37.045854] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-01T17:25:37.046331] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-01T17:25:37.046377] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-01T17:25:37.047437] [DEBUG] [LOCAL ] AWF: Trimmed 36207 records to 24390 (keeping 200 days of data) [2025-10-01T17:25:37.184228] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T17:25:37.227671] [DEBUG] [LOCAL ] AWF: Primary data saved (24390 records). [2025-10-01T17:25:37.227816] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-01T17:25:37.227943] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 31.6s. Estimated remaining: 4h 53m 27s. Rate: 7.4 symbols/min [2025-10-01T17:25:37.426955] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:25:37.450294] [DEBUG] [LOCAL ] AWR: Loaded 22569 existing records from primary storage. [2025-10-01T17:25:37.450618] [INFO ] [MAIN ] AWR: Loaded 22569 existing records. [2025-10-01T17:25:37.652202] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:25:37.652434] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-01T17:25:37.652489] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-01T17:25:37.652744] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-01T17:25:37.652805] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-01T17:25:37.713321] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-01T17:25:38.063998] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:25:38.192871] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T17:25:38.502404] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-01T17:25:39.263015] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T17:25:39.302344] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-01T17:25:39.825245] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T17:25:40.102415] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-01T17:25:40.902379] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-01T17:25:41.031737] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T17:25:41.129078] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T17:25:41.586912] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T17:25:41.702398] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-01T17:25:42.502391] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-01T17:25:42.530234] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T17:25:43.302362] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-01T17:25:43.755039] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T17:25:44.102422] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-01T17:25:44.259743] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T17:25:44.902399] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-01T17:25:45.702467] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-01T17:25:45.962319] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T17:25:45.964760] [INFO ] [REMOTE ] AWI: Full fetch complete (35452 records). [2025-10-01T17:25:45.964939] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-01T17:25:46.430531] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T17:25:46.504245] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-01T17:25:46.667982] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-01T17:25:46.668134] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-01T17:25:46.668668] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-01T17:25:46.668919] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-01T17:25:46.670372] [DEBUG] [LOCAL ] AWI: Trimmed 35452 records to 25337 (keeping 200 days of data) [2025-10-01T17:25:46.858102] [DEBUG] [LOCAL ] AWI: Primary data saved (25337 records). [2025-10-01T17:25:46.858254] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-01T17:25:46.858335] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 37.6s. Estimated remaining: 4h 53m 36s. Rate: 7.4 symbols/min [2025-10-01T17:25:47.006050] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T17:25:47.092079] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:25:47.123788] [DEBUG] [LOCAL ] AX: Loaded 28340 existing records from primary storage. [2025-10-01T17:25:47.124209] [INFO ] [MAIN ] AX: Loaded 28340 existing records. [2025-10-01T17:25:47.307491] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-01T17:25:47.376853] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:25:47.377062] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-01T17:25:47.377112] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-01T17:25:47.377420] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-01T17:25:47.377479] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-01T17:25:47.797155] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:25:47.896632] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T17:25:48.102426] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-01T17:25:48.902023] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T17:25:48.906566] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-01T17:25:49.030768] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T17:25:49.702409] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-01T17:25:50.079862] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T17:25:50.502426] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-01T17:25:50.955572] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T17:25:50.956933] [INFO ] [REMOTE ] AWP: Full fetch complete (32431 records). [2025-10-01T17:25:50.957013] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-01T17:25:51.307509] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-01T17:25:51.386785] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-01T17:25:51.387058] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-01T17:25:51.387485] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-01T17:25:51.387530] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-01T17:25:51.388497] [DEBUG] [LOCAL ] AWP: Trimmed 32431 records to 21493 (keeping 200 days of data) [2025-10-01T17:25:51.519765] [DEBUG] [LOCAL ] AWP: Primary data saved (21493 records). [2025-10-01T17:25:51.519888] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-01T17:25:51.519985] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 28.8s. Estimated remaining: 4h 52m 49s. Rate: 7.4 symbols/min [2025-10-01T17:25:51.719580] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:25:51.740465] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T17:25:51.792849] [DEBUG] [LOCAL ] AXL: Loaded 50501 existing records from primary storage. [2025-10-01T17:25:51.793237] [INFO ] [MAIN ] AXL: Loaded 50501 existing records. [2025-10-01T17:25:51.989018] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:25:51.989280] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-01T17:25:51.989336] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-01T17:25:51.989735] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-01T17:25:51.989808] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-01T17:25:52.103073] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-01T17:25:52.424509] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:25:52.902384] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-01T17:25:53.197722] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T17:25:53.363769] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-01T17:25:53.702402] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-01T17:25:53.979972] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T17:25:54.502430] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-01T17:25:55.302359] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-01T17:25:55.552752] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T17:25:55.813158] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T17:25:56.102372] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-01T17:25:56.183286] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T17:25:56.902401] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-01T17:25:57.537366] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T17:25:57.702405] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-01T17:25:57.784918] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T17:25:58.457592] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T17:25:58.502413] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-01T17:25:59.302422] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-01T17:25:59.744732] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T17:26:00.102421] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-01T17:26:00.902355] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-01T17:26:01.104029] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T17:26:01.664568] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:26:01.702362] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-01T17:26:01.748186] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T17:26:02.502453] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-01T17:26:03.302425] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-01T17:26:03.376417] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T17:26:03.827576] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T17:26:04.102352] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-01T17:26:04.274360] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T17:26:04.902401] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-01T17:26:05.614859] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T17:26:05.616006] [INFO ] [REMOTE ] AWR: Full fetch complete (32067 records). [2025-10-01T17:26:05.616085] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-01T17:26:05.707588] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-01T17:26:06.043167] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-01T17:26:06.043257] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-01T17:26:06.043704] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-01T17:26:06.043787] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-01T17:26:06.044782] [DEBUG] [LOCAL ] AWR: Trimmed 32067 records to 22600 (keeping 200 days of data) [2025-10-01T17:26:06.193988] [DEBUG] [LOCAL ] AWR: Primary data saved (22600 records). [2025-10-01T17:26:06.194116] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-01T17:26:06.194197] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWR took 29.0s. Estimated remaining: 4h 53m 56s. Rate: 7.4 symbols/min [2025-10-01T17:26:06.381698] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:06.437724] [DEBUG] [LOCAL ] AXP: Loaded 53200 existing records from primary storage. [2025-10-01T17:26:06.438087] [INFO ] [MAIN ] AXP: Loaded 53200 existing records. [2025-10-01T17:26:06.515265] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-01T17:26:06.656144] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:26:06.656434] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-01T17:26:06.656518] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-01T17:26:06.656926] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-01T17:26:06.656999] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-01T17:26:07.128587] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:07.147046] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-01T17:26:07.172425] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T17:26:07.302379] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-01T17:26:08.102414] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-01T17:26:08.483491] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:26:08.893695] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T17:26:08.897877] [INFO ] [REMOTE ] AWK: Full fetch complete (70642 records). [2025-10-01T17:26:08.898001] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-01T17:26:08.910744] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-01T17:26:09.336788] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-01T17:26:09.336892] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-01T17:26:09.337682] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-01T17:26:09.337749] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-01T17:26:09.339268] [DEBUG] [LOCAL ] AWK: Trimmed 70642 records to 48703 (keeping 200 days of data) [2025-10-01T17:26:09.665559] [DEBUG] [LOCAL ] AWK: Primary data saved (48703 records). [2025-10-01T17:26:09.665751] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-01T17:26:09.665878] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWK took 51.5s. Estimated remaining: 4h 52m 56s. Rate: 7.4 symbols/min [2025-10-01T17:26:09.714163] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-01T17:26:09.860448] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:09.865938] [DEBUG] [LOCAL ] AXR: Loaded 3063 existing records from primary storage. [2025-10-01T17:26:09.866098] [INFO ] [MAIN ] AXR: Loaded 3063 existing records. [2025-10-01T17:26:10.061743] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:26:10.062032] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-01T17:26:10.062080] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-01T17:26:10.062308] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-01T17:26:10.062378] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-01T17:26:10.468839] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:10.498898] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-01T17:26:10.510091] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-01T17:26:10.614207] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T17:26:10.912399] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T17:26:11.099794] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-01T17:26:11.302400] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-01T17:26:12.102405] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-01T17:26:12.616401] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T17:26:12.904045] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-01T17:26:12.907345] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T17:26:13.702385] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-01T17:26:14.502359] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-01T17:26:14.616394] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T17:26:14.675900] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T17:26:15.302369] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-01T17:26:15.699601] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-01T17:26:16.102424] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-01T17:26:16.907533] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-01T17:26:16.921442] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-01T17:26:17.408788] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T17:26:17.526612] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-01T17:26:17.527804] [INFO ] [REMOTE ] AX: Full fetch complete (42633 records). [2025-10-01T17:26:17.527941] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-01T17:26:17.717592] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-01T17:26:17.946538] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-01T17:26:17.946628] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-01T17:26:17.947152] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-01T17:26:17.947205] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-01T17:26:17.948386] [DEBUG] [LOCAL ] AX: Trimmed 42633 records to 28317 (keeping 200 days of data) [2025-10-01T17:26:18.145683] [DEBUG] [LOCAL ] AX: Primary data saved (28317 records). [2025-10-01T17:26:18.145821] [INFO ] [MAIN ] AX: Full history saved. [2025-10-01T17:26:18.145905] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 31.3s. Estimated remaining: 4h 52m 52s. Rate: 7.4 symbols/min [2025-10-01T17:26:18.329714] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:18.371527] [DEBUG] [LOCAL ] AXS: Loaded 38397 existing records from primary storage. [2025-10-01T17:26:18.371887] [INFO ] [MAIN ] AXS: Loaded 38397 existing records. [2025-10-01T17:26:18.507468] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-01T17:26:18.568206] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:26:18.568581] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-01T17:26:18.568639] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-01T17:26:18.568926] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-01T17:26:18.568985] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-01T17:26:18.941885] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:19.266341] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T17:26:19.302348] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-01T17:26:20.102404] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-01T17:26:20.514774] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-01T17:26:20.668957] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-01T17:26:20.746474] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T17:26:20.902439] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-01T17:26:21.702388] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-01T17:26:22.502404] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-01T17:26:23.096967] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-01T17:26:23.098543] [INFO ] [REMOTE ] AXL: Full fetch complete (72638 records). [2025-10-01T17:26:23.098681] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-01T17:26:23.213719] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T17:26:23.302953] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-01T17:26:23.541399] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-01T17:26:23.541674] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-01T17:26:23.542598] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-01T17:26:23.542769] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-01T17:26:23.544341] [DEBUG] [LOCAL ] AXL: Trimmed 72638 records to 50496 (keeping 200 days of data) [2025-10-01T17:26:23.786076] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-01T17:26:23.893711] [DEBUG] [LOCAL ] AXL: Primary data saved (50496 records). [2025-10-01T17:26:23.893854] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-01T17:26:23.893954] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 32.4s. Estimated remaining: 4h 52m 19s. Rate: 7.4 symbols/min [2025-10-01T17:26:23.992751] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T17:26:24.126850] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-01T17:26:24.129702] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:24.130798] [DEBUG] [LOCAL ] AXTA: No existing data file found in primary storage. [2025-10-01T17:26:24.130849] [WARN ] [MAIN ] AXTA: No existing data found, performing full refresh instead. [2025-10-01T17:26:24.130962] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-01T17:26:24.131006] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-01T17:26:24.131051] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-01T17:26:24.131084] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-01T17:26:24.525799] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:24.902400] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-01T17:26:25.248387] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-01T17:26:25.640342] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:26:25.702401] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-01T17:26:26.502435] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-01T17:26:27.302384] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-01T17:26:27.394755] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T17:26:27.788965] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T17:26:28.102389] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-01T17:26:28.855817] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-01T17:26:28.902364] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-01T17:26:29.355622] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T17:26:29.702380] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-01T17:26:30.331339] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T17:26:30.502380] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-01T17:26:31.226991] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-01T17:26:31.302391] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-01T17:26:31.795020] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T17:26:32.066520] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-01T17:26:32.067315] [INFO ] [REMOTE ] AXR: Full fetch complete (4884 records). [2025-10-01T17:26:32.067401] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-01T17:26:32.107596] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-01T17:26:32.487918] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-01T17:26:32.488000] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-01T17:26:32.488145] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-01T17:26:32.488183] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-01T17:26:32.488592] [DEBUG] [LOCAL ] AXR: Trimmed 4884 records to 3037 (keeping 200 days of data) [2025-10-01T17:26:32.508369] [DEBUG] [LOCAL ] AXR: Primary data saved (3037 records). [2025-10-01T17:26:32.508552] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-01T17:26:32.508674] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 22.8s. Estimated remaining: 4h 52m 17s. Rate: 7.4 symbols/min [2025-10-01T17:26:32.902393] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-01T17:26:33.702393] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-01T17:26:33.774360] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T17:26:34.215733] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T17:26:34.502385] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-01T17:26:35.302393] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-01T17:26:35.415331] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T17:26:36.102383] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-01T17:26:36.524258] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-01T17:26:36.709603] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T17:26:36.902375] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-01T17:26:37.716290] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-01T17:26:37.719515] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T17:26:38.502453] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-01T17:26:38.776481] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T17:26:39.225980] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T17:26:39.302369] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-01T17:26:40.102379] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-01T17:26:40.347487] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T17:26:40.902357] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-01T17:26:41.058492] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T17:26:41.364051] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T17:26:41.702377] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-01T17:26:42.502407] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-01T17:26:43.173802] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T17:26:43.302349] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-01T17:26:43.715576] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-01T17:26:44.102359] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-01T17:26:44.257371] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T17:26:44.376905] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T17:26:44.902385] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-01T17:26:45.702396] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-01T17:26:45.997004] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T17:26:46.502416] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-01T17:26:46.891535] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-01T17:26:46.893120] [INFO ] [REMOTE ] AXP: Full fetch complete (76898 records). [2025-10-01T17:26:46.893227] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-01T17:26:47.365914] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-01T17:26:47.366280] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-01T17:26:47.367230] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-01T17:26:47.367394] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-01T17:26:47.405688] [DEBUG] [LOCAL ] AXP: Trimmed 76898 records to 53197 (keeping 200 days of data) [2025-10-01T17:26:47.408410] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T17:26:47.426705] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-01T17:26:47.780178] [DEBUG] [LOCAL ] AXP: Primary data saved (53197 records). [2025-10-01T17:26:47.780333] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-01T17:26:47.780423] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 41.6s. Estimated remaining: 4h 53m 28s. Rate: 7.4 symbols/min [2025-10-01T17:26:47.937043] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T17:26:48.102380] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-01T17:26:49.007392] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T17:26:49.018738] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-01T17:26:49.550621] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T17:26:49.702394] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-01T17:26:51.177575] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-01T17:26:51.179343] [INFO ] [REMOTE ] AXTA: Full fetch complete (75025 records). [2025-10-01T17:26:51.179540] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-01T17:26:51.566499] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T17:26:51.610941] [INFO ] [REMOTE ] AXS: Full fetch complete (55655 records). [2025-10-01T17:26:51.634155] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-01T17:26:51.633955] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-01T17:26:51.634495] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-01T17:26:51.635500] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-01T17:26:51.683440] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-01T17:26:51.760499] [DEBUG] [LOCAL ] AXTA: Trimmed 75025 records to 52067 (keeping 200 days of data) [2025-10-01T17:26:52.191678] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-01T17:26:52.192302] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-01T17:26:52.193334] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-01T17:26:52.193425] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-01T17:26:52.199002] [DEBUG] [LOCAL ] AXS: Trimmed 55655 records to 38383 (keeping 200 days of data) [2025-10-01T17:26:52.668691] [DEBUG] [LOCAL ] AXTA: Primary data saved (52067 records). [2025-10-01T17:26:52.669349] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-01T17:26:52.669714] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXTA took 28.8s. Estimated remaining: 4h 52m 44s. Rate: 7.4 symbols/min [2025-10-01T17:26:52.675056] [DEBUG] [LOCAL ] AXS: Primary data saved (38383 records). [2025-10-01T17:26:52.675220] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-01T17:26:52.677061] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXS took 34.5s. Estimated remaining: 4h 51m 9s. Rate: 7.5 symbols/min [2025-10-01T17:26:53.404033] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:53.370622] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:53.490431] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:53.497367] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:53.497988] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-01T17:26:53.498347] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-01T17:26:53.498851] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-01T17:26:53.498904] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-01T17:26:53.498949] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-01T17:26:53.498983] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-01T17:26:53.594859] [DEBUG] [LOCAL ] AZO: Loaded 11334 existing records from primary storage. [2025-10-01T17:26:53.621818] [INFO ] [MAIN ] AZO: Loaded 11334 existing records. [2025-10-01T17:26:53.700963] [DEBUG] [LOCAL ] AYI: Loaded 25081 existing records from primary storage. [2025-10-01T17:26:53.753450] [DEBUG] [LOCAL ] AZZ: Loaded 21981 existing records from primary storage. [2025-10-01T17:26:53.789959] [INFO ] [MAIN ] AYI: Loaded 25081 existing records. [2025-10-01T17:26:53.790277] [INFO ] [MAIN ] AZZ: Loaded 21981 existing records. [2025-10-01T17:26:54.421873] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:26:54.504854] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-01T17:26:54.585720] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:26:54.582453] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:26:54.590305] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-01T17:26:54.613590] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-01T17:26:54.605664] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-01T17:26:54.613978] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-01T17:26:54.620368] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:54.614065] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-01T17:26:54.620894] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-01T17:26:54.620829] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-01T17:26:54.621088] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-01T17:26:54.621058] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-01T17:26:54.626736] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-01T17:26:54.645471] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-01T17:26:54.711691] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-01T17:26:55.692775] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:55.782552] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-01T17:26:55.766739] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:55.788952] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-01T17:26:55.850200] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:55.850569] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-01T17:26:56.381142] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T17:26:56.388354] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-01T17:26:56.958027] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T17:26:56.962507] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-01T17:26:56.980770] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T17:26:56.984635] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-01T17:26:57.074170] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T17:26:57.081113] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-01T17:26:57.611456] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T17:26:57.617350] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-01T17:26:57.670215] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T17:26:57.702341] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-01T17:26:57.787361] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:26:57.787749] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-01T17:26:57.787972] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:26:57.788105] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-01T17:26:57.788200] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:26:57.788378] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-01T17:26:57.788488] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-01T17:26:57.788584] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-01T17:26:57.788699] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-01T17:26:57.788803] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 5.1s. Estimated remaining: 4h 50m 29s. Rate: 7.5 symbols/min [2025-10-01T17:26:57.984869] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:26:57.997560] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T17:26:58.061762] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-01T17:26:58.062200] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-01T17:26:58.189152] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T17:26:58.293314] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:26:58.294524] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-01T17:26:58.294340] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T17:26:58.294688] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-01T17:26:58.297764] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-01T17:26:58.297865] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-01T17:26:58.508566] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-01T17:26:58.705783] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:26:59.197453] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T17:26:59.302375] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-01T17:26:59.935146] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T17:27:00.102388] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-01T17:27:00.902392] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-01T17:27:00.958961] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T17:27:01.702359] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-01T17:27:02.025638] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T17:27:02.502386] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-01T17:27:03.302366] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-01T17:27:03.611772] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T17:27:04.007686] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-01T17:27:04.102397] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-01T17:27:04.476206] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T17:27:04.902379] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-01T17:27:04.973358] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T17:27:05.702401] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-01T17:27:06.072840] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T17:27:06.502393] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-01T17:27:07.302372] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-01T17:27:07.754908] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T17:27:08.080716] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-01T17:27:08.102342] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-01T17:27:08.543314] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T17:27:08.902395] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-01T17:27:09.702380] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-01T17:27:10.014331] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T17:27:10.198497] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-01T17:27:10.502380] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-01T17:27:11.050699] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T17:27:11.302376] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-01T17:27:12.083681] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T17:27:12.102377] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-01T17:27:12.902424] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-01T17:27:13.180356] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T17:27:13.702368] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-01T17:27:14.090597] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T17:27:14.177943] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-01T17:27:14.502396] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-01T17:27:14.549420] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T17:27:15.302352] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-01T17:27:15.683194] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T17:27:16.102385] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-01T17:27:16.902395] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-01T17:27:17.270859] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T17:27:17.702396] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-01T17:27:17.752353] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T17:27:17.812172] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-01T17:27:18.502393] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-01T17:27:18.636189] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T17:27:19.302365] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-01T17:27:19.616160] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T17:27:20.102389] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-01T17:27:20.493509] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T17:27:20.494490] [INFO ] [REMOTE ] AZO: Full fetch complete (16181 records). [2025-10-01T17:27:20.494576] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-01T17:27:20.904902] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-01T17:27:20.904986] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-01T17:27:20.905234] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-01T17:27:20.906585] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-01T17:27:20.906681] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-01T17:27:20.907376] [DEBUG] [LOCAL ] AZO: Trimmed 16181 records to 11278 (keeping 200 days of data) [2025-10-01T17:27:20.990032] [DEBUG] [LOCAL ] AZO: Primary data saved (11278 records). [2025-10-01T17:27:20.990280] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-01T17:27:20.990454] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZO took 28.3s. Estimated remaining: 4h 53m 4s. Rate: 7.4 symbols/min [2025-10-01T17:27:21.196217] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:27:21.196558] [DEBUG] [LOCAL ] BABA: No existing data file found in primary storage. [2025-10-01T17:27:21.196677] [WARN ] [MAIN ] BABA: No existing data found, performing full refresh instead. [2025-10-01T17:27:21.203908] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-01T17:27:21.203994] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-01T17:27:21.213806] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-01T17:27:21.216540] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-01T17:27:21.223980] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T17:27:21.610885] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:27:21.702503] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-01T17:27:22.193623] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-01T17:27:22.194736] [INFO ] [REMOTE ] AZZ: Full fetch complete (30813 records). [2025-10-01T17:27:22.194820] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-01T17:27:22.507561] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-01T17:27:22.603360] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-01T17:27:22.603454] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-01T17:27:22.603981] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-01T17:27:22.604049] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-01T17:27:22.605073] [DEBUG] [LOCAL ] AZZ: Trimmed 30813 records to 21975 (keeping 200 days of data) [2025-10-01T17:27:22.753730] [DEBUG] [LOCAL ] AZZ: Primary data saved (21975 records). [2025-10-01T17:27:22.753865] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-01T17:27:22.753953] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 30.1s. Estimated remaining: 4h 51m 48s. Rate: 7.4 symbols/min [2025-10-01T17:27:22.940467] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:27:22.997276] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-01T17:27:22.997614] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-01T17:27:23.198963] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:27:23.199185] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-01T17:27:23.199257] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-01T17:27:23.199610] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-01T17:27:23.199699] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-01T17:27:23.307673] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-01T17:27:23.622397] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:27:23.636988] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T17:27:24.102388] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-01T17:27:24.450722] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-01T17:27:24.902409] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-01T17:27:25.702414] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-01T17:27:26.136766] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-01T17:27:26.193871] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-01T17:27:26.359774] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T17:27:26.361066] [INFO ] [REMOTE ] AYI: Full fetch complete (36973 records). [2025-10-01T17:27:26.361180] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-01T17:27:26.511541] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-01T17:27:26.771110] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-01T17:27:26.771191] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-01T17:27:26.771686] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-01T17:27:26.771749] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-01T17:27:26.772619] [DEBUG] [LOCAL ] AYI: Trimmed 36973 records to 25181 (keeping 200 days of data) [2025-10-01T17:27:26.939755] [DEBUG] [LOCAL ] AYI: Primary data saved (25181 records). [2025-10-01T17:27:26.939899] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-01T17:27:26.940011] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AYI took 34.3s. Estimated remaining: 4h 50m 58s. Rate: 7.4 symbols/min [2025-10-01T17:27:27.143452] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:27:27.205860] [DEBUG] [LOCAL ] BAH: Loaded 51655 existing records from primary storage. [2025-10-01T17:27:27.206256] [INFO ] [MAIN ] BAH: Loaded 51655 existing records. [2025-10-01T17:27:27.311927] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-01T17:27:27.410066] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:27:27.410293] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-01T17:27:27.410342] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-01T17:27:27.410559] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-01T17:27:27.410617] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-01T17:27:27.818214] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:27:27.853397] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-01T17:27:28.102391] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-01T17:27:28.902457] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-01T17:27:29.118412] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-01T17:27:29.692009] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-01T17:27:29.702871] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-01T17:27:29.988281] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T17:27:30.502474] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-01T17:27:31.271085] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-01T17:27:31.302401] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-01T17:27:32.102414] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-01T17:27:32.243454] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-01T17:27:32.386832] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T17:27:32.902377] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-01T17:27:33.180676] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T17:27:33.702380] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-01T17:27:34.437637] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T17:27:34.502394] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-01T17:27:34.918333] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-01T17:27:35.302393] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-01T17:27:35.773160] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-01T17:27:36.102385] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-01T17:27:36.849322] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-01T17:27:36.902343] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-01T17:27:37.342952] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T17:27:37.702373] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-01T17:27:38.175854] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T17:27:38.502377] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-01T17:27:39.249298] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-01T17:27:39.302372] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-01T17:27:39.368285] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T17:27:40.102377] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-01T17:27:40.902354] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-01T17:27:40.960195] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-01T17:27:41.702380] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-01T17:27:41.902918] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T17:27:42.502385] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-01T17:27:42.792137] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (3.49 seconds). [2025-10-01T17:27:42.793870] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-01T17:27:42.794005] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-01T17:27:43.226546] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-01T17:27:43.226678] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-01T17:27:43.227506] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-01T17:27:43.227553] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-01T17:27:43.229203] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-10-01T17:27:43.614036] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T17:27:43.635584] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-01T17:27:43.673577] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-01T17:27:43.694046] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-01T17:27:43.694181] [INFO ] [MAIN ] BA: Full history saved. [2025-10-01T17:27:43.695445] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 45.9s. Estimated remaining: 4h 52m 22s. Rate: 7.4 symbols/min [2025-10-01T17:27:43.880488] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:27:43.880718] [DEBUG] [LOCAL ] BAK: No existing data file found in primary storage. [2025-10-01T17:27:43.880774] [WARN ] [MAIN ] BAK: No existing data found, performing full refresh instead. [2025-10-01T17:27:43.880897] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-01T17:27:43.880942] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-01T17:27:43.880986] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-10-01T17:27:43.881027] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-01T17:27:44.109977] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-01T17:27:44.306824] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:27:44.624680] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-01T17:27:44.902383] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-01T17:27:45.702417] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-01T17:27:45.904811] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-01T17:27:46.502377] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-01T17:27:46.812037] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T17:27:46.995248] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T17:27:47.038166] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-01T17:27:47.302394] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-01T17:27:48.102327] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-01T17:27:48.827526] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-01T17:27:48.902394] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-01T17:27:49.702424] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-01T17:27:49.766991] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-01T17:27:49.993752] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T17:27:50.502406] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-01T17:27:50.986598] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-01T17:27:51.135922] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T17:27:51.302430] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-01T17:27:51.545305] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T17:27:52.102396] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-01T17:27:52.902357] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-01T17:27:52.951361] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T17:27:53.634791] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T17:27:53.702369] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-01T17:27:54.502417] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-01T17:27:55.302438] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-01T17:27:56.313037] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (3.41 seconds). [2025-10-01T17:27:56.314687] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-01T17:27:56.314799] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-01T17:27:56.771821] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T17:27:56.822143] [INFO ] [REMOTE ] BAH: Full fetch complete (74783 records). [2025-10-01T17:27:56.839891] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-01T17:27:56.858308] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-01T17:27:56.865754] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-01T17:27:56.840254] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-01T17:27:56.869034] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-01T17:27:56.872572] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (3.17 seconds). [2025-10-01T17:27:56.909052] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T17:27:56.945467] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-10-01T17:27:56.945158] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-01T17:27:56.967546] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-01T17:27:57.473242] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-01T17:27:57.473583] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-01T17:27:57.474702] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-01T17:27:57.474788] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-01T17:27:57.478694] [DEBUG] [LOCAL ] BAH: Trimmed 74783 records to 51669 (keeping 200 days of data) [2025-10-01T17:27:57.955827] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-01T17:27:57.956688] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-01T17:27:57.957028] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAC took 35.2s. Estimated remaining: 4h 53m 19s. Rate: 7.4 symbols/min [2025-10-01T17:27:58.166203] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:27:58.262543] [DEBUG] [LOCAL ] BAH: Primary data saved (51669 records). [2025-10-01T17:27:58.262798] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-01T17:27:58.262949] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 31.3s. Estimated remaining: 4h 51m 49s. Rate: 7.4 symbols/min [2025-10-01T17:27:58.334822] [DEBUG] [LOCAL ] BALL: Loaded 51794 existing records from primary storage. [2025-10-01T17:27:58.388482] [INFO ] [MAIN ] BALL: Loaded 51794 existing records. [2025-10-01T17:27:58.577030] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T17:27:58.620338] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:27:58.651786] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-01T17:27:58.656223] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-01T17:27:58.656428] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-01T17:27:58.656875] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-01T17:27:58.657536] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-01T17:27:58.658766] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-01T17:27:58.658197] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-01T17:27:58.883008] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:27:58.886567] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-01T17:27:58.886993] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-01T17:27:58.892945] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-01T17:27:58.908371] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-01T17:27:59.387770] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:27:59.422518] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-01T17:27:59.582836] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:27:59.583172] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-01T17:27:59.659682] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-01T17:27:59.802092] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T17:28:00.102426] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-01T17:28:00.746215] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T17:28:00.902396] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-01T17:28:01.319391] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T17:28:01.386128] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T17:28:01.702353] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-01T17:28:01.738898] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T17:28:02.502414] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-01T17:28:03.209056] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T17:28:03.274184] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T17:28:03.302352] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-01T17:28:04.102384] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-01T17:28:04.902429] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-01T17:28:05.324496] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T17:28:05.543397] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T17:28:05.637546] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-01T17:28:05.702389] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-01T17:28:06.502440] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-01T17:28:07.302410] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-01T17:28:07.929525] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T17:28:08.102386] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-01T17:28:08.243056] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-01T17:28:08.244511] [INFO ] [REMOTE ] BAK: Full fetch complete (57188 records). [2025-10-01T17:28:08.244603] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-01T17:28:08.676820] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-01T17:28:08.676910] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-01T17:28:08.677695] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-01T17:28:08.677775] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-01T17:28:08.679124] [DEBUG] [LOCAL ] BAK: Trimmed 57188 records to 39146 (keeping 200 days of data) [2025-10-01T17:28:08.902844] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-01T17:28:08.911213] [DEBUG] [LOCAL ] BAK: Primary data saved (39146 records). [2025-10-01T17:28:08.911820] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-01T17:28:08.912014] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAK took 25.2s. Estimated remaining: 4h 52m 8s. Rate: 7.4 symbols/min [2025-10-01T17:28:09.115864] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:28:09.114292] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T17:28:09.116040] [DEBUG] [LOCAL ] BAM: No existing data file found in primary storage. [2025-10-01T17:28:09.119486] [WARN ] [MAIN ] BAM: No existing data found, performing full refresh instead. [2025-10-01T17:28:09.119969] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-01T17:28:09.120019] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-01T17:28:09.120063] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-01T17:28:09.120096] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-01T17:28:09.511256] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:28:09.702434] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-01T17:28:10.203283] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (4.50 seconds). [2025-10-01T17:28:10.205081] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-01T17:28:10.205186] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-01T17:28:10.507296] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-01T17:28:10.639339] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-01T17:28:10.639505] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-01T17:28:10.640320] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-01T17:28:10.640405] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-01T17:28:10.662418] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-10-01T17:28:10.684550] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T17:28:11.048143] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-01T17:28:11.048291] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-01T17:28:11.048369] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BABA took 50.1s. Estimated remaining: 4h 50m 58s. Rate: 7.4 symbols/min [2025-10-01T17:28:11.252169] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:28:11.284092] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T17:28:11.302346] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-01T17:28:11.346755] [DEBUG] [LOCAL ] BANC: Loaded 51234 existing records from primary storage. [2025-10-01T17:28:11.347154] [INFO ] [MAIN ] BANC: Loaded 51234 existing records. [2025-10-01T17:28:11.592878] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T17:28:11.592102] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:28:11.596298] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-01T17:28:11.597353] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-01T17:28:11.597817] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-01T17:28:11.597901] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-01T17:28:12.046906] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:28:12.102402] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-01T17:28:12.902353] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-01T17:28:12.984274] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T17:28:13.020778] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T17:28:13.702407] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-01T17:28:14.200750] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T17:28:14.502430] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-01T17:28:15.302403] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-01T17:28:15.468265] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-01T17:28:16.102388] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-01T17:28:16.252387] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T17:28:16.519096] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T17:28:16.902386] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-01T17:28:17.702371] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-01T17:28:17.802999] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T17:28:18.108615] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-01T17:28:18.510815] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-01T17:28:18.533099] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T17:28:19.302385] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-01T17:28:19.994540] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:28:20.102397] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-01T17:28:20.902381] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-01T17:28:20.960198] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T17:28:21.674798] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:28:21.702362] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-01T17:28:22.371189] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T17:28:22.502417] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-01T17:28:23.302393] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-01T17:28:23.493887] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T17:28:24.102392] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-01T17:28:24.195240] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T17:28:24.237430] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T17:28:24.902443] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-01T17:28:25.465481] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T17:28:25.702394] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-01T17:28:26.502412] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-01T17:28:26.575672] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T17:28:27.302364] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-01T17:28:27.451892] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T17:28:28.042888] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T17:28:28.102411] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-01T17:28:28.191213] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T17:28:28.192153] [INFO ] [REMOTE ] BALY: Full fetch complete (16930 records). [2025-10-01T17:28:28.192232] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-01T17:28:28.407059] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T17:28:28.407403] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-01T17:28:28.407476] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-01T17:28:28.407559] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-01T17:28:28.407632] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-01T17:28:28.407714] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-01T17:28:28.407794] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-01T17:28:28.407912] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALY took 30.1s. Estimated remaining: 4h 52m 25s. Rate: 7.4 symbols/min [2025-10-01T17:28:28.594998] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:28:28.620638] [DEBUG] [LOCAL ] BAP: Loaded 26131 existing records from primary storage. [2025-10-01T17:28:28.620979] [INFO ] [MAIN ] BAP: Loaded 26131 existing records. [2025-10-01T17:28:28.825838] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:28:28.826114] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-01T17:28:28.826169] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-01T17:28:28.826400] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-01T17:28:28.826461] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-01T17:28:28.910075] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-01T17:28:29.246191] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:28:29.702385] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-01T17:28:29.858318] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T17:28:30.502367] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-01T17:28:30.706046] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T17:28:31.108561] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T17:28:31.302390] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-01T17:28:32.102352] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-01T17:28:32.135440] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T17:28:32.489600] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T17:28:32.902388] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-01T17:28:33.438706] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T17:28:33.702389] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-01T17:28:34.179215] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T17:28:34.502384] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-01T17:28:35.302404] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-01T17:28:35.365010] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T17:28:36.102375] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-01T17:28:36.171006] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T17:28:36.214135] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T17:28:36.902380] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-01T17:28:37.702390] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-01T17:28:38.281231] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-01T17:28:38.283205] [INFO ] [REMOTE ] BALL: Full fetch complete (75365 records). [2025-10-01T17:28:38.283370] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-01T17:28:38.519534] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-01T17:28:39.048086] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-01T17:28:39.048217] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-01T17:28:39.049876] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-01T17:28:39.054173] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-01T17:28:39.056853] [DEBUG] [LOCAL ] BALL: Trimmed 75365 records to 51797 (keeping 200 days of data) [2025-10-01T17:28:39.063852] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-01T17:28:39.303529] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-01T17:28:39.505978] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T17:28:39.629928] [DEBUG] [LOCAL ] BALL: Primary data saved (51797 records). [2025-10-01T17:28:39.630089] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-01T17:28:39.630184] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALL took 41.7s. Estimated remaining: 4h 52m 49s. Rate: 7.4 symbols/min [2025-10-01T17:28:39.857366] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:28:39.859114] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T17:28:39.865688] [DEBUG] [LOCAL ] BARK: No existing data file found in primary storage. [2025-10-01T17:28:39.865781] [WARN ] [MAIN ] BARK: No existing data found, performing full refresh instead. [2025-10-01T17:28:39.865922] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-01T17:28:39.865969] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-01T17:28:39.866044] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-10-01T17:28:39.866115] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-01T17:28:40.107458] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-01T17:28:40.274226] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:28:40.902398] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-01T17:28:41.294410] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-01T17:28:41.535543] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T17:28:41.702418] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-01T17:28:42.502390] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-01T17:28:43.072142] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T17:28:43.073852] [INFO ] [REMOTE ] BANC: Full fetch complete (74241 records). [2025-10-01T17:28:43.073980] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-01T17:28:43.309080] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-01T17:28:43.516843] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-01T17:28:43.516941] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-01T17:28:43.517775] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-01T17:28:43.517870] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-01T17:28:43.519530] [DEBUG] [LOCAL ] BANC: Trimmed 74241 records to 51240 (keeping 200 days of data) [2025-10-01T17:28:43.640442] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T17:28:43.877233] [DEBUG] [LOCAL ] BANC: Primary data saved (51240 records). [2025-10-01T17:28:43.877466] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-01T17:28:43.877569] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BANC took 32.8s. Estimated remaining: 4h 52m 1s. Rate: 7.4 symbols/min [2025-10-01T17:28:43.952460] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T17:28:43.992092] [INFO ] [REMOTE ] BAM: Full fetch complete (74254 records). [2025-10-01T17:28:43.995479] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-01T17:28:44.120406] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-01T17:28:44.160249] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:28:44.564311] [DEBUG] [LOCAL ] BAX: Loaded 53492 existing records from primary storage. [2025-10-01T17:28:44.568604] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-01T17:28:44.568994] [INFO ] [MAIN ] BAX: Loaded 53492 existing records. [2025-10-01T17:28:44.569200] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-01T17:28:44.575446] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-01T17:28:44.608789] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-01T17:28:44.689710] [DEBUG] [LOCAL ] BAM: Trimmed 74254 records to 51995 (keeping 200 days of data) [2025-10-01T17:28:44.886103] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:28:44.893232] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-01T17:28:44.893315] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-01T17:28:44.893966] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-01T17:28:44.894064] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-01T17:28:45.055254] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T17:28:45.086418] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-01T17:28:45.355338] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T17:28:45.413039] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:28:45.635846] [DEBUG] [LOCAL ] BAM: Primary data saved (51995 records). [2025-10-01T17:28:45.635991] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-01T17:28:45.636070] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BAM took 36.7s. Estimated remaining: 4h 50m 49s. Rate: 7.4 symbols/min [2025-10-01T17:28:45.707583] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-01T17:28:45.823994] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:28:45.873200] [DEBUG] [LOCAL ] BB: Loaded 52928 existing records from primary storage. [2025-10-01T17:28:45.873551] [INFO ] [MAIN ] BB: Loaded 52928 existing records. [2025-10-01T17:28:46.066777] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:28:46.067004] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-01T17:28:46.067051] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-01T17:28:46.067281] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-01T17:28:46.067339] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-01T17:28:46.454472] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:28:46.502353] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-01T17:28:46.598351] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T17:28:47.177539] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T17:28:47.302415] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-01T17:28:48.102423] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-01T17:28:48.373038] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T17:28:48.453103] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T17:28:48.902394] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-01T17:28:49.500866] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T17:28:49.702385] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-01T17:28:50.502398] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-01T17:28:50.930514] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-01T17:28:50.937235] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T17:28:51.302412] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-01T17:28:52.102366] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-01T17:28:52.522463] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-01T17:28:52.910483] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-01T17:28:52.926771] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T17:28:53.702437] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-01T17:28:54.106775] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-01T17:28:54.108033] [INFO ] [REMOTE ] BAP: Full fetch complete (37719 records). [2025-10-01T17:28:54.108118] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-01T17:28:54.512423] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-01T17:28:54.531095] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-01T17:28:54.531224] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-01T17:28:54.531899] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-01T17:28:54.532064] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-01T17:28:54.533286] [DEBUG] [LOCAL ] BAP: Trimmed 37719 records to 26187 (keeping 200 days of data) [2025-10-01T17:28:54.718310] [DEBUG] [LOCAL ] BAP: Primary data saved (26187 records). [2025-10-01T17:28:54.718482] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-01T17:28:54.718595] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 26.3s. Estimated remaining: 4h 50m 51s. Rate: 7.4 symbols/min [2025-10-01T17:28:54.943553] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:28:54.998813] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-01T17:28:54.999343] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-01T17:28:55.153278] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-01T17:28:55.250121] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:28:55.250434] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-01T17:28:55.250723] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-01T17:28:55.251118] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-01T17:28:55.251208] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-01T17:28:55.319172] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-01T17:28:55.584139] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T17:28:55.718575] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:28:55.742435] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T17:28:56.102424] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-01T17:28:56.902401] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-01T17:28:57.348405] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T17:28:57.702393] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-01T17:28:57.839762] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T17:28:57.980808] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T17:28:58.502380] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-01T17:28:59.302352] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-01T17:28:59.715325] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T17:29:00.102374] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-01T17:29:00.291634] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T17:29:00.902400] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-01T17:29:01.702444] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-01T17:29:02.097969] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-10-01T17:29:02.175901] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T17:29:02.263915] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T17:29:02.502430] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-01T17:29:03.268278] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T17:29:03.302342] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-01T17:29:03.753541] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T17:29:04.102421] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-01T17:29:04.730041] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T17:29:04.902403] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-01T17:29:05.232434] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T17:29:05.702392] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-01T17:29:06.502445] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-01T17:29:07.302427] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-01T17:29:07.452325] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T17:29:07.497571] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-01T17:29:07.531196] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T17:29:08.102422] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-01T17:29:08.902360] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-01T17:29:09.377960] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-01T17:29:09.601841] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T17:29:09.702447] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-01T17:29:10.502390] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-01T17:29:10.735775] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-01T17:29:10.737111] [INFO ] [REMOTE ] BARK: Full fetch complete (56491 records). [2025-10-01T17:29:10.737220] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-01T17:29:11.148173] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-01T17:29:11.148269] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-01T17:29:11.148926] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-01T17:29:11.148992] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-01T17:29:11.150214] [DEBUG] [LOCAL ] BARK: Trimmed 56491 records to 38105 (keeping 200 days of data) [2025-10-01T17:29:11.307481] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-01T17:29:11.374094] [DEBUG] [LOCAL ] BARK: Primary data saved (38105 records). [2025-10-01T17:29:11.374246] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-01T17:29:11.374338] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BARK took 31.7s. Estimated remaining: 4h 52m 8s. Rate: 7.4 symbols/min [2025-10-01T17:29:11.574404] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:29:11.617173] [DEBUG] [LOCAL ] BBAR: Loaded 41447 existing records from primary storage. [2025-10-01T17:29:11.617681] [INFO ] [MAIN ] BBAR: Loaded 41447 existing records. [2025-10-01T17:29:11.827283] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:29:11.827798] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-01T17:29:11.827951] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-01T17:29:11.828445] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-01T17:29:11.839824] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-01T17:29:11.968007] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-01T17:29:12.107061] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-01T17:29:12.322065] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:29:12.902369] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-01T17:29:13.101961] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-01T17:29:13.196316] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T17:29:13.702380] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-01T17:29:14.046232] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T17:29:14.502386] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-01T17:29:14.779103] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T17:29:15.302390] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-01T17:29:16.102348] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-01T17:29:16.259973] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-01T17:29:16.451826] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T17:29:16.913389] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-01T17:29:16.919349] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T17:29:17.702412] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-01T17:29:17.940357] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T17:29:18.502420] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-01T17:29:19.033457] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-01T17:29:19.302392] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-01T17:29:20.102405] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-01T17:29:20.432542] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-01T17:29:20.434174] [INFO ] [REMOTE ] BB: Full fetch complete (76988 records). [2025-10-01T17:29:20.434273] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-01T17:29:20.865763] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-01T17:29:20.865855] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-01T17:29:20.866698] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-01T17:29:20.866787] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-01T17:29:20.868330] [DEBUG] [LOCAL ] BB: Trimmed 76988 records to 52930 (keeping 200 days of data) [2025-10-01T17:29:20.966073] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-01T17:29:20.968937] [INFO ] [REMOTE ] BAX: Full fetch complete (77443 records). [2025-10-01T17:29:20.969629] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-01T17:29:21.450843] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-01T17:29:21.453539] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-01T17:29:21.456640] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-01T17:29:21.457450] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-01T17:29:21.462501] [DEBUG] [LOCAL ] BAX: Trimmed 77443 records to 53493 (keeping 200 days of data) [2025-10-01T17:29:21.684133] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T17:29:21.698438] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-01T17:29:21.903394] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-01T17:29:21.971876] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-01T17:29:22.011520] [DEBUG] [LOCAL ] BB: Primary data saved (52930 records). [2025-10-01T17:29:22.012251] [INFO ] [MAIN ] BB: Full history saved. [2025-10-01T17:29:22.016106] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BB took 36.4s. Estimated remaining: 4h 52m 25s. Rate: 7.4 symbols/min [2025-10-01T17:29:22.214617] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:29:22.340823] [DEBUG] [LOCAL ] BBD: Loaded 53195 existing records from primary storage. [2025-10-01T17:29:22.343527] [DEBUG] [LOCAL ] BAX: Primary data saved (53493 records). [2025-10-01T17:29:22.343907] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-01T17:29:22.344069] [INFO ] [MAIN ] BBD: Loaded 53195 existing records. [2025-10-01T17:29:22.349380] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BAX took 38.5s. Estimated remaining: 4h 50m 60s. Rate: 7.4 symbols/min [2025-10-01T17:29:22.746755] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:29:22.751577] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:29:22.751949] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-01T17:29:22.752316] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-01T17:29:22.752581] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-01T17:29:22.752676] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-01T17:29:23.062095] [DEBUG] [LOCAL ] BBDC: Loaded 33001 existing records from primary storage. [2025-10-01T17:29:23.069807] [INFO ] [MAIN ] BBDC: Loaded 33001 existing records. [2025-10-01T17:29:23.319713] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:29:23.320288] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-01T17:29:23.413995] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:29:23.414390] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-01T17:29:23.414462] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-01T17:29:23.414782] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-01T17:29:23.414853] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-01T17:29:23.613903] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T17:29:23.711519] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-01T17:29:23.866213] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:29:24.102344] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-01T17:29:24.203846] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-01T17:29:24.902437] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-01T17:29:25.242540] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T17:29:25.374783] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T17:29:25.513848] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-01T17:29:25.702397] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-01T17:29:26.502383] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-01T17:29:27.007284] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T17:29:27.302389] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-01T17:29:27.852556] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-01T17:29:28.021827] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T17:29:28.102385] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-01T17:29:28.196796] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T17:29:28.902381] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-01T17:29:29.702421] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-01T17:29:30.424311] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-01T17:29:30.502399] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-01T17:29:30.623396] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T17:29:31.195498] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T17:29:31.302438] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-01T17:29:32.102424] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-01T17:29:32.391566] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T17:29:32.685167] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-01T17:29:32.902401] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-01T17:29:33.283272] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:29:33.702379] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-01T17:29:34.124630] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-01T17:29:34.502381] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-01T17:29:35.298971] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T17:29:35.309151] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-01T17:29:35.772210] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T17:29:36.102386] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-01T17:29:36.902376] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-01T17:29:37.570448] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T17:29:37.702375] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-01T17:29:37.854896] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T17:29:38.502426] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-01T17:29:39.302397] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-01T17:29:39.409901] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T17:29:39.444185] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (4.14 seconds). [2025-10-01T17:29:39.445807] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-01T17:29:39.445916] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-01T17:29:39.909088] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-01T17:29:39.910450] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T17:29:39.909574] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-01T17:29:39.913835] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-01T17:29:39.917980] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-01T17:29:39.920352] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-01T17:29:40.124059] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-01T17:29:40.241117] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-01T17:29:40.241254] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-01T17:29:40.241347] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAI took 45.5s. Estimated remaining: 4h 52m 28s. Rate: 7.4 symbols/min [2025-10-01T17:29:40.433316] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:29:40.440466] [DEBUG] [LOCAL ] BBDO: Loaded 4915 existing records from primary storage. [2025-10-01T17:29:40.440720] [INFO ] [MAIN ] BBDO: Loaded 4915 existing records. [2025-10-01T17:29:40.645201] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:29:40.645426] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-01T17:29:40.645476] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-01T17:29:40.646442] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-01T17:29:40.646503] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-01T17:29:40.903723] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-01T17:29:41.040224] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:29:41.206808] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T17:29:41.358731] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T17:29:41.702397] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-01T17:29:42.502356] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-01T17:29:42.511189] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T17:29:43.015538] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-01T17:29:43.302388] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-01T17:29:44.071463] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T17:29:44.102348] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-01T17:29:44.902371] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-01T17:29:45.099623] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T17:29:45.702436] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-01T17:29:46.406741] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T17:29:46.411439] [INFO ] [REMOTE ] BBAR: Full fetch complete (60837 records). [2025-10-01T17:29:46.411596] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-01T17:29:46.511676] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-01T17:29:46.609957] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T17:29:46.664089] [INFO ] [REMOTE ] BBDC: Full fetch complete (48740 records). [2025-10-01T17:29:46.689675] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-01T17:29:47.065134] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-01T17:29:47.083749] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-01T17:29:47.114265] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-01T17:29:47.119999] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T17:29:47.172127] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-01T17:29:47.241381] [DEBUG] [LOCAL ] BBAR: Trimmed 60837 records to 41510 (keeping 200 days of data) [2025-10-01T17:29:47.341428] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-01T17:29:47.341050] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-01T17:29:47.350569] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-01T17:29:47.380063] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-01T17:29:47.380455] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-01T17:29:47.396089] [DEBUG] [LOCAL ] BBDC: Trimmed 48740 records to 32973 (keeping 200 days of data) [2025-10-01T17:29:47.667095] [DEBUG] [LOCAL ] BBAR: Primary data saved (41510 records). [2025-10-01T17:29:47.668579] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-01T17:29:47.669307] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBAR took 36.3s. Estimated remaining: 4h 52m 13s. Rate: 7.4 symbols/min [2025-10-01T17:29:47.881449] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:29:47.928902] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T17:29:47.989239] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-01T17:29:48.012923] [DEBUG] [LOCAL ] BBN: Loaded 18034 existing records from primary storage. [2025-10-01T17:29:48.024111] [INFO ] [MAIN ] BBN: Loaded 18034 existing records. [2025-10-01T17:29:48.028379] [DEBUG] [LOCAL ] BBDC: Primary data saved (32973 records). [2025-10-01T17:29:48.033759] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-01T17:29:48.065371] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDC took 25.7s. Estimated remaining: 4h 50m 49s. Rate: 7.4 symbols/min [2025-10-01T17:29:48.107462] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-01T17:29:48.451255] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:29:48.451477] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-01T17:29:48.447034] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:29:48.451603] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-01T17:29:48.451740] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-01T17:29:48.451859] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-01T17:29:48.452002] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-01T17:29:48.452054] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-01T17:29:48.452099] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-01T17:29:48.452134] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-01T17:29:48.452176] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-01T17:29:48.452246] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-01T17:29:48.910504] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-01T17:29:49.276929] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:29:49.299737] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:29:49.702410] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-01T17:29:49.782055] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T17:29:49.932198] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T17:29:50.502392] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-01T17:29:50.788742] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T17:29:51.302404] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-01T17:29:51.822064] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-01T17:29:52.102365] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-01T17:29:52.264742] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T17:29:52.294528] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:29:52.294875] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-01T17:29:52.294976] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:29:52.295035] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-01T17:29:52.295115] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:29:52.295200] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-01T17:29:52.295294] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-01T17:29:52.295353] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-01T17:29:52.295430] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-01T17:29:52.295528] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBT took 4.2s. Estimated remaining: 4h 50m 3s. Rate: 7.4 symbols/min [2025-10-01T17:29:52.477845] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:29:52.485353] [DEBUG] [LOCAL ] BBU: Loaded 4648 existing records from primary storage. [2025-10-01T17:29:52.485564] [INFO ] [MAIN ] BBU: Loaded 4648 existing records. [2025-10-01T17:29:52.673060] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:29:52.673276] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-01T17:29:52.673345] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-01T17:29:52.673600] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-01T17:29:52.673697] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-01T17:29:52.907507] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-01T17:29:53.067891] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:29:53.702386] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-01T17:29:54.502392] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-01T17:29:54.679077] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T17:29:54.711958] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T17:29:55.103860] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T17:29:55.302396] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-01T17:29:56.102372] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-01T17:29:56.240446] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-01T17:29:56.687961] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T17:29:56.902447] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-01T17:29:57.492930] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T17:29:57.702390] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-01T17:29:58.086838] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-01T17:29:58.502385] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-01T17:29:59.047548] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T17:29:59.302399] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-01T17:30:00.102430] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-01T17:30:00.550506] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T17:30:00.902355] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-01T17:30:01.702387] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-01T17:30:01.763694] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-01T17:30:02.119818] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-01T17:30:02.123235] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-10-01T17:30:02.123494] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-01T17:30:02.266994] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-01T17:30:02.507528] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-01T17:30:02.620794] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-01T17:30:02.620893] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-01T17:30:02.622012] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-01T17:30:02.622082] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-01T17:30:02.623871] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53197 (keeping 200 days of data) [2025-10-01T17:30:02.947463] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T17:30:02.972455] [DEBUG] [LOCAL ] BBD: Primary data saved (53197 records). [2025-10-01T17:30:02.972613] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-01T17:30:02.973781] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBD took 41.0s. Estimated remaining: 4h 50m 20s. Rate: 7.4 symbols/min [2025-10-01T17:30:03.167400] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:30:03.184981] [DEBUG] [LOCAL ] BBUC: Loaded 13313 existing records from primary storage. [2025-10-01T17:30:03.185233] [INFO ] [MAIN ] BBUC: Loaded 13313 existing records. [2025-10-01T17:30:03.307513] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-01T17:30:03.382142] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:30:03.382373] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-01T17:30:03.382423] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-01T17:30:03.382723] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-01T17:30:03.382788] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-01T17:30:03.814692] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:30:04.102350] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-01T17:30:04.484315] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T17:30:04.820904] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T17:30:04.902403] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-01T17:30:05.306379] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-01T17:30:05.702365] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-01T17:30:06.217450] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-01T17:30:06.502400] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-01T17:30:07.302457] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-01T17:30:07.356452] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T17:30:07.357341] [INFO ] [REMOTE ] BBDO: Full fetch complete (7663 records). [2025-10-01T17:30:07.357427] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-01T17:30:07.764419] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-01T17:30:07.764498] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-01T17:30:07.764712] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-01T17:30:07.764775] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-01T17:30:07.765180] [DEBUG] [LOCAL ] BBDO: Trimmed 7663 records to 4975 (keeping 200 days of data) [2025-10-01T17:30:07.795137] [DEBUG] [LOCAL ] BBDO: Primary data saved (4975 records). [2025-10-01T17:30:07.795266] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-01T17:30:07.795345] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDO took 27.6s. Estimated remaining: 4h 49m 40s. Rate: 7.4 symbols/min [2025-10-01T17:30:07.999678] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:30:08.054906] [DEBUG] [LOCAL ] BBVA: Loaded 49310 existing records from primary storage. [2025-10-01T17:30:08.055224] [INFO ] [MAIN ] BBVA: Loaded 49310 existing records. [2025-10-01T17:30:08.114673] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-01T17:30:08.176913] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T17:30:08.264963] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:30:08.265220] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-01T17:30:08.265271] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-01T17:30:08.265937] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-01T17:30:08.266002] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-01T17:30:08.668739] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:30:08.902404] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-01T17:30:09.295861] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T17:30:09.693504] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T17:30:09.702335] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-01T17:30:10.451357] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T17:30:10.502373] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-01T17:30:11.302388] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-01T17:30:11.407867] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T17:30:12.102434] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-01T17:30:12.905413] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-01T17:30:12.911037] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T17:30:13.702399] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-01T17:30:13.825061] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T17:30:13.984054] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T17:30:14.502427] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-01T17:30:15.175480] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T17:30:15.302408] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-01T17:30:16.102391] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-01T17:30:16.554743] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-01T17:30:16.867196] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:30:16.902384] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-01T17:30:16.955985] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T17:30:17.688335] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T17:30:17.702357] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-01T17:30:18.502422] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-01T17:30:18.569134] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T17:30:19.302400] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-01T17:30:19.525623] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T17:30:19.860559] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T17:30:20.102405] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-01T17:30:20.902386] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-01T17:30:21.291124] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T17:30:21.292102] [INFO ] [REMOTE ] BBU: Full fetch complete (6638 records). [2025-10-01T17:30:21.292203] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-01T17:30:21.713347] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-01T17:30:21.741542] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-01T17:30:21.741670] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-01T17:30:21.741984] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-01T17:30:21.742069] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-01T17:30:21.742539] [DEBUG] [LOCAL ] BBU: Trimmed 6638 records to 4720 (keeping 200 days of data) [2025-10-01T17:30:21.775300] [DEBUG] [LOCAL ] BBU: Primary data saved (4720 records). [2025-10-01T17:30:21.775450] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-01T17:30:21.775582] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBU took 29.5s. Estimated remaining: 4h 50m 29s. Rate: 7.4 symbols/min [2025-10-01T17:30:21.975289] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:30:21.976562] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T17:30:22.009218] [DEBUG] [LOCAL ] BBW: Loaded 26640 existing records from primary storage. [2025-10-01T17:30:22.009541] [INFO ] [MAIN ] BBW: Loaded 26640 existing records. [2025-10-01T17:30:22.209883] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:30:22.210177] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-01T17:30:22.210230] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-01T17:30:22.210477] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-01T17:30:22.210551] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-01T17:30:22.507875] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-01T17:30:22.609295] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:30:22.743388] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T17:30:23.302373] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-01T17:30:23.318919] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T17:30:24.102418] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-01T17:30:24.167622] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T17:30:24.902396] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-01T17:30:25.702404] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-01T17:30:25.855028] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T17:30:26.086766] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T17:30:26.502409] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-01T17:30:27.302355] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-01T17:30:27.698928] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T17:30:27.869595] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-01T17:30:28.102397] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-01T17:30:28.727472] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-01T17:30:28.728896] [INFO ] [REMOTE ] BBN: Full fetch complete (26604 records). [2025-10-01T17:30:28.729002] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-01T17:30:28.916157] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-01T17:30:29.154008] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-01T17:30:29.154118] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-01T17:30:29.154698] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-01T17:30:29.154784] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-01T17:30:29.175158] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T17:30:29.182172] [DEBUG] [LOCAL ] BBN: Trimmed 26604 records to 18077 (keeping 200 days of data) [2025-10-01T17:30:29.306024] [DEBUG] [LOCAL ] BBN: Primary data saved (18077 records). [2025-10-01T17:30:29.306170] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-01T17:30:29.306257] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBN took 41.6s. Estimated remaining: 4h 50m 15s. Rate: 7.4 symbols/min [2025-10-01T17:30:29.489032] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:30:29.554319] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-10-01T17:30:29.554703] [INFO ] [MAIN ] BBWI: Loaded 53580 existing records. [2025-10-01T17:30:29.715336] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-01T17:30:29.758448] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:30:29.758689] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-01T17:30:29.758749] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-01T17:30:29.760491] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-01T17:30:29.760556] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-01T17:30:30.158063] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:30:30.329319] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T17:30:30.502400] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-01T17:30:30.970400] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T17:30:31.302388] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-01T17:30:32.016621] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:30:32.102405] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-01T17:30:32.856507] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T17:30:32.902384] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-01T17:30:33.197945] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-01T17:30:33.198830] [INFO ] [REMOTE ] BBUC: Full fetch complete (17991 records). [2025-10-01T17:30:33.198902] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-01T17:30:33.607685] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-01T17:30:33.608258] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-01T17:30:33.608615] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-01T17:30:33.608713] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-01T17:30:33.609429] [DEBUG] [LOCAL ] BBUC: Trimmed 17991 records to 13313 (keeping 200 days of data) [2025-10-01T17:30:33.699295] [DEBUG] [LOCAL ] BBUC: Primary data saved (13313 records). [2025-10-01T17:30:33.699495] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-01T17:30:33.699639] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBUC took 30.7s. Estimated remaining: 4h 49m 32s. Rate: 7.4 symbols/min [2025-10-01T17:30:33.705085] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-01T17:30:33.927124] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:30:33.944108] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T17:30:34.003242] [DEBUG] [LOCAL ] BBY: Loaded 53467 existing records from primary storage. [2025-10-01T17:30:34.003635] [INFO ] [MAIN ] BBY: Loaded 53467 existing records. [2025-10-01T17:30:34.198042] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:30:34.198298] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-01T17:30:34.198372] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-01T17:30:34.198786] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-01T17:30:34.198848] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-01T17:30:34.503204] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-01T17:30:34.592434] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:30:35.302383] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-01T17:30:35.495754] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T17:30:35.736415] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T17:30:36.102443] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-01T17:30:36.873943] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T17:30:36.902345] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-01T17:30:37.348626] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-01T17:30:37.702400] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-01T17:30:38.112382] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T17:30:38.502441] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-01T17:30:39.304739] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-01T17:30:39.307464] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T17:30:40.102376] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-01T17:30:40.367916] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T17:30:40.902355] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-01T17:30:40.983328] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T17:30:41.646818] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T17:30:41.702385] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-01T17:30:42.299736] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T17:30:42.502388] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-01T17:30:43.302395] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-01T17:30:43.661791] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-01T17:30:44.102392] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-01T17:30:44.378877] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-01T17:30:44.380124] [INFO ] [REMOTE ] BBW: Full fetch complete (39198 records). [2025-10-01T17:30:44.380205] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-01T17:30:44.820841] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-01T17:30:44.820994] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-01T17:30:44.821519] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-01T17:30:44.821584] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-01T17:30:44.822781] [DEBUG] [LOCAL ] BBW: Trimmed 39198 records to 26701 (keeping 200 days of data) [2025-10-01T17:30:44.923057] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-01T17:30:45.037193] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T17:30:45.057871] [DEBUG] [LOCAL ] BBW: Primary data saved (26701 records). [2025-10-01T17:30:45.058016] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-01T17:30:45.058134] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 23.3s. Estimated remaining: 4h 49m 54s. Rate: 7.4 symbols/min [2025-10-01T17:30:45.247450] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:30:45.297898] [DEBUG] [LOCAL ] BC: Loaded 44228 existing records from primary storage. [2025-10-01T17:30:45.298283] [INFO ] [MAIN ] BC: Loaded 44228 existing records. [2025-10-01T17:30:45.504425] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:30:45.504976] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-01T17:30:45.505140] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-01T17:30:45.506143] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-01T17:30:45.506239] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-01T17:30:45.727760] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-01T17:30:45.940348] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:30:46.151787] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-01T17:30:46.507314] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-01T17:30:46.513416] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T17:30:47.302413] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-01T17:30:47.666821] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T17:30:48.102431] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-01T17:30:48.223193] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T17:30:48.855049] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T17:30:48.902374] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-01T17:30:49.702360] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-01T17:30:49.922341] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T17:30:50.464478] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T17:30:50.502420] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-01T17:30:51.252324] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T17:30:51.302398] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-01T17:30:52.102398] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-01T17:30:52.490405] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-01T17:30:52.902359] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-01T17:30:53.029514] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T17:30:53.702393] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-01T17:30:54.477667] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-01T17:30:54.502353] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-01T17:30:54.957077] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-01T17:30:55.302391] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-01T17:30:55.378512] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T17:30:56.078491] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T17:30:56.102418] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-01T17:30:56.902349] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-01T17:30:57.224096] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T17:30:57.639344] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T17:30:57.702399] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-01T17:30:58.502388] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-01T17:30:58.968763] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-01T17:30:58.970638] [INFO ] [REMOTE ] BBVA: Full fetch complete (71599 records). [2025-10-01T17:30:58.970778] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-01T17:30:59.302755] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-01T17:30:59.411926] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-01T17:30:59.412603] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-01T17:30:59.413491] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-01T17:30:59.413576] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-01T17:30:59.415278] [DEBUG] [LOCAL ] BBVA: Trimmed 71599 records to 49276 (keeping 200 days of data) [2025-10-01T17:30:59.551182] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T17:30:59.784903] [DEBUG] [LOCAL ] BBVA: Primary data saved (49276 records). [2025-10-01T17:30:59.785054] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-01T17:30:59.785141] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBVA took 52.0s. Estimated remaining: 4h 50m 48s. Rate: 7.4 symbols/min [2025-10-01T17:30:59.978683] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:31:00.059637] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T17:31:00.057854] [DEBUG] [LOCAL ] BCAT: Loaded 34276 existing records from primary storage. [2025-10-01T17:31:00.072112] [INFO ] [MAIN ] BCAT: Loaded 34276 existing records. [2025-10-01T17:31:00.108885] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-01T17:31:00.282735] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:31:00.282949] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-01T17:31:00.282998] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-01T17:31:00.283533] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-01T17:31:00.283593] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-01T17:31:00.681448] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:31:00.902353] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-01T17:31:01.086978] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T17:31:01.702447] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-01T17:31:02.404888] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-01T17:31:02.502389] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-01T17:31:02.710946] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T17:31:03.302382] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-01T17:31:03.439672] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T17:31:04.102390] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-01T17:31:04.902381] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-01T17:31:05.132175] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-01T17:31:05.133844] [INFO ] [REMOTE ] BBWI: Full fetch complete (77416 records). [2025-10-01T17:31:05.133964] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-01T17:31:05.576443] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-01T17:31:05.576734] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-01T17:31:05.577703] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-01T17:31:05.581541] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-01T17:31:05.583333] [DEBUG] [LOCAL ] BBWI: Trimmed 77416 records to 53580 (keeping 200 days of data) [2025-10-01T17:31:05.714818] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T17:31:05.723315] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-01T17:31:05.851253] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-01T17:31:05.855780] [INFO ] [REMOTE ] BBY: Full fetch complete (77240 records). [2025-10-01T17:31:05.856638] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-01T17:31:06.371416] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-01T17:31:06.371514] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-01T17:31:06.372383] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-01T17:31:06.406692] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-01T17:31:06.438828] [DEBUG] [LOCAL ] BBY: Trimmed 77240 records to 53466 (keeping 200 days of data) [2025-10-01T17:31:06.526444] [DEBUG] [LOCAL ] BBWI: Primary data saved (53580 records). [2025-10-01T17:31:06.559267] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-01T17:31:06.561734] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 37.3s. Estimated remaining: 4h 50m 27s. Rate: 7.4 symbols/min [2025-10-01T17:31:06.784355] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:31:06.826945] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T17:31:06.850776] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T17:31:06.868039] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-01T17:31:06.885949] [DEBUG] [LOCAL ] BCC: Loaded 28207 existing records from primary storage. [2025-10-01T17:31:06.887801] [INFO ] [MAIN ] BCC: Loaded 28207 existing records. [2025-10-01T17:31:07.098919] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:31:07.100985] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-01T17:31:07.104565] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-01T17:31:07.104938] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-01T17:31:07.105000] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-01T17:31:07.310742] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-01T17:31:07.638487] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:31:07.759595] [DEBUG] [LOCAL ] BBY: Primary data saved (53466 records). [2025-10-01T17:31:07.759769] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-01T17:31:07.760992] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBY took 34.1s. Estimated remaining: 4h 49m 15s. Rate: 7.4 symbols/min [2025-10-01T17:31:07.954316] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:31:08.015121] [DEBUG] [LOCAL ] BCE: Loaded 52277 existing records from primary storage. [2025-10-01T17:31:08.015550] [INFO ] [MAIN ] BCE: Loaded 52277 existing records. [2025-10-01T17:31:08.118089] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-01T17:31:08.245509] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:31:08.245874] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-01T17:31:08.246013] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-01T17:31:08.246832] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-01T17:31:08.246997] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-01T17:31:08.675165] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T17:31:08.718128] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:31:08.740402] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T17:31:08.902370] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-01T17:31:09.244950] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T17:31:09.702393] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-01T17:31:10.502367] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-01T17:31:10.533240] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T17:31:10.779771] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T17:31:11.302430] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-01T17:31:11.949719] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T17:31:12.102382] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-01T17:31:12.591313] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T17:31:12.902428] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-01T17:31:13.395148] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T17:31:13.709304] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-01T17:31:13.716719] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T17:31:14.502433] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-01T17:31:15.089433] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T17:31:15.302469] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-01T17:31:15.715346] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T17:31:16.102441] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-01T17:31:16.604260] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:31:16.902416] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-01T17:31:17.461899] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T17:31:17.702423] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-01T17:31:18.288226] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T17:31:18.502449] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-01T17:31:19.302385] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-01T17:31:19.614995] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T17:31:20.104591] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-01T17:31:20.108855] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T17:31:20.183330] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T17:31:20.902383] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-01T17:31:21.637094] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T17:31:21.702387] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-01T17:31:22.234418] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T17:31:22.502420] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-01T17:31:23.203799] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T17:31:23.302396] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-01T17:31:24.105981] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-01T17:31:24.111052] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T17:31:24.346969] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T17:31:24.902385] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-01T17:31:25.702401] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-01T17:31:25.881228] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T17:31:26.382593] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T17:31:26.502389] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-01T17:31:26.681080] [DEBUG] [REMOTE ] BC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:31:26.681424] [WARN ] [REMOTE ] BC: No data returned for month 2025-10 [2025-10-01T17:31:26.681545] [FATAL] [REMOTE ] BC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:31:26.681685] [FATAL] [MAIN ] BC: Failed to fetch primary data. [2025-10-01T17:31:26.681759] [WARN ] [MAIN ] BC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:31:26.681830] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-01T17:31:26.681932] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-01T17:31:26.681988] [INFO ] [LOCAL ] BC: Starting deletion of derivative data. [2025-10-01T17:31:26.683347] [DEBUG] [LOCAL ] BC: Deleted derivative data file. [2025-10-01T17:31:26.683446] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 41.6s. Estimated remaining: 4h 50m 47s. Rate: 7.4 symbols/min [2025-10-01T17:31:26.909192] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:31:26.939441] [DEBUG] [LOCAL ] BCH: Loaded 29483 existing records from primary storage. [2025-10-01T17:31:26.939767] [INFO ] [MAIN ] BCH: Loaded 29483 existing records. [2025-10-01T17:31:27.136297] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:31:27.136574] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-01T17:31:27.136636] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-01T17:31:27.137194] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-01T17:31:27.137258] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-01T17:31:27.307557] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-01T17:31:27.543851] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:31:28.063769] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T17:31:28.102434] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-01T17:31:28.721336] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T17:31:28.902413] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-01T17:31:29.606211] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T17:31:29.702390] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-01T17:31:30.502358] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-01T17:31:30.545056] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T17:31:30.588002] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T17:31:31.302412] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-01T17:31:31.559808] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T17:31:32.102427] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-01T17:31:32.206262] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T17:31:32.902411] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-01T17:31:33.412176] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T17:31:33.702385] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-01T17:31:34.502429] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-01T17:31:34.612302] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T17:31:34.613573] [INFO ] [REMOTE ] BCAT: Full fetch complete (50104 records). [2025-10-01T17:31:34.613679] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-01T17:31:35.088966] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-01T17:31:35.089128] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-01T17:31:35.089820] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-01T17:31:35.090001] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-01T17:31:35.091491] [DEBUG] [LOCAL ] BCAT: Trimmed 50104 records to 34251 (keeping 200 days of data) [2025-10-01T17:31:35.307546] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-01T17:31:35.327154] [DEBUG] [LOCAL ] BCAT: Primary data saved (34251 records). [2025-10-01T17:31:35.327514] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-01T17:31:35.327671] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 35.5s. Estimated remaining: 4h 50m 43s. Rate: 7.4 symbols/min [2025-10-01T17:31:35.433192] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T17:31:35.600900] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:31:35.628663] [DEBUG] [LOCAL ] BCO: Loaded 26127 existing records from primary storage. [2025-10-01T17:31:35.628974] [INFO ] [MAIN ] BCO: Loaded 26127 existing records. [2025-10-01T17:31:35.828992] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:31:35.829228] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-01T17:31:35.829280] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-01T17:31:35.830180] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-01T17:31:35.830245] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-01T17:31:36.110395] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-01T17:31:36.115897] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-01T17:31:36.157800] [INFO ] [REMOTE ] BCC: Full fetch complete (40562 records). [2025-10-01T17:31:36.161338] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-01T17:31:36.349940] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:31:36.630720] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T17:31:36.760913] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-01T17:31:36.761020] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-01T17:31:36.761550] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-01T17:31:36.761616] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-01T17:31:36.762853] [DEBUG] [LOCAL ] BCC: Trimmed 40562 records to 28212 (keeping 200 days of data) [2025-10-01T17:31:36.920771] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-01T17:31:36.954602] [DEBUG] [LOCAL ] BCC: Primary data saved (28212 records). [2025-10-01T17:31:36.954786] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-01T17:31:36.954897] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 30.4s. Estimated remaining: 4h 49m 35s. Rate: 7.4 symbols/min [2025-10-01T17:31:37.149165] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:31:37.207268] [DEBUG] [LOCAL ] BCS: Loaded 53457 existing records from primary storage. [2025-10-01T17:31:37.207625] [INFO ] [MAIN ] BCS: Loaded 53457 existing records. [2025-10-01T17:31:37.399844] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:31:37.400066] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-01T17:31:37.400118] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-01T17:31:37.402620] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-01T17:31:37.402718] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-01T17:31:37.708114] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-01T17:31:37.819610] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:31:37.865210] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T17:31:37.959759] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T17:31:38.502383] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-01T17:31:39.221909] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:31:39.302378] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-01T17:31:40.102360] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-01T17:31:40.222491] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T17:31:40.437229] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T17:31:40.902592] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-01T17:31:41.702387] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-01T17:31:42.216707] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-01T17:31:42.218380] [INFO ] [REMOTE ] BCE: Full fetch complete (76066 records). [2025-10-01T17:31:42.218515] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-01T17:31:42.516188] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-01T17:31:42.676697] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-01T17:31:42.677054] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-01T17:31:42.678008] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-01T17:31:42.678138] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-01T17:31:42.680164] [DEBUG] [LOCAL ] BCE: Trimmed 76066 records to 52287 (keeping 200 days of data) [2025-10-01T17:31:42.807770] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T17:31:43.000437] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-01T17:31:43.133476] [DEBUG] [LOCAL ] BCE: Primary data saved (52287 records). [2025-10-01T17:31:43.133676] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-01T17:31:43.138051] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 35.4s. Estimated remaining: 4h 49m 9s. Rate: 7.4 symbols/min [2025-10-01T17:31:43.324482] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:31:43.319603] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-01T17:31:43.359972] [DEBUG] [LOCAL ] BCSF: Loaded 27698 existing records from primary storage. [2025-10-01T17:31:43.360302] [INFO ] [MAIN ] BCSF: Loaded 27698 existing records. [2025-10-01T17:31:43.583156] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:31:43.583665] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-01T17:31:43.583752] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-01T17:31:43.584509] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-01T17:31:43.584586] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-01T17:31:44.009145] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:31:44.032922] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T17:31:44.102370] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-01T17:31:44.902405] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-01T17:31:44.989757] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T17:31:45.216581] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T17:31:45.702482] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-01T17:31:45.862255] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T17:31:46.502346] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-01T17:31:46.670387] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T17:31:47.244219] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T17:31:47.302391] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-01T17:31:48.102391] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-01T17:31:48.768329] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T17:31:48.902376] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-01T17:31:49.702365] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-01T17:31:50.287465] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-01T17:31:50.431283] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T17:31:50.502396] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-01T17:31:50.725003] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T17:31:51.302396] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-01T17:31:52.102435] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-01T17:31:52.502767] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-01T17:31:52.687733] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T17:31:52.902382] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-01T17:31:53.567101] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T17:31:53.702410] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-01T17:31:54.502388] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-01T17:31:54.652194] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T17:31:55.000633] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T17:31:55.302414] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-01T17:31:55.693787] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T17:31:56.102392] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-01T17:31:56.243587] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T17:31:56.902388] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-01T17:31:57.559240] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T17:31:57.702391] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-01T17:31:58.207325] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:31:58.502432] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-01T17:31:58.719770] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T17:31:59.302394] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-01T17:31:59.933639] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T17:32:00.102363] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-01T17:32:00.470442] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T17:32:00.902434] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-01T17:32:01.702351] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-01T17:32:01.834525] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T17:32:02.502405] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-01T17:32:02.643746] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-01T17:32:02.647222] [INFO ] [REMOTE ] BCH: Full fetch complete (40899 records). [2025-10-01T17:32:02.647344] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-01T17:32:02.877202] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T17:32:03.126869] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-01T17:32:03.127006] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-01T17:32:03.127570] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-01T17:32:03.127615] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-01T17:32:03.128824] [DEBUG] [LOCAL ] BCH: Trimmed 40899 records to 29569 (keeping 200 days of data) [2025-10-01T17:32:03.306307] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-01T17:32:03.327758] [DEBUG] [LOCAL ] BCH: Primary data saved (29569 records). [2025-10-01T17:32:03.328369] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-01T17:32:03.328498] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 36.6s. Estimated remaining: 4h 50m 51s. Rate: 7.3 symbols/min [2025-10-01T17:32:03.538175] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:32:03.561187] [DEBUG] [LOCAL ] BCX: Loaded 21589 existing records from primary storage. [2025-10-01T17:32:03.561456] [INFO ] [MAIN ] BCX: Loaded 21589 existing records. [2025-10-01T17:32:03.777439] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:32:03.777667] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-01T17:32:03.777730] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-01T17:32:03.778118] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-01T17:32:03.778177] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-01T17:32:04.106586] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-01T17:32:04.197959] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:32:04.274146] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T17:32:04.718134] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T17:32:04.902390] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-01T17:32:05.380377] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T17:32:05.702394] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-01T17:32:05.831206] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T17:32:06.502395] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-01T17:32:07.225772] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T17:32:07.302397] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-01T17:32:07.747504] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T17:32:08.102386] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-01T17:32:08.378913] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T17:32:08.784950] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T17:32:08.902401] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-01T17:32:09.702375] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-01T17:32:09.969122] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T17:32:10.502382] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-01T17:32:10.602242] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T17:32:11.302393] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-01T17:32:11.719579] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T17:32:12.102389] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-01T17:32:12.767308] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T17:32:12.902407] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-01T17:32:13.539442] [DEBUG] [REMOTE ] BCS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:32:13.539809] [WARN ] [REMOTE ] BCS: No data returned for month 2025-10 [2025-10-01T17:32:13.539964] [FATAL] [REMOTE ] BCS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:32:13.540064] [FATAL] [MAIN ] BCS: Failed to fetch primary data. [2025-10-01T17:32:13.540131] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:32:13.540204] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-01T17:32:13.540282] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-01T17:32:13.540340] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-10-01T17:32:13.540833] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-10-01T17:32:13.540936] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCS took 36.6s. Estimated remaining: 4h 51m 1s. Rate: 7.3 symbols/min [2025-10-01T17:32:13.709777] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-01T17:32:13.732525] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:32:13.760474] [DEBUG] [LOCAL ] BDC: Loaded 24593 existing records from primary storage. [2025-10-01T17:32:13.760851] [INFO ] [MAIN ] BDC: Loaded 24593 existing records. [2025-10-01T17:32:13.977549] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:32:13.977841] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-01T17:32:13.977905] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-01T17:32:13.978750] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-01T17:32:13.978844] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-01T17:32:14.386874] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:32:14.390224] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-01T17:32:14.391403] [INFO ] [REMOTE ] BCO: Full fetch complete (36800 records). [2025-10-01T17:32:14.391492] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-01T17:32:14.507587] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-01T17:32:14.838040] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-01T17:32:14.838146] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-01T17:32:14.838663] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-01T17:32:14.838729] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-01T17:32:14.839730] [DEBUG] [LOCAL ] BCO: Trimmed 36800 records to 26080 (keeping 200 days of data) [2025-10-01T17:32:15.033815] [DEBUG] [LOCAL ] BCO: Primary data saved (26080 records). [2025-10-01T17:32:15.033987] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-01T17:32:15.034130] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCO took 39.7s. Estimated remaining: 4h 49m 53s. Rate: 7.4 symbols/min [2025-10-01T17:32:15.302445] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-01T17:32:15.475860] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-01T17:32:15.477467] [INFO ] [REMOTE ] BCSF: Full fetch complete (38442 records). [2025-10-01T17:32:15.477634] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-01T17:32:15.997125] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T17:32:16.003593] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-01T17:32:16.003818] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-01T17:32:16.004487] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-01T17:32:16.004538] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-01T17:32:16.005747] [DEBUG] [LOCAL ] BCSF: Trimmed 38442 records to 27746 (keeping 200 days of data) [2025-10-01T17:32:16.109183] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-01T17:32:16.204237] [DEBUG] [LOCAL ] BCSF: Primary data saved (27746 records). [2025-10-01T17:32:16.204376] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-01T17:32:16.205937] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCSF took 33.1s. Estimated remaining: 4h 48m 42s. Rate: 7.4 symbols/min [2025-10-01T17:32:16.352896] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T17:32:16.902362] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-01T17:32:17.042089] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T17:32:17.702377] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-01T17:32:17.784994] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T17:32:18.502399] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-01T17:32:18.733368] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T17:32:19.302381] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-01T17:32:19.605348] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T17:32:20.102429] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-01T17:32:20.345853] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T17:32:20.815036] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-01T17:32:20.902383] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-01T17:32:21.702392] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-01T17:32:22.154074] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T17:32:22.502384] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-01T17:32:22.892415] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T17:32:23.302385] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-01T17:32:23.824415] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-01T17:32:23.826784] [INFO ] [REMOTE ] BCX: Full fetch complete (34023 records). [2025-10-01T17:32:23.827023] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-01T17:32:24.387287] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-01T17:32:24.387426] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-01T17:32:24.388068] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-01T17:32:24.388252] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-01T17:32:24.408009] [DEBUG] [LOCAL ] BCX: Trimmed 34023 records to 21685 (keeping 200 days of data) [2025-10-01T17:32:24.410286] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T17:32:24.417470] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-01T17:32:24.560574] [DEBUG] [LOCAL ] BCX: Primary data saved (21685 records). [2025-10-01T17:32:24.560995] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-01T17:32:24.561140] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCX took 21.2s. Estimated remaining: 4h 48m 36s. Rate: 7.4 symbols/min [2025-10-01T17:32:25.529888] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T17:32:25.535540] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-01T17:32:26.830461] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T17:32:26.837469] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-01T17:32:27.991109] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T17:32:27.997218] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-01T17:32:29.358242] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T17:32:29.368015] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-01T17:32:30.827913] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T17:32:30.829568] [INFO ] [REMOTE ] BDC: Full fetch complete (35909 records). [2025-10-01T17:32:30.829780] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-01T17:32:31.266016] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-01T17:32:31.266120] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-01T17:32:31.266789] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-01T17:32:31.266858] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-01T17:32:31.267966] [DEBUG] [LOCAL ] BDC: Trimmed 35909 records to 24616 (keeping 200 days of data) [2025-10-01T17:32:31.460267] [DEBUG] [LOCAL ] BDC: Primary data saved (24616 records). [2025-10-01T17:32:31.460444] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-01T17:32:31.460553] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 17.9s. Estimated remaining: 4h 48m 17s. Rate: 7.4 symbols/min [2025-10-01T17:32:32.325439] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:32:32.384150] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:32:32.382297] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:32:32.416533] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:32:32.416781] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-01T17:32:32.417010] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-01T17:32:32.418864] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-01T17:32:32.418964] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-01T17:32:32.420469] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-01T17:32:32.420565] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-01T17:32:32.724080] [DEBUG] [LOCAL ] BDJ: Loaded 28950 existing records from primary storage. [2025-10-01T17:32:32.752396] [INFO ] [MAIN ] BDJ: Loaded 28950 existing records. [2025-10-01T17:32:32.944081] [DEBUG] [LOCAL ] BDN: Loaded 47511 existing records from primary storage. [2025-10-01T17:32:33.003112] [DEBUG] [LOCAL ] BDX: Loaded 52372 existing records from primary storage. [2025-10-01T17:32:33.013691] [INFO ] [MAIN ] BDN: Loaded 47511 existing records. [2025-10-01T17:32:33.063838] [INFO ] [MAIN ] BDX: Loaded 52372 existing records. [2025-10-01T17:32:33.378890] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:32:33.441214] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:32:33.429468] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-01T17:32:33.479394] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-01T17:32:33.502309] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-01T17:32:33.525811] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:32:33.547766] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-01T17:32:33.542068] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-01T17:32:33.583165] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-01T17:32:33.583000] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-01T17:32:33.626190] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-01T17:32:33.658914] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-01T17:32:33.658791] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:32:33.755168] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-01T17:32:33.809759] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-01T17:32:33.867952] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-01T17:32:33.924927] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-01T17:32:34.559661] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:32:34.608087] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-01T17:32:34.738704] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:32:34.775365] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-01T17:32:34.914350] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:32:34.914699] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-01T17:32:35.541682] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T17:32:35.556828] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-01T17:32:36.044558] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T17:32:36.051905] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-01T17:32:36.162101] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T17:32:36.172589] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-01T17:32:36.238509] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T17:32:36.249603] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-01T17:32:37.147497] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T17:32:37.154430] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-01T17:32:37.378594] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T17:32:37.389307] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-01T17:32:37.626010] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-01T17:32:37.637453] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-01T17:32:37.992950] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T17:32:38.004340] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-01T17:32:38.027948] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T17:32:38.034616] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-01T17:32:38.734620] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T17:32:38.745930] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-01T17:32:39.164565] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T17:32:39.230973] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T17:32:39.302377] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-01T17:32:39.623720] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T17:32:39.915691] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T17:32:40.102427] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-01T17:32:40.902429] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-01T17:32:41.017386] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T17:32:41.649755] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T17:32:41.702440] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-01T17:32:42.308934] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T17:32:42.502404] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-01T17:32:42.954428] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T17:32:43.302398] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-01T17:32:44.102377] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-01T17:32:44.422301] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T17:32:44.451122] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T17:32:44.902430] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-01T17:32:45.437627] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T17:32:45.702394] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-01T17:32:46.239830] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T17:32:46.502413] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-01T17:32:47.302386] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-01T17:32:47.975886] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-01T17:32:48.102427] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-01T17:32:48.316264] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T17:32:48.868102] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T17:32:48.902378] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-01T17:32:48.934517] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T17:32:49.702432] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-01T17:32:50.191907] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T17:32:50.502427] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-01T17:32:51.302408] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-01T17:32:51.342935] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T17:32:52.102358] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-01T17:32:52.211930] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T17:32:52.510329] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-01T17:32:52.902421] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-01T17:32:53.349003] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T17:32:53.702418] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-01T17:32:54.502370] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-01T17:32:54.844626] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T17:32:55.266868] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T17:32:55.302384] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-01T17:32:55.911010] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-01T17:32:55.912253] [INFO ] [REMOTE ] BDJ: Full fetch complete (42957 records). [2025-10-01T17:32:55.912331] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-01T17:32:56.105493] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-01T17:32:56.379151] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-01T17:32:56.379231] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-01T17:32:56.379753] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-01T17:32:56.379816] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-01T17:32:56.380800] [DEBUG] [LOCAL ] BDJ: Trimmed 42957 records to 28985 (keeping 200 days of data) [2025-10-01T17:32:56.561534] [DEBUG] [LOCAL ] BDJ: Primary data saved (28985 records). [2025-10-01T17:32:56.561696] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-01T17:32:56.561796] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 25.1s. Estimated remaining: 4h 50m 39s. Rate: 7.3 symbols/min [2025-10-01T17:32:56.765203] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:32:56.765395] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-01T17:32:56.765467] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-01T17:32:56.765736] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-01T17:32:56.765784] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-01T17:32:56.765828] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-01T17:32:56.765863] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-01T17:32:56.906264] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-01T17:32:57.131679] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T17:32:57.231221] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:32:57.702421] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-01T17:32:57.896010] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T17:32:58.502418] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-01T17:32:59.274183] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-01T17:32:59.302462] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-01T17:33:00.018763] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-01T17:33:00.020991] [INFO ] [REMOTE ] BDN: Full fetch complete (69234 records). [2025-10-01T17:33:00.021092] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-01T17:33:00.108467] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-01T17:33:00.424460] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T17:33:00.567849] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-01T17:33:00.567966] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-01T17:33:00.568865] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-01T17:33:00.568947] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-01T17:33:00.571238] [DEBUG] [LOCAL ] BDN: Trimmed 69234 records to 47488 (keeping 200 days of data) [2025-10-01T17:33:00.678744] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-01T17:33:00.903536] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-01T17:33:00.909236] [DEBUG] [LOCAL ] BDN: Primary data saved (47488 records). [2025-10-01T17:33:00.909381] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-01T17:33:00.910896] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 29.4s. Estimated remaining: 4h 49m 57s. Rate: 7.3 symbols/min [2025-10-01T17:33:01.121084] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:33:01.191346] [DEBUG] [LOCAL ] BEKE: Loaded 53241 existing records from primary storage. [2025-10-01T17:33:01.191747] [INFO ] [MAIN ] BEKE: Loaded 53241 existing records. [2025-10-01T17:33:01.420069] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:33:01.420606] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-01T17:33:01.420812] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-01T17:33:01.421602] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-01T17:33:01.421806] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-01T17:33:01.683190] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-01T17:33:01.705324] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-01T17:33:01.940619] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:33:02.214958] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-01T17:33:02.502381] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-01T17:33:02.768250] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T17:33:03.302408] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-01T17:33:04.102353] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-01T17:33:04.545460] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T17:33:04.902383] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-01T17:33:05.478795] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-01T17:33:05.702429] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-01T17:33:06.039626] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-01T17:33:06.502356] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-01T17:33:06.624752] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-01T17:33:06.626673] [INFO ] [REMOTE ] BDX: Full fetch complete (75787 records). [2025-10-01T17:33:06.626857] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-01T17:33:06.969899] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-01T17:33:07.016276] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-01T17:33:07.146729] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-01T17:33:07.146860] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-01T17:33:07.147820] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-01T17:33:07.147894] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-01T17:33:07.149992] [DEBUG] [LOCAL ] BDX: Trimmed 75787 records to 52388 (keeping 200 days of data) [2025-10-01T17:33:07.352435] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-01T17:33:07.510281] [DEBUG] [LOCAL ] BDX: Primary data saved (52388 records). [2025-10-01T17:33:07.510465] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-01T17:33:07.510570] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 36.0s. Estimated remaining: 4h 49m 35s. Rate: 7.3 symbols/min [2025-10-01T17:33:07.710247] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:33:07.710447] [DEBUG] [LOCAL ] BEN: No existing data file found in primary storage. [2025-10-01T17:33:07.710488] [WARN ] [MAIN ] BEN: No existing data found, performing full refresh instead. [2025-10-01T17:33:07.710613] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-01T17:33:07.710694] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-01T17:33:07.710795] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-01T17:33:07.710847] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-01T17:33:07.832310] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-01T17:33:08.108844] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-01T17:33:08.124429] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:33:08.902570] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-01T17:33:09.702399] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-01T17:33:09.983094] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-01T17:33:10.502363] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-01T17:33:10.573943] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T17:33:10.955101] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T17:33:11.302389] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-01T17:33:12.019435] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (3.91 seconds). [2025-10-01T17:33:12.021698] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-01T17:33:12.021831] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-01T17:33:12.113005] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-01T17:33:12.417471] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-01T17:33:12.514844] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-01T17:33:12.514940] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-01T17:33:12.515818] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-01T17:33:12.515889] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-01T17:33:12.517714] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53653 (keeping 200 days of data) [2025-10-01T17:33:12.853327] [DEBUG] [LOCAL ] BE: Primary data saved (53653 records). [2025-10-01T17:33:12.853471] [INFO ] [MAIN ] BE: Full history saved. [2025-10-01T17:33:12.853550] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 41.4s. Estimated remaining: 4h 49m 2s. Rate: 7.4 symbols/min [2025-10-01T17:33:12.907525] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-01T17:33:13.066535] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:33:13.099033] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T17:33:13.144811] [DEBUG] [LOCAL ] BEP: Loaded 38613 existing records from primary storage. [2025-10-01T17:33:13.145135] [INFO ] [MAIN ] BEP: Loaded 38613 existing records. [2025-10-01T17:33:13.364800] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:33:13.365032] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-01T17:33:13.365133] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-01T17:33:13.365692] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-01T17:33:13.365757] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-01T17:33:13.707531] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-01T17:33:13.764544] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:33:13.961309] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-01T17:33:14.502358] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-01T17:33:14.628842] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T17:33:15.302406] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-01T17:33:16.082349] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T17:33:16.102384] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-01T17:33:16.902445] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-01T17:33:17.059023] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T17:33:17.356771] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T17:33:17.702389] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-01T17:33:18.502439] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-01T17:33:18.736465] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T17:33:19.081822] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T17:33:19.302397] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-01T17:33:20.102383] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-01T17:33:20.400554] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T17:33:20.829875] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T17:33:20.902369] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-01T17:33:21.673664] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:33:21.702418] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-01T17:33:22.287625] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T17:33:22.502423] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-01T17:33:23.206002] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T17:33:23.302400] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-01T17:33:23.769555] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T17:33:24.102390] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-01T17:33:24.902458] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-01T17:33:25.013800] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T17:33:25.468240] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T17:33:25.702407] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-01T17:33:26.173736] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-01T17:33:26.502382] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-01T17:33:26.816207] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T17:33:27.302394] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-01T17:33:27.833297] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T17:33:27.834127] [INFO ] [REMOTE ] BEDU: Full fetch complete (1420 records). [2025-10-01T17:33:27.834260] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-01T17:33:28.049516] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-01T17:33:28.049742] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-01T17:33:28.049830] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-01T17:33:28.049921] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-01T17:33:28.050033] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-01T17:33:28.050093] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-01T17:33:28.050155] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-01T17:33:28.050237] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 31.5s. Estimated remaining: 4h 49m 55s. Rate: 7.3 symbols/min [2025-10-01T17:33:28.107453] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-01T17:33:28.270860] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:33:28.310037] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T17:33:28.365273] [DEBUG] [LOCAL ] BEPC: Loaded 46429 existing records from primary storage. [2025-10-01T17:33:28.365571] [INFO ] [MAIN ] BEPC: Loaded 46429 existing records. [2025-10-01T17:33:28.561850] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:33:28.562116] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-01T17:33:28.562176] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-01T17:33:28.562725] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-01T17:33:28.562787] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-01T17:33:28.907620] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-01T17:33:28.953906] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:33:29.702361] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-01T17:33:29.886010] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T17:33:30.319839] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T17:33:30.502399] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-01T17:33:31.308263] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-01T17:33:31.323017] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T17:33:31.550598] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T17:33:32.102407] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-01T17:33:32.902412] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-01T17:33:32.947551] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T17:33:32.983901] [DEBUG] [REMOTE ] BEP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:33:32.984217] [WARN ] [REMOTE ] BEP: No data returned for month 2025-10 [2025-10-01T17:33:32.984308] [FATAL] [REMOTE ] BEP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:33:32.984380] [FATAL] [MAIN ] BEP: Failed to fetch primary data. [2025-10-01T17:33:32.984442] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:33:32.984514] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-01T17:33:32.984683] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-01T17:33:32.984747] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-10-01T17:33:32.985183] [DEBUG] [LOCAL ] BEP: Deleted derivative data file. [2025-10-01T17:33:32.985270] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEP took 20.1s. Estimated remaining: 4h 49m 19s. Rate: 7.3 symbols/min [2025-10-01T17:33:33.219077] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:33:33.228374] [DEBUG] [LOCAL ] BEPH: Loaded 5285 existing records from primary storage. [2025-10-01T17:33:33.228606] [INFO ] [MAIN ] BEPH: Loaded 5285 existing records. [2025-10-01T17:33:33.428769] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:33:33.429016] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-01T17:33:33.429076] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-01T17:33:33.429282] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-01T17:33:33.429341] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-01T17:33:33.707536] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-01T17:33:33.848124] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:33:34.502393] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-01T17:33:34.835315] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T17:33:35.159785] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T17:33:35.302383] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-01T17:33:36.112107] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-01T17:33:36.117692] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T17:33:36.795693] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T17:33:36.902439] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-01T17:33:37.421581] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-01T17:33:37.702431] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-01T17:33:38.132487] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-01T17:33:38.502429] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-01T17:33:39.302413] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-01T17:33:39.962091] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-01T17:33:39.963813] [INFO ] [REMOTE ] BEN: Full fetch complete (76895 records). [2025-10-01T17:33:39.963974] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-01T17:33:40.104104] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-01T17:33:40.396807] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-01T17:33:40.396983] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-01T17:33:40.397984] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-01T17:33:40.398066] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-01T17:33:40.410724] [DEBUG] [LOCAL ] BEN: Trimmed 76895 records to 53049 (keeping 200 days of data) [2025-10-01T17:33:40.434492] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T17:33:40.586841] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T17:33:40.608628] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T17:33:40.842905] [DEBUG] [LOCAL ] BEN: Primary data saved (53049 records). [2025-10-01T17:33:40.843076] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-01T17:33:40.843181] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEN took 33.3s. Estimated remaining: 4h 49m 8s. Rate: 7.3 symbols/min [2025-10-01T17:33:40.910118] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-01T17:33:41.043387] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:33:41.048856] [DEBUG] [LOCAL ] BEPI: Loaded 3514 existing records from primary storage. [2025-10-01T17:33:41.049028] [INFO ] [MAIN ] BEPI: Loaded 3514 existing records. [2025-10-01T17:33:41.243234] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:33:41.243517] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-01T17:33:41.243572] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-01T17:33:41.243851] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-01T17:33:41.243913] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-01T17:33:41.371553] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T17:33:41.658537] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:33:41.702438] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-01T17:33:42.403122] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-01T17:33:42.502418] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-01T17:33:43.302403] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-01T17:33:43.825150] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T17:33:43.840517] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-01T17:33:44.102441] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-01T17:33:44.902420] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-01T17:33:45.351315] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T17:33:45.702385] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-01T17:33:46.313039] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-01T17:33:46.392414] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-01T17:33:46.394051] [INFO ] [REMOTE ] BEKE: Full fetch complete (77193 records). [2025-10-01T17:33:46.394152] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-01T17:33:46.507465] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-01T17:33:46.845155] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-01T17:33:46.845249] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-01T17:33:46.846130] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-01T17:33:46.846197] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-01T17:33:46.847757] [DEBUG] [LOCAL ] BEKE: Trimmed 77193 records to 53239 (keeping 200 days of data) [2025-10-01T17:33:47.184111] [DEBUG] [LOCAL ] BEKE: Primary data saved (53239 records). [2025-10-01T17:33:47.184265] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-01T17:33:47.186578] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 46.3s. Estimated remaining: 4h 48m 45s. Rate: 7.4 symbols/min [2025-10-01T17:33:47.307017] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-01T17:33:47.389538] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:33:47.395309] [DEBUG] [LOCAL ] BEPJ: Loaded 3144 existing records from primary storage. [2025-10-01T17:33:47.395532] [INFO ] [MAIN ] BEPJ: Loaded 3144 existing records. [2025-10-01T17:33:47.614532] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:33:47.614797] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-01T17:33:47.614860] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-01T17:33:47.615881] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-01T17:33:47.615944] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-01T17:33:47.825977] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T17:33:48.062703] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:33:48.102373] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-01T17:33:48.366494] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T17:33:48.433562] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-01T17:33:48.902408] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-01T17:33:49.437879] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-01T17:33:49.702401] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-01T17:33:50.301117] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T17:33:50.502385] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-01T17:33:51.302405] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-01T17:33:51.686049] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-01T17:33:52.112262] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-01T17:33:52.117786] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T17:33:52.706552] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T17:33:52.902441] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-01T17:33:53.464477] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-01T17:33:53.702414] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-01T17:33:54.393243] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T17:33:54.502437] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-01T17:33:55.302414] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-01T17:33:55.763363] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-01T17:33:56.102404] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-01T17:33:56.104913] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T17:33:56.657574] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T17:33:56.902408] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-01T17:33:57.236625] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-01T17:33:57.702379] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-01T17:33:58.166617] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T17:33:58.502400] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-01T17:33:59.121349] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T17:33:59.302378] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-01T17:34:00.017317] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T17:34:00.102390] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-01T17:34:00.588865] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T17:34:00.902387] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-01T17:34:01.702386] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-01T17:34:01.807254] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-01T17:34:01.808298] [INFO ] [REMOTE ] BEPH: Full fetch complete (7756 records). [2025-10-01T17:34:01.808391] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-01T17:34:02.153684] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T17:34:02.244895] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-01T17:34:02.244984] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-01T17:34:02.245218] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-01T17:34:02.245303] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-01T17:34:02.246001] [DEBUG] [LOCAL ] BEPH: Trimmed 7756 records to 5335 (keeping 200 days of data) [2025-10-01T17:34:02.281756] [DEBUG] [LOCAL ] BEPH: Primary data saved (5335 records). [2025-10-01T17:34:02.281906] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-01T17:34:02.282052] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPH took 29.3s. Estimated remaining: 4h 49m 35s. Rate: 7.3 symbols/min [2025-10-01T17:34:02.473425] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:34:02.473609] [DEBUG] [LOCAL ] BFAM: No existing data file found in primary storage. [2025-10-01T17:34:02.473674] [WARN ] [MAIN ] BFAM: No existing data found, performing full refresh instead. [2025-10-01T17:34:02.473798] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-01T17:34:02.473841] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-01T17:34:02.473882] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-01T17:34:02.473939] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-01T17:34:02.507535] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-01T17:34:02.880455] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:34:03.302388] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-01T17:34:04.061230] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T17:34:04.102391] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-01T17:34:04.734563] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T17:34:04.902383] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-01T17:34:05.702383] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-01T17:34:05.841094] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T17:34:05.932260] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T17:34:06.239988] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-01T17:34:06.502378] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-01T17:34:07.302375] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-01T17:34:07.733136] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T17:34:07.829305] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T17:34:08.102459] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-01T17:34:08.699476] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-01T17:34:08.700386] [INFO ] [REMOTE ] BEPI: Full fetch complete (5009 records). [2025-10-01T17:34:08.700549] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-01T17:34:08.917253] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-01T17:34:09.190602] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-01T17:34:09.190726] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-01T17:34:09.190891] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-01T17:34:09.190934] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-01T17:34:09.191482] [DEBUG] [LOCAL ] BEPI: Trimmed 5009 records to 3536 (keeping 200 days of data) [2025-10-01T17:34:09.215540] [DEBUG] [LOCAL ] BEPI: Primary data saved (3536 records). [2025-10-01T17:34:09.215707] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-01T17:34:09.215828] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPI took 28.4s. Estimated remaining: 4h 49m 17s. Rate: 7.3 symbols/min [2025-10-01T17:34:09.407591] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:34:09.456797] [DEBUG] [LOCAL ] BFH: Loaded 41617 existing records from primary storage. [2025-10-01T17:34:09.457105] [INFO ] [MAIN ] BFH: Loaded 41617 existing records. [2025-10-01T17:34:09.564500] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T17:34:09.664742] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:34:09.664967] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-01T17:34:09.665018] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-01T17:34:09.665932] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-01T17:34:09.665995] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-01T17:34:09.707541] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-01T17:34:10.062715] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:34:10.502376] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-01T17:34:11.047048] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T17:34:11.188373] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T17:34:11.302378] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-01T17:34:12.102391] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-01T17:34:12.902361] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-01T17:34:13.170614] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T17:34:13.507457] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T17:34:13.551532] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T17:34:13.702428] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-01T17:34:14.502389] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-01T17:34:14.833708] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-01T17:34:15.010442] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T17:34:15.302424] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-01T17:34:16.102575] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-01T17:34:16.582558] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T17:34:16.902361] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-01T17:34:17.423269] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T17:34:17.702430] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-01T17:34:18.156354] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T17:34:18.351242] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T17:34:18.502411] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-01T17:34:19.302434] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-01T17:34:20.102407] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-01T17:34:20.238435] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T17:34:20.618146] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-01T17:34:20.619259] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4500 records). [2025-10-01T17:34:20.619531] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-01T17:34:20.907488] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-01T17:34:21.032846] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T17:34:21.064020] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-01T17:34:21.064190] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-01T17:34:21.064682] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-01T17:34:21.065007] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-01T17:34:21.065449] [DEBUG] [LOCAL ] BEPJ: Trimmed 4500 records to 3149 (keeping 200 days of data) [2025-10-01T17:34:21.085523] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3149 records). [2025-10-01T17:34:21.085611] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-01T17:34:21.085717] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 33.9s. Estimated remaining: 4h 49m 40s. Rate: 7.3 symbols/min [2025-10-01T17:34:21.276559] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:34:21.292967] [DEBUG] [LOCAL ] BFK: Loaded 13853 existing records from primary storage. [2025-10-01T17:34:21.293199] [INFO ] [MAIN ] BFK: Loaded 13853 existing records. [2025-10-01T17:34:21.494554] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:34:21.494816] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-01T17:34:21.494866] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-01T17:34:21.495169] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-01T17:34:21.495228] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-01T17:34:21.709068] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-01T17:34:21.891344] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:34:22.382101] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T17:34:22.502388] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-01T17:34:23.019121] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T17:34:23.302397] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-01T17:34:24.102349] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-01T17:34:24.226026] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T17:34:24.902394] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-01T17:34:25.043186] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-01T17:34:25.044477] [INFO ] [REMOTE ] BFAM: Full fetch complete (46950 records). [2025-10-01T17:34:25.044566] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-01T17:34:25.479623] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-01T17:34:25.479841] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-01T17:34:25.480422] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-01T17:34:25.480559] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-01T17:34:25.481970] [DEBUG] [LOCAL ] BFAM: Trimmed 46950 records to 33171 (keeping 200 days of data) [2025-10-01T17:34:25.601723] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T17:34:25.705615] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-01T17:34:25.732049] [DEBUG] [LOCAL ] BFAM: Primary data saved (33171 records). [2025-10-01T17:34:25.732554] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-01T17:34:25.732678] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BFAM took 23.5s. Estimated remaining: 4h 49m 2s. Rate: 7.3 symbols/min [2025-10-01T17:34:25.936139] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:34:25.986145] [DEBUG] [LOCAL ] BFLY: Loaded 51779 existing records from primary storage. [2025-10-01T17:34:25.986473] [INFO ] [MAIN ] BFLY: Loaded 51779 existing records. [2025-10-01T17:34:26.184755] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:34:26.185000] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-01T17:34:26.185076] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-01T17:34:26.185460] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-01T17:34:26.185519] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-01T17:34:26.506363] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-01T17:34:26.595447] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:34:26.627010] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T17:34:27.302400] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-01T17:34:27.475632] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-01T17:34:27.477332] [INFO ] [REMOTE ] BEPC: Full fetch complete (68468 records). [2025-10-01T17:34:27.477429] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-01T17:34:27.628811] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T17:34:27.947332] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-01T17:34:27.947457] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-01T17:34:27.948276] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-01T17:34:27.948342] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-01T17:34:27.950310] [DEBUG] [LOCAL ] BEPC: Trimmed 68468 records to 46451 (keeping 200 days of data) [2025-10-01T17:34:28.135033] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-01T17:34:28.254335] [DEBUG] [LOCAL ] BEPC: Primary data saved (46451 records). [2025-10-01T17:34:28.254531] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-01T17:34:28.254633] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BEPC took 1m 0s. Estimated remaining: 4h 48m 6s. Rate: 7.4 symbols/min [2025-10-01T17:34:28.442282] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:34:28.454402] [DEBUG] [LOCAL ] BFS: Loaded 9115 existing records from primary storage. [2025-10-01T17:34:28.454628] [INFO ] [MAIN ] BFS: Loaded 9115 existing records. [2025-10-01T17:34:28.653711] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:34:28.654154] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-01T17:34:28.654248] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-01T17:34:28.654684] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-01T17:34:28.654756] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-01T17:34:28.873497] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T17:34:28.912485] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-01T17:34:29.097727] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:34:29.647047] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T17:34:29.702351] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-01T17:34:29.943350] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T17:34:30.502385] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-01T17:34:31.219384] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T17:34:31.263493] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T17:34:31.302349] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-01T17:34:31.881397] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-01T17:34:32.102387] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-01T17:34:32.902389] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-01T17:34:33.275943] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T17:34:33.702435] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-01T17:34:34.247890] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T17:34:34.341209] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T17:34:34.502432] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-01T17:34:35.223094] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T17:34:35.302418] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-01T17:34:36.102411] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-01T17:34:36.870627] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T17:34:36.902380] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-01T17:34:37.119485] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T17:34:37.702431] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-01T17:34:37.840309] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T17:34:38.502435] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-01T17:34:39.068032] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T17:34:39.106413] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T17:34:39.302432] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-01T17:34:40.102413] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-01T17:34:40.902383] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-01T17:34:41.033447] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T17:34:41.340840] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-01T17:34:41.702421] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-01T17:34:41.973751] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T17:34:42.502355] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-01T17:34:42.806250] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T17:34:43.302383] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-01T17:34:44.102411] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-01T17:34:44.277397] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T17:34:44.311753] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T17:34:44.902366] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-01T17:34:45.075988] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T17:34:45.702420] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-01T17:34:46.311571] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T17:34:46.344910] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T17:34:46.502406] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-01T17:34:47.302416] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-01T17:34:48.033833] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T17:34:48.102397] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-01T17:34:48.178712] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T17:34:48.902437] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-01T17:34:48.914990] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T17:34:49.702378] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-01T17:34:50.128999] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T17:34:50.449499] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T17:34:50.502399] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-01T17:34:51.302414] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-01T17:34:52.102410] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-01T17:34:52.222454] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T17:34:52.305411] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T17:34:52.306863] [INFO ] [REMOTE ] BFH: Full fetch complete (59703 records). [2025-10-01T17:34:52.307088] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-01T17:34:52.727512] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-01T17:34:52.727614] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-01T17:34:52.728351] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-01T17:34:52.728428] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-01T17:34:52.729870] [DEBUG] [LOCAL ] BFH: Trimmed 59703 records to 41602 (keeping 200 days of data) [2025-10-01T17:34:52.904401] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-01T17:34:52.985179] [DEBUG] [LOCAL ] BFH: Primary data saved (41602 records). [2025-10-01T17:34:52.985315] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-01T17:34:52.985406] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFH took 43.8s. Estimated remaining: 4h 50m 16s. Rate: 7.3 symbols/min [2025-10-01T17:34:53.167829] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:34:53.182098] [DEBUG] [LOCAL ] BFZ: Loaded 12147 existing records from primary storage. [2025-10-01T17:34:53.182381] [INFO ] [MAIN ] BFZ: Loaded 12147 existing records. [2025-10-01T17:34:53.381211] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:34:53.381458] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-01T17:34:53.381608] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-01T17:34:53.381870] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-01T17:34:53.381941] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-01T17:34:53.705383] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-01T17:34:53.841451] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T17:34:53.847468] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:34:54.089602] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-01T17:34:54.502392] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-01T17:34:54.969835] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T17:34:54.970812] [INFO ] [REMOTE ] BFK: Full fetch complete (19266 records). [2025-10-01T17:34:54.970887] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-01T17:34:55.307489] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-01T17:34:55.404094] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-01T17:34:55.404183] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-01T17:34:55.404534] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-01T17:34:55.404584] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-01T17:34:55.405386] [DEBUG] [LOCAL ] BFK: Trimmed 19266 records to 13896 (keeping 200 days of data) [2025-10-01T17:34:55.501897] [DEBUG] [LOCAL ] BFK: Primary data saved (13896 records). [2025-10-01T17:34:55.502373] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-01T17:34:55.502468] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFK took 34.4s. Estimated remaining: 4h 49m 20s. Rate: 7.3 symbols/min [2025-10-01T17:34:55.709989] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:34:55.763232] [DEBUG] [LOCAL ] BG: Loaded 50409 existing records from primary storage. [2025-10-01T17:34:55.763585] [INFO ] [MAIN ] BG: Loaded 50409 existing records. [2025-10-01T17:34:55.958228] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:34:55.958496] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-01T17:34:55.958551] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-01T17:34:55.959497] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-01T17:34:55.959561] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-01T17:34:56.106576] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-01T17:34:56.315160] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T17:34:56.410309] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:34:56.473417] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T17:34:56.902368] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-01T17:34:57.060350] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T17:34:57.702376] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-01T17:34:58.174465] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-01T17:34:58.502387] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-01T17:34:59.279512] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T17:34:59.281034] [INFO ] [REMOTE ] BFLY: Full fetch complete (75252 records). [2025-10-01T17:34:59.281165] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-01T17:34:59.307500] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-01T17:34:59.777817] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-01T17:34:59.777982] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-01T17:34:59.779301] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-01T17:34:59.779391] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-01T17:34:59.781788] [DEBUG] [LOCAL ] BFLY: Trimmed 75252 records to 51781 (keeping 200 days of data) [2025-10-01T17:35:00.105848] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-01T17:35:00.116864] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T17:35:00.288211] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T17:35:00.334109] [DEBUG] [LOCAL ] BFLY: Primary data saved (51781 records). [2025-10-01T17:35:00.334269] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-01T17:35:00.334376] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 34.6s. Estimated remaining: 4h 48m 44s. Rate: 7.3 symbols/min [2025-10-01T17:35:00.617996] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:35:00.618239] [DEBUG] [LOCAL ] BGB: No existing data file found in primary storage. [2025-10-01T17:35:00.618296] [WARN ] [MAIN ] BGB: No existing data found, performing full refresh instead. [2025-10-01T17:35:00.618444] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-01T17:35:00.618503] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-01T17:35:00.618569] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-01T17:35:00.618619] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-01T17:35:00.913464] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-01T17:35:01.107411] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:35:01.274547] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T17:35:01.275540] [INFO ] [REMOTE ] BFS: Full fetch complete (12676 records). [2025-10-01T17:35:01.275679] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-01T17:35:01.714382] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-01T17:35:01.726889] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-01T17:35:01.728195] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-01T17:35:01.728705] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-01T17:35:01.728776] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-01T17:35:01.729847] [DEBUG] [LOCAL ] BFS: Trimmed 12676 records to 9143 (keeping 200 days of data) [2025-10-01T17:35:01.798444] [DEBUG] [LOCAL ] BFS: Primary data saved (9143 records). [2025-10-01T17:35:01.806353] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-01T17:35:01.807440] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T17:35:01.807158] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFS took 33.6s. Estimated remaining: 4h 47m 41s. Rate: 7.3 symbols/min [2025-10-01T17:35:02.011080] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:35:02.030827] [DEBUG] [LOCAL ] BGH: Loaded 16746 existing records from primary storage. [2025-10-01T17:35:02.031078] [INFO ] [MAIN ] BGH: Loaded 16746 existing records. [2025-10-01T17:35:02.232511] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:35:02.232747] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-01T17:35:02.232863] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-01T17:35:02.233190] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-01T17:35:02.233250] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-01T17:35:02.507483] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-01T17:35:02.655614] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:35:03.031623] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T17:35:03.302381] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-01T17:35:03.812718] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-01T17:35:03.836788] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T17:35:04.102389] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-01T17:35:04.902373] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-01T17:35:04.979718] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T17:35:05.702386] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-01T17:35:05.988098] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T17:35:06.502450] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-01T17:35:07.130271] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T17:35:07.302379] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-01T17:35:07.536024] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T17:35:08.102385] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-01T17:35:08.742190] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T17:35:08.902398] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-01T17:35:09.029033] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T17:35:09.545024] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T17:35:09.702380] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-01T17:35:10.502390] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-01T17:35:11.191856] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T17:35:11.302400] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-01T17:35:11.408123] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T17:35:11.932565] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T17:35:12.102435] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-01T17:35:12.902445] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-01T17:35:13.000476] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T17:35:13.702406] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-01T17:35:14.324281] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T17:35:14.434546] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T17:35:14.502397] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-01T17:35:15.302419] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-01T17:35:15.339750] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T17:35:16.102397] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-01T17:35:16.126249] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T17:35:16.902394] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-01T17:35:17.573312] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T17:35:17.702380] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-01T17:35:17.759848] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T17:35:18.502410] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-01T17:35:19.244322] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T17:35:19.302389] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-01T17:35:19.488330] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T17:35:20.102437] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-01T17:35:20.613890] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T17:35:20.902387] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-01T17:35:21.149095] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T17:35:21.692078] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T17:35:21.702342] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-01T17:35:22.432359] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T17:35:22.502465] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-01T17:35:23.302431] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-01T17:35:23.360712] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T17:35:24.102418] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-01T17:35:24.140039] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T17:35:24.902378] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-01T17:35:25.702403] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-01T17:35:25.845964] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T17:35:25.880448] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T17:35:26.502418] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-01T17:35:26.813880] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T17:35:26.814893] [INFO ] [REMOTE ] BGB: Full fetch complete (26962 records). [2025-10-01T17:35:26.814976] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-01T17:35:27.236719] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-01T17:35:27.236810] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-01T17:35:27.237239] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-01T17:35:27.237303] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-01T17:35:27.238227] [DEBUG] [LOCAL ] BGB: Trimmed 26962 records to 17523 (keeping 200 days of data) [2025-10-01T17:35:27.326080] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-01T17:35:27.365054] [DEBUG] [LOCAL ] BGB: Primary data saved (17523 records). [2025-10-01T17:35:27.365201] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-01T17:35:27.365300] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BGB took 27.0s. Estimated remaining: 4h 49m 55s. Rate: 7.3 symbols/min [2025-10-01T17:35:27.552212] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:35:27.552437] [DEBUG] [LOCAL ] BGR: No existing data file found in primary storage. [2025-10-01T17:35:27.552490] [WARN ] [MAIN ] BGR: No existing data found, performing full refresh instead. [2025-10-01T17:35:27.552639] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-01T17:35:27.552772] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-01T17:35:27.552910] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-01T17:35:27.552981] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-01T17:35:27.964097] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:35:28.058338] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T17:35:28.102431] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-01T17:35:28.436632] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T17:35:28.728389] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T17:35:28.902428] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-01T17:35:29.702424] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-01T17:35:29.832756] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T17:35:30.502425] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-01T17:35:31.302369] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-01T17:35:31.432433] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-01T17:35:31.920729] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-01T17:35:31.922666] [INFO ] [REMOTE ] BG: Full fetch complete (72788 records). [2025-10-01T17:35:31.922795] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-01T17:35:32.105559] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-01T17:35:32.292225] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T17:35:32.401052] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-01T17:35:32.401164] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-01T17:35:32.402010] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-01T17:35:32.402077] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-01T17:35:32.403591] [DEBUG] [LOCAL ] BG: Trimmed 72788 records to 50413 (keeping 200 days of data) [2025-10-01T17:35:32.752182] [DEBUG] [LOCAL ] BG: Primary data saved (50413 records). [2025-10-01T17:35:32.752350] [INFO ] [MAIN ] BG: Full history saved. [2025-10-01T17:35:32.753189] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BG took 37.3s. Estimated remaining: 4h 49m 24s. Rate: 7.3 symbols/min [2025-10-01T17:35:32.908125] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-01T17:35:32.944002] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:35:32.999686] [DEBUG] [LOCAL ] BGS: Loaded 50452 existing records from primary storage. [2025-10-01T17:35:33.000071] [INFO ] [MAIN ] BGS: Loaded 50452 existing records. [2025-10-01T17:35:33.197875] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:35:33.198110] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-01T17:35:33.198160] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-01T17:35:33.198622] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-01T17:35:33.198712] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-01T17:35:33.493103] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-01T17:35:33.519553] [INFO ] [REMOTE ] BFZ: Full fetch complete (18122 records). [2025-10-01T17:35:33.524894] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-01T17:35:33.619121] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:35:33.687213] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T17:35:33.708955] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-01T17:35:34.026863] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-01T17:35:34.026959] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-01T17:35:34.027309] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-01T17:35:34.027353] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-01T17:35:34.028112] [DEBUG] [LOCAL ] BFZ: Trimmed 18122 records to 12123 (keeping 200 days of data) [2025-10-01T17:35:34.120442] [DEBUG] [LOCAL ] BFZ: Primary data saved (12123 records). [2025-10-01T17:35:34.120602] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-01T17:35:34.120729] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BFZ took 41.1s. Estimated remaining: 4h 48m 20s. Rate: 7.3 symbols/min [2025-10-01T17:35:34.310528] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:35:34.320588] [DEBUG] [LOCAL ] BGSF: Loaded 7130 existing records from primary storage. [2025-10-01T17:35:34.320822] [INFO ] [MAIN ] BGSF: Loaded 7130 existing records. [2025-10-01T17:35:34.507276] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-01T17:35:34.541966] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:35:34.543864] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-01T17:35:34.544110] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-01T17:35:34.544397] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-01T17:35:34.544460] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-01T17:35:34.683678] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T17:35:34.976361] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:35:35.302388] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-01T17:35:36.102360] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-01T17:35:36.237933] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T17:35:36.744047] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-01T17:35:36.745405] [INFO ] [REMOTE ] BGH: Full fetch complete (22321 records). [2025-10-01T17:35:36.745517] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-01T17:35:36.909746] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-01T17:35:37.122305] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T17:35:37.198102] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-01T17:35:37.198188] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-01T17:35:37.198529] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-01T17:35:37.198568] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-01T17:35:37.199262] [DEBUG] [LOCAL ] BGH: Trimmed 22321 records to 16856 (keeping 200 days of data) [2025-10-01T17:35:37.306148] [DEBUG] [LOCAL ] BGH: Primary data saved (16856 records). [2025-10-01T17:35:37.306293] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-01T17:35:37.306378] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGH took 35.5s. Estimated remaining: 4h 47m 31s. Rate: 7.3 symbols/min [2025-10-01T17:35:37.493741] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:35:37.512710] [DEBUG] [LOCAL ] BGT: Loaded 16599 existing records from primary storage. [2025-10-01T17:35:37.512964] [INFO ] [MAIN ] BGT: Loaded 16599 existing records. [2025-10-01T17:35:37.707463] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-01T17:35:37.711491] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:35:37.712141] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-01T17:35:37.712879] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-01T17:35:37.713171] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-01T17:35:37.713232] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-01T17:35:38.142996] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:35:38.507457] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-01T17:35:38.527460] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T17:35:38.624530] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T17:35:39.302398] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-01T17:35:39.613300] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T17:35:40.102440] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-01T17:35:40.570250] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T17:35:40.902487] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-01T17:35:41.174600] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T17:35:41.702426] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-01T17:35:42.413243] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T17:35:42.502421] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-01T17:35:42.630315] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T17:35:43.302413] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-01T17:35:43.875129] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T17:35:44.102370] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-01T17:35:44.205914] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T17:35:44.515711] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T17:35:44.902430] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-01T17:35:45.304364] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-01T17:35:45.702379] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-01T17:35:46.142892] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T17:35:46.502439] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-01T17:35:47.302395] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-01T17:35:47.448985] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T17:35:48.102395] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-01T17:35:48.650153] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T17:35:48.764731] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T17:35:48.902409] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-01T17:35:49.554105] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T17:35:49.702395] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-01T17:35:50.502375] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-01T17:35:50.970434] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T17:35:51.185390] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T17:35:51.302394] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-01T17:35:52.102409] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-01T17:35:52.492726] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T17:35:52.902387] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-01T17:35:52.916546] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T17:35:53.365687] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T17:35:53.702380] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-01T17:35:54.268785] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T17:35:54.502442] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-01T17:35:55.302383] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-01T17:35:55.392804] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T17:35:55.917964] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T17:35:56.102379] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-01T17:35:56.902414] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-01T17:35:57.026842] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-01T17:35:57.027827] [INFO ] [REMOTE ] BGR: Full fetch complete (20211 records). [2025-10-01T17:35:57.027905] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-01T17:35:57.451853] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-01T17:35:57.451937] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-01T17:35:57.452295] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-01T17:35:57.452341] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-01T17:35:57.453000] [DEBUG] [LOCAL ] BGR: Trimmed 20211 records to 13508 (keeping 200 days of data) [2025-10-01T17:35:57.545598] [DEBUG] [LOCAL ] BGR: Primary data saved (13508 records). [2025-10-01T17:35:57.545772] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-01T17:35:57.545858] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 30.2s. Estimated remaining: 4h 48m 60s. Rate: 7.3 symbols/min [2025-10-01T17:35:57.707628] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-01T17:35:57.738454] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:35:57.752410] [DEBUG] [LOCAL ] BGX: Loaded 10830 existing records from primary storage. [2025-10-01T17:35:57.752682] [INFO ] [MAIN ] BGX: Loaded 10830 existing records. [2025-10-01T17:35:57.949561] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:35:57.949827] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-01T17:35:57.949878] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-01T17:35:57.950195] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-01T17:35:57.950272] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-01T17:35:58.382095] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:35:58.415521] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T17:35:58.502392] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-01T17:35:58.901206] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T17:35:59.172127] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T17:35:59.302388] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-01T17:36:00.102378] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-01T17:36:00.902381] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-01T17:36:01.249833] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-01T17:36:01.251268] [INFO ] [REMOTE ] BGSF: Full fetch complete (8790 records). [2025-10-01T17:36:01.251356] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-01T17:36:01.708314] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-01T17:36:01.709343] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-01T17:36:01.709887] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-01T17:36:01.711395] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-01T17:36:01.711495] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-01T17:36:01.720427] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T17:36:01.724136] [DEBUG] [LOCAL ] BGSF: Trimmed 8790 records to 7403 (keeping 200 days of data) [2025-10-01T17:36:01.776330] [DEBUG] [LOCAL ] BGSF: Primary data saved (7403 records). [2025-10-01T17:36:01.776608] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-01T17:36:01.776832] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGSF took 27.7s. Estimated remaining: 4h 48m 20s. Rate: 7.3 symbols/min [2025-10-01T17:36:01.978210] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:36:02.009503] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T17:36:02.040230] [DEBUG] [LOCAL ] BGY: Loaded 22377 existing records from primary storage. [2025-10-01T17:36:02.040553] [INFO ] [MAIN ] BGY: Loaded 22377 existing records. [2025-10-01T17:36:02.241269] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:36:02.241503] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-01T17:36:02.241552] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-01T17:36:02.241840] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-01T17:36:02.241899] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-01T17:36:02.505980] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-01T17:36:02.658604] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:36:02.796481] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T17:36:03.302380] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-01T17:36:04.102578] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-01T17:36:04.233539] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T17:36:04.500423] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T17:36:04.652153] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-01T17:36:04.902378] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-01T17:36:05.645458] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T17:36:05.702350] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-01T17:36:06.502370] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-01T17:36:06.570355] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T17:36:07.302414] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-01T17:36:08.036191] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T17:36:08.102464] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-01T17:36:08.402709] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-01T17:36:08.404957] [INFO ] [REMOTE ] BGS: Full fetch complete (72505 records). [2025-10-01T17:36:08.405191] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-01T17:36:08.919266] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T17:36:08.919357] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-01T17:36:08.997052] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-01T17:36:08.997174] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-01T17:36:08.998061] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-01T17:36:08.998129] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-01T17:36:09.000124] [DEBUG] [LOCAL ] BGS: Trimmed 72505 records to 50455 (keeping 200 days of data) [2025-10-01T17:36:09.319685] [DEBUG] [LOCAL ] BGS: Primary data saved (50455 records). [2025-10-01T17:36:09.319849] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-01T17:36:09.322008] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 36.6s. Estimated remaining: 4h 48m 6s. Rate: 7.3 symbols/min [2025-10-01T17:36:09.538978] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:36:09.560423] [DEBUG] [LOCAL ] BH: Loaded 15828 existing records from primary storage. [2025-10-01T17:36:09.560746] [INFO ] [MAIN ] BH: Loaded 15828 existing records. [2025-10-01T17:36:09.718560] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-01T17:36:09.768229] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:36:09.769562] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-01T17:36:09.770174] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T17:36:09.770313] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-01T17:36:09.774762] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-01T17:36:09.774835] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-01T17:36:10.197786] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:36:10.502420] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-01T17:36:10.769898] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T17:36:11.302396] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-01T17:36:11.544695] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T17:36:12.102360] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-01T17:36:12.285427] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T17:36:12.705891] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T17:36:12.902421] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-01T17:36:13.702417] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-01T17:36:13.821024] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T17:36:14.502434] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-01T17:36:15.027931] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-01T17:36:15.201487] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T17:36:15.302401] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-01T17:36:15.775297] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T17:36:16.102416] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-01T17:36:16.889795] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T17:36:16.902332] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-01T17:36:17.702370] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-01T17:36:17.881593] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T17:36:18.502682] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-01T17:36:18.505191] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T17:36:19.106403] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T17:36:19.302432] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-01T17:36:20.102370] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-01T17:36:20.159012] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T17:36:20.902389] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-01T17:36:21.117030] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T17:36:21.118013] [INFO ] [REMOTE ] BGT: Full fetch complete (24316 records). [2025-10-01T17:36:21.118094] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-01T17:36:21.539037] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-01T17:36:21.539126] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-01T17:36:21.539574] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-01T17:36:21.539618] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-01T17:36:21.540385] [DEBUG] [LOCAL ] BGT: Trimmed 24316 records to 16603 (keeping 200 days of data) [2025-10-01T17:36:21.649377] [DEBUG] [LOCAL ] BGT: Primary data saved (16603 records). [2025-10-01T17:36:21.649516] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-01T17:36:21.649596] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGT took 44.3s. Estimated remaining: 4h 48m 31s. Rate: 7.3 symbols/min [2025-10-01T17:36:21.708118] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-01T17:36:21.799826] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-01T17:36:21.861336] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:36:21.907988] [DEBUG] [LOCAL ] BHC: Loaded 46835 existing records from primary storage. [2025-10-01T17:36:21.908340] [INFO ] [MAIN ] BHC: Loaded 46835 existing records. [2025-10-01T17:36:22.104244] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:36:22.104448] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-01T17:36:22.104497] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-01T17:36:22.105048] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-01T17:36:22.105108] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-01T17:36:22.507531] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-01T17:36:22.507466] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:36:22.596694] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T17:36:23.020251] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T17:36:23.302423] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-01T17:36:23.982837] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T17:36:24.102450] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-01T17:36:24.902417] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-01T17:36:25.291860] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T17:36:25.702401] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-01T17:36:26.507678] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-01T17:36:26.529728] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T17:36:26.661602] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T17:36:27.302414] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-01T17:36:27.393233] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T17:36:27.394294] [INFO ] [REMOTE ] BGX: Full fetch complete (16106 records). [2025-10-01T17:36:27.394394] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-01T17:36:27.855377] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-01T17:36:27.855467] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-01T17:36:27.855873] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-01T17:36:27.855938] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-01T17:36:27.857228] [DEBUG] [LOCAL ] BGX: Trimmed 16106 records to 10935 (keeping 200 days of data) [2025-10-01T17:36:27.926842] [DEBUG] [LOCAL ] BGX: Primary data saved (10935 records). [2025-10-01T17:36:27.926993] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-01T17:36:27.927226] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGX took 30.4s. Estimated remaining: 4h 48m 7s. Rate: 7.3 symbols/min [2025-10-01T17:36:28.116045] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-01T17:36:28.120289] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:36:28.148462] [DEBUG] [LOCAL ] BHE: Loaded 24753 existing records from primary storage. [2025-10-01T17:36:28.148878] [INFO ] [MAIN ] BHE: Loaded 24753 existing records. [2025-10-01T17:36:28.213187] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T17:36:28.367889] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:36:28.368152] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-01T17:36:28.368223] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-01T17:36:28.368481] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-01T17:36:28.368544] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-01T17:36:28.806028] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:36:28.902412] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-01T17:36:29.562765] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T17:36:29.702354] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-01T17:36:29.863202] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T17:36:30.502392] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-01T17:36:31.240120] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T17:36:31.302359] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-01T17:36:31.630214] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T17:36:32.102379] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-01T17:36:32.640004] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T17:36:32.902353] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-01T17:36:32.931386] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T17:36:33.505527] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T17:36:33.702428] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-01T17:36:34.419428] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T17:36:34.502446] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-01T17:36:35.302401] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-01T17:36:35.556171] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T17:36:36.102405] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-01T17:36:36.383826] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T17:36:36.902400] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-01T17:36:37.197574] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T17:36:37.702392] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-01T17:36:38.014782] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T17:36:38.015927] [INFO ] [REMOTE ] BGY: Full fetch complete (33223 records). [2025-10-01T17:36:38.016008] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-01T17:36:38.431179] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-01T17:36:38.431260] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-01T17:36:38.431720] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-01T17:36:38.431781] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-01T17:36:38.432604] [DEBUG] [LOCAL ] BGY: Trimmed 33223 records to 22399 (keeping 200 days of data) [2025-10-01T17:36:38.525494] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-01T17:36:38.590704] [DEBUG] [LOCAL ] BGY: Primary data saved (22399 records). [2025-10-01T17:36:38.590868] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-01T17:36:38.590971] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 36.8s. Estimated remaining: 4h 48m 18s. Rate: 7.3 symbols/min [2025-10-01T17:36:38.820854] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:36:38.845604] [DEBUG] [LOCAL ] BHK: Loaded 23022 existing records from primary storage. [2025-10-01T17:36:38.845928] [INFO ] [MAIN ] BHK: Loaded 23022 existing records. [2025-10-01T17:36:39.050046] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:36:39.050282] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-01T17:36:39.050333] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-01T17:36:39.050603] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-01T17:36:39.050692] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-01T17:36:39.304913] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-01T17:36:39.509020] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T17:36:39.559677] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:36:39.590599] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T17:36:40.102360] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-01T17:36:40.338951] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T17:36:40.902394] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-01T17:36:41.295921] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T17:36:41.702355] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-01T17:36:41.915544] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T17:36:42.502398] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-01T17:36:43.054172] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T17:36:43.302413] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-01T17:36:43.590819] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T17:36:43.592024] [INFO ] [REMOTE ] BH: Full fetch complete (19539 records). [2025-10-01T17:36:43.592219] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-01T17:36:43.963783] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-01T17:36:44.031009] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-01T17:36:44.031087] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-01T17:36:44.031444] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-01T17:36:44.031506] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-01T17:36:44.032154] [DEBUG] [LOCAL ] BH: Trimmed 19539 records to 15869 (keeping 200 days of data) [2025-10-01T17:36:44.103840] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-01T17:36:44.141735] [DEBUG] [LOCAL ] BH: Primary data saved (15869 records). [2025-10-01T17:36:44.141909] [INFO ] [MAIN ] BH: Full history saved. [2025-10-01T17:36:44.142045] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 34.8s. Estimated remaining: 4h 47m 49s. Rate: 7.3 symbols/min [2025-10-01T17:36:44.335422] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:36:44.390907] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-01T17:36:44.391269] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-10-01T17:36:44.608255] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:36:44.608513] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-01T17:36:44.608566] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-01T17:36:44.609232] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-01T17:36:44.609334] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-01T17:36:44.903479] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-01T17:36:45.032552] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:36:45.079728] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T17:36:45.702408] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-01T17:36:45.885064] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T17:36:46.502398] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-01T17:36:47.302433] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-01T17:36:47.520080] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T17:36:47.641878] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T17:36:48.102375] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-01T17:36:48.322673] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T17:36:48.902420] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-01T17:36:49.594463] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T17:36:49.670148] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T17:36:49.702378] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-01T17:36:50.502377] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-01T17:36:51.302360] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-01T17:36:51.375055] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T17:36:51.538471] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T17:36:52.102404] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-01T17:36:52.731490] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T17:36:52.902381] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-01T17:36:52.933156] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T17:36:53.702428] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-01T17:36:54.502419] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-01T17:36:54.640381] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T17:36:55.057579] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T17:36:55.236375] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T17:36:55.302376] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-01T17:36:56.102380] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-01T17:36:56.371264] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T17:36:56.372327] [INFO ] [REMOTE ] BHE: Full fetch complete (36532 records). [2025-10-01T17:36:56.372406] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-01T17:36:56.822396] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-01T17:36:56.822489] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-01T17:36:56.822977] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-01T17:36:56.823042] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-01T17:36:56.823940] [DEBUG] [LOCAL ] BHE: Trimmed 36532 records to 24657 (keeping 200 days of data) [2025-10-01T17:36:56.914965] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-01T17:36:56.987866] [DEBUG] [LOCAL ] BHE: Primary data saved (24657 records). [2025-10-01T17:36:56.987999] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-01T17:36:56.988151] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 29.1s. Estimated remaining: 4h 48m 17s. Rate: 7.3 symbols/min [2025-10-01T17:36:57.179060] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:36:57.200886] [DEBUG] [LOCAL ] BHR: Loaded 21377 existing records from primary storage. [2025-10-01T17:36:57.201143] [INFO ] [MAIN ] BHR: Loaded 21377 existing records. [2025-10-01T17:36:57.401428] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:36:57.401943] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-01T17:36:57.401999] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-01T17:36:57.402274] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-01T17:36:57.402336] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-01T17:36:57.705860] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-01T17:36:57.803752] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:36:57.832042] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T17:36:58.502384] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-01T17:36:58.735331] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T17:36:58.757514] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T17:36:59.305137] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-01T17:36:59.308941] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T17:37:00.102440] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-01T17:37:00.422563] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T17:37:00.902394] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-01T17:37:01.702374] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-01T17:37:02.068488] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T17:37:02.490259] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-01T17:37:02.491741] [INFO ] [REMOTE ] BHC: Full fetch complete (66960 records). [2025-10-01T17:37:02.491828] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-01T17:37:02.507555] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-01T17:37:02.928545] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-01T17:37:02.928678] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-01T17:37:02.929432] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-01T17:37:02.929482] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-01T17:37:02.930905] [DEBUG] [LOCAL ] BHC: Trimmed 66960 records to 46844 (keeping 200 days of data) [2025-10-01T17:37:03.164480] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T17:37:03.223750] [DEBUG] [LOCAL ] BHC: Primary data saved (46844 records). [2025-10-01T17:37:03.223882] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-01T17:37:03.223962] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 41.6s. Estimated remaining: 4h 47m 53s. Rate: 7.3 symbols/min [2025-10-01T17:37:03.308719] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-01T17:37:03.421094] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:37:03.421354] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-01T17:37:03.421403] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-01T17:37:03.421513] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-01T17:37:03.421556] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-01T17:37:03.421600] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-01T17:37:03.421692] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-01T17:37:03.815517] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:37:03.872841] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-01T17:37:04.102386] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-01T17:37:04.237855] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T17:37:04.902371] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-01T17:37:05.211518] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T17:37:05.389685] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-01T17:37:05.702403] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-01T17:37:06.502351] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-01T17:37:06.547000] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T17:37:07.302407] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-01T17:37:07.635906] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-01T17:37:07.655688] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T17:37:08.102387] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-01T17:37:08.902417] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-01T17:37:09.702366] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-01T17:37:09.941261] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T17:37:10.065210] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-01T17:37:10.067038] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-01T17:37:10.502396] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-01T17:37:11.302419] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-01T17:37:12.102366] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-01T17:37:12.188365] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T17:37:12.404602] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T17:37:12.902387] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-01T17:37:13.359725] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T17:37:13.702384] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-01T17:37:14.344404] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T17:37:14.502425] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-01T17:37:14.776252] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-01T17:37:15.307186] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-01T17:37:15.313515] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-01T17:37:16.102363] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-01T17:37:16.317711] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T17:37:16.902401] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-01T17:37:17.702429] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-01T17:37:17.881071] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T17:37:18.064320] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T17:37:18.502349] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-01T17:37:18.813338] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T17:37:19.162986] [DEBUG] [REMOTE ] BHK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:37:19.163298] [WARN ] [REMOTE ] BHK: No data returned for month 2025-10 [2025-10-01T17:37:19.163442] [FATAL] [REMOTE ] BHK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:37:19.163557] [FATAL] [MAIN ] BHK: Failed to fetch primary data. [2025-10-01T17:37:19.163628] [WARN ] [MAIN ] BHK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:37:19.163719] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-01T17:37:19.163786] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-01T17:37:19.163824] [INFO ] [LOCAL ] BHK: Starting deletion of derivative data. [2025-10-01T17:37:19.164318] [DEBUG] [LOCAL ] BHK: Deleted derivative data file. [2025-10-01T17:37:19.164409] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 40.6s. Estimated remaining: 4h 48m 45s. Rate: 7.3 symbols/min [2025-10-01T17:37:19.307486] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-01T17:37:19.372798] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:37:19.423741] [DEBUG] [LOCAL ] BHVN: Loaded 49759 existing records from primary storage. [2025-10-01T17:37:19.424055] [INFO ] [MAIN ] BHVN: Loaded 49759 existing records. [2025-10-01T17:37:19.622577] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:37:19.622848] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-01T17:37:19.622900] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-01T17:37:19.623574] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-01T17:37:19.623686] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-01T17:37:20.020867] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:37:20.102414] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-01T17:37:20.472023] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-01T17:37:20.902398] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-01T17:37:21.218319] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-01T17:37:21.702413] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-01T17:37:22.502406] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-01T17:37:22.557565] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T17:37:23.302428] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-01T17:37:23.468148] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T17:37:24.102384] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-01T17:37:24.166702] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-01T17:37:24.168277] [INFO ] [REMOTE ] BHP: Full fetch complete (77251 records). [2025-10-01T17:37:24.168373] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-01T17:37:24.629275] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-01T17:37:24.629500] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-01T17:37:24.630354] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-01T17:37:24.630438] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-01T17:37:24.655634] [DEBUG] [LOCAL ] BHP: Trimmed 77251 records to 53373 (keeping 200 days of data) [2025-10-01T17:37:24.657630] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T17:37:24.905408] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-01T17:37:24.996873] [DEBUG] [LOCAL ] BHP: Primary data saved (53373 records). [2025-10-01T17:37:24.997011] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-01T17:37:24.998286] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHP took 40.9s. Estimated remaining: 4h 48m 18s. Rate: 7.3 symbols/min [2025-10-01T17:37:25.175419] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:37:25.175625] [DEBUG] [LOCAL ] BILL: No existing data file found in primary storage. [2025-10-01T17:37:25.175703] [WARN ] [MAIN ] BILL: No existing data found, performing full refresh instead. [2025-10-01T17:37:25.175822] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-01T17:37:25.175865] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-01T17:37:25.175907] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-10-01T17:37:25.175940] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-01T17:37:25.284691] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-01T17:37:25.479292] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T17:37:25.501931] [INFO ] [REMOTE ] BHR: Full fetch complete (30674 records). [2025-10-01T17:37:25.523046] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-01T17:37:25.649095] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:37:25.707517] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-01T17:37:26.041266] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-01T17:37:26.041347] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-01T17:37:26.041819] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-01T17:37:26.041882] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-01T17:37:26.042635] [DEBUG] [LOCAL ] BHR: Trimmed 30674 records to 21361 (keeping 200 days of data) [2025-10-01T17:37:26.169908] [DEBUG] [LOCAL ] BHR: Primary data saved (21361 records). [2025-10-01T17:37:26.170037] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-01T17:37:26.170120] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 29.2s. Estimated remaining: 4h 47m 16s. Rate: 7.3 symbols/min [2025-10-01T17:37:26.367906] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:37:26.393483] [DEBUG] [LOCAL ] BIO: Loaded 24946 existing records from primary storage. [2025-10-01T17:37:26.393776] [INFO ] [MAIN ] BIO: Loaded 24946 existing records. [2025-10-01T17:37:26.507683] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-01T17:37:26.614294] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:37:26.614598] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-01T17:37:26.614693] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-01T17:37:26.614962] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-01T17:37:26.615024] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-01T17:37:26.932440] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-01T17:37:27.044665] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:37:27.068711] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T17:37:27.302396] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-01T17:37:28.102392] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-01T17:37:28.505859] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-01T17:37:28.902364] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-01T17:37:29.351359] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T17:37:29.384888] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-01T17:37:29.702397] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-01T17:37:30.264537] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-01T17:37:30.265263] [INFO ] [REMOTE ] BHV: Full fetch complete (1375 records). [2025-10-01T17:37:30.265336] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-01T17:37:30.482441] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-01T17:37:30.482793] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-01T17:37:30.482870] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-01T17:37:30.482946] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-01T17:37:30.483061] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-01T17:37:30.483124] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-01T17:37:30.483216] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-01T17:37:30.483290] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHV took 27.3s. Estimated remaining: 4h 46m 37s. Rate: 7.3 symbols/min [2025-10-01T17:37:30.507526] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-01T17:37:30.675336] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:37:30.713731] [DEBUG] [LOCAL ] BIP: Loaded 39540 existing records from primary storage. [2025-10-01T17:37:30.714019] [INFO ] [MAIN ] BIP: Loaded 39540 existing records. [2025-10-01T17:37:30.909049] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:37:30.909367] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-01T17:37:30.909456] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-01T17:37:30.910012] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-01T17:37:30.910097] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-01T17:37:31.289777] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:37:31.302383] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-01T17:37:31.581862] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T17:37:32.102372] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-01T17:37:32.902414] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-01T17:37:32.988751] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T17:37:33.337169] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T17:37:33.702414] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-01T17:37:33.996215] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T17:37:34.502390] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-01T17:37:34.873523] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T17:37:35.302359] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-01T17:37:35.362919] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T17:37:36.102401] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-01T17:37:36.420109] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T17:37:36.902390] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-01T17:37:37.702387] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-01T17:37:37.795891] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T17:37:38.407046] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T17:37:38.502349] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-01T17:37:38.959015] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T17:37:39.302401] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-01T17:37:39.875130] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T17:37:40.102394] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-01T17:37:40.726811] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T17:37:40.902409] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-01T17:37:41.561524] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T17:37:41.702409] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-01T17:37:42.463743] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T17:37:42.502336] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-01T17:37:43.127396] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T17:37:43.302380] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-01T17:37:43.953460] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T17:37:44.102408] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-01T17:37:44.628374] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T17:37:44.902392] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-01T17:37:45.039209] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T17:37:45.702395] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-01T17:37:46.502424] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-01T17:37:46.831926] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-01T17:37:46.870169] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T17:37:47.302413] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-01T17:37:47.718793] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T17:37:48.102393] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-01T17:37:48.902420] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-01T17:37:49.088978] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T17:37:49.118024] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T17:37:49.702380] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-01T17:37:50.377965] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T17:37:50.502379] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-01T17:37:51.125121] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T17:37:51.302405] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-01T17:37:52.102396] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-01T17:37:52.212214] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T17:37:52.404417] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T17:37:52.902450] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-01T17:37:53.702403] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-01T17:37:53.873101] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T17:37:54.475103] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T17:37:54.502344] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-01T17:37:55.124820] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T17:37:55.302385] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-01T17:37:56.102387] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-01T17:37:56.427761] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T17:37:56.429203] [INFO ] [REMOTE ] BIP: Full fetch complete (56918 records). [2025-10-01T17:37:56.429330] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-01T17:37:56.853366] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-01T17:37:56.853485] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-01T17:37:56.854185] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-01T17:37:56.854297] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-01T17:37:56.855628] [DEBUG] [LOCAL ] BIP: Trimmed 56918 records to 39543 (keeping 200 days of data) [2025-10-01T17:37:56.912582] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-01T17:37:57.108204] [DEBUG] [LOCAL ] BIP: Primary data saved (39543 records). [2025-10-01T17:37:57.108358] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-01T17:37:57.108444] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIP took 26.6s. Estimated remaining: 4h 48m 50s. Rate: 7.3 symbols/min [2025-10-01T17:37:57.300687] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:37:57.343836] [DEBUG] [LOCAL ] BIPC: Loaded 41499 existing records from primary storage. [2025-10-01T17:37:57.344156] [INFO ] [MAIN ] BIPC: Loaded 41499 existing records. [2025-10-01T17:37:57.543565] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:37:57.543802] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-01T17:37:57.543877] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-01T17:37:57.544291] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-01T17:37:57.544365] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-01T17:37:57.838238] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-01T17:37:57.899087] [INFO ] [REMOTE ] BHVN: Full fetch complete (69920 records). [2025-10-01T17:37:57.906212] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T17:37:57.906417] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-01T17:37:57.999869] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-01T17:37:58.029166] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:37:58.103370] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-01T17:37:58.477282] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-01T17:37:58.477409] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-01T17:37:58.478230] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-01T17:37:58.478294] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-01T17:37:58.479736] [DEBUG] [LOCAL ] BHVN: Trimmed 69920 records to 49802 (keeping 200 days of data) [2025-10-01T17:37:58.535141] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-01T17:37:58.797150] [DEBUG] [LOCAL ] BHVN: Primary data saved (49802 records). [2025-10-01T17:37:58.797333] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-01T17:37:58.797470] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BHVN took 39.6s. Estimated remaining: 4h 47m 52s. Rate: 7.3 symbols/min [2025-10-01T17:37:58.988459] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:37:58.995893] [DEBUG] [LOCAL ] BIPH: Loaded 2575 existing records from primary storage. [2025-10-01T17:37:58.996090] [INFO ] [MAIN ] BIPH: Loaded 2575 existing records. [2025-10-01T17:37:59.190079] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:37:59.190308] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-01T17:37:59.190356] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-01T17:37:59.190547] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-01T17:37:59.190634] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-01T17:37:59.302425] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-01T17:37:59.370740] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-01T17:37:59.419742] [INFO ] [REMOTE ] BIO: Full fetch complete (34185 records). [2025-10-01T17:37:59.462150] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-01T17:37:59.708891] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:00.049135] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-01T17:38:00.048871] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:38:00.049312] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-01T17:38:00.058588] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-01T17:38:00.058745] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-01T17:38:00.059738] [DEBUG] [LOCAL ] BIO: Trimmed 34185 records to 24947 (keeping 200 days of data) [2025-10-01T17:38:00.121744] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-01T17:38:00.233965] [DEBUG] [LOCAL ] BIO: Primary data saved (24947 records). [2025-10-01T17:38:00.234116] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-01T17:38:00.234203] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIO took 34.1s. Estimated remaining: 4h 46m 52s. Rate: 7.3 symbols/min [2025-10-01T17:38:00.787183] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T17:38:00.902340] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-01T17:38:01.166254] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T17:38:01.702441] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-01T17:38:02.077479] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T17:38:02.313590] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T17:38:02.502428] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-01T17:38:02.957971] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T17:38:03.302403] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-01T17:38:04.102435] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-01T17:38:04.902381] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-01T17:38:05.171872] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-01T17:38:05.292476] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-01T17:38:05.702358] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-01T17:38:06.103881] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-01T17:38:06.478913] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T17:38:06.502427] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-01T17:38:06.794288] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-01T17:38:07.302388] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-01T17:38:08.102403] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-01T17:38:08.521026] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-01T17:38:08.779194] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T17:38:08.902393] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-01T17:38:09.702439] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-01T17:38:10.171068] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-01T17:38:10.502404] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-01T17:38:10.618474] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T17:38:11.302411] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-01T17:38:12.090049] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T17:38:12.102352] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-01T17:38:12.655637] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T17:38:12.902428] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-01T17:38:12.962457] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T17:38:13.582142] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T17:38:13.702386] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-01T17:38:14.502440] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-01T17:38:14.884233] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T17:38:15.302404] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-01T17:38:15.901020] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-01T17:38:15.901794] [INFO ] [REMOTE ] BIPH: Full fetch complete (4335 records). [2025-10-01T17:38:15.901864] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-01T17:38:16.107444] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-01T17:38:16.310861] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-01T17:38:16.310945] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-01T17:38:16.311102] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-01T17:38:16.311143] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-01T17:38:16.311578] [DEBUG] [LOCAL ] BIPH: Trimmed 4335 records to 2578 (keeping 200 days of data) [2025-10-01T17:38:16.329053] [DEBUG] [LOCAL ] BIPH: Primary data saved (2578 records). [2025-10-01T17:38:16.329169] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-01T17:38:16.329261] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPH took 17.5s. Estimated remaining: 4h 47m 43s. Rate: 7.3 symbols/min [2025-10-01T17:38:17.371634] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-01T17:38:17.374163] [INFO ] [REMOTE ] BILL: Full fetch complete (75652 records). [2025-10-01T17:38:17.374373] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-01T17:38:17.845522] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-01T17:38:17.845693] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-01T17:38:17.846805] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-01T17:38:17.846909] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-01T17:38:17.870498] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T17:38:17.878906] [DEBUG] [LOCAL ] BILL: Trimmed 75652 records to 52336 (keeping 200 days of data) [2025-10-01T17:38:17.880321] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-01T17:38:18.212249] [DEBUG] [LOCAL ] BILL: Primary data saved (52336 records). [2025-10-01T17:38:18.212410] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-01T17:38:18.212489] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BILL took 53.2s. Estimated remaining: 4h 46m 47s. Rate: 7.3 symbols/min [2025-10-01T17:38:19.063037] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:38:19.073286] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-01T17:38:20.680154] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T17:38:20.689293] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-01T17:38:22.006356] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T17:38:22.015368] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-01T17:38:22.889977] [DEBUG] [REMOTE ] BIPC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:38:22.890312] [WARN ] [REMOTE ] BIPC: No data returned for month 2025-10 [2025-10-01T17:38:22.890418] [FATAL] [REMOTE ] BIPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:38:22.890509] [FATAL] [MAIN ] BIPC: Failed to fetch primary data. [2025-10-01T17:38:22.890578] [WARN ] [MAIN ] BIPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:38:22.890677] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-01T17:38:22.890758] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-01T17:38:22.890797] [INFO ] [LOCAL ] BIPC: Starting deletion of derivative data. [2025-10-01T17:38:22.891259] [DEBUG] [LOCAL ] BIPC: Deleted derivative data file. [2025-10-01T17:38:22.891351] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 25.8s. Estimated remaining: 4h 46m 12s. Rate: 7.3 symbols/min [2025-10-01T17:38:23.603989] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:38:23.632961] [DEBUG] [LOCAL ] BIPJ: No existing data file found in primary storage. [2025-10-01T17:38:23.635200] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:38:23.664686] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:38:23.665439] [WARN ] [MAIN ] BIPJ: No existing data found, performing full refresh instead. [2025-10-01T17:38:23.666289] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-01T17:38:23.672030] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-01T17:38:23.677580] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-01T17:38:23.682816] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-01T17:38:23.748731] [DEBUG] [LOCAL ] BIPI: Loaded 3193 existing records from primary storage. [2025-10-01T17:38:23.835745] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:38:23.841345] [INFO ] [MAIN ] BIPI: Loaded 3193 existing records. [2025-10-01T17:38:23.920703] [DEBUG] [LOCAL ] BIT: Loaded 22692 existing records from primary storage. [2025-10-01T17:38:23.959320] [INFO ] [MAIN ] BIT: Loaded 22692 existing records. [2025-10-01T17:38:24.487907] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:38:24.551368] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-01T17:38:24.556773] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-01T17:38:24.592203] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:38:24.592697] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-01T17:38:24.592926] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-01T17:38:24.592856] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-01T17:38:24.594243] [DEBUG] [LOCAL ] BIRK: Loaded 50901 existing records from primary storage. [2025-10-01T17:38:24.610668] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-01T17:38:24.621038] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-01T17:38:24.633728] [INFO ] [MAIN ] BIRK: Loaded 50901 existing records. [2025-10-01T17:38:24.655708] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-01T17:38:24.886201] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:24.994981] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-01T17:38:25.377251] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:38:25.431029] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-01T17:38:25.541193] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-01T17:38:25.566215] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-01T17:38:25.571606] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-01T17:38:25.767725] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:25.824805] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:25.835607] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-01T17:38:25.821203] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-01T17:38:26.069125] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T17:38:26.086660] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-01T17:38:26.163348] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:26.163809] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-01T17:38:26.596230] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-01T17:38:26.597778] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-01T17:38:26.759562] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T17:38:26.761630] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-01T17:38:27.022426] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T17:38:27.023923] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-01T17:38:27.103199] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-01T17:38:27.104864] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-01T17:38:27.125965] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T17:38:27.302402] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-01T17:38:27.567743] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T17:38:27.572627] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T17:38:27.947572] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T17:38:28.102407] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-01T17:38:28.334098] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T17:38:28.554585] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-01T17:38:28.902429] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-01T17:38:29.537223] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T17:38:29.702385] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-01T17:38:30.502375] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-01T17:38:30.887204] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T17:38:30.995345] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T17:38:31.302380] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-01T17:38:32.102428] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-01T17:38:32.238724] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T17:38:32.644165] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-01T17:38:32.902405] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-01T17:38:33.488677] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T17:38:33.702396] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-01T17:38:34.502393] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-01T17:38:34.760017] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T17:38:35.082765] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-01T17:38:35.302402] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-01T17:38:35.683312] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-01T17:38:36.102431] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-01T17:38:36.902355] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-01T17:38:37.121234] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T17:38:37.702417] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-01T17:38:37.956064] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T17:38:38.502406] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-01T17:38:38.810802] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-01T17:38:39.302396] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-01T17:38:39.351674] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T17:38:39.828792] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T17:38:40.102428] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-01T17:38:40.580281] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-01T17:38:40.902388] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-01T17:38:41.702359] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-01T17:38:41.931018] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T17:38:42.275761] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T17:38:42.502366] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-01T17:38:43.302409] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-01T17:38:43.650877] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T17:38:44.004117] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-01T17:38:44.004842] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4445 records). [2025-10-01T17:38:44.004952] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-01T17:38:44.107512] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-01T17:38:44.491276] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-01T17:38:44.491472] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-01T17:38:44.491830] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-01T17:38:44.491911] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-01T17:38:44.492800] [DEBUG] [LOCAL ] BIPJ: Trimmed 4445 records to 3132 (keeping 200 days of data) [2025-10-01T17:38:44.525763] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3132 records). [2025-10-01T17:38:44.526040] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-01T17:38:44.526168] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 21.6s. Estimated remaining: 4h 47m 44s. Rate: 7.3 symbols/min [2025-10-01T17:38:44.714431] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T17:38:44.829992] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:38:44.916604] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-01T17:38:44.920835] [DEBUG] [LOCAL ] BJ: Loaded 51365 existing records from primary storage. [2025-10-01T17:38:44.921340] [INFO ] [MAIN ] BJ: Loaded 51365 existing records. [2025-10-01T17:38:45.219089] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:38:45.219380] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-01T17:38:45.219439] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-01T17:38:45.221279] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-01T17:38:45.221355] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-01T17:38:45.700182] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:45.702343] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-01T17:38:46.433591] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T17:38:46.502387] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-01T17:38:47.302372] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-01T17:38:47.523487] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T17:38:47.570675] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T17:38:47.937387] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T17:38:48.102385] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-01T17:38:48.902371] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-01T17:38:49.343112] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T17:38:49.650437] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-01T17:38:49.651365] [INFO ] [REMOTE ] BIPI: Full fetch complete (5138 records). [2025-10-01T17:38:49.651452] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-01T17:38:49.707606] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-01T17:38:50.062616] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-01T17:38:50.062734] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-01T17:38:50.062905] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-01T17:38:50.062948] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-01T17:38:50.063439] [DEBUG] [LOCAL ] BIPI: Trimmed 5138 records to 3202 (keeping 200 days of data) [2025-10-01T17:38:50.084141] [DEBUG] [LOCAL ] BIPI: Primary data saved (3202 records). [2025-10-01T17:38:50.084281] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-01T17:38:50.084402] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 27.2s. Estimated remaining: 4h 47m 16s. Rate: 7.3 symbols/min [2025-10-01T17:38:50.284068] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:38:50.344214] [DEBUG] [LOCAL ] BK: Loaded 53538 existing records from primary storage. [2025-10-01T17:38:50.344706] [INFO ] [MAIN ] BK: Loaded 53538 existing records. [2025-10-01T17:38:50.511568] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-01T17:38:50.558586] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:38:50.558862] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-01T17:38:50.558947] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-01T17:38:50.559822] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-01T17:38:50.559892] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-01T17:38:50.974530] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:51.302395] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-01T17:38:51.948609] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-01T17:38:52.102386] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-01T17:38:52.449185] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T17:38:52.450777] [INFO ] [REMOTE ] BIT: Full fetch complete (31669 records). [2025-10-01T17:38:52.450888] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-01T17:38:52.885232] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-01T17:38:52.885401] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-01T17:38:52.886027] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-01T17:38:52.886093] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-01T17:38:52.886899] [DEBUG] [LOCAL ] BIT: Trimmed 31669 records to 22791 (keeping 200 days of data) [2025-10-01T17:38:52.942887] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-01T17:38:53.065835] [DEBUG] [LOCAL ] BIT: Primary data saved (22791 records). [2025-10-01T17:38:53.066919] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T17:38:53.067173] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-01T17:38:53.076957] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 30.2s. Estimated remaining: 4h 46m 28s. Rate: 7.3 symbols/min [2025-10-01T17:38:53.267610] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:38:53.315755] [DEBUG] [LOCAL ] BKD: Loaded 50188 existing records from primary storage. [2025-10-01T17:38:53.316093] [INFO ] [MAIN ] BKD: Loaded 50188 existing records. [2025-10-01T17:38:53.516568] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:38:53.516921] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-01T17:38:53.517035] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-01T17:38:53.517401] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-01T17:38:53.517498] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-01T17:38:53.716785] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-01T17:38:53.937028] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:38:53.973933] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T17:38:54.506434] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-01T17:38:54.512038] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T17:38:55.302357] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-01T17:38:55.580621] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T17:38:55.873383] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:38:56.102379] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-01T17:38:56.884412] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T17:38:56.902334] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-01T17:38:57.481528] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T17:38:57.702377] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-01T17:38:58.076084] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T17:38:58.502376] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-01T17:38:59.296901] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T17:38:59.307576] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-01T17:38:59.980705] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:39:00.102394] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-01T17:39:00.902403] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-01T17:39:01.104574] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T17:39:01.508230] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T17:39:01.702391] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-01T17:39:02.360701] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T17:39:02.502387] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-01T17:39:03.300029] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T17:39:03.309714] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-01T17:39:04.102389] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-01T17:39:04.548229] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T17:39:04.902410] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-01T17:39:05.222177] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T17:39:05.531971] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T17:39:05.702406] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-01T17:39:06.502447] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-01T17:39:06.704390] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T17:39:06.876630] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T17:39:07.302419] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-01T17:39:08.102356] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-01T17:39:08.153968] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T17:39:08.810972] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T17:39:08.902408] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-01T17:39:09.702355] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-01T17:39:09.829637] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T17:39:10.502348] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-01T17:39:10.575745] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T17:39:11.008008] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T17:39:11.302402] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-01T17:39:11.665408] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T17:39:12.102431] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-01T17:39:12.902389] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-01T17:39:13.575897] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T17:39:13.577507] [INFO ] [REMOTE ] BIRK: Full fetch complete (72986 records). [2025-10-01T17:39:13.577608] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-01T17:39:13.713578] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-01T17:39:14.055574] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-01T17:39:14.055759] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-01T17:39:14.056787] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-01T17:39:14.056868] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-01T17:39:14.059163] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-01T17:39:14.071182] [DEBUG] [LOCAL ] BIRK: Trimmed 72986 records to 50925 (keeping 200 days of data) [2025-10-01T17:39:14.392475] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T17:39:14.421989] [DEBUG] [LOCAL ] BIRK: Primary data saved (50925 records). [2025-10-01T17:39:14.422119] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-01T17:39:14.422197] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 51.5s. Estimated remaining: 4h 47m 57s. Rate: 7.2 symbols/min [2025-10-01T17:39:14.507524] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-01T17:39:14.609479] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:39:14.609734] [DEBUG] [LOCAL ] BKE: No existing data file found in primary storage. [2025-10-01T17:39:14.609785] [WARN ] [MAIN ] BKE: No existing data found, performing full refresh instead. [2025-10-01T17:39:14.609910] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-01T17:39:14.609953] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-01T17:39:14.609995] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-10-01T17:39:14.610029] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-01T17:39:14.996988] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:39:15.302428] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-01T17:39:15.604952] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T17:39:15.815222] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T17:39:16.102420] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-01T17:39:16.725699] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T17:39:16.902453] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-01T17:39:17.475462] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T17:39:17.702403] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-01T17:39:18.480232] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T17:39:18.502336] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-01T17:39:19.073808] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T17:39:19.302394] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-01T17:39:20.102428] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-01T17:39:20.546920] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-01T17:39:20.548492] [INFO ] [REMOTE ] BKD: Full fetch complete (71654 records). [2025-10-01T17:39:20.548611] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-01T17:39:20.907899] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-01T17:39:20.987444] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-01T17:39:20.987606] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-01T17:39:20.988619] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-01T17:39:20.988710] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-01T17:39:20.990222] [DEBUG] [LOCAL ] BKD: Trimmed 71654 records to 50196 (keeping 200 days of data) [2025-10-01T17:39:21.281819] [DEBUG] [LOCAL ] BKD: Primary data saved (50196 records). [2025-10-01T17:39:21.281968] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-01T17:39:21.282091] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BKD took 28.2s. Estimated remaining: 4h 47m 38s. Rate: 7.3 symbols/min [2025-10-01T17:39:21.475300] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:39:21.475539] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T17:39:21.477915] [INFO ] [REMOTE ] BJ: Full fetch complete (73811 records). [2025-10-01T17:39:21.478056] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-01T17:39:21.774521] [DEBUG] [LOCAL ] BKH: Loaded 36624 existing records from primary storage. [2025-10-01T17:39:21.800372] [INFO ] [MAIN ] BKH: Loaded 36624 existing records. [2025-10-01T17:39:22.207472] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:39:22.234715] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-01T17:39:22.235390] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-01T17:39:22.235315] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-01T17:39:22.236524] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-01T17:39:22.236998] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-01T17:39:22.237165] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-01T17:39:22.239219] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-01T17:39:22.239320] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-01T17:39:22.244705] [DEBUG] [LOCAL ] BJ: Trimmed 73811 records to 51373 (keeping 200 days of data) [2025-10-01T17:39:22.471904] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:39:22.573003] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-01T17:39:22.701385] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-01T17:39:22.767988] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-01T17:39:22.888160] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:39:23.095664] [DEBUG] [LOCAL ] BJ: Primary data saved (51373 records). [2025-10-01T17:39:23.095822] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-01T17:39:23.095953] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BJ took 38.6s. Estimated remaining: 4h 46m 43s. Rate: 7.3 symbols/min [2025-10-01T17:39:23.286244] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:39:23.307417] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-01T17:39:23.324568] [DEBUG] [LOCAL ] BKKT: Loaded 35076 existing records from primary storage. [2025-10-01T17:39:23.324932] [INFO ] [MAIN ] BKKT: Loaded 35076 existing records. [2025-10-01T17:39:23.521613] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:39:23.521942] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-01T17:39:23.521994] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-01T17:39:23.522484] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-01T17:39:23.522546] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-01T17:39:23.942329] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:39:23.965832] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T17:39:24.102397] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-01T17:39:24.619912] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T17:39:24.739216] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T17:39:24.902461] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-01T17:39:25.702393] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-01T17:39:26.153049] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-01T17:39:26.502406] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-01T17:39:26.705518] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T17:39:27.247278] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T17:39:27.302387] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-01T17:39:27.627460] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T17:39:28.102367] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-01T17:39:28.704528] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T17:39:28.902391] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-01T17:39:29.702376] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-01T17:39:29.831090] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T17:39:30.152354] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T17:39:30.153947] [INFO ] [REMOTE ] BK: Full fetch complete (77479 records). [2025-10-01T17:39:30.154065] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-01T17:39:30.508826] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-01T17:39:30.572791] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-01T17:39:30.572891] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-01T17:39:30.573852] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-01T17:39:30.573925] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-01T17:39:30.576009] [DEBUG] [LOCAL ] BK: Trimmed 77479 records to 53537 (keeping 200 days of data) [2025-10-01T17:39:30.913748] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T17:39:30.966437] [DEBUG] [LOCAL ] BK: Primary data saved (53537 records). [2025-10-01T17:39:30.966593] [INFO ] [MAIN ] BK: Full history saved. [2025-10-01T17:39:30.966706] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BK took 40.9s. Estimated remaining: 4h 46m 32s. Rate: 7.3 symbols/min [2025-10-01T17:39:31.195900] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:39:31.205963] [DEBUG] [LOCAL ] BKN: Loaded 7734 existing records from primary storage. [2025-10-01T17:39:31.206191] [INFO ] [MAIN ] BKN: Loaded 7734 existing records. [2025-10-01T17:39:31.307457] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-01T17:39:31.415912] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:39:31.416143] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-01T17:39:31.416199] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-01T17:39:31.416599] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-01T17:39:31.416696] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-01T17:39:31.800362] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:39:31.990353] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:39:32.102393] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-01T17:39:32.409578] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T17:39:32.902400] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-01T17:39:33.643502] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T17:39:33.702363] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-01T17:39:33.826576] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T17:39:34.258430] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T17:39:34.502383] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-01T17:39:35.302382] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-01T17:39:35.714177] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T17:39:35.945689] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T17:39:36.102376] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-01T17:39:36.902402] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-01T17:39:37.468976] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T17:39:37.702402] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-01T17:39:38.074427] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T17:39:38.502377] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-01T17:39:39.088091] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T17:39:39.302407] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-01T17:39:39.604702] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T17:39:40.102069] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T17:39:40.102958] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-01T17:39:40.902418] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-01T17:39:41.092237] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T17:39:41.392039] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-01T17:39:41.702385] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-01T17:39:42.229378] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-01T17:39:42.502387] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-01T17:39:43.302396] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-01T17:39:43.743232] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T17:39:44.102364] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-01T17:39:44.243048] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T17:39:44.902393] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-01T17:39:45.278280] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T17:39:45.702379] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-01T17:39:46.322588] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T17:39:46.502385] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-01T17:39:47.302387] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-01T17:39:47.481880] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-01T17:39:47.483196] [INFO ] [REMOTE ] BKE: Full fetch complete (50175 records). [2025-10-01T17:39:47.483299] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-01T17:39:47.974808] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-01T17:39:47.974982] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-01T17:39:47.977187] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-01T17:39:47.977292] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-01T17:39:47.996462] [DEBUG] [LOCAL ] BKE: Trimmed 50175 records to 34453 (keeping 200 days of data) [2025-10-01T17:39:47.997132] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T17:39:48.105346] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-01T17:39:48.236709] [DEBUG] [LOCAL ] BKE: Primary data saved (34453 records). [2025-10-01T17:39:48.236857] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-01T17:39:48.236991] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 33.8s. Estimated remaining: 4h 47m 29s. Rate: 7.2 symbols/min [2025-10-01T17:39:48.477726] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:39:48.527854] [DEBUG] [LOCAL ] BKSY: Loaded 48205 existing records from primary storage. [2025-10-01T17:39:48.528210] [INFO ] [MAIN ] BKSY: Loaded 48205 existing records. [2025-10-01T17:39:48.794133] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:39:48.794714] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-01T17:39:48.794832] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-01T17:39:48.795215] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-01T17:39:48.795371] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-01T17:39:48.906056] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-01T17:39:49.194716] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T17:39:49.247720] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:39:49.606069] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T17:39:49.702394] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-01T17:39:50.059450] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T17:39:50.502412] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-01T17:39:50.925457] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-01T17:39:51.302379] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-01T17:39:51.440839] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T17:39:52.102468] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-01T17:39:52.902410] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-01T17:39:53.209862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T17:39:53.684891] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T17:39:53.702342] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-01T17:39:54.502353] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-01T17:39:54.610523] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T17:39:55.245807] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T17:39:55.302383] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-01T17:39:55.347812] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T17:39:56.102374] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-01T17:39:56.902348] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-01T17:39:57.252419] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-01T17:39:57.702401] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-01T17:39:57.892680] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T17:39:57.894017] [INFO ] [REMOTE ] BKH: Full fetch complete (52370 records). [2025-10-01T17:39:57.894105] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-01T17:39:58.322950] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-01T17:39:58.323037] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-01T17:39:58.323633] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-01T17:39:58.323716] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-01T17:39:58.324841] [DEBUG] [LOCAL ] BKH: Trimmed 52370 records to 36630 (keeping 200 days of data) [2025-10-01T17:39:58.522040] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-01T17:39:58.554792] [DEBUG] [LOCAL ] BKH: Primary data saved (36630 records). [2025-10-01T17:39:58.554938] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-01T17:39:58.555039] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 37.3s. Estimated remaining: 4h 47m 35s. Rate: 7.2 symbols/min [2025-10-01T17:39:58.747902] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:39:58.762683] [DEBUG] [LOCAL ] BKT: Loaded 11267 existing records from primary storage. [2025-10-01T17:39:58.762945] [INFO ] [MAIN ] BKT: Loaded 11267 existing records. [2025-10-01T17:39:58.966902] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:39:58.967295] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-01T17:39:58.967381] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-01T17:39:58.967765] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-01T17:39:58.967923] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-01T17:39:59.300711] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-01T17:39:59.379094] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-01T17:39:59.412705] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:39:59.740759] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T17:40:00.102388] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-01T17:40:00.902441] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-01T17:40:01.709387] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T17:40:01.719188] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-01T17:40:01.978514] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T17:40:02.502445] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-01T17:40:02.588461] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (3.21 seconds). [2025-10-01T17:40:02.590437] [INFO ] [REMOTE ] BKKT: Full fetch complete (50254 records). [2025-10-01T17:40:02.590596] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-01T17:40:03.070779] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-01T17:40:03.070973] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-01T17:40:03.071852] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-01T17:40:03.071918] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-01T17:40:03.073137] [DEBUG] [LOCAL ] BKKT: Trimmed 50254 records to 35253 (keeping 200 days of data) [2025-10-01T17:40:03.136496] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (4.61 seconds). [2025-10-01T17:40:03.153976] [INFO ] [REMOTE ] BKN: Full fetch complete (11904 records). [2025-10-01T17:40:03.154489] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T17:40:03.183946] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-01T17:40:03.311892] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-01T17:40:03.537196] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T17:40:03.707853] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-01T17:40:03.708838] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-01T17:40:03.709170] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-01T17:40:03.709242] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-01T17:40:03.710861] [DEBUG] [LOCAL ] BKN: Trimmed 11904 records to 7730 (keeping 200 days of data) [2025-10-01T17:40:03.837115] [DEBUG] [LOCAL ] BKN: Primary data saved (7730 records). [2025-10-01T17:40:03.838627] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-01T17:40:03.840582] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 32.9s. Estimated remaining: 4h 47m 5s. Rate: 7.2 symbols/min [2025-10-01T17:40:04.059756] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:40:04.074240] [DEBUG] [LOCAL ] BKKT: Primary data saved (35253 records). [2025-10-01T17:40:04.074692] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-01T17:40:04.074804] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 41.0s. Estimated remaining: 4h 45m 59s. Rate: 7.3 symbols/min [2025-10-01T17:40:04.110603] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-01T17:40:04.205821] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T17:40:04.298254] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:40:04.311460] [DEBUG] [LOCAL ] BKU: Loaded 41483 existing records from primary storage. [2025-10-01T17:40:04.312006] [INFO ] [MAIN ] BKU: Loaded 41483 existing records. [2025-10-01T17:40:04.522601] [DEBUG] [LOCAL ] BKV: Loaded 29775 existing records from primary storage. [2025-10-01T17:40:04.545673] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:40:04.545920] [INFO ] [MAIN ] BKV: Loaded 29775 existing records. [2025-10-01T17:40:04.546241] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-01T17:40:04.546330] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-01T17:40:04.551720] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-01T17:40:04.556987] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-01T17:40:04.943956] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-01T17:40:05.028977] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:40:05.061365] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-01T17:40:05.077005] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-01T17:40:05.099724] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-01T17:40:05.114389] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-01T17:40:05.430900] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:40:05.692010] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:40:05.702395] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-01T17:40:05.922722] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T17:40:06.089756] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-01T17:40:06.502439] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-01T17:40:07.119969] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:40:07.302405] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-01T17:40:08.102364] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-01T17:40:08.203032] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T17:40:08.902401] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-01T17:40:09.574370] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-01T17:40:09.643783] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T17:40:09.707475] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-01T17:40:09.724163] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T17:40:10.502434] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-01T17:40:11.140536] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T17:40:11.302424] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-01T17:40:11.586504] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T17:40:12.007247] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T17:40:12.102374] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-01T17:40:12.902345] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-01T17:40:12.912767] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T17:40:13.702439] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-01T17:40:14.502436] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-01T17:40:15.084227] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T17:40:15.262740] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T17:40:15.302388] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-01T17:40:16.102375] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-01T17:40:16.318397] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T17:40:16.633762] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (3.73 seconds). [2025-10-01T17:40:16.902401] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-01T17:40:17.543617] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T17:40:17.702464] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-01T17:40:18.282639] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T17:40:18.502379] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-01T17:40:18.971896] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-01T17:40:19.302433] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-01T17:40:19.420081] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T17:40:20.102394] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-01T17:40:20.902383] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-01T17:40:20.993814] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T17:40:21.479091] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T17:40:21.702423] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-01T17:40:22.502387] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-01T17:40:23.183680] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T17:40:23.302399] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-01T17:40:23.685281] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-01T17:40:23.687249] [INFO ] [REMOTE ] BKSY: Full fetch complete (69583 records). [2025-10-01T17:40:23.687394] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-01T17:40:23.777319] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-01T17:40:23.803413] [INFO ] [REMOTE ] BKT: Full fetch complete (15462 records). [2025-10-01T17:40:23.815983] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-01T17:40:24.133835] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-01T17:40:24.541420] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-01T17:40:24.542056] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-01T17:40:24.553580] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-01T17:40:24.601186] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-01T17:40:24.644481] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-01T17:40:24.644681] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-01T17:40:24.644928] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-01T17:40:24.645300] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-01T17:40:24.645775] [DEBUG] [LOCAL ] BKSY: Trimmed 69583 records to 48210 (keeping 200 days of data) [2025-10-01T17:40:24.646687] [DEBUG] [LOCAL ] BKT: Trimmed 15462 records to 11379 (keeping 200 days of data) [2025-10-01T17:40:24.873392] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T17:40:24.952841] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-01T17:40:25.010479] [DEBUG] [LOCAL ] BKT: Primary data saved (11379 records). [2025-10-01T17:40:25.013382] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-01T17:40:25.014324] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKT took 26.5s. Estimated remaining: 4h 47m 21s. Rate: 7.2 symbols/min [2025-10-01T17:40:25.232397] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:40:25.269391] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T17:40:25.350811] [DEBUG] [LOCAL ] BLCO: Loaded 35436 existing records from primary storage. [2025-10-01T17:40:25.352917] [INFO ] [MAIN ] BLCO: Loaded 35436 existing records. [2025-10-01T17:40:25.568006] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:40:25.569920] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-01T17:40:25.569986] [DEBUG] [LOCAL ] BKSY: Primary data saved (48210 records). [2025-10-01T17:40:25.570161] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-01T17:40:25.572375] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 37.3s. Estimated remaining: 4h 46m 18s. Rate: 7.3 symbols/min [2025-10-01T17:40:25.570096] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-01T17:40:25.577953] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-01T17:40:25.620258] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-01T17:40:25.722424] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-01T17:40:25.929465] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:40:26.229892] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:40:26.231117] [DEBUG] [LOCAL ] BLD: Loaded 27707 existing records from primary storage. [2025-10-01T17:40:26.232224] [INFO ] [MAIN ] BLD: Loaded 27707 existing records. [2025-10-01T17:40:26.434764] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:40:26.435247] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-01T17:40:26.435513] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-01T17:40:26.435909] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-01T17:40:26.435984] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-01T17:40:26.507715] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-01T17:40:26.778158] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T17:40:26.924292] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:40:27.151294] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T17:40:27.302421] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-01T17:40:27.958517] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T17:40:28.102408] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-01T17:40:28.275546] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T17:40:28.902404] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-01T17:40:29.392396] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T17:40:29.702411] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-01T17:40:30.412767] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T17:40:30.502430] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-01T17:40:31.082755] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T17:40:31.302390] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-01T17:40:31.708890] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T17:40:32.102415] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-01T17:40:32.806103] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T17:40:32.902375] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-01T17:40:33.702423] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-01T17:40:33.925345] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-01T17:40:33.926789] [INFO ] [REMOTE ] BKU: Full fetch complete (59809 records). [2025-10-01T17:40:33.926891] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-01T17:40:34.218462] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T17:40:34.391850] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-01T17:40:34.391953] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-01T17:40:34.392732] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-01T17:40:34.392805] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-01T17:40:34.394743] [DEBUG] [LOCAL ] BKU: Trimmed 59809 records to 41412 (keeping 200 days of data) [2025-10-01T17:40:34.502572] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-01T17:40:34.657510] [DEBUG] [LOCAL ] BKU: Primary data saved (41412 records). [2025-10-01T17:40:34.657658] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-01T17:40:34.657817] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 30.8s. Estimated remaining: 4h 46m 16s. Rate: 7.3 symbols/min [2025-10-01T17:40:34.857142] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:40:34.877004] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T17:40:34.941817] [DEBUG] [LOCAL ] BLDR: Loaded 51633 existing records from primary storage. [2025-10-01T17:40:34.942201] [INFO ] [MAIN ] BLDR: Loaded 51633 existing records. [2025-10-01T17:40:35.146868] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:40:35.147110] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-01T17:40:35.147160] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-01T17:40:35.147848] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-01T17:40:35.147911] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-01T17:40:35.307617] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-01T17:40:35.594037] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:40:35.667601] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T17:40:36.102396] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-01T17:40:36.747620] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-01T17:40:36.749575] [INFO ] [REMOTE ] BKV: Full fetch complete (44950 records). [2025-10-01T17:40:36.749722] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-01T17:40:36.907463] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-01T17:40:37.192734] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-01T17:40:37.192939] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-01T17:40:37.193596] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-01T17:40:37.193720] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-01T17:40:37.194849] [DEBUG] [LOCAL ] BKV: Trimmed 44950 records to 29752 (keeping 200 days of data) [2025-10-01T17:40:37.398177] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T17:40:37.412912] [DEBUG] [LOCAL ] BKV: Primary data saved (29752 records). [2025-10-01T17:40:37.413076] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-01T17:40:37.413167] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 33.3s. Estimated remaining: 4h 45m 29s. Rate: 7.3 symbols/min [2025-10-01T17:40:37.605305] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:40:37.622836] [DEBUG] [LOCAL ] BLE: Loaded 14340 existing records from primary storage. [2025-10-01T17:40:37.623106] [INFO ] [MAIN ] BLE: Loaded 14340 existing records. [2025-10-01T17:40:37.711526] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-01T17:40:37.839043] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:40:37.839240] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-01T17:40:37.839328] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-01T17:40:37.839580] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-01T17:40:37.839639] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-01T17:40:38.271933] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:40:38.352573] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T17:40:38.502372] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-01T17:40:38.777407] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T17:40:39.302382] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-01T17:40:39.318444] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-01T17:40:40.102411] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-01T17:40:40.902426] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-01T17:40:41.063379] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T17:40:41.223242] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T17:40:41.702359] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-01T17:40:41.771703] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T17:40:42.502410] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-01T17:40:42.904296] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T17:40:43.264488] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T17:40:43.302377] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-01T17:40:44.102439] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-01T17:40:44.882068] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T17:40:44.902396] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-01T17:40:45.241467] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T17:40:45.702387] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-01T17:40:46.458701] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:40:46.502372] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-01T17:40:47.128548] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T17:40:47.302400] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-01T17:40:47.947815] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T17:40:48.102384] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-01T17:40:48.630247] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T17:40:48.902394] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-01T17:40:49.558220] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T17:40:49.578677] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T17:40:49.702391] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-01T17:40:50.502386] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-01T17:40:51.302393] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-01T17:40:51.519751] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T17:40:51.734864] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T17:40:52.102384] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-01T17:40:52.134049] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T17:40:52.902377] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-01T17:40:53.631305] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T17:40:53.679128] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T17:40:53.702359] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-01T17:40:54.502421] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-01T17:40:55.302442] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-01T17:40:55.350212] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T17:40:55.394262] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T17:40:56.102416] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-01T17:40:56.665407] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T17:40:56.902426] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-01T17:40:57.532201] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T17:40:57.675156] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T17:40:57.702356] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-01T17:40:58.502387] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-01T17:40:59.302427] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-01T17:40:59.564588] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T17:40:59.566066] [INFO ] [REMOTE ] BLCO: Full fetch complete (52754 records). [2025-10-01T17:40:59.566238] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-01T17:41:00.045833] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T17:41:00.046127] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-01T17:41:00.052698] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-01T17:41:00.053813] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-01T17:41:00.054021] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-01T17:41:00.055425] [DEBUG] [LOCAL ] BLCO: Trimmed 52754 records to 35433 (keeping 200 days of data) [2025-10-01T17:41:00.106473] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-01T17:41:00.279603] [DEBUG] [LOCAL ] BLCO: Primary data saved (35433 records). [2025-10-01T17:41:00.279793] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-01T17:41:00.279887] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 35.3s. Estimated remaining: 4h 47m 3s. Rate: 7.2 symbols/min [2025-10-01T17:41:00.495589] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:00.534373] [DEBUG] [LOCAL ] BLK: Loaded 34458 existing records from primary storage. [2025-10-01T17:41:00.534722] [INFO ] [MAIN ] BLK: Loaded 34458 existing records. [2025-10-01T17:41:00.739923] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:41:00.740392] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-01T17:41:00.740518] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-01T17:41:00.741229] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-01T17:41:00.741290] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-01T17:41:00.914008] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-01T17:41:01.160398] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:01.192466] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T17:41:01.230121] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T17:41:01.702451] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-01T17:41:01.914081] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T17:41:02.280244] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T17:41:02.502418] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-01T17:41:03.302392] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-01T17:41:04.102352] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-01T17:41:04.351606] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T17:41:04.658451] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T17:41:04.902370] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-01T17:41:05.339972] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T17:41:05.702410] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-01T17:41:05.901483] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T17:41:05.902414] [INFO ] [REMOTE ] BLE: Full fetch complete (20378 records). [2025-10-01T17:41:05.902497] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-01T17:41:06.336735] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-01T17:41:06.336848] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-01T17:41:06.337316] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-01T17:41:06.337383] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-01T17:41:06.338345] [DEBUG] [LOCAL ] BLE: Trimmed 20378 records to 14294 (keeping 200 days of data) [2025-10-01T17:41:06.431205] [DEBUG] [LOCAL ] BLE: Primary data saved (14294 records). [2025-10-01T17:41:06.431357] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-01T17:41:06.431446] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLE took 29.0s. Estimated remaining: 4h 46m 40s. Rate: 7.2 symbols/min [2025-10-01T17:41:06.507487] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-01T17:41:06.620481] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:06.620693] [DEBUG] [LOCAL ] BLND: No existing data file found in primary storage. [2025-10-01T17:41:06.620749] [WARN ] [MAIN ] BLND: No existing data found, performing full refresh instead. [2025-10-01T17:41:06.620868] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-01T17:41:06.620917] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-01T17:41:06.620975] [DEBUG] [LOCAL ] BLND: No primary data file found to delete. [2025-10-01T17:41:06.621014] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-01T17:41:07.025374] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:07.302389] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-01T17:41:07.663828] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-01T17:41:08.102409] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-01T17:41:08.342832] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T17:41:08.902373] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-01T17:41:09.052020] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T17:41:09.702430] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-01T17:41:10.502389] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-01T17:41:10.606817] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-01T17:41:10.608818] [INFO ] [REMOTE ] BLDR: Full fetch complete (74416 records). [2025-10-01T17:41:10.608935] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-01T17:41:10.994611] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-01T17:41:11.102329] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-01T17:41:11.102440] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-01T17:41:11.103309] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-01T17:41:11.103588] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-01T17:41:11.135491] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T17:41:11.134216] [DEBUG] [LOCAL ] BLDR: Trimmed 74416 records to 51639 (keeping 200 days of data) [2025-10-01T17:41:11.332969] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-01T17:41:11.478756] [DEBUG] [LOCAL ] BLDR: Primary data saved (51639 records). [2025-10-01T17:41:11.478904] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-01T17:41:11.479001] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLDR took 36.8s. Estimated remaining: 4h 46m 9s. Rate: 7.2 symbols/min [2025-10-01T17:41:11.674585] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:11.674793] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-01T17:41:11.674877] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-01T17:41:11.674992] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-01T17:41:11.675036] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-01T17:41:11.675094] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-01T17:41:11.675133] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-01T17:41:12.010625] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T17:41:12.038637] [INFO ] [REMOTE ] BLD: Full fetch complete (40285 records). [2025-10-01T17:41:12.061043] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-01T17:41:12.107398] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:12.107477] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-01T17:41:12.546007] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-01T17:41:12.546102] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-01T17:41:12.546686] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-01T17:41:12.546751] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-01T17:41:12.547822] [DEBUG] [LOCAL ] BLD: Trimmed 40285 records to 27631 (keeping 200 days of data) [2025-10-01T17:41:12.733205] [DEBUG] [LOCAL ] BLD: Primary data saved (27631 records). [2025-10-01T17:41:12.733352] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-01T17:41:12.733459] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLD took 47.2s. Estimated remaining: 4h 45m 12s. Rate: 7.3 symbols/min [2025-10-01T17:41:12.908071] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-01T17:41:12.943177] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:12.960635] [DEBUG] [LOCAL ] BLW: Loaded 12979 existing records from primary storage. [2025-10-01T17:41:12.960958] [INFO ] [MAIN ] BLW: Loaded 12979 existing records. [2025-10-01T17:41:13.178171] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:41:13.178517] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-01T17:41:13.178628] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-01T17:41:13.179008] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-01T17:41:13.179146] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-01T17:41:13.412007] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:41:13.473628] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-01T17:41:13.488400] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:41:13.498598] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-01T17:41:13.515186] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:41:13.527923] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-01T17:41:13.522372] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-01T17:41:13.541748] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-01T17:41:13.552226] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-01T17:41:13.615235] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-01T17:41:13.617412] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLSH took 2.1s. Estimated remaining: 4h 44m 13s. Rate: 7.3 symbols/min [2025-10-01T17:41:13.617307] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T17:41:13.711823] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-01T17:41:13.809434] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:13.919248] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:13.936262] [DEBUG] [LOCAL ] BLX: Loaded 15578 existing records from primary storage. [2025-10-01T17:41:13.936547] [INFO ] [MAIN ] BLX: Loaded 15578 existing records. [2025-10-01T17:41:14.148747] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:41:14.149061] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-01T17:41:14.149118] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-01T17:41:14.149346] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-01T17:41:14.149404] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-01T17:41:14.507580] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-01T17:41:14.578526] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:15.302440] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-01T17:41:15.751157] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T17:41:15.974113] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T17:41:16.102373] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-01T17:41:16.412329] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T17:41:16.902402] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-01T17:41:16.980934] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T17:41:17.702433] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-01T17:41:18.140745] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T17:41:18.502436] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-01T17:41:19.070983] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:41:19.302434] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-01T17:41:19.315316] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T17:41:20.027668] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T17:41:20.102391] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-01T17:41:20.902413] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-01T17:41:21.624432] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T17:41:21.702418] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-01T17:41:22.161878] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T17:41:22.268478] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T17:41:22.502389] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-01T17:41:23.302380] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-01T17:41:24.084987] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T17:41:24.102332] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-01T17:41:24.224875] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T17:41:24.693991] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T17:41:24.902418] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-01T17:41:25.702379] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-01T17:41:26.465806] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T17:41:26.502389] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-01T17:41:26.552344] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T17:41:27.302428] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-01T17:41:27.644445] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T17:41:28.102391] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-01T17:41:28.674523] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T17:41:28.902388] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-01T17:41:29.163053] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T17:41:29.702401] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-01T17:41:30.476601] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T17:41:30.502400] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-01T17:41:30.608495] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-01T17:41:31.302414] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-01T17:41:31.706337] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T17:41:32.102370] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-01T17:41:32.882398] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T17:41:32.902345] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-01T17:41:33.061548] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T17:41:33.702393] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-01T17:41:34.349711] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T17:41:34.502411] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-01T17:41:34.622583] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T17:41:35.302409] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-01T17:41:36.102456] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-01T17:41:36.605231] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T17:41:36.608019] [INFO ] [REMOTE ] BLND: Full fetch complete (72247 records). [2025-10-01T17:41:36.608308] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-01T17:41:36.916196] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-01T17:41:37.160445] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T17:41:37.226597] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-01T17:41:37.226987] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-01T17:41:37.227923] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-01T17:41:37.227999] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-01T17:41:37.229861] [DEBUG] [LOCAL ] BLND: Trimmed 72247 records to 49264 (keeping 200 days of data) [2025-10-01T17:41:37.537944] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T17:41:37.538087] [DEBUG] [LOCAL ] BLND: Primary data saved (49264 records). [2025-10-01T17:41:37.538390] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-01T17:41:37.539631] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLND took 31.1s. Estimated remaining: 4h 45m 52s. Rate: 7.2 symbols/min [2025-10-01T17:41:37.545243] [INFO ] [REMOTE ] BLK: Full fetch complete (52710 records). [2025-10-01T17:41:37.564055] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-01T17:41:37.711506] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T17:41:37.710887] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-01T17:41:37.928820] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:38.290844] [DEBUG] [LOCAL ] BMA: Loaded 35166 existing records from primary storage. [2025-10-01T17:41:38.291203] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-01T17:41:38.291445] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-01T17:41:38.292177] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-01T17:41:38.292260] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-01T17:41:38.292627] [INFO ] [MAIN ] BMA: Loaded 35166 existing records. [2025-10-01T17:41:38.379630] [DEBUG] [LOCAL ] BLK: Trimmed 52710 records to 34407 (keeping 200 days of data) [2025-10-01T17:41:38.507458] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-01T17:41:38.634996] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:41:38.636389] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-01T17:41:38.636610] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-01T17:41:38.641540] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-01T17:41:38.642734] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-01T17:41:39.069705] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T17:41:39.109571] [DEBUG] [LOCAL ] BLK: Primary data saved (34407 records). [2025-10-01T17:41:39.136027] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-01T17:41:39.147987] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLK took 38.9s. Estimated remaining: 4h 44m 58s. Rate: 7.3 symbols/min [2025-10-01T17:41:39.317758] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-01T17:41:39.379585] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:39.472208] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:39.481108] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T17:41:39.494370] [DEBUG] [LOCAL ] BME: Loaded 10880 existing records from primary storage. [2025-10-01T17:41:39.494609] [INFO ] [MAIN ] BME: Loaded 10880 existing records. [2025-10-01T17:41:39.695439] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:41:39.695729] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-01T17:41:39.695787] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-01T17:41:39.695997] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-01T17:41:39.696057] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-01T17:41:40.089757] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:40.100268] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T17:41:40.103682] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-01T17:41:40.735613] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T17:41:40.902395] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-01T17:41:41.702416] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-01T17:41:41.764964] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T17:41:42.502373] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-01T17:41:43.021931] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T17:41:43.302396] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-01T17:41:43.557536] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T17:41:43.558539] [INFO ] [REMOTE ] BLX: Full fetch complete (22739 records). [2025-10-01T17:41:43.558621] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-01T17:41:43.965415] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-01T17:41:43.965519] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-01T17:41:43.966075] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-01T17:41:43.966139] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-01T17:41:43.966836] [DEBUG] [LOCAL ] BLX: Trimmed 22739 records to 15623 (keeping 200 days of data) [2025-10-01T17:41:44.065274] [DEBUG] [LOCAL ] BLX: Primary data saved (15623 records). [2025-10-01T17:41:44.065415] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-01T17:41:44.065498] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLX took 30.4s. Estimated remaining: 4h 44m 27s. Rate: 7.3 symbols/min [2025-10-01T17:41:44.111494] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-01T17:41:44.260626] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:44.289201] [DEBUG] [LOCAL ] BMEZ: Loaded 26164 existing records from primary storage. [2025-10-01T17:41:44.289476] [INFO ] [MAIN ] BMEZ: Loaded 26164 existing records. [2025-10-01T17:41:44.480825] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:41:44.481097] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-01T17:41:44.481147] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-01T17:41:44.481446] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-01T17:41:44.481508] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-01T17:41:44.892561] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:44.900150] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T17:41:44.902922] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-01T17:41:45.049226] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T17:41:45.690241] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T17:41:45.702384] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-01T17:41:46.502386] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-01T17:41:46.958215] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T17:41:47.112481] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T17:41:47.302390] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-01T17:41:48.102366] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-01T17:41:48.243533] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T17:41:48.902390] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-01T17:41:49.541371] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T17:41:49.702411] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-01T17:41:49.734311] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T17:41:50.502446] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-01T17:41:51.044051] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T17:41:51.302422] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-01T17:41:51.717875] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T17:41:51.718893] [INFO ] [REMOTE ] BLW: Full fetch complete (19164 records). [2025-10-01T17:41:51.718982] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-01T17:41:52.138906] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-01T17:41:52.110305] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-01T17:41:52.139960] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-01T17:41:52.140500] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-01T17:41:52.140596] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-01T17:41:52.150371] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-01T17:41:52.153820] [DEBUG] [LOCAL ] BLW: Trimmed 19164 records to 13110 (keeping 200 days of data) [2025-10-01T17:41:52.240711] [DEBUG] [LOCAL ] BLW: Primary data saved (13110 records). [2025-10-01T17:41:52.240871] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-01T17:41:52.240966] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLW took 39.5s. Estimated remaining: 4h 44m 18s. Rate: 7.3 symbols/min [2025-10-01T17:41:52.429248] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:41:52.455295] [DEBUG] [LOCAL ] BMI: Loaded 24271 existing records from primary storage. [2025-10-01T17:41:52.455589] [INFO ] [MAIN ] BMI: Loaded 24271 existing records. [2025-10-01T17:41:52.654631] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:41:52.654899] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-01T17:41:52.654955] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-01T17:41:52.655194] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-01T17:41:52.655272] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-01T17:41:52.909715] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-01T17:41:53.035910] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:41:53.702369] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-01T17:41:53.738590] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T17:41:53.781605] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T17:41:54.502394] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-01T17:41:54.718553] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T17:41:55.302390] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-01T17:41:55.357465] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T17:41:56.102443] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-01T17:41:56.679264] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T17:41:56.805920] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T17:41:56.902394] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-01T17:41:57.702353] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-01T17:41:58.096520] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T17:41:58.502365] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-01T17:41:58.793374] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T17:41:59.302437] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-01T17:41:59.333692] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T17:42:00.102403] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-01T17:42:00.651575] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T17:42:00.902444] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-01T17:42:01.205761] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T17:42:01.702452] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-01T17:42:02.009001] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T17:42:02.502398] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-01T17:42:02.849796] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T17:42:03.302387] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-01T17:42:03.752309] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T17:42:04.102380] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-01T17:42:04.333106] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T17:42:04.334229] [INFO ] [REMOTE ] BME: Full fetch complete (16132 records). [2025-10-01T17:42:04.334319] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-01T17:42:04.776225] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-01T17:42:04.776366] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-01T17:42:04.776839] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-01T17:42:04.776907] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-01T17:42:04.778392] [DEBUG] [LOCAL ] BME: Trimmed 16132 records to 10934 (keeping 200 days of data) [2025-10-01T17:42:04.852035] [DEBUG] [LOCAL ] BME: Primary data saved (10934 records). [2025-10-01T17:42:04.852177] [INFO ] [MAIN ] BME: Full history saved. [2025-10-01T17:42:04.852295] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BME took 25.7s. Estimated remaining: 4h 44m 40s. Rate: 7.3 symbols/min [2025-10-01T17:42:04.903843] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-01T17:42:05.049145] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:42:05.049464] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-10-01T17:42:05.049794] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-10-01T17:42:05.050122] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-01T17:42:05.050285] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-01T17:42:05.050424] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-10-01T17:42:05.050482] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-01T17:42:05.206070] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T17:42:05.514010] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:42:05.702422] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-01T17:42:06.507578] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-01T17:42:06.532258] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T17:42:06.672405] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T17:42:07.302390] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-01T17:42:07.985773] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T17:42:08.102427] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-01T17:42:08.739340] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T17:42:08.902437] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-01T17:42:09.424231] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-01T17:42:09.427265] [INFO ] [REMOTE ] BMA: Full fetch complete (51458 records). [2025-10-01T17:42:09.427416] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-01T17:42:09.712239] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-01T17:42:09.896206] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-01T17:42:09.893357] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T17:42:09.901575] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-01T17:42:09.902878] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-01T17:42:09.902953] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-01T17:42:09.904231] [DEBUG] [LOCAL ] BMA: Trimmed 51458 records to 35306 (keeping 200 days of data) [2025-10-01T17:42:10.140514] [DEBUG] [LOCAL ] BMA: Primary data saved (35306 records). [2025-10-01T17:42:10.140702] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-01T17:42:10.140837] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BMA took 32.6s. Estimated remaining: 4h 44m 11s. Rate: 7.3 symbols/min [2025-10-01T17:42:10.332409] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:42:10.376623] [DEBUG] [LOCAL ] BMO: Loaded 41237 existing records from primary storage. [2025-10-01T17:42:10.376941] [INFO ] [MAIN ] BMO: Loaded 41237 existing records. [2025-10-01T17:42:10.507568] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-01T17:42:10.587705] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:42:10.587962] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-01T17:42:10.588015] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-01T17:42:10.588376] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-01T17:42:10.588439] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-01T17:42:11.038126] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:42:11.073042] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T17:42:11.074386] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T17:42:11.302436] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-01T17:42:11.964290] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T17:42:12.102430] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-01T17:42:12.902433] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-01T17:42:13.588823] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T17:42:13.702374] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-01T17:42:14.118540] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-01T17:42:14.502423] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-01T17:42:15.302375] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-01T17:42:15.355833] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T17:42:15.404766] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T17:42:15.914757] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T17:42:16.102397] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-01T17:42:16.902428] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-01T17:42:17.136243] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T17:42:17.702391] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-01T17:42:17.924221] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T17:42:18.502380] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-01T17:42:19.015594] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T17:42:19.302547] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-01T17:42:19.469109] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T17:42:20.102424] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-01T17:42:20.498879] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T17:42:20.902398] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-01T17:42:20.982797] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T17:42:21.702409] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-01T17:42:22.388285] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T17:42:22.502393] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-01T17:42:22.814214] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T17:42:22.932832] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T17:42:23.302428] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-01T17:42:24.102381] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-01T17:42:24.670861] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T17:42:24.866392] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-01T17:42:24.867486] [INFO ] [REMOTE ] BMI: Full fetch complete (32908 records). [2025-10-01T17:42:24.867571] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-01T17:42:24.907693] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-01T17:42:25.295810] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-01T17:42:25.295904] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-01T17:42:25.296408] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-01T17:42:25.296449] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-01T17:42:25.297472] [DEBUG] [LOCAL ] BMI: Trimmed 32908 records to 24194 (keeping 200 days of data) [2025-10-01T17:42:25.393961] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T17:42:25.461034] [DEBUG] [LOCAL ] BMI: Primary data saved (24194 records). [2025-10-01T17:42:25.461176] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-01T17:42:25.461263] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMI took 33.2s. Estimated remaining: 4h 44m 51s. Rate: 7.2 symbols/min [2025-10-01T17:42:25.650300] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:42:25.705895] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-01T17:42:25.708621] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-01T17:42:25.709077] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-01T17:42:25.902282] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:42:25.902499] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-01T17:42:25.902548] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-01T17:42:25.902866] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-01T17:42:25.902929] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-01T17:42:26.091463] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-01T17:42:26.326637] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:42:26.502392] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-01T17:42:27.302409] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-01T17:42:27.840701] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T17:42:28.102462] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-01T17:42:28.902474] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-01T17:42:29.064253] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-01T17:42:29.066747] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40941 records). [2025-10-01T17:42:29.066959] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-01T17:42:29.409004] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-01T17:42:29.592582] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-01T17:42:29.602887] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-01T17:42:29.603474] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-01T17:42:29.603560] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-01T17:42:29.606247] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T17:42:29.615677] [DEBUG] [LOCAL ] BMEZ: Trimmed 40941 records to 26275 (keeping 200 days of data) [2025-10-01T17:42:29.708788] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-01T17:42:29.789783] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26275 records). [2025-10-01T17:42:29.789923] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-01T17:42:29.790007] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMEZ took 45.7s. Estimated remaining: 4h 44m 16s. Rate: 7.3 symbols/min [2025-10-01T17:42:29.990928] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:42:30.042948] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-01T17:42:30.043291] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-01T17:42:30.260443] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:42:30.260744] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-01T17:42:30.260816] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-01T17:42:30.261061] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-01T17:42:30.261124] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-01T17:42:30.506305] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-01T17:42:30.678384] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:42:30.711371] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T17:42:31.040750] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-01T17:42:31.302405] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-01T17:42:32.102406] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-01T17:42:32.508352] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T17:42:32.900683] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T17:42:32.909773] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-01T17:42:33.702380] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-01T17:42:34.502380] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-01T17:42:34.595211] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T17:42:34.595941] [INFO ] [REMOTE ] BMN: Full fetch complete (3740 records). [2025-10-01T17:42:34.596013] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-01T17:42:35.004164] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-01T17:42:35.004377] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-01T17:42:35.004582] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-01T17:42:35.004760] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-01T17:42:35.005256] [DEBUG] [LOCAL ] BMN: Trimmed 3740 records to 2576 (keeping 200 days of data) [2025-10-01T17:42:35.023096] [DEBUG] [LOCAL ] BMN: Primary data saved (2576 records). [2025-10-01T17:42:35.023217] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-01T17:42:35.023395] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMN took 30.2s. Estimated remaining: 4h 43m 47s. Rate: 7.3 symbols/min [2025-10-01T17:42:35.162194] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-01T17:42:35.307613] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-01T17:42:35.311472] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:42:35.346736] [DEBUG] [LOCAL ] BNED: Loaded 29561 existing records from primary storage. [2025-10-01T17:42:35.347114] [INFO ] [MAIN ] BNED: Loaded 29561 existing records. [2025-10-01T17:42:35.577731] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:42:35.578241] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-01T17:42:35.578303] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-01T17:42:35.578744] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-01T17:42:35.578807] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-01T17:42:36.020040] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:42:36.045154] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T17:42:36.102383] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-01T17:42:36.736873] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T17:42:36.902391] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-01T17:42:37.702384] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-01T17:42:37.743957] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T17:42:38.502377] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-01T17:42:38.578204] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T17:42:39.259497] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T17:42:39.302396] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-01T17:42:40.102383] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-01T17:42:40.203626] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T17:42:40.902321] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-01T17:42:40.992579] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-01T17:42:40.994193] [INFO ] [REMOTE ] BMO: Full fetch complete (59670 records). [2025-10-01T17:42:40.994323] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-01T17:42:41.423504] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-01T17:42:41.423667] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-01T17:42:41.424429] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-01T17:42:41.424518] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-01T17:42:41.426886] [DEBUG] [LOCAL ] BMO: Trimmed 59670 records to 41214 (keeping 200 days of data) [2025-10-01T17:42:41.703915] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-01T17:42:41.712890] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T17:42:41.749913] [DEBUG] [LOCAL ] BMO: Primary data saved (41214 records). [2025-10-01T17:42:41.750068] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-01T17:42:41.750220] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 31.6s. Estimated remaining: 4h 43m 29s. Rate: 7.3 symbols/min [2025-10-01T17:42:41.944688] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:42:41.954968] [DEBUG] [LOCAL ] BNH: Loaded 5055 existing records from primary storage. [2025-10-01T17:42:41.955182] [INFO ] [MAIN ] BNH: Loaded 5055 existing records. [2025-10-01T17:42:42.163149] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:42:42.163495] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-01T17:42:42.163556] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-01T17:42:42.163902] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-01T17:42:42.163978] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-01T17:42:42.505776] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-01T17:42:42.616482] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:42:42.635158] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T17:42:42.679511] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T17:42:43.302382] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-01T17:42:44.102368] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-01T17:42:44.166934] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T17:42:44.902371] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-01T17:42:45.006393] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T17:42:45.209742] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T17:42:45.702407] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-01T17:42:46.502399] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-01T17:42:47.152428] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-01T17:42:47.279289] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-01T17:42:47.302381] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-01T17:42:47.393331] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T17:42:47.798386] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T17:42:48.102390] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-01T17:42:48.657034] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-01T17:42:48.902380] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-01T17:42:49.316029] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-01T17:42:49.702381] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-01T17:42:50.502376] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-01T17:42:51.302413] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-01T17:42:51.412372] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T17:42:51.927081] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T17:42:52.102392] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-01T17:42:52.534700] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-01T17:42:52.902375] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-01T17:42:53.036935] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T17:42:53.702363] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-01T17:42:54.502402] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-01T17:42:54.883439] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-01T17:42:54.973899] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T17:42:55.074303] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T17:42:55.302407] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-01T17:42:56.102433] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-01T17:42:56.616452] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-01T17:42:56.902389] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-01T17:42:57.271426] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T17:42:57.702442] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-01T17:42:58.381595] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T17:42:58.502353] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-01T17:42:58.626024] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T17:42:59.302442] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-01T17:43:00.102375] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-01T17:43:00.252472] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T17:43:00.902355] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-01T17:43:01.073153] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T17:43:01.482230] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-01T17:43:01.702420] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-01T17:43:02.364798] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-01T17:43:02.502402] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-01T17:43:03.010050] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-01T17:43:03.114104] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T17:43:03.302425] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-01T17:43:04.102428] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-01T17:43:04.600750] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T17:43:04.602491] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-01T17:43:04.602719] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-01T17:43:04.913053] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-01T17:43:05.074306] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-01T17:43:05.074411] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-01T17:43:05.075376] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-01T17:43:05.075445] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-01T17:43:05.079469] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-10-01T17:43:05.438767] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-01T17:43:05.438913] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-01T17:43:05.439011] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 40.0s. Estimated remaining: 4h 45m 3s. Rate: 7.2 symbols/min [2025-10-01T17:43:05.637398] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:43:05.633415] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T17:43:05.639517] [INFO ] [REMOTE ] BNH: Full fetch complete (6996 records). [2025-10-01T17:43:05.639687] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-01T17:43:05.703583] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-01T17:43:05.725356] [DEBUG] [LOCAL ] BNJ: Loaded 2607 existing records from primary storage. [2025-10-01T17:43:05.741444] [INFO ] [MAIN ] BNJ: Loaded 2607 existing records. [2025-10-01T17:43:06.056795] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:43:06.104499] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-01T17:43:06.131336] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-01T17:43:06.200071] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-01T17:43:06.200638] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-01T17:43:06.424456] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-01T17:43:06.453317] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-01T17:43:06.454956] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-01T17:43:06.467954] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-01T17:43:06.468199] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-01T17:43:06.490028] [DEBUG] [LOCAL ] BNH: Trimmed 6996 records to 5106 (keeping 200 days of data) [2025-10-01T17:43:06.540346] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-01T17:43:06.771954] [DEBUG] [LOCAL ] BNH: Primary data saved (5106 records). [2025-10-01T17:43:06.792694] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-01T17:43:06.800434] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNH took 25.1s. Estimated remaining: 4h 44m 9s. Rate: 7.2 symbols/min [2025-10-01T17:43:06.807000] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:43:07.002910] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:43:07.003161] [DEBUG] [LOCAL ] BNL: No existing data file found in primary storage. [2025-10-01T17:43:07.003232] [WARN ] [MAIN ] BNL: No existing data found, performing full refresh instead. [2025-10-01T17:43:07.003394] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-01T17:43:07.003468] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-01T17:43:07.003556] [DEBUG] [LOCAL ] BNL: No primary data file found to delete. [2025-10-01T17:43:07.003624] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-01T17:43:07.303607] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-01T17:43:07.443309] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:43:07.445246] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T17:43:08.102372] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-01T17:43:08.168100] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T17:43:08.195468] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T17:43:08.902409] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-01T17:43:09.702380] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-01T17:43:09.788768] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T17:43:09.967133] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T17:43:10.502428] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-01T17:43:11.302413] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-01T17:43:11.676467] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-01T17:43:11.868257] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T17:43:11.946468] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T17:43:11.948044] [INFO ] [REMOTE ] BN: Full fetch complete (76680 records). [2025-10-01T17:43:11.948148] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-01T17:43:12.111502] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-01T17:43:12.383119] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-01T17:43:12.383205] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-01T17:43:12.384022] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-01T17:43:12.384087] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-01T17:43:12.385517] [DEBUG] [LOCAL ] BN: Trimmed 76680 records to 52993 (keeping 200 days of data) [2025-10-01T17:43:12.744216] [DEBUG] [LOCAL ] BN: Primary data saved (52993 records). [2025-10-01T17:43:12.744365] [INFO ] [MAIN ] BN: Full history saved. [2025-10-01T17:43:12.744483] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 43.0s. Estimated remaining: 4h 43m 45s. Rate: 7.3 symbols/min [2025-10-01T17:43:12.910844] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-01T17:43:12.945763] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:43:12.945994] [DEBUG] [LOCAL ] BNS: No existing data file found in primary storage. [2025-10-01T17:43:12.946053] [WARN ] [MAIN ] BNS: No existing data found, performing full refresh instead. [2025-10-01T17:43:12.946192] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-01T17:43:12.946270] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-01T17:43:12.946317] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-10-01T17:43:12.946351] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-01T17:43:13.345098] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:43:13.369454] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T17:43:13.519997] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T17:43:13.702386] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-01T17:43:14.502370] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-01T17:43:15.302387] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-01T17:43:15.483927] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T17:43:15.535072] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T17:43:15.872663] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-01T17:43:16.102430] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-01T17:43:16.902452] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-01T17:43:17.702390] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-01T17:43:17.756571] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T17:43:18.469243] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:43:18.502341] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-01T17:43:18.703965] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T17:43:19.302407] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-01T17:43:19.761139] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-01T17:43:19.891065] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T17:43:20.102399] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-01T17:43:20.902351] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-01T17:43:21.370147] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T17:43:21.472598] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-01T17:43:21.473781] [INFO ] [REMOTE ] BNED: Full fetch complete (43945 records). [2025-10-01T17:43:21.473861] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-01T17:43:21.707567] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-01T17:43:21.885040] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-01T17:43:21.885131] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-01T17:43:21.885781] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-01T17:43:21.885846] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-01T17:43:21.886877] [DEBUG] [LOCAL ] BNED: Trimmed 43945 records to 29491 (keeping 200 days of data) [2025-10-01T17:43:22.070029] [DEBUG] [LOCAL ] BNED: Primary data saved (29491 records). [2025-10-01T17:43:22.070331] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-01T17:43:22.070444] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNED took 47.0s. Estimated remaining: 4h 43m 44s. Rate: 7.2 symbols/min [2025-10-01T17:43:22.157619] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T17:43:22.269225] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:43:22.275321] [DEBUG] [LOCAL ] BNT: Loaded 3373 existing records from primary storage. [2025-10-01T17:43:22.275516] [INFO ] [MAIN ] BNT: Loaded 3373 existing records. [2025-10-01T17:43:22.469964] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:43:22.470196] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-01T17:43:22.470244] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-01T17:43:22.470512] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-01T17:43:22.470587] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-01T17:43:22.507539] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-01T17:43:22.862350] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:43:23.302411] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-01T17:43:23.906061] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T17:43:24.003287] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T17:43:24.102382] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-01T17:43:24.591238] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T17:43:24.902388] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-01T17:43:25.349190] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-01T17:43:25.702417] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-01T17:43:26.109669] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-01T17:43:26.502387] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-01T17:43:26.836319] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-01T17:43:27.302386] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-01T17:43:28.102388] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-01T17:43:28.475332] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T17:43:28.665152] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T17:43:28.902389] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-01T17:43:29.702380] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-01T17:43:30.260759] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T17:43:30.502370] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-01T17:43:31.013387] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T17:43:31.302401] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-01T17:43:31.887585] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T17:43:32.102353] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-01T17:43:32.253863] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T17:43:32.703359] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T17:43:32.902400] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-01T17:43:33.292924] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-01T17:43:33.702391] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-01T17:43:34.502391] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-01T17:43:34.931276] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T17:43:35.302384] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-01T17:43:35.472147] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T17:43:35.873204] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-01T17:43:36.102385] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-01T17:43:36.601532] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T17:43:36.902378] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-01T17:43:37.494765] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T17:43:37.702522] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-01T17:43:38.476768] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-01T17:43:38.477759] [INFO ] [REMOTE ] BNT: Full fetch complete (4488 records). [2025-10-01T17:43:38.477883] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-01T17:43:38.507638] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-01T17:43:38.978026] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-01T17:43:38.978113] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-01T17:43:38.978260] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-01T17:43:38.978307] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-01T17:43:38.978760] [DEBUG] [LOCAL ] BNT: Trimmed 4488 records to 3373 (keeping 200 days of data) [2025-10-01T17:43:39.001782] [DEBUG] [LOCAL ] BNT: Primary data saved (3373 records). [2025-10-01T17:43:39.001891] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-01T17:43:39.001979] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNT took 16.9s. Estimated remaining: 4h 44m 32s. Rate: 7.2 symbols/min [2025-10-01T17:43:39.198776] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T17:43:39.198612] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:43:39.199936] [INFO ] [REMOTE ] BNJ: Full fetch complete (4379 records). [2025-10-01T17:43:39.200051] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-01T17:43:39.302733] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-01T17:43:39.356962] [DEBUG] [LOCAL ] BNY: Loaded 7119 existing records from primary storage. [2025-10-01T17:43:39.380501] [INFO ] [MAIN ] BNY: Loaded 7119 existing records. [2025-10-01T17:43:39.836695] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:43:39.864474] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-01T17:43:39.864730] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-01T17:43:39.864852] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-01T17:43:39.864935] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-01T17:43:39.865313] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-01T17:43:39.865257] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-01T17:43:39.865495] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-01T17:43:39.865441] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-01T17:43:39.914042] [DEBUG] [LOCAL ] BNJ: Trimmed 4379 records to 2630 (keeping 200 days of data) [2025-10-01T17:43:40.048055] [DEBUG] [LOCAL ] BNJ: Primary data saved (2630 records). [2025-10-01T17:43:40.072550] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-01T17:43:40.082449] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNJ took 34.6s. Estimated remaining: 4h 43m 37s. Rate: 7.2 symbols/min [2025-10-01T17:43:40.109589] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-01T17:43:40.487467] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:43:40.484282] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:43:40.507678] [DEBUG] [LOCAL ] BOC: Loaded 18278 existing records from primary storage. [2025-10-01T17:43:40.507951] [INFO ] [MAIN ] BOC: Loaded 18278 existing records. [2025-10-01T17:43:40.710766] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:43:40.711012] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-01T17:43:40.711064] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-01T17:43:40.711317] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-01T17:43:40.711389] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-01T17:43:40.903034] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-01T17:43:41.142835] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:43:41.269887] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-01T17:43:41.710465] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-01T17:43:41.746325] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T17:43:41.743048] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T17:43:42.502613] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-01T17:43:42.599321] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T17:43:42.962379] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-01T17:43:43.302402] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-01T17:43:44.102403] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-01T17:43:44.786375] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T17:43:44.841360] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T17:43:44.902355] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-01T17:43:45.702424] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-01T17:43:46.502383] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-01T17:43:47.022042] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-01T17:43:47.024385] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T17:43:47.029737] [INFO ] [REMOTE ] BNL: Full fetch complete (66888 records). [2025-10-01T17:43:47.036410] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-01T17:43:47.307486] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-01T17:43:47.288506] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T17:43:47.509404] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-01T17:43:47.509490] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-01T17:43:47.510240] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-01T17:43:47.510305] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-01T17:43:47.511730] [DEBUG] [LOCAL ] BNL: Trimmed 66888 records to 46913 (keeping 200 days of data) [2025-10-01T17:43:47.833901] [DEBUG] [LOCAL ] BNL: Primary data saved (46913 records). [2025-10-01T17:43:47.834051] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-01T17:43:47.834134] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNL took 41.0s. Estimated remaining: 4h 43m 25s. Rate: 7.2 symbols/min [2025-10-01T17:43:48.102413] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-01T17:43:48.876847] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T17:43:48.902385] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-01T17:43:49.090786] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T17:43:49.702433] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-01T17:43:49.870608] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T17:43:50.348875] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T17:43:50.502425] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-01T17:43:51.111356] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T17:43:51.302397] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-01T17:43:52.102430] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-01T17:43:52.370128] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T17:43:52.637504] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-01T17:43:52.902382] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-01T17:43:53.558676] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T17:43:53.702418] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-01T17:43:54.502372] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-01T17:43:55.306547] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-01T17:43:55.307350] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T17:43:55.374970] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T17:43:56.102367] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-01T17:43:56.478466] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T17:43:56.686055] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T17:43:56.902447] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-01T17:43:57.675065] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T17:43:57.702349] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-01T17:43:58.502388] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-01T17:43:58.702737] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T17:43:58.703501] [INFO ] [REMOTE ] BNY: Full fetch complete (10447 records). [2025-10-01T17:43:58.703571] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-01T17:43:59.118480] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-01T17:43:59.130078] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-01T17:43:59.130467] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T17:43:59.130797] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-01T17:43:59.134248] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-01T17:43:59.135727] [DEBUG] [LOCAL ] BNY: Trimmed 10447 records to 7113 (keeping 200 days of data) [2025-10-01T17:43:59.181784] [DEBUG] [LOCAL ] BNY: Primary data saved (7113 records). [2025-10-01T17:43:59.181921] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-01T17:43:59.182005] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNY took 20.2s. Estimated remaining: 4h 43m 36s. Rate: 7.2 symbols/min [2025-10-01T17:43:59.302428] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-01T17:43:59.978627] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T17:44:00.102407] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-01T17:44:00.902406] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-01T17:44:01.495210] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T17:44:01.702443] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-01T17:44:02.186462] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T17:44:02.502451] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-01T17:44:03.454025] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T17:44:03.458466] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-01T17:44:03.948069] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T17:44:03.949627] [INFO ] [REMOTE ] BNS: Full fetch complete (74227 records). [2025-10-01T17:44:03.949754] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-01T17:44:04.388025] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-01T17:44:04.388113] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-01T17:44:04.388997] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-01T17:44:04.389065] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-01T17:44:04.390764] [DEBUG] [LOCAL ] BNS: Trimmed 74227 records to 51486 (keeping 200 days of data) [2025-10-01T17:44:04.618227] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T17:44:04.620811] [INFO ] [REMOTE ] BOC: Full fetch complete (25778 records). [2025-10-01T17:44:04.621727] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-01T17:44:05.099548] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-01T17:44:05.099898] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-01T17:44:05.100711] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-01T17:44:05.101018] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-01T17:44:05.138761] [DEBUG] [LOCAL ] BOC: Trimmed 25778 records to 18283 (keeping 200 days of data) [2025-10-01T17:44:05.284400] [DEBUG] [LOCAL ] BOC: Primary data saved (18283 records). [2025-10-01T17:44:05.285884] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-01T17:44:05.286278] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BOC took 25.2s. Estimated remaining: 4h 43m 14s. Rate: 7.2 symbols/min [2025-10-01T17:44:05.288778] [DEBUG] [LOCAL ] BNS: Primary data saved (51486 records). [2025-10-01T17:44:05.288929] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-01T17:44:05.289008] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BNS took 52.5s. Estimated remaining: 4h 42m 13s. Rate: 7.3 symbols/min [2025-10-01T17:44:05.989492] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:06.063919] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:06.054351] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:06.082093] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-10-01T17:44:06.082807] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-10-01T17:44:06.121236] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-01T17:44:06.121408] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-01T17:44:06.121626] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-01T17:44:06.121092] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:06.121757] [DEBUG] [LOCAL ] BOH: No existing data file found in primary storage. [2025-10-01T17:44:06.121807] [WARN ] [MAIN ] BOH: No existing data found, performing full refresh instead. [2025-10-01T17:44:06.121940] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-01T17:44:06.122063] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-01T17:44:06.122004] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-01T17:44:06.145686] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-10-01T17:44:06.174871] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-01T17:44:06.431124] [DEBUG] [LOCAL ] BOND: Loaded 32125 existing records from primary storage. [2025-10-01T17:44:06.491922] [INFO ] [MAIN ] BOND: Loaded 32125 existing records. [2025-10-01T17:44:06.580428] [DEBUG] [LOCAL ] BOOT: Loaded 40594 existing records from primary storage. [2025-10-01T17:44:06.731849] [INFO ] [MAIN ] BOOT: Loaded 40594 existing records. [2025-10-01T17:44:07.305211] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:07.287688] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:44:07.336783] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-01T17:44:07.375549] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-01T17:44:07.434042] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:44:07.434107] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-01T17:44:07.460598] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:07.461120] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-01T17:44:07.460704] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-01T17:44:07.461238] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-01T17:44:07.462114] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-01T17:44:07.462056] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-01T17:44:07.485597] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-01T17:44:07.538309] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-01T17:44:08.243832] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:08.255552] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-01T17:44:08.290496] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:08.290907] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-01T17:44:08.623440] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T17:44:08.628413] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-01T17:44:08.929416] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T17:44:08.935573] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-01T17:44:09.724076] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T17:44:09.737093] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-01T17:44:09.746495] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T17:44:09.751373] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-01T17:44:09.894116] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T17:44:10.275152] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T17:44:10.502370] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-01T17:44:10.677408] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T17:44:10.735955] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T17:44:11.302409] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-01T17:44:11.323699] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T17:44:12.102434] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-01T17:44:12.902396] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-01T17:44:12.961793] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T17:44:13.429136] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T17:44:13.628329] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T17:44:13.702440] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-01T17:44:14.449105] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T17:44:14.502388] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-01T17:44:15.302381] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-01T17:44:15.750925] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T17:44:16.102385] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-01T17:44:16.622484] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T17:44:16.902400] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-01T17:44:17.087320] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T17:44:17.702430] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-01T17:44:18.502388] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-01T17:44:18.586002] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T17:44:18.704872] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T17:44:19.302409] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-01T17:44:19.623908] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T17:44:20.102471] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-01T17:44:20.788239] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T17:44:20.902367] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-01T17:44:21.000902] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T17:44:21.702423] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-01T17:44:21.893023] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T17:44:22.502392] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-01T17:44:23.173273] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T17:44:23.302396] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-01T17:44:23.340817] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T17:44:23.901585] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T17:44:24.102429] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-01T17:44:24.902367] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-01T17:44:25.119479] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-01T17:44:25.702362] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-01T17:44:26.121864] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-01T17:44:26.502388] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-01T17:44:26.734834] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T17:44:27.302389] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-01T17:44:27.422828] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T17:44:28.102381] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-01T17:44:28.765424] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T17:44:28.902379] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-01T17:44:29.341065] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T17:44:29.342243] [INFO ] [REMOTE ] BOE: Full fetch complete (26689 records). [2025-10-01T17:44:29.342328] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-01T17:44:29.707587] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-01T17:44:29.852333] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-01T17:44:29.852463] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-01T17:44:29.853566] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-01T17:44:29.853684] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-01T17:44:29.855056] [DEBUG] [LOCAL ] BOE: Trimmed 26689 records to 17689 (keeping 200 days of data) [2025-10-01T17:44:30.035318] [DEBUG] [LOCAL ] BOE: Primary data saved (17689 records). [2025-10-01T17:44:30.035555] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-01T17:44:30.035723] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOE took 24.7s. Estimated remaining: 4h 43m 50s. Rate: 7.2 symbols/min [2025-10-01T17:44:30.336828] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:30.437082] [DEBUG] [LOCAL ] BORR: Loaded 51149 existing records from primary storage. [2025-10-01T17:44:30.451791] [INFO ] [MAIN ] BORR: Loaded 51149 existing records. [2025-10-01T17:44:30.503148] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-01T17:44:30.516683] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T17:44:30.844851] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:44:30.845348] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-01T17:44:30.845479] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-01T17:44:30.846382] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-01T17:44:30.847160] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-01T17:44:31.012789] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T17:44:31.308589] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-01T17:44:31.315585] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:31.621740] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T17:44:32.102381] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-01T17:44:32.647250] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T17:44:32.902364] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-01T17:44:33.045764] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T17:44:33.702393] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-01T17:44:33.977726] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T17:44:34.502376] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-01T17:44:35.302379] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-01T17:44:35.524184] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T17:44:35.563357] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T17:44:36.102375] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-01T17:44:36.624739] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T17:44:36.902413] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-01T17:44:37.702369] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-01T17:44:37.813059] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T17:44:37.814377] [INFO ] [REMOTE ] BOND: Full fetch complete (46458 records). [2025-10-01T17:44:37.814469] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-01T17:44:37.941167] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T17:44:38.267028] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-01T17:44:38.267119] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-01T17:44:38.267774] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-01T17:44:38.267871] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-01T17:44:38.268935] [DEBUG] [LOCAL ] BOND: Trimmed 46458 records to 32203 (keeping 200 days of data) [2025-10-01T17:44:38.478357] [DEBUG] [LOCAL ] BOND: Primary data saved (32203 records). [2025-10-01T17:44:38.478501] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-01T17:44:38.480450] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOND took 33.2s. Estimated remaining: 4h 43m 42s. Rate: 7.2 symbols/min [2025-10-01T17:44:38.515245] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-01T17:44:38.675348] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:38.700499] [DEBUG] [LOCAL ] BOW: Loaded 23531 existing records from primary storage. [2025-10-01T17:44:38.700793] [INFO ] [MAIN ] BOW: Loaded 23531 existing records. [2025-10-01T17:44:38.900625] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:44:38.900904] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-01T17:44:38.900956] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-01T17:44:38.901232] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-01T17:44:38.901294] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-01T17:44:39.304985] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-01T17:44:39.348837] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:39.508012] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T17:44:39.552945] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T17:44:40.102406] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-01T17:44:40.902440] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-01T17:44:41.040770] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-01T17:44:41.041958] [INFO ] [REMOTE ] BOH: Full fetch complete (44834 records). [2025-10-01T17:44:41.042061] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-01T17:44:41.268083] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T17:44:41.491485] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-01T17:44:41.491577] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-01T17:44:41.492303] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-01T17:44:41.492369] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-01T17:44:41.493497] [DEBUG] [LOCAL ] BOH: Trimmed 44834 records to 30758 (keeping 200 days of data) [2025-10-01T17:44:41.696889] [DEBUG] [LOCAL ] BOH: Primary data saved (30758 records). [2025-10-01T17:44:41.697034] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-01T17:44:41.697138] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOH took 36.4s. Estimated remaining: 4h 43m 2s. Rate: 7.2 symbols/min [2025-10-01T17:44:41.708449] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-01T17:44:41.901292] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:41.948184] [DEBUG] [LOCAL ] BOX: Loaded 50231 existing records from primary storage. [2025-10-01T17:44:41.948555] [INFO ] [MAIN ] BOX: Loaded 50231 existing records. [2025-10-01T17:44:42.153484] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:44:42.153758] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-01T17:44:42.153813] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-01T17:44:42.154075] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-01T17:44:42.154147] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-01T17:44:42.524626] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-01T17:44:42.584048] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T17:44:42.587913] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:42.666221] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T17:44:43.302429] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-01T17:44:44.102392] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-01T17:44:44.450865] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T17:44:44.452403] [INFO ] [REMOTE ] BOOT: Full fetch complete (60223 records). [2025-10-01T17:44:44.452534] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-01T17:44:44.909329] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-01T17:44:44.905326] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-01T17:44:44.909749] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-01T17:44:44.912202] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-01T17:44:44.912589] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-01T17:44:44.923344] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T17:44:44.927896] [DEBUG] [LOCAL ] BOOT: Trimmed 60223 records to 40532 (keeping 200 days of data) [2025-10-01T17:44:44.962273] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T17:44:45.232084] [DEBUG] [LOCAL ] BOOT: Primary data saved (40532 records). [2025-10-01T17:44:45.232219] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-01T17:44:45.232335] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 39.9s. Estimated remaining: 4h 42m 23s. Rate: 7.2 symbols/min [2025-10-01T17:44:45.423263] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:44:45.478268] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-10-01T17:44:45.478599] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-10-01T17:44:45.685109] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:44:45.685319] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-01T17:44:45.685366] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-01T17:44:45.685634] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-01T17:44:45.685724] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-01T17:44:45.709015] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-01T17:44:46.102074] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:44:46.502377] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-01T17:44:46.737534] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T17:44:47.302439] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-01T17:44:47.335821] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T17:44:48.102473] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-01T17:44:48.361402] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T17:44:48.902393] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-01T17:44:49.069718] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T17:44:49.558598] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T17:44:49.702374] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-01T17:44:49.924287] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T17:44:50.502407] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-01T17:44:51.254952] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T17:44:51.302421] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-01T17:44:52.102382] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-01T17:44:52.231686] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T17:44:52.292208] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T17:44:52.902427] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-01T17:44:53.702391] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-01T17:44:53.780612] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T17:44:53.838229] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T17:44:54.502438] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-01T17:44:55.302467] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-01T17:44:55.554820] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T17:44:55.681604] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T17:44:56.102407] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-01T17:44:56.902407] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-01T17:44:57.135100] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T17:44:57.136296] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T17:44:57.702393] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-01T17:44:58.502428] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-01T17:44:58.941599] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T17:44:58.996928] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T17:44:59.302423] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-01T17:44:59.885053] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T17:45:00.017232] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T17:45:00.102432] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-01T17:45:00.779636] [DEBUG] [REMOTE ] BOW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:45:00.780065] [WARN ] [REMOTE ] BOW: No data returned for month 2025-10 [2025-10-01T17:45:00.780188] [FATAL] [REMOTE ] BOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:45:00.780318] [FATAL] [MAIN ] BOW: Failed to fetch primary data. [2025-10-01T17:45:00.780406] [WARN ] [MAIN ] BOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:45:00.780503] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-01T17:45:00.780603] [DEBUG] [LOCAL ] BOW: No primary data file found to delete. [2025-10-01T17:45:00.780684] [INFO ] [LOCAL ] BOW: Starting deletion of derivative data. [2025-10-01T17:45:00.781231] [DEBUG] [LOCAL ] BOW: Deleted derivative data file. [2025-10-01T17:45:00.781361] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 22.3s. Estimated remaining: 4h 43m 1s. Rate: 7.2 symbols/min [2025-10-01T17:45:00.907474] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-01T17:45:00.978532] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:45:01.025020] [DEBUG] [LOCAL ] BR: Loaded 34609 existing records from primary storage. [2025-10-01T17:45:01.025334] [INFO ] [MAIN ] BR: Loaded 34609 existing records. [2025-10-01T17:45:01.268260] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:45:01.268499] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-01T17:45:01.268573] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-01T17:45:01.268870] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-01T17:45:01.268933] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-01T17:45:01.730000] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:45:01.720210] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-01T17:45:02.502438] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-01T17:45:03.302366] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-01T17:45:03.411283] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T17:45:03.524523] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-01T17:45:03.818031] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T17:45:04.102446] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-01T17:45:04.902359] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-01T17:45:05.143083] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T17:45:05.217012] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T17:45:05.702422] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-01T17:45:06.502383] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-01T17:45:06.542191] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T17:45:06.680326] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T17:45:07.302404] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-01T17:45:08.102389] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-01T17:45:08.394579] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T17:45:08.902422] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-01T17:45:09.035423] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T17:45:09.572838] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T17:45:09.702390] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-01T17:45:10.502388] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-01T17:45:10.673918] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T17:45:10.965964] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T17:45:11.302399] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-01T17:45:12.102403] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-01T17:45:12.902410] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-01T17:45:13.032080] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-01T17:45:13.034090] [INFO ] [REMOTE ] BORR: Full fetch complete (74655 records). [2025-10-01T17:45:13.034224] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-01T17:45:13.339027] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T17:45:13.558481] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-01T17:45:13.558578] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-01T17:45:13.559457] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-01T17:45:13.559534] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-01T17:45:13.561297] [DEBUG] [LOCAL ] BORR: Trimmed 74655 records to 51122 (keeping 200 days of data) [2025-10-01T17:45:13.729736] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-01T17:45:13.871539] [DEBUG] [LOCAL ] BORR: Primary data saved (51122 records). [2025-10-01T17:45:13.871706] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-01T17:45:13.871800] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 43.8s. Estimated remaining: 4h 43m 23s. Rate: 7.2 symbols/min [2025-10-01T17:45:14.053687] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:45:14.104415] [DEBUG] [LOCAL ] BRBR: Loaded 51262 existing records from primary storage. [2025-10-01T17:45:14.104786] [INFO ] [MAIN ] BRBR: Loaded 51262 existing records. [2025-10-01T17:45:14.312133] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:45:14.313070] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-01T17:45:14.313368] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-01T17:45:14.330364] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-01T17:45:14.346357] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T17:45:14.346505] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-01T17:45:14.502900] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-01T17:45:14.777250] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-01T17:45:14.833823] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:45:15.161854] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T17:45:15.302422] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-01T17:45:15.596945] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T17:45:16.102415] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-01T17:45:16.902387] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-01T17:45:17.426009] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T17:45:17.530995] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-01T17:45:17.702396] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-01T17:45:17.991258] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T17:45:18.502380] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-01T17:45:18.800001] [DEBUG] [REMOTE ] BOX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:45:18.800287] [WARN ] [REMOTE ] BOX: No data returned for month 2025-10 [2025-10-01T17:45:18.800398] [FATAL] [REMOTE ] BOX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:45:18.800531] [FATAL] [MAIN ] BOX: Failed to fetch primary data. [2025-10-01T17:45:18.800612] [WARN ] [MAIN ] BOX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:45:18.800723] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-01T17:45:18.800798] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-01T17:45:18.800843] [INFO ] [LOCAL ] BOX: Starting deletion of derivative data. [2025-10-01T17:45:18.801462] [DEBUG] [LOCAL ] BOX: Deleted derivative data file. [2025-10-01T17:45:18.801570] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 37.1s. Estimated remaining: 4h 42m 53s. Rate: 7.2 symbols/min [2025-10-01T17:45:18.991493] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:45:19.012782] [DEBUG] [LOCAL ] BRC: Loaded 19102 existing records from primary storage. [2025-10-01T17:45:19.013070] [INFO ] [MAIN ] BRC: Loaded 19102 existing records. [2025-10-01T17:45:19.208249] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:45:19.208484] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-01T17:45:19.208538] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-01T17:45:19.208769] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-01T17:45:19.208835] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-01T17:45:19.307485] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-01T17:45:19.618962] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:45:20.102415] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-01T17:45:20.546020] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T17:45:20.710382] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-01T17:45:20.902403] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-01T17:45:21.007141] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T17:45:21.702443] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-01T17:45:21.977214] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T17:45:22.502497] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-01T17:45:23.302423] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-01T17:45:23.769872] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T17:45:23.901275] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-01T17:45:24.102377] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-01T17:45:24.139985] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T17:45:24.902380] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-01T17:45:25.702387] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-01T17:45:26.328468] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-01T17:45:26.406190] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T17:45:26.502408] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-01T17:45:27.302411] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-01T17:45:27.590905] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T17:45:27.592633] [INFO ] [REMOTE ] BR: Full fetch complete (49247 records). [2025-10-01T17:45:27.592825] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-01T17:45:28.068514] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-01T17:45:28.068782] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-01T17:45:28.069536] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-01T17:45:28.069785] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-01T17:45:28.071426] [DEBUG] [LOCAL ] BR: Trimmed 49247 records to 34667 (keeping 200 days of data) [2025-10-01T17:45:28.143813] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-01T17:45:28.206622] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T17:45:28.367163] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T17:45:28.369394] [DEBUG] [LOCAL ] BR: Primary data saved (34667 records). [2025-10-01T17:45:28.374094] [INFO ] [MAIN ] BR: Full history saved. [2025-10-01T17:45:28.375886] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BR took 27.6s. Estimated remaining: 4h 42m 53s. Rate: 7.2 symbols/min [2025-10-01T17:45:28.556059] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:45:28.603212] [DEBUG] [LOCAL ] BRCC: Loaded 40248 existing records from primary storage. [2025-10-01T17:45:28.603553] [INFO ] [MAIN ] BRCC: Loaded 40248 existing records. [2025-10-01T17:45:28.809420] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:45:28.809716] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-01T17:45:28.809781] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-01T17:45:28.810024] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-01T17:45:28.810098] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-01T17:45:28.907569] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-01T17:45:29.264482] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:45:29.702415] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-01T17:45:30.078105] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T17:45:30.502390] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-01T17:45:31.230239] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (3.09 seconds). [2025-10-01T17:45:31.234715] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-10-01T17:45:31.234909] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-01T17:45:31.303095] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-01T17:45:31.721071] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-01T17:45:31.721429] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-01T17:45:31.737899] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-01T17:45:31.738897] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-01T17:45:31.740954] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T17:45:31.768732] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 53711 (keeping 200 days of data) [2025-10-01T17:45:31.784150] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-01T17:45:32.115302] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-01T17:45:32.146503] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-10-01T17:45:32.146769] [INFO ] [MAIN ] BP: Full history saved. [2025-10-01T17:45:32.146913] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BP took 46.9s. Estimated remaining: 4h 42m 16s. Rate: 7.2 symbols/min [2025-10-01T17:45:32.331364] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:45:32.393726] [DEBUG] [LOCAL ] BRO: Loaded 51886 existing records from primary storage. [2025-10-01T17:45:32.394256] [INFO ] [MAIN ] BRO: Loaded 51886 existing records. [2025-10-01T17:45:32.585020] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:45:32.585300] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-01T17:45:32.585351] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-01T17:45:32.585801] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-01T17:45:32.585862] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-01T17:45:32.903381] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-01T17:45:32.963188] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:45:33.002583] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T17:45:33.059340] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T17:45:33.702411] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-01T17:45:34.502396] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-01T17:45:34.784329] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T17:45:35.268032] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T17:45:35.302396] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-01T17:45:35.900206] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T17:45:36.102474] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-01T17:45:36.902437] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-01T17:45:37.105004] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T17:45:37.163880] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T17:45:37.702490] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-01T17:45:38.502411] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-01T17:45:38.721604] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T17:45:39.159162] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T17:45:39.302393] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-01T17:45:39.894116] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T17:45:40.102388] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-01T17:45:40.902448] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-01T17:45:41.004069] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T17:45:41.681700] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T17:45:41.702381] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-01T17:45:41.737857] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T17:45:42.502404] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-01T17:45:43.302388] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-01T17:45:43.456213] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T17:45:43.866734] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T17:45:44.102421] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-01T17:45:44.902444] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-01T17:45:45.134120] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T17:45:45.682314] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T17:45:45.702345] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-01T17:45:46.330492] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T17:45:46.502403] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-01T17:45:47.302361] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-01T17:45:47.745709] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T17:45:48.052442] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T17:45:48.072999] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T17:45:48.102387] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-01T17:45:48.902397] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-01T17:45:49.702398] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-01T17:45:49.752117] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T17:45:49.881096] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T17:45:50.502399] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-01T17:45:51.302372] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-01T17:45:51.388794] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T17:45:51.863495] [DEBUG] [REMOTE ] BRBR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:45:51.863852] [WARN ] [REMOTE ] BRBR: No data returned for month 2025-10 [2025-10-01T17:45:51.863948] [FATAL] [REMOTE ] BRBR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:45:51.864031] [FATAL] [MAIN ] BRBR: Failed to fetch primary data. [2025-10-01T17:45:51.864099] [WARN ] [MAIN ] BRBR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:45:51.864173] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-01T17:45:51.864238] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-01T17:45:51.864277] [INFO ] [LOCAL ] BRBR: Starting deletion of derivative data. [2025-10-01T17:45:51.864819] [DEBUG] [LOCAL ] BRBR: Deleted derivative data file. [2025-10-01T17:45:51.864945] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 38.0s. Estimated remaining: 4h 43m 19s. Rate: 7.2 symbols/min [2025-10-01T17:45:52.077151] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:45:52.107941] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-01T17:45:52.135786] [DEBUG] [LOCAL ] BROS: Loaded 53289 existing records from primary storage. [2025-10-01T17:45:52.136282] [INFO ] [MAIN ] BROS: Loaded 53289 existing records. [2025-10-01T17:45:52.350122] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:45:52.350342] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-01T17:45:52.350435] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-01T17:45:52.350818] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-01T17:45:52.350882] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-01T17:45:52.752051] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:45:52.814922] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T17:45:52.816725] [INFO ] [REMOTE ] BRC: Full fetch complete (29040 records). [2025-10-01T17:45:52.816875] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-01T17:45:52.912213] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-01T17:45:53.263127] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-01T17:45:53.263226] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-01T17:45:53.263808] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-01T17:45:53.263881] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-01T17:45:53.264886] [DEBUG] [LOCAL ] BRC: Trimmed 29040 records to 19040 (keeping 200 days of data) [2025-10-01T17:45:53.397544] [DEBUG] [LOCAL ] BRC: Primary data saved (19040 records). [2025-10-01T17:45:53.397811] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-01T17:45:53.397921] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRC took 34.6s. Estimated remaining: 4h 42m 29s. Rate: 7.2 symbols/min [2025-10-01T17:45:53.594521] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:45:53.594924] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-01T17:45:53.594992] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-01T17:45:53.595196] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-01T17:45:53.595297] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-01T17:45:53.595407] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-01T17:45:53.595564] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-01T17:45:53.707261] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-01T17:45:53.966910] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T17:45:54.052898] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:45:54.502406] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-01T17:45:54.760186] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T17:45:54.903385] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T17:45:55.302394] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-01T17:45:56.102352] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-01T17:45:56.188371] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T17:45:56.684078] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T17:45:56.902395] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-01T17:45:57.651805] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T17:45:57.702474] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-01T17:45:58.502346] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-01T17:45:58.715480] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T17:45:59.302362] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-01T17:45:59.657844] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-01T17:46:00.102426] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-01T17:46:00.458283] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-01T17:46:00.459661] [INFO ] [REMOTE ] BRCC: Full fetch complete (57743 records). [2025-10-01T17:46:00.459762] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-01T17:46:00.907826] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-01T17:46:00.925460] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-01T17:46:00.925682] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-01T17:46:00.927013] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-01T17:46:00.927290] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-01T17:46:00.929398] [DEBUG] [LOCAL ] BRCC: Trimmed 57743 records to 40209 (keeping 200 days of data) [2025-10-01T17:46:00.966222] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T17:46:01.156005] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:46:01.156860] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-01T17:46:01.187101] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:46:01.188271] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-01T17:46:01.189838] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:46:01.190537] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-01T17:46:01.191464] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-01T17:46:01.191888] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-01T17:46:01.192593] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-01T17:46:01.193915] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRSL took 7.8s. Estimated remaining: 4h 42m 17s. Rate: 7.2 symbols/min [2025-10-01T17:46:01.438140] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:46:01.478867] [DEBUG] [LOCAL ] BRCC: Primary data saved (40209 records). [2025-10-01T17:46:01.479030] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-01T17:46:01.479992] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRCC took 33.1s. Estimated remaining: 4h 41m 20s. Rate: 7.2 symbols/min [2025-10-01T17:46:01.563268] [DEBUG] [LOCAL ] BRSP: Loaded 36799 existing records from primary storage. [2025-10-01T17:46:01.609529] [INFO ] [MAIN ] BRSP: Loaded 36799 existing records. [2025-10-01T17:46:01.712944] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-01T17:46:01.832294] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:46:01.942623] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:46:01.943483] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-01T17:46:01.946723] [DEBUG] [LOCAL ] BRT: Loaded 4982 existing records from primary storage. [2025-10-01T17:46:01.946982] [INFO ] [MAIN ] BRT: Loaded 4982 existing records. [2025-10-01T17:46:01.947044] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-01T17:46:01.997923] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-01T17:46:02.027249] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-01T17:46:02.289007] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:46:02.313740] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-01T17:46:02.319617] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-01T17:46:02.330558] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-01T17:46:02.363826] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-01T17:46:02.941375] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:46:02.971720] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-01T17:46:02.987718] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-01T17:46:03.159850] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:46:03.302416] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-01T17:46:04.047777] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T17:46:04.051510] [INFO ] [REMOTE ] BRO: Full fetch complete (74224 records). [2025-10-01T17:46:04.051742] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-01T17:46:04.103954] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-01T17:46:04.166093] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T17:46:04.554460] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-01T17:46:04.555166] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-01T17:46:04.556071] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T17:46:04.557011] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-01T17:46:04.565105] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-01T17:46:04.567185] [DEBUG] [LOCAL ] BRO: Trimmed 74224 records to 51893 (keeping 200 days of data) [2025-10-01T17:46:04.902778] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-01T17:46:04.925730] [DEBUG] [LOCAL ] BRO: Primary data saved (51893 records). [2025-10-01T17:46:04.926077] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-01T17:46:04.926189] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 32.8s. Estimated remaining: 4h 40m 42s. Rate: 7.3 symbols/min [2025-10-01T17:46:05.129562] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:46:05.150201] [DEBUG] [LOCAL ] BRW: Loaded 19912 existing records from primary storage. [2025-10-01T17:46:05.150502] [INFO ] [MAIN ] BRW: Loaded 19912 existing records. [2025-10-01T17:46:05.352143] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:46:05.352352] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-01T17:46:05.352402] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-01T17:46:05.352673] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-01T17:46:05.352736] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-01T17:46:05.665930] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T17:46:05.707572] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-01T17:46:05.793517] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:46:06.195171] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T17:46:06.502427] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-01T17:46:06.745339] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T17:46:07.302398] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-01T17:46:08.102420] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-01T17:46:08.333822] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T17:46:08.755046] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T17:46:08.902398] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-01T17:46:09.253078] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T17:46:09.271837] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-01T17:46:09.702397] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-01T17:46:10.502383] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-01T17:46:10.777401] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T17:46:11.302460] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-01T17:46:11.805916] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T17:46:12.102417] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-01T17:46:12.413420] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T17:46:12.500694] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-01T17:46:12.902381] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-01T17:46:13.702386] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-01T17:46:13.808794] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T17:46:14.407141] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T17:46:14.502455] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-01T17:46:15.302385] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-01T17:46:16.087170] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T17:46:16.102347] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-01T17:46:16.902382] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-01T17:46:16.991796] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T17:46:17.528727] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-01T17:46:17.702393] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-01T17:46:17.868979] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T17:46:18.502394] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-01T17:46:18.973792] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T17:46:19.302351] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-01T17:46:19.843048] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-01T17:46:20.102385] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-01T17:46:20.812006] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T17:46:20.902392] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-01T17:46:21.318462] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-01T17:46:21.702452] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-01T17:46:22.210193] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-01T17:46:22.502376] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-01T17:46:22.889516] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T17:46:23.302374] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-01T17:46:24.096227] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T17:46:24.102326] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-01T17:46:24.902375] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-01T17:46:25.049977] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-01T17:46:25.051571] [INFO ] [REMOTE ] BROS: Full fetch complete (77033 records). [2025-10-01T17:46:25.051730] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-01T17:46:25.204199] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T17:46:25.539186] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-01T17:46:25.539275] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-01T17:46:25.540088] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-01T17:46:25.540159] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-01T17:46:25.541767] [DEBUG] [LOCAL ] BROS: Trimmed 77033 records to 53292 (keeping 200 days of data) [2025-10-01T17:46:25.731502] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-01T17:46:25.904169] [DEBUG] [LOCAL ] BROS: Primary data saved (53292 records). [2025-10-01T17:46:25.904588] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-01T17:46:25.904727] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BROS took 34.0s. Estimated remaining: 4h 41m 51s. Rate: 7.2 symbols/min [2025-10-01T17:46:26.126425] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:46:26.182060] [DEBUG] [LOCAL ] BRX: Loaded 51710 existing records from primary storage. [2025-10-01T17:46:26.182402] [INFO ] [MAIN ] BRX: Loaded 51710 existing records. [2025-10-01T17:46:26.430785] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:46:26.438876] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-01T17:46:26.452216] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-01T17:46:26.453289] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-01T17:46:26.454905] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T17:46:26.455066] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-01T17:46:26.510067] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-01T17:46:26.831199] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T17:46:26.923062] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:46:27.285491] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T17:46:27.302340] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-01T17:46:27.898055] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T17:46:28.102430] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-01T17:46:28.902403] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-01T17:46:29.702388] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-01T17:46:29.720521] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-01T17:46:29.721891] [INFO ] [REMOTE ] BRSP: Full fetch complete (54224 records). [2025-10-01T17:46:29.721994] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-01T17:46:30.157848] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-01T17:46:30.157945] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-01T17:46:30.158701] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-01T17:46:30.158792] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-01T17:46:30.160101] [DEBUG] [LOCAL ] BRSP: Trimmed 54224 records to 36857 (keeping 200 days of data) [2025-10-01T17:46:30.392946] [DEBUG] [LOCAL ] BRSP: Primary data saved (36857 records). [2025-10-01T17:46:30.393136] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-01T17:46:30.393265] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRSP took 29.2s. Estimated remaining: 4h 41m 19s. Rate: 7.2 symbols/min [2025-10-01T17:46:30.503702] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-01T17:46:30.603083] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:46:30.645530] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T17:46:30.646412] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T17:46:30.689207] [DEBUG] [LOCAL ] BSAC: Loaded 32974 existing records from primary storage. [2025-10-01T17:46:30.689519] [INFO ] [MAIN ] BSAC: Loaded 32974 existing records. [2025-10-01T17:46:30.896273] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:46:30.896525] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-01T17:46:30.896604] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-01T17:46:30.896926] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-01T17:46:30.896986] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-01T17:46:31.037243] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T17:46:31.305816] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-01T17:46:31.331700] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:46:32.011575] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T17:46:32.012523] [INFO ] [REMOTE ] BRT: Full fetch complete (6791 records). [2025-10-01T17:46:32.012612] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-01T17:46:32.107489] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-01T17:46:32.459200] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-01T17:46:32.459378] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-01T17:46:32.459599] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-01T17:46:32.459666] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-01T17:46:32.460142] [DEBUG] [LOCAL ] BRT: Trimmed 6791 records to 4950 (keeping 200 days of data) [2025-10-01T17:46:32.498458] [DEBUG] [LOCAL ] BRT: Primary data saved (4950 records). [2025-10-01T17:46:32.498609] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-01T17:46:32.498759] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRT took 31.0s. Estimated remaining: 4h 40m 34s. Rate: 7.2 symbols/min [2025-10-01T17:46:32.688336] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:46:32.733891] [DEBUG] [LOCAL ] BSBR: Loaded 35311 existing records from primary storage. [2025-10-01T17:46:32.734226] [INFO ] [MAIN ] BSBR: Loaded 35311 existing records. [2025-10-01T17:46:32.913879] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-01T17:46:32.948057] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:46:32.949044] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-01T17:46:32.949105] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-01T17:46:32.949420] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-01T17:46:32.949482] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-01T17:46:33.320494] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T17:46:33.402631] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:46:33.702447] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-01T17:46:34.503260] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T17:46:34.503344] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-01T17:46:34.805056] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T17:46:35.302401] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-01T17:46:35.717562] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T17:46:36.102389] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-01T17:46:36.553241] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T17:46:36.902393] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-01T17:46:36.928840] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T17:46:37.702381] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-01T17:46:38.321771] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:46:38.502431] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-01T17:46:38.960764] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T17:46:39.302422] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-01T17:46:39.732605] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T17:46:40.102382] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-01T17:46:40.902399] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-01T17:46:41.137254] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T17:46:41.477872] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T17:46:41.582048] [DEBUG] [REMOTE ] BRW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:46:41.582413] [WARN ] [REMOTE ] BRW: No data returned for month 2025-10 [2025-10-01T17:46:41.582500] [FATAL] [REMOTE ] BRW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:46:41.582585] [FATAL] [MAIN ] BRW: Failed to fetch primary data. [2025-10-01T17:46:41.582675] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:46:41.582753] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-01T17:46:41.582819] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-01T17:46:41.582856] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-01T17:46:41.583386] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-01T17:46:41.583478] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 36.7s. Estimated remaining: 4h 40m 30s. Rate: 7.2 symbols/min [2025-10-01T17:46:41.707510] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-01T17:46:41.777637] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:46:41.789101] [DEBUG] [LOCAL ] BSL: Loaded 8187 existing records from primary storage. [2025-10-01T17:46:41.789325] [INFO ] [MAIN ] BSL: Loaded 8187 existing records. [2025-10-01T17:46:42.009196] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:46:42.009441] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-01T17:46:42.009542] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-01T17:46:42.009846] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-01T17:46:42.009907] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-01T17:46:42.422583] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:46:42.502351] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-01T17:46:43.302424] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-01T17:46:43.333087] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T17:46:43.372624] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T17:46:44.102421] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-01T17:46:44.454186] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T17:46:44.604686] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T17:46:44.902395] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-01T17:46:45.702403] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-01T17:46:46.157497] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T17:46:46.502426] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-01T17:46:47.198581] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T17:46:47.302403] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-01T17:46:47.575807] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T17:46:48.102402] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-01T17:46:48.799497] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T17:46:48.888815] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T17:46:48.902376] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-01T17:46:49.702411] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-01T17:46:49.817611] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T17:46:50.502400] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-01T17:46:50.657323] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T17:46:51.302405] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-01T17:46:51.827700] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T17:46:52.102431] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-01T17:46:52.902413] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-01T17:46:53.173374] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T17:46:53.306017] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-01T17:46:53.702433] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-01T17:46:54.314942] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T17:46:54.502417] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-01T17:46:55.051962] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T17:46:55.302403] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-01T17:46:55.789087] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T17:46:56.102411] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-01T17:46:56.287149] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T17:46:56.902451] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-01T17:46:57.451408] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T17:46:57.702427] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-01T17:46:58.199438] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-01T17:46:58.502367] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-01T17:46:58.702976] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T17:46:58.923330] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-01T17:46:59.302428] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-01T17:47:00.102440] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-01T17:47:00.410725] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T17:47:00.902385] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-01T17:47:01.469823] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-01T17:47:01.559410] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T17:47:01.702408] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-01T17:47:02.287469] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T17:47:02.502443] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-01T17:47:03.112333] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T17:47:03.302397] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-01T17:47:04.102445] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-01T17:47:04.179299] [DEBUG] [REMOTE ] BSAC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:47:04.180292] [WARN ] [REMOTE ] BSAC: No data returned for month 2025-10 [2025-10-01T17:47:04.180457] [FATAL] [REMOTE ] BSAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:47:04.180637] [FATAL] [MAIN ] BSAC: Failed to fetch primary data. [2025-10-01T17:47:04.180763] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:47:04.180875] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-01T17:47:04.181032] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-01T17:47:04.181098] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-10-01T17:47:04.181535] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-10-01T17:47:04.181743] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSAC took 33.8s. Estimated remaining: 4h 41m 48s. Rate: 7.2 symbols/min [2025-10-01T17:47:04.373902] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:47:04.421984] [DEBUG] [LOCAL ] BSM: Loaded 32206 existing records from primary storage. [2025-10-01T17:47:04.422349] [INFO ] [MAIN ] BSM: Loaded 32206 existing records. [2025-10-01T17:47:04.676846] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:47:04.677068] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-01T17:47:04.677117] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-01T17:47:04.677386] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-01T17:47:04.677457] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-01T17:47:04.907541] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-01T17:47:04.958179] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T17:47:05.118086] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:47:05.702384] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-01T17:47:06.141219] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T17:47:06.502407] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-01T17:47:07.308290] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-01T17:47:07.322822] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T17:47:07.612762] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T17:47:07.613730] [INFO ] [REMOTE ] BSL: Full fetch complete (12736 records). [2025-10-01T17:47:07.613809] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-01T17:47:08.019043] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-01T17:47:08.019167] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-01T17:47:08.019545] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-01T17:47:08.019616] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-01T17:47:08.020365] [DEBUG] [LOCAL ] BSL: Trimmed 12736 records to 8243 (keeping 200 days of data) [2025-10-01T17:47:08.076098] [DEBUG] [LOCAL ] BSL: Primary data saved (8243 records). [2025-10-01T17:47:08.076241] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-01T17:47:08.076327] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSL took 26.5s. Estimated remaining: 4h 41m 13s. Rate: 7.2 symbols/min [2025-10-01T17:47:08.108350] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-01T17:47:08.270779] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:47:08.290787] [DEBUG] [LOCAL ] BST: Loaded 19010 existing records from primary storage. [2025-10-01T17:47:08.291075] [INFO ] [MAIN ] BST: Loaded 19010 existing records. [2025-10-01T17:47:08.516626] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:47:08.516883] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-01T17:47:08.516933] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-01T17:47:08.517141] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-01T17:47:08.517201] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-01T17:47:08.904814] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-01T17:47:08.918415] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T17:47:08.972833] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:47:09.588158] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T17:47:09.702433] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-01T17:47:10.502380] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-01T17:47:10.600272] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T17:47:10.852330] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-01T17:47:10.853933] [INFO ] [REMOTE ] BRX: Full fetch complete (74915 records). [2025-10-01T17:47:10.854076] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-01T17:47:11.313887] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-01T17:47:11.317874] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-01T17:47:11.318846] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-01T17:47:11.319937] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-01T17:47:11.320160] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-01T17:47:11.322043] [DEBUG] [LOCAL ] BRX: Trimmed 74915 records to 51713 (keeping 200 days of data) [2025-10-01T17:47:11.663740] [DEBUG] [LOCAL ] BRX: Primary data saved (51713 records). [2025-10-01T17:47:11.663881] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-01T17:47:11.663962] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BRX took 45.8s. Estimated remaining: 4h 40m 37s. Rate: 7.2 symbols/min [2025-10-01T17:47:11.852324] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:47:11.877223] [DEBUG] [LOCAL ] BSTZ: Loaded 24736 existing records from primary storage. [2025-10-01T17:47:11.877514] [INFO ] [MAIN ] BSTZ: Loaded 24736 existing records. [2025-10-01T17:47:12.073695] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:47:12.077856] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-01T17:47:12.077662] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-01T17:47:12.078060] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-01T17:47:12.079571] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-01T17:47:12.079635] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-01T17:47:12.112133] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-01T17:47:12.112376] [INFO ] [REMOTE ] BSBR: Full fetch complete (50691 records). [2025-10-01T17:47:12.125874] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-01T17:47:12.860554] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:47:12.905253] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-01T17:47:12.953522] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-01T17:47:12.953680] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-01T17:47:12.954400] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-01T17:47:12.954621] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-01T17:47:12.975960] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T17:47:12.976093] [DEBUG] [LOCAL ] BSBR: Trimmed 50691 records to 35400 (keeping 200 days of data) [2025-10-01T17:47:13.217264] [DEBUG] [LOCAL ] BSBR: Primary data saved (35400 records). [2025-10-01T17:47:13.217411] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-01T17:47:13.218882] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSBR took 40.7s. Estimated remaining: 4h 39m 49s. Rate: 7.3 symbols/min [2025-10-01T17:47:13.430584] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:47:13.446547] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T17:47:13.510914] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-01T17:47:13.511299] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-01T17:47:13.715619] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-01T17:47:13.723244] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:47:13.724584] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-01T17:47:13.724709] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-01T17:47:13.725153] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-01T17:47:13.725219] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-01T17:47:14.148597] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:47:14.165542] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T17:47:14.502390] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-01T17:47:15.043920] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T17:47:15.302415] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-01T17:47:16.102381] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-01T17:47:16.139375] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T17:47:16.165498] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T17:47:16.902378] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-01T17:47:17.267476] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T17:47:17.702391] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-01T17:47:18.502391] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-01T17:47:18.776258] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-01T17:47:19.005379] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T17:47:19.150868] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T17:47:19.302381] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-01T17:47:20.102358] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-01T17:47:20.426020] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T17:47:20.902384] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-01T17:47:21.137216] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T17:47:21.702397] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-01T17:47:22.284034] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T17:47:22.502449] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-01T17:47:22.770174] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T17:47:23.302393] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-01T17:47:23.523055] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T17:47:24.102385] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-01T17:47:24.617603] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T17:47:24.902424] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-01T17:47:25.243825] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T17:47:25.702391] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-01T17:47:26.396128] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T17:47:26.502415] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-01T17:47:26.697956] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T17:47:27.302404] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-01T17:47:28.029832] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T17:47:28.102380] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-01T17:47:28.442708] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T17:47:28.902391] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-01T17:47:29.171753] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T17:47:29.702448] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-01T17:47:29.794569] [DEBUG] [REMOTE ] BST: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-01T17:47:29.794971] [WARN ] [REMOTE ] BST: No data returned for month 2025-05 [2025-10-01T17:47:29.795086] [FATAL] [REMOTE ] BST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:47:29.795192] [FATAL] [MAIN ] BST: Failed to fetch primary data. [2025-10-01T17:47:29.795271] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:47:29.795359] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-01T17:47:29.795441] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-01T17:47:29.795495] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-01T17:47:29.796185] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-10-01T17:47:29.796296] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BST took 21.7s. Estimated remaining: 4h 40m 29s. Rate: 7.2 symbols/min [2025-10-01T17:47:30.032431] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:47:30.043988] [DEBUG] [LOCAL ] BTA: Loaded 5400 existing records from primary storage. [2025-10-01T17:47:30.044280] [INFO ] [MAIN ] BTA: Loaded 5400 existing records. [2025-10-01T17:47:30.269920] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:47:30.270223] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-01T17:47:30.270298] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-01T17:47:30.270521] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-01T17:47:30.270591] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-01T17:47:30.507711] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-01T17:47:30.705713] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:47:30.740250] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T17:47:31.266600] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-01T17:47:31.302345] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-01T17:47:32.102355] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-01T17:47:32.200950] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T17:47:32.902386] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-01T17:47:32.995322] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T17:47:33.702421] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-01T17:47:33.797763] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T17:47:34.481025] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T17:47:34.502357] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-01T17:47:35.249286] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T17:47:35.302412] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-01T17:47:36.102393] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-01T17:47:36.401457] [DEBUG] [REMOTE ] BSTZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:47:36.401845] [WARN ] [REMOTE ] BSTZ: No data returned for month 2025-10 [2025-10-01T17:47:36.401938] [FATAL] [REMOTE ] BSTZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:47:36.402020] [FATAL] [MAIN ] BSTZ: Failed to fetch primary data. [2025-10-01T17:47:36.402160] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:47:36.402234] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-01T17:47:36.402313] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-01T17:47:36.402368] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-01T17:47:36.403157] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-10-01T17:47:36.403248] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSTZ took 24.7s. Estimated remaining: 4h 40m 11s. Rate: 7.2 symbols/min [2025-10-01T17:47:36.619427] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:47:36.638795] [DEBUG] [LOCAL ] BTCM: Loaded 15242 existing records from primary storage. [2025-10-01T17:47:36.639082] [INFO ] [MAIN ] BTCM: Loaded 15242 existing records. [2025-10-01T17:47:36.853872] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:47:36.854090] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-01T17:47:36.854142] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-01T17:47:36.854446] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-01T17:47:36.854506] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-01T17:47:36.907562] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-01T17:47:37.290133] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:47:37.312900] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T17:47:37.702435] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-01T17:47:38.477681] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T17:47:38.502364] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-01T17:47:38.669471] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T17:47:39.302476] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-01T17:47:39.683629] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-01T17:47:40.032161] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-01T17:47:40.033360] [INFO ] [REMOTE ] BSM: Full fetch complete (47471 records). [2025-10-01T17:47:40.033459] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-01T17:47:40.110595] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-01T17:47:40.482497] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-01T17:47:40.482586] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-01T17:47:40.483218] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-01T17:47:40.483285] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-01T17:47:40.484443] [DEBUG] [LOCAL ] BSM: Trimmed 47471 records to 32181 (keeping 200 days of data) [2025-10-01T17:47:40.702903] [DEBUG] [LOCAL ] BSM: Primary data saved (32181 records). [2025-10-01T17:47:40.703078] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-01T17:47:40.703185] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSM took 36.5s. Estimated remaining: 4h 39m 39s. Rate: 7.2 symbols/min [2025-10-01T17:47:40.846780] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T17:47:40.907530] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-01T17:47:40.939530] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:47:41.002464] [DEBUG] [LOCAL ] BTE: Loaded 52722 existing records from primary storage. [2025-10-01T17:47:41.003017] [INFO ] [MAIN ] BTE: Loaded 52722 existing records. [2025-10-01T17:47:41.204540] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:47:41.204828] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-01T17:47:41.204881] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-01T17:47:41.205245] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-01T17:47:41.205309] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-01T17:47:41.624470] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:47:41.702385] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-01T17:47:42.226802] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T17:47:42.502382] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-01T17:47:43.302378] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-01T17:47:43.365752] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T17:47:43.776437] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T17:47:43.971317] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T17:47:44.102466] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-01T17:47:44.902426] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-01T17:47:45.442035] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-01T17:47:45.702442] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-01T17:47:46.009730] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T17:47:46.502443] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-01T17:47:47.266495] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T17:47:47.302422] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-01T17:47:48.102413] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-01T17:47:48.292372] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T17:47:48.295968] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T17:47:48.902433] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-01T17:47:49.341794] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T17:47:49.499002] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T17:47:49.702415] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-01T17:47:50.366780] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T17:47:50.502434] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-01T17:47:51.216228] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T17:47:51.302422] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-01T17:47:51.953237] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T17:47:52.102420] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-01T17:47:52.551204] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T17:47:52.902402] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-01T17:47:53.366230] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-01T17:47:53.702430] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-01T17:47:54.502475] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-01T17:47:54.995932] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-01T17:47:55.302419] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-01T17:47:55.751562] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T17:47:56.102412] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-01T17:47:56.902403] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-01T17:47:57.238287] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T17:47:57.622734] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T17:47:57.673937] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T17:47:57.702349] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-01T17:47:58.502424] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-01T17:47:59.302397] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-01T17:47:59.534469] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T17:48:00.080585] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T17:48:00.102369] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-01T17:48:00.165803] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T17:48:00.902423] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-01T17:48:01.692564] [DEBUG] [REMOTE ] BSX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:48:01.692992] [WARN ] [REMOTE ] BSX: No data returned for month 2025-10 [2025-10-01T17:48:01.693112] [FATAL] [REMOTE ] BSX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:48:01.693218] [FATAL] [MAIN ] BSX: Failed to fetch primary data. [2025-10-01T17:48:01.693300] [WARN ] [MAIN ] BSX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:48:01.693391] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-01T17:48:01.693475] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-01T17:48:01.693528] [INFO ] [LOCAL ] BSX: Starting deletion of derivative data. [2025-10-01T17:48:01.693987] [DEBUG] [LOCAL ] BSX: Deleted derivative data file. [2025-10-01T17:48:01.694099] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSX took 48.5s. Estimated remaining: 4h 40m 45s. Rate: 7.2 symbols/min [2025-10-01T17:48:01.711484] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-01T17:48:01.937631] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:02.006023] [DEBUG] [LOCAL ] BTI: Loaded 53556 existing records from primary storage. [2025-10-01T17:48:02.006453] [INFO ] [MAIN ] BTI: Loaded 53556 existing records. [2025-10-01T17:48:02.222193] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:02.222597] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-01T17:48:02.222804] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-01T17:48:02.223115] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-01T17:48:02.223176] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-01T17:48:02.515210] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-01T17:48:02.667276] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T17:48:02.680998] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:02.743364] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T17:48:02.744242] [INFO ] [REMOTE ] BTA: Full fetch complete (9552 records). [2025-10-01T17:48:02.744315] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-01T17:48:03.149906] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-01T17:48:03.149994] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-01T17:48:03.150290] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-01T17:48:03.150351] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-01T17:48:03.150880] [DEBUG] [LOCAL ] BTA: Trimmed 9552 records to 5410 (keeping 200 days of data) [2025-10-01T17:48:03.185737] [DEBUG] [LOCAL ] BTA: Primary data saved (5410 records). [2025-10-01T17:48:03.185848] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-01T17:48:03.185938] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTA took 33.4s. Estimated remaining: 4h 39m 57s. Rate: 7.2 symbols/min [2025-10-01T17:48:03.307452] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-01T17:48:03.375497] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:03.386677] [DEBUG] [LOCAL ] BTO: Loaded 8761 existing records from primary storage. [2025-10-01T17:48:03.386886] [INFO ] [MAIN ] BTO: Loaded 8761 existing records. [2025-10-01T17:48:03.578927] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:03.579163] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-01T17:48:03.579213] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-01T17:48:03.579396] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-01T17:48:03.579455] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-01T17:48:03.980543] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:03.995896] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T17:48:04.102387] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-01T17:48:04.902357] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-01T17:48:05.066173] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T17:48:05.231683] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T17:48:05.702385] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-01T17:48:06.008579] [DEBUG] [REMOTE ] BTCM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:48:06.008980] [WARN ] [REMOTE ] BTCM: No data returned for month 2025-10 [2025-10-01T17:48:06.009075] [FATAL] [REMOTE ] BTCM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:48:06.009165] [FATAL] [MAIN ] BTCM: Failed to fetch primary data. [2025-10-01T17:48:06.009230] [WARN ] [MAIN ] BTCM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:48:06.009322] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-01T17:48:06.009436] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-01T17:48:06.009481] [INFO ] [LOCAL ] BTCM: Starting deletion of derivative data. [2025-10-01T17:48:06.009802] [DEBUG] [LOCAL ] BTCM: Deleted derivative data file. [2025-10-01T17:48:06.009904] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 29.6s. Estimated remaining: 4h 39m 17s. Rate: 7.2 symbols/min [2025-10-01T17:48:06.206692] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:06.224803] [DEBUG] [LOCAL ] BTT: Loaded 15894 existing records from primary storage. [2025-10-01T17:48:06.225067] [INFO ] [MAIN ] BTT: Loaded 15894 existing records. [2025-10-01T17:48:06.431430] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:06.431701] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-01T17:48:06.431790] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-01T17:48:06.432038] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-01T17:48:06.432111] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-01T17:48:06.507534] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-01T17:48:06.838459] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:07.291510] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T17:48:07.302290] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-01T17:48:07.362672] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T17:48:08.102376] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-01T17:48:08.902414] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-01T17:48:09.546616] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-01T17:48:09.702430] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-01T17:48:09.802065] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T17:48:10.157550] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T17:48:10.227285] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T17:48:10.502387] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-01T17:48:11.285598] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T17:48:11.302363] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-01T17:48:12.102381] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-01T17:48:12.188485] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T17:48:12.902389] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-01T17:48:13.702368] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-01T17:48:13.763430] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T17:48:14.148505] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-01T17:48:14.502442] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-01T17:48:14.958351] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T17:48:15.277286] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T17:48:15.302383] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-01T17:48:16.102384] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-01T17:48:16.883189] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T17:48:16.902372] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-01T17:48:17.499944] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-01T17:48:17.501520] [INFO ] [REMOTE ] BTE: Full fetch complete (76022 records). [2025-10-01T17:48:17.501685] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-01T17:48:17.703807] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-01T17:48:17.781761] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T17:48:18.024766] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-01T17:48:18.024872] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-01T17:48:18.026009] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-01T17:48:18.026081] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-01T17:48:18.027699] [DEBUG] [LOCAL ] BTE: Trimmed 76022 records to 52720 (keeping 200 days of data) [2025-10-01T17:48:18.361309] [DEBUG] [LOCAL ] BTE: Primary data saved (52720 records). [2025-10-01T17:48:18.361471] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-01T17:48:18.361589] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTE took 37.7s. Estimated remaining: 4h 39m 32s. Rate: 7.2 symbols/min [2025-10-01T17:48:18.506966] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-01T17:48:18.568835] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:18.626546] [DEBUG] [LOCAL ] BTU: Loaded 53307 existing records from primary storage. [2025-10-01T17:48:18.626969] [INFO ] [MAIN ] BTU: Loaded 53307 existing records. [2025-10-01T17:48:18.790286] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T17:48:18.871955] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:18.872191] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-01T17:48:18.872252] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-01T17:48:18.872519] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-01T17:48:18.872581] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-01T17:48:19.257201] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T17:48:19.308996] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-01T17:48:19.337051] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:20.102365] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-01T17:48:20.231680] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T17:48:20.902405] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-01T17:48:21.401624] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T17:48:21.668318] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T17:48:21.702418] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-01T17:48:22.502427] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-01T17:48:22.995918] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T17:48:23.279234] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T17:48:23.302371] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-01T17:48:24.102400] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-01T17:48:24.515321] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T17:48:24.902349] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-01T17:48:25.148911] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T17:48:25.702423] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-01T17:48:26.507451] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-01T17:48:26.529531] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T17:48:26.605012] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-01T17:48:26.606576] [INFO ] [REMOTE ] BTO: Full fetch complete (13300 records). [2025-10-01T17:48:26.606728] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-01T17:48:27.015603] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-01T17:48:27.015748] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-01T17:48:27.016167] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-01T17:48:27.016235] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-01T17:48:27.016791] [DEBUG] [LOCAL ] BTO: Trimmed 13300 records to 8767 (keeping 200 days of data) [2025-10-01T17:48:27.077181] [DEBUG] [LOCAL ] BTO: Primary data saved (8767 records). [2025-10-01T17:48:27.077326] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-01T17:48:27.077412] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTO took 23.9s. Estimated remaining: 4h 39m 27s. Rate: 7.2 symbols/min [2025-10-01T17:48:27.269596] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:27.269867] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-01T17:48:27.269924] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-01T17:48:27.270239] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-01T17:48:27.270284] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-01T17:48:27.270330] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-01T17:48:27.270370] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-01T17:48:27.307729] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-01T17:48:27.668174] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:28.102396] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-01T17:48:28.435318] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T17:48:28.454153] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:48:28.454469] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-01T17:48:28.454600] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:48:28.454684] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-01T17:48:28.454753] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:48:28.454827] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-01T17:48:28.454908] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-01T17:48:28.454964] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-01T17:48:28.455009] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-01T17:48:28.455058] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 1.4s. Estimated remaining: 4h 38m 38s. Rate: 7.2 symbols/min [2025-10-01T17:48:28.661116] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:28.688769] [DEBUG] [LOCAL ] BTZ: Loaded 22619 existing records from primary storage. [2025-10-01T17:48:28.689091] [INFO ] [MAIN ] BTZ: Loaded 22619 existing records. [2025-10-01T17:48:28.902350] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-01T17:48:28.901787] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:28.903783] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-01T17:48:28.903894] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-01T17:48:28.904427] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-01T17:48:28.904591] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-01T17:48:29.357720] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:29.393266] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T17:48:29.702417] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-01T17:48:30.502449] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-01T17:48:30.737339] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T17:48:30.912964] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T17:48:31.302435] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-01T17:48:31.765273] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T17:48:32.102450] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-01T17:48:32.902367] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-01T17:48:33.153034] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T17:48:33.221899] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T17:48:33.702419] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-01T17:48:34.502389] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-01T17:48:34.568693] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T17:48:35.307579] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-01T17:48:35.326532] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T17:48:35.562142] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T17:48:36.102434] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-01T17:48:36.902386] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-01T17:48:37.032800] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T17:48:37.253277] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T17:48:37.702436] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-01T17:48:38.502479] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-01T17:48:38.719819] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T17:48:39.302443] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-01T17:48:39.443913] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-01T17:48:40.058404] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-01T17:48:40.083067] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T17:48:40.102355] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-01T17:48:40.664163] [DEBUG] [REMOTE ] BTT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:48:40.664550] [WARN ] [REMOTE ] BTT: No data returned for month 2025-10 [2025-10-01T17:48:40.664625] [FATAL] [REMOTE ] BTT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:48:40.664742] [FATAL] [MAIN ] BTT: Failed to fetch primary data. [2025-10-01T17:48:40.664814] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:48:40.664885] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-01T17:48:40.664972] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-01T17:48:40.665029] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-01T17:48:40.665488] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-10-01T17:48:40.665577] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTT took 34.7s. Estimated remaining: 4h 38m 53s. Rate: 7.2 symbols/min [2025-10-01T17:48:40.861380] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:40.915880] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-01T17:48:40.919503] [DEBUG] [LOCAL ] BUD: Loaded 52713 existing records from primary storage. [2025-10-01T17:48:40.920009] [INFO ] [MAIN ] BUD: Loaded 52713 existing records. [2025-10-01T17:48:41.138300] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:41.138515] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-01T17:48:41.138566] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-01T17:48:41.138843] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-01T17:48:41.138905] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-01T17:48:41.562423] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:41.702450] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-01T17:48:42.346505] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T17:48:42.502443] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-01T17:48:43.302448] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-01T17:48:43.732525] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-01T17:48:43.799786] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T17:48:44.102389] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-01T17:48:44.902377] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-01T17:48:45.187307] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T17:48:45.702399] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-01T17:48:45.834588] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T17:48:46.424994] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T17:48:46.502362] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-01T17:48:47.302374] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-01T17:48:47.346725] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T17:48:47.778039] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-01T17:48:48.102408] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-01T17:48:48.902367] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-01T17:48:49.042569] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T17:48:49.338374] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-01T17:48:49.702417] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-01T17:48:50.507487] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-01T17:48:50.529120] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T17:48:51.302423] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-01T17:48:52.102405] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-01T17:48:52.518848] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T17:48:52.550483] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T17:48:52.706115] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-01T17:48:52.709190] [INFO ] [REMOTE ] BTI: Full fetch complete (77445 records). [2025-10-01T17:48:52.709328] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-01T17:48:52.909396] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-01T17:48:53.172380] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-01T17:48:53.172514] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-01T17:48:53.173462] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-01T17:48:53.173531] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-01T17:48:53.175165] [DEBUG] [LOCAL ] BTI: Trimmed 77445 records to 53556 (keeping 200 days of data) [2025-10-01T17:48:53.538135] [DEBUG] [LOCAL ] BTI: Primary data saved (53556 records). [2025-10-01T17:48:53.538278] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-01T17:48:53.538378] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTI took 51.8s. Estimated remaining: 4h 39m 11s. Rate: 7.2 symbols/min [2025-10-01T17:48:53.705821] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-01T17:48:53.728410] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:53.744293] [DEBUG] [LOCAL ] BUI: Loaded 11559 existing records from primary storage. [2025-10-01T17:48:53.744595] [INFO ] [MAIN ] BUI: Loaded 11559 existing records. [2025-10-01T17:48:53.947228] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:53.947568] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-01T17:48:53.947623] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-01T17:48:53.947978] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-01T17:48:53.948039] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-01T17:48:54.347476] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:54.502387] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-01T17:48:54.532134] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T17:48:54.616235] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-01T17:48:54.617902] [INFO ] [REMOTE ] BTU: Full fetch complete (76904 records). [2025-10-01T17:48:54.618037] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-01T17:48:55.064138] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-01T17:48:55.064422] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-01T17:48:55.065378] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-01T17:48:55.065603] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-01T17:48:55.099544] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-01T17:48:55.098070] [DEBUG] [LOCAL ] BTU: Trimmed 76904 records to 53311 (keeping 200 days of data) [2025-10-01T17:48:55.186220] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T17:48:55.312282] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-01T17:48:55.473586] [DEBUG] [LOCAL ] BTU: Primary data saved (53311 records). [2025-10-01T17:48:55.473790] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-01T17:48:55.473879] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 37.1s. Estimated remaining: 4h 38m 26s. Rate: 7.2 symbols/min [2025-10-01T17:48:55.656122] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:55.702729] [DEBUG] [LOCAL ] BUR: Loaded 45112 existing records from primary storage. [2025-10-01T17:48:55.703239] [INFO ] [MAIN ] BUR: Loaded 45112 existing records. [2025-10-01T17:48:55.905155] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:55.905363] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-01T17:48:55.905413] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-01T17:48:55.905767] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-01T17:48:55.905827] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-01T17:48:56.116146] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-01T17:48:56.331738] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:56.380852] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T17:48:56.902374] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-01T17:48:57.602332] [DEBUG] [REMOTE ] BTZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:48:57.602724] [WARN ] [REMOTE ] BTZ: No data returned for month 2025-10 [2025-10-01T17:48:57.602863] [FATAL] [REMOTE ] BTZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:48:57.602973] [FATAL] [MAIN ] BTZ: Failed to fetch primary data. [2025-10-01T17:48:57.603045] [WARN ] [MAIN ] BTZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:48:57.603130] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-01T17:48:57.603215] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-10-01T17:48:57.603255] [INFO ] [LOCAL ] BTZ: Starting deletion of derivative data. [2025-10-01T17:48:57.603767] [DEBUG] [LOCAL ] BTZ: Deleted derivative data file. [2025-10-01T17:48:57.603879] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTZ took 29.1s. Estimated remaining: 4h 37m 43s. Rate: 7.3 symbols/min [2025-10-01T17:48:57.703850] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-01T17:48:57.811800] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:48:57.851197] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T17:48:57.915583] [DEBUG] [LOCAL ] BURL: Loaded 46056 existing records from primary storage. [2025-10-01T17:48:57.916026] [INFO ] [MAIN ] BURL: Loaded 46056 existing records. [2025-10-01T17:48:58.119710] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:48:58.120000] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-01T17:48:58.120059] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-01T17:48:58.120358] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-01T17:48:58.120419] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-01T17:48:58.502421] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-01T17:48:58.533117] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:48:59.302358] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-01T17:48:59.418574] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T17:48:59.936130] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T17:49:00.045090] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T17:49:00.102409] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-01T17:49:00.902424] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-01T17:49:01.702353] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-01T17:49:01.815204] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T17:49:01.930192] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T17:49:02.502389] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-01T17:49:03.158908] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T17:49:03.302381] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-01T17:49:03.940682] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T17:49:04.102402] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-01T17:49:04.766054] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T17:49:04.884682] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T17:49:04.902391] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-01T17:49:05.702373] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-01T17:49:06.502430] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-01T17:49:06.806148] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T17:49:07.302399] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-01T17:49:07.337244] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T17:49:08.102384] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-01T17:49:08.217088] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T17:49:08.902419] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-01T17:49:09.009833] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T17:49:09.429782] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T17:49:09.702382] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-01T17:49:10.196626] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T17:49:10.502379] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-01T17:49:11.302359] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-01T17:49:11.363045] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T17:49:11.841410] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-01T17:49:11.843229] [INFO ] [REMOTE ] BUD: Full fetch complete (76486 records). [2025-10-01T17:49:11.843348] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-01T17:49:12.113757] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-01T17:49:12.312875] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-01T17:49:12.312969] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-01T17:49:12.313872] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-01T17:49:12.313941] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-01T17:49:12.315756] [DEBUG] [LOCAL ] BUD: Trimmed 76486 records to 52716 (keeping 200 days of data) [2025-10-01T17:49:12.664141] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T17:49:12.699784] [DEBUG] [LOCAL ] BUD: Primary data saved (52716 records). [2025-10-01T17:49:12.699945] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-01T17:49:12.700142] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUD took 32.0s. Estimated remaining: 4h 38m 13s. Rate: 7.2 symbols/min [2025-10-01T17:49:12.907431] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:49:12.907499] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-01T17:49:12.925261] [DEBUG] [LOCAL ] BUXX: Loaded 15166 existing records from primary storage. [2025-10-01T17:49:12.925509] [INFO ] [MAIN ] BUXX: Loaded 15166 existing records. [2025-10-01T17:49:13.135143] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:49:13.135419] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-01T17:49:13.135507] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-01T17:49:13.135805] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-01T17:49:13.135878] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-01T17:49:13.536972] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:49:13.702498] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-01T17:49:13.732846] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T17:49:14.238506] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-01T17:49:14.484366] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T17:49:14.502396] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-01T17:49:15.177312] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T17:49:15.302428] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-01T17:49:15.905215] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T17:49:16.102394] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-01T17:49:16.746935] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T17:49:16.902393] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-01T17:49:17.670291] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T17:49:17.702354] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-01T17:49:18.249369] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-01T17:49:18.502398] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-01T17:49:19.017629] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-01T17:49:19.302398] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-01T17:49:20.102351] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-01T17:49:20.240217] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T17:49:20.902395] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-01T17:49:21.263582] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T17:49:21.702411] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-01T17:49:22.502364] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-01T17:49:22.784019] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T17:49:22.821963] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T17:49:23.302417] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-01T17:49:24.062299] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T17:49:24.083162] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T17:49:24.102356] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-01T17:49:24.902406] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-01T17:49:25.085082] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T17:49:25.702426] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-01T17:49:26.065629] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T17:49:26.502383] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-01T17:49:27.212847] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T17:49:27.302396] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-01T17:49:27.705921] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T17:49:28.102403] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-01T17:49:28.221888] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T17:49:28.902386] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-01T17:49:29.600494] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T17:49:29.702407] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-01T17:49:29.776518] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T17:49:30.324780] [DEBUG] [REMOTE ] BUXX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:49:30.325101] [WARN ] [REMOTE ] BUXX: No data returned for month 2025-10 [2025-10-01T17:49:30.325209] [FATAL] [REMOTE ] BUXX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:49:30.325333] [FATAL] [MAIN ] BUXX: Failed to fetch primary data. [2025-10-01T17:49:30.325408] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:49:30.325484] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-01T17:49:30.325584] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-01T17:49:30.325666] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-10-01T17:49:30.326100] [DEBUG] [LOCAL ] BUXX: Deleted derivative data file. [2025-10-01T17:49:30.326192] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUXX took 17.6s. Estimated remaining: 4h 38m 58s. Rate: 7.2 symbols/min [2025-10-01T17:49:30.502411] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-01T17:49:31.302442] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-01T17:49:32.107592] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-01T17:49:32.127419] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T17:49:32.239244] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T17:49:32.902353] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-01T17:49:33.702395] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-01T17:49:33.972057] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T17:49:33.973445] [INFO ] [REMOTE ] BUR: Full fetch complete (63489 records). [2025-10-01T17:49:33.973535] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-01T17:49:34.403272] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-01T17:49:34.403437] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-01T17:49:34.404422] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-01T17:49:34.404506] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-01T17:49:34.406113] [DEBUG] [LOCAL ] BUR: Trimmed 63489 records to 45140 (keeping 200 days of data) [2025-10-01T17:49:34.511040] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T17:49:34.516762] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-01T17:49:34.564862] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T17:49:34.757566] [DEBUG] [LOCAL ] BUR: Primary data saved (45140 records). [2025-10-01T17:49:34.757742] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-01T17:49:34.757861] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUR took 39.3s. Estimated remaining: 4h 38m 28s. Rate: 7.2 symbols/min [2025-10-01T17:49:35.034543] [DEBUG] [REMOTE ] BUI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:49:35.034958] [WARN ] [REMOTE ] BUI: No data returned for month 2025-10 [2025-10-01T17:49:35.035066] [FATAL] [REMOTE ] BUI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:49:35.035160] [FATAL] [MAIN ] BUI: Failed to fetch primary data. [2025-10-01T17:49:35.035238] [WARN ] [MAIN ] BUI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:49:35.035373] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-01T17:49:35.035463] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-01T17:49:35.035539] [INFO ] [LOCAL ] BUI: Starting deletion of derivative data. [2025-10-01T17:49:35.035956] [DEBUG] [LOCAL ] BUI: Deleted derivative data file. [2025-10-01T17:49:35.036051] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUI took 41.5s. Estimated remaining: 4h 37m 34s. Rate: 7.2 symbols/min [2025-10-01T17:49:35.302400] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-01T17:49:37.366370] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-01T17:49:37.367777] [INFO ] [REMOTE ] BURL: Full fetch complete (65670 records). [2025-10-01T17:49:37.367901] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-01T17:49:37.804390] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-01T17:49:37.804479] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-01T17:49:37.805258] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-01T17:49:37.805321] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-01T17:49:37.806621] [DEBUG] [LOCAL ] BURL: Trimmed 65670 records to 45991 (keeping 200 days of data) [2025-10-01T17:49:38.111932] [DEBUG] [LOCAL ] BURL: Primary data saved (45991 records). [2025-10-01T17:49:38.112075] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-01T17:49:38.112178] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 40.5s. Estimated remaining: 4h 36m 57s. Rate: 7.3 symbols/min [2025-10-01T17:49:38.838373] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:49:38.869175] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:49:38.899783] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:49:38.921072] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:49:38.921907] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-01T17:49:38.921993] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-01T17:49:38.922727] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-01T17:49:38.922827] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-01T17:49:38.922893] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-01T17:49:38.922936] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-01T17:49:39.140356] [DEBUG] [LOCAL ] BW: Loaded 39796 existing records from primary storage. [2025-10-01T17:49:39.196770] [INFO ] [MAIN ] BW: Loaded 39796 existing records. [2025-10-01T17:49:39.204541] [DEBUG] [LOCAL ] BVN: Loaded 43983 existing records from primary storage. [2025-10-01T17:49:39.242792] [INFO ] [MAIN ] BVN: Loaded 43983 existing records. [2025-10-01T17:49:39.392053] [DEBUG] [LOCAL ] BWA: Loaded 52185 existing records from primary storage. [2025-10-01T17:49:39.508166] [INFO ] [MAIN ] BWA: Loaded 52185 existing records. [2025-10-01T17:49:39.732171] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:49:39.838532] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-01T17:49:39.933597] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:49:39.983823] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:49:39.989469] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-01T17:49:39.990126] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-01T17:49:39.989854] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-01T17:49:40.000977] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-01T17:49:40.012814] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-01T17:49:40.039284] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-01T17:49:40.039236] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-01T17:49:40.071255] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-01T17:49:40.081279] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:49:40.164921] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-01T17:49:40.232100] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-01T17:49:40.316467] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-01T17:49:40.352559] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-01T17:49:41.074002] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:49:41.132540] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-01T17:49:41.138562] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:49:41.149781] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-01T17:49:41.316964] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:49:41.317371] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-01T17:49:41.337585] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T17:49:41.345133] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-01T17:49:42.256001] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T17:49:42.262504] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-01T17:49:42.608570] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T17:49:42.619086] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-01T17:49:42.728115] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T17:49:42.739413] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-01T17:49:42.823042] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T17:49:42.832549] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-01T17:49:43.634255] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T17:49:43.643214] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-01T17:49:43.710386] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T17:49:43.997364] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T17:49:44.099265] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T17:49:44.109294] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-01T17:49:44.605982] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T17:49:44.902411] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-01T17:49:45.471872] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T17:49:45.702389] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-01T17:49:46.466596] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T17:49:46.502397] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-01T17:49:47.307496] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-01T17:49:47.320580] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T17:49:48.107493] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-01T17:49:48.122423] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T17:49:48.295071] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T17:49:48.902385] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-01T17:49:49.360627] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T17:49:49.702385] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-01T17:49:50.278963] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T17:49:50.502399] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-01T17:49:51.035983] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T17:49:51.302384] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-01T17:49:51.675624] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T17:49:52.102427] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-01T17:49:52.902389] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-01T17:49:52.940018] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T17:49:53.400987] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:49:53.702397] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-01T17:49:54.140110] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T17:49:54.502423] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-01T17:49:55.243217] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T17:49:55.302403] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-01T17:49:55.747095] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T17:49:56.102435] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-01T17:49:56.567765] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T17:49:56.902394] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-01T17:49:57.491929] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T17:49:57.702391] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-01T17:49:58.507555] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-01T17:49:58.539668] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T17:49:59.004725] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T17:49:59.302438] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-01T17:49:59.891897] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T17:50:00.102388] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-01T17:50:00.589159] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T17:50:00.902405] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-01T17:50:01.702430] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-01T17:50:01.847489] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T17:50:02.502420] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-01T17:50:02.553135] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T17:50:02.714367] [DEBUG] [REMOTE ] BV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:50:02.714779] [WARN ] [REMOTE ] BV: No data returned for month 2025-10 [2025-10-01T17:50:02.714890] [FATAL] [REMOTE ] BV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:50:02.715057] [FATAL] [MAIN ] BV: Failed to fetch primary data. [2025-10-01T17:50:02.715131] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:50:02.715267] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-01T17:50:02.715365] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-01T17:50:02.715448] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-01T17:50:02.715562] [DEBUG] [LOCAL ] BV: No derivative data file found to delete. [2025-10-01T17:50:02.715716] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 24.6s. Estimated remaining: 4h 38m 20s. Rate: 7.2 symbols/min [2025-10-01T17:50:02.914371] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:02.914621] [DEBUG] [LOCAL ] BWG: No existing data file found in primary storage. [2025-10-01T17:50:02.914709] [WARN ] [MAIN ] BWG: No existing data found, performing full refresh instead. [2025-10-01T17:50:02.914835] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-01T17:50:02.914880] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-01T17:50:02.914924] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-10-01T17:50:02.914961] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-01T17:50:03.307546] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-01T17:50:03.372873] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:04.078745] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T17:50:04.102381] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-01T17:50:04.902386] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-01T17:50:05.203348] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-01T17:50:05.205179] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T17:50:05.702392] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-01T17:50:06.502391] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-01T17:50:06.609450] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T17:50:07.302392] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-01T17:50:08.039589] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-01T17:50:08.041084] [INFO ] [REMOTE ] BW: Full fetch complete (58850 records). [2025-10-01T17:50:08.041234] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-01T17:50:08.107567] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-01T17:50:08.288823] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T17:50:08.544536] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-01T17:50:08.544630] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-01T17:50:08.545435] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-01T17:50:08.545505] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-01T17:50:08.548467] [DEBUG] [LOCAL ] BW: Trimmed 58850 records to 39882 (keeping 200 days of data) [2025-10-01T17:50:08.798477] [DEBUG] [LOCAL ] BW: Primary data saved (39882 records). [2025-10-01T17:50:08.798687] [INFO ] [MAIN ] BW: Full history saved. [2025-10-01T17:50:08.798822] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BW took 30.7s. Estimated remaining: 4h 37m 59s. Rate: 7.2 symbols/min [2025-10-01T17:50:08.907217] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-01T17:50:08.965255] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T17:50:09.039855] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:09.040158] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-10-01T17:50:09.040226] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-10-01T17:50:09.040397] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-01T17:50:09.040471] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-01T17:50:09.040577] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-01T17:50:09.040675] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-01T17:50:09.417161] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-01T17:50:09.513557] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:09.702389] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-01T17:50:10.489428] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T17:50:10.502338] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-01T17:50:10.605260] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T17:50:11.302318] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-01T17:50:11.382540] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T17:50:12.102442] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-01T17:50:12.902402] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-01T17:50:13.532021] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T17:50:13.533663] [INFO ] [REMOTE ] BVN: Full fetch complete (62939 records). [2025-10-01T17:50:13.533767] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-01T17:50:13.706334] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-01T17:50:14.021966] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-01T17:50:14.022115] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-01T17:50:14.023147] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-01T17:50:14.031308] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-01T17:50:14.048306] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-01T17:50:14.056489] [DEBUG] [LOCAL ] BVN: Trimmed 62939 records to 44017 (keeping 200 days of data) [2025-10-01T17:50:14.343889] [DEBUG] [LOCAL ] BVN: Primary data saved (44017 records). [2025-10-01T17:50:14.344070] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-01T17:50:14.344182] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BVN took 36.2s. Estimated remaining: 4h 37m 36s. Rate: 7.2 symbols/min [2025-10-01T17:50:14.512041] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-01T17:50:14.549480] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:14.551229] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-10-01T17:50:14.551300] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-10-01T17:50:14.551542] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-01T17:50:14.551639] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-01T17:50:14.551804] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-01T17:50:14.552021] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-01T17:50:14.702255] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T17:50:14.696097] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T17:50:15.034700] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:15.302392] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-01T17:50:15.811529] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T17:50:15.826532] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-01T17:50:16.102444] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-01T17:50:16.902412] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-01T17:50:17.412316] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-01T17:50:17.702396] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-01T17:50:17.787093] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T17:50:18.361485] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T17:50:18.502443] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-01T17:50:19.302467] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-01T17:50:19.623399] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T17:50:20.033239] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T17:50:20.102406] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-01T17:50:20.902397] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-01T17:50:21.368805] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T17:50:21.702446] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-01T17:50:22.502396] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-01T17:50:23.048826] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T17:50:23.076845] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T17:50:23.080329] [INFO ] [REMOTE ] BWA: Full fetch complete (75720 records). [2025-10-01T17:50:23.080447] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-01T17:50:23.307526] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-01T17:50:23.545909] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T17:50:23.545041] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-01T17:50:23.550353] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-01T17:50:23.551704] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-01T17:50:23.551792] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-01T17:50:23.553335] [DEBUG] [LOCAL ] BWA: Trimmed 75720 records to 52184 (keeping 200 days of data) [2025-10-01T17:50:23.905772] [DEBUG] [LOCAL ] BWA: Primary data saved (52184 records). [2025-10-01T17:50:23.905918] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-01T17:50:23.906015] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 45.8s. Estimated remaining: 4h 37m 34s. Rate: 7.2 symbols/min [2025-10-01T17:50:24.092232] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:24.100943] [DEBUG] [LOCAL ] BWNB: Loaded 4448 existing records from primary storage. [2025-10-01T17:50:24.101143] [INFO ] [MAIN ] BWNB: Loaded 4448 existing records. [2025-10-01T17:50:24.112529] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-01T17:50:24.300332] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:50:24.300552] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-01T17:50:24.300603] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-01T17:50:24.301107] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-01T17:50:24.301171] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-01T17:50:24.738940] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:24.745607] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T17:50:24.868673] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T17:50:24.902377] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-01T17:50:25.702439] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-01T17:50:26.323277] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T17:50:26.414253] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T17:50:26.502443] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-01T17:50:27.302416] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-01T17:50:27.464411] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T17:50:27.906270] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T17:50:28.102399] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-01T17:50:28.902392] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-01T17:50:28.920523] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T17:50:29.701386] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T17:50:29.704046] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-01T17:50:30.323307] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-01T17:50:30.502409] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-01T17:50:30.944118] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T17:50:31.302395] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-01T17:50:31.641626] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-01T17:50:32.102438] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-01T17:50:32.699972] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T17:50:32.902434] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-01T17:50:33.702405] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-01T17:50:34.338632] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T17:50:34.351925] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T17:50:34.502423] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-01T17:50:35.302403] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-01T17:50:35.432142] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T17:50:36.102393] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-01T17:50:36.607959] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T17:50:36.742717] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T17:50:36.902417] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-01T17:50:37.249306] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-01T17:50:37.702390] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-01T17:50:38.472105] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T17:50:38.502341] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-01T17:50:39.095704] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T17:50:39.302389] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-01T17:50:40.102398] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-01T17:50:40.403219] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-01T17:50:40.464502] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T17:50:40.465372] [INFO ] [REMOTE ] BWMX: Full fetch complete (10095 records). [2025-10-01T17:50:40.465452] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-01T17:50:40.883805] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-01T17:50:40.883888] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-01T17:50:40.884203] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-01T17:50:40.884278] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-01T17:50:40.884883] [DEBUG] [LOCAL ] BWMX: Trimmed 10095 records to 7699 (keeping 200 days of data) [2025-10-01T17:50:40.908984] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-01T17:50:40.938275] [DEBUG] [LOCAL ] BWMX: Primary data saved (7699 records). [2025-10-01T17:50:40.938419] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-01T17:50:40.938498] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 26.6s. Estimated remaining: 4h 38m 14s. Rate: 7.2 symbols/min [2025-10-01T17:50:41.145124] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:41.154056] [DEBUG] [LOCAL ] BWSN: Loaded 5105 existing records from primary storage. [2025-10-01T17:50:41.154312] [INFO ] [MAIN ] BWSN: Loaded 5105 existing records. [2025-10-01T17:50:41.361233] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:50:41.361542] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-01T17:50:41.361602] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-01T17:50:41.362119] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-01T17:50:41.362196] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-01T17:50:41.715698] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-01T17:50:41.764409] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:41.775017] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T17:50:42.322262] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T17:50:42.502371] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-01T17:50:43.076400] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T17:50:43.302416] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-01T17:50:43.924688] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-01T17:50:43.925379] [INFO ] [REMOTE ] BWNB: Full fetch complete (5742 records). [2025-10-01T17:50:43.925451] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-01T17:50:44.102377] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-01T17:50:44.330911] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-01T17:50:44.331018] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-01T17:50:44.331217] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-01T17:50:44.331278] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-01T17:50:44.331709] [DEBUG] [LOCAL ] BWNB: Trimmed 5742 records to 4444 (keeping 200 days of data) [2025-10-01T17:50:44.361758] [DEBUG] [LOCAL ] BWNB: Primary data saved (4444 records). [2025-10-01T17:50:44.361888] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-01T17:50:44.361974] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWNB took 20.5s. Estimated remaining: 4h 37m 39s. Rate: 7.2 symbols/min [2025-10-01T17:50:44.550487] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:44.603208] [DEBUG] [LOCAL ] BWXT: Loaded 46809 existing records from primary storage. [2025-10-01T17:50:44.603635] [INFO ] [MAIN ] BWXT: Loaded 46809 existing records. [2025-10-01T17:50:44.841225] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:50:44.841482] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-01T17:50:44.841532] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-01T17:50:44.842833] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-01T17:50:44.842896] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-01T17:50:44.905442] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-01T17:50:45.213143] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T17:50:45.260072] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:45.702382] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-01T17:50:46.502424] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-01T17:50:46.815314] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T17:50:46.816802] [INFO ] [REMOTE ] BWLP: Full fetch complete (48237 records). [2025-10-01T17:50:46.816887] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-01T17:50:47.258346] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-01T17:50:47.258478] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-01T17:50:47.259333] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-01T17:50:47.259503] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-01T17:50:47.261383] [DEBUG] [LOCAL ] BWLP: Trimmed 48237 records to 32416 (keeping 200 days of data) [2025-10-01T17:50:47.317138] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-01T17:50:47.397253] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T17:50:47.526714] [DEBUG] [LOCAL ] BWLP: Primary data saved (32416 records). [2025-10-01T17:50:47.526888] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-01T17:50:47.527006] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWLP took 38.7s. Estimated remaining: 4h 37m 2s. Rate: 7.2 symbols/min [2025-10-01T17:50:47.653001] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T17:50:47.681393] [INFO ] [REMOTE ] BWG: Full fetch complete (17890 records). [2025-10-01T17:50:47.691924] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-01T17:50:47.833567] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:47.871780] [DEBUG] [LOCAL ] BX: No existing data file found in primary storage. [2025-10-01T17:50:47.878031] [WARN ] [MAIN ] BX: No existing data found, performing full refresh instead. [2025-10-01T17:50:47.909326] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-01T17:50:47.909773] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-01T17:50:47.909552] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-01T17:50:47.941924] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-10-01T17:50:47.944013] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-01T17:50:48.106486] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-01T17:50:48.498323] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-01T17:50:48.512339] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-01T17:50:48.526467] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-01T17:50:48.547668] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-01T17:50:48.551729] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T17:50:48.579837] [DEBUG] [LOCAL ] BWG: Trimmed 17890 records to 12509 (keeping 200 days of data) [2025-10-01T17:50:48.641217] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:48.722879] [DEBUG] [LOCAL ] BWG: Primary data saved (12509 records). [2025-10-01T17:50:48.723056] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-01T17:50:48.723146] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWG took 46.0s. Estimated remaining: 4h 36m 15s. Rate: 7.3 symbols/min [2025-10-01T17:50:48.908523] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-01T17:50:48.912473] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:50:48.913554] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-10-01T17:50:48.913601] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-10-01T17:50:48.913748] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-01T17:50:48.913792] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-01T17:50:48.913834] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-01T17:50:48.913866] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-01T17:50:49.300980] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:50:49.702374] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-01T17:50:50.426524] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T17:50:50.502394] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-01T17:50:50.919679] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T17:50:51.302360] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-01T17:50:51.822203] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T17:50:52.102410] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-01T17:50:52.117186] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T17:50:52.902439] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-01T17:50:53.702404] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-01T17:50:53.770914] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T17:50:54.507523] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-01T17:50:54.528783] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T17:50:54.534218] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T17:50:55.103050] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T17:50:55.302405] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-01T17:50:56.081070] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T17:50:56.102357] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-01T17:50:56.902407] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-01T17:50:56.958797] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T17:50:57.480046] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T17:50:57.702392] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-01T17:50:58.502390] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-01T17:50:58.789602] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T17:50:59.302380] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-01T17:51:00.102405] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-01T17:51:00.141948] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T17:51:00.177343] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T17:51:00.902385] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-01T17:51:01.052488] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T17:51:01.599613] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T17:51:01.702402] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-01T17:51:02.502398] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-01T17:51:03.301628] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T17:51:03.305447] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-01T17:51:03.505257] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T17:51:04.021829] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T17:51:04.102382] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-01T17:51:04.902409] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-01T17:51:05.702382] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-01T17:51:05.807872] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T17:51:06.071053] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-01T17:51:06.502405] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-01T17:51:07.041946] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-01T17:51:07.302438] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T17:51:07.302515] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-01T17:51:07.734564] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T17:51:08.102459] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-01T17:51:08.902435] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-01T17:51:09.359915] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T17:51:09.702431] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-01T17:51:10.069824] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T17:51:10.447485] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T17:51:10.502394] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-01T17:51:11.302388] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-01T17:51:11.418015] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-01T17:51:11.418763] [INFO ] [REMOTE ] BWSN: Full fetch complete (6135 records). [2025-10-01T17:51:11.418838] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-01T17:51:11.805963] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-01T17:51:11.806044] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-01T17:51:11.806242] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-01T17:51:11.806285] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-01T17:51:11.806765] [DEBUG] [LOCAL ] BWSN: Trimmed 6135 records to 5090 (keeping 200 days of data) [2025-10-01T17:51:11.840369] [DEBUG] [LOCAL ] BWSN: Primary data saved (5090 records). [2025-10-01T17:51:11.840539] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-01T17:51:11.840683] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 30.9s. Estimated remaining: 4h 37m 28s. Rate: 7.2 symbols/min [2025-10-01T17:51:12.025315] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:51:12.025507] [DEBUG] [LOCAL ] BXMT: No existing data file found in primary storage. [2025-10-01T17:51:12.025548] [WARN ] [MAIN ] BXMT: No existing data found, performing full refresh instead. [2025-10-01T17:51:12.025741] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-01T17:51:12.025792] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-01T17:51:12.025837] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-01T17:51:12.025872] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-01T17:51:12.107603] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-01T17:51:12.340687] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T17:51:12.342536] [INFO ] [REMOTE ] BXC: Full fetch complete (17899 records). [2025-10-01T17:51:12.358628] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-01T17:51:12.491720] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:51:12.843089] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-01T17:51:12.843173] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-01T17:51:12.843603] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-01T17:51:12.843690] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-01T17:51:12.844365] [DEBUG] [LOCAL ] BXC: Trimmed 17899 records to 13649 (keeping 200 days of data) [2025-10-01T17:51:12.903939] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-01T17:51:12.929833] [DEBUG] [LOCAL ] BXC: Primary data saved (13649 records). [2025-10-01T17:51:12.930010] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-01T17:51:12.930094] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 24.2s. Estimated remaining: 4h 36m 40s. Rate: 7.2 symbols/min [2025-10-01T17:51:13.119530] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:51:13.119767] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-10-01T17:51:13.119819] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-10-01T17:51:13.119931] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-01T17:51:13.119973] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-01T17:51:13.120020] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-10-01T17:51:13.120055] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-01T17:51:13.548329] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:51:13.702406] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-01T17:51:13.806514] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T17:51:14.436739] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T17:51:14.502404] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-01T17:51:15.302359] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-01T17:51:15.583053] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T17:51:16.102407] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-01T17:51:16.417259] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T17:51:16.897579] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T17:51:16.908247] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-01T17:51:16.928521] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T17:51:17.702390] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-01T17:51:18.502359] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-01T17:51:18.781847] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T17:51:18.799119] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T17:51:19.302390] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-01T17:51:19.845532] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T17:51:20.102414] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-01T17:51:20.360284] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T17:51:20.902380] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-01T17:51:21.702411] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-01T17:51:22.150308] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T17:51:22.502399] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-01T17:51:22.619759] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T17:51:23.015598] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T17:51:23.222295] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T17:51:23.302426] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-01T17:51:24.102426] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-01T17:51:24.902397] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-01T17:51:24.966685] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T17:51:25.677965] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T17:51:25.702354] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-01T17:51:26.502382] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-01T17:51:26.882802] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T17:51:26.931048] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T17:51:27.302413] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-01T17:51:27.359392] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T17:51:28.102456] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-01T17:51:28.744515] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T17:51:28.902433] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-01T17:51:29.592500] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T17:51:29.702394] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-01T17:51:30.502360] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-01T17:51:30.818290] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T17:51:31.280220] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T17:51:31.281847] [INFO ] [REMOTE ] BX: Full fetch complete (77403 records). [2025-10-01T17:51:31.281957] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-01T17:51:31.307563] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-01T17:51:31.785273] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-01T17:51:31.785458] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-01T17:51:31.786427] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-01T17:51:31.786603] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-01T17:51:31.788801] [DEBUG] [LOCAL ] BX: Trimmed 77403 records to 53489 (keeping 200 days of data) [2025-10-01T17:51:31.823582] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T17:51:32.102565] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-01T17:51:32.211454] [DEBUG] [LOCAL ] BX: Primary data saved (53489 records). [2025-10-01T17:51:32.211637] [INFO ] [MAIN ] BX: Full history saved. [2025-10-01T17:51:32.211773] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BX took 44.7s. Estimated remaining: 4h 37m 31s. Rate: 7.2 symbols/min [2025-10-01T17:51:32.400419] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:51:32.452467] [DEBUG] [LOCAL ] BXP: Loaded 49851 existing records from primary storage. [2025-10-01T17:51:32.452961] [INFO ] [MAIN ] BXP: Loaded 49851 existing records. [2025-10-01T17:51:32.669763] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:51:32.670097] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-01T17:51:32.670159] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-01T17:51:32.670489] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-01T17:51:32.670550] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-01T17:51:32.916418] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-01T17:51:33.093211] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:51:33.305512] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-01T17:51:33.450895] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T17:51:33.684413] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T17:51:33.702340] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-01T17:51:34.502408] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-01T17:51:35.302466] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-01T17:51:35.482368] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T17:51:36.102382] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-01T17:51:36.221491] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T17:51:36.902434] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-01T17:51:37.702481] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-01T17:51:37.922276] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T17:51:38.037874] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-01T17:51:38.040064] [INFO ] [REMOTE ] BWXT: Full fetch complete (67444 records). [2025-10-01T17:51:38.040195] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-01T17:51:38.352399] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T17:51:38.509196] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-01T17:51:38.508322] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-01T17:51:38.510335] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-01T17:51:38.511230] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-01T17:51:38.511423] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-01T17:51:38.513569] [DEBUG] [LOCAL ] BWXT: Trimmed 67444 records to 46870 (keeping 200 days of data) [2025-10-01T17:51:38.832848] [DEBUG] [LOCAL ] BWXT: Primary data saved (46870 records). [2025-10-01T17:51:38.833188] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-01T17:51:38.833509] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BWXT took 54.5s. Estimated remaining: 4h 37m 14s. Rate: 7.2 symbols/min [2025-10-01T17:51:39.043037] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:51:39.102971] [DEBUG] [LOCAL ] BXSL: Loaded 47607 existing records from primary storage. [2025-10-01T17:51:39.103426] [INFO ] [MAIN ] BXSL: Loaded 47607 existing records. [2025-10-01T17:51:39.331751] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-01T17:51:39.339073] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:51:39.341406] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T17:51:39.347117] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-01T17:51:39.347299] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-01T17:51:39.348564] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-01T17:51:39.349033] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-01T17:51:39.794751] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:51:39.798907] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T17:51:39.800921] [INFO ] [REMOTE ] BXMT: Full fetch complete (69662 records). [2025-10-01T17:51:39.801032] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-01T17:51:40.110529] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-01T17:51:40.247153] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-01T17:51:40.247250] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-01T17:51:40.248131] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-01T17:51:40.248199] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-01T17:51:40.249743] [DEBUG] [LOCAL ] BXMT: Trimmed 69662 records to 47227 (keeping 200 days of data) [2025-10-01T17:51:40.557538] [DEBUG] [LOCAL ] BXMT: Primary data saved (47227 records). [2025-10-01T17:51:40.557746] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-01T17:51:40.557872] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMT took 28.7s. Estimated remaining: 4h 36m 30s. Rate: 7.2 symbols/min [2025-10-01T17:51:40.747208] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:51:40.770950] [DEBUG] [LOCAL ] BY: Loaded 21722 existing records from primary storage. [2025-10-01T17:51:40.771243] [INFO ] [MAIN ] BY: Loaded 21722 existing records. [2025-10-01T17:51:40.906767] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-01T17:51:40.986939] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:51:40.987317] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-01T17:51:40.987509] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-01T17:51:40.987958] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-01T17:51:40.988038] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-01T17:51:41.220284] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-01T17:51:41.463588] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:51:41.702353] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-01T17:51:41.877248] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T17:51:42.502395] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-01T17:51:42.958432] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T17:51:43.302438] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-01T17:51:43.803197] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T17:51:43.805332] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (3.69 seconds). [2025-10-01T17:51:43.817207] [INFO ] [REMOTE ] BXMX: Full fetch complete (29043 records). [2025-10-01T17:51:43.817983] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-01T17:51:44.115201] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-01T17:51:44.246608] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-01T17:51:44.246725] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-01T17:51:44.247213] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-01T17:51:44.247258] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-01T17:51:44.248890] [DEBUG] [LOCAL ] BXMX: Trimmed 29043 records to 19559 (keeping 200 days of data) [2025-10-01T17:51:44.377323] [DEBUG] [LOCAL ] BXMX: Primary data saved (19559 records). [2025-10-01T17:51:44.377471] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-01T17:51:44.377550] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 31.4s. Estimated remaining: 4h 35m 58s. Rate: 7.2 symbols/min [2025-10-01T17:51:44.571087] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:51:44.667881] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T17:51:44.665841] [DEBUG] [LOCAL ] BYD: Loaded 45002 existing records from primary storage. [2025-10-01T17:51:44.678481] [INFO ] [MAIN ] BYD: Loaded 45002 existing records. [2025-10-01T17:51:44.890051] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:51:44.890257] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-01T17:51:44.890308] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-01T17:51:44.892083] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-01T17:51:44.892160] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-01T17:51:44.913140] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-01T17:51:45.239777] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T17:51:45.318677] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:51:45.702390] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-01T17:51:46.205360] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T17:51:46.502386] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-01T17:51:47.023473] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T17:51:47.302410] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-01T17:51:47.430232] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T17:51:47.951979] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T17:51:48.102395] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-01T17:51:48.902403] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-01T17:51:49.702413] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-01T17:51:49.922556] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T17:51:50.496002] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T17:51:50.504804] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-01T17:51:51.302352] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-01T17:51:51.342696] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T17:51:51.465852] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T17:51:52.102401] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-01T17:51:52.446011] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T17:51:52.902402] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-01T17:51:53.619845] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T17:51:53.702396] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-01T17:51:54.014686] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T17:51:54.502391] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-01T17:51:54.897785] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T17:51:55.302390] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-01T17:51:55.509067] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T17:51:56.102388] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-01T17:51:56.744925] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T17:51:56.902394] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-01T17:51:57.577146] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T17:51:57.702377] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-01T17:51:58.477440] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T17:51:58.502467] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-01T17:51:59.302421] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-01T17:51:59.543741] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T17:51:59.917723] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T17:52:00.102397] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-01T17:52:00.902360] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-01T17:52:00.947672] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T17:52:01.376405] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T17:52:01.702389] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-01T17:52:02.502396] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-01T17:52:02.554928] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T17:52:03.100260] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T17:52:03.302380] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-01T17:52:03.908187] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T17:52:04.102362] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-01T17:52:04.902350] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-01T17:52:05.031169] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T17:52:05.079128] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T17:52:05.702392] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-01T17:52:06.480796] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T17:52:06.502360] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-01T17:52:07.302391] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-01T17:52:07.792577] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T17:52:07.880778] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-01T17:52:07.882318] [INFO ] [REMOTE ] BXP: Full fetch complete (71460 records). [2025-10-01T17:52:07.882411] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-01T17:52:08.103759] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-01T17:52:08.347272] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T17:52:08.348448] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-01T17:52:08.354040] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-01T17:52:08.355211] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-01T17:52:08.355327] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-01T17:52:08.359102] [DEBUG] [LOCAL ] BXP: Trimmed 71460 records to 49856 (keeping 200 days of data) [2025-10-01T17:52:08.691377] [DEBUG] [LOCAL ] BXP: Primary data saved (49856 records). [2025-10-01T17:52:08.691539] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-01T17:52:08.691717] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 36.5s. Estimated remaining: 4h 37m 15s. Rate: 7.2 symbols/min [2025-10-01T17:52:08.879236] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:52:08.893152] [DEBUG] [LOCAL ] BYM: Loaded 12028 existing records from primary storage. [2025-10-01T17:52:08.893390] [INFO ] [MAIN ] BYM: Loaded 12028 existing records. [2025-10-01T17:52:08.907611] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-01T17:52:09.093496] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:52:09.093826] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-01T17:52:09.093909] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-01T17:52:09.095130] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-01T17:52:09.095207] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-01T17:52:09.488214] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:52:09.702431] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-01T17:52:09.979968] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-01T17:52:10.235430] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T17:52:10.502395] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-01T17:52:10.905567] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-01T17:52:10.906842] [INFO ] [REMOTE ] BY: Full fetch complete (29462 records). [2025-10-01T17:52:10.906930] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-01T17:52:11.305175] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-01T17:52:11.336873] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-01T17:52:11.338059] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-01T17:52:11.338862] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-01T17:52:11.338932] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-01T17:52:11.339990] [DEBUG] [LOCAL ] BY: Trimmed 29462 records to 21678 (keeping 200 days of data) [2025-10-01T17:52:11.481140] [DEBUG] [LOCAL ] BY: Primary data saved (21678 records). [2025-10-01T17:52:11.481279] [INFO ] [MAIN ] BY: Full history saved. [2025-10-01T17:52:11.481366] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BY took 30.9s. Estimated remaining: 4h 36m 37s. Rate: 7.2 symbols/min [2025-10-01T17:52:11.686338] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:52:11.720859] [DEBUG] [LOCAL ] BZH: Loaded 32445 existing records from primary storage. [2025-10-01T17:52:11.721285] [INFO ] [MAIN ] BZH: Loaded 32445 existing records. [2025-10-01T17:52:11.972911] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T17:52:11.979913] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:52:11.990372] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-01T17:52:11.990605] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-01T17:52:11.992223] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-01T17:52:11.992289] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-01T17:52:12.107551] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-01T17:52:12.381828] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:52:12.902382] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-01T17:52:13.177340] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T17:52:13.358963] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T17:52:13.360373] [INFO ] [REMOTE ] BYD: Full fetch complete (64999 records). [2025-10-01T17:52:13.360475] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-01T17:52:13.704308] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-01T17:52:13.812438] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-01T17:52:13.812605] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-01T17:52:13.814379] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-01T17:52:13.814449] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-01T17:52:13.816002] [DEBUG] [LOCAL ] BYD: Trimmed 64999 records to 44923 (keeping 200 days of data) [2025-10-01T17:52:14.113586] [DEBUG] [LOCAL ] BYD: Primary data saved (44923 records). [2025-10-01T17:52:14.113771] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-01T17:52:14.113883] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BYD took 29.7s. Estimated remaining: 4h 35m 59s. Rate: 7.2 symbols/min [2025-10-01T17:52:14.245672] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T17:52:14.327313] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:52:14.385426] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-01T17:52:14.385804] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-01T17:52:14.507609] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-01T17:52:14.584759] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:52:14.584986] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-01T17:52:14.585043] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-01T17:52:14.586799] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-01T17:52:14.586870] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-01T17:52:14.978433] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:52:15.042051] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T17:52:15.302386] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-01T17:52:15.735599] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T17:52:16.102422] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-01T17:52:16.902445] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-01T17:52:17.240042] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T17:52:17.702392] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-01T17:52:18.177032] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-01T17:52:18.246359] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T17:52:18.502413] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-01T17:52:19.302419] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-01T17:52:19.633461] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T17:52:20.045184] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-01T17:52:20.046859] [INFO ] [REMOTE ] BXSL: Full fetch complete (69435 records). [2025-10-01T17:52:20.046975] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-01T17:52:20.107597] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-01T17:52:20.287483] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T17:52:20.506767] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-01T17:52:20.506865] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-01T17:52:20.507699] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-01T17:52:20.507773] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-01T17:52:20.509306] [DEBUG] [LOCAL ] BXSL: Trimmed 69435 records to 47639 (keeping 200 days of data) [2025-10-01T17:52:20.825488] [DEBUG] [LOCAL ] BXSL: Primary data saved (47639 records). [2025-10-01T17:52:20.825625] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-01T17:52:20.825757] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BXSL took 42.0s. Estimated remaining: 4h 35m 42s. Rate: 7.2 symbols/min [2025-10-01T17:52:20.908004] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-01T17:52:21.014407] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:52:21.034442] [DEBUG] [LOCAL ] CAAP: Loaded 19924 existing records from primary storage. [2025-10-01T17:52:21.034705] [INFO ] [MAIN ] CAAP: Loaded 19924 existing records. [2025-10-01T17:52:21.233979] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:52:21.234228] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-01T17:52:21.234284] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-01T17:52:21.236016] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-01T17:52:21.236081] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-01T17:52:21.653748] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:52:21.675365] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T17:52:21.702366] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-01T17:52:21.758501] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T17:52:22.502367] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-01T17:52:22.993516] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T17:52:23.251788] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T17:52:23.302387] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-01T17:52:24.102355] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-01T17:52:24.415001] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T17:52:24.773828] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-01T17:52:24.902412] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-01T17:52:25.702395] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-01T17:52:25.775907] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T17:52:26.502360] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-01T17:52:26.647236] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T17:52:27.302434] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-01T17:52:28.102392] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-01T17:52:28.113799] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T17:52:28.486601] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-01T17:52:28.822394] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T17:52:28.902406] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-01T17:52:29.702379] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-01T17:52:30.481488] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T17:52:30.502363] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-01T17:52:30.833285] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T17:52:31.302374] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-01T17:52:31.711527] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T17:52:32.102367] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-01T17:52:32.197783] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T17:52:32.902424] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-01T17:52:33.115204] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T17:52:33.702390] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-01T17:52:34.204198] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T17:52:34.432952] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T17:52:34.502417] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-01T17:52:35.302379] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-01T17:52:35.377462] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T17:52:36.102395] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-01T17:52:36.368629] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T17:52:36.902423] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-01T17:52:37.256486] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T17:52:37.702347] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-01T17:52:37.754993] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T17:52:38.476500] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T17:52:38.502387] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-01T17:52:39.183250] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T17:52:39.302391] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-01T17:52:40.102412] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-01T17:52:40.902384] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-01T17:52:41.322524] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-01T17:52:41.323571] [INFO ] [REMOTE ] BZH: Full fetch complete (46905 records). [2025-10-01T17:52:41.323673] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-01T17:52:41.707516] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-01T17:52:41.792447] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-01T17:52:41.792535] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-01T17:52:41.793230] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-01T17:52:41.793297] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-01T17:52:41.794435] [DEBUG] [LOCAL ] BZH: Trimmed 46905 records to 32356 (keeping 200 days of data) [2025-10-01T17:52:41.896395] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T17:52:42.012004] [DEBUG] [LOCAL ] BZH: Primary data saved (32356 records). [2025-10-01T17:52:42.012149] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-01T17:52:42.012234] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BZH took 30.5s. Estimated remaining: 4h 36m 41s. Rate: 7.2 symbols/min [2025-10-01T17:52:42.198965] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:52:42.218783] [DEBUG] [LOCAL ] CABO: Loaded 17138 existing records from primary storage. [2025-10-01T17:52:42.219025] [INFO ] [MAIN ] CABO: Loaded 17138 existing records. [2025-10-01T17:52:42.414121] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:52:42.414343] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-01T17:52:42.414485] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-01T17:52:42.415042] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-01T17:52:42.415152] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-01T17:52:42.506545] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-01T17:52:42.635908] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-01T17:52:42.860716] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:52:42.938327] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-01T17:52:42.939590] [INFO ] [REMOTE ] BYM: Full fetch complete (18062 records). [2025-10-01T17:52:42.939708] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-01T17:52:43.312481] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-01T17:52:43.352967] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-01T17:52:43.353049] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-01T17:52:43.353440] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-01T17:52:43.353486] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-01T17:52:43.354265] [DEBUG] [LOCAL ] BYM: Trimmed 18062 records to 12042 (keeping 200 days of data) [2025-10-01T17:52:43.433773] [DEBUG] [LOCAL ] BYM: Primary data saved (12042 records). [2025-10-01T17:52:43.433919] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-01T17:52:43.434007] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BYM took 34.7s. Estimated remaining: 4h 35m 57s. Rate: 7.2 symbols/min [2025-10-01T17:52:43.622420] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:52:43.647259] [DEBUG] [LOCAL ] CACI: Loaded 24598 existing records from primary storage. [2025-10-01T17:52:43.647514] [INFO ] [MAIN ] CACI: Loaded 24598 existing records. [2025-10-01T17:52:43.855763] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:52:43.866534] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-01T17:52:43.867308] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-01T17:52:43.868036] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T17:52:43.874208] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-01T17:52:43.874476] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-01T17:52:44.114208] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-01T17:52:44.290143] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:52:44.902399] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-01T17:52:45.562319] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-01T17:52:45.667433] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-01T17:52:45.668600] [INFO ] [REMOTE ] CAAP: Full fetch complete (27927 records). [2025-10-01T17:52:45.668751] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-01T17:52:45.703972] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-01T17:52:45.806618] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T17:52:46.078230] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-01T17:52:46.078319] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-01T17:52:46.078829] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-01T17:52:46.078902] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-01T17:52:46.079633] [DEBUG] [LOCAL ] CAAP: Trimmed 27927 records to 19995 (keeping 200 days of data) [2025-10-01T17:52:46.202812] [DEBUG] [LOCAL ] CAAP: Primary data saved (19995 records). [2025-10-01T17:52:46.202961] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-01T17:52:46.203058] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 25.4s. Estimated remaining: 4h 35m 20s. Rate: 7.2 symbols/min [2025-10-01T17:52:46.391660] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:52:46.441508] [DEBUG] [LOCAL ] CADE: Loaded 48810 existing records from primary storage. [2025-10-01T17:52:46.441869] [INFO ] [MAIN ] CADE: Loaded 48810 existing records. [2025-10-01T17:52:46.507869] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-01T17:52:46.632771] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:52:46.632996] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-01T17:52:46.633045] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-01T17:52:46.634711] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-01T17:52:46.634776] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-01T17:52:47.026836] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T17:52:47.054758] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:52:47.248980] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T17:52:47.302348] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-01T17:52:48.102378] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-01T17:52:48.780889] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T17:52:48.902379] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-01T17:52:49.702388] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-01T17:52:49.921113] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T17:52:50.502446] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-01T17:52:50.780722] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T17:52:51.094420] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-01T17:52:51.302444] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-01T17:52:51.660409] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T17:52:52.102398] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-01T17:52:52.902357] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-01T17:52:53.398840] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-01T17:52:53.480335] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T17:52:53.499720] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T17:52:53.702384] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-01T17:52:54.502393] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-01T17:52:54.833607] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T17:52:55.302411] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-01T17:52:56.102391] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-01T17:52:56.493393] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T17:52:56.693370] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T17:52:56.902376] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-01T17:52:57.624542] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T17:52:57.702354] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-01T17:52:58.084982] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T17:52:58.502381] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-01T17:52:59.084618] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T17:52:59.302391] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-01T17:52:59.962785] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T17:53:00.102367] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-01T17:53:00.234140] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T17:53:00.902374] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-01T17:53:01.702284] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-01T17:53:01.734030] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T17:53:01.847279] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T17:53:02.502369] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-01T17:53:02.579723] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T17:53:03.302359] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-01T17:53:03.439441] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T17:53:04.102394] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-01T17:53:04.902432] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-01T17:53:05.467749] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-01T17:53:05.691801] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T17:53:05.702357] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-01T17:53:05.745782] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T17:53:06.502435] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-01T17:53:07.302399] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-01T17:53:07.674146] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T17:53:07.854283] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T17:53:08.102423] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-01T17:53:08.810042] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T17:53:08.811181] [INFO ] [REMOTE ] CACI: Full fetch complete (38925 records). [2025-10-01T17:53:08.811262] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-01T17:53:08.907495] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-01T17:53:09.227686] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-01T17:53:09.227780] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-01T17:53:09.228350] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-01T17:53:09.228401] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-01T17:53:09.229306] [DEBUG] [LOCAL ] CACI: Trimmed 38925 records to 24519 (keeping 200 days of data) [2025-10-01T17:53:09.392021] [DEBUG] [LOCAL ] CACI: Primary data saved (24519 records). [2025-10-01T17:53:09.392232] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-01T17:53:09.392330] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CACI took 26.0s. Estimated remaining: 4h 36m 29s. Rate: 7.2 symbols/min [2025-10-01T17:53:09.579759] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:53:09.617360] [DEBUG] [LOCAL ] CAE: Loaded 39024 existing records from primary storage. [2025-10-01T17:53:09.617700] [INFO ] [MAIN ] CAE: Loaded 39024 existing records. [2025-10-01T17:53:09.707495] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-01T17:53:09.822231] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:53:09.822520] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-01T17:53:09.822576] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-01T17:53:09.824833] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-01T17:53:09.824911] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-01T17:53:10.241963] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:53:10.502381] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-01T17:53:10.619780] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T17:53:10.681571] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T17:53:11.114144] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-01T17:53:11.115786] [INFO ] [REMOTE ] C: Full fetch complete (77785 records). [2025-10-01T17:53:11.115888] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-01T17:53:11.311760] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-01T17:53:11.597351] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-01T17:53:11.597444] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-01T17:53:11.598349] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-01T17:53:11.598421] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-01T17:53:11.600195] [DEBUG] [LOCAL ] C: Trimmed 77785 records to 53741 (keeping 200 days of data) [2025-10-01T17:53:11.854571] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T17:53:11.983040] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-01T17:53:11.983184] [INFO ] [MAIN ] C: Full history saved. [2025-10-01T17:53:11.983267] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 57.9s. Estimated remaining: 4h 35m 51s. Rate: 7.2 symbols/min [2025-10-01T17:53:12.107461] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-01T17:53:12.184732] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:53:12.184935] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-10-01T17:53:12.185029] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-10-01T17:53:12.185144] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-01T17:53:12.185197] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-01T17:53:12.185247] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-01T17:53:12.185283] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-01T17:53:12.589403] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:53:12.602950] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T17:53:12.902408] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-01T17:53:13.509450] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T17:53:13.702411] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-01T17:53:14.291522] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T17:53:14.502391] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-01T17:53:15.173321] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T17:53:15.302394] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-01T17:53:16.102365] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-01T17:53:16.206477] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-01T17:53:16.790330] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-01T17:53:16.791908] [INFO ] [REMOTE ] CADE: Full fetch complete (69868 records). [2025-10-01T17:53:16.792006] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-01T17:53:16.905587] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-01T17:53:17.224523] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-01T17:53:17.224751] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-01T17:53:17.225568] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-01T17:53:17.225615] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-01T17:53:17.227255] [DEBUG] [LOCAL ] CADE: Trimmed 69868 records to 48856 (keeping 200 days of data) [2025-10-01T17:53:17.348525] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T17:53:17.579580] [DEBUG] [LOCAL ] CADE: Primary data saved (48856 records). [2025-10-01T17:53:17.579751] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-01T17:53:17.579860] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CADE took 31.4s. Estimated remaining: 4h 35m 28s. Rate: 7.2 symbols/min [2025-10-01T17:53:17.707473] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-01T17:53:17.773903] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:53:17.830149] [DEBUG] [LOCAL ] CAG: Loaded 53661 existing records from primary storage. [2025-10-01T17:53:17.830492] [INFO ] [MAIN ] CAG: Loaded 53661 existing records. [2025-10-01T17:53:18.038712] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T17:53:18.037925] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:53:18.042798] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-01T17:53:18.042971] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-01T17:53:18.043992] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-01T17:53:18.044056] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-01T17:53:18.419147] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:53:18.502385] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-01T17:53:19.302434] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-01T17:53:19.359056] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T17:53:20.102405] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-01T17:53:20.211532] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T17:53:20.290748] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T17:53:20.902377] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-01T17:53:21.607720] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T17:53:21.702363] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-01T17:53:22.383637] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T17:53:22.502388] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-01T17:53:22.679777] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T17:53:23.302389] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-01T17:53:23.618303] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T17:53:23.619353] [INFO ] [REMOTE ] CABO: Full fetch complete (23141 records). [2025-10-01T17:53:23.619437] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-01T17:53:23.738840] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-01T17:53:24.039606] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-01T17:53:24.039714] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-01T17:53:24.040109] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-01T17:53:24.040159] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-01T17:53:24.040861] [DEBUG] [LOCAL ] CABO: Trimmed 23141 records to 17049 (keeping 200 days of data) [2025-10-01T17:53:24.116873] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-01T17:53:24.151382] [DEBUG] [LOCAL ] CABO: Primary data saved (17049 records). [2025-10-01T17:53:24.151506] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-01T17:53:24.151586] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CABO took 42.1s. Estimated remaining: 4h 35m 11s. Rate: 7.2 symbols/min [2025-10-01T17:53:24.352288] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:53:24.409602] [DEBUG] [LOCAL ] CAH: Loaded 51417 existing records from primary storage. [2025-10-01T17:53:24.409962] [INFO ] [MAIN ] CAH: Loaded 51417 existing records. [2025-10-01T17:53:24.613127] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:53:24.613335] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-01T17:53:24.613397] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-01T17:53:24.614982] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-01T17:53:24.615047] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-01T17:53:24.907565] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-01T17:53:25.035019] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:53:25.554813] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T17:53:25.702349] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-01T17:53:25.851247] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T17:53:26.502383] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-01T17:53:26.858746] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T17:53:27.302445] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-01T17:53:28.109224] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-01T17:53:28.143767] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T17:53:28.847091] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T17:53:28.902434] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-01T17:53:29.702420] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-01T17:53:29.847412] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T17:53:30.348802] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T17:53:30.426361] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T17:53:30.502391] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-01T17:53:31.302445] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-01T17:53:31.672624] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T17:53:31.777567] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-01T17:53:32.102410] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-01T17:53:32.902432] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-01T17:53:33.702370] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-01T17:53:33.805914] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T17:53:34.282692] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T17:53:34.499049] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T17:53:34.509778] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-01T17:53:35.302399] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-01T17:53:36.102398] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-01T17:53:36.446058] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T17:53:36.447473] [INFO ] [REMOTE ] CAE: Full fetch complete (55993 records). [2025-10-01T17:53:36.447570] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-01T17:53:36.890266] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-01T17:53:36.890390] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-01T17:53:36.891296] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-01T17:53:36.891387] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-01T17:53:36.892838] [DEBUG] [LOCAL ] CAE: Trimmed 55993 records to 39036 (keeping 200 days of data) [2025-10-01T17:53:36.945050] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-01T17:53:37.046077] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T17:53:37.195524] [DEBUG] [LOCAL ] CAE: Primary data saved (39036 records). [2025-10-01T17:53:37.195728] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-01T17:53:37.195864] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAE took 27.8s. Estimated remaining: 4h 35m 27s. Rate: 7.2 symbols/min [2025-10-01T17:53:37.394534] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:53:37.394790] [DEBUG] [LOCAL ] CAL: No existing data file found in primary storage. [2025-10-01T17:53:37.394846] [WARN ] [MAIN ] CAL: No existing data found, performing full refresh instead. [2025-10-01T17:53:37.394986] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-01T17:53:37.395042] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-01T17:53:37.395113] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-01T17:53:37.395161] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-01T17:53:37.539324] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T17:53:37.707635] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-01T17:53:37.844249] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:53:38.001895] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T17:53:38.227259] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-01T17:53:38.502433] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-01T17:53:39.302394] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-01T17:53:39.761575] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T17:53:40.102416] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-01T17:53:40.579434] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-01T17:53:40.902490] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-01T17:53:40.946718] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T17:53:41.702494] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-01T17:53:41.947888] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T17:53:42.293269] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T17:53:42.502439] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-01T17:53:43.302465] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-01T17:53:43.729324] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T17:53:44.102408] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-01T17:53:44.902368] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-01T17:53:45.311941] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T17:53:45.702439] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-01T17:53:45.926118] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T17:53:46.502384] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-01T17:53:47.014561] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-01T17:53:47.302374] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-01T17:53:47.593192] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T17:53:47.872609] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T17:53:48.102383] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-01T17:53:48.824265] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T17:53:48.902373] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-01T17:53:49.702418] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-01T17:53:50.131245] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-01T17:53:50.273638] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T17:53:50.502389] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-01T17:53:50.560888] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T17:53:50.561761] [INFO ] [REMOTE ] CAF: Full fetch complete (5554 records). [2025-10-01T17:53:50.561835] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-01T17:53:50.968779] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-01T17:53:50.968861] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-01T17:53:50.969028] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-01T17:53:50.969069] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-01T17:53:50.969436] [DEBUG] [LOCAL ] CAF: Trimmed 5554 records to 3394 (keeping 200 days of data) [2025-10-01T17:53:50.996184] [DEBUG] [LOCAL ] CAF: Primary data saved (3394 records). [2025-10-01T17:53:50.996317] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-01T17:53:50.996449] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAF took 39.0s. Estimated remaining: 4h 35m 47s. Rate: 7.2 symbols/min [2025-10-01T17:53:51.192923] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:53:51.236848] [DEBUG] [LOCAL ] CALX: Loaded 37984 existing records from primary storage. [2025-10-01T17:53:51.237136] [INFO ] [MAIN ] CALX: Loaded 37984 existing records. [2025-10-01T17:53:51.307594] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-01T17:53:51.431685] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:53:51.431919] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-01T17:53:51.431968] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-01T17:53:51.433036] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-01T17:53:51.433097] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-01T17:53:51.855137] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:53:52.066807] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T17:53:52.102377] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-01T17:53:52.902388] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-01T17:53:53.382421] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-01T17:53:53.702357] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-01T17:53:53.815390] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T17:53:54.501248] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T17:53:54.513600] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-01T17:53:55.302396] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-01T17:53:56.102387] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-01T17:53:56.333664] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-01T17:53:56.335263] [INFO ] [REMOTE ] CAG: Full fetch complete (77652 records). [2025-10-01T17:53:56.335414] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-01T17:53:56.835554] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T17:53:56.854610] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-01T17:53:56.862571] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-01T17:53:56.864170] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-01T17:53:56.894106] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-01T17:53:56.897242] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-01T17:53:56.908512] [DEBUG] [LOCAL ] CAG: Trimmed 77652 records to 53663 (keeping 200 days of data) [2025-10-01T17:53:56.907935] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-01T17:53:57.273067] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T17:53:57.301072] [DEBUG] [LOCAL ] CAG: Primary data saved (53663 records). [2025-10-01T17:53:57.301220] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-01T17:53:57.301308] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 39.7s. Estimated remaining: 4h 35m 28s. Rate: 7.2 symbols/min [2025-10-01T17:53:57.488158] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:53:57.515314] [DEBUG] [LOCAL ] CANG: Loaded 27013 existing records from primary storage. [2025-10-01T17:53:57.515598] [INFO ] [MAIN ] CANG: Loaded 27013 existing records. [2025-10-01T17:53:57.707471] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-01T17:53:57.753721] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:53:57.754017] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-01T17:53:57.754066] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-01T17:53:57.756222] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-01T17:53:57.756323] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-01T17:53:58.160560] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:53:58.358266] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T17:53:58.502388] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-01T17:53:59.268112] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T17:53:59.302381] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-01T17:53:59.947135] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T17:54:00.102376] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-01T17:54:00.756472] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T17:54:00.902375] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-01T17:54:01.702385] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-01T17:54:02.026810] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T17:54:02.502412] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-01T17:54:02.507328] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-01T17:54:02.508842] [INFO ] [REMOTE ] CAL: Full fetch complete (61850 records). [2025-10-01T17:54:02.508931] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-01T17:54:02.941250] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-01T17:54:02.941367] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-01T17:54:02.942125] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-01T17:54:02.942208] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-01T17:54:02.943930] [DEBUG] [LOCAL ] CAL: Trimmed 61850 records to 43156 (keeping 200 days of data) [2025-10-01T17:54:03.069855] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T17:54:03.268856] [DEBUG] [LOCAL ] CAL: Primary data saved (43156 records). [2025-10-01T17:54:03.269050] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-01T17:54:03.269185] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 26.1s. Estimated remaining: 4h 35m 7s. Rate: 7.2 symbols/min [2025-10-01T17:54:03.307490] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-01T17:54:03.455915] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:03.462723] [DEBUG] [LOCAL ] CAPL: Loaded 5788 existing records from primary storage. [2025-10-01T17:54:03.462956] [INFO ] [MAIN ] CAPL: Loaded 5788 existing records. [2025-10-01T17:54:03.660872] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:03.661112] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-01T17:54:03.661164] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-01T17:54:03.663513] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-01T17:54:03.663590] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-01T17:54:04.070764] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:04.102399] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-01T17:54:04.188988] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T17:54:04.902359] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-01T17:54:05.642945] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T17:54:05.702360] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-01T17:54:05.853971] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T17:54:05.906565] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-01T17:54:05.908904] [INFO ] [REMOTE ] CAH: Full fetch complete (74615 records). [2025-10-01T17:54:05.909073] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-01T17:54:06.360087] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-01T17:54:06.360456] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-01T17:54:06.361463] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-01T17:54:06.361530] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-01T17:54:06.363179] [DEBUG] [LOCAL ] CAH: Trimmed 74615 records to 51417 (keeping 200 days of data) [2025-10-01T17:54:06.502542] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-01T17:54:06.747767] [DEBUG] [LOCAL ] CAH: Primary data saved (51417 records). [2025-10-01T17:54:06.747945] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-01T17:54:06.748052] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 42.6s. Estimated remaining: 4h 34m 34s. Rate: 7.2 symbols/min [2025-10-01T17:54:06.950895] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:07.008029] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-10-01T17:54:07.008415] [INFO ] [MAIN ] CARR: Loaded 53594 existing records. [2025-10-01T17:54:07.218801] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:07.219070] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-01T17:54:07.219120] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-01T17:54:07.221383] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-01T17:54:07.221448] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-01T17:54:07.310288] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-01T17:54:07.476380] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T17:54:07.688539] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:07.690135] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T17:54:07.878972] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T17:54:08.102422] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-01T17:54:08.902428] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-01T17:54:09.456508] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T17:54:09.702402] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-01T17:54:10.265165] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T17:54:10.502427] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-01T17:54:10.643243] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T17:54:11.302431] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-01T17:54:11.826469] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-01T17:54:12.042559] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T17:54:12.102355] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-01T17:54:12.902425] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-01T17:54:13.358928] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T17:54:13.702373] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-01T17:54:14.042426] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T17:54:14.417931] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T17:54:14.502437] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-01T17:54:15.302378] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-01T17:54:15.539961] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T17:54:16.102395] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-01T17:54:16.500866] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T17:54:16.902421] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-01T17:54:17.366374] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T17:54:17.702413] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-01T17:54:18.223802] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T17:54:18.268151] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T17:54:18.502387] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-01T17:54:19.302406] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-01T17:54:19.893365] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T17:54:20.102366] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-01T17:54:20.297832] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T17:54:20.299079] [INFO ] [REMOTE ] CALX: Full fetch complete (54049 records). [2025-10-01T17:54:20.299177] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-01T17:54:20.638824] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-01T17:54:20.740039] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-01T17:54:20.740129] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-01T17:54:20.740875] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-01T17:54:20.740944] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-01T17:54:20.742273] [DEBUG] [LOCAL ] CALX: Trimmed 54049 records to 37899 (keeping 200 days of data) [2025-10-01T17:54:20.924281] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-01T17:54:21.004589] [DEBUG] [LOCAL ] CALX: Primary data saved (37899 records). [2025-10-01T17:54:21.004822] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-01T17:54:21.004931] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 30.0s. Estimated remaining: 4h 34m 56s. Rate: 7.2 symbols/min [2025-10-01T17:54:21.214597] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:21.261686] [DEBUG] [LOCAL ] CARS: Loaded 39829 existing records from primary storage. [2025-10-01T17:54:21.262000] [INFO ] [MAIN ] CARS: Loaded 39829 existing records. [2025-10-01T17:54:21.471944] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:21.477566] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-01T17:54:21.479201] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T17:54:21.479297] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-01T17:54:21.483009] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-01T17:54:21.483100] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-01T17:54:21.708594] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-01T17:54:21.895272] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:22.369739] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-01T17:54:22.502428] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-01T17:54:23.302438] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-01T17:54:23.969408] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T17:54:24.102390] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-01T17:54:24.676230] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T17:54:24.902382] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-01T17:54:25.159683] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T17:54:25.702386] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-01T17:54:25.780364] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-01T17:54:25.781166] [INFO ] [REMOTE ] CAPL: Full fetch complete (8816 records). [2025-10-01T17:54:25.781243] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-01T17:54:26.198586] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-01T17:54:26.198696] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-01T17:54:26.199015] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-01T17:54:26.199077] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-01T17:54:26.199630] [DEBUG] [LOCAL ] CAPL: Trimmed 8816 records to 5747 (keeping 200 days of data) [2025-10-01T17:54:26.238927] [DEBUG] [LOCAL ] CAPL: Primary data saved (5747 records). [2025-10-01T17:54:26.239072] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-01T17:54:26.239166] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAPL took 23.0s. Estimated remaining: 4h 34m 32s. Rate: 7.2 symbols/min [2025-10-01T17:54:26.435573] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:26.494796] [DEBUG] [LOCAL ] CAT: Loaded 52912 existing records from primary storage. [2025-10-01T17:54:26.495342] [INFO ] [MAIN ] CAT: Loaded 52912 existing records. [2025-10-01T17:54:26.511009] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-01T17:54:26.705489] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:26.705883] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-01T17:54:26.706037] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-01T17:54:26.707741] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-01T17:54:26.707834] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-01T17:54:26.848937] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T17:54:27.126723] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:27.302439] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-01T17:54:27.749139] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T17:54:28.102425] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-01T17:54:28.902422] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-01T17:54:29.344693] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T17:54:29.452242] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T17:54:29.702423] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-01T17:54:30.347415] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T17:54:30.502405] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-01T17:54:31.251842] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T17:54:31.302383] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-01T17:54:31.603505] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T17:54:32.102374] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-01T17:54:32.902374] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-01T17:54:33.002568] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T17:54:33.281760] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T17:54:33.702381] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-01T17:54:34.411503] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T17:54:34.502448] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-01T17:54:35.234486] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T17:54:35.302396] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-01T17:54:35.600327] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T17:54:36.102386] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-01T17:54:36.806927] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T17:54:36.902363] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-01T17:54:37.263190] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T17:54:37.702388] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-01T17:54:38.502436] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-01T17:54:38.718209] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T17:54:39.147405] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T17:54:39.302387] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-01T17:54:40.102396] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-01T17:54:40.169867] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T17:54:40.792602] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T17:54:40.902356] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-01T17:54:41.702421] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-01T17:54:41.890021] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T17:54:42.002700] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T17:54:42.502416] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-01T17:54:43.302351] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-01T17:54:43.770253] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T17:54:44.102386] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-01T17:54:44.408966] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T17:54:44.902364] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-01T17:54:44.947431] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T17:54:45.702415] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-01T17:54:45.792992] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T17:54:46.451041] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T17:54:46.502395] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-01T17:54:47.010080] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T17:54:47.302387] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-01T17:54:48.102386] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-01T17:54:48.472167] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T17:54:48.902405] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-01T17:54:49.133032] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-01T17:54:49.134472] [INFO ] [REMOTE ] CARS: Full fetch complete (55328 records). [2025-10-01T17:54:49.134564] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-01T17:54:49.563957] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-01T17:54:49.564055] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-01T17:54:49.564895] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-01T17:54:49.564963] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-01T17:54:49.566235] [DEBUG] [LOCAL ] CARS: Trimmed 55328 records to 39803 (keeping 200 days of data) [2025-10-01T17:54:49.741704] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-01T17:54:49.755060] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-01T17:54:49.782712] [INFO ] [REMOTE ] CANG: Full fetch complete (40543 records). [2025-10-01T17:54:49.783694] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-01T17:54:50.232177] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-01T17:54:50.232558] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-01T17:54:50.233865] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-01T17:54:50.234198] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-01T17:54:50.239094] [DEBUG] [LOCAL ] CANG: Trimmed 40543 records to 26966 (keeping 200 days of data) [2025-10-01T17:54:50.250392] [DEBUG] [LOCAL ] CARS: Primary data saved (39803 records). [2025-10-01T17:54:50.250538] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-01T17:54:50.250625] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CARS took 29.2s. Estimated remaining: 4h 35m 43s. Rate: 7.2 symbols/min [2025-10-01T17:54:50.551248] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:50.568621] [DEBUG] [LOCAL ] CATO: Loaded 7042 existing records from primary storage. [2025-10-01T17:54:50.571008] [INFO ] [MAIN ] CATO: Loaded 7042 existing records. [2025-10-01T17:54:50.854522] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:50.856150] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-01T17:54:50.858822] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-01T17:54:50.861620] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-01T17:54:50.862058] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-01T17:54:50.869423] [DEBUG] [LOCAL ] CANG: Primary data saved (26966 records). [2025-10-01T17:54:50.893844] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-01T17:54:50.924362] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CANG took 53.6s. Estimated remaining: 4h 34m 56s. Rate: 7.2 symbols/min [2025-10-01T17:54:51.459694] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-01T17:54:51.499593] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:51.537049] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-01T17:54:51.848718] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:51.876489] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-01T17:54:51.878719] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-10-01T17:54:51.880399] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-10-01T17:54:52.113301] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:52.113768] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-01T17:54:52.113927] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-01T17:54:52.124777] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-01T17:54:52.143292] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-01T17:54:52.218188] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-01T17:54:52.282461] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-01T17:54:52.550145] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:52.709945] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T17:54:52.902376] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-01T17:54:53.702367] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-01T17:54:53.787593] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T17:54:54.411890] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-01T17:54:54.413925] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-01T17:54:54.426558] [INFO ] [REMOTE ] CARR: Full fetch complete (77606 records). [2025-10-01T17:54:54.427152] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-01T17:54:54.507535] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-01T17:54:54.862227] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-01T17:54:54.862326] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-01T17:54:54.863214] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-01T17:54:54.863284] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-01T17:54:54.864816] [DEBUG] [LOCAL ] CARR: Trimmed 77606 records to 53594 (keeping 200 days of data) [2025-10-01T17:54:55.213399] [DEBUG] [LOCAL ] CARR: Primary data saved (53594 records). [2025-10-01T17:54:55.213569] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-01T17:54:55.213692] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 48.5s. Estimated remaining: 4h 34m 27s. Rate: 7.2 symbols/min [2025-10-01T17:54:55.310047] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-01T17:54:55.398967] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:55.447590] [DEBUG] [LOCAL ] CB: Loaded 49964 existing records from primary storage. [2025-10-01T17:54:55.448005] [INFO ] [MAIN ] CB: Loaded 49964 existing records. [2025-10-01T17:54:55.645074] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:55.645298] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-01T17:54:55.645348] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-01T17:54:55.647461] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-01T17:54:55.647532] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-01T17:54:55.971137] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T17:54:56.086466] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:56.102418] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-01T17:54:56.104373] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-01T17:54:56.902409] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-01T17:54:57.207375] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-01T17:54:57.209160] [INFO ] [REMOTE ] CAT: Full fetch complete (76678 records). [2025-10-01T17:54:57.209264] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-01T17:54:57.633803] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-01T17:54:57.634027] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-01T17:54:57.635010] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-01T17:54:57.635147] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-01T17:54:57.636810] [DEBUG] [LOCAL ] CAT: Trimmed 76678 records to 52920 (keeping 200 days of data) [2025-10-01T17:54:57.703226] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-01T17:54:57.931181] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T17:54:58.055836] [DEBUG] [LOCAL ] CAT: Primary data saved (52920 records). [2025-10-01T17:54:58.056013] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-01T17:54:58.056113] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CAT took 31.8s. Estimated remaining: 4h 33m 52s. Rate: 7.2 symbols/min [2025-10-01T17:54:58.252211] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:54:58.269205] [DEBUG] [LOCAL ] CBAN: Loaded 10891 existing records from primary storage. [2025-10-01T17:54:58.269558] [INFO ] [MAIN ] CBAN: Loaded 10891 existing records. [2025-10-01T17:54:58.389631] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T17:54:58.475759] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:54:58.476023] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-01T17:54:58.476073] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-01T17:54:58.476546] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-01T17:54:58.476610] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-01T17:54:58.515855] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-01T17:54:58.929243] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:54:58.961521] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-01T17:54:59.302357] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-01T17:55:00.080945] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T17:55:00.102356] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-01T17:55:00.902371] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-01T17:55:01.016746] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T17:55:01.604013] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T17:55:01.702392] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-01T17:55:01.806674] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T17:55:02.502460] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-01T17:55:03.187867] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T17:55:03.302475] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-01T17:55:03.477120] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T17:55:03.824549] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T17:55:04.102467] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-01T17:55:04.714942] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T17:55:04.902392] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-01T17:55:05.512335] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T17:55:05.702442] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-01T17:55:06.162633] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T17:55:06.502465] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-01T17:55:07.277125] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T17:55:07.302421] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-01T17:55:07.861497] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T17:55:08.102391] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-01T17:55:08.902422] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-01T17:55:09.702427] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-01T17:55:09.838680] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-01T17:55:09.839417] [INFO ] [REMOTE ] CATO: Full fetch complete (11518 records). [2025-10-01T17:55:09.839488] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-01T17:55:10.293592] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-01T17:55:10.293856] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-01T17:55:10.294278] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-01T17:55:10.320909] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-01T17:55:10.326830] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-01T17:55:10.325479] [DEBUG] [LOCAL ] CATO: Trimmed 11518 records to 7016 (keeping 200 days of data) [2025-10-01T17:55:10.382418] [DEBUG] [LOCAL ] CATO: Primary data saved (7016 records). [2025-10-01T17:55:10.382581] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-01T17:55:10.382703] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CATO took 20.1s. Estimated remaining: 4h 34m 3s. Rate: 7.2 symbols/min [2025-10-01T17:55:10.502447] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-01T17:55:10.598687] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T17:55:11.302403] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-01T17:55:12.102437] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-01T17:55:12.747785] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-01T17:55:12.902404] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-01T17:55:13.242707] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T17:55:13.275388] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T17:55:13.702394] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-01T17:55:14.502450] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-01T17:55:14.609596] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T17:55:14.663146] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T17:55:15.302386] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-01T17:55:16.102363] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-01T17:55:16.218694] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T17:55:16.902376] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-01T17:55:17.114839] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T17:55:17.501586] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-01T17:55:17.702388] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-01T17:55:18.434029] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T17:55:18.502427] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-01T17:55:19.281619] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T17:55:19.302364] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-01T17:55:19.373783] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T17:55:19.902569] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T17:55:20.102413] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-01T17:55:20.902414] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-01T17:55:21.369017] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-01T17:55:21.702357] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-01T17:55:21.875383] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T17:55:22.502463] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-01T17:55:23.302399] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-01T17:55:23.450877] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T17:55:24.102392] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-01T17:55:24.131699] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T17:55:24.767578] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-01T17:55:24.902407] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-01T17:55:25.702452] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-01T17:55:25.839079] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T17:55:25.885532] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T17:55:25.886367] [INFO ] [REMOTE ] CBAN: Full fetch complete (16135 records). [2025-10-01T17:55:25.886441] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-01T17:55:26.302465] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-01T17:55:26.302566] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-01T17:55:26.303016] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-01T17:55:26.303068] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-01T17:55:26.303632] [DEBUG] [LOCAL ] CBAN: Trimmed 16135 records to 10857 (keeping 200 days of data) [2025-10-01T17:55:26.373269] [DEBUG] [LOCAL ] CBAN: Primary data saved (10857 records). [2025-10-01T17:55:26.373433] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-01T17:55:26.373540] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 28.3s. Estimated remaining: 4h 34m 33s. Rate: 7.2 symbols/min [2025-10-01T17:55:26.502386] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-01T17:55:27.337979] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T17:55:27.350325] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-01T17:55:28.751774] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T17:55:28.753320] [INFO ] [REMOTE ] CB: Full fetch complete (72672 records). [2025-10-01T17:55:28.753425] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-01T17:55:29.186613] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-01T17:55:29.186794] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-01T17:55:29.188051] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-01T17:55:29.188135] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-01T17:55:29.190015] [DEBUG] [LOCAL ] CB: Trimmed 72672 records to 49947 (keeping 200 days of data) [2025-10-01T17:55:29.547897] [DEBUG] [LOCAL ] CB: Primary data saved (49947 records). [2025-10-01T17:55:29.548085] [INFO ] [MAIN ] CB: Full history saved. [2025-10-01T17:55:29.548210] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CB took 34.3s. Estimated remaining: 4h 33m 59s. Rate: 7.2 symbols/min [2025-10-01T17:55:30.455751] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (3.11 seconds). [2025-10-01T17:55:30.457475] [INFO ] [REMOTE ] CAVA: Full fetch complete (77291 records). [2025-10-01T17:55:30.457616] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-01T17:55:30.913741] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-01T17:55:30.913840] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-01T17:55:30.914764] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-01T17:55:30.914832] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-01T17:55:30.916451] [DEBUG] [LOCAL ] CAVA: Trimmed 77291 records to 53552 (keeping 200 days of data) [2025-10-01T17:55:31.260788] [DEBUG] [LOCAL ] CAVA: Primary data saved (53552 records). [2025-10-01T17:55:31.260933] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-01T17:55:31.261016] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CAVA took 40.3s. Estimated remaining: 4h 33m 18s. Rate: 7.2 symbols/min [2025-10-01T17:55:31.989786] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:31.986005] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:32.055187] [DEBUG] [LOCAL ] CBNA: No existing data file found in primary storage. [2025-10-01T17:55:32.085210] [WARN ] [MAIN ] CBNA: No existing data found, performing full refresh instead. [2025-10-01T17:55:32.106785] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:32.135451] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:32.135605] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-01T17:55:32.135941] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-01T17:55:32.136054] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-01T17:55:32.136360] [DEBUG] [LOCAL ] CBNA: No primary data file found to delete. [2025-10-01T17:55:32.136672] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-01T17:55:32.136546] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-01T17:55:32.149372] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-01T17:55:32.160579] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-01T17:55:32.175339] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-01T17:55:32.186476] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-01T17:55:32.320209] [DEBUG] [LOCAL ] CBL: Loaded 16317 existing records from primary storage. [2025-10-01T17:55:32.374785] [INFO ] [MAIN ] CBL: Loaded 16317 existing records. [2025-10-01T17:55:32.589850] [DEBUG] [LOCAL ] CBRE: Loaded 50590 existing records from primary storage. [2025-10-01T17:55:32.755776] [INFO ] [MAIN ] CBRE: Loaded 50590 existing records. [2025-10-01T17:55:33.160220] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:55:33.215143] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-01T17:55:33.234222] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-01T17:55:33.291326] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:33.335354] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-01T17:55:33.335085] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-01T17:55:33.372864] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-01T17:55:33.412455] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:55:33.416123] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:33.416585] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-01T17:55:33.439773] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-01T17:55:33.450463] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-01T17:55:33.490221] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-01T17:55:33.502867] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-01T17:55:33.703314] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:55:33.795163] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-01T17:55:33.870382] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:55:33.912559] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-01T17:55:33.917988] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:55:33.966907] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-01T17:55:34.018510] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-01T17:55:34.047171] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-01T17:55:34.052639] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-01T17:55:34.083904] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.8s. Estimated remaining: 4h 32m 43s. Rate: 7.2 symbols/min [2025-10-01T17:55:34.247636] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:34.284864] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-01T17:55:34.370919] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:34.372312] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-01T17:55:34.371943] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T17:55:34.398399] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-01T17:55:34.465353] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:34.496306] [DEBUG] [LOCAL ] CBT: Loaded 30830 existing records from primary storage. [2025-10-01T17:55:34.496706] [INFO ] [MAIN ] CBT: Loaded 30830 existing records. [2025-10-01T17:55:34.693532] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:55:34.693809] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-01T17:55:34.693866] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-01T17:55:34.694953] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-01T17:55:34.695017] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-01T17:55:35.086011] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T17:55:35.092606] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:35.095376] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-01T17:55:35.095017] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-01T17:55:35.414004] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-01T17:55:35.415421] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-01T17:55:35.534068] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T17:55:35.540170] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-01T17:55:35.871134] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T17:55:35.872882] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-01T17:55:35.874953] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T17:55:36.102387] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-01T17:55:36.363866] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-01T17:55:36.551576] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T17:55:36.649451] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T17:55:36.902399] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-01T17:55:37.624167] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T17:55:37.702403] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-01T17:55:37.890905] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T17:55:38.502404] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-01T17:55:39.307066] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-01T17:55:39.319015] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T17:55:39.339064] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T17:55:40.102385] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-01T17:55:40.601090] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T17:55:40.631191] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-01T17:55:40.902451] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-01T17:55:41.639697] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-01T17:55:41.702405] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-01T17:55:42.469575] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T17:55:42.502360] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-01T17:55:43.070992] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-01T17:55:43.302456] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-01T17:55:44.102384] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-01T17:55:44.520949] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-01T17:55:44.721059] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T17:55:44.902392] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-01T17:55:45.346942] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-01T17:55:45.702408] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-01T17:55:46.293160] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T17:55:46.502402] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-01T17:55:47.302395] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-01T17:55:47.756953] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T17:55:47.776212] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T17:55:48.102407] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-01T17:55:48.699201] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-01T17:55:48.699920] [INFO ] [REMOTE ] CBNA: Full fetch complete (4625 records). [2025-10-01T17:55:48.699993] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-01T17:55:48.907515] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-01T17:55:49.131046] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-01T17:55:49.131130] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-01T17:55:49.131279] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-01T17:55:49.131340] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-01T17:55:49.131721] [DEBUG] [LOCAL ] CBNA: Trimmed 4625 records to 2915 (keeping 200 days of data) [2025-10-01T17:55:49.149593] [DEBUG] [LOCAL ] CBNA: Primary data saved (2915 records). [2025-10-01T17:55:49.149687] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-01T17:55:49.149787] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 17.9s. Estimated remaining: 4h 33m 7s. Rate: 7.2 symbols/min [2025-10-01T17:55:49.333230] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:49.356286] [DEBUG] [LOCAL ] CBU: Loaded 22647 existing records from primary storage. [2025-10-01T17:55:49.356596] [INFO ] [MAIN ] CBU: Loaded 22647 existing records. [2025-10-01T17:55:49.564309] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:55:49.564565] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-01T17:55:49.564631] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-01T17:55:49.565449] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-01T17:55:49.565521] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-01T17:55:49.707520] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-01T17:55:49.977632] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:50.502379] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-01T17:55:50.587102] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T17:55:50.691257] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T17:55:51.238675] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T17:55:51.302369] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-01T17:55:52.101936] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T17:55:52.106712] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-01T17:55:52.902390] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-01T17:55:53.540456] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T17:55:53.596373] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T17:55:53.702409] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-01T17:55:54.502407] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-01T17:55:54.844820] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-01T17:55:54.845832] [INFO ] [REMOTE ] CBL: Full fetch complete (25497 records). [2025-10-01T17:55:54.845911] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-01T17:55:55.257533] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-01T17:55:55.257671] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-01T17:55:55.258130] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-01T17:55:55.258191] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-01T17:55:55.259248] [DEBUG] [LOCAL ] CBL: Trimmed 25497 records to 16243 (keeping 200 days of data) [2025-10-01T17:55:55.303306] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-01T17:55:55.366027] [DEBUG] [LOCAL ] CBL: Primary data saved (16243 records). [2025-10-01T17:55:55.366201] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-01T17:55:55.366313] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBL took 24.1s. Estimated remaining: 4h 32m 49s. Rate: 7.2 symbols/min [2025-10-01T17:55:55.560537] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:55.560791] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-01T17:55:55.560849] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-01T17:55:55.560962] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-01T17:55:55.561006] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-01T17:55:55.561050] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-01T17:55:55.561085] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-01T17:55:55.965944] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:56.102369] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-01T17:55:56.162036] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T17:55:56.357207] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T17:55:56.902405] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-01T17:55:57.088319] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:55:57.088705] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-01T17:55:57.088816] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:55:57.088880] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-01T17:55:57.088956] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:55:57.089026] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-01T17:55:57.089089] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-01T17:55:57.089126] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-01T17:55:57.089166] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-01T17:55:57.089213] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 1.7s. Estimated remaining: 4h 32m 8s. Rate: 7.2 symbols/min [2025-10-01T17:55:57.280220] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:55:57.320921] [DEBUG] [LOCAL ] CBZ: Loaded 33660 existing records from primary storage. [2025-10-01T17:55:57.321236] [INFO ] [MAIN ] CBZ: Loaded 33660 existing records. [2025-10-01T17:55:57.478906] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T17:55:57.567301] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:55:57.567531] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-01T17:55:57.567583] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-01T17:55:57.568633] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-01T17:55:57.568806] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-01T17:55:57.707532] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-01T17:55:57.969311] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:55:58.502426] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-01T17:55:59.308143] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-01T17:55:59.323056] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T17:55:59.739900] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T17:56:00.102388] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-01T17:56:00.604299] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:56:00.902387] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-01T17:56:01.702361] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-01T17:56:02.005274] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T17:56:02.209430] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T17:56:02.502417] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-01T17:56:02.665009] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T17:56:03.302426] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-01T17:56:03.801099] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T17:56:04.102389] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-01T17:56:04.292581] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T17:56:04.902349] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-01T17:56:04.942264] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T17:56:05.702450] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-01T17:56:06.174405] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T17:56:06.502418] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-01T17:56:06.901991] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T17:56:07.268915] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T17:56:07.302386] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-01T17:56:08.102423] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-01T17:56:08.307089] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T17:56:08.902403] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-01T17:56:09.702345] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-01T17:56:09.758961] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T17:56:10.126204] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T17:56:10.502435] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-01T17:56:10.692260] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T17:56:11.302365] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-01T17:56:11.382499] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T17:56:12.102390] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-01T17:56:12.758181] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T17:56:12.902367] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-01T17:56:13.222865] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T17:56:13.702424] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-01T17:56:14.502414] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-01T17:56:14.772194] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T17:56:15.148950] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T17:56:15.150082] [INFO ] [REMOTE ] CBU: Full fetch complete (32304 records). [2025-10-01T17:56:15.150178] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-01T17:56:15.307573] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-01T17:56:15.575206] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-01T17:56:15.575308] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-01T17:56:15.575862] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-01T17:56:15.575925] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-01T17:56:15.576825] [DEBUG] [LOCAL ] CBU: Trimmed 32304 records to 22654 (keeping 200 days of data) [2025-10-01T17:56:15.722163] [DEBUG] [LOCAL ] CBU: Primary data saved (22654 records). [2025-10-01T17:56:15.722301] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-01T17:56:15.722389] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBU took 26.6s. Estimated remaining: 4h 32m 50s. Rate: 7.2 symbols/min [2025-10-01T17:56:15.911786] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:56:15.946488] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T17:56:15.994530] [DEBUG] [LOCAL ] CC: Loaded 53006 existing records from primary storage. [2025-10-01T17:56:15.994953] [INFO ] [MAIN ] CC: Loaded 53006 existing records. [2025-10-01T17:56:16.109883] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-01T17:56:16.208473] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:56:16.208740] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-01T17:56:16.208800] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-01T17:56:16.210664] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-01T17:56:16.210730] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-01T17:56:16.618323] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:56:16.801860] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T17:56:16.902380] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-01T17:56:17.068883] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T17:56:17.702386] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-01T17:56:18.143262] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T17:56:18.502385] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-01T17:56:19.302414] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-01T17:56:19.874788] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T17:56:19.877556] [INFO ] [REMOTE ] CBRE: Full fetch complete (73966 records). [2025-10-01T17:56:19.877746] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-01T17:56:20.114932] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-01T17:56:20.231195] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-01T17:56:20.254307] [INFO ] [REMOTE ] CBT: Full fetch complete (45780 records). [2025-10-01T17:56:20.275218] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-01T17:56:20.485276] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-01T17:56:20.517551] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-01T17:56:20.524666] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-01T17:56:20.552134] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-01T17:56:20.663763] [DEBUG] [LOCAL ] CBRE: Trimmed 73966 records to 50580 (keeping 200 days of data) [2025-10-01T17:56:21.002315] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-01T17:56:21.002596] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-01T17:56:21.003393] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-01T17:56:21.003949] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-01T17:56:21.009070] [DEBUG] [LOCAL ] CBT: Trimmed 45780 records to 30845 (keeping 200 days of data) [2025-10-01T17:56:21.148605] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T17:56:21.161976] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-01T17:56:21.387105] [DEBUG] [LOCAL ] CBT: Primary data saved (30845 records). [2025-10-01T17:56:21.388491] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-01T17:56:21.388890] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBT took 47.3s. Estimated remaining: 4h 32m 29s. Rate: 7.2 symbols/min [2025-10-01T17:56:21.618637] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:56:21.652041] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T17:56:21.717447] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-01T17:56:21.777013] [DEBUG] [LOCAL ] CCI: Loaded 53140 existing records from primary storage. [2025-10-01T17:56:21.779091] [INFO ] [MAIN ] CCI: Loaded 53140 existing records. [2025-10-01T17:56:22.003315] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:56:22.005388] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-01T17:56:22.005874] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-01T17:56:22.008887] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-01T17:56:22.009054] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-01T17:56:22.008974] [DEBUG] [LOCAL ] CBRE: Primary data saved (50580 records). [2025-10-01T17:56:22.014388] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-01T17:56:22.072299] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBRE took 50.8s. Estimated remaining: 4h 31m 44s. Rate: 7.2 symbols/min [2025-10-01T17:56:22.502320] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:56:22.519402] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-01T17:56:22.528338] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-01T17:56:22.587703] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-01T17:56:22.600809] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-01T17:56:22.601271] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-01T17:56:22.612329] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-01T17:56:22.748777] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:56:22.754369] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-01T17:56:23.058869] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T17:56:23.172689] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:56:23.197057] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T17:56:23.302375] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-01T17:56:24.102412] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-01T17:56:24.555142] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T17:56:24.686871] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-01T17:56:24.902388] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-01T17:56:25.526679] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T17:56:25.702423] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-01T17:56:26.502362] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-01T17:56:26.635865] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T17:56:26.964910] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-01T17:56:27.302419] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-01T17:56:27.655125] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-01T17:56:27.656485] [INFO ] [REMOTE ] CBZ: Full fetch complete (45420 records). [2025-10-01T17:56:27.656635] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-01T17:56:28.104795] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-01T17:56:28.105332] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-01T17:56:28.106272] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-01T17:56:28.106972] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-01T17:56:28.107041] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-01T17:56:28.112048] [DEBUG] [LOCAL ] CBZ: Trimmed 45420 records to 33691 (keeping 200 days of data) [2025-10-01T17:56:28.325700] [DEBUG] [LOCAL ] CBZ: Primary data saved (33691 records). [2025-10-01T17:56:28.325856] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-01T17:56:28.325987] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBZ took 31.2s. Estimated remaining: 4h 31m 26s. Rate: 7.2 symbols/min [2025-10-01T17:56:28.516525] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:56:28.535668] [DEBUG] [LOCAL ] CCIF: Loaded 15713 existing records from primary storage. [2025-10-01T17:56:28.535928] [INFO ] [MAIN ] CCIF: Loaded 15713 existing records. [2025-10-01T17:56:28.744243] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:56:28.744502] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-01T17:56:28.744554] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-01T17:56:28.745290] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-01T17:56:28.745372] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-01T17:56:28.907351] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-01T17:56:29.155400] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:56:29.188329] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T17:56:29.423203] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T17:56:29.702361] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-01T17:56:29.936773] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-01T17:56:30.394804] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T17:56:30.502386] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-01T17:56:31.302389] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-01T17:56:31.670268] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-01T17:56:32.108678] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-01T17:56:32.124726] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T17:56:32.469801] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-01T17:56:32.902440] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-01T17:56:33.702375] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-01T17:56:34.502390] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-01T17:56:34.585504] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T17:56:35.102863] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T17:56:35.274467] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T17:56:35.302452] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-01T17:56:36.102391] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-01T17:56:36.875338] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T17:56:36.902384] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-01T17:56:37.702360] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-01T17:56:37.761512] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T17:56:38.248516] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T17:56:38.502399] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-01T17:56:38.755983] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-01T17:56:38.804202] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T17:56:39.302375] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-01T17:56:40.102345] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-01T17:56:40.223266] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T17:56:40.902395] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-01T17:56:41.702153] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T17:56:41.712997] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-01T17:56:42.502415] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-01T17:56:43.134306] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-01T17:56:43.159496] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T17:56:43.302385] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-01T17:56:44.102366] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-01T17:56:44.155889] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T17:56:44.209903] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T17:56:44.400960] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-01T17:56:44.902381] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-01T17:56:45.702428] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-01T17:56:45.978763] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-01T17:56:46.438513] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T17:56:46.502361] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-01T17:56:47.302369] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-01T17:56:47.606739] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-01T17:56:48.025573] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T17:56:48.102383] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-01T17:56:48.902390] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-01T17:56:49.577940] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T17:56:49.702392] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-01T17:56:49.861735] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T17:56:50.502382] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-01T17:56:50.697503] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T17:56:51.302375] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-01T17:56:52.102415] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-01T17:56:52.682423] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T17:56:52.683238] [INFO ] [REMOTE ] CCIA: Full fetch complete (2064 records). [2025-10-01T17:56:52.683312] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-01T17:56:52.797499] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T17:56:52.808514] [INFO ] [REMOTE ] CC: Full fetch complete (75598 records). [2025-10-01T17:56:52.824049] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-01T17:56:52.902906] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-01T17:56:52.908245] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T17:56:52.945730] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-01T17:56:52.945903] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-01T17:56:52.946161] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-01T17:56:52.982082] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-01T17:56:53.003038] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-01T17:56:53.014254] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-01T17:56:53.025031] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CCIA took 30.9s. Estimated remaining: 4h 32m 36s. Rate: 7.2 symbols/min [2025-10-01T17:56:53.442765] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:56:53.563860] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-01T17:56:53.600823] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-01T17:56:53.601340] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-01T17:56:53.605483] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-01T17:56:53.605926] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-01T17:56:53.608150] [DEBUG] [LOCAL ] CC: Trimmed 75598 records to 53000 (keeping 200 days of data) [2025-10-01T17:56:53.702367] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-01T17:56:53.758489] [DEBUG] [LOCAL ] CCJ: Loaded 53673 existing records from primary storage. [2025-10-01T17:56:53.760374] [INFO ] [MAIN ] CCJ: Loaded 53673 existing records. [2025-10-01T17:56:53.884413] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T17:56:54.022363] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:56:54.023410] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-01T17:56:54.023764] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-01T17:56:54.026110] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-01T17:56:54.026404] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-01T17:56:54.536354] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-01T17:56:54.544877] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:56:54.658378] [DEBUG] [LOCAL ] CC: Primary data saved (53000 records). [2025-10-01T17:56:54.658519] [INFO ] [MAIN ] CC: Full history saved. [2025-10-01T17:56:54.658636] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 38.9s. Estimated remaining: 4h 31m 56s. Rate: 7.2 symbols/min [2025-10-01T17:56:54.858403] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:56:54.904922] [DEBUG] [LOCAL ] CCK: Loaded 46241 existing records from primary storage. [2025-10-01T17:56:54.905250] [INFO ] [MAIN ] CCK: Loaded 46241 existing records. [2025-10-01T17:56:55.103457] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:56:55.103684] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-01T17:56:55.103742] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-01T17:56:55.105418] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-01T17:56:55.105482] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-01T17:56:55.330253] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-01T17:56:55.494924] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:56:55.593139] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T17:56:56.102385] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-01T17:56:56.289251] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-01T17:56:56.291162] [INFO ] [REMOTE ] CCI: Full fetch complete (76998 records). [2025-10-01T17:56:56.291413] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-01T17:56:56.717469] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-01T17:56:56.717553] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-01T17:56:56.718449] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-01T17:56:56.718524] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-01T17:56:56.721353] [DEBUG] [LOCAL ] CCI: Trimmed 76998 records to 53139 (keeping 200 days of data) [2025-10-01T17:56:56.917043] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-01T17:56:57.084216] [DEBUG] [LOCAL ] CCI: Primary data saved (53139 records). [2025-10-01T17:56:57.084478] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-01T17:56:57.085639] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCI took 35.7s. Estimated remaining: 4h 31m 19s. Rate: 7.2 symbols/min [2025-10-01T17:56:57.326011] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-01T17:56:57.385269] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:56:57.441285] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-01T17:56:57.441693] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-01T17:56:57.643718] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:56:57.643930] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-01T17:56:57.644000] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-01T17:56:57.645283] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-01T17:56:57.645345] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-01T17:56:57.719103] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-01T17:56:58.064713] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T17:56:58.108061] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:56:58.103546] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-01T17:56:58.502417] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-01T17:56:59.302431] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-01T17:56:59.836911] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-01T17:57:00.102449] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-01T17:57:00.291637] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T17:57:00.902385] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-01T17:57:01.702360] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-01T17:57:02.184752] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-01T17:57:02.324085] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-01T17:57:02.426400] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T17:57:02.427501] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T17:57:02.502420] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-01T17:57:03.302382] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-01T17:57:04.102419] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-01T17:57:04.561639] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-01T17:57:04.691392] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T17:57:04.902394] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-01T17:57:05.611357] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T17:57:05.612494] [INFO ] [REMOTE ] CCIF: Full fetch complete (21908 records). [2025-10-01T17:57:05.612594] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-01T17:57:05.707613] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-01T17:57:06.042772] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-01T17:57:06.042855] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-01T17:57:06.043247] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-01T17:57:06.043291] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-01T17:57:06.043937] [DEBUG] [LOCAL ] CCIF: Trimmed 21908 records to 15750 (keeping 200 days of data) [2025-10-01T17:57:06.141109] [DEBUG] [LOCAL ] CCIF: Primary data saved (15750 records). [2025-10-01T17:57:06.141260] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-01T17:57:06.141347] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 37.8s. Estimated remaining: 4h 31m 15s. Rate: 7.2 symbols/min [2025-10-01T17:57:06.332765] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:57:06.384305] [DEBUG] [LOCAL ] CCO: Loaded 47809 existing records from primary storage. [2025-10-01T17:57:06.384711] [INFO ] [MAIN ] CCO: Loaded 47809 existing records. [2025-10-01T17:57:06.507479] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-01T17:57:06.586949] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:57:06.587295] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-01T17:57:06.587365] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-01T17:57:06.588899] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-01T17:57:06.588988] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-01T17:57:06.990933] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:57:07.035091] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-01T17:57:07.302408] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-01T17:57:08.102374] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-01T17:57:08.232782] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-01T17:57:08.688884] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-01T17:57:08.848115] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T17:57:08.902408] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-01T17:57:09.702436] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-01T17:57:09.947255] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T17:57:10.502388] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-01T17:57:10.990741] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-01T17:57:11.302402] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-01T17:57:11.691548] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T17:57:11.914281] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T17:57:12.102387] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-01T17:57:12.345908] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T17:57:12.902384] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-01T17:57:13.702391] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-01T17:57:14.502407] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-01T17:57:14.660381] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-01T17:57:14.861051] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T17:57:14.969012] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T17:57:15.302452] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-01T17:57:16.102387] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-01T17:57:16.902352] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-01T17:57:16.962408] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T17:57:17.029827] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-01T17:57:17.702423] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-01T17:57:18.197145] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T17:57:18.502422] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-01T17:57:18.631013] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T17:57:19.302377] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-01T17:57:19.836587] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T17:57:19.943445] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-01T17:57:20.102389] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-01T17:57:20.902368] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-01T17:57:21.076161] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T17:57:21.303690] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T17:57:21.702417] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-01T17:57:22.502386] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-01T17:57:23.195977] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-01T17:57:23.302391] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-01T17:57:23.490045] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T17:57:24.102382] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-01T17:57:24.599126] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T17:57:24.600751] [INFO ] [REMOTE ] CCK: Full fetch complete (67661 records). [2025-10-01T17:57:24.600853] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-01T17:57:24.907529] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-01T17:57:25.022991] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-01T17:57:25.023210] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-01T17:57:25.024047] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-01T17:57:25.024131] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-01T17:57:25.025851] [DEBUG] [LOCAL ] CCK: Trimmed 67661 records to 46232 (keeping 200 days of data) [2025-10-01T17:57:25.163286] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T17:57:25.375012] [DEBUG] [LOCAL ] CCK: Primary data saved (46232 records). [2025-10-01T17:57:25.375169] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-01T17:57:25.375259] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 30.7s. Estimated remaining: 4h 31m 58s. Rate: 7.2 symbols/min [2025-10-01T17:57:25.566530] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:57:25.577357] [DEBUG] [LOCAL ] CCRD: Loaded 9062 existing records from primary storage. [2025-10-01T17:57:25.577600] [INFO ] [MAIN ] CCRD: Loaded 9062 existing records. [2025-10-01T17:57:25.708486] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-01T17:57:25.811758] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T17:57:25.818388] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:57:25.828820] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-01T17:57:25.829436] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-01T17:57:25.829881] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-01T17:57:25.829972] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-01T17:57:26.259525] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:57:26.502417] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-01T17:57:27.125686] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T17:57:27.302440] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-01T17:57:27.602862] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-01T17:57:27.688802] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-01T17:57:28.102476] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-01T17:57:28.510669] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-01T17:57:28.744524] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T17:57:28.902400] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-01T17:57:29.702405] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-01T17:57:30.333535] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T17:57:30.502392] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-01T17:57:31.094983] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T17:57:31.168715] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T17:57:31.170531] [INFO ] [REMOTE ] CCO: Full fetch complete (66600 records). [2025-10-01T17:57:31.170793] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-01T17:57:31.307547] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-01T17:57:31.611302] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-01T17:57:31.611386] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-01T17:57:31.612232] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-01T17:57:31.612300] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-01T17:57:31.613688] [DEBUG] [LOCAL ] CCO: Trimmed 66600 records to 47896 (keeping 200 days of data) [2025-10-01T17:57:31.890313] [DEBUG] [LOCAL ] CCO: Primary data saved (47896 records). [2025-10-01T17:57:31.890478] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-01T17:57:31.890718] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCO took 25.7s. Estimated remaining: 4h 31m 41s. Rate: 7.2 symbols/min [2025-10-01T17:57:32.094748] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:57:32.102394] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-01T17:57:32.128493] [DEBUG] [LOCAL ] CCS: Loaded 30574 existing records from primary storage. [2025-10-01T17:57:32.128852] [INFO ] [MAIN ] CCS: Loaded 30574 existing records. [2025-10-01T17:57:32.336966] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:57:32.337200] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-01T17:57:32.337249] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-01T17:57:32.338247] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-01T17:57:32.338310] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-01T17:57:32.729473] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:57:32.734380] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T17:57:32.902401] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-01T17:57:33.353865] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-01T17:57:33.702359] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-01T17:57:34.482441] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T17:57:34.502361] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-01T17:57:35.302415] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-01T17:57:36.102403] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-01T17:57:36.113752] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T17:57:36.271941] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (3.37 seconds). [2025-10-01T17:57:36.276561] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-10-01T17:57:36.276711] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-01T17:57:36.724455] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-01T17:57:36.724595] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-01T17:57:36.725720] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-01T17:57:36.725819] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-01T17:57:36.727589] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 53674 (keeping 200 days of data) [2025-10-01T17:57:36.924954] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-01T17:57:37.000432] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-01T17:57:37.142162] [DEBUG] [LOCAL ] CCJ: Primary data saved (53674 records). [2025-10-01T17:57:37.142347] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-01T17:57:37.142468] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCJ took 44.1s. Estimated remaining: 4h 31m 18s. Rate: 7.2 symbols/min [2025-10-01T17:57:37.338330] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:57:37.357292] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T17:57:37.381018] [DEBUG] [LOCAL ] CCU: Loaded 23218 existing records from primary storage. [2025-10-01T17:57:37.381286] [INFO ] [MAIN ] CCU: Loaded 23218 existing records. [2025-10-01T17:57:37.581029] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:57:37.581269] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-01T17:57:37.581321] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-01T17:57:37.582036] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-01T17:57:37.582099] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-01T17:57:37.707483] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-01T17:57:38.024293] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T17:57:38.028412] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:57:38.502380] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-01T17:57:39.302361] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-01T17:57:39.428828] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T17:57:39.854451] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-01T17:57:40.102391] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-01T17:57:40.670870] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T17:57:40.896631] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T17:57:40.902335] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-01T17:57:41.702381] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-01T17:57:41.814799] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-01T17:57:41.815588] [INFO ] [REMOTE ] CCRD: Full fetch complete (11861 records). [2025-10-01T17:57:41.815688] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-01T17:57:42.264468] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-01T17:57:42.264554] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-01T17:57:42.264891] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-01T17:57:42.264961] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-01T17:57:42.265628] [DEBUG] [LOCAL ] CCRD: Trimmed 11861 records to 9107 (keeping 200 days of data) [2025-10-01T17:57:42.319893] [DEBUG] [LOCAL ] CCRD: Primary data saved (9107 records). [2025-10-01T17:57:42.320032] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-01T17:57:42.320127] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCRD took 16.9s. Estimated remaining: 4h 30m 55s. Rate: 7.2 symbols/min [2025-10-01T17:57:42.509098] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-01T17:57:42.533041] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:57:42.534419] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-01T17:57:42.534549] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-01T17:57:42.534773] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-01T17:57:42.534857] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-01T17:57:42.534963] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-01T17:57:42.535041] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-01T17:57:42.887460] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T17:57:42.955088] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:57:43.302387] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-01T17:57:43.921462] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T17:57:44.102390] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-01T17:57:44.902394] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-01T17:57:45.006304] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T17:57:45.310506] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-01T17:57:45.325305] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-01T17:57:45.702396] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-01T17:57:46.502396] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-01T17:57:46.697889] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T17:57:46.733397] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-01T17:57:47.302389] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-01T17:57:48.102384] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-01T17:57:48.460205] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T17:57:48.747098] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T17:57:48.902381] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-01T17:57:49.702382] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-01T17:57:50.502390] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-01T17:57:51.075391] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T17:57:51.302343] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-01T17:57:51.507281] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T17:57:52.102420] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-01T17:57:52.297901] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (3.40 seconds). [2025-10-01T17:57:52.299449] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-01T17:57:52.299553] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-01T17:57:52.682889] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T17:57:52.827110] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-01T17:57:52.827194] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-01T17:57:52.828109] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-01T17:57:52.828197] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-01T17:57:52.829753] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-10-01T17:57:52.926624] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-01T17:57:52.985164] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T17:57:53.212287] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-01T17:57:53.212445] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-01T17:57:53.212533] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCL took 56.1s. Estimated remaining: 4h 30m 59s. Rate: 7.2 symbols/min [2025-10-01T17:57:53.404277] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:57:53.460378] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-10-01T17:57:53.460812] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-10-01T17:57:53.661742] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:57:53.662080] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-01T17:57:53.662168] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-01T17:57:53.663676] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-01T17:57:53.663751] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-01T17:57:53.707674] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-01T17:57:54.020514] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-01T17:57:54.089946] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:57:54.105530] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T17:57:54.502383] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-01T17:57:55.302383] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-01T17:57:55.657144] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-01T17:57:55.873263] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T17:57:56.102380] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-01T17:57:56.902392] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-01T17:57:57.180994] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-01T17:57:57.298772] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T17:57:57.702383] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-01T17:57:58.502424] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-01T17:57:59.286754] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T17:57:59.302339] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-01T17:58:00.102397] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-01T17:58:00.436602] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-01T17:58:00.439533] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T17:58:00.902373] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-01T17:58:01.296233] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-01T17:58:01.297688] [INFO ] [REMOTE ] CCS: Full fetch complete (45105 records). [2025-10-01T17:58:01.297785] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-01T17:58:01.713301] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-01T17:58:01.733169] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-01T17:58:01.734503] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-01T17:58:01.735332] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-01T17:58:01.735409] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-01T17:58:01.736705] [DEBUG] [LOCAL ] CCS: Trimmed 45105 records to 30499 (keeping 200 days of data) [2025-10-01T17:58:01.953474] [DEBUG] [LOCAL ] CCS: Primary data saved (30499 records). [2025-10-01T17:58:01.954112] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-01T17:58:01.954324] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCS took 30.1s. Estimated remaining: 4h 30m 53s. Rate: 7.2 symbols/min [2025-10-01T17:58:02.163082] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:58:02.175756] [DEBUG] [LOCAL ] CDLR: Loaded 9816 existing records from primary storage. [2025-10-01T17:58:02.176036] [INFO ] [MAIN ] CDLR: Loaded 9816 existing records. [2025-10-01T17:58:02.386799] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:58:02.387010] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-01T17:58:02.387059] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-01T17:58:02.387486] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-01T17:58:02.387547] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-01T17:58:02.507600] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-01T17:58:02.786253] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:58:02.822387] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-01T17:58:02.846113] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:58:02.846707] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:58:02.846849] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-01T17:58:02.846996] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:58:02.847069] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-01T17:58:02.847135] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-01T17:58:02.847172] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-01T17:58:02.847229] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-01T17:58:02.847298] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCZ took 20.5s. Estimated remaining: 4h 30m 10s. Rate: 7.2 symbols/min [2025-10-01T17:58:03.039606] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:58:03.054024] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T17:58:03.091619] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-01T17:58:03.134044] [DEBUG] [LOCAL ] CDP: Loaded 42529 existing records from primary storage. [2025-10-01T17:58:03.134346] [INFO ] [MAIN ] CDP: Loaded 42529 existing records. [2025-10-01T17:58:03.307906] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-01T17:58:03.338579] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:58:03.338819] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-01T17:58:03.338880] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-01T17:58:03.340026] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-01T17:58:03.340103] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-01T17:58:03.735303] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:58:04.102375] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-01T17:58:04.902375] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-01T17:58:05.284845] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T17:58:05.549085] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T17:58:05.702368] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-01T17:58:05.799505] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-01T17:58:06.125133] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-01T17:58:06.502398] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-01T17:58:07.302421] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-01T17:58:07.541123] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T17:58:08.102412] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-01T17:58:08.759363] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T17:58:08.903680] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-01T17:58:08.910192] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T17:58:09.702383] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-01T17:58:10.365949] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T17:58:10.502359] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-01T17:58:10.682283] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T17:58:11.298776] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T17:58:11.302344] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-01T17:58:12.064163] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T17:58:12.102376] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-01T17:58:12.634736] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T17:58:12.902431] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-01T17:58:13.702394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-01T17:58:14.502352] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-01T17:58:14.626374] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T17:58:15.024453] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-01T17:58:15.302403] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-01T17:58:15.717918] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T17:58:16.102388] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-01T17:58:16.902360] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-01T17:58:17.033759] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T17:58:17.086452] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T17:58:17.702393] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-01T17:58:17.759150] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T17:58:18.502383] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-01T17:58:18.961316] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T17:58:19.302392] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-01T17:58:19.962955] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T17:58:20.102393] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-01T17:58:20.519322] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T17:58:20.520480] [INFO ] [REMOTE ] CCU: Full fetch complete (33038 records). [2025-10-01T17:58:20.520565] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-01T17:58:20.908322] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-01T17:58:20.941719] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-01T17:58:20.941814] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-01T17:58:20.942375] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-01T17:58:20.942416] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-01T17:58:20.943325] [DEBUG] [LOCAL ] CCU: Trimmed 33038 records to 23246 (keeping 200 days of data) [2025-10-01T17:58:21.084219] [DEBUG] [LOCAL ] CCU: Primary data saved (23246 records). [2025-10-01T17:58:21.084396] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-01T17:58:21.084484] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCU took 43.9s. Estimated remaining: 4h 30m 48s. Rate: 7.2 symbols/min [2025-10-01T17:58:21.271922] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:58:21.296459] [DEBUG] [LOCAL ] CDRE: Loaded 25130 existing records from primary storage. [2025-10-01T17:58:21.296745] [INFO ] [MAIN ] CDRE: Loaded 25130 existing records. [2025-10-01T17:58:21.498264] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:58:21.498474] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-01T17:58:21.498523] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-01T17:58:21.499518] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-01T17:58:21.499608] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-01T17:58:21.705215] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-01T17:58:21.933726] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:58:21.960904] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T17:58:22.479131] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T17:58:22.502374] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-01T17:58:23.054432] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-01T17:58:23.302387] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-01T17:58:24.102364] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-01T17:58:24.197977] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T17:58:24.249271] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-01T17:58:24.250167] [INFO ] [REMOTE ] CDLR: Full fetch complete (13288 records). [2025-10-01T17:58:24.250238] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-01T17:58:24.652436] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-01T17:58:24.652516] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-01T17:58:24.652875] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-01T17:58:24.652942] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-01T17:58:24.653459] [DEBUG] [LOCAL ] CDLR: Trimmed 13288 records to 9854 (keeping 200 days of data) [2025-10-01T17:58:24.716160] [DEBUG] [LOCAL ] CDLR: Primary data saved (9854 records). [2025-10-01T17:58:24.716338] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-01T17:58:24.716446] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 22.8s. Estimated remaining: 4h 30m 17s. Rate: 7.2 symbols/min [2025-10-01T17:58:24.915962] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-01T17:58:24.920721] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:58:24.973009] [DEBUG] [LOCAL ] CE: Loaded 51519 existing records from primary storage. [2025-10-01T17:58:24.973364] [INFO ] [MAIN ] CE: Loaded 51519 existing records. [2025-10-01T17:58:25.186469] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:58:25.186710] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-01T17:58:25.186770] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-01T17:58:25.188747] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-01T17:58:25.188837] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-01T17:58:25.596613] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:58:25.702397] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-01T17:58:26.190696] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T17:58:26.323377] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T17:58:26.502379] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-01T17:58:27.256687] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T17:58:27.302372] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-01T17:58:28.102399] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-01T17:58:28.283171] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T17:58:28.851327] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T17:58:28.889229] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T17:58:28.902334] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-01T17:58:29.490532] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T17:58:29.702398] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-01T17:58:30.502413] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-01T17:58:31.302422] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-01T17:58:31.937720] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-01T17:58:32.054911] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T17:58:32.102393] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-01T17:58:32.146814] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T17:58:32.902388] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-01T17:58:33.702432] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-01T17:58:34.393393] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T17:58:34.502364] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-01T17:58:35.059714] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T17:58:35.102413] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-01T17:58:35.109038] [INFO ] [REMOTE ] CDE: Full fetch complete (77583 records). [2025-10-01T17:58:35.109264] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-01T17:58:35.307561] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-01T17:58:35.743525] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-01T17:58:35.743845] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-01T17:58:35.745110] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-01T17:58:35.745239] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-01T17:58:35.747361] [DEBUG] [LOCAL ] CDE: Trimmed 77583 records to 53642 (keeping 200 days of data) [2025-10-01T17:58:35.890001] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T17:58:36.111120] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-01T17:58:36.139977] [DEBUG] [LOCAL ] CDE: Primary data saved (53642 records). [2025-10-01T17:58:36.140119] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-01T17:58:36.140228] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDE took 42.9s. Estimated remaining: 4h 30m 23s. Rate: 7.2 symbols/min [2025-10-01T17:58:36.340058] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:58:36.348487] [DEBUG] [LOCAL ] CEE: Loaded 6103 existing records from primary storage. [2025-10-01T17:58:36.348749] [INFO ] [MAIN ] CEE: Loaded 6103 existing records. [2025-10-01T17:58:36.565201] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:58:36.565456] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-01T17:58:36.565524] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-01T17:58:36.565887] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-01T17:58:36.565959] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-01T17:58:36.904702] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-01T17:58:37.001716] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:58:37.097035] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T17:58:37.700911] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T17:58:37.703125] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-01T17:58:38.147488] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T17:58:38.502397] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-01T17:58:38.948457] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-01T17:58:38.949996] [INFO ] [REMOTE ] CDP: Full fetch complete (61826 records). [2025-10-01T17:58:38.950086] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-01T17:58:39.307464] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-01T17:58:39.386327] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-01T17:58:39.386410] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-01T17:58:39.387228] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-01T17:58:39.387294] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-01T17:58:39.388871] [DEBUG] [LOCAL ] CDP: Trimmed 61826 records to 42586 (keeping 200 days of data) [2025-10-01T17:58:39.659521] [DEBUG] [LOCAL ] CDP: Primary data saved (42586 records). [2025-10-01T17:58:39.659683] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-01T17:58:39.659786] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDP took 36.8s. Estimated remaining: 4h 29m 53s. Rate: 7.2 symbols/min [2025-10-01T17:58:39.846401] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:58:39.872771] [DEBUG] [LOCAL ] CEPU: Loaded 25948 existing records from primary storage. [2025-10-01T17:58:39.873045] [INFO ] [MAIN ] CEPU: Loaded 25948 existing records. [2025-10-01T17:58:39.993202] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T17:58:40.087065] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:58:40.087292] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-01T17:58:40.087361] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-01T17:58:40.088231] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-01T17:58:40.088296] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-01T17:58:40.111872] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-01T17:58:40.489564] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:58:40.522620] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-01T17:58:40.902365] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-01T17:58:40.978057] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T17:58:41.702414] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-01T17:58:42.019568] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T17:58:42.502397] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-01T17:58:42.825288] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T17:58:43.302382] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-01T17:58:43.333874] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T17:58:44.102379] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-01T17:58:44.292032] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T17:58:44.902402] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-01T17:58:45.702385] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-01T17:58:46.070325] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T17:58:46.379194] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:58:46.502360] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-01T17:58:46.573560] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T17:58:47.302356] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-01T17:58:47.467987] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T17:58:48.097252] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T17:58:48.102327] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-01T17:58:48.567579] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T17:58:48.902373] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-01T17:58:49.702396] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-01T17:58:50.332005] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T17:58:50.374289] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T17:58:50.502380] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-01T17:58:51.302388] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-01T17:58:51.886130] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T17:58:52.102360] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-01T17:58:52.178765] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T17:58:52.569224] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-01T17:58:52.902421] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-01T17:58:53.702438] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-01T17:58:54.153247] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T17:58:54.154467] [INFO ] [REMOTE ] CDRE: Full fetch complete (35261 records). [2025-10-01T17:58:54.154549] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-01T17:58:54.507544] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-01T17:58:54.596535] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-01T17:58:54.596715] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-01T17:58:54.597378] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-01T17:58:54.597424] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-01T17:58:54.598524] [DEBUG] [LOCAL ] CDRE: Trimmed 35261 records to 24990 (keeping 200 days of data) [2025-10-01T17:58:54.734858] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T17:58:54.819040] [DEBUG] [LOCAL ] CDRE: Primary data saved (24990 records). [2025-10-01T17:58:54.819268] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-01T17:58:54.819371] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDRE took 33.7s. Estimated remaining: 4h 30m 16s. Rate: 7.2 symbols/min [2025-10-01T17:58:55.055232] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:58:55.109917] [DEBUG] [LOCAL ] CF: Loaded 52186 existing records from primary storage. [2025-10-01T17:58:55.110387] [INFO ] [MAIN ] CF: Loaded 52186 existing records. [2025-10-01T17:58:55.308731] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-01T17:58:55.314627] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:58:55.315480] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-01T17:58:55.316276] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-01T17:58:55.317936] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-01T17:58:55.318005] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-01T17:58:55.398802] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T17:58:55.715288] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:58:56.102385] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-01T17:58:56.421380] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T17:58:56.902383] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-01T17:58:57.702378] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-01T17:58:57.761627] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T17:58:58.502360] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-01T17:58:58.660270] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T17:58:58.998890] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T17:58:59.302383] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-01T17:58:59.874456] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T17:59:00.102350] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-01T17:59:00.273169] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T17:59:00.902361] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-01T17:59:00.947150] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T17:59:01.702424] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-01T17:59:02.335263] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T17:59:02.336042] [INFO ] [REMOTE ] CEE: Full fetch complete (10190 records). [2025-10-01T17:59:02.336121] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-01T17:59:02.504696] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-01T17:59:02.752020] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-01T17:59:02.752168] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-01T17:59:02.752558] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-01T17:59:02.752640] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-01T17:59:02.753452] [DEBUG] [LOCAL ] CEE: Trimmed 10190 records to 5946 (keeping 200 days of data) [2025-10-01T17:59:02.809268] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-01T17:59:02.829912] [DEBUG] [LOCAL ] CEE: Primary data saved (5946 records). [2025-10-01T17:59:02.830057] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-01T17:59:02.830148] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEE took 26.7s. Estimated remaining: 4h 30m 6s. Rate: 7.2 symbols/min [2025-10-01T17:59:03.019023] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:03.074469] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-01T17:59:03.074859] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-10-01T17:59:03.275067] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:03.275324] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-01T17:59:03.275381] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-01T17:59:03.277071] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-01T17:59:03.277137] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-01T17:59:03.310036] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-01T17:59:03.672751] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:04.102371] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-01T17:59:04.438343] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T17:59:04.902443] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-01T17:59:05.029339] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T17:59:05.137425] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T17:59:05.702382] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-01T17:59:06.498093] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T17:59:06.508289] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-01T17:59:06.800414] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T17:59:07.302400] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-01T17:59:07.929724] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T17:59:08.102382] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-01T17:59:08.681960] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T17:59:08.902409] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-01T17:59:09.702366] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-01T17:59:09.914512] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T17:59:10.502393] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-01T17:59:10.851430] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-01T17:59:10.853442] [INFO ] [REMOTE ] CE: Full fetch complete (74843 records). [2025-10-01T17:59:10.853725] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-01T17:59:11.110017] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T17:59:11.312019] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-01T17:59:11.373926] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-01T17:59:11.374020] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-01T17:59:11.375137] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-01T17:59:11.375205] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-01T17:59:11.376778] [DEBUG] [LOCAL ] CE: Trimmed 74843 records to 51501 (keeping 200 days of data) [2025-10-01T17:59:11.698698] [DEBUG] [LOCAL ] CE: Primary data saved (51501 records). [2025-10-01T17:59:11.698838] [INFO ] [MAIN ] CE: Full history saved. [2025-10-01T17:59:11.698921] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CE took 47.0s. Estimated remaining: 4h 30m 1s. Rate: 7.2 symbols/min [2025-10-01T17:59:11.875760] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:11.875953] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-01T17:59:11.875993] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-01T17:59:11.876161] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-01T17:59:11.876204] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-01T17:59:11.876247] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-01T17:59:11.876320] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-01T17:59:12.111303] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-01T17:59:12.155161] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-01T17:59:12.183018] [INFO ] [REMOTE ] CEPU: Full fetch complete (39613 records). [2025-10-01T17:59:12.183320] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-01T17:59:12.410202] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:12.692420] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-01T17:59:12.692539] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-01T17:59:12.693287] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-01T17:59:12.693367] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-01T17:59:12.694633] [DEBUG] [LOCAL ] CEPU: Trimmed 39613 records to 25885 (keeping 200 days of data) [2025-10-01T17:59:12.813620] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T17:59:12.892015] [DEBUG] [LOCAL ] CEPU: Primary data saved (25885 records). [2025-10-01T17:59:12.892196] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-01T17:59:12.892299] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CEPU took 33.2s. Estimated remaining: 4h 29m 20s. Rate: 7.2 symbols/min [2025-10-01T17:59:12.907595] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-01T17:59:13.079606] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:13.113188] [DEBUG] [LOCAL ] CFR: Loaded 33291 existing records from primary storage. [2025-10-01T17:59:13.113509] [INFO ] [MAIN ] CFR: Loaded 33291 existing records. [2025-10-01T17:59:13.307544] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:13.307916] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-01T17:59:13.308002] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-01T17:59:13.310089] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-01T17:59:13.310152] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-01T17:59:13.706000] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-01T17:59:13.754773] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:13.792060] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T17:59:13.964395] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T17:59:13.964801] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-01T17:59:13.964937] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T17:59:13.964985] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-01T17:59:13.965020] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T17:59:13.965057] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-01T17:59:13.965115] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-01T17:59:13.965157] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-01T17:59:13.965214] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-01T17:59:13.965284] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 2.3s. Estimated remaining: 4h 28m 39s. Rate: 7.2 symbols/min [2025-10-01T17:59:14.153965] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:14.196236] [DEBUG] [LOCAL ] CGAU: Loaded 42654 existing records from primary storage. [2025-10-01T17:59:14.196575] [INFO ] [MAIN ] CGAU: Loaded 42654 existing records. [2025-10-01T17:59:14.396782] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:14.396996] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-01T17:59:14.397092] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-01T17:59:14.398302] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-01T17:59:14.398362] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-01T17:59:14.513478] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-01T17:59:14.834683] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:14.867901] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-01T17:59:15.302390] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-01T17:59:16.025837] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T17:59:16.102401] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-01T17:59:16.902396] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-01T17:59:17.188952] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T17:59:17.536073] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T17:59:17.702402] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-01T17:59:18.243625] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T17:59:18.502388] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-01T17:59:18.776790] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T17:59:19.302373] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-01T17:59:19.499278] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T17:59:20.102410] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-01T17:59:20.902380] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-01T17:59:21.201341] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T17:59:21.311940] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T17:59:21.702371] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-01T17:59:22.502343] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-01T17:59:22.713662] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T17:59:23.302347] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-01T17:59:23.569910] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T17:59:23.883242] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T17:59:24.102397] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-01T17:59:24.191026] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T17:59:24.902377] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-01T17:59:24.968887] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T17:59:25.702382] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-01T17:59:26.229443] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T17:59:26.502436] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-01T17:59:27.302475] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-01T17:59:27.478755] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T17:59:27.550104] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T17:59:28.102421] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-01T17:59:28.902362] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-01T17:59:29.102439] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T17:59:29.702392] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-01T17:59:29.931609] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T17:59:30.387328] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T17:59:30.502392] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-01T17:59:31.302357] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-01T17:59:31.506503] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T17:59:31.888875] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T17:59:32.102394] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-01T17:59:32.902442] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-01T17:59:33.096931] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T17:59:33.702369] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-01T17:59:33.828828] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T17:59:34.502363] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-01T17:59:34.770025] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T17:59:35.308625] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-01T17:59:35.318983] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T17:59:35.503803] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T17:59:36.102464] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-01T17:59:36.902444] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-01T17:59:37.505208] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-01T17:59:37.506898] [INFO ] [REMOTE ] CF: Full fetch complete (75244 records). [2025-10-01T17:59:37.507094] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-01T17:59:37.708343] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-01T17:59:37.953389] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-01T17:59:37.953492] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-01T17:59:37.954397] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-01T17:59:37.954472] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-01T17:59:37.956072] [DEBUG] [LOCAL ] CF: Trimmed 75244 records to 52176 (keeping 200 days of data) [2025-10-01T17:59:38.219204] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-01T17:59:38.223475] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-01T17:59:38.226801] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-01T17:59:38.776144] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-01T17:59:38.776987] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-01T17:59:38.779721] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-01T17:59:38.780782] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-01T17:59:38.786443] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53624 (keeping 200 days of data) [2025-10-01T17:59:38.788516] [DEBUG] [LOCAL ] CF: Primary data saved (52176 records). [2025-10-01T17:59:38.788866] [INFO ] [MAIN ] CF: Full history saved. [2025-10-01T17:59:38.789011] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 44.0s. Estimated remaining: 4h 29m 45s. Rate: 7.2 symbols/min [2025-10-01T17:59:38.977037] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-01T17:59:39.000310] [INFO ] [REMOTE ] CFR: Full fetch complete (48611 records). [2025-10-01T17:59:39.025446] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-01T17:59:39.198504] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:39.260909] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T17:59:39.304876] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-01T17:59:39.366809] [DEBUG] [LOCAL ] CGV: Loaded 1411 existing records from primary storage. [2025-10-01T17:59:39.391380] [INFO ] [MAIN ] CGV: Loaded 1411 existing records. [2025-10-01T17:59:39.755202] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-01T17:59:39.763160] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-01T17:59:39.764474] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-01T17:59:39.895454] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-01T17:59:39.895097] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:39.899772] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-01T17:59:39.900223] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-01T17:59:39.903217] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-01T17:59:39.904436] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-01T17:59:39.927089] [DEBUG] [LOCAL ] CFR: Trimmed 48611 records to 33188 (keeping 200 days of data) [2025-10-01T17:59:40.467927] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:40.469884] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-01T17:59:40.651931] [DEBUG] [LOCAL ] CFR: Primary data saved (33188 records). [2025-10-01T17:59:40.653496] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-01T17:59:40.654171] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFR took 27.8s. Estimated remaining: 4h 29m 8s. Rate: 7.2 symbols/min [2025-10-01T17:59:40.819469] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-10-01T17:59:40.826127] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-01T17:59:40.858500] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:40.857573] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFG took 38.0s. Estimated remaining: 4h 28m 23s. Rate: 7.2 symbols/min [2025-10-01T17:59:41.099330] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:41.095132] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T17:59:41.071366] [DEBUG] [LOCAL ] CHCT: Loaded 23849 existing records from primary storage. [2025-10-01T17:59:41.111101] [INFO ] [MAIN ] CHCT: Loaded 23849 existing records. [2025-10-01T17:59:41.110273] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T17:59:41.117958] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-01T17:59:41.130709] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-01T17:59:41.346026] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:41.346313] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-01T17:59:41.346373] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-01T17:59:41.347548] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-01T17:59:41.347629] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-01T17:59:41.488798] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-01T17:59:41.501411] [DEBUG] [LOCAL ] CHD: Loaded 52070 existing records from primary storage. [2025-10-01T17:59:41.535047] [INFO ] [MAIN ] CHD: Loaded 52070 existing records. [2025-10-01T17:59:41.709114] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-01T17:59:41.957597] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:41.975635] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-01T17:59:41.994830] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-01T17:59:41.998758] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:42.001428] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-01T17:59:42.001537] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-01T17:59:42.229169] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T17:59:42.415831] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:42.502390] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-01T17:59:42.660735] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T17:59:42.845005] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-01T17:59:43.302378] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-01T17:59:44.102382] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-01T17:59:44.630469] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-01T17:59:44.863436] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T17:59:44.902395] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-01T17:59:45.248194] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-01T17:59:45.702377] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-01T17:59:46.142723] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-01T17:59:46.502376] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-01T17:59:47.030810] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T17:59:47.302379] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-01T17:59:47.566634] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-01T17:59:48.102390] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-01T17:59:48.902379] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-01T17:59:49.231281] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T17:59:49.702363] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-01T17:59:50.248485] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T17:59:50.502393] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-01T17:59:50.863313] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-01T17:59:51.112204] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T17:59:51.302392] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-01T17:59:52.102379] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-01T17:59:52.732496] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T17:59:52.733242] [INFO ] [REMOTE ] CGV: Full fetch complete (2275 records). [2025-10-01T17:59:52.733323] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-01T17:59:52.916032] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-01T17:59:53.058542] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T17:59:53.199726] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-01T17:59:53.199825] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-01T17:59:53.199932] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-01T17:59:53.199973] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-01T17:59:53.200317] [DEBUG] [LOCAL ] CGV: Trimmed 2275 records to 1400 (keeping 200 days of data) [2025-10-01T17:59:53.210370] [DEBUG] [LOCAL ] CGV: Primary data saved (1400 records). [2025-10-01T17:59:53.210475] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-01T17:59:53.210602] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGV took 14.4s. Estimated remaining: 4h 28m 33s. Rate: 7.2 symbols/min [2025-10-01T17:59:53.397032] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:53.413445] [DEBUG] [LOCAL ] CHE: Loaded 14939 existing records from primary storage. [2025-10-01T17:59:53.413715] [INFO ] [MAIN ] CHE: Loaded 14939 existing records. [2025-10-01T17:59:53.608057] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:53.608299] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-01T17:59:53.608375] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-01T17:59:53.609337] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-01T17:59:53.609402] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-01T17:59:53.710712] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-01T17:59:54.014104] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:54.398095] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T17:59:54.502380] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-01T17:59:55.302440] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-01T17:59:55.582838] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T17:59:55.844630] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-01T17:59:55.960872] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T17:59:55.963143] [INFO ] [REMOTE ] CGAU: Full fetch complete (60847 records). [2025-10-01T17:59:55.963288] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-01T17:59:56.107680] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-01T17:59:56.446000] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-01T17:59:56.446121] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-01T17:59:56.446967] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-01T17:59:56.447036] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-01T17:59:56.448446] [DEBUG] [LOCAL ] CGAU: Trimmed 60847 records to 42721 (keeping 200 days of data) [2025-10-01T17:59:56.763431] [DEBUG] [LOCAL ] CGAU: Primary data saved (42721 records). [2025-10-01T17:59:56.763569] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-01T17:59:56.763680] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGAU took 42.8s. Estimated remaining: 4h 28m 3s. Rate: 7.2 symbols/min [2025-10-01T17:59:56.907513] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-01T17:59:56.960893] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T17:59:57.008627] [DEBUG] [LOCAL ] CHGG: Loaded 47636 existing records from primary storage. [2025-10-01T17:59:57.009038] [INFO ] [MAIN ] CHGG: Loaded 47636 existing records. [2025-10-01T17:59:57.218625] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T17:59:57.219044] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-01T17:59:57.219272] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-01T17:59:57.221157] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-01T17:59:57.221226] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-01T17:59:57.659301] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T17:59:57.665482] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T17:59:57.702360] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-01T17:59:57.797116] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T17:59:58.498278] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T17:59:58.503563] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-01T17:59:59.302379] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-01T17:59:59.836236] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T17:59:59.907629] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T18:00:00.102417] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-01T18:00:00.902375] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-01T18:00:01.018298] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T18:00:01.702379] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-01T18:00:02.502394] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-01T18:00:02.898533] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T18:00:03.302379] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-01T18:00:03.548486] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T18:00:03.606705] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T18:00:04.102388] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-01T18:00:04.895804] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T18:00:04.906712] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-01T18:00:05.535612] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T18:00:05.690154] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T18:00:05.702351] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-01T18:00:06.502409] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-01T18:00:06.889401] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T18:00:07.302410] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-01T18:00:08.102390] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-01T18:00:08.403518] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T18:00:08.436581] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-01T18:00:08.902423] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-01T18:00:09.702426] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-01T18:00:09.872799] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T18:00:10.412944] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T18:00:10.502365] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-01T18:00:10.749483] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T18:00:11.302380] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-01T18:00:11.834178] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T18:00:12.102385] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-01T18:00:12.662500] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T18:00:12.902384] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-01T18:00:13.382627] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T18:00:13.702398] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-01T18:00:13.989705] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T18:00:14.502423] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-01T18:00:15.087013] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T18:00:15.302384] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-01T18:00:16.102412] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-01T18:00:16.707931] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T18:00:16.825072] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-01T18:00:16.902395] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-01T18:00:17.702423] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-01T18:00:17.745062] [DEBUG] [REMOTE ] CHCT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:00:17.745427] [WARN ] [REMOTE ] CHCT: No data returned for month 2025-10 [2025-10-01T18:00:17.745525] [FATAL] [REMOTE ] CHCT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:00:17.745610] [FATAL] [MAIN ] CHCT: Failed to fetch primary data. [2025-10-01T18:00:17.745700] [WARN ] [MAIN ] CHCT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:00:17.745774] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-01T18:00:17.745841] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-01T18:00:17.745878] [INFO ] [LOCAL ] CHCT: Starting deletion of derivative data. [2025-10-01T18:00:17.746434] [DEBUG] [LOCAL ] CHCT: Deleted derivative data file. [2025-10-01T18:00:17.746558] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHCT took 37.1s. Estimated remaining: 4h 28m 51s. Rate: 7.2 symbols/min [2025-10-01T18:00:17.964003] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:00:17.999420] [DEBUG] [LOCAL ] CHH: Loaded 32027 existing records from primary storage. [2025-10-01T18:00:17.999765] [INFO ] [MAIN ] CHH: Loaded 32027 existing records. [2025-10-01T18:00:18.198248] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:00:18.198636] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-01T18:00:18.198744] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-01T18:00:18.199849] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-01T18:00:18.199920] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-01T18:00:18.314209] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-01T18:00:18.507505] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-01T18:00:18.672447] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:00:18.705879] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T18:00:19.302448] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-01T18:00:20.102356] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-01T18:00:20.406750] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T18:00:20.902376] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-01T18:00:21.224524] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T18:00:21.547072] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T18:00:21.702366] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-01T18:00:22.327544] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T18:00:22.502383] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-01T18:00:22.789286] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T18:00:23.302371] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-01T18:00:23.639522] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T18:00:24.102388] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-01T18:00:24.725328] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T18:00:24.902396] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-01T18:00:25.506975] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-01T18:00:25.508094] [INFO ] [REMOTE ] CHE: Full fetch complete (19968 records). [2025-10-01T18:00:25.508198] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-01T18:00:25.715009] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-01T18:00:25.947394] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-01T18:00:25.947482] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-01T18:00:25.947978] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-01T18:00:25.948042] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-01T18:00:25.948808] [DEBUG] [LOCAL ] CHE: Trimmed 19968 records to 15044 (keeping 200 days of data) [2025-10-01T18:00:26.052145] [DEBUG] [LOCAL ] CHE: Primary data saved (15044 records). [2025-10-01T18:00:26.052315] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-01T18:00:26.052407] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 32.8s. Estimated remaining: 4h 28m 43s. Rate: 7.2 symbols/min [2025-10-01T18:00:26.240862] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:00:26.262735] [DEBUG] [LOCAL ] CHMI: Loaded 21961 existing records from primary storage. [2025-10-01T18:00:26.263025] [INFO ] [MAIN ] CHMI: Loaded 21961 existing records. [2025-10-01T18:00:26.471218] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:00:26.471500] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-01T18:00:26.471554] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-01T18:00:26.473156] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-01T18:00:26.473291] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-01T18:00:26.516497] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-01T18:00:26.905364] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:00:27.302418] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-01T18:00:27.328319] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-01T18:00:27.329893] [INFO ] [REMOTE ] CHD: Full fetch complete (74396 records). [2025-10-01T18:00:27.329991] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-01T18:00:27.477800] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T18:00:27.821439] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-01T18:00:27.821623] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-01T18:00:27.822728] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-01T18:00:27.822890] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-01T18:00:27.824499] [DEBUG] [LOCAL ] CHD: Trimmed 74396 records to 52113 (keeping 200 days of data) [2025-10-01T18:00:28.102806] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-01T18:00:28.201302] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T18:00:28.245035] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T18:00:28.263929] [DEBUG] [LOCAL ] CHD: Primary data saved (52113 records). [2025-10-01T18:00:28.264090] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-01T18:00:28.264187] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHD took 47.4s. Estimated remaining: 4h 28m 7s. Rate: 7.2 symbols/min [2025-10-01T18:00:28.474230] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:00:28.484017] [DEBUG] [LOCAL ] CHN: Loaded 4833 existing records from primary storage. [2025-10-01T18:00:28.484302] [INFO ] [MAIN ] CHN: Loaded 4833 existing records. [2025-10-01T18:00:28.701271] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:00:28.701500] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-01T18:00:28.701589] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-01T18:00:28.701951] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-01T18:00:28.702012] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-01T18:00:28.907177] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-01T18:00:29.123408] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:00:29.147489] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T18:00:29.702376] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-01T18:00:30.502381] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-01T18:00:30.613789] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T18:00:30.738193] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T18:00:31.302409] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-01T18:00:31.530738] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T18:00:32.102419] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-01T18:00:32.902436] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-01T18:00:33.367753] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T18:00:33.705676] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-01T18:00:33.706590] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T18:00:33.767326] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-01T18:00:33.769583] [INFO ] [REMOTE ] CHGG: Full fetch complete (70495 records). [2025-10-01T18:00:33.769832] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-01T18:00:34.226356] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-01T18:00:34.226476] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-01T18:00:34.227605] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-01T18:00:34.227717] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-01T18:00:34.229581] [DEBUG] [LOCAL ] CHGG: Trimmed 70495 records to 47653 (keeping 200 days of data) [2025-10-01T18:00:34.507042] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-01T18:00:34.524509] [DEBUG] [LOCAL ] CHGG: Primary data saved (47653 records). [2025-10-01T18:00:34.524674] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-01T18:00:34.524794] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHGG took 37.8s. Estimated remaining: 4h 27m 50s. Rate: 7.2 symbols/min [2025-10-01T18:00:34.897489] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T18:00:35.045089] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T18:00:35.302377] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-01T18:00:35.835771] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T18:00:36.102421] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-01T18:00:36.902408] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-01T18:00:37.268324] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T18:00:37.687341] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T18:00:37.702349] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-01T18:00:38.502352] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-01T18:00:38.885437] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T18:00:38.954929] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T18:00:39.302384] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-01T18:00:40.102391] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-01T18:00:40.208392] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T18:00:40.752021] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T18:00:40.902408] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-01T18:00:41.702358] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-01T18:00:42.028579] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T18:00:42.502397] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-01T18:00:43.087450] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T18:00:43.302424] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-01T18:00:43.750752] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T18:00:43.998774] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T18:00:44.102362] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-01T18:00:44.902382] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-01T18:00:45.491327] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T18:00:45.702374] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-01T18:00:45.920309] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-01T18:00:45.921496] [INFO ] [REMOTE ] CHH: Full fetch complete (46543 records). [2025-10-01T18:00:45.921576] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-01T18:00:46.343764] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-01T18:00:46.343860] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-01T18:00:46.344534] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-01T18:00:46.344604] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-01T18:00:46.345738] [DEBUG] [LOCAL ] CHH: Trimmed 46543 records to 32022 (keeping 200 days of data) [2025-10-01T18:00:46.511079] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-01T18:00:46.558324] [DEBUG] [LOCAL ] CHH: Primary data saved (32022 records). [2025-10-01T18:00:46.558516] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-01T18:00:46.558623] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHH took 28.8s. Estimated remaining: 4h 27m 58s. Rate: 7.2 symbols/min [2025-10-01T18:00:46.852444] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T18:00:47.196622] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-01T18:00:47.302399] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-01T18:00:48.102397] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-01T18:00:48.408876] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T18:00:48.857699] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T18:00:48.902417] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-01T18:00:49.702372] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-01T18:00:50.130337] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T18:00:50.306912] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T18:00:50.502394] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-01T18:00:51.149930] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T18:00:51.150694] [INFO ] [REMOTE ] CHN: Full fetch complete (7431 records). [2025-10-01T18:00:51.150766] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-01T18:00:51.312891] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-01T18:00:51.559378] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-01T18:00:51.559505] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-01T18:00:51.559994] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-01T18:00:51.560077] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-01T18:00:51.561908] [DEBUG] [LOCAL ] CHN: Trimmed 7431 records to 4818 (keeping 200 days of data) [2025-10-01T18:00:51.593616] [DEBUG] [LOCAL ] CHN: Primary data saved (4818 records). [2025-10-01T18:00:51.593762] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-01T18:00:51.593898] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 23.3s. Estimated remaining: 4h 27m 35s. Rate: 7.2 symbols/min [2025-10-01T18:00:52.178100] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T18:00:52.184268] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-01T18:00:53.382831] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-01T18:00:53.384116] [INFO ] [REMOTE ] CHMI: Full fetch complete (31798 records). [2025-10-01T18:00:53.384204] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-01T18:00:53.833856] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-01T18:00:53.833985] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-01T18:00:53.834616] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-01T18:00:53.834704] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-01T18:00:53.835692] [DEBUG] [LOCAL ] CHMI: Trimmed 31798 records to 21894 (keeping 200 days of data) [2025-10-01T18:00:53.971327] [DEBUG] [LOCAL ] CHMI: Primary data saved (21894 records). [2025-10-01T18:00:53.971457] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-01T18:00:53.971583] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 27.9s. Estimated remaining: 4h 27m 1s. Rate: 7.2 symbols/min [2025-10-01T18:00:54.568219] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:00:54.712616] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:00:54.711739] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:00:54.770335] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:00:54.803933] [DEBUG] [LOCAL ] CHT: Loaded 19569 existing records from primary storage. [2025-10-01T18:00:54.804408] [INFO ] [MAIN ] CHT: Loaded 19569 existing records. [2025-10-01T18:00:55.021321] [DEBUG] [LOCAL ] CHPT: Loaded 48767 existing records from primary storage. [2025-10-01T18:00:55.080842] [INFO ] [MAIN ] CHPT: Loaded 48767 existing records. [2025-10-01T18:00:55.079487] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:00:55.131224] [DEBUG] [LOCAL ] CI: Loaded 49729 existing records from primary storage. [2025-10-01T18:00:55.131407] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-01T18:00:55.158670] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-01T18:00:55.158532] [INFO ] [MAIN ] CI: Loaded 49729 existing records. [2025-10-01T18:00:55.147864] [DEBUG] [LOCAL ] CHWY: Loaded 53655 existing records from primary storage. [2025-10-01T18:00:55.195872] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-01T18:00:55.216998] [INFO ] [MAIN ] CHWY: Loaded 53655 existing records. [2025-10-01T18:00:55.232001] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-01T18:00:55.812929] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:00:55.847986] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-01T18:00:55.847762] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:00:55.917317] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-01T18:00:55.881044] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-01T18:00:55.952637] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-01T18:00:55.974151] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-01T18:00:56.059658] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-01T18:00:56.059334] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:00:56.064966] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-01T18:00:56.076588] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-01T18:00:56.108149] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-01T18:00:56.121353] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-01T18:00:56.247461] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-01T18:00:56.272914] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-01T18:00:56.534470] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:00:56.556992] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-01T18:00:57.243147] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:00:57.275848] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-01T18:00:57.457916] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:00:57.462627] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:00:57.463210] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-01T18:00:57.463547] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-01T18:00:57.847000] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T18:00:57.853047] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-01T18:00:58.884198] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T18:00:58.888110] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-01T18:00:58.935720] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T18:00:58.946635] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-01T18:00:59.719163] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-01T18:00:59.731225] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-01T18:00:59.779826] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-01T18:00:59.798224] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-01T18:00:59.916226] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T18:01:00.102442] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-01T18:01:01.158306] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-01T18:01:01.169356] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-01T18:01:01.470458] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T18:01:01.702370] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-01T18:01:01.821511] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T18:01:02.088300] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-01T18:01:02.502394] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-01T18:01:02.838717] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T18:01:02.927990] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T18:01:03.302411] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-01T18:01:04.102377] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-01T18:01:04.530075] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-01T18:01:04.902346] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-01T18:01:05.149042] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T18:01:05.594848] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T18:01:05.702374] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-01T18:01:06.502403] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-01T18:01:06.571043] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T18:01:07.036821] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-01T18:01:07.302384] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-01T18:01:08.102359] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-01T18:01:08.175127] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T18:01:08.857717] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T18:01:08.902424] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-01T18:01:09.702369] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-01T18:01:09.947014] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T18:01:10.500238] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T18:01:10.502462] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-01T18:01:10.935965] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T18:01:11.302390] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-01T18:01:12.102421] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-01T18:01:12.564295] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-01T18:01:12.823498] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T18:01:12.853126] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T18:01:12.902408] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-01T18:01:13.702374] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-01T18:01:14.502401] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-01T18:01:14.894117] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T18:01:15.187131] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T18:01:15.302357] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-01T18:01:15.593212] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T18:01:16.026514] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T18:01:16.102388] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-01T18:01:16.755528] [DEBUG] [REMOTE ] CHT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:01:16.755871] [WARN ] [REMOTE ] CHT: No data returned for month 2025-10 [2025-10-01T18:01:16.755963] [FATAL] [REMOTE ] CHT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:01:16.756044] [FATAL] [MAIN ] CHT: Failed to fetch primary data. [2025-10-01T18:01:16.756103] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:01:16.756175] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-01T18:01:16.756254] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-01T18:01:16.756311] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-01T18:01:16.756736] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-01T18:01:16.756824] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 22.8s. Estimated remaining: 4h 27m 56s. Rate: 7.2 symbols/min [2025-10-01T18:01:16.909580] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-01T18:01:16.947834] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:01:16.971454] [DEBUG] [LOCAL ] CIA: Loaded 17030 existing records from primary storage. [2025-10-01T18:01:16.971800] [INFO ] [MAIN ] CIA: Loaded 17030 existing records. [2025-10-01T18:01:17.202541] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:01:17.202809] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-01T18:01:17.202859] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-01T18:01:17.203083] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-01T18:01:17.203154] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-01T18:01:17.608255] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:01:17.702383] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-01T18:01:18.502398] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-01T18:01:18.728831] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T18:01:18.763045] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T18:01:19.302384] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-01T18:01:19.930446] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T18:01:20.102391] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-01T18:01:20.681492] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-01T18:01:20.902400] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-01T18:01:21.030933] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T18:01:21.702383] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-01T18:01:22.502446] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-01T18:01:22.790444] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T18:01:23.017939] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-01T18:01:23.302390] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-01T18:01:24.102355] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-01T18:01:24.291332] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T18:01:24.902389] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-01T18:01:25.068961] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T18:01:25.702406] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-01T18:01:26.371713] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-01T18:01:26.502402] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-01T18:01:26.645463] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T18:01:27.201994] [DEBUG] [REMOTE ] CHWY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:01:27.203461] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T18:01:27.203545] [WARN ] [REMOTE ] CHWY: No data returned for month 2025-10 [2025-10-01T18:01:27.207632] [FATAL] [REMOTE ] CHWY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:01:27.207851] [FATAL] [MAIN ] CHWY: Failed to fetch primary data. [2025-10-01T18:01:27.208239] [WARN ] [MAIN ] CHWY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:01:27.208459] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-01T18:01:27.208900] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-01T18:01:27.208968] [INFO ] [LOCAL ] CHWY: Starting deletion of derivative data. [2025-10-01T18:01:27.209552] [DEBUG] [LOCAL ] CHWY: Deleted derivative data file. [2025-10-01T18:01:27.209664] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHWY took 33.2s. Estimated remaining: 4h 27m 57s. Rate: 7.2 symbols/min [2025-10-01T18:01:27.307483] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-01T18:01:27.410778] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:01:27.447014] [DEBUG] [LOCAL ] CIB: Loaded 30856 existing records from primary storage. [2025-10-01T18:01:27.447305] [INFO ] [MAIN ] CIB: Loaded 30856 existing records. [2025-10-01T18:01:27.666508] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:01:27.666793] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-01T18:01:27.666854] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-01T18:01:27.667773] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-01T18:01:27.667886] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-01T18:01:28.105378] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-01T18:01:28.143474] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:01:28.265354] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T18:01:28.902391] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-01T18:01:29.702377] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-01T18:01:29.762152] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T18:01:30.062123] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T18:01:30.502416] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-01T18:01:31.302441] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-01T18:01:31.645028] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T18:01:31.670764] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T18:01:32.102387] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-01T18:01:32.902360] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-01T18:01:33.176804] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T18:01:33.483766] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T18:01:33.702367] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-01T18:01:34.003716] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T18:01:34.502415] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-01T18:01:34.888541] [DEBUG] [REMOTE ] CI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:01:34.888923] [WARN ] [REMOTE ] CI: No data returned for month 2025-10 [2025-10-01T18:01:34.889032] [FATAL] [REMOTE ] CI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:01:34.889132] [FATAL] [MAIN ] CI: Failed to fetch primary data. [2025-10-01T18:01:34.889215] [WARN ] [MAIN ] CI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:01:34.889327] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-01T18:01:34.889422] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-01T18:01:34.889492] [INFO ] [LOCAL ] CI: Starting deletion of derivative data. [2025-10-01T18:01:34.889908] [DEBUG] [LOCAL ] CI: Deleted derivative data file. [2025-10-01T18:01:34.890014] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CI took 40.9s. Estimated remaining: 4h 27m 46s. Rate: 7.2 symbols/min [2025-10-01T18:01:35.113048] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:01:35.113296] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-01T18:01:35.113368] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-01T18:01:35.113510] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-01T18:01:35.113579] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-01T18:01:35.113668] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-01T18:01:35.113743] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-01T18:01:35.302595] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-01T18:01:35.515093] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T18:01:35.580733] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:01:36.102419] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-01T18:01:36.902408] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-01T18:01:37.432748] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-01T18:01:37.455697] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T18:01:37.459407] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-01T18:01:37.470272] [INFO ] [REMOTE ] CHPT: Full fetch complete (72745 records). [2025-10-01T18:01:37.470431] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-01T18:01:37.703183] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-01T18:01:37.859418] [DEBUG] [REMOTE ] CIB: Error fetching primary data for 2025-02: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) [2025-10-01T18:01:37.875227] [WARN ] [REMOTE ] CIB: No data returned for month 2025-02 [2025-10-01T18:01:37.880566] [FATAL] [REMOTE ] CIB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:01:37.899039] [FATAL] [MAIN ] CIB: Failed to fetch primary data. [2025-10-01T18:01:37.916229] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:01:37.936501] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-01T18:01:37.968384] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-01T18:01:37.968712] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-01T18:01:37.968983] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-01T18:01:37.969164] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-01T18:01:37.970363] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-01T18:01:37.970584] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-01T18:01:37.970434] [DEBUG] [LOCAL ] CIB: Deleted derivative data file. [2025-10-01T18:01:37.971071] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CIB took 10.8s. Estimated remaining: 4h 27m 15s. Rate: 7.2 symbols/min [2025-10-01T18:01:38.070578] [DEBUG] [LOCAL ] CHPT: Trimmed 72745 records to 48646 (keeping 200 days of data) [2025-10-01T18:01:38.275690] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:01:38.409390] [DEBUG] [LOCAL ] CIEN: Loaded 52073 existing records from primary storage. [2025-10-01T18:01:38.439614] [INFO ] [MAIN ] CIEN: Loaded 52073 existing records. [2025-10-01T18:01:38.502751] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-01T18:01:38.686808] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:01:38.687236] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-01T18:01:38.687759] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-01T18:01:38.690006] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-01T18:01:38.690409] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-01T18:01:39.034358] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-01T18:01:39.214812] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:01:39.254671] [DEBUG] [LOCAL ] CHPT: Primary data saved (48646 records). [2025-10-01T18:01:39.254852] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-01T18:01:39.254954] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CHPT took 45.3s. Estimated remaining: 4h 26m 36s. Rate: 7.2 symbols/min [2025-10-01T18:01:39.307488] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-01T18:01:39.444431] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:01:39.450564] [DEBUG] [LOCAL ] CIF: Loaded 4251 existing records from primary storage. [2025-10-01T18:01:39.450800] [INFO ] [MAIN ] CIF: Loaded 4251 existing records. [2025-10-01T18:01:39.649823] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:01:39.650019] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-01T18:01:39.650070] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-01T18:01:39.650409] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-01T18:01:39.650470] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-01T18:01:40.044579] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:01:40.102422] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-01T18:01:40.388273] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-01T18:01:40.550206] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T18:01:40.902382] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-01T18:01:41.241046] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-01T18:01:41.702364] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-01T18:01:42.144977] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T18:01:42.502381] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-01T18:01:42.762708] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-01T18:01:43.302373] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-01T18:01:44.102382] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-01T18:01:44.902454] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-01T18:01:45.195759] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T18:01:45.210864] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T18:01:45.212784] [INFO ] [REMOTE ] CIA: Full fetch complete (23627 records). [2025-10-01T18:01:45.212893] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-01T18:01:45.355349] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T18:01:45.643167] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-01T18:01:45.643262] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-01T18:01:45.643703] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-01T18:01:45.643765] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-01T18:01:45.644430] [DEBUG] [LOCAL ] CIA: Trimmed 23627 records to 17039 (keeping 200 days of data) [2025-10-01T18:01:45.715465] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-01T18:01:45.746311] [DEBUG] [LOCAL ] CIA: Primary data saved (17039 records). [2025-10-01T18:01:45.746459] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-01T18:01:45.746544] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CIA took 29.0s. Estimated remaining: 4h 26m 20s. Rate: 7.2 symbols/min [2025-10-01T18:01:45.937732] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:01:45.981413] [DEBUG] [LOCAL ] CIG: Loaded 43817 existing records from primary storage. [2025-10-01T18:01:45.981785] [INFO ] [MAIN ] CIG: Loaded 43817 existing records. [2025-10-01T18:01:46.181615] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:01:46.181893] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-01T18:01:46.181944] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-01T18:01:46.183232] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-01T18:01:46.183294] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-01T18:01:46.507575] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-01T18:01:46.590178] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:01:46.678145] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T18:01:46.962334] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T18:01:47.302424] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-01T18:01:48.102399] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-01T18:01:48.793348] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T18:01:48.861028] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T18:01:48.902391] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-01T18:01:49.412297] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T18:01:49.702428] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-01T18:01:50.502406] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-01T18:01:51.104589] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T18:01:51.302408] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-01T18:01:51.361109] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T18:01:52.102447] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-01T18:01:52.423507] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-01T18:01:52.612088] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T18:01:52.902387] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-01T18:01:53.555630] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T18:01:53.702441] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-01T18:01:54.502380] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-01T18:01:55.289055] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T18:01:55.302339] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-01T18:01:55.648555] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T18:01:56.102416] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-01T18:01:56.637482] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-01T18:01:56.638221] [INFO ] [REMOTE ] CICB: Full fetch complete (2084 records). [2025-10-01T18:01:56.638295] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-01T18:01:56.849259] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-01T18:01:56.849522] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:01:56.849593] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:01:56.849721] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-01T18:01:56.849792] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-01T18:01:56.849831] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-01T18:01:56.849872] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-01T18:01:56.849931] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CICB took 22.0s. Estimated remaining: 4h 26m 24s. Rate: 7.2 symbols/min [2025-10-01T18:01:56.911562] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-01T18:01:57.050982] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:01:57.105791] [DEBUG] [LOCAL ] CII: Loaded 15237 existing records from primary storage. [2025-10-01T18:01:57.109407] [INFO ] [MAIN ] CII: Loaded 15237 existing records. [2025-10-01T18:01:57.191435] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T18:01:57.343748] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:01:57.343978] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-01T18:01:57.344091] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-01T18:01:57.344827] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-01T18:01:57.344895] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-01T18:01:57.707481] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-01T18:01:57.792997] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:01:58.018725] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T18:01:58.502368] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-01T18:01:58.645992] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T18:01:59.302359] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-01T18:01:59.508833] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T18:01:59.919552] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-01T18:02:00.102431] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-01T18:02:00.648282] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-01T18:02:00.902426] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-01T18:02:01.702402] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-01T18:02:02.509361] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-01T18:02:02.523150] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T18:02:02.519836] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T18:02:03.302427] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-01T18:02:03.748737] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-01T18:02:03.959770] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T18:02:04.102432] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-01T18:02:04.522901] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T18:02:04.902397] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-01T18:02:05.702579] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-01T18:02:06.502595] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-01T18:02:06.561009] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T18:02:07.169117] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T18:02:07.302392] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-01T18:02:07.612538] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T18:02:08.102443] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-01T18:02:08.902416] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-01T18:02:08.942089] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-01T18:02:08.943290] [INFO ] [REMOTE ] CIF: Full fetch complete (6615 records). [2025-10-01T18:02:08.943382] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-01T18:02:09.379766] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-01T18:02:09.485461] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-01T18:02:09.485778] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-01T18:02:09.486119] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-01T18:02:09.486234] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-01T18:02:09.486956] [DEBUG] [LOCAL ] CIF: Trimmed 6615 records to 4204 (keeping 200 days of data) [2025-10-01T18:02:09.511163] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T18:02:09.531859] [DEBUG] [LOCAL ] CIF: Primary data saved (4204 records). [2025-10-01T18:02:09.532026] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-01T18:02:09.532122] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIF took 30.3s. Estimated remaining: 4h 26m 34s. Rate: 7.2 symbols/min [2025-10-01T18:02:09.707500] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-01T18:02:09.741420] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:09.784933] [DEBUG] [LOCAL ] CIM: Loaded 37414 existing records from primary storage. [2025-10-01T18:02:09.785331] [INFO ] [MAIN ] CIM: Loaded 37414 existing records. [2025-10-01T18:02:10.016628] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:02:10.016901] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-01T18:02:10.016951] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-01T18:02:10.018113] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-01T18:02:10.018177] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-01T18:02:10.467981] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:02:10.502407] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-01T18:02:11.302382] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-01T18:02:11.376161] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T18:02:12.102556] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-01T18:02:12.106707] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T18:02:12.828984] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T18:02:12.902391] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-01T18:02:13.689614] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T18:02:13.702353] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-01T18:02:14.502397] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-01T18:02:14.664967] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T18:02:14.790434] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T18:02:15.302407] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-01T18:02:16.103012] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-01T18:02:16.110212] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T18:02:16.902394] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-01T18:02:17.527685] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T18:02:17.702382] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-01T18:02:18.257315] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-01T18:02:18.259225] [INFO ] [REMOTE ] CIEN: Full fetch complete (75581 records). [2025-10-01T18:02:18.259375] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-01T18:02:18.513356] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-01T18:02:18.759010] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-01T18:02:18.759428] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-01T18:02:18.760409] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-01T18:02:18.760594] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-01T18:02:18.795020] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T18:02:18.805539] [DEBUG] [LOCAL ] CIEN: Trimmed 75581 records to 52071 (keeping 200 days of data) [2025-10-01T18:02:18.936941] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T18:02:19.180569] [DEBUG] [LOCAL ] CIEN: Primary data saved (52071 records). [2025-10-01T18:02:19.180956] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-01T18:02:19.181053] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 41.2s. Estimated remaining: 4h 26m 31s. Rate: 7.2 symbols/min [2025-10-01T18:02:19.303484] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-01T18:02:19.395411] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:19.400622] [DEBUG] [LOCAL ] CIMN: Loaded 2679 existing records from primary storage. [2025-10-01T18:02:19.400853] [INFO ] [MAIN ] CIMN: Loaded 2679 existing records. [2025-10-01T18:02:19.594545] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T18:02:19.647114] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:02:19.648267] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-01T18:02:19.648328] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-01T18:02:19.648589] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-01T18:02:19.648698] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-01T18:02:20.075281] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:02:20.102342] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-01T18:02:20.543173] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T18:02:20.594276] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T18:02:20.902537] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-01T18:02:21.384634] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T18:02:21.702383] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-01T18:02:22.134080] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-01T18:02:22.502426] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-01T18:02:23.302391] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-01T18:02:23.894051] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T18:02:24.102352] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-01T18:02:24.902401] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-01T18:02:24.969599] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T18:02:25.435561] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-01T18:02:25.702404] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-01T18:02:26.204985] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T18:02:26.206596] [INFO ] [REMOTE ] CIG: Full fetch complete (61188 records). [2025-10-01T18:02:26.206715] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-01T18:02:26.507559] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-01T18:02:26.662664] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-01T18:02:26.662775] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-01T18:02:26.663699] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-01T18:02:26.663768] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-01T18:02:26.665191] [DEBUG] [LOCAL ] CIG: Trimmed 61188 records to 43824 (keeping 200 days of data) [2025-10-01T18:02:26.944694] [DEBUG] [LOCAL ] CIG: Primary data saved (43824 records). [2025-10-01T18:02:26.944860] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-01T18:02:26.944947] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CIG took 41.2s. Estimated remaining: 4h 26m 21s. Rate: 7.2 symbols/min [2025-10-01T18:02:27.149210] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:27.149571] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-01T18:02:27.149710] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-01T18:02:27.149889] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-01T18:02:27.150022] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-01T18:02:27.150115] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-01T18:02:27.150191] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-01T18:02:27.311403] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-01T18:02:27.473542] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T18:02:27.466958] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T18:02:27.670739] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:02:28.050804] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-01T18:02:28.102380] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-01T18:02:28.902393] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-01T18:02:29.577119] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T18:02:29.702364] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-01T18:02:30.074787] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T18:02:30.502397] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-01T18:02:30.876203] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T18:02:31.154548] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T18:02:31.302382] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-01T18:02:32.102388] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-01T18:02:32.330516] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T18:02:32.902353] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-01T18:02:32.980382] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T18:02:33.702376] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-01T18:02:34.038660] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T18:02:34.502428] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-01T18:02:34.566471] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T18:02:35.302382] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-01T18:02:35.356491] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T18:02:35.769403] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T18:02:36.102381] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-01T18:02:36.512905] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-01T18:02:36.902398] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-01T18:02:37.702439] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-01T18:02:38.153309] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-01T18:02:38.502356] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-01T18:02:38.556397] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T18:02:39.000917] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T18:02:39.302376] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-01T18:02:40.102428] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-01T18:02:40.550865] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T18:02:40.902425] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-01T18:02:40.917779] [DEBUG] [REMOTE ] CIM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:02:40.918062] [WARN ] [REMOTE ] CIM: No data returned for month 2025-10 [2025-10-01T18:02:40.918153] [FATAL] [REMOTE ] CIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:02:40.918257] [FATAL] [MAIN ] CIM: Failed to fetch primary data. [2025-10-01T18:02:40.918336] [WARN ] [MAIN ] CIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:02:40.918428] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-01T18:02:40.918518] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-01T18:02:40.918570] [INFO ] [LOCAL ] CIM: Starting deletion of derivative data. [2025-10-01T18:02:40.919083] [DEBUG] [LOCAL ] CIM: Deleted derivative data file. [2025-10-01T18:02:40.919175] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIM took 31.4s. Estimated remaining: 4h 26m 36s. Rate: 7.2 symbols/min [2025-10-01T18:02:41.107234] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:41.107441] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-01T18:02:41.107497] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-01T18:02:41.107609] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-01T18:02:41.107679] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-01T18:02:41.107744] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-01T18:02:41.107781] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-01T18:02:41.529968] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:02:41.702429] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-01T18:02:42.159463] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T18:02:42.197223] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T18:02:42.502502] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-01T18:02:43.302396] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-01T18:02:43.654207] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T18:02:43.655305] [INFO ] [REMOTE ] CII: Full fetch complete (23073 records). [2025-10-01T18:02:43.655394] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-01T18:02:44.072189] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-01T18:02:44.086291] [INFO ] [REMOTE ] CIMN: Full fetch complete (3916 records). [2025-10-01T18:02:44.111035] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-01T18:02:44.114331] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-01T18:02:44.158045] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-01T18:02:44.166836] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-01T18:02:44.167548] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-01T18:02:44.167627] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-01T18:02:44.211635] [DEBUG] [LOCAL ] CII: Trimmed 23073 records to 15206 (keeping 200 days of data) [2025-10-01T18:02:44.624050] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-01T18:02:44.710438] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-01T18:02:44.713855] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-01T18:02:44.714952] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-01T18:02:44.715287] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-01T18:02:44.716406] [DEBUG] [LOCAL ] CIMN: Trimmed 3916 records to 2682 (keeping 200 days of data) [2025-10-01T18:02:44.742923] [DEBUG] [LOCAL ] CIMN: Primary data saved (2682 records). [2025-10-01T18:02:44.743909] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-01T18:02:44.744284] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMN took 25.6s. Estimated remaining: 4h 26m 9s. Rate: 7.2 symbols/min [2025-10-01T18:02:44.842850] [DEBUG] [LOCAL ] CII: Primary data saved (15206 records). [2025-10-01T18:02:44.860936] [INFO ] [MAIN ] CII: Full history saved. [2025-10-01T18:02:44.873161] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CII took 48.0s. Estimated remaining: 4h 25m 26s. Rate: 7.2 symbols/min [2025-10-01T18:02:44.910444] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-01T18:02:45.073236] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:45.164610] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:45.173506] [DEBUG] [LOCAL ] CINT: Loaded 18629 existing records from primary storage. [2025-10-01T18:02:45.173790] [INFO ] [MAIN ] CINT: Loaded 18629 existing records. [2025-10-01T18:02:45.268627] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:02:45.298796] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-01T18:02:45.303767] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:02:45.303863] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-01T18:02:45.304296] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:02:45.327433] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-01T18:02:45.343066] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-01T18:02:45.363146] [DEBUG] [LOCAL ] CIO: Loaded 20234 existing records from primary storage. [2025-10-01T18:02:45.362343] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-01T18:02:45.377056] [INFO ] [MAIN ] CIO: Loaded 20234 existing records. [2025-10-01T18:02:45.427023] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-01T18:02:45.404806] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:02:45.427304] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIMP took 4.5s. Estimated remaining: 4h 24m 45s. Rate: 7.2 symbols/min [2025-10-01T18:02:45.427363] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-01T18:02:45.453332] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-01T18:02:45.588975] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-01T18:02:45.627281] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-01T18:02:45.710012] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-01T18:02:45.881306] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:45.910104] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:02:45.933715] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-01T18:02:45.933964] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-01T18:02:45.939751] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-01T18:02:45.945046] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-01T18:02:46.286333] [DEBUG] [LOCAL ] CION: Loaded 29029 existing records from primary storage. [2025-10-01T18:02:46.338182] [INFO ] [MAIN ] CION: Loaded 29029 existing records. [2025-10-01T18:02:46.582515] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T18:02:46.689319] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-01T18:02:46.676838] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:02:46.913047] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:02:46.919108] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:02:46.919942] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-01T18:02:46.920007] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-01T18:02:46.920941] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-01T18:02:46.921003] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-01T18:02:47.218095] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T18:02:47.307637] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-01T18:02:47.352795] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:02:47.793573] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T18:02:48.102392] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-01T18:02:48.902402] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-01T18:02:49.011833] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T18:02:49.527179] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-01T18:02:49.702417] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-01T18:02:50.502422] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-01T18:02:51.302362] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-01T18:02:51.347344] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T18:02:51.673277] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T18:02:52.102379] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-01T18:02:52.290464] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T18:02:52.902378] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-01T18:02:53.058906] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T18:02:53.702374] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-01T18:02:53.900216] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T18:02:54.478285] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T18:02:54.502407] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-01T18:02:55.302389] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-01T18:02:55.324222] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T18:02:56.102409] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-01T18:02:56.310918] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T18:02:56.902407] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-01T18:02:57.209965] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T18:02:57.539220] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T18:02:57.702448] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-01T18:02:58.452137] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T18:02:58.502451] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-01T18:02:59.302391] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-01T18:02:59.653049] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T18:02:59.717046] [DEBUG] [REMOTE ] CIMO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:02:59.717403] [WARN ] [REMOTE ] CIMO: No data returned for month 2025-10 [2025-10-01T18:02:59.717504] [FATAL] [REMOTE ] CIMO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:02:59.717589] [FATAL] [MAIN ] CIMO: Failed to fetch primary data. [2025-10-01T18:02:59.717689] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:02:59.717769] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-01T18:02:59.717969] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-01T18:02:59.718032] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-01T18:02:59.718102] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-01T18:02:59.718206] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMO took 32.8s. Estimated remaining: 4h 25m 2s. Rate: 7.2 symbols/min [2025-10-01T18:02:59.933597] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:02:59.988890] [DEBUG] [LOCAL ] CIVI: Loaded 52589 existing records from primary storage. [2025-10-01T18:02:59.989323] [INFO ] [MAIN ] CIVI: Loaded 52589 existing records. [2025-10-01T18:03:00.107687] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-01T18:03:00.202120] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:03:00.202336] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-01T18:03:00.202393] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-01T18:03:00.204694] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-01T18:03:00.204772] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-01T18:03:00.623718] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:00.902391] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-01T18:03:01.414939] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T18:03:01.702420] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-01T18:03:01.780385] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T18:03:02.502451] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-01T18:03:02.796494] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T18:03:03.302383] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-01T18:03:04.102387] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-01T18:03:04.333565] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T18:03:04.438738] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T18:03:04.902416] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-01T18:03:05.148411] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T18:03:05.702425] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-01T18:03:05.767427] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T18:03:06.502399] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-01T18:03:06.865452] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T18:03:07.302409] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-01T18:03:08.102420] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-01T18:03:08.161263] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T18:03:08.192464] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T18:03:08.701980] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T18:03:08.902383] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-01T18:03:09.702396] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-01T18:03:09.906084] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T18:03:10.502386] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-01T18:03:10.746398] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T18:03:11.302388] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-01T18:03:11.666327] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T18:03:12.102401] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-01T18:03:12.509039] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T18:03:12.902701] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-01T18:03:13.061996] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T18:03:13.702405] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-01T18:03:14.362884] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T18:03:14.502356] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-01T18:03:14.760281] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T18:03:15.302415] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-01T18:03:16.102398] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-01T18:03:16.312522] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T18:03:16.607271] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T18:03:16.820599] [DEBUG] [REMOTE ] CINT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:03:16.821019] [WARN ] [REMOTE ] CINT: No data returned for month 2025-10 [2025-10-01T18:03:16.821173] [FATAL] [REMOTE ] CINT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:03:16.821293] [FATAL] [MAIN ] CINT: Failed to fetch primary data. [2025-10-01T18:03:16.821443] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:03:16.821559] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-01T18:03:16.821693] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-01T18:03:16.821766] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-10-01T18:03:16.822273] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-10-01T18:03:16.822392] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CINT took 32.1s. Estimated remaining: 4h 25m 31s. Rate: 7.2 symbols/min [2025-10-01T18:03:16.912531] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-01T18:03:17.085922] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:03:17.086133] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-01T18:03:17.086173] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-01T18:03:17.086290] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-01T18:03:17.086334] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-01T18:03:17.086378] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-01T18:03:17.086413] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-01T18:03:17.480811] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:17.702395] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-01T18:03:18.502370] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-01T18:03:18.693753] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T18:03:18.948740] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T18:03:19.302415] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-01T18:03:20.102433] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-01T18:03:20.712841] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-01T18:03:20.902382] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-01T18:03:21.138272] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T18:03:21.179637] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T18:03:21.702379] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-01T18:03:22.502375] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-01T18:03:22.832570] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T18:03:22.867364] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T18:03:22.868857] [INFO ] [REMOTE ] CIO: Full fetch complete (29034 records). [2025-10-01T18:03:22.869034] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-01T18:03:23.307509] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-01T18:03:23.412663] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-01T18:03:23.412794] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-01T18:03:23.413902] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-01T18:03:23.413984] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-01T18:03:23.415517] [DEBUG] [LOCAL ] CIO: Trimmed 29034 records to 20291 (keeping 200 days of data) [2025-10-01T18:03:23.589225] [DEBUG] [LOCAL ] CIO: Primary data saved (20291 records). [2025-10-01T18:03:23.589378] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-01T18:03:23.589769] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIO took 38.7s. Estimated remaining: 4h 25m 16s. Rate: 7.2 symbols/min [2025-10-01T18:03:23.802407] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:03:23.845445] [DEBUG] [LOCAL ] CLB: Loaded 33011 existing records from primary storage. [2025-10-01T18:03:23.846006] [INFO ] [MAIN ] CLB: Loaded 33011 existing records. [2025-10-01T18:03:24.060750] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:03:24.060968] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-01T18:03:24.061017] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-01T18:03:24.062558] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-01T18:03:24.062638] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-01T18:03:24.114812] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-01T18:03:24.279527] [DEBUG] [REMOTE ] CION: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:03:24.300259] [WARN ] [REMOTE ] CION: No data returned for month 2025-10 [2025-10-01T18:03:24.318818] [FATAL] [REMOTE ] CION: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:03:24.338928] [FATAL] [MAIN ] CION: Failed to fetch primary data. [2025-10-01T18:03:24.366587] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:03:24.385615] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-01T18:03:24.412948] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-01T18:03:24.419086] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-01T18:03:24.466289] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-01T18:03:24.466487] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CION took 39.0s. Estimated remaining: 4h 24m 36s. Rate: 7.2 symbols/min [2025-10-01T18:03:24.583027] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:24.637623] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-01T18:03:24.751136] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:03:24.766765] [DEBUG] [LOCAL ] CLCO: Loaded 12668 existing records from primary storage. [2025-10-01T18:03:24.766994] [INFO ] [MAIN ] CLCO: Loaded 12668 existing records. [2025-10-01T18:03:24.907507] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-01T18:03:24.970861] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:03:24.971074] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-01T18:03:24.971125] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-01T18:03:24.971557] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-01T18:03:24.971618] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-01T18:03:25.378076] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:25.702573] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-01T18:03:25.911175] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T18:03:26.256578] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T18:03:26.502391] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-01T18:03:27.312711] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-01T18:03:27.337249] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T18:03:27.833849] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T18:03:28.102352] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-01T18:03:28.588965] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T18:03:28.902375] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-01T18:03:29.036014] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T18:03:29.702396] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-01T18:03:29.887802] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T18:03:30.502365] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-01T18:03:31.302627] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-01T18:03:31.515703] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T18:03:32.035181] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-01T18:03:32.102355] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-01T18:03:32.237101] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T18:03:32.902387] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-01T18:03:33.062469] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T18:03:33.702384] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-01T18:03:34.502382] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-01T18:03:34.742619] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T18:03:34.913904] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T18:03:35.302403] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-01T18:03:36.097245] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T18:03:36.102285] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-01T18:03:36.304184] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T18:03:36.902357] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-01T18:03:36.990135] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T18:03:37.702423] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-01T18:03:38.317577] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T18:03:38.502387] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-01T18:03:39.302394] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-01T18:03:39.396500] [DEBUG] [REMOTE ] CL: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-01T18:03:39.396872] [WARN ] [REMOTE ] CL: No data returned for month 2025-06 [2025-10-01T18:03:39.396968] [FATAL] [REMOTE ] CL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:03:39.397087] [FATAL] [MAIN ] CL: Failed to fetch primary data. [2025-10-01T18:03:39.397159] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:03:39.397233] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-01T18:03:39.397301] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-01T18:03:39.397341] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-10-01T18:03:39.397385] [DEBUG] [LOCAL ] CL: No derivative data file found to delete. [2025-10-01T18:03:39.397442] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CL took 22.6s. Estimated remaining: 4h 24m 56s. Rate: 7.2 symbols/min [2025-10-01T18:03:39.610630] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:03:39.640386] [DEBUG] [LOCAL ] CLDT: Loaded 25444 existing records from primary storage. [2025-10-01T18:03:39.640753] [INFO ] [MAIN ] CLDT: Loaded 25444 existing records. [2025-10-01T18:03:39.837048] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:03:39.837323] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-01T18:03:39.837386] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-01T18:03:39.837873] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-01T18:03:39.837934] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-01T18:03:40.107157] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-01T18:03:40.135875] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-01T18:03:40.171332] [INFO ] [REMOTE ] CIVI: Full fetch complete (75693 records). [2025-10-01T18:03:40.207703] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-01T18:03:40.276520] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:40.411472] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T18:03:40.742279] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-01T18:03:40.742370] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-01T18:03:40.743200] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-01T18:03:40.743269] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-01T18:03:40.744977] [DEBUG] [LOCAL ] CIVI: Trimmed 75693 records to 52597 (keeping 200 days of data) [2025-10-01T18:03:40.928516] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-01T18:03:41.072610] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T18:03:41.098077] [DEBUG] [LOCAL ] CIVI: Primary data saved (52597 records). [2025-10-01T18:03:41.098196] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-01T18:03:41.098276] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CIVI took 41.4s. Estimated remaining: 4h 24m 20s. Rate: 7.2 symbols/min [2025-10-01T18:03:41.291331] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:03:41.350805] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-01T18:03:41.351297] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-01T18:03:41.598983] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:03:41.599201] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-01T18:03:41.599259] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-01T18:03:41.600607] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-01T18:03:41.600698] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-01T18:03:41.707529] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-01T18:03:42.013393] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:42.387266] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T18:03:42.502370] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-01T18:03:42.652504] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T18:03:43.302407] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-01T18:03:43.895389] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T18:03:44.102446] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-01T18:03:44.902433] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-01T18:03:45.202963] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T18:03:45.374513] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-01T18:03:45.531303] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T18:03:45.702366] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-01T18:03:46.284352] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-01T18:03:46.502402] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-01T18:03:47.302374] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-01T18:03:48.102364] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-01T18:03:48.217839] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T18:03:48.653636] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-01T18:03:48.654675] [INFO ] [REMOTE ] CLCO: Full fetch complete (22800 records). [2025-10-01T18:03:48.654747] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-01T18:03:48.907552] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-01T18:03:49.079826] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-01T18:03:49.079915] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-01T18:03:49.080316] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-01T18:03:49.080357] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-01T18:03:49.081242] [DEBUG] [LOCAL ] CLCO: Trimmed 22800 records to 12678 (keeping 200 days of data) [2025-10-01T18:03:49.153778] [DEBUG] [LOCAL ] CLCO: Primary data saved (12678 records). [2025-10-01T18:03:49.153912] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-01T18:03:49.153993] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CLCO took 24.7s. Estimated remaining: 4h 24m 11s. Rate: 7.2 symbols/min [2025-10-01T18:03:49.350551] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:03:49.380178] [DEBUG] [LOCAL ] CLH: Loaded 27833 existing records from primary storage. [2025-10-01T18:03:49.380439] [INFO ] [MAIN ] CLH: Loaded 27833 existing records. [2025-10-01T18:03:49.607160] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T18:03:49.612172] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:03:49.619980] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-01T18:03:49.620286] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-01T18:03:49.620634] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-01T18:03:49.620772] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-01T18:03:49.708434] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-01T18:03:50.041690] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:50.063923] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T18:03:50.502404] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-01T18:03:51.018248] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T18:03:51.302355] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-01T18:03:51.674102] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T18:03:52.102435] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-01T18:03:52.755991] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T18:03:52.902385] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-01T18:03:53.437006] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T18:03:53.702398] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-01T18:03:54.502449] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-01T18:03:54.681773] [DEBUG] [REMOTE ] CLB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:03:54.682155] [WARN ] [REMOTE ] CLB: No data returned for month 2025-10 [2025-10-01T18:03:54.682268] [FATAL] [REMOTE ] CLB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:03:54.682369] [FATAL] [MAIN ] CLB: Failed to fetch primary data. [2025-10-01T18:03:54.682447] [WARN ] [MAIN ] CLB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:03:54.682536] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-01T18:03:54.682666] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-01T18:03:54.682740] [INFO ] [LOCAL ] CLB: Starting deletion of derivative data. [2025-10-01T18:03:54.683292] [DEBUG] [LOCAL ] CLB: Deleted derivative data file. [2025-10-01T18:03:54.683391] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLB took 31.1s. Estimated remaining: 4h 23m 51s. Rate: 7.2 symbols/min [2025-10-01T18:03:54.916863] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:03:54.931371] [DEBUG] [LOCAL ] CLPR: Loaded 11437 existing records from primary storage. [2025-10-01T18:03:54.931632] [INFO ] [MAIN ] CLPR: Loaded 11437 existing records. [2025-10-01T18:03:55.166563] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:03:55.170360] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-01T18:03:55.170679] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-01T18:03:55.173217] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-01T18:03:55.173362] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-01T18:03:55.173141] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-01T18:03:55.307609] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-01T18:03:55.589116] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:03:55.905601] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T18:03:56.102382] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-01T18:03:56.902445] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-01T18:03:57.471773] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T18:03:57.702370] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-01T18:03:57.850702] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-01T18:03:57.990941] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T18:03:58.502419] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-01T18:03:58.727637] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T18:03:59.302379] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-01T18:03:59.376282] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T18:04:00.102418] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-01T18:04:00.902400] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-01T18:04:01.465002] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-01T18:04:01.700436] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T18:04:01.706671] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-01T18:04:02.297389] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T18:04:02.502386] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-01T18:04:03.302391] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-01T18:04:04.039545] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T18:04:04.102343] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-01T18:04:04.275119] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (3.37 seconds). [2025-10-01T18:04:04.902549] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-01T18:04:05.334598] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-01T18:04:05.702552] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-01T18:04:05.760361] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T18:04:06.078288] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T18:04:06.502425] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-01T18:04:07.302377] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-01T18:04:07.394781] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T18:04:07.653930] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T18:04:08.102380] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-01T18:04:08.539792] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T18:04:08.726361] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-01T18:04:08.902386] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-01T18:04:09.702406] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-01T18:04:10.502424] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-01T18:04:10.654008] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T18:04:11.226104] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-01T18:04:11.302347] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-01T18:04:11.689070] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T18:04:12.102385] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-01T18:04:12.902355] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-01T18:04:12.986073] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T18:04:13.031798] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-01T18:04:13.702412] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-01T18:04:14.358019] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T18:04:14.502431] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-01T18:04:15.078310] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T18:04:15.302394] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-01T18:04:16.102360] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-01T18:04:16.150456] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-01T18:04:16.488704] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T18:04:16.902396] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-01T18:04:17.319713] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T18:04:17.702359] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-01T18:04:17.933186] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T18:04:18.502377] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-01T18:04:18.625109] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T18:04:19.302414] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-01T18:04:19.507256] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T18:04:20.102394] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-01T18:04:20.902317] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-01T18:04:20.902415] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-01T18:04:20.905147] [INFO ] [REMOTE ] CLH: Full fetch complete (41778 records). [2025-10-01T18:04:20.905291] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-01T18:04:20.944604] [DEBUG] [REMOTE ] CLDT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:04:20.984722] [WARN ] [REMOTE ] CLDT: No data returned for month 2025-10 [2025-10-01T18:04:21.002801] [FATAL] [REMOTE ] CLDT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:04:21.029998] [FATAL] [MAIN ] CLDT: Failed to fetch primary data. [2025-10-01T18:04:21.030567] [WARN ] [MAIN ] CLDT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:04:21.051549] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-01T18:04:21.086848] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-10-01T18:04:21.096951] [INFO ] [LOCAL ] CLDT: Starting deletion of derivative data. [2025-10-01T18:04:21.137165] [DEBUG] [LOCAL ] CLDT: Deleted derivative data file. [2025-10-01T18:04:21.183458] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 41.8s. Estimated remaining: 4h 24m 58s. Rate: 7.2 symbols/min [2025-10-01T18:04:21.559395] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:04:21.592406] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-01T18:04:21.592506] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-01T18:04:21.593086] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-01T18:04:21.593149] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-01T18:04:21.594329] [DEBUG] [LOCAL ] CLH: Trimmed 41778 records to 27798 (keeping 200 days of data) [2025-10-01T18:04:21.703348] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-01T18:04:21.757257] [DEBUG] [LOCAL ] CLS: Loaded 53623 existing records from primary storage. [2025-10-01T18:04:21.759130] [INFO ] [MAIN ] CLS: Loaded 53623 existing records. [2025-10-01T18:04:21.890176] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T18:04:21.991860] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:04:21.992412] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-01T18:04:21.993133] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-01T18:04:21.994518] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-01T18:04:21.994969] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-01T18:04:22.465995] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:04:22.473028] [DEBUG] [LOCAL ] CLH: Primary data saved (27798 records). [2025-10-01T18:04:22.473155] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-01T18:04:22.473278] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLH took 33.3s. Estimated remaining: 4h 24m 20s. Rate: 7.2 symbols/min [2025-10-01T18:04:22.507576] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-01T18:04:22.669913] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:04:22.727159] [DEBUG] [LOCAL ] CLVT: Loaded 51954 existing records from primary storage. [2025-10-01T18:04:22.727535] [INFO ] [MAIN ] CLVT: Loaded 51954 existing records. [2025-10-01T18:04:22.925120] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:04:22.925349] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-01T18:04:22.925398] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-01T18:04:22.925703] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-01T18:04:22.925763] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-01T18:04:23.247311] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T18:04:23.309176] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-01T18:04:23.331824] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:04:23.966354] [DEBUG] [REMOTE ] CLPR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:04:23.966701] [WARN ] [REMOTE ] CLPR: No data returned for month 2025-10 [2025-10-01T18:04:23.966795] [FATAL] [REMOTE ] CLPR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:04:23.966886] [FATAL] [MAIN ] CLPR: Failed to fetch primary data. [2025-10-01T18:04:23.966955] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:04:23.967037] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-01T18:04:23.967112] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-01T18:04:23.967156] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-01T18:04:23.967680] [DEBUG] [LOCAL ] CLPR: Deleted derivative data file. [2025-10-01T18:04:23.967780] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLPR took 29.3s. Estimated remaining: 4h 23m 44s. Rate: 7.2 symbols/min [2025-10-01T18:04:24.107531] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-01T18:04:24.184586] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:04:24.211886] [DEBUG] [LOCAL ] CLW: Loaded 21778 existing records from primary storage. [2025-10-01T18:04:24.212146] [INFO ] [MAIN ] CLW: Loaded 21778 existing records. [2025-10-01T18:04:24.414855] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:04:24.415064] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-01T18:04:24.415113] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-01T18:04:24.415332] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-01T18:04:24.415392] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-01T18:04:24.810503] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (3.11 seconds). [2025-10-01T18:04:24.830328] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-01T18:04:24.836317] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-01T18:04:24.836183] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:04:24.909513] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-01T18:04:25.299896] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-01T18:04:25.299991] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-01T18:04:25.300840] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-01T18:04:25.300972] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-01T18:04:25.302442] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-10-01T18:04:25.639461] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-01T18:04:25.639610] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-01T18:04:25.639743] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLF took 44.5s. Estimated remaining: 4h 23m 9s. Rate: 7.2 symbols/min [2025-10-01T18:04:25.706715] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-01T18:04:25.862956] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:04:25.894559] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T18:04:25.954712] [DEBUG] [LOCAL ] CLX: Loaded 51484 existing records from primary storage. [2025-10-01T18:04:25.955066] [INFO ] [MAIN ] CLX: Loaded 51484 existing records. [2025-10-01T18:04:26.154088] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:04:26.154346] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-01T18:04:26.154397] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-01T18:04:26.154695] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-01T18:04:26.154764] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-01T18:04:26.514356] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-01T18:04:26.559147] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:04:26.921134] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-01T18:04:27.102896] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T18:04:27.302394] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-01T18:04:27.887831] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T18:04:28.102385] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-01T18:04:28.902384] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-01T18:04:29.489475] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-01T18:04:29.533631] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T18:04:29.702375] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-01T18:04:30.300887] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T18:04:30.502375] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-01T18:04:31.302382] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-01T18:04:31.731810] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-01T18:04:32.102404] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-01T18:04:32.205978] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T18:04:32.511437] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T18:04:32.902383] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-01T18:04:33.644908] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T18:04:33.702391] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-01T18:04:34.502436] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-01T18:04:34.719784] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T18:04:35.302445] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-01T18:04:35.899208] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-01T18:04:36.102347] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-01T18:04:36.335573] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T18:04:36.749609] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T18:04:36.902436] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-01T18:04:37.197025] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T18:04:37.702400] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-01T18:04:38.502438] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-01T18:04:38.974289] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T18:04:39.302428] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-01T18:04:39.535404] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T18:04:39.751855] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T18:04:40.102403] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-01T18:04:40.725753] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T18:04:40.902388] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-01T18:04:41.244619] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T18:04:41.702449] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-01T18:04:42.500796] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T18:04:42.511295] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-01T18:04:43.302359] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-01T18:04:43.469502] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T18:04:43.709235] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-01T18:04:44.102421] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-01T18:04:44.902345] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-01T18:04:45.204034] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T18:04:45.702378] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-01T18:04:45.976715] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T18:04:46.046036] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T18:04:46.502403] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-01T18:04:47.302365] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-01T18:04:47.486729] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T18:04:48.102397] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-01T18:04:48.441933] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T18:04:48.908639] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-01T18:04:48.914410] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T18:04:49.702385] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-01T18:04:49.757039] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T18:04:50.502436] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-01T18:04:51.315296] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-01T18:04:51.321032] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-01T18:04:51.636946] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T18:04:51.663914] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T18:04:52.102477] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-01T18:04:52.877925] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T18:04:52.902348] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-01T18:04:53.702394] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-01T18:04:54.185814] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-01T18:04:54.502466] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-01T18:04:54.655752] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T18:04:55.302358] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-01T18:04:55.476604] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T18:04:56.102404] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-01T18:04:56.847034] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T18:04:56.902451] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-01T18:04:57.639263] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-01T18:04:57.641061] [INFO ] [REMOTE ] CLVT: Full fetch complete (75241 records). [2025-10-01T18:04:57.641245] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-01T18:04:57.713133] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-01T18:04:58.108204] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-01T18:04:58.111564] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-01T18:04:58.113244] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-01T18:04:58.112263] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (3.61 seconds). [2025-10-01T18:04:58.113424] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-01T18:04:58.115704] [INFO ] [REMOTE ] CLS: Full fetch complete (77460 records). [2025-10-01T18:04:58.115882] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-01T18:04:58.122152] [DEBUG] [LOCAL ] CLVT: Trimmed 75241 records to 51961 (keeping 200 days of data) [2025-10-01T18:04:58.659536] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-01T18:04:58.660398] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-01T18:04:58.662353] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-01T18:04:58.662866] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-01T18:04:58.668996] [DEBUG] [LOCAL ] CLS: Trimmed 77460 records to 53619 (keeping 200 days of data) [2025-10-01T18:04:58.920507] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-01T18:04:58.938729] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-01T18:04:59.134226] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-01T18:04:59.137696] [INFO ] [REMOTE ] CLW: Full fetch complete (35102 records). [2025-10-01T18:04:59.138351] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-01T18:04:59.594617] [DEBUG] [LOCAL ] CLVT: Primary data saved (51961 records). [2025-10-01T18:04:59.626121] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-01T18:04:59.635825] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLVT took 37.2s. Estimated remaining: 4h 24m 45s. Rate: 7.2 symbols/min [2025-10-01T18:04:59.635943] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-01T18:04:59.648229] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-01T18:04:59.649222] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-01T18:04:59.673539] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-01T18:04:59.738203] [DEBUG] [LOCAL ] CLW: Trimmed 35102 records to 21778 (keeping 200 days of data) [2025-10-01T18:04:59.999204] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:00.024610] [DEBUG] [LOCAL ] CLS: Primary data saved (53619 records). [2025-10-01T18:05:00.025846] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-01T18:05:00.026000] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLS took 38.8s. Estimated remaining: 4h 24m 5s. Rate: 7.2 symbols/min [2025-10-01T18:05:00.251798] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:00.259815] [DEBUG] [LOCAL ] CM: Loaded 48567 existing records from primary storage. [2025-10-01T18:05:00.261609] [INFO ] [MAIN ] CM: Loaded 48567 existing records. [2025-10-01T18:05:00.486833] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:00.487920] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-01T18:05:00.488047] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-01T18:05:00.490265] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-01T18:05:00.491055] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-01T18:05:00.602832] [DEBUG] [LOCAL ] CMA: Loaded 49922 existing records from primary storage. [2025-10-01T18:05:00.625793] [INFO ] [MAIN ] CMA: Loaded 49922 existing records. [2025-10-01T18:05:00.931370] [DEBUG] [LOCAL ] CLW: Primary data saved (21778 records). [2025-10-01T18:05:00.932144] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-01T18:05:00.953514] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLW took 37.0s. Estimated remaining: 4h 23m 26s. Rate: 7.2 symbols/min [2025-10-01T18:05:01.167761] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:01.255015] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-01T18:05:01.261187] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-01T18:05:01.268439] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T18:05:01.298332] [INFO ] [REMOTE ] CLX: Full fetch complete (73060 records). [2025-10-01T18:05:01.321583] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-01T18:05:01.322298] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-01T18:05:01.326883] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-01T18:05:01.326229] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:01.378249] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-01T18:05:01.487809] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:01.777748] [DEBUG] [LOCAL ] CMBT: Loaded 23214 existing records from primary storage. [2025-10-01T18:05:01.916227] [INFO ] [MAIN ] CMBT: Loaded 23214 existing records. [2025-10-01T18:05:02.423622] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:02.482799] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-01T18:05:02.563777] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:02.605846] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-01T18:05:02.606002] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-01T18:05:02.606128] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-01T18:05:02.607390] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-01T18:05:02.607493] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-01T18:05:02.607549] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-01T18:05:02.608375] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-01T18:05:02.608483] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-01T18:05:02.683811] [DEBUG] [LOCAL ] CLX: Trimmed 73060 records to 51491 (keeping 200 days of data) [2025-10-01T18:05:03.120459] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:03.121346] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-01T18:05:03.365095] [DEBUG] [LOCAL ] CLX: Primary data saved (51491 records). [2025-10-01T18:05:03.365361] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-01T18:05:03.365543] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLX took 37.7s. Estimated remaining: 4h 22m 54s. Rate: 7.2 symbols/min [2025-10-01T18:05:03.541546] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-01T18:05:03.580987] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-01T18:05:03.602726] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:03.647055] [DEBUG] [LOCAL ] CMC: Loaded 45583 existing records from primary storage. [2025-10-01T18:05:03.647416] [INFO ] [MAIN ] CMC: Loaded 45583 existing records. [2025-10-01T18:05:03.858877] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:03.859111] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-01T18:05:03.859163] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-01T18:05:03.860672] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-01T18:05:03.860740] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-01T18:05:04.320511] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:04.321017] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-01T18:05:04.455991] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T18:05:04.460393] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-01T18:05:04.986107] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-01T18:05:04.997599] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-01T18:05:05.036330] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T18:05:05.046577] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-01T18:05:05.319716] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T18:05:05.633770] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T18:05:05.702397] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-01T18:05:06.502366] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-01T18:05:06.669504] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T18:05:06.830605] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-01T18:05:07.072801] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T18:05:07.104797] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T18:05:07.302387] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-01T18:05:08.102428] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-01T18:05:08.907572] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-01T18:05:08.926403] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T18:05:09.125906] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T18:05:09.702388] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-01T18:05:10.200283] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T18:05:10.502426] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-01T18:05:11.302410] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-01T18:05:11.500909] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T18:05:12.102382] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-01T18:05:12.191180] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T18:05:12.792422] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T18:05:12.902403] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-01T18:05:13.702379] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-01T18:05:13.832836] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T18:05:14.289703] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T18:05:14.502385] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-01T18:05:15.302357] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-01T18:05:15.461181] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T18:05:16.102405] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-01T18:05:16.186356] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T18:05:16.353283] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T18:05:16.902383] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-01T18:05:17.667196] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T18:05:17.702389] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-01T18:05:18.363543] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T18:05:18.502407] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-01T18:05:19.302361] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-01T18:05:19.373783] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T18:05:20.098467] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T18:05:20.102379] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-01T18:05:20.141564] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T18:05:20.902402] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-01T18:05:21.702370] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-01T18:05:21.738568] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T18:05:22.253137] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T18:05:22.502385] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-01T18:05:23.107728] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T18:05:23.302370] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-01T18:05:24.102347] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-01T18:05:24.359387] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T18:05:24.902372] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-01T18:05:25.012550] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T18:05:25.050197] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T18:05:25.702400] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-01T18:05:26.502358] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-01T18:05:26.704869] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T18:05:27.302347] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-01T18:05:27.562763] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T18:05:27.738991] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T18:05:28.102437] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-01T18:05:28.652337] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T18:05:28.902387] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-01T18:05:29.683427] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T18:05:29.702356] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-01T18:05:30.502442] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-01T18:05:31.273037] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-01T18:05:31.274554] [INFO ] [REMOTE ] CMC: Full fetch complete (67069 records). [2025-10-01T18:05:31.274672] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-01T18:05:31.309465] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-01T18:05:31.564251] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T18:05:31.791348] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-01T18:05:31.791466] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-01T18:05:31.792386] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-01T18:05:31.792460] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-01T18:05:31.794512] [DEBUG] [LOCAL ] CMC: Trimmed 67069 records to 45589 (keeping 200 days of data) [2025-10-01T18:05:32.102530] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-01T18:05:32.157869] [DEBUG] [LOCAL ] CMC: Primary data saved (45589 records). [2025-10-01T18:05:32.158038] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-01T18:05:32.158151] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMC took 28.8s. Estimated remaining: 4h 24m 8s. Rate: 7.2 symbols/min [2025-10-01T18:05:32.356036] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:32.390820] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T18:05:32.394599] [DEBUG] [LOCAL ] CMCM: Loaded 4747 existing records from primary storage. [2025-10-01T18:05:32.394982] [INFO ] [MAIN ] CMCM: Loaded 4747 existing records. [2025-10-01T18:05:32.637005] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:32.637222] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-01T18:05:32.637271] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-01T18:05:32.637690] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-01T18:05:32.637809] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-01T18:05:32.914290] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-01T18:05:33.046629] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:33.460938] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-01T18:05:33.462539] [INFO ] [REMOTE ] CMA: Full fetch complete (73115 records). [2025-10-01T18:05:33.462726] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-01T18:05:33.725730] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-01T18:05:33.924987] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-01T18:05:33.925084] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-01T18:05:33.926096] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-01T18:05:33.926172] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-01T18:05:33.927904] [DEBUG] [LOCAL ] CMA: Trimmed 73115 records to 49871 (keeping 200 days of data) [2025-10-01T18:05:34.277311] [DEBUG] [LOCAL ] CMA: Primary data saved (49871 records). [2025-10-01T18:05:34.277478] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-01T18:05:34.277579] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMA took 34.3s. Estimated remaining: 4h 23m 35s. Rate: 7.2 symbols/min [2025-10-01T18:05:34.508214] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:34.508711] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-01T18:05:34.508839] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-01T18:05:34.509130] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-01T18:05:34.509230] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-01T18:05:34.509317] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-01T18:05:34.509368] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-01T18:05:34.598483] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-01T18:05:34.637457] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T18:05:34.626754] [INFO ] [REMOTE ] CMBT: Full fetch complete (30321 records). [2025-10-01T18:05:34.650256] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-01T18:05:34.658605] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-01T18:05:35.313756] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-01T18:05:35.303421] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:35.338700] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-01T18:05:35.326191] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-01T18:05:35.500277] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-01T18:05:35.500390] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-01T18:05:35.500990] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-01T18:05:35.501058] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-01T18:05:35.502241] [DEBUG] [LOCAL ] CMBT: Trimmed 30321 records to 23471 (keeping 200 days of data) [2025-10-01T18:05:35.654398] [DEBUG] [LOCAL ] CMBT: Primary data saved (23471 records). [2025-10-01T18:05:35.654538] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-01T18:05:35.654661] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMBT took 34.6s. Estimated remaining: 4h 22m 59s. Rate: 7.2 symbols/min [2025-10-01T18:05:35.855302] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:35.917041] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-01T18:05:35.917472] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-01T18:05:36.047816] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T18:05:36.105186] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-01T18:05:36.133906] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:36.134134] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-01T18:05:36.134194] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-01T18:05:36.134538] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-01T18:05:36.134598] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-01T18:05:36.580804] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:36.598295] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-01T18:05:36.902387] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-01T18:05:37.593316] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T18:05:37.702404] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-01T18:05:38.502420] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-01T18:05:38.700913] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:05:38.701257] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-01T18:05:38.701598] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:05:38.701721] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-01T18:05:38.701810] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:05:38.701891] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-01T18:05:38.701982] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-01T18:05:38.702048] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-01T18:05:38.702114] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-01T18:05:38.702223] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMDB took 4.4s. Estimated remaining: 4h 22m 29s. Rate: 7.2 symbols/min [2025-10-01T18:05:38.885054] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:38.936185] [DEBUG] [LOCAL ] CMI: Loaded 41730 existing records from primary storage. [2025-10-01T18:05:38.936556] [INFO ] [MAIN ] CMI: Loaded 41730 existing records. [2025-10-01T18:05:39.151477] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:39.151782] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-01T18:05:39.151870] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-01T18:05:39.152721] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-01T18:05:39.152809] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-01T18:05:39.307539] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-01T18:05:39.577284] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:39.930569] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T18:05:39.933233] [INFO ] [REMOTE ] CM: Full fetch complete (69345 records). [2025-10-01T18:05:39.933399] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-01T18:05:40.109734] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-01T18:05:40.385781] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-01T18:05:40.385880] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-01T18:05:40.386675] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-01T18:05:40.386741] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-01T18:05:40.388417] [DEBUG] [LOCAL ] CM: Trimmed 69345 records to 48556 (keeping 200 days of data) [2025-10-01T18:05:40.725574] [DEBUG] [LOCAL ] CM: Primary data saved (48556 records). [2025-10-01T18:05:40.725737] [INFO ] [MAIN ] CM: Full history saved. [2025-10-01T18:05:40.725831] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CM took 41.1s. Estimated remaining: 4h 21m 56s. Rate: 7.2 symbols/min [2025-10-01T18:05:40.925384] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:40.925603] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-01T18:05:40.966241] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T18:05:41.006074] [DEBUG] [LOCAL ] CMP: Loaded 36282 existing records from primary storage. [2025-10-01T18:05:41.006388] [INFO ] [MAIN ] CMP: Loaded 36282 existing records. [2025-10-01T18:05:41.224492] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:05:41.224789] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-01T18:05:41.224843] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-01T18:05:41.225101] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-01T18:05:41.225204] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-01T18:05:41.434725] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T18:05:41.650156] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:41.687280] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T18:05:41.702344] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-01T18:05:42.502402] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-01T18:05:43.302400] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-01T18:05:43.386576] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T18:05:43.927638] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T18:05:44.102365] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-01T18:05:44.339500] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T18:05:44.902400] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-01T18:05:45.598372] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T18:05:45.702386] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-01T18:05:46.347558] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T18:05:46.434260] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:05:46.502390] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-01T18:05:47.302428] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-01T18:05:47.498445] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T18:05:48.102379] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-01T18:05:48.275448] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T18:05:48.902432] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-01T18:05:49.612933] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T18:05:49.702368] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-01T18:05:49.758985] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T18:05:50.502412] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-01T18:05:50.549905] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T18:05:50.550625] [INFO ] [REMOTE ] CMCM: Full fetch complete (6989 records). [2025-10-01T18:05:50.550723] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-01T18:05:50.964144] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-01T18:05:50.964249] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-01T18:05:50.964483] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-01T18:05:50.964525] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-01T18:05:50.964965] [DEBUG] [LOCAL ] CMCM: Trimmed 6989 records to 4726 (keeping 200 days of data) [2025-10-01T18:05:50.995922] [DEBUG] [LOCAL ] CMCM: Primary data saved (4726 records). [2025-10-01T18:05:50.996081] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-01T18:05:50.996186] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMCM took 18.8s. Estimated remaining: 4h 21m 56s. Rate: 7.2 symbols/min [2025-10-01T18:05:51.207571] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:05:51.207854] [DEBUG] [LOCAL ] CMPO: No existing data file found in primary storage. [2025-10-01T18:05:51.207912] [WARN ] [MAIN ] CMPO: No existing data found, performing full refresh instead. [2025-10-01T18:05:51.208079] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-01T18:05:51.208167] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-01T18:05:51.208230] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-01T18:05:51.208266] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-01T18:05:51.307333] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-01T18:05:51.610196] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:05:51.784522] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T18:05:52.102395] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-01T18:05:52.902409] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-01T18:05:52.945625] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T18:05:53.375886] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:05:53.702411] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-01T18:05:54.429348] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T18:05:54.502405] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-01T18:05:55.302407] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-01T18:05:55.787229] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T18:05:56.072848] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T18:05:56.102354] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-01T18:05:56.902359] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-01T18:05:57.206889] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T18:05:57.702389] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-01T18:05:57.779520] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T18:05:58.119379] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T18:05:58.502389] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-01T18:05:58.985772] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T18:05:59.302393] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-01T18:06:00.102359] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-01T18:06:00.264340] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T18:06:00.902399] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-01T18:06:01.263426] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-01T18:06:01.352806] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T18:06:01.702377] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-01T18:06:02.495082] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T18:06:02.503500] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-01T18:06:02.777003] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T18:06:03.302383] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-01T18:06:04.102386] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-01T18:06:04.834790] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T18:06:04.902354] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-01T18:06:04.984921] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-01T18:06:05.283483] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T18:06:05.702414] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-01T18:06:05.917189] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T18:06:06.502441] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-01T18:06:07.302411] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-01T18:06:07.902159] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-01T18:06:08.102397] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-01T18:06:08.293021] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T18:06:08.835896] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T18:06:08.902407] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-01T18:06:09.702357] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-01T18:06:09.892926] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T18:06:10.370562] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T18:06:10.502407] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-01T18:06:11.302400] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-01T18:06:11.824503] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-01T18:06:11.826275] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T18:06:11.836682] [INFO ] [REMOTE ] CMI: Full fetch complete (60010 records). [2025-10-01T18:06:11.837608] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-01T18:06:12.107477] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-01T18:06:12.294422] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-01T18:06:12.294512] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-01T18:06:12.295429] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-01T18:06:12.295506] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-01T18:06:12.296956] [DEBUG] [LOCAL ] CMI: Trimmed 60010 records to 41704 (keeping 200 days of data) [2025-10-01T18:06:12.577109] [DEBUG] [LOCAL ] CMI: Primary data saved (41704 records). [2025-10-01T18:06:12.577252] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-01T18:06:12.577338] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMI took 33.9s. Estimated remaining: 4h 22m 40s. Rate: 7.2 symbols/min [2025-10-01T18:06:12.846690] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T18:06:12.902395] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-01T18:06:13.702380] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-01T18:06:13.734907] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T18:06:14.502490] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-01T18:06:14.775362] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T18:06:14.959699] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T18:06:15.302386] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-01T18:06:16.015271] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T18:06:16.102398] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-01T18:06:16.902401] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-01T18:06:16.930622] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-01T18:06:16.932083] [INFO ] [REMOTE ] CMP: Full fetch complete (52626 records). [2025-10-01T18:06:16.932180] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-01T18:06:17.365937] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-01T18:06:17.366023] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-01T18:06:17.366679] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-01T18:06:17.366745] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-01T18:06:17.368020] [DEBUG] [LOCAL ] CMP: Trimmed 52626 records to 36257 (keeping 200 days of data) [2025-10-01T18:06:17.595776] [DEBUG] [LOCAL ] CMP: Primary data saved (36257 records). [2025-10-01T18:06:17.595937] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-01T18:06:17.596036] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMP took 36.9s. Estimated remaining: 4h 22m 19s. Rate: 7.2 symbols/min [2025-10-01T18:06:18.108502] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-01T18:06:18.123589] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-01T18:06:18.647244] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-01T18:06:18.648694] [INFO ] [REMOTE ] CMPO: Full fetch complete (59012 records). [2025-10-01T18:06:18.648794] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-01T18:06:19.073414] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-01T18:06:19.073496] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-01T18:06:19.074209] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-01T18:06:19.074271] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-01T18:06:19.075674] [DEBUG] [LOCAL ] CMPO: Trimmed 59012 records to 39242 (keeping 200 days of data) [2025-10-01T18:06:19.319969] [DEBUG] [LOCAL ] CMPO: Primary data saved (39242 records). [2025-10-01T18:06:19.320120] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-01T18:06:19.320205] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 28.3s. Estimated remaining: 4h 21m 44s. Rate: 7.2 symbols/min [2025-10-01T18:06:20.527067] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-01T18:06:20.540074] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-01T18:06:24.102567] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (3.56 seconds). [2025-10-01T18:06:24.104424] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-01T18:06:24.104616] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-01T18:06:24.558708] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-01T18:06:24.558803] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-01T18:06:24.559736] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-01T18:06:24.559810] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-01T18:06:24.561392] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-10-01T18:06:24.916089] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-10-01T18:06:24.916338] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-01T18:06:24.916497] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMG took 49.3s. Estimated remaining: 4h 21m 25s. Rate: 7.2 symbols/min [2025-10-01T18:06:25.710987] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:06:25.770423] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:06:25.813189] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:06:25.832797] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-10-01T18:06:25.833361] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-10-01T18:06:25.833846] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-01T18:06:25.833923] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-01T18:06:25.833999] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-01T18:06:25.839088] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:06:25.839712] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-01T18:06:25.924930] [DEBUG] [LOCAL ] CMSC: Loaded 5049 existing records from primary storage. [2025-10-01T18:06:25.949347] [INFO ] [MAIN ] CMSC: Loaded 5049 existing records. [2025-10-01T18:06:25.943792] [DEBUG] [LOCAL ] CMSA: Loaded 3503 existing records from primary storage. [2025-10-01T18:06:25.965632] [INFO ] [MAIN ] CMSA: Loaded 3503 existing records. [2025-10-01T18:06:26.623463] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:06:26.631859] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:06:26.619773] [DEBUG] [LOCAL ] CMS: Loaded 52610 existing records from primary storage. [2025-10-01T18:06:26.660745] [INFO ] [MAIN ] CMS: Loaded 52610 existing records. [2025-10-01T18:06:26.661007] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-01T18:06:26.666891] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-01T18:06:26.683980] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-01T18:06:26.699708] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-01T18:06:26.807526] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:06:26.783513] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-01T18:06:26.818125] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-01T18:06:26.804310] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-01T18:06:26.818320] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-01T18:06:26.874120] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-01T18:06:27.193438] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:06:27.235135] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-01T18:06:27.240534] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-01T18:06:27.278407] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-01T18:06:27.294024] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-01T18:06:28.000291] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:06:28.078901] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:06:28.112019] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-01T18:06:28.111623] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-01T18:06:28.308380] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T18:06:28.331254] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:06:28.337203] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-01T18:06:28.337518] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-01T18:06:28.636352] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-01T18:06:28.638299] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-01T18:06:28.832259] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T18:06:28.834081] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-01T18:06:29.249372] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T18:06:29.251851] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-01T18:06:29.422732] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T18:06:29.424383] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-01T18:06:29.612501] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-01T18:06:29.614107] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-01T18:06:29.658403] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T18:06:29.665509] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-01T18:06:29.905223] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T18:06:29.907150] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T18:06:29.909169] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-01T18:06:29.921441] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-01T18:06:30.218073] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T18:06:30.220184] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-01T18:06:30.330220] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-01T18:06:30.502391] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-01T18:06:30.844905] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-01T18:06:30.851448] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-01T18:06:31.102426] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T18:06:31.302355] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-01T18:06:31.715295] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T18:06:32.102382] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-01T18:06:32.539381] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T18:06:32.768778] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T18:06:32.902404] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-01T18:06:33.258277] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-01T18:06:33.702385] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-01T18:06:34.403064] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T18:06:34.502413] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-01T18:06:35.302365] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-01T18:06:35.947529] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T18:06:36.106444] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-01T18:06:36.111607] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T18:06:36.902384] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-01T18:06:37.325623] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-01T18:06:37.695943] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T18:06:37.705049] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-01T18:06:38.462787] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T18:06:38.502419] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-01T18:06:39.302428] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-01T18:06:39.779841] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T18:06:40.102379] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-01T18:06:40.345159] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T18:06:40.774903] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-01T18:06:40.775686] [INFO ] [REMOTE ] CMSC: Full fetch complete (7185 records). [2025-10-01T18:06:40.775761] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-01T18:06:40.907576] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-01T18:06:41.160017] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-01T18:06:41.160101] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-01T18:06:41.160309] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-01T18:06:41.160353] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-01T18:06:41.160802] [DEBUG] [LOCAL ] CMSC: Trimmed 7185 records to 5075 (keeping 200 days of data) [2025-10-01T18:06:41.194393] [DEBUG] [LOCAL ] CMSC: Primary data saved (5075 records). [2025-10-01T18:06:41.194519] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-01T18:06:41.194615] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSC took 16.3s. Estimated remaining: 4h 21m 49s. Rate: 7.2 symbols/min [2025-10-01T18:06:41.372708] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:06:41.383312] [DEBUG] [LOCAL ] CMSD: Loaded 8092 existing records from primary storage. [2025-10-01T18:06:41.383523] [INFO ] [MAIN ] CMSD: Loaded 8092 existing records. [2025-10-01T18:06:41.529813] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T18:06:41.595982] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:06:41.596256] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-01T18:06:41.596313] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-01T18:06:41.596620] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-01T18:06:41.596717] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-01T18:06:41.707568] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-01T18:06:42.031661] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:06:42.502390] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-01T18:06:43.001858] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T18:06:43.302367] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-01T18:06:43.384604] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T18:06:44.102390] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-01T18:06:44.902377] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-01T18:06:45.125524] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T18:06:45.331562] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T18:06:45.702367] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-01T18:06:45.850535] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T18:06:46.502386] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-01T18:06:46.826573] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T18:06:47.302402] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-01T18:06:48.102429] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-01T18:06:48.380906] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T18:06:48.495067] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T18:06:48.666357] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T18:06:48.902388] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-01T18:06:49.702432] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-01T18:06:50.251107] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T18:06:50.475784] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T18:06:50.502341] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-01T18:06:51.065040] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T18:06:51.302418] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-01T18:06:52.102412] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-01T18:06:52.902379] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-01T18:06:53.172758] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T18:06:53.702425] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-01T18:06:53.746555] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-01T18:06:53.747317] [INFO ] [REMOTE ] CMSA: Full fetch complete (5159 records). [2025-10-01T18:06:53.747386] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-01T18:06:53.924489] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-01T18:06:53.954211] [INFO ] [REMOTE ] CMRE: Full fetch complete (49999 records). [2025-10-01T18:06:53.961987] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-01T18:06:54.366704] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-01T18:06:54.366865] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-01T18:06:54.367093] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-01T18:06:54.367494] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-01T18:06:54.410107] [DEBUG] [LOCAL ] CMSA: Trimmed 5159 records to 3509 (keeping 200 days of data) [2025-10-01T18:06:54.503538] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-01T18:06:54.625709] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T18:06:54.678900] [DEBUG] [LOCAL ] CMSA: Primary data saved (3509 records). [2025-10-01T18:06:54.679036] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-01T18:06:54.679156] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 29.8s. Estimated remaining: 4h 22m 1s. Rate: 7.2 symbols/min [2025-10-01T18:06:54.679297] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-01T18:06:54.690835] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-01T18:06:54.741258] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-01T18:06:54.758441] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-01T18:06:54.817325] [DEBUG] [LOCAL ] CMRE: Trimmed 49999 records to 35458 (keeping 200 days of data) [2025-10-01T18:06:54.928333] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:06:55.071941] [DEBUG] [LOCAL ] CMTG: Loaded 36969 existing records from primary storage. [2025-10-01T18:06:55.096958] [INFO ] [MAIN ] CMTG: Loaded 36969 existing records. [2025-10-01T18:06:55.309920] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-01T18:06:55.317362] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:06:55.319291] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-01T18:06:55.320567] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-01T18:06:55.324458] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-01T18:06:55.325044] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-01T18:06:55.445361] [DEBUG] [LOCAL ] CMRE: Primary data saved (35458 records). [2025-10-01T18:06:55.456109] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-01T18:06:55.466473] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 30.5s. Estimated remaining: 4h 21m 23s. Rate: 7.2 symbols/min [2025-10-01T18:06:55.855723] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:06:55.948294] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:06:55.952889] [DEBUG] [LOCAL ] CMU: Loaded 6938 existing records from primary storage. [2025-10-01T18:06:55.953137] [INFO ] [MAIN ] CMU: Loaded 6938 existing records. [2025-10-01T18:06:56.107476] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-01T18:06:56.149860] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:06:56.150695] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-01T18:06:56.150890] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-01T18:06:56.151176] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-01T18:06:56.151244] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-01T18:06:56.417015] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T18:06:56.641439] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-01T18:06:56.677919] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:06:56.902393] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-01T18:06:57.181910] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T18:06:57.605838] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T18:06:57.702385] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-01T18:06:58.431184] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-01T18:06:58.502466] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-01T18:06:59.302395] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-01T18:06:59.832941] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T18:07:00.102380] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-01T18:07:00.902388] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-01T18:07:01.274425] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-01T18:07:01.394248] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T18:07:01.631154] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:07:01.702389] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-01T18:07:02.502404] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-01T18:07:02.595510] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T18:07:03.302380] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-01T18:07:03.860345] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T18:07:04.102386] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-01T18:07:04.135336] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T18:07:04.902395] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-01T18:07:04.998995] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-01T18:07:05.000506] [INFO ] [REMOTE ] CMSD: Full fetch complete (12445 records). [2025-10-01T18:07:05.000579] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-01T18:07:05.390570] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-01T18:07:05.390672] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-01T18:07:05.390970] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-01T18:07:05.391010] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-01T18:07:05.391522] [DEBUG] [LOCAL ] CMSD: Trimmed 12445 records to 8099 (keeping 200 days of data) [2025-10-01T18:07:05.444939] [DEBUG] [LOCAL ] CMSD: Primary data saved (8099 records). [2025-10-01T18:07:05.445077] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-01T18:07:05.445160] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMSD took 24.3s. Estimated remaining: 4h 21m 21s. Rate: 7.2 symbols/min [2025-10-01T18:07:05.517918] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T18:07:05.639364] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:07:05.639543] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-01T18:07:05.639584] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-01T18:07:05.639727] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-01T18:07:05.639775] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-01T18:07:05.639826] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-01T18:07:05.639863] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-01T18:07:05.707721] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-01T18:07:06.049235] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:07:06.502396] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-01T18:07:07.302372] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-01T18:07:07.345860] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T18:07:07.891107] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T18:07:07.932707] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T18:07:08.102376] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-01T18:07:08.750419] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T18:07:08.902414] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-01T18:07:09.546729] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T18:07:09.702386] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-01T18:07:10.502389] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-01T18:07:10.764002] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T18:07:11.302393] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-01T18:07:11.653821] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-01T18:07:11.659507] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T18:07:12.102397] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-01T18:07:12.902402] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-01T18:07:13.049307] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T18:07:13.702346] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-01T18:07:13.833230] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T18:07:14.482837] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T18:07:14.502346] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-01T18:07:15.173046] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T18:07:15.302392] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-01T18:07:16.102392] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-01T18:07:16.163127] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T18:07:16.902389] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-01T18:07:17.453327] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T18:07:17.702389] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-01T18:07:18.196632] [DEBUG] [REMOTE ] CMU: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:07:18.197018] [WARN ] [REMOTE ] CMU: No data returned for month 2025-10 [2025-10-01T18:07:18.197159] [FATAL] [REMOTE ] CMU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:07:18.197298] [FATAL] [MAIN ] CMU: Failed to fetch primary data. [2025-10-01T18:07:18.197394] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:07:18.197492] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-01T18:07:18.197586] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-01T18:07:18.197634] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-10-01T18:07:18.198172] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-10-01T18:07:18.198264] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMU took 22.7s. Estimated remaining: 4h 21m 30s. Rate: 7.2 symbols/min [2025-10-01T18:07:18.384695] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:07:18.438507] [DEBUG] [LOCAL ] CNC: Loaded 53740 existing records from primary storage. [2025-10-01T18:07:18.438876] [INFO ] [MAIN ] CNC: Loaded 53740 existing records. [2025-10-01T18:07:18.507629] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-01T18:07:18.594215] [DEBUG] [REMOTE ] CMS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:07:18.606177] [WARN ] [REMOTE ] CMS: No data returned for month 2025-10 [2025-10-01T18:07:18.616318] [FATAL] [REMOTE ] CMS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:07:18.616846] [FATAL] [MAIN ] CMS: Failed to fetch primary data. [2025-10-01T18:07:18.633192] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:07:18.638613] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-01T18:07:18.638775] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-01T18:07:18.638521] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:07:18.639046] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-01T18:07:18.638987] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-01T18:07:18.639203] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-01T18:07:18.639534] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-01T18:07:18.639593] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-01T18:07:18.672241] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-01T18:07:18.719243] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMS took 53.8s. Estimated remaining: 4h 20m 51s. Rate: 7.2 symbols/min [2025-10-01T18:07:19.155559] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:07:19.235107] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:07:19.240976] [DEBUG] [LOCAL ] CNF: Loaded 10899 existing records from primary storage. [2025-10-01T18:07:19.241255] [INFO ] [MAIN ] CNF: Loaded 10899 existing records. [2025-10-01T18:07:19.308405] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-01T18:07:19.436947] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:07:19.437181] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-01T18:07:19.437236] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-01T18:07:19.437451] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-01T18:07:19.437518] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-01T18:07:19.850910] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:07:20.037389] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T18:07:20.102367] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-01T18:07:20.902361] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-01T18:07:21.277230] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-01T18:07:21.702380] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-01T18:07:22.117231] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-01T18:07:22.511945] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-01T18:07:22.516620] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T18:07:23.228567] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T18:07:23.302370] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-01T18:07:23.435550] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T18:07:24.102410] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-01T18:07:24.567560] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T18:07:24.902394] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-01T18:07:25.679677] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T18:07:25.702386] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-01T18:07:26.109827] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T18:07:26.502351] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-01T18:07:26.585873] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T18:07:27.302389] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-01T18:07:27.713047] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-01T18:07:28.085115] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T18:07:28.102339] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-01T18:07:28.902386] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-01T18:07:29.065388] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T18:07:29.702385] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-01T18:07:29.846410] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T18:07:30.502375] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-01T18:07:30.613231] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T18:07:31.302381] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-01T18:07:32.102384] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-01T18:07:32.343548] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T18:07:32.902392] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-01T18:07:32.980867] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-01T18:07:32.982076] [INFO ] [REMOTE ] CNA: Full fetch complete (45546 records). [2025-10-01T18:07:32.982163] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-01T18:07:33.398503] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-01T18:07:33.398599] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-01T18:07:33.399267] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-01T18:07:33.399335] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-01T18:07:33.400624] [DEBUG] [LOCAL ] CNA: Trimmed 45546 records to 32776 (keeping 200 days of data) [2025-10-01T18:07:33.594959] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T18:07:33.618636] [DEBUG] [LOCAL ] CNA: Primary data saved (32776 records). [2025-10-01T18:07:33.618811] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-01T18:07:33.618893] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CNA took 28.2s. Estimated remaining: 4h 21m 9s. Rate: 7.2 symbols/min [2025-10-01T18:07:33.707517] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-01T18:07:33.746672] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T18:07:33.769229] [INFO ] [REMOTE ] CMTG: Full fetch complete (53487 records). [2025-10-01T18:07:33.779761] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-01T18:07:33.919178] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:07:34.289489] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-01T18:07:34.289577] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-01T18:07:34.290261] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-01T18:07:34.290406] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-01T18:07:34.292303] [DEBUG] [LOCAL ] CNH: Loaded 53555 existing records from primary storage. [2025-10-01T18:07:34.293005] [INFO ] [MAIN ] CNH: Loaded 53555 existing records. [2025-10-01T18:07:34.330016] [DEBUG] [LOCAL ] CMTG: Trimmed 53487 records to 36836 (keeping 200 days of data) [2025-10-01T18:07:34.522581] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-01T18:07:34.593300] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:07:34.595267] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-01T18:07:34.595979] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-01T18:07:34.597942] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-01T18:07:34.598919] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-01T18:07:35.155591] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:07:35.170231] [DEBUG] [LOCAL ] CMTG: Primary data saved (36836 records). [2025-10-01T18:07:35.170393] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-01T18:07:35.170484] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CMTG took 40.5s. Estimated remaining: 4h 20m 34s. Rate: 7.2 symbols/min [2025-10-01T18:07:35.306084] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-01T18:07:35.374922] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:07:35.407637] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T18:07:35.463925] [DEBUG] [LOCAL ] CNI: Loaded 51650 existing records from primary storage. [2025-10-01T18:07:35.475869] [INFO ] [MAIN ] CNI: Loaded 51650 existing records. [2025-10-01T18:07:35.476300] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T18:07:35.692820] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:07:35.693030] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-01T18:07:35.693079] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-01T18:07:35.693317] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-01T18:07:35.693376] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-01T18:07:36.110818] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-01T18:07:36.110703] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:07:36.689360] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T18:07:36.842394] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T18:07:36.902352] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-01T18:07:37.691440] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T18:07:37.702334] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-01T18:07:38.502372] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-01T18:07:38.670066] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T18:07:39.302400] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-01T18:07:40.102400] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-01T18:07:40.279417] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T18:07:40.902392] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-01T18:07:41.167225] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T18:07:41.468776] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-01T18:07:41.702380] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-01T18:07:42.014779] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-01T18:07:42.502401] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-01T18:07:43.299225] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T18:07:43.303483] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-01T18:07:43.353052] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T18:07:44.102397] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-01T18:07:44.902378] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-01T18:07:44.941436] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T18:07:45.144636] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T18:07:45.702448] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-01T18:07:46.502371] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-01T18:07:46.683692] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T18:07:47.306362] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-01T18:07:47.311965] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T18:07:48.102344] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-01T18:07:48.512701] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T18:07:48.902400] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-01T18:07:49.037161] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T18:07:49.702384] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-01T18:07:49.946236] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T18:07:50.503518] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-01T18:07:50.853482] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T18:07:51.302357] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-01T18:07:51.476747] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T18:07:52.102809] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-01T18:07:52.660108] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-01T18:07:52.902379] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-01T18:07:53.032759] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T18:07:53.347754] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T18:07:53.702414] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-01T18:07:53.952623] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T18:07:53.953744] [INFO ] [REMOTE ] CNF: Full fetch complete (12968 records). [2025-10-01T18:07:53.953828] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-01T18:07:54.345351] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-01T18:07:54.345433] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-01T18:07:54.345772] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-01T18:07:54.345835] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-01T18:07:54.346391] [DEBUG] [LOCAL ] CNF: Trimmed 12968 records to 10716 (keeping 200 days of data) [2025-10-01T18:07:54.410635] [DEBUG] [LOCAL ] CNF: Primary data saved (10716 records). [2025-10-01T18:07:54.410888] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-01T18:07:54.410993] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNF took 35.7s. Estimated remaining: 4h 21m 8s. Rate: 7.2 symbols/min [2025-10-01T18:07:54.509958] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-01T18:07:54.597621] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:07:54.651822] [DEBUG] [LOCAL ] CNK: Loaded 52880 existing records from primary storage. [2025-10-01T18:07:54.652202] [INFO ] [MAIN ] CNK: Loaded 52880 existing records. [2025-10-01T18:07:54.849538] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:07:54.849781] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-01T18:07:54.849841] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-01T18:07:54.850114] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-01T18:07:54.850174] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-01T18:07:55.255353] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:07:55.302357] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-01T18:07:55.575548] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T18:07:56.102384] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-01T18:07:56.840907] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T18:07:56.902418] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-01T18:07:57.126954] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-01T18:07:57.702383] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-01T18:07:58.216561] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T18:07:58.502378] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-01T18:07:59.240678] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T18:07:59.302381] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-01T18:07:59.955187] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T18:08:00.102381] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-01T18:08:00.902388] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-01T18:08:01.233244] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T18:08:01.702401] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-01T18:08:01.843838] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T18:08:02.165971] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (6.06 seconds). [2025-10-01T18:08:02.502349] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-01T18:08:02.553571] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T18:08:03.302386] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-01T18:08:03.652624] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T18:08:03.994057] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T18:08:04.102385] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-01T18:08:04.744314] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T18:08:04.902376] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-01T18:08:05.702382] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-01T18:08:06.502392] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-01T18:08:07.112993] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-01T18:08:07.114733] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-01T18:08:07.114841] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-01T18:08:07.235346] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T18:08:07.263554] [INFO ] [REMOTE ] CNI: Full fetch complete (74630 records). [2025-10-01T18:08:07.286188] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-01T18:08:07.832696] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-01T18:08:07.866159] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-01T18:08:07.914584] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-01T18:08:07.932359] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-01T18:08:08.008059] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 53739 (keeping 200 days of data) [2025-10-01T18:08:08.052824] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-01T18:08:08.053280] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-01T18:08:08.054073] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-01T18:08:08.054198] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-01T18:08:08.055880] [DEBUG] [LOCAL ] CNI: Trimmed 74630 records to 51668 (keeping 200 days of data) [2025-10-01T18:08:08.252280] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-01T18:08:08.256865] [INFO ] [REMOTE ] CNH: Full fetch complete (77534 records). [2025-10-01T18:08:08.258509] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-01T18:08:08.914588] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-01T18:08:08.917800] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-01T18:08:08.972135] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-01T18:08:08.981834] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-01T18:08:09.017846] [DEBUG] [LOCAL ] CNH: Trimmed 77534 records to 53555 (keeping 200 days of data) [2025-10-01T18:08:09.174191] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-01T18:08:09.190790] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-01T18:08:09.490417] [DEBUG] [LOCAL ] CNI: Primary data saved (51668 records). [2025-10-01T18:08:09.491398] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-01T18:08:09.492370] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNI took 34.3s. Estimated remaining: 4h 21m 26s. Rate: 7.2 symbols/min [2025-10-01T18:08:09.701781] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:09.729219] [DEBUG] [LOCAL ] CNC: Primary data saved (53739 records). [2025-10-01T18:08:09.730026] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-01T18:08:09.730677] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNC took 51.5s. Estimated remaining: 4h 20m 46s. Rate: 7.2 symbols/min [2025-10-01T18:08:09.964896] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:09.966881] [DEBUG] [LOCAL ] CNM: Loaded 50981 existing records from primary storage. [2025-10-01T18:08:09.969721] [INFO ] [MAIN ] CNM: Loaded 50981 existing records. [2025-10-01T18:08:10.284320] [DEBUG] [LOCAL ] CNMD: Loaded 32253 existing records from primary storage. [2025-10-01T18:08:10.285391] [INFO ] [MAIN ] CNMD: Loaded 32253 existing records. [2025-10-01T18:08:10.282698] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:08:10.286796] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-01T18:08:10.309488] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-01T18:08:10.327558] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-01T18:08:10.328102] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-01T18:08:10.747235] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:08:10.768950] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-01T18:08:10.790673] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-01T18:08:10.824347] [DEBUG] [LOCAL ] CNH: Primary data saved (53555 records). [2025-10-01T18:08:10.862758] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-01T18:08:10.863423] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNH took 37.2s. Estimated remaining: 4h 20m 10s. Rate: 7.2 symbols/min [2025-10-01T18:08:10.873858] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-01T18:08:10.931487] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-01T18:08:11.102754] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:11.162820] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-01T18:08:11.329487] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:11.405370] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-01T18:08:11.441113] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-01T18:08:11.461120] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-01T18:08:11.464754] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-01T18:08:11.475517] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-01T18:08:11.480781] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-01T18:08:11.624023] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:11.659200] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-01T18:08:11.883446] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-01T18:08:11.923428] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-01T18:08:12.035482] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:12.035870] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-01T18:08:12.753430] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T18:08:12.764692] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-01T18:08:12.797461] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T18:08:12.803926] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-01T18:08:13.253176] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T18:08:13.258695] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-01T18:08:13.743431] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T18:08:13.756001] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-01T18:08:13.776696] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T18:08:14.021173] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T18:08:14.393083] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T18:08:14.502381] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-01T18:08:15.302392] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-01T18:08:15.431764] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T18:08:15.518423] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T18:08:16.102425] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-01T18:08:16.887529] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T18:08:16.902337] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-01T18:08:17.706771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-01T18:08:17.713029] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T18:08:18.502369] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-01T18:08:18.695011] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T18:08:19.218153] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T18:08:19.302404] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-01T18:08:20.102378] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-01T18:08:20.130616] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T18:08:20.659881] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T18:08:20.902396] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-01T18:08:21.702388] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-01T18:08:22.029090] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T18:08:22.293454] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T18:08:22.502390] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-01T18:08:22.802855] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T18:08:23.302377] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-01T18:08:24.102387] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-01T18:08:24.393733] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T18:08:24.906861] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-01T18:08:24.913133] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T18:08:25.548906] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T18:08:25.702437] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-01T18:08:26.156499] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T18:08:26.502385] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-01T18:08:27.026791] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T18:08:27.302445] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-01T18:08:27.467176] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T18:08:28.102416] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-01T18:08:28.657761] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T18:08:28.902436] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-01T18:08:29.477618] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T18:08:29.702361] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-01T18:08:30.371876] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T18:08:30.502409] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-01T18:08:30.981218] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T18:08:31.302399] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-01T18:08:31.760948] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T18:08:32.102395] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-01T18:08:32.474673] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T18:08:32.902394] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-01T18:08:33.233358] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T18:08:33.702430] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-01T18:08:34.502397] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-01T18:08:34.733585] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T18:08:35.229292] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-01T18:08:35.230507] [INFO ] [REMOTE ] CNMD: Full fetch complete (47255 records). [2025-10-01T18:08:35.230582] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-01T18:08:35.307484] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-01T18:08:35.661941] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-01T18:08:35.662038] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-01T18:08:35.662675] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-01T18:08:35.662739] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-01T18:08:35.663869] [DEBUG] [LOCAL ] CNMD: Trimmed 47255 records to 32280 (keeping 200 days of data) [2025-10-01T18:08:35.877797] [DEBUG] [LOCAL ] CNMD: Primary data saved (32280 records). [2025-10-01T18:08:35.878003] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-01T18:08:35.878110] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNMD took 26.1s. Estimated remaining: 4h 21m 6s. Rate: 7.2 symbols/min [2025-10-01T18:08:36.081054] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:36.081482] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-10-01T18:08:36.081604] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-10-01T18:08:36.081810] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-01T18:08:36.081895] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-01T18:08:36.081984] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-01T18:08:36.082044] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-01T18:08:36.107539] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-01T18:08:36.325774] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T18:08:36.547063] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:36.902417] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-01T18:08:37.478266] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T18:08:37.702392] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-01T18:08:37.756581] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-01T18:08:37.758315] [INFO ] [REMOTE ] CNK: Full fetch complete (75755 records). [2025-10-01T18:08:37.758447] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-01T18:08:38.181481] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-01T18:08:38.181774] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-01T18:08:38.182804] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-01T18:08:38.182903] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-01T18:08:38.184970] [DEBUG] [LOCAL ] CNK: Trimmed 75755 records to 52876 (keeping 200 days of data) [2025-10-01T18:08:38.336804] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T18:08:38.522389] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-01T18:08:38.570616] [DEBUG] [LOCAL ] CNK: Primary data saved (52876 records). [2025-10-01T18:08:38.570794] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-01T18:08:38.570887] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNK took 44.2s. Estimated remaining: 4h 20m 36s. Rate: 7.2 symbols/min [2025-10-01T18:08:38.759558] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:38.811089] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-10-01T18:08:38.811451] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-10-01T18:08:39.012485] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:08:39.012726] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-01T18:08:39.012782] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-01T18:08:39.013077] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-01T18:08:39.013138] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-01T18:08:39.307549] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-01T18:08:39.403865] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:39.489078] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T18:08:39.490390] [INFO ] [REMOTE ] CNNE: Full fetch complete (49744 records). [2025-10-01T18:08:39.490488] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-01T18:08:39.918942] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-01T18:08:39.919118] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-01T18:08:39.919899] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-01T18:08:39.919965] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-01T18:08:39.921128] [DEBUG] [LOCAL ] CNNE: Trimmed 49744 records to 36373 (keeping 200 days of data) [2025-10-01T18:08:40.121869] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-01T18:08:40.157375] [DEBUG] [LOCAL ] CNNE: Primary data saved (36373 records). [2025-10-01T18:08:40.157524] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-01T18:08:40.157605] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNNE took 29.3s. Estimated remaining: 4h 20m 2s. Rate: 7.2 symbols/min [2025-10-01T18:08:40.361538] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:40.397239] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T18:08:40.455027] [DEBUG] [LOCAL ] CNQ: Loaded 53581 existing records from primary storage. [2025-10-01T18:08:40.455391] [INFO ] [MAIN ] CNQ: Loaded 53581 existing records. [2025-10-01T18:08:40.665192] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:08:40.665461] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-01T18:08:40.665636] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-01T18:08:40.666012] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-01T18:08:40.666114] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-01T18:08:40.840771] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T18:08:40.908042] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-01T18:08:41.129469] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:41.702398] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-01T18:08:41.981881] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T18:08:42.481294] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T18:08:42.502492] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-01T18:08:43.302420] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-01T18:08:43.712172] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-01T18:08:44.102396] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-01T18:08:44.801082] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T18:08:44.849154] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-01T18:08:44.850871] [INFO ] [REMOTE ] CNM: Full fetch complete (73642 records). [2025-10-01T18:08:44.851010] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-01T18:08:44.907530] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-01T18:08:45.309434] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-01T18:08:45.309533] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-01T18:08:45.310457] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-01T18:08:45.310525] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-01T18:08:45.312061] [DEBUG] [LOCAL ] CNM: Trimmed 73642 records to 50990 (keeping 200 days of data) [2025-10-01T18:08:45.625811] [DEBUG] [LOCAL ] CNM: Primary data saved (50990 records). [2025-10-01T18:08:45.625962] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-01T18:08:45.626081] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNM took 36.1s. Estimated remaining: 4h 19m 43s. Rate: 7.2 symbols/min [2025-10-01T18:08:45.706608] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-01T18:08:45.827049] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:45.827366] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-01T18:08:45.827438] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-01T18:08:45.827708] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-01T18:08:45.827762] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-01T18:08:45.827808] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-01T18:08:45.827898] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-01T18:08:46.141582] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-01T18:08:46.262519] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:46.502367] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-01T18:08:46.534369] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T18:08:47.302356] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-01T18:08:47.365377] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T18:08:48.102403] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-01T18:08:48.230258] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T18:08:48.902369] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-01T18:08:48.997017] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T18:08:49.118589] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:08:49.118978] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-01T18:08:49.119105] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:08:49.119196] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-01T18:08:49.119284] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:08:49.119376] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-01T18:08:49.119481] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-01T18:08:49.119539] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-01T18:08:49.119588] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-01T18:08:49.119637] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 3.5s. Estimated remaining: 4h 19m 16s. Rate: 7.2 symbols/min [2025-10-01T18:08:49.304201] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:08:49.327056] [DEBUG] [LOCAL ] CNS: Loaded 20624 existing records from primary storage. [2025-10-01T18:08:49.327385] [INFO ] [MAIN ] CNS: Loaded 20624 existing records. [2025-10-01T18:08:49.573891] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:08:49.574400] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-01T18:08:49.574514] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-01T18:08:49.574955] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-01T18:08:49.575126] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-01T18:08:49.703556] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-01T18:08:49.961349] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T18:08:50.042504] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:08:50.502404] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-01T18:08:51.151292] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T18:08:51.302393] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-01T18:08:51.832932] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T18:08:52.102388] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-01T18:08:52.902387] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-01T18:08:53.248082] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-01T18:08:53.648795] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T18:08:53.702378] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-01T18:08:54.023575] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T18:08:54.502437] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-01T18:08:54.750792] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T18:08:55.302383] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-01T18:08:56.102381] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-01T18:08:56.387933] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T18:08:56.902372] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-01T18:08:57.564881] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-01T18:08:57.702389] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-01T18:08:58.063444] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-01T18:08:58.502387] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-01T18:08:58.801797] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T18:08:59.302401] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-01T18:08:59.589031] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T18:09:00.102378] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-01T18:09:00.161755] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T18:09:00.672808] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (3.77 seconds). [2025-10-01T18:09:00.902432] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-01T18:09:01.493008] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T18:09:01.702503] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-01T18:09:02.502456] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-01T18:09:02.595371] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T18:09:02.666310] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T18:09:03.302410] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-01T18:09:04.102348] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-01T18:09:04.310411] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T18:09:04.784635] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T18:09:04.902382] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-01T18:09:04.951290] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T18:09:05.702380] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-01T18:09:06.502382] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-01T18:09:06.626195] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T18:09:06.985552] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T18:09:07.302382] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-01T18:09:07.811752] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T18:09:08.102404] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-01T18:09:08.363522] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T18:09:08.902394] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-01T18:09:09.630436] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T18:09:09.702389] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-01T18:09:10.502357] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-01T18:09:10.705755] [DEBUG] [REMOTE ] CNO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:09:10.706131] [WARN ] [REMOTE ] CNO: No data returned for month 2025-10 [2025-10-01T18:09:10.706249] [FATAL] [REMOTE ] CNO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:09:10.706333] [FATAL] [MAIN ] CNO: Failed to fetch primary data. [2025-10-01T18:09:10.706399] [WARN ] [MAIN ] CNO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:09:10.706478] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-01T18:09:10.706543] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-01T18:09:10.706582] [INFO ] [LOCAL ] CNO: Starting deletion of derivative data. [2025-10-01T18:09:10.706623] [DEBUG] [LOCAL ] CNO: No derivative data file found to delete. [2025-10-01T18:09:10.706744] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNO took 34.8s. Estimated remaining: 4h 19m 58s. Rate: 7.2 symbols/min [2025-10-01T18:09:10.894466] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:10.894754] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-01T18:09:10.894870] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-01T18:09:10.895233] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-01T18:09:10.895387] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-01T18:09:10.895563] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-01T18:09:10.895707] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-01T18:09:11.096080] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-01T18:09:11.312174] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-01T18:09:11.346754] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:12.102414] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-01T18:09:12.402950] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T18:09:12.898201] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-01T18:09:12.900244] [INFO ] [REMOTE ] CNP: Full fetch complete (77370 records). [2025-10-01T18:09:12.900391] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-01T18:09:12.907504] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-01T18:09:13.350823] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-01T18:09:13.350927] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-01T18:09:13.351781] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-01T18:09:13.351845] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-01T18:09:13.353279] [DEBUG] [LOCAL ] CNP: Trimmed 77370 records to 53469 (keeping 200 days of data) [2025-10-01T18:09:13.697288] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-10-01T18:09:13.697442] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-01T18:09:13.697530] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNP took 35.1s. Estimated remaining: 4h 19m 30s. Rate: 7.2 symbols/min [2025-10-01T18:09:13.725100] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-01T18:09:13.904415] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:13.937124] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T18:09:13.985019] [DEBUG] [LOCAL ] CODI: Loaded 39921 existing records from primary storage. [2025-10-01T18:09:13.985335] [INFO ] [MAIN ] CODI: Loaded 39921 existing records. [2025-10-01T18:09:14.182919] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:09:14.183311] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-01T18:09:14.183385] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-01T18:09:14.183836] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-01T18:09:14.183984] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-01T18:09:14.321958] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-01T18:09:14.360729] [INFO ] [REMOTE ] CNS: Full fetch complete (30133 records). [2025-10-01T18:09:14.371544] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-01T18:09:14.507526] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-01T18:09:14.914980] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:15.051382] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-01T18:09:15.051483] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-01T18:09:15.052104] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-01T18:09:15.052210] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-01T18:09:15.053848] [DEBUG] [LOCAL ] CNS: Trimmed 30133 records to 20584 (keeping 200 days of data) [2025-10-01T18:09:15.192887] [DEBUG] [LOCAL ] CNS: Primary data saved (20584 records). [2025-10-01T18:09:15.193016] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-01T18:09:15.193123] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 26.1s. Estimated remaining: 4h 18m 56s. Rate: 7.2 symbols/min [2025-10-01T18:09:15.303532] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-01T18:09:15.383847] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:15.384283] [DEBUG] [LOCAL ] COF: No existing data file found in primary storage. [2025-10-01T18:09:15.384461] [WARN ] [MAIN ] COF: No existing data found, performing full refresh instead. [2025-10-01T18:09:15.384637] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-01T18:09:15.384737] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-01T18:09:15.384846] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-10-01T18:09:15.385024] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-01T18:09:15.819605] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:15.822671] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T18:09:16.102358] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-01T18:09:16.338131] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T18:09:16.406354] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T18:09:16.902379] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-01T18:09:17.702364] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-01T18:09:18.066242] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-01T18:09:18.502373] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-01T18:09:18.569529] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T18:09:19.302353] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-01T18:09:19.477599] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T18:09:20.062581] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T18:09:20.102343] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-01T18:09:20.902346] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-01T18:09:21.023983] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T18:09:21.495273] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T18:09:21.621967] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-01T18:09:21.702388] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-01T18:09:22.502425] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-01T18:09:23.302419] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-01T18:09:23.403635] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T18:09:23.428373] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T18:09:24.102369] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-01T18:09:24.902374] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-01T18:09:25.120189] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T18:09:25.702357] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-01T18:09:26.029341] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T18:09:26.502409] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-01T18:09:26.793538] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T18:09:27.302423] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-01T18:09:28.102394] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-01T18:09:28.126025] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-01T18:09:28.127703] [INFO ] [REMOTE ] CNQ: Full fetch complete (77554 records). [2025-10-01T18:09:28.127872] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-01T18:09:28.602608] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-01T18:09:28.622029] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-01T18:09:28.623631] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-01T18:09:28.624356] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-01T18:09:28.626077] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T18:09:28.635922] [DEBUG] [LOCAL ] CNQ: Trimmed 77554 records to 53581 (keeping 200 days of data) [2025-10-01T18:09:28.774055] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-01T18:09:28.915146] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-01T18:09:29.044953] [DEBUG] [LOCAL ] CNQ: Primary data saved (53581 records). [2025-10-01T18:09:29.045114] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-01T18:09:29.045231] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNQ took 48.9s. Estimated remaining: 4h 19m 8s. Rate: 7.2 symbols/min [2025-10-01T18:09:29.285466] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:29.340797] [DEBUG] [LOCAL ] COHR: Loaded 53362 existing records from primary storage. [2025-10-01T18:09:29.341173] [INFO ] [MAIN ] COHR: Loaded 53362 existing records. [2025-10-01T18:09:29.550520] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:09:29.550910] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-01T18:09:29.551086] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-01T18:09:29.551532] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-01T18:09:29.551593] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-01T18:09:29.704302] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-01T18:09:29.756817] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T18:09:30.016899] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:30.045105] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T18:09:30.502386] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-01T18:09:31.302437] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-01T18:09:31.650733] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T18:09:32.102362] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-01T18:09:32.608264] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-01T18:09:32.902386] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-01T18:09:32.971084] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T18:09:33.702381] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-01T18:09:34.009550] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T18:09:34.502410] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-01T18:09:34.610682] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T18:09:35.302385] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-01T18:09:35.467153] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T18:09:36.102381] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-01T18:09:36.478364] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-01T18:09:36.903820] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-01T18:09:36.907198] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T18:09:37.702372] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-01T18:09:37.820474] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T18:09:38.502419] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-01T18:09:38.847122] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T18:09:39.302368] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-01T18:09:39.438163] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T18:09:40.102355] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-01T18:09:40.274211] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T18:09:40.902390] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-01T18:09:41.286439] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T18:09:41.322152] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T18:09:41.702391] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-01T18:09:41.799242] [DEBUG] [REMOTE ] COHR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-01T18:09:41.799675] [WARN ] [REMOTE ] COHR: No data returned for month 2025-03 [2025-10-01T18:09:41.799792] [FATAL] [REMOTE ] COHR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:09:41.799897] [FATAL] [MAIN ] COHR: Failed to fetch primary data. [2025-10-01T18:09:41.799982] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:09:41.800076] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-01T18:09:41.800207] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-01T18:09:41.800267] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-01T18:09:41.800956] [DEBUG] [LOCAL ] COHR: Deleted derivative data file. [2025-10-01T18:09:41.801102] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. COHR took 12.8s. Estimated remaining: 4h 19m 17s. Rate: 7.2 symbols/min [2025-10-01T18:09:42.007541] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:42.057844] [DEBUG] [LOCAL ] COLD: Loaded 52066 existing records from primary storage. [2025-10-01T18:09:42.058163] [INFO ] [MAIN ] COLD: Loaded 52066 existing records. [2025-10-01T18:09:42.252775] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:09:42.252984] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-01T18:09:42.253035] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-01T18:09:42.253333] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-01T18:09:42.253426] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-01T18:09:42.514324] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-01T18:09:42.644980] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:43.144032] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T18:09:43.145582] [INFO ] [REMOTE ] CNX: Full fetch complete (74755 records). [2025-10-01T18:09:43.145749] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-01T18:09:43.307463] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-01T18:09:43.572892] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-01T18:09:43.572979] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-01T18:09:43.574021] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-01T18:09:43.574132] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-01T18:09:43.575738] [DEBUG] [LOCAL ] CNX: Trimmed 74755 records to 51372 (keeping 200 days of data) [2025-10-01T18:09:43.895952] [DEBUG] [LOCAL ] CNX: Primary data saved (51372 records). [2025-10-01T18:09:43.896101] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-01T18:09:43.896191] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 33.2s. Estimated remaining: 4h 18m 45s. Rate: 7.2 symbols/min [2025-10-01T18:09:44.094575] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:44.094875] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-01T18:09:44.095095] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-01T18:09:44.095397] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-01T18:09:44.095510] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-01T18:09:44.095791] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-01T18:09:44.095960] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-01T18:09:44.130077] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-01T18:09:44.290527] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T18:09:44.542715] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:44.902398] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-01T18:09:45.315839] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-01T18:09:45.669324] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T18:09:45.702378] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-01T18:09:46.502372] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-01T18:09:46.634365] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T18:09:47.045508] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T18:09:47.302391] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-01T18:09:48.102391] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-01T18:09:48.294060] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T18:09:48.295838] [INFO ] [REMOTE ] CODI: Full fetch complete (50857 records). [2025-10-01T18:09:48.295939] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-01T18:09:48.713864] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-01T18:09:48.713952] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-01T18:09:48.714715] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-01T18:09:48.714782] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-01T18:09:48.716021] [DEBUG] [LOCAL ] CODI: Trimmed 50857 records to 40010 (keeping 200 days of data) [2025-10-01T18:09:48.928207] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-01T18:09:48.967097] [DEBUG] [LOCAL ] CODI: Primary data saved (40010 records). [2025-10-01T18:09:48.967255] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-01T18:09:48.967380] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. CODI took 35.3s. Estimated remaining: 4h 18m 25s. Rate: 7.2 symbols/min [2025-10-01T18:09:49.186958] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:49.189002] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-01T18:09:49.239086] [DEBUG] [LOCAL ] CON: Loaded 38743 existing records from primary storage. [2025-10-01T18:09:49.239397] [INFO ] [MAIN ] CON: Loaded 38743 existing records. [2025-10-01T18:09:49.430252] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:09:49.430499] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-01T18:09:49.430575] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-01T18:09:49.430942] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-01T18:09:49.431002] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-01T18:09:49.707568] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-01T18:09:49.824887] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:50.502866] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-01T18:09:50.669298] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T18:09:50.753940] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-01T18:09:50.757250] [INFO ] [REMOTE ] COF: Full fetch complete (77412 records). [2025-10-01T18:09:50.757432] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-01T18:09:51.246361] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-01T18:09:51.246521] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-01T18:09:51.247588] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-01T18:09:51.247719] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-01T18:09:51.249599] [DEBUG] [LOCAL ] COF: Trimmed 77412 records to 53609 (keeping 200 days of data) [2025-10-01T18:09:51.312952] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-01T18:09:51.526871] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T18:09:51.683934] [DEBUG] [LOCAL ] COF: Primary data saved (53609 records). [2025-10-01T18:09:51.684107] [INFO ] [MAIN ] COF: Full history saved. [2025-10-01T18:09:51.684230] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COF took 36.5s. Estimated remaining: 4h 17m 56s. Rate: 7.2 symbols/min [2025-10-01T18:09:51.884737] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:09:51.908766] [DEBUG] [LOCAL ] COOK: Loaded 24364 existing records from primary storage. [2025-10-01T18:09:51.909033] [INFO ] [MAIN ] COOK: Loaded 24364 existing records. [2025-10-01T18:09:52.117731] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-01T18:09:52.124310] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:09:52.125466] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-01T18:09:52.125523] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-01T18:09:52.125797] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-01T18:09:52.125860] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-01T18:09:52.580674] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:09:52.608064] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T18:09:52.902354] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-01T18:09:52.958966] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T18:09:53.599241] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:09:53.702387] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-01T18:09:54.173857] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:09:54.502401] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-01T18:09:55.192188] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T18:09:55.302405] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-01T18:09:56.102369] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-01T18:09:56.218663] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T18:09:56.902442] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-01T18:09:57.170455] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T18:09:57.241365] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T18:09:57.702405] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-01T18:09:58.502393] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-01T18:09:58.717671] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T18:09:59.124309] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T18:09:59.302382] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-01T18:09:59.626629] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T18:10:00.102405] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-01T18:10:00.871149] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T18:10:00.902347] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-01T18:10:01.600912] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T18:10:01.702426] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-01T18:10:02.502391] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-01T18:10:02.780250] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T18:10:03.302385] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-01T18:10:03.383816] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T18:10:03.574391] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T18:10:04.102385] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-01T18:10:04.902376] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-01T18:10:05.038002] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T18:10:05.059768] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T18:10:05.702385] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-01T18:10:06.430017] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T18:10:06.502393] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-01T18:10:07.302394] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-01T18:10:07.815210] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-01T18:10:07.816789] [INFO ] [REMOTE ] COLD: Full fetch complete (74254 records). [2025-10-01T18:10:07.816895] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-01T18:10:08.024159] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T18:10:08.107513] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-01T18:10:08.315087] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-01T18:10:08.315182] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-01T18:10:08.316027] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-01T18:10:08.316093] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-01T18:10:08.317674] [DEBUG] [LOCAL ] COLD: Trimmed 74254 records to 52075 (keeping 200 days of data) [2025-10-01T18:10:08.661470] [DEBUG] [LOCAL ] COLD: Primary data saved (52075 records). [2025-10-01T18:10:08.661799] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-01T18:10:08.661925] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 26.9s. Estimated remaining: 4h 18m 20s. Rate: 7.2 symbols/min [2025-10-01T18:10:08.899921] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:10:08.902864] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-01T18:10:08.906765] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T18:10:08.971185] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-01T18:10:08.971556] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-01T18:10:09.185416] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:10:09.185829] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-01T18:10:09.185962] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-01T18:10:09.186249] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-01T18:10:09.186307] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-01T18:10:09.339532] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T18:10:09.615215] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:10:09.702415] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-01T18:10:10.509675] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-01T18:10:10.516299] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T18:10:10.813581] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T18:10:11.302390] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-01T18:10:12.102391] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-01T18:10:12.902397] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-01T18:10:13.037151] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T18:10:13.296051] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T18:10:13.384024] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-01T18:10:13.702383] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-01T18:10:14.360833] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T18:10:14.502395] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-01T18:10:14.779162] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T18:10:15.302376] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-01T18:10:16.102381] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-01T18:10:16.902396] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-01T18:10:17.014428] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-01T18:10:17.145002] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T18:10:17.702390] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-01T18:10:18.261760] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-01T18:10:18.321002] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T18:10:18.502375] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-01T18:10:18.749208] [DEBUG] [REMOTE ] CON: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:10:18.749570] [WARN ] [REMOTE ] CON: No data returned for month 2025-10 [2025-10-01T18:10:18.749709] [FATAL] [REMOTE ] CON: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:10:18.749815] [FATAL] [MAIN ] CON: Failed to fetch primary data. [2025-10-01T18:10:18.749889] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:10:18.749964] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-01T18:10:18.750031] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-01T18:10:18.750070] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-01T18:10:18.750628] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-10-01T18:10:18.750754] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. CON took 29.8s. Estimated remaining: 4h 18m 18s. Rate: 7.2 symbols/min [2025-10-01T18:10:18.942408] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:10:18.988867] [DEBUG] [LOCAL ] COR: Loaded 47089 existing records from primary storage. [2025-10-01T18:10:18.989186] [INFO ] [MAIN ] COR: Loaded 47089 existing records. [2025-10-01T18:10:19.186820] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:10:19.187050] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-01T18:10:19.187100] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-01T18:10:19.187371] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-01T18:10:19.187431] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-01T18:10:19.307489] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-01T18:10:19.590840] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:10:19.635717] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T18:10:20.102390] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-01T18:10:20.902443] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-01T18:10:21.225584] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T18:10:21.702402] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-01T18:10:22.456703] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T18:10:22.502348] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-01T18:10:22.617576] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-01T18:10:22.909514] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T18:10:23.302396] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-01T18:10:23.876098] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T18:10:24.102404] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-01T18:10:24.902387] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-01T18:10:25.459935] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T18:10:25.461013] [INFO ] [REMOTE ] COOK: Full fetch complete (32603 records). [2025-10-01T18:10:25.461097] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-01T18:10:25.707474] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-01T18:10:25.742361] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-01T18:10:25.769580] [INFO ] [REMOTE ] COMP: Full fetch complete (77145 records). [2025-10-01T18:10:25.784522] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-01T18:10:26.038549] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-01T18:10:26.049333] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-01T18:10:26.055144] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-01T18:10:26.060378] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-01T18:10:26.105184] [DEBUG] [LOCAL ] COOK: Trimmed 32603 records to 24333 (keeping 200 days of data) [2025-10-01T18:10:26.512062] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-01T18:10:26.517581] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-01T18:10:26.523407] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-01T18:10:26.523536] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-01T18:10:26.554481] [DEBUG] [LOCAL ] COOK: Primary data saved (24333 records). [2025-10-01T18:10:26.554780] [DEBUG] [LOCAL ] COMP: Trimmed 77145 records to 53389 (keeping 200 days of data) [2025-10-01T18:10:26.554984] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-01T18:10:26.555347] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COOK took 34.9s. Estimated remaining: 4h 18m 8s. Rate: 7.2 symbols/min [2025-10-01T18:10:26.846999] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:10:26.862766] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-01T18:10:26.863225] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-01T18:10:26.878330] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-01T18:10:26.879258] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-01T18:10:26.881822] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-01T18:10:26.882973] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T18:10:26.892625] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-01T18:10:26.930774] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-01T18:10:27.407071] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:10:27.408422] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-01T18:10:27.550878] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T18:10:27.582153] [DEBUG] [LOCAL ] COMP: Primary data saved (53389 records). [2025-10-01T18:10:27.583297] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-01T18:10:27.583705] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COMP took 43.7s. Estimated remaining: 4h 17m 33s. Rate: 7.2 symbols/min [2025-10-01T18:10:27.789691] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:10:27.837934] [DEBUG] [LOCAL ] COUR: Loaded 48912 existing records from primary storage. [2025-10-01T18:10:27.838278] [INFO ] [MAIN ] COUR: Loaded 48912 existing records. [2025-10-01T18:10:28.054288] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:10:28.054493] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-01T18:10:28.054542] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-01T18:10:28.054891] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-01T18:10:28.054956] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-01T18:10:28.110231] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-01T18:10:28.477784] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:10:28.720035] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T18:10:28.902378] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-01T18:10:29.016610] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T18:10:29.702388] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-01T18:10:30.313372] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-01T18:10:30.408115] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T18:10:30.502388] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-01T18:10:31.302354] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-01T18:10:31.373225] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T18:10:32.102391] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-01T18:10:32.638092] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-01T18:10:32.842099] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T18:10:32.902388] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-01T18:10:33.461086] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T18:10:33.702420] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-01T18:10:34.502362] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-01T18:10:34.924523] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-01T18:10:35.003045] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T18:10:35.302410] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-01T18:10:35.994953] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T18:10:36.102409] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-01T18:10:36.862719] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T18:10:36.902408] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-01T18:10:37.418615] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T18:10:37.702391] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-01T18:10:38.424022] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T18:10:38.502436] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-01T18:10:39.112015] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T18:10:39.302382] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-01T18:10:40.102375] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-01T18:10:40.214376] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T18:10:40.792334] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T18:10:40.902377] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-01T18:10:41.702433] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-01T18:10:42.062042] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T18:10:42.502595] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-01T18:10:42.507005] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T18:10:43.021812] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T18:10:43.302437] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-01T18:10:44.113063] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-01T18:10:44.121219] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T18:10:44.902378] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-01T18:10:44.936481] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T18:10:45.702400] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-01T18:10:45.943816] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-01T18:10:45.945473] [INFO ] [REMOTE ] COR: Full fetch complete (68812 records). [2025-10-01T18:10:45.945603] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-01T18:10:46.423776] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-01T18:10:46.423892] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-01T18:10:46.424768] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-01T18:10:46.424855] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-01T18:10:46.428613] [DEBUG] [LOCAL ] COR: Trimmed 68812 records to 47080 (keeping 200 days of data) [2025-10-01T18:10:46.528033] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-01T18:10:46.714517] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T18:10:46.794785] [DEBUG] [LOCAL ] COR: Primary data saved (47080 records). [2025-10-01T18:10:46.794931] [INFO ] [MAIN ] COR: Full history saved. [2025-10-01T18:10:46.795017] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COR took 28.0s. Estimated remaining: 4h 18m 4s. Rate: 7.2 symbols/min [2025-10-01T18:10:46.987520] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:10:47.038437] [DEBUG] [LOCAL ] CP: Loaded 53267 existing records from primary storage. [2025-10-01T18:10:47.038785] [INFO ] [MAIN ] CP: Loaded 53267 existing records. [2025-10-01T18:10:47.276574] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:10:47.277118] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-01T18:10:47.278170] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-01T18:10:47.278480] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-01T18:10:47.278676] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-01T18:10:47.314038] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-01T18:10:47.536697] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T18:10:47.746759] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:10:48.102432] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-01T18:10:48.454477] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T18:10:48.902402] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-01T18:10:49.665389] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T18:10:49.702350] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-01T18:10:50.175264] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-01T18:10:50.177156] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-01T18:10:50.177326] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-01T18:10:50.516091] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-01T18:10:50.631268] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-01T18:10:50.631444] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-01T18:10:50.632349] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-01T18:10:50.632945] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-01T18:10:50.634925] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-10-01T18:10:50.806962] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T18:10:51.043299] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-01T18:10:51.043473] [INFO ] [MAIN ] COP: Full history saved. [2025-10-01T18:10:51.043608] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COP took 42.4s. Estimated remaining: 4h 17m 41s. Rate: 7.2 symbols/min [2025-10-01T18:10:51.240954] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:10:51.270767] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T18:10:51.307442] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-01T18:10:51.308236] [DEBUG] [LOCAL ] CPA: Loaded 28403 existing records from primary storage. [2025-10-01T18:10:51.309446] [INFO ] [MAIN ] CPA: Loaded 28403 existing records. [2025-10-01T18:10:51.530498] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:10:51.530748] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-01T18:10:51.530803] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-01T18:10:51.531088] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-01T18:10:51.531170] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-01T18:10:51.913873] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:10:52.102434] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-01T18:10:52.559713] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T18:10:52.902355] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-01T18:10:52.955383] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T18:10:53.476157] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T18:10:53.702439] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-01T18:10:54.429210] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T18:10:54.502391] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-01T18:10:55.153242] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T18:10:55.302434] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-01T18:10:56.102466] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-01T18:10:56.771293] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T18:10:56.801146] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T18:10:56.803402] [INFO ] [REMOTE ] COTY: Full fetch complete (77071 records). [2025-10-01T18:10:56.803569] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-01T18:10:56.908287] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-01T18:10:57.253828] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-01T18:10:57.254110] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-01T18:10:57.255371] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-01T18:10:57.255542] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-01T18:10:57.257396] [DEBUG] [LOCAL ] COTY: Trimmed 77071 records to 53229 (keeping 200 days of data) [2025-10-01T18:10:57.379182] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T18:10:57.627040] [DEBUG] [LOCAL ] COTY: Primary data saved (53229 records). [2025-10-01T18:10:57.627211] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-01T18:10:57.627290] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 31.1s. Estimated remaining: 4h 17m 26s. Rate: 7.2 symbols/min [2025-10-01T18:10:57.707522] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-01T18:10:57.828049] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:10:57.828346] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-01T18:10:57.828392] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-01T18:10:57.828540] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-01T18:10:57.828583] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-01T18:10:57.828625] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-01T18:10:57.828699] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-01T18:10:58.220584] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:10:58.259765] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T18:10:58.502357] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-01T18:10:58.631690] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T18:10:59.302392] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-01T18:11:00.102349] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-01T18:11:00.221447] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T18:11:00.579336] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-01T18:11:00.902382] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-01T18:11:01.647529] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T18:11:01.702408] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-01T18:11:01.752250] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T18:11:02.502387] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-01T18:11:02.962530] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T18:11:03.302389] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-01T18:11:04.102359] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-01T18:11:04.298727] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T18:11:04.846027] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T18:11:04.902343] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-01T18:11:05.544342] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T18:11:05.702395] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-01T18:11:06.181792] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T18:11:06.502392] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-01T18:11:06.952508] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T18:11:07.040451] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T18:11:07.302377] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-01T18:11:08.102384] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-01T18:11:08.549511] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T18:11:08.902406] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-01T18:11:09.239167] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-01T18:11:09.707490] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-01T18:11:09.725294] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T18:11:10.502384] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-01T18:11:10.841103] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T18:11:11.302391] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-01T18:11:11.722091] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-01T18:11:11.960130] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T18:11:12.102382] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-01T18:11:12.412248] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-01T18:11:12.902378] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-01T18:11:13.702384] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-01T18:11:14.057946] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-01T18:11:14.502481] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-01T18:11:14.739752] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T18:11:14.930007] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T18:11:15.302393] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-01T18:11:15.689500] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-01T18:11:16.102372] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-01T18:11:16.902401] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-01T18:11:17.383267] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T18:11:17.702381] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-01T18:11:18.502386] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-01T18:11:18.547705] [DEBUG] [REMOTE ] CPA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:11:18.548121] [WARN ] [REMOTE ] CPA: No data returned for month 2025-10 [2025-10-01T18:11:18.548238] [FATAL] [REMOTE ] CPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:11:18.548377] [FATAL] [MAIN ] CPA: Failed to fetch primary data. [2025-10-01T18:11:18.548449] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:11:18.548522] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-01T18:11:18.548618] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-01T18:11:18.548710] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-01T18:11:18.549219] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-10-01T18:11:18.549324] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CPA took 27.5s. Estimated remaining: 4h 18m 4s. Rate: 7.2 symbols/min [2025-10-01T18:11:18.750354] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:11:18.783893] [DEBUG] [LOCAL ] CPAY: Loaded 30567 existing records from primary storage. [2025-10-01T18:11:18.784200] [INFO ] [MAIN ] CPAY: Loaded 30567 existing records. [2025-10-01T18:11:18.903263] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-01T18:11:18.989278] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:11:18.989631] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-01T18:11:18.989740] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-01T18:11:18.990140] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-01T18:11:18.990222] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-01T18:11:19.285139] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T18:11:19.307539] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-01T18:11:19.325033] [INFO ] [REMOTE ] COUR: Full fetch complete (70876 records). [2025-10-01T18:11:19.326517] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-01T18:11:19.528849] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:11:19.808560] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-01T18:11:19.850538] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-01T18:11:19.850627] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-01T18:11:19.851546] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-01T18:11:19.851679] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-01T18:11:19.853302] [DEBUG] [LOCAL ] COUR: Trimmed 70876 records to 48918 (keeping 200 days of data) [2025-10-01T18:11:20.117307] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-01T18:11:20.157684] [DEBUG] [LOCAL ] COUR: Primary data saved (48918 records). [2025-10-01T18:11:20.157810] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-01T18:11:20.157966] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. COUR took 52.6s. Estimated remaining: 4h 17m 31s. Rate: 7.2 symbols/min [2025-10-01T18:11:20.363631] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:11:20.363844] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-01T18:11:20.363887] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-01T18:11:20.364052] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-01T18:11:20.364094] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-01T18:11:20.364192] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-01T18:11:20.364247] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-01T18:11:20.823150] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:11:20.902386] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-01T18:11:20.940876] [DEBUG] [REMOTE ] CPAC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:11:20.941192] [WARN ] [REMOTE ] CPAC: No data returned for month 2025-10 [2025-10-01T18:11:20.941291] [FATAL] [REMOTE ] CPAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:11:20.941380] [FATAL] [MAIN ] CPAC: Failed to fetch primary data. [2025-10-01T18:11:20.941447] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:11:20.941524] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-01T18:11:20.941589] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-01T18:11:20.941628] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-01T18:11:20.941726] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-01T18:11:20.941784] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPAC took 23.3s. Estimated remaining: 4h 16m 56s. Rate: 7.2 symbols/min [2025-10-01T18:11:21.123324] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:11:21.140435] [DEBUG] [LOCAL ] CPK: Loaded 13455 existing records from primary storage. [2025-10-01T18:11:21.140702] [INFO ] [MAIN ] CPK: Loaded 13455 existing records. [2025-10-01T18:11:21.340295] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:11:21.340788] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-01T18:11:21.340842] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-01T18:11:21.341214] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-01T18:11:21.341271] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-01T18:11:21.705509] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-01T18:11:21.739522] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:11:22.502399] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-01T18:11:23.077130] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-01T18:11:23.116985] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T18:11:23.257323] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T18:11:23.302401] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-01T18:11:23.864764] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T18:11:24.102379] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-01T18:11:24.902391] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-01T18:11:25.702405] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-01T18:11:26.005303] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-01T18:11:26.007964] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-10-01T18:11:26.008126] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-01T18:11:26.161352] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T18:11:26.417367] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-01T18:11:26.483451] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-01T18:11:26.483562] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-01T18:11:26.484602] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-01T18:11:26.484699] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-01T18:11:26.486302] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 53267 (keeping 200 days of data) [2025-10-01T18:11:26.548872] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-01T18:11:26.855179] [DEBUG] [LOCAL ] CP: Primary data saved (53267 records). [2025-10-01T18:11:26.855354] [INFO ] [MAIN ] CP: Full history saved. [2025-10-01T18:11:26.855477] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 40.1s. Estimated remaining: 4h 16m 39s. Rate: 7.2 symbols/min [2025-10-01T18:11:27.037286] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:11:27.037481] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-10-01T18:11:27.037526] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-10-01T18:11:27.037689] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-01T18:11:27.037747] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-01T18:11:27.037793] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-01T18:11:27.037861] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-01T18:11:27.307548] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-01T18:11:27.418356] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:11:27.798936] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T18:11:28.102406] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-01T18:11:28.646276] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T18:11:28.902394] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-01T18:11:29.228238] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T18:11:29.536731] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T18:11:29.702416] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-01T18:11:30.502393] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-01T18:11:30.968136] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T18:11:31.302396] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-01T18:11:31.474539] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T18:11:32.102389] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-01T18:11:32.238579] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T18:11:32.902415] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-01T18:11:33.084990] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T18:11:33.702391] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-01T18:11:34.502412] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-01T18:11:35.024635] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T18:11:35.302426] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-01T18:11:35.350444] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-01T18:11:35.373827] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T18:11:36.102454] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-01T18:11:36.301322] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T18:11:36.902412] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-01T18:11:37.702392] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-01T18:11:37.936749] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-01T18:11:37.965024] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T18:11:38.502409] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-01T18:11:39.021269] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T18:11:39.302392] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-01T18:11:39.333319] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T18:11:40.102430] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-01T18:11:40.665081] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T18:11:40.682499] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T18:11:40.902421] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-01T18:11:41.695173] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T18:11:41.702326] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-01T18:11:42.453212] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T18:11:42.502385] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-01T18:11:43.091906] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T18:11:43.302400] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-01T18:11:44.102399] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-01T18:11:44.297190] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T18:11:44.902383] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-01T18:11:45.280920] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T18:11:45.702429] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-01T18:11:46.117710] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T18:11:46.118711] [INFO ] [REMOTE ] CPK: Full fetch complete (17817 records). [2025-10-01T18:11:46.118787] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-01T18:11:46.506706] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-01T18:11:46.536542] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-01T18:11:46.536629] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-01T18:11:46.537166] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-01T18:11:46.537229] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-01T18:11:46.537889] [DEBUG] [LOCAL ] CPK: Trimmed 17817 records to 13479 (keeping 200 days of data) [2025-10-01T18:11:46.635394] [DEBUG] [LOCAL ] CPK: Primary data saved (13479 records). [2025-10-01T18:11:46.635560] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-01T18:11:46.635699] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPK took 25.7s. Estimated remaining: 4h 17m 12s. Rate: 7.2 symbols/min [2025-10-01T18:11:47.302421] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-01T18:11:47.538321] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T18:11:47.603517] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T18:11:48.102362] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-01T18:11:48.329334] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T18:11:48.902385] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-01T18:11:49.702426] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-01T18:11:49.827874] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-01T18:11:50.008116] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T18:11:50.502415] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-01T18:11:50.959263] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T18:11:51.302391] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-01T18:11:52.102422] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-01T18:11:52.381310] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T18:11:52.382334] [INFO ] [REMOTE ] CPF: Full fetch complete (24139 records). [2025-10-01T18:11:52.382460] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-01T18:11:52.800571] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-01T18:11:52.800704] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-01T18:11:52.801232] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-01T18:11:52.801365] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-01T18:11:52.813922] [DEBUG] [LOCAL ] CPF: Trimmed 24139 records to 15158 (keeping 200 days of data) [2025-10-01T18:11:52.835427] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-01T18:11:52.914633] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-01T18:11:52.945455] [DEBUG] [LOCAL ] CPF: Primary data saved (15158 records). [2025-10-01T18:11:52.945585] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-01T18:11:52.945685] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPF took 32.8s. Estimated remaining: 4h 16m 56s. Rate: 7.2 symbols/min [2025-10-01T18:11:53.627900] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-01T18:11:53.629624] [INFO ] [REMOTE ] CPAY: Full fetch complete (45028 records). [2025-10-01T18:11:53.629809] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-01T18:11:54.082454] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-01T18:11:54.082547] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-01T18:11:54.083236] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-01T18:11:54.083343] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-01T18:11:54.084516] [DEBUG] [LOCAL ] CPAY: Trimmed 45028 records to 30628 (keeping 200 days of data) [2025-10-01T18:11:54.296116] [DEBUG] [LOCAL ] CPAY: Primary data saved (30628 records). [2025-10-01T18:11:54.296261] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-01T18:11:54.296347] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPAY took 35.7s. Estimated remaining: 4h 16m 23s. Rate: 7.2 symbols/min [2025-10-01T18:11:55.340181] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-01T18:11:55.352437] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-01T18:11:57.489198] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-01T18:11:57.500995] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-01T18:11:59.975322] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-01T18:11:59.988274] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-01T18:12:02.350918] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-01T18:12:02.363279] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-01T18:12:04.613952] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-01T18:12:04.627768] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-01T18:12:08.021419] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (3.39 seconds). [2025-10-01T18:12:08.023011] [INFO ] [REMOTE ] CPNG: Full fetch complete (77674 records). [2025-10-01T18:12:08.023124] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-01T18:12:08.469150] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-01T18:12:08.469283] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-01T18:12:08.470206] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-01T18:12:08.470273] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-01T18:12:08.471969] [DEBUG] [LOCAL ] CPNG: Trimmed 77674 records to 53671 (keeping 200 days of data) [2025-10-01T18:12:08.825099] [DEBUG] [LOCAL ] CPNG: Primary data saved (53671 records). [2025-10-01T18:12:08.825256] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-01T18:12:08.825368] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 42.0s. Estimated remaining: 4h 16m 37s. Rate: 7.2 symbols/min [2025-10-01T18:12:09.572983] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:09.706569] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:09.711130] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:09.735146] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:09.754689] [DEBUG] [LOCAL ] CQP: Loaded 19633 existing records from primary storage. [2025-10-01T18:12:09.754983] [INFO ] [MAIN ] CQP: Loaded 19633 existing records. [2025-10-01T18:12:09.850359] [DEBUG] [LOCAL ] CPS: Loaded 25989 existing records from primary storage. [2025-10-01T18:12:09.867286] [INFO ] [MAIN ] CPS: Loaded 25989 existing records. [2025-10-01T18:12:10.084443] [DEBUG] [LOCAL ] CPT: Loaded 44325 existing records from primary storage. [2025-10-01T18:12:10.113505] [INFO ] [MAIN ] CPT: Loaded 44325 existing records. [2025-10-01T18:12:10.184230] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:10.170955] [DEBUG] [LOCAL ] CPRI: Loaded 52547 existing records from primary storage. [2025-10-01T18:12:10.191912] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-01T18:12:10.215701] [INFO ] [MAIN ] CPRI: Loaded 52547 existing records. [2025-10-01T18:12:10.226203] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-01T18:12:10.396257] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:10.401814] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-01T18:12:10.418116] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-01T18:12:10.438976] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-01T18:12:10.449457] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-01T18:12:10.573768] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-01T18:12:10.627940] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-01T18:12:10.843276] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:10.917447] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-01T18:12:10.995003] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:11.052529] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-01T18:12:11.062472] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-01T18:12:11.154917] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-01T18:12:11.121216] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-01T18:12:11.260131] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-01T18:12:11.275510] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-01T18:12:11.381626] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-01T18:12:11.675004] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:11.692395] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-01T18:12:11.844442] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:11.896281] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-01T18:12:12.426399] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:12.430477] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-01T18:12:12.430219] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:12.431533] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-01T18:12:13.008552] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T18:12:13.013208] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-01T18:12:13.173714] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T18:12:13.178510] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-01T18:12:13.951013] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T18:12:13.956514] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-01T18:12:13.993075] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T18:12:14.007308] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-01T18:12:14.046033] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T18:12:14.059255] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-01T18:12:14.079711] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T18:12:14.086618] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-01T18:12:14.834372] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T18:12:14.840127] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-01T18:12:15.228621] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T18:12:15.239565] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-01T18:12:15.283631] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:12:15.289707] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-01T18:12:15.437725] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T18:12:15.449371] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-01T18:12:16.031616] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T18:12:16.038174] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-01T18:12:16.401430] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T18:12:16.409765] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-01T18:12:16.579201] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T18:12:16.588497] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-01T18:12:17.101083] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T18:12:17.116139] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-01T18:12:17.149046] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T18:12:17.157019] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-01T18:12:17.191573] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T18:12:17.196698] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-01T18:12:17.910241] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T18:12:17.921874] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-01T18:12:18.399030] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T18:12:18.406363] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-01T18:12:18.512115] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T18:12:18.518409] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-01T18:12:18.554077] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T18:12:18.565602] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-01T18:12:19.538741] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T18:12:19.544247] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-01T18:12:19.639685] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T18:12:19.653108] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-01T18:12:19.682873] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T18:12:19.689411] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-01T18:12:20.135081] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T18:12:20.153083] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-01T18:12:20.587509] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T18:12:20.593252] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-01T18:12:20.973716] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T18:12:20.980160] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-01T18:12:21.330929] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T18:12:21.702425] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-01T18:12:21.833617] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T18:12:21.911180] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T18:12:21.961157] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T18:12:22.502417] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-01T18:12:23.120157] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T18:12:23.302392] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-01T18:12:23.448086] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T18:12:24.102406] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-01T18:12:24.902364] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-01T18:12:25.062753] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T18:12:25.286739] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-01T18:12:25.702418] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-01T18:12:26.447964] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-01T18:12:26.449011] [INFO ] [REMOTE ] CPS: Full fetch complete (36236 records). [2025-10-01T18:12:26.449087] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-01T18:12:26.508342] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-01T18:12:26.758760] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T18:12:26.793417] [INFO ] [REMOTE ] CQP: Full fetch complete (30695 records). [2025-10-01T18:12:26.809237] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-01T18:12:27.015863] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-01T18:12:27.016092] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-01T18:12:27.016809] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-01T18:12:27.022717] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-01T18:12:27.077338] [DEBUG] [LOCAL ] CPS: Trimmed 36236 records to 25887 (keeping 200 days of data) [2025-10-01T18:12:27.311203] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-01T18:12:27.581966] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-01T18:12:27.582087] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-01T18:12:27.583280] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-01T18:12:27.583364] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-01T18:12:27.585252] [DEBUG] [LOCAL ] CQP: Trimmed 30695 records to 19493 (keeping 200 days of data) [2025-10-01T18:12:27.824991] [DEBUG] [LOCAL ] CPS: Primary data saved (25887 records). [2025-10-01T18:12:27.825541] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-01T18:12:27.825759] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CPS took 19.0s. Estimated remaining: 4h 17m 6s. Rate: 7.2 symbols/min [2025-10-01T18:12:28.115059] [DEBUG] [LOCAL ] CQP: Primary data saved (19493 records). [2025-10-01T18:12:28.117043] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-01T18:12:28.117341] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CQP took 19.3s. Estimated remaining: 4h 16m 30s. Rate: 7.2 symbols/min [2025-10-01T18:12:28.116773] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:28.364515] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:28.379437] [DEBUG] [LOCAL ] CR: Loaded 24400 existing records from primary storage. [2025-10-01T18:12:28.390717] [INFO ] [MAIN ] CR: Loaded 24400 existing records. [2025-10-01T18:12:28.473707] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T18:12:28.519038] [DEBUG] [LOCAL ] CRBD: Loaded 8991 existing records from primary storage. [2025-10-01T18:12:28.545917] [INFO ] [MAIN ] CRBD: Loaded 8991 existing records. [2025-10-01T18:12:28.551419] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-01T18:12:28.767064] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:28.768119] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-01T18:12:28.783878] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-01T18:12:28.816545] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-01T18:12:28.825073] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-01T18:12:28.857412] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:28.863128] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-01T18:12:28.909468] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-01T18:12:28.971993] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-01T18:12:28.983162] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-01T18:12:29.479587] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-01T18:12:29.523105] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:29.548061] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-01T18:12:29.712260] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-01T18:12:29.747532] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:30.032693] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T18:12:30.502408] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-01T18:12:30.828681] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T18:12:31.302386] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-01T18:12:31.606435] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T18:12:32.002787] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T18:12:32.102355] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-01T18:12:32.121663] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T18:12:32.902398] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-01T18:12:33.702360] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-01T18:12:33.815904] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T18:12:34.502394] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-01T18:12:34.930347] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T18:12:35.082940] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-01T18:12:35.084460] [INFO ] [REMOTE ] CPT: Full fetch complete (63937 records). [2025-10-01T18:12:35.084582] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-01T18:12:35.307582] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-01T18:12:35.523071] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-01T18:12:35.523168] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-01T18:12:35.524041] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-01T18:12:35.524116] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-01T18:12:35.526799] [DEBUG] [LOCAL ] CPT: Trimmed 63937 records to 44368 (keeping 200 days of data) [2025-10-01T18:12:35.824072] [DEBUG] [LOCAL ] CPT: Primary data saved (44368 records). [2025-10-01T18:12:35.824207] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-01T18:12:35.824292] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 27.0s. Estimated remaining: 4h 16m 19s. Rate: 7.2 symbols/min [2025-10-01T18:12:36.011472] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:36.063380] [DEBUG] [LOCAL ] CRBG: Loaded 52349 existing records from primary storage. [2025-10-01T18:12:36.063739] [INFO ] [MAIN ] CRBG: Loaded 52349 existing records. [2025-10-01T18:12:36.108843] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-01T18:12:36.265176] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:36.265405] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-01T18:12:36.265456] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-01T18:12:36.265735] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-01T18:12:36.265811] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-01T18:12:36.701867] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:36.703923] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T18:12:36.804828] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T18:12:36.806533] [INFO ] [REMOTE ] CPRI: Full fetch complete (76162 records). [2025-10-01T18:12:36.806700] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-01T18:12:36.909698] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-01T18:12:37.265809] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-01T18:12:37.261893] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T18:12:37.266028] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-01T18:12:37.272775] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-01T18:12:37.272846] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-01T18:12:37.274343] [DEBUG] [LOCAL ] CPRI: Trimmed 76162 records to 52548 (keeping 200 days of data) [2025-10-01T18:12:37.603345] [DEBUG] [LOCAL ] CPRI: Primary data saved (52548 records). [2025-10-01T18:12:37.603491] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-01T18:12:37.603577] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 28.8s. Estimated remaining: 4h 15m 48s. Rate: 7.2 symbols/min [2025-10-01T18:12:37.710995] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-01T18:12:37.809464] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:37.851584] [DEBUG] [LOCAL ] CRC: Loaded 44118 existing records from primary storage. [2025-10-01T18:12:37.852014] [INFO ] [MAIN ] CRC: Loaded 44118 existing records. [2025-10-01T18:12:38.056186] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:12:38.056421] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-01T18:12:38.056483] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-01T18:12:38.056847] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-01T18:12:38.056909] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-01T18:12:38.458296] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:12:38.502346] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-01T18:12:38.560057] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T18:12:38.578285] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T18:12:39.302425] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-01T18:12:40.070546] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T18:12:40.102403] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-01T18:12:40.867790] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T18:12:40.902346] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-01T18:12:41.243358] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T18:12:41.702400] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-01T18:12:42.317309] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T18:12:42.502437] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-01T18:12:42.946052] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T18:12:43.302389] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-01T18:12:43.597503] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T18:12:44.102383] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-01T18:12:44.902397] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-01T18:12:45.274324] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T18:12:45.697128] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T18:12:45.702340] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-01T18:12:46.445840] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-01T18:12:46.502434] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-01T18:12:47.302406] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-01T18:12:47.905090] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T18:12:47.931200] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T18:12:48.102404] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-01T18:12:48.382297] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (5.08 seconds). [2025-10-01T18:12:48.902416] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-01T18:12:49.195719] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T18:12:49.702440] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-01T18:12:50.507549] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-01T18:12:50.530385] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T18:12:50.556893] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T18:12:51.277300] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T18:12:51.302399] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-01T18:12:52.046415] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T18:12:52.102368] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-01T18:12:52.902402] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-01T18:12:53.618467] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T18:12:53.640913] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T18:12:53.702390] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-01T18:12:54.502412] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-01T18:12:54.995686] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T18:12:55.302353] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-01T18:12:55.658298] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T18:12:56.102404] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-01T18:12:56.905307] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-01T18:12:56.907969] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T18:12:57.620799] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T18:12:57.702426] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-01T18:12:58.220251] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T18:12:58.221431] [INFO ] [REMOTE ] CR: Full fetch complete (34784 records). [2025-10-01T18:12:58.221520] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-01T18:12:58.512704] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-01T18:12:58.651887] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-01T18:12:58.651976] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-01T18:12:58.652581] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-01T18:12:58.652666] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-01T18:12:58.653500] [DEBUG] [LOCAL ] CR: Trimmed 34784 records to 24428 (keeping 200 days of data) [2025-10-01T18:12:58.813133] [DEBUG] [LOCAL ] CR: Primary data saved (24428 records). [2025-10-01T18:12:58.813269] [INFO ] [MAIN ] CR: Full history saved. [2025-10-01T18:12:58.813368] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 31.0s. Estimated remaining: 4h 16m 25s. Rate: 7.2 symbols/min [2025-10-01T18:12:58.989042] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:12:58.989232] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-01T18:12:58.989273] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-01T18:12:58.989387] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-01T18:12:58.989429] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-01T18:12:58.989472] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-01T18:12:58.989507] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-01T18:12:59.304234] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-01T18:12:59.310033] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T18:12:59.399556] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:00.102380] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-01T18:13:00.274949] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-01T18:13:00.651749] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T18:13:00.764743] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T18:13:00.902389] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-01T18:13:01.702357] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-01T18:13:01.895084] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:13:01.895692] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-01T18:13:01.895840] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:13:01.895992] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-01T18:13:01.896077] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:13:01.896202] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-01T18:13:01.896335] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-01T18:13:01.896396] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-01T18:13:01.896451] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-01T18:13:01.896558] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRCL took 3.1s. Estimated remaining: 4h 15m 58s. Rate: 7.2 symbols/min [2025-10-01T18:13:02.118601] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:02.119005] [DEBUG] [LOCAL ] CRGY: No existing data file found in primary storage. [2025-10-01T18:13:02.119055] [WARN ] [MAIN ] CRGY: No existing data found, performing full refresh instead. [2025-10-01T18:13:02.119168] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-01T18:13:02.119233] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-01T18:13:02.119279] [DEBUG] [LOCAL ] CRGY: No primary data file found to delete. [2025-10-01T18:13:02.119325] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-01T18:13:02.504433] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-01T18:13:02.541833] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:02.578951] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T18:13:03.302383] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-01T18:13:03.316047] [DEBUG] [REMOTE ] CRBD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:13:03.316416] [WARN ] [REMOTE ] CRBD: No data returned for month 2025-10 [2025-10-01T18:13:03.316514] [FATAL] [REMOTE ] CRBD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:13:03.316603] [FATAL] [MAIN ] CRBD: Failed to fetch primary data. [2025-10-01T18:13:03.316694] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:13:03.316770] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-01T18:13:03.316849] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-01T18:13:03.316922] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-10-01T18:13:03.317377] [DEBUG] [LOCAL ] CRBD: Deleted derivative data file. [2025-10-01T18:13:03.317466] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBD took 35.2s. Estimated remaining: 4h 15m 26s. Rate: 7.2 symbols/min [2025-10-01T18:13:03.503395] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:03.563350] [DEBUG] [LOCAL ] CRH: Loaded 53463 existing records from primary storage. [2025-10-01T18:13:03.563768] [INFO ] [MAIN ] CRH: Loaded 53463 existing records. [2025-10-01T18:13:03.795075] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:13:03.795324] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-01T18:13:03.795385] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-01T18:13:03.795835] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-01T18:13:03.795914] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-01T18:13:04.107469] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-01T18:13:04.189000] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:04.902392] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-01T18:13:05.077912] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T18:13:05.654600] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T18:13:05.702375] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-01T18:13:06.208662] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T18:13:06.502381] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-01T18:13:07.302366] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-01T18:13:07.396312] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T18:13:08.102360] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-01T18:13:08.190209] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T18:13:08.806362] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T18:13:08.902370] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-01T18:13:09.702362] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-01T18:13:09.785063] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T18:13:10.502372] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-01T18:13:10.672755] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T18:13:11.302415] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-01T18:13:11.408253] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T18:13:12.102386] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-01T18:13:12.313470] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T18:13:12.902358] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-01T18:13:12.944074] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T18:13:13.702405] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-01T18:13:14.039252] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T18:13:14.040719] [INFO ] [REMOTE ] CRC: Full fetch complete (62396 records). [2025-10-01T18:13:14.040865] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-01T18:13:14.451377] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-01T18:13:14.451495] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-01T18:13:14.452379] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-01T18:13:14.452445] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-01T18:13:14.453795] [DEBUG] [LOCAL ] CRC: Trimmed 62396 records to 44050 (keeping 200 days of data) [2025-10-01T18:13:14.507518] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-01T18:13:14.744186] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T18:13:14.801016] [DEBUG] [LOCAL ] CRC: Primary data saved (44050 records). [2025-10-01T18:13:14.801209] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-01T18:13:14.801303] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 37.2s. Estimated remaining: 4h 15m 28s. Rate: 7.2 symbols/min [2025-10-01T18:13:14.997969] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:15.050137] [DEBUG] [LOCAL ] CRI: Loaded 49913 existing records from primary storage. [2025-10-01T18:13:15.050521] [INFO ] [MAIN ] CRI: Loaded 49913 existing records. [2025-10-01T18:13:15.285514] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:13:15.285935] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-01T18:13:15.286031] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-01T18:13:15.286725] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-01T18:13:15.286837] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-01T18:13:15.308769] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-01T18:13:15.602362] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T18:13:15.755458] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:16.102424] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-01T18:13:16.831398] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-01T18:13:16.833208] [INFO ] [REMOTE ] CRBG: Full fetch complete (75690 records). [2025-10-01T18:13:16.833317] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-01T18:13:16.907596] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-01T18:13:17.284774] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-01T18:13:17.284916] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-01T18:13:17.285794] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-01T18:13:17.285859] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-01T18:13:17.287396] [DEBUG] [LOCAL ] CRBG: Trimmed 75690 records to 52361 (keeping 200 days of data) [2025-10-01T18:13:17.561064] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-01T18:13:17.682727] [DEBUG] [LOCAL ] CRBG: Primary data saved (52361 records). [2025-10-01T18:13:17.683023] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-01T18:13:17.683202] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRBG took 41.9s. Estimated remaining: 4h 15m 1s. Rate: 7.2 symbols/min [2025-10-01T18:13:17.707494] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-01T18:13:17.897785] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:17.948942] [DEBUG] [LOCAL ] CRK: Loaded 52148 existing records from primary storage. [2025-10-01T18:13:17.949290] [INFO ] [MAIN ] CRK: Loaded 52148 existing records. [2025-10-01T18:13:18.151102] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:13:18.151449] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-01T18:13:18.151507] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-01T18:13:18.180739] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-01T18:13:18.181022] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-01T18:13:18.219293] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-01T18:13:18.506738] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-01T18:13:18.595297] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:18.946026] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T18:13:19.198818] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T18:13:19.302390] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-01T18:13:20.102357] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-01T18:13:20.579334] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T18:13:20.902400] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-01T18:13:21.207036] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T18:13:21.349091] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T18:13:21.702388] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-01T18:13:22.502381] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-01T18:13:22.778734] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T18:13:23.237998] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T18:13:23.302402] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-01T18:13:23.668857] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T18:13:24.102413] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-01T18:13:24.902376] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-01T18:13:25.056449] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T18:13:25.694607] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T18:13:25.705064] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-01T18:13:26.506314] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-01T18:13:26.512478] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T18:13:27.301449] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T18:13:27.311238] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-01T18:13:28.102395] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-01T18:13:28.747248] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-01T18:13:28.902370] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-01T18:13:29.091120] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T18:13:29.702370] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-01T18:13:29.824752] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T18:13:30.502354] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-01T18:13:30.563591] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T18:13:31.302359] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-01T18:13:31.518431] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T18:13:32.102400] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-01T18:13:32.409603] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T18:13:32.902397] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-01T18:13:32.975631] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T18:13:33.702397] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-01T18:13:34.285555] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-01T18:13:34.287173] [INFO ] [REMOTE ] CRGY: Full fetch complete (75968 records). [2025-10-01T18:13:34.287283] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-01T18:13:34.511380] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-01T18:13:34.754984] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T18:13:34.785935] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-01T18:13:34.786187] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-01T18:13:34.787363] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-01T18:13:34.787452] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-01T18:13:34.789723] [DEBUG] [LOCAL ] CRGY: Trimmed 75968 records to 52509 (keeping 200 days of data) [2025-10-01T18:13:35.165294] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T18:13:35.277052] [DEBUG] [LOCAL ] CRGY: Primary data saved (52509 records). [2025-10-01T18:13:35.277311] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-01T18:13:35.277496] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRGY took 33.4s. Estimated remaining: 4h 15m 25s. Rate: 7.2 symbols/min [2025-10-01T18:13:35.311003] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-01T18:13:35.585739] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:35.659487] [DEBUG] [LOCAL ] CRL: Loaded 42984 existing records from primary storage. [2025-10-01T18:13:35.659905] [INFO ] [MAIN ] CRL: Loaded 42984 existing records. [2025-10-01T18:13:35.922065] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:13:35.922394] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-01T18:13:35.922467] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-01T18:13:35.922824] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-01T18:13:35.922887] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-01T18:13:36.104839] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-01T18:13:36.351714] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:36.384093] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T18:13:36.902360] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-01T18:13:37.024371] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T18:13:37.702372] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-01T18:13:38.053233] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T18:13:38.272373] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T18:13:38.502431] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-01T18:13:39.302343] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-01T18:13:39.526621] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T18:13:39.865108] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T18:13:40.102419] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-01T18:13:40.902406] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-01T18:13:41.060440] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T18:13:41.457130] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T18:13:41.702421] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-01T18:13:42.502415] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-01T18:13:43.302370] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-01T18:13:43.467522] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T18:13:43.648745] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-01T18:13:43.652075] [INFO ] [REMOTE ] CRH: Full fetch complete (77299 records). [2025-10-01T18:13:43.652229] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-01T18:13:44.091138] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-01T18:13:44.091282] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-01T18:13:44.092386] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-01T18:13:44.092495] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-01T18:13:44.095166] [DEBUG] [LOCAL ] CRH: Trimmed 77299 records to 53462 (keeping 200 days of data) [2025-10-01T18:13:44.156080] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-01T18:13:44.244165] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T18:13:44.500373] [DEBUG] [LOCAL ] CRH: Primary data saved (53462 records). [2025-10-01T18:13:44.500605] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-01T18:13:44.500786] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 41.2s. Estimated remaining: 4h 15m 20s. Rate: 7.2 symbols/min [2025-10-01T18:13:44.687459] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:44.721424] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T18:13:44.781322] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-01T18:13:44.781723] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-01T18:13:44.907526] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-01T18:13:44.998448] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:13:44.998794] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-01T18:13:44.998854] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-01T18:13:44.999190] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-01T18:13:44.999262] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-01T18:13:45.396021] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:45.652575] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T18:13:45.702405] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-01T18:13:46.502413] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-01T18:13:46.764723] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T18:13:47.302395] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-01T18:13:47.889125] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T18:13:47.935232] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-01T18:13:48.102417] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-01T18:13:48.902394] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-01T18:13:49.531326] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T18:13:49.533023] [INFO ] [REMOTE ] CRK: Full fetch complete (75597 records). [2025-10-01T18:13:49.533179] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-01T18:13:49.710211] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-01T18:13:50.008449] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-01T18:13:50.008582] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-01T18:13:50.009510] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-01T18:13:50.009774] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-01T18:13:50.013289] [DEBUG] [LOCAL ] CRK: Trimmed 75597 records to 52153 (keeping 200 days of data) [2025-10-01T18:13:50.158110] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-01T18:13:50.390908] [DEBUG] [LOCAL ] CRK: Primary data saved (52153 records). [2025-10-01T18:13:50.391058] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-01T18:13:50.391158] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRK took 32.7s. Estimated remaining: 4h 15m 3s. Rate: 7.2 symbols/min [2025-10-01T18:13:50.507753] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-01T18:13:50.575847] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:50.619529] [DEBUG] [LOCAL ] CRS: Loaded 43193 existing records from primary storage. [2025-10-01T18:13:50.619856] [INFO ] [MAIN ] CRS: Loaded 43193 existing records. [2025-10-01T18:13:50.816179] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:13:50.816384] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-01T18:13:50.816460] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-01T18:13:50.816854] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-01T18:13:50.816920] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-01T18:13:51.124898] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-01T18:13:51.132876] [INFO ] [REMOTE ] CRI: Full fetch complete (70979 records). [2025-10-01T18:13:51.156042] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-01T18:13:51.285556] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:51.320459] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-01T18:13:51.707296] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-01T18:13:51.708228] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-01T18:13:51.709728] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-01T18:13:51.720073] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-01T18:13:51.720823] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-01T18:13:51.722763] [DEBUG] [LOCAL ] CRI: Trimmed 70979 records to 49912 (keeping 200 days of data) [2025-10-01T18:13:52.047208] [DEBUG] [LOCAL ] CRI: Primary data saved (49912 records). [2025-10-01T18:13:52.047346] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-01T18:13:52.047438] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRI took 37.2s. Estimated remaining: 4h 14m 32s. Rate: 7.2 symbols/min [2025-10-01T18:13:52.115441] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-01T18:13:52.231396] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:13:52.238271] [DEBUG] [LOCAL ] CRT: Loaded 4979 existing records from primary storage. [2025-10-01T18:13:52.238474] [INFO ] [MAIN ] CRT: Loaded 4979 existing records. [2025-10-01T18:13:52.423135] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:13:52.423375] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-01T18:13:52.423428] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-01T18:13:52.423675] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-01T18:13:52.423748] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-01T18:13:52.834505] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:13:52.915692] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T18:13:52.925517] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-01T18:13:52.942019] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-01T18:13:53.693429] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T18:13:53.702334] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-01T18:13:53.779294] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T18:13:54.187089] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T18:13:54.502402] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-01T18:13:55.155507] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T18:13:55.302392] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-01T18:13:56.102395] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-01T18:13:56.902368] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-01T18:13:56.986854] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T18:13:57.702401] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-01T18:13:58.500963] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T18:13:58.509682] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-01T18:13:58.771922] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-01T18:13:59.174479] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T18:13:59.302347] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-01T18:13:59.337829] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T18:14:00.102402] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-01T18:14:00.902365] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-01T18:14:00.949152] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T18:14:01.702379] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-01T18:14:02.286173] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T18:14:02.479374] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T18:14:02.502396] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-01T18:14:02.688105] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-01T18:14:02.913358] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-01T18:14:03.302384] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-01T18:14:04.017881] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T18:14:04.102369] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-01T18:14:04.902383] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-01T18:14:05.370134] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-01T18:14:05.702384] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-01T18:14:06.502409] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-01T18:14:06.712807] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-01T18:14:06.950086] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-01T18:14:07.302370] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-01T18:14:07.630435] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T18:14:07.997758] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T18:14:08.102379] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-01T18:14:08.902387] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-01T18:14:08.954611] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T18:14:08.955619] [INFO ] [REMOTE ] CRT: Full fetch complete (7589 records). [2025-10-01T18:14:08.955732] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-01T18:14:09.410932] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-01T18:14:09.411013] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-01T18:14:09.411248] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-01T18:14:09.411296] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-01T18:14:09.411741] [DEBUG] [LOCAL ] CRT: Trimmed 7589 records to 4988 (keeping 200 days of data) [2025-10-01T18:14:09.443826] [DEBUG] [LOCAL ] CRT: Primary data saved (4988 records). [2025-10-01T18:14:09.443935] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-01T18:14:09.444015] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRT took 17.4s. Estimated remaining: 4h 14m 55s. Rate: 7.2 symbols/min [2025-10-01T18:14:09.638907] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:14:09.679663] [DEBUG] [LOCAL ] CSAN: Loaded 42417 existing records from primary storage. [2025-10-01T18:14:09.680050] [INFO ] [MAIN ] CSAN: Loaded 42417 existing records. [2025-10-01T18:14:09.712199] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-01T18:14:09.879749] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:14:09.880006] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-01T18:14:09.880058] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-01T18:14:09.880309] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-01T18:14:09.880369] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-01T18:14:10.269490] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:14:10.502382] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-01T18:14:11.302395] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-01T18:14:11.431989] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T18:14:11.503148] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-01T18:14:12.102388] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-01T18:14:12.162837] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T18:14:12.606386] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T18:14:12.902382] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-01T18:14:13.702432] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-01T18:14:14.285397] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-01T18:14:14.286913] [INFO ] [REMOTE ] CRL: Full fetch complete (62921 records). [2025-10-01T18:14:14.287009] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-01T18:14:14.509672] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-01T18:14:14.749189] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-01T18:14:14.749320] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-01T18:14:14.750315] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-01T18:14:14.750393] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-01T18:14:14.751907] [DEBUG] [LOCAL ] CRL: Trimmed 62921 records to 42959 (keeping 200 days of data) [2025-10-01T18:14:15.061497] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-01T18:14:15.113577] [DEBUG] [LOCAL ] CRL: Primary data saved (42959 records). [2025-10-01T18:14:15.113738] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-01T18:14:15.113842] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRL took 39.8s. Estimated remaining: 4h 14m 37s. Rate: 7.2 symbols/min [2025-10-01T18:14:15.306452] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-01T18:14:15.310378] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:14:15.349889] [DEBUG] [LOCAL ] CSL: Loaded 31515 existing records from primary storage. [2025-10-01T18:14:15.350166] [INFO ] [MAIN ] CSL: Loaded 31515 existing records. [2025-10-01T18:14:15.591901] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:14:15.595283] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T18:14:15.593431] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-01T18:14:15.595797] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-01T18:14:15.607286] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-01T18:14:15.607400] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-01T18:14:16.048809] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:14:16.075210] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T18:14:16.102414] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-01T18:14:16.902411] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-01T18:14:17.620594] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T18:14:17.702375] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-01T18:14:17.928264] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-01T18:14:18.507724] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-01T18:14:18.519988] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T18:14:19.302381] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-01T18:14:19.441432] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T18:14:20.102412] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-01T18:14:20.466994] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T18:14:20.642488] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-01T18:14:20.902401] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-01T18:14:21.702381] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-01T18:14:21.746379] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T18:14:22.502415] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-01T18:14:22.942147] [DEBUG] [REMOTE ] CRM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:14:22.942481] [WARN ] [REMOTE ] CRM: No data returned for month 2025-10 [2025-10-01T18:14:22.942573] [FATAL] [REMOTE ] CRM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:14:22.942682] [FATAL] [MAIN ] CRM: Failed to fetch primary data. [2025-10-01T18:14:22.942755] [WARN ] [MAIN ] CRM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:14:22.942828] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-01T18:14:22.942893] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-01T18:14:22.942930] [INFO ] [LOCAL ] CRM: Starting deletion of derivative data. [2025-10-01T18:14:22.943397] [DEBUG] [LOCAL ] CRM: Deleted derivative data file. [2025-10-01T18:14:22.943488] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRM took 38.4s. Estimated remaining: 4h 14m 27s. Rate: 7.2 symbols/min [2025-10-01T18:14:23.144924] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:14:23.183442] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T18:14:23.206050] [DEBUG] [LOCAL ] CSR: Loaded 12774 existing records from primary storage. [2025-10-01T18:14:23.206372] [INFO ] [MAIN ] CSR: Loaded 12774 existing records. [2025-10-01T18:14:23.307992] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-01T18:14:23.407746] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:14:23.407989] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-01T18:14:23.408039] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-01T18:14:23.408267] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-01T18:14:23.408324] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-01T18:14:23.829210] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:14:23.873208] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T18:14:24.102436] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-01T18:14:24.873324] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T18:14:24.902357] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-01T18:14:25.006541] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T18:14:25.702406] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-01T18:14:26.384909] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T18:14:26.502378] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-01T18:14:26.549141] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T18:14:27.302443] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-01T18:14:27.804846] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T18:14:28.102447] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-01T18:14:28.464299] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T18:14:28.801188] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T18:14:28.902434] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-01T18:14:29.702428] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-01T18:14:30.121149] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T18:14:30.502442] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-01T18:14:31.047127] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T18:14:31.302426] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-01T18:14:31.691436] [DEBUG] [REMOTE ] CRS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:14:31.691787] [WARN ] [REMOTE ] CRS: No data returned for month 2025-10 [2025-10-01T18:14:31.691876] [FATAL] [REMOTE ] CRS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:14:31.691961] [FATAL] [MAIN ] CRS: Failed to fetch primary data. [2025-10-01T18:14:31.691999] [WARN ] [MAIN ] CRS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:14:31.692064] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-01T18:14:31.692128] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-01T18:14:31.692164] [INFO ] [LOCAL ] CRS: Starting deletion of derivative data. [2025-10-01T18:14:31.692541] [DEBUG] [LOCAL ] CRS: Deleted derivative data file. [2025-10-01T18:14:31.692628] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRS took 41.3s. Estimated remaining: 4h 14m 20s. Rate: 7.2 symbols/min [2025-10-01T18:14:31.893959] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:14:31.894223] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-10-01T18:14:31.894284] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-10-01T18:14:31.894403] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-01T18:14:31.894447] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-01T18:14:31.894490] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-01T18:14:31.894523] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-01T18:14:32.107559] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-01T18:14:32.300114] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:14:32.783069] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:14:32.902364] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-01T18:14:33.515622] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T18:14:33.702371] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-01T18:14:33.740793] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T18:14:34.502420] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-01T18:14:35.231379] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T18:14:35.281093] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T18:14:35.302344] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-01T18:14:36.102401] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-01T18:14:36.369795] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T18:14:36.902396] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-01T18:14:37.662768] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T18:14:37.705836] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-01T18:14:37.709499] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T18:14:38.502398] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-01T18:14:39.309492] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-01T18:14:39.315519] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T18:14:39.563719] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T18:14:40.102410] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-01T18:14:40.902387] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-01T18:14:41.258730] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-01T18:14:41.260092] [INFO ] [REMOTE ] CSAN: Full fetch complete (60723 records). [2025-10-01T18:14:41.260202] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-01T18:14:41.704768] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-01T18:14:41.731247] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-01T18:14:41.732417] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-01T18:14:41.733368] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-01T18:14:41.733720] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-01T18:14:41.742365] [DEBUG] [LOCAL ] CSAN: Trimmed 60723 records to 42343 (keeping 200 days of data) [2025-10-01T18:14:41.762407] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T18:14:42.040534] [DEBUG] [LOCAL ] CSAN: Primary data saved (42343 records). [2025-10-01T18:14:42.040694] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-01T18:14:42.040788] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 32.6s. Estimated remaining: 4h 14m 19s. Rate: 7.2 symbols/min [2025-10-01T18:14:42.254533] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:14:42.286689] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:14:42.307409] [DEBUG] [LOCAL ] CSV: Loaded 12824 existing records from primary storage. [2025-10-01T18:14:42.307676] [INFO ] [MAIN ] CSV: Loaded 12824 existing records. [2025-10-01T18:14:42.504890] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-01T18:14:42.537109] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:14:42.537577] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-01T18:14:42.537673] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-01T18:14:42.537997] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-01T18:14:42.538059] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-01T18:14:42.694514] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T18:14:42.991404] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:14:43.302411] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-01T18:14:43.939615] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T18:14:44.104387] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-01T18:14:44.107964] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T18:14:44.902422] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-01T18:14:45.551108] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T18:14:45.702390] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-01T18:14:45.876263] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T18:14:46.502382] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-01T18:14:47.302357] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-01T18:14:47.414208] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T18:14:47.434223] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T18:14:48.102389] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-01T18:14:48.213411] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T18:14:48.902390] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-01T18:14:49.345414] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T18:14:49.702412] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-01T18:14:49.937501] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T18:14:50.502350] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-01T18:14:51.302351] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-01T18:14:51.673704] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T18:14:51.946077] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T18:14:51.947239] [INFO ] [REMOTE ] CSL: Full fetch complete (45274 records). [2025-10-01T18:14:51.947329] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-01T18:14:52.110068] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-01T18:14:52.384357] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-01T18:14:52.384445] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-01T18:14:52.385080] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-01T18:14:52.385143] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-01T18:14:52.386221] [DEBUG] [LOCAL ] CSL: Trimmed 45274 records to 31471 (keeping 200 days of data) [2025-10-01T18:14:52.620253] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T18:14:52.647517] [DEBUG] [LOCAL ] CSL: Primary data saved (31471 records). [2025-10-01T18:14:52.647711] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-01T18:14:52.647820] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSL took 37.5s. Estimated remaining: 4h 14m 18s. Rate: 7.2 symbols/min [2025-10-01T18:14:52.838471] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:14:52.838714] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-01T18:14:52.838766] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-01T18:14:52.838877] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-01T18:14:52.838921] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-01T18:14:52.838965] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-01T18:14:52.839000] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-01T18:14:52.907510] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-01T18:14:53.224579] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T18:14:53.290990] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:14:53.702347] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-01T18:14:53.932209] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T18:14:54.502387] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-01T18:14:55.274414] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T18:14:55.302327] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-01T18:14:55.462733] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T18:14:55.504582] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:14:55.504937] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-01T18:14:55.505028] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:14:55.505076] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-01T18:14:55.505164] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:14:55.505238] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-01T18:14:55.505333] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-01T18:14:55.505388] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-01T18:14:55.505435] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-01T18:14:55.505482] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 2.9s. Estimated remaining: 4h 13m 52s. Rate: 7.2 symbols/min [2025-10-01T18:14:55.719802] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:14:55.730357] [DEBUG] [LOCAL ] CTBB: Loaded 7058 existing records from primary storage. [2025-10-01T18:14:55.730598] [INFO ] [MAIN ] CTBB: Loaded 7058 existing records. [2025-10-01T18:14:55.924227] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:14:55.924429] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-01T18:14:55.924478] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-01T18:14:55.924734] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-01T18:14:55.924795] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-01T18:14:56.107464] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-01T18:14:56.349129] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:14:56.902375] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-01T18:14:57.702376] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-01T18:14:57.755996] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T18:14:57.798953] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T18:14:58.483938] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T18:14:58.502349] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-01T18:14:59.302386] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-01T18:14:59.656200] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T18:14:59.785412] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T18:15:00.102393] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-01T18:15:00.902363] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-01T18:15:01.000966] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T18:15:01.702388] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-01T18:15:02.350599] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T18:15:02.351517] [INFO ] [REMOTE ] CSR: Full fetch complete (17677 records). [2025-10-01T18:15:02.351604] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-01T18:15:02.475206] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T18:15:02.504883] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-01T18:15:02.784107] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-01T18:15:02.784193] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-01T18:15:02.784635] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-01T18:15:02.784721] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-01T18:15:02.785389] [DEBUG] [LOCAL ] CSR: Trimmed 17677 records to 12788 (keeping 200 days of data) [2025-10-01T18:15:02.871098] [DEBUG] [LOCAL ] CSR: Primary data saved (12788 records). [2025-10-01T18:15:02.871245] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-01T18:15:02.871338] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSR took 39.9s. Estimated remaining: 4h 13m 40s. Rate: 7.2 symbols/min [2025-10-01T18:15:03.072229] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:03.080973] [DEBUG] [LOCAL ] CTDD: Loaded 5892 existing records from primary storage. [2025-10-01T18:15:03.081160] [INFO ] [MAIN ] CTDD: Loaded 5892 existing records. [2025-10-01T18:15:03.256692] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T18:15:03.299181] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:15:03.299416] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-01T18:15:03.299466] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-01T18:15:03.299725] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-01T18:15:03.299785] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-01T18:15:03.311456] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-01T18:15:03.713695] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:04.018956] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T18:15:04.102384] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-01T18:15:04.902371] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-01T18:15:05.297698] [DEBUG] [REMOTE ] CSTM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:15:05.298106] [WARN ] [REMOTE ] CSTM: No data returned for month 2025-10 [2025-10-01T18:15:05.298199] [FATAL] [REMOTE ] CSTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:15:05.298292] [FATAL] [MAIN ] CSTM: Failed to fetch primary data. [2025-10-01T18:15:05.298367] [WARN ] [MAIN ] CSTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:15:05.298442] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-01T18:15:05.298552] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-01T18:15:05.298627] [INFO ] [LOCAL ] CSTM: Starting deletion of derivative data. [2025-10-01T18:15:05.298726] [DEBUG] [LOCAL ] CSTM: No derivative data file found to delete. [2025-10-01T18:15:05.298784] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSTM took 33.6s. Estimated remaining: 4h 13m 12s. Rate: 7.2 symbols/min [2025-10-01T18:15:05.507581] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:05.515737] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-01T18:15:05.516130] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-01T18:15:05.516044] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T18:15:05.516293] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-01T18:15:05.519495] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-01T18:15:05.519896] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-01T18:15:05.519952] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-01T18:15:05.707495] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-01T18:15:05.961063] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:06.229946] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-01T18:15:06.502380] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-01T18:15:06.982398] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:15:06.982750] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-01T18:15:06.982842] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:15:06.982890] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-01T18:15:06.982926] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:15:06.982992] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-01T18:15:06.983088] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-01T18:15:06.983144] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-01T18:15:06.983187] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-01T18:15:06.983234] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 1.7s. Estimated remaining: 4h 12m 41s. Rate: 7.2 symbols/min [2025-10-01T18:15:07.191534] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:07.191724] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-01T18:15:07.191775] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-01T18:15:07.191893] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-01T18:15:07.191936] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-01T18:15:07.191980] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-01T18:15:07.192057] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-01T18:15:07.307528] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-01T18:15:07.619677] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:07.938832] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T18:15:08.102433] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-01T18:15:08.718987] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T18:15:08.902420] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-01T18:15:09.702416] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-01T18:15:09.791398] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T18:15:09.961196] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:15:09.961536] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-01T18:15:09.961628] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:15:09.961717] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-01T18:15:09.961783] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:15:09.961856] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-01T18:15:09.961922] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-01T18:15:09.961959] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-01T18:15:09.962026] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-01T18:15:09.962096] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEV took 3.0s. Estimated remaining: 4h 12m 15s. Rate: 7.2 symbols/min [2025-10-01T18:15:10.158867] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:10.189977] [DEBUG] [LOCAL ] CTO: Loaded 27915 existing records from primary storage. [2025-10-01T18:15:10.190246] [INFO ] [MAIN ] CTO: Loaded 27915 existing records. [2025-10-01T18:15:10.400084] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:15:10.400342] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-01T18:15:10.400396] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-01T18:15:10.400639] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-01T18:15:10.400736] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-01T18:15:10.507569] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-01T18:15:10.825061] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:11.134156] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T18:15:11.302400] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-01T18:15:11.891331] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T18:15:12.102430] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-01T18:15:12.902414] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-01T18:15:13.617570] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T18:15:13.702398] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-01T18:15:13.976853] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T18:15:14.502395] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-01T18:15:14.582182] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-01T18:15:14.583002] [INFO ] [REMOTE ] CTBB: Full fetch complete (10838 records). [2025-10-01T18:15:14.583079] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-01T18:15:15.042167] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-01T18:15:15.042411] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-01T18:15:15.042907] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-01T18:15:15.042988] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-01T18:15:15.043703] [DEBUG] [LOCAL ] CTBB: Trimmed 10838 records to 7070 (keeping 200 days of data) [2025-10-01T18:15:15.092470] [DEBUG] [LOCAL ] CTBB: Primary data saved (7070 records). [2025-10-01T18:15:15.092617] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-01T18:15:15.092780] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTBB took 19.6s. Estimated remaining: 4h 11m 56s. Rate: 7.2 symbols/min [2025-10-01T18:15:15.293158] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:15.302350] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-01T18:15:15.331460] [DEBUG] [LOCAL ] CTOS: Loaded 36496 existing records from primary storage. [2025-10-01T18:15:15.331841] [INFO ] [MAIN ] CTOS: Loaded 36496 existing records. [2025-10-01T18:15:15.552911] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:15:15.553301] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-01T18:15:15.553409] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-01T18:15:15.553989] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-01T18:15:15.554052] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-01T18:15:15.753081] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T18:15:15.903759] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T18:15:15.990476] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:16.102383] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-01T18:15:16.902408] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-01T18:15:16.984395] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T18:15:17.614111] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T18:15:17.702705] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-01T18:15:18.502436] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-01T18:15:19.116991] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T18:15:19.302374] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-01T18:15:19.319523] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T18:15:20.102452] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-01T18:15:20.621180] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T18:15:20.768748] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-01T18:15:20.902393] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-01T18:15:21.702405] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-01T18:15:21.993708] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T18:15:21.994989] [INFO ] [REMOTE ] CSV: Full fetch complete (19438 records). [2025-10-01T18:15:21.995145] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-01T18:15:22.359795] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T18:15:22.453744] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-01T18:15:22.453842] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-01T18:15:22.454330] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-01T18:15:22.454410] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-01T18:15:22.455190] [DEBUG] [LOCAL ] CSV: Trimmed 19438 records to 12774 (keeping 200 days of data) [2025-10-01T18:15:22.514572] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-01T18:15:22.543161] [DEBUG] [LOCAL ] CSV: Primary data saved (12774 records). [2025-10-01T18:15:22.543325] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-01T18:15:22.543427] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CSV took 40.5s. Estimated remaining: 4h 11m 45s. Rate: 7.2 symbols/min [2025-10-01T18:15:22.744394] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:22.805749] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-10-01T18:15:22.806157] [INFO ] [MAIN ] CTRA: Loaded 53648 existing records. [2025-10-01T18:15:23.014375] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:15:23.018736] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-01T18:15:23.019318] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-01T18:15:23.019163] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-01T18:15:23.021452] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-01T18:15:23.021515] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-01T18:15:23.307545] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-01T18:15:23.432424] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:23.837214] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T18:15:24.102404] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-01T18:15:24.902418] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-01T18:15:25.653054] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T18:15:25.702412] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-01T18:15:26.502442] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-01T18:15:26.948138] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-01T18:15:27.001462] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T18:15:27.049066] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T18:15:27.302389] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-01T18:15:28.102394] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-01T18:15:28.902373] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-01T18:15:29.195892] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T18:15:29.239606] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T18:15:29.702424] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-01T18:15:30.322753] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T18:15:30.423443] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T18:15:30.502403] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-01T18:15:31.051447] [DEBUG] [REMOTE ] CTDD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:15:31.051839] [WARN ] [REMOTE ] CTDD: No data returned for month 2025-10 [2025-10-01T18:15:31.051939] [FATAL] [REMOTE ] CTDD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:15:31.052041] [FATAL] [MAIN ] CTDD: Failed to fetch primary data. [2025-10-01T18:15:31.052125] [WARN ] [MAIN ] CTDD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:15:31.052200] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-01T18:15:31.052270] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-01T18:15:31.052310] [INFO ] [LOCAL ] CTDD: Starting deletion of derivative data. [2025-10-01T18:15:31.052885] [DEBUG] [LOCAL ] CTDD: Deleted derivative data file. [2025-10-01T18:15:31.052979] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTDD took 28.2s. Estimated remaining: 4h 11m 38s. Rate: 7.2 symbols/min [2025-10-01T18:15:31.274996] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:31.312843] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-01T18:15:31.337342] [DEBUG] [LOCAL ] CTRE: Loaded 49202 existing records from primary storage. [2025-10-01T18:15:31.337750] [INFO ] [MAIN ] CTRE: Loaded 49202 existing records. [2025-10-01T18:15:31.573033] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:15:31.573559] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-01T18:15:31.573623] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-01T18:15:31.573906] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-01T18:15:31.573974] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-01T18:15:31.996172] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:32.102425] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-01T18:15:32.681416] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T18:15:32.902385] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-01T18:15:33.378446] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T18:15:33.702408] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-01T18:15:33.825145] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T18:15:34.502429] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-01T18:15:35.302427] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-01T18:15:35.580313] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T18:15:35.722075] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T18:15:36.102415] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-01T18:15:36.896816] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T18:15:36.906665] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-01T18:15:37.270573] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T18:15:37.702384] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-01T18:15:37.983420] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T18:15:38.502394] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-01T18:15:39.302372] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-01T18:15:39.366947] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T18:15:39.863121] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T18:15:40.102393] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-01T18:15:40.881468] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T18:15:40.902348] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-01T18:15:41.702389] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-01T18:15:41.826368] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T18:15:42.502371] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-01T18:15:42.764974] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T18:15:43.302401] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-01T18:15:43.450890] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T18:15:44.073898] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T18:15:44.102407] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-01T18:15:44.902350] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-01T18:15:45.004102] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T18:15:45.640146] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T18:15:45.702385] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-01T18:15:46.502386] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-01T18:15:46.745423] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T18:15:47.177894] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T18:15:47.302447] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-01T18:15:47.723565] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T18:15:48.102421] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-01T18:15:48.766888] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T18:15:48.902388] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-01T18:15:49.702414] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-01T18:15:49.898734] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T18:15:49.900009] [INFO ] [REMOTE ] CTO: Full fetch complete (41764 records). [2025-10-01T18:15:49.900095] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-01T18:15:50.331574] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-01T18:15:50.331694] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-01T18:15:50.332380] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-01T18:15:50.332427] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-01T18:15:50.333533] [DEBUG] [LOCAL ] CTO: Trimmed 41764 records to 27816 (keeping 200 days of data) [2025-10-01T18:15:50.505909] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-01T18:15:50.524859] [DEBUG] [LOCAL ] CTO: Primary data saved (27816 records). [2025-10-01T18:15:50.525115] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-01T18:15:50.525488] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTO took 40.6s. Estimated remaining: 4h 12m 7s. Rate: 7.2 symbols/min [2025-10-01T18:15:50.729108] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:50.769903] [DEBUG] [LOCAL ] CTRI: Loaded 38422 existing records from primary storage. [2025-10-01T18:15:50.770526] [INFO ] [MAIN ] CTRI: Loaded 38422 existing records. [2025-10-01T18:15:50.911628] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-01T18:15:51.041935] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:15:51.042162] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-01T18:15:51.042212] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-01T18:15:51.042506] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-01T18:15:51.042567] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-01T18:15:51.304634] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-01T18:15:51.441036] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:51.726030] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-01T18:15:52.102376] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-01T18:15:52.394009] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T18:15:52.395293] [INFO ] [REMOTE ] CTOS: Full fetch complete (53460 records). [2025-10-01T18:15:52.395406] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-01T18:15:52.846470] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-01T18:15:52.846676] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-01T18:15:52.847525] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-01T18:15:52.847731] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-01T18:15:52.900734] [DEBUG] [LOCAL ] CTOS: Trimmed 53460 records to 36522 (keeping 200 days of data) [2025-10-01T18:15:52.906120] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-01T18:15:52.984251] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T18:15:53.178051] [DEBUG] [LOCAL ] CTOS: Primary data saved (36522 records). [2025-10-01T18:15:53.178206] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-01T18:15:53.178296] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTOS took 38.1s. Estimated remaining: 4h 11m 40s. Rate: 7.2 symbols/min [2025-10-01T18:15:53.376380] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:15:53.404050] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T18:15:53.430355] [DEBUG] [LOCAL ] CTS: Loaded 19345 existing records from primary storage. [2025-10-01T18:15:53.430617] [INFO ] [MAIN ] CTS: Loaded 19345 existing records. [2025-10-01T18:15:53.624342] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:15:53.624925] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-01T18:15:53.624983] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-01T18:15:53.625577] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-01T18:15:53.625727] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-01T18:15:53.712230] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-01T18:15:54.037472] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:15:54.502435] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-01T18:15:54.845109] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T18:15:55.116905] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T18:15:55.302382] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-01T18:15:55.516570] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T18:15:56.102422] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-01T18:15:56.902420] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-01T18:15:57.216583] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T18:15:57.702964] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-01T18:15:57.721920] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T18:15:57.782217] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T18:15:58.464898] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T18:15:58.502356] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-01T18:15:59.302374] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-01T18:15:59.486249] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T18:16:00.102348] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-01T18:16:00.192221] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T18:16:00.902381] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-01T18:16:01.702385] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-01T18:16:02.203105] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T18:16:02.321221] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-01T18:16:02.502392] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-01T18:16:03.287886] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T18:16:03.302337] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-01T18:16:03.512369] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T18:16:04.102402] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-01T18:16:04.366162] [DEBUG] [REMOTE ] CTRE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:16:04.366557] [WARN ] [REMOTE ] CTRE: No data returned for month 2025-10 [2025-10-01T18:16:04.366678] [FATAL] [REMOTE ] CTRE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:16:04.366809] [FATAL] [MAIN ] CTRE: Failed to fetch primary data. [2025-10-01T18:16:04.366898] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:16:04.367024] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-01T18:16:04.367134] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-01T18:16:04.367233] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-01T18:16:04.367915] [DEBUG] [LOCAL ] CTRE: Deleted derivative data file. [2025-10-01T18:16:04.368010] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRE took 33.3s. Estimated remaining: 4h 11m 41s. Rate: 7.2 symbols/min [2025-10-01T18:16:04.556564] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:16:04.615969] [DEBUG] [LOCAL ] CTVA: Loaded 53236 existing records from primary storage. [2025-10-01T18:16:04.616338] [INFO ] [MAIN ] CTVA: Loaded 53236 existing records. [2025-10-01T18:16:04.816451] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:16:04.816708] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-01T18:16:04.816773] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-01T18:16:04.817408] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-01T18:16:04.817469] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-01T18:16:04.909733] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-01T18:16:05.236160] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:16:05.258403] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T18:16:05.702448] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-01T18:16:05.772614] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T18:16:06.502448] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-01T18:16:07.302391] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-01T18:16:07.532107] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T18:16:07.664424] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T18:16:08.102404] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-01T18:16:08.902392] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-01T18:16:09.677181] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T18:16:09.702352] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-01T18:16:09.875845] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-01T18:16:09.878217] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-10-01T18:16:09.878345] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-01T18:16:10.110163] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T18:16:10.339230] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-01T18:16:10.339337] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-01T18:16:10.340301] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-01T18:16:10.340408] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-01T18:16:10.342103] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 53648 (keeping 200 days of data) [2025-10-01T18:16:10.542217] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-01T18:16:10.717887] [DEBUG] [LOCAL ] CTRA: Primary data saved (53648 records). [2025-10-01T18:16:10.718042] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-01T18:16:10.718143] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRA took 48.2s. Estimated remaining: 4h 11m 26s. Rate: 7.2 symbols/min [2025-10-01T18:16:10.944003] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:16:10.944238] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-01T18:16:10.944282] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-01T18:16:10.944359] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-01T18:16:10.944396] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-01T18:16:10.944469] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-01T18:16:10.944516] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-01T18:16:11.305628] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-01T18:16:11.396045] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:16:11.432721] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T18:16:11.578599] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T18:16:12.102392] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-01T18:16:12.610997] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T18:16:12.902454] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-01T18:16:13.567363] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-01T18:16:13.702397] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-01T18:16:14.048550] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T18:16:14.109568] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-01T18:16:14.502581] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-01T18:16:15.302412] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-01T18:16:16.102437] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-01T18:16:16.550382] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T18:16:16.619523] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T18:16:16.902408] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-01T18:16:17.305051] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T18:16:17.702439] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-01T18:16:18.073298] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-01T18:16:18.502368] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-01T18:16:18.771279] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T18:16:19.302361] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-01T18:16:19.588254] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-01T18:16:19.607640] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T18:16:20.102386] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-01T18:16:20.459289] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-01T18:16:20.902431] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-01T18:16:21.702412] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-01T18:16:22.299288] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T18:16:22.502391] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-01T18:16:23.213804] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T18:16:23.302373] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-01T18:16:24.102430] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-01T18:16:24.138717] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T18:16:24.902356] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-01T18:16:25.155088] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T18:16:25.275096] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T18:16:25.276133] [INFO ] [REMOTE ] CTS: Full fetch complete (26761 records). [2025-10-01T18:16:25.276222] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-01T18:16:25.453535] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-01T18:16:25.704702] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-01T18:16:25.704378] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-01T18:16:25.704972] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-01T18:16:25.706461] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-01T18:16:25.706540] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-01T18:16:25.707461] [DEBUG] [LOCAL ] CTS: Trimmed 26761 records to 19374 (keeping 200 days of data) [2025-10-01T18:16:25.834057] [DEBUG] [LOCAL ] CTS: Primary data saved (19374 records). [2025-10-01T18:16:25.834201] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-01T18:16:25.834289] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTS took 32.7s. Estimated remaining: 4h 11m 40s. Rate: 7.2 symbols/min [2025-10-01T18:16:26.029219] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:16:26.025035] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-01T18:16:26.085889] [DEBUG] [LOCAL ] CUBE: Loaded 50616 existing records from primary storage. [2025-10-01T18:16:26.086205] [INFO ] [MAIN ] CUBE: Loaded 50616 existing records. [2025-10-01T18:16:26.275822] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:16:26.276054] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-01T18:16:26.276103] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-01T18:16:26.278184] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-01T18:16:26.278249] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-01T18:16:26.507591] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-01T18:16:26.666487] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:16:26.814986] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-01T18:16:27.302403] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-01T18:16:28.102450] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-01T18:16:28.414422] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-01T18:16:28.902377] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-01T18:16:29.160424] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T18:16:29.702407] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-01T18:16:30.502394] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-01T18:16:31.028867] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T18:16:31.173193] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T18:16:31.175085] [INFO ] [REMOTE ] CTRI: Full fetch complete (51881 records). [2025-10-01T18:16:31.175197] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-01T18:16:31.307500] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-01T18:16:31.615829] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-01T18:16:31.615926] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-01T18:16:31.616711] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-01T18:16:31.616779] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-01T18:16:31.618165] [DEBUG] [LOCAL ] CTRI: Trimmed 51881 records to 38669 (keeping 200 days of data) [2025-10-01T18:16:31.720701] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-01T18:16:31.866246] [DEBUG] [LOCAL ] CTRI: Primary data saved (38669 records). [2025-10-01T18:16:31.866484] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-01T18:16:31.866591] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTRI took 41.3s. Estimated remaining: 4h 11m 25s. Rate: 7.2 symbols/min [2025-10-01T18:16:32.057352] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:16:32.091705] [DEBUG] [LOCAL ] CUBI: Loaded 27167 existing records from primary storage. [2025-10-01T18:16:32.092057] [INFO ] [MAIN ] CUBI: Loaded 27167 existing records. [2025-10-01T18:16:32.107509] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-01T18:16:32.323134] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:16:32.323411] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-01T18:16:32.323570] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-01T18:16:32.325258] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-01T18:16:32.325328] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-01T18:16:32.700312] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-01T18:16:32.783174] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:16:32.902365] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-01T18:16:33.229440] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-01T18:16:33.482203] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T18:16:33.702431] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-01T18:16:34.502422] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-01T18:16:35.307597] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-01T18:16:35.334115] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T18:16:36.063449] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T18:16:36.102386] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-01T18:16:36.569077] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T18:16:36.902389] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-01T18:16:37.547493] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T18:16:37.702365] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-01T18:16:37.836582] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T18:16:38.502405] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-01T18:16:39.302364] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-01T18:16:39.532864] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T18:16:40.102398] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-01T18:16:40.246570] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-01T18:16:40.813002] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-01T18:16:40.814869] [INFO ] [REMOTE ] CTVA: Full fetch complete (76979 records). [2025-10-01T18:16:40.815015] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-01T18:16:40.907490] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-01T18:16:41.274312] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-01T18:16:41.274412] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-01T18:16:41.275294] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-01T18:16:41.275359] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-01T18:16:41.277368] [DEBUG] [LOCAL ] CTVA: Trimmed 76979 records to 53239 (keeping 200 days of data) [2025-10-01T18:16:41.644892] [DEBUG] [LOCAL ] CTVA: Primary data saved (53239 records). [2025-10-01T18:16:41.645043] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-01T18:16:41.645132] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTVA took 37.3s. Estimated remaining: 4h 11m 21s. Rate: 7.2 symbols/min [2025-10-01T18:16:41.707117] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-01T18:16:41.855589] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:16:41.856012] [DEBUG] [LOCAL ] CUK: No existing data file found in primary storage. [2025-10-01T18:16:41.856546] [WARN ] [MAIN ] CUK: No existing data found, performing full refresh instead. [2025-10-01T18:16:41.856700] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-01T18:16:41.856781] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-01T18:16:41.856920] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-10-01T18:16:41.857026] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-01T18:16:42.004037] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T18:16:42.285624] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T18:16:42.338784] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:16:42.354830] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T18:16:42.355456] [INFO ] [REMOTE ] CUBB: Full fetch complete (927 records). [2025-10-01T18:16:42.355527] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-01T18:16:42.514604] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-01T18:16:42.559427] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-01T18:16:42.559691] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:16:42.559765] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:16:42.559844] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-01T18:16:42.559912] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-01T18:16:42.559951] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-01T18:16:42.559993] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-01T18:16:42.560069] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBB took 31.8s. Estimated remaining: 4h 10m 49s. Rate: 7.2 symbols/min [2025-10-01T18:16:42.746392] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:16:42.751204] [DEBUG] [LOCAL ] CULP: Loaded 2957 existing records from primary storage. [2025-10-01T18:16:42.751439] [INFO ] [MAIN ] CULP: Loaded 2957 existing records. [2025-10-01T18:16:42.948260] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:16:42.948471] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-01T18:16:42.948519] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-01T18:16:42.948843] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-01T18:16:42.948906] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-01T18:16:43.307477] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-01T18:16:43.348315] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:16:44.102360] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-01T18:16:44.400842] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T18:16:44.465028] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T18:16:44.836848] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T18:16:44.902422] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-01T18:16:45.004981] [DEBUG] [REMOTE ] CUBI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-01T18:16:45.005329] [WARN ] [REMOTE ] CUBI: No data returned for month 2025-05 [2025-10-01T18:16:45.005421] [FATAL] [REMOTE ] CUBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:16:45.005513] [FATAL] [MAIN ] CUBI: Failed to fetch primary data. [2025-10-01T18:16:45.005578] [WARN ] [MAIN ] CUBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:16:45.005692] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-01T18:16:45.005765] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-01T18:16:45.005803] [INFO ] [LOCAL ] CUBI: Starting deletion of derivative data. [2025-10-01T18:16:45.006236] [DEBUG] [LOCAL ] CUBI: Deleted derivative data file. [2025-10-01T18:16:45.006327] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBI took 13.1s. Estimated remaining: 4h 10m 21s. Rate: 7.2 symbols/min [2025-10-01T18:16:45.194239] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:16:45.230620] [DEBUG] [LOCAL ] CURB: Loaded 32587 existing records from primary storage. [2025-10-01T18:16:45.230951] [INFO ] [MAIN ] CURB: Loaded 32587 existing records. [2025-10-01T18:16:45.439799] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:16:45.440048] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-01T18:16:45.440099] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-01T18:16:45.441375] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-01T18:16:45.441437] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-01T18:16:45.709751] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-01T18:16:45.850489] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:16:46.373795] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-01T18:16:46.502384] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-01T18:16:47.302410] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-01T18:16:48.102398] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-01T18:16:48.274721] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-01T18:16:48.597439] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-01T18:16:48.818751] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T18:16:48.902396] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-01T18:16:49.456396] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T18:16:49.702381] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-01T18:16:50.199879] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-01T18:16:50.502385] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-01T18:16:51.302381] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-01T18:16:51.766793] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T18:16:52.046474] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T18:16:52.102342] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-01T18:16:52.902373] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-01T18:16:53.702396] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-01T18:16:53.744222] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T18:16:54.191480] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-01T18:16:54.502373] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-01T18:16:54.813716] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T18:16:54.815417] [INFO ] [REMOTE ] CUBE: Full fetch complete (73032 records). [2025-10-01T18:16:54.815523] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-01T18:16:55.263202] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-01T18:16:55.263310] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-01T18:16:55.264395] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-01T18:16:55.264473] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-01T18:16:55.266162] [DEBUG] [LOCAL ] CUBE: Trimmed 73032 records to 50642 (keeping 200 days of data) [2025-10-01T18:16:55.325977] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-01T18:16:55.602850] [DEBUG] [LOCAL ] CUBE: Primary data saved (50642 records). [2025-10-01T18:16:55.603030] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-01T18:16:55.603133] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBE took 29.8s. Estimated remaining: 4h 10m 21s. Rate: 7.2 symbols/min [2025-10-01T18:16:56.057547] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T18:16:56.102372] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-01T18:16:56.174499] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T18:16:56.620064] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T18:16:56.902383] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-01T18:16:57.495761] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T18:16:57.702381] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-01T18:16:58.502375] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-01T18:16:58.596300] [DEBUG] [REMOTE ] CULP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:16:58.596611] [WARN ] [REMOTE ] CULP: No data returned for month 2025-10 [2025-10-01T18:16:58.596725] [FATAL] [REMOTE ] CULP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:16:58.596826] [FATAL] [MAIN ] CULP: Failed to fetch primary data. [2025-10-01T18:16:58.596896] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:16:58.596966] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-01T18:16:58.597032] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-01T18:16:58.597070] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-01T18:16:58.597429] [DEBUG] [LOCAL ] CULP: Deleted derivative data file. [2025-10-01T18:16:58.597515] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CULP took 16.0s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-01T18:16:59.302434] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-01T18:17:00.653017] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-01T18:17:00.664685] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-01T18:17:00.685030] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T18:17:00.902377] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-01T18:17:02.169144] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T18:17:02.176191] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-01T18:17:02.660707] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-01T18:17:02.671967] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-01T18:17:02.997888] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T18:17:03.302438] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-01T18:17:04.275850] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T18:17:04.286772] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-01T18:17:04.663046] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T18:17:04.902402] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-01T18:17:05.707772] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T18:17:05.718919] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-01T18:17:06.375775] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T18:17:06.502358] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-01T18:17:07.429821] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T18:17:07.442199] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-01T18:17:07.468896] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T18:17:08.102398] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-01T18:17:09.439414] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-01T18:17:09.462842] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T18:17:09.470130] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-01T18:17:09.702431] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-01T18:17:10.428938] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T18:17:10.502378] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-01T18:17:11.345113] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T18:17:11.356872] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-01T18:17:12.092607] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T18:17:12.102337] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-01T18:17:13.461857] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T18:17:13.469298] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-01T18:17:13.673780] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-01T18:17:13.675482] [INFO ] [REMOTE ] CUK: Full fetch complete (73907 records). [2025-10-01T18:17:13.675611] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-01T18:17:14.124077] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-01T18:17:14.124169] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-01T18:17:14.125079] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-01T18:17:14.125145] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-01T18:17:14.126703] [DEBUG] [LOCAL ] CUK: Trimmed 73907 records to 51001 (keeping 200 days of data) [2025-10-01T18:17:14.451317] [DEBUG] [LOCAL ] CUK: Primary data saved (51001 records). [2025-10-01T18:17:14.451478] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-01T18:17:14.451561] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CUK took 32.8s. Estimated remaining: 4h 10m 12s. Rate: 7.2 symbols/min [2025-10-01T18:17:14.935443] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-01T18:17:14.936807] [INFO ] [REMOTE ] CURB: Full fetch complete (47271 records). [2025-10-01T18:17:14.936910] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-01T18:17:15.361494] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-01T18:17:15.361574] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-01T18:17:15.362231] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-01T18:17:15.362294] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-01T18:17:15.363280] [DEBUG] [LOCAL ] CURB: Trimmed 47271 records to 32632 (keeping 200 days of data) [2025-10-01T18:17:15.580329] [DEBUG] [LOCAL ] CURB: Primary data saved (32632 records). [2025-10-01T18:17:15.580461] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-01T18:17:15.580550] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CURB took 30.6s. Estimated remaining: 4h 9m 40s. Rate: 7.3 symbols/min [2025-10-01T18:17:16.328210] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:17:16.452854] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:17:16.436195] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:17:16.457238] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-01T18:17:16.456880] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:17:16.457386] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-01T18:17:16.458258] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-01T18:17:16.458308] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-01T18:17:16.458354] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-01T18:17:16.458388] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-01T18:17:16.663712] [DEBUG] [LOCAL ] CURV: Loaded 26521 existing records from primary storage. [2025-10-01T18:17:16.747501] [INFO ] [MAIN ] CURV: Loaded 26521 existing records. [2025-10-01T18:17:16.926445] [DEBUG] [LOCAL ] CUZ: Loaded 49350 existing records from primary storage. [2025-10-01T18:17:16.938883] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-10-01T18:17:16.960577] [INFO ] [MAIN ] CVE: Loaded 53556 existing records. [2025-10-01T18:17:16.954719] [INFO ] [MAIN ] CUZ: Loaded 49350 existing records. [2025-10-01T18:17:17.264127] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:17:17.382293] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-01T18:17:17.460216] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:17:17.471274] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-01T18:17:17.489016] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-01T18:17:17.517975] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:17:17.528437] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-01T18:17:17.546265] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-01T18:17:17.551484] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-01T18:17:17.551539] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-01T18:17:17.562067] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-01T18:17:17.596803] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-01T18:17:17.591496] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:17:17.615820] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-01T18:17:17.679515] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-01T18:17:17.779187] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-01T18:17:17.801805] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-01T18:17:18.676579] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T18:17:18.706460] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:17:18.740033] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-01T18:17:18.752745] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-01T18:17:18.872146] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:17:18.872566] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-01T18:17:18.864474] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:17:18.873823] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-01T18:17:19.589358] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T18:17:19.591789] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-01T18:17:20.283223] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T18:17:20.293410] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-01T18:17:20.417267] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T18:17:20.424581] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-01T18:17:20.439974] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-01T18:17:20.442206] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-01T18:17:20.850006] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-01T18:17:20.902449] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-01T18:17:21.096190] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T18:17:21.305920] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T18:17:21.702361] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-01T18:17:21.761509] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T18:17:22.510858] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-01T18:17:22.518930] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T18:17:22.727937] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T18:17:23.302406] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-01T18:17:23.612482] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T18:17:24.102414] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-01T18:17:24.755460] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T18:17:24.810595] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T18:17:24.902380] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-01T18:17:25.587515] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T18:17:25.702406] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-01T18:17:26.502424] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-01T18:17:26.895802] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T18:17:27.230304] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T18:17:27.302399] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-01T18:17:28.102399] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-01T18:17:28.904702] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-01T18:17:28.908373] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T18:17:29.056693] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T18:17:29.702403] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-01T18:17:30.502366] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-01T18:17:30.568219] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T18:17:31.242010] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T18:17:31.302368] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-01T18:17:31.373379] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T18:17:32.102465] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-01T18:17:32.487393] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T18:17:32.902377] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-01T18:17:33.661709] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T18:17:33.702364] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-01T18:17:33.846368] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T18:17:34.502414] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-01T18:17:34.826038] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T18:17:35.121955] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-01T18:17:35.302463] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-01T18:17:36.102472] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-01T18:17:36.107904] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T18:17:36.902425] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-01T18:17:37.468165] [DEBUG] [REMOTE ] CVEO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:17:37.468524] [WARN ] [REMOTE ] CVEO: No data returned for month 2025-10 [2025-10-01T18:17:37.468694] [FATAL] [REMOTE ] CVEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:17:37.468833] [FATAL] [MAIN ] CVEO: Failed to fetch primary data. [2025-10-01T18:17:37.468930] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:17:37.469044] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-01T18:17:37.469219] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-01T18:17:37.469292] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-01T18:17:37.469396] [DEBUG] [LOCAL ] CVEO: No derivative data file found to delete. [2025-10-01T18:17:37.469564] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 21.9s. Estimated remaining: 4h 10m 16s. Rate: 7.2 symbols/min [2025-10-01T18:17:37.662507] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:17:37.708296] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-01T18:17:37.712795] [DEBUG] [LOCAL ] CVI: Loaded 46463 existing records from primary storage. [2025-10-01T18:17:37.713327] [INFO ] [MAIN ] CVI: Loaded 46463 existing records. [2025-10-01T18:17:37.914488] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:17:37.914880] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-01T18:17:37.915035] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-01T18:17:37.915420] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-01T18:17:37.915489] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-01T18:17:38.344837] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:17:38.347446] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-01T18:17:38.502364] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-01T18:17:38.637205] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T18:17:39.302406] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-01T18:17:40.102412] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-01T18:17:40.423912] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T18:17:40.862365] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T18:17:40.902373] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-01T18:17:41.300811] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T18:17:41.702394] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-01T18:17:42.502451] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-01T18:17:42.877314] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-01T18:17:42.879246] [INFO ] [REMOTE ] CURV: Full fetch complete (39120 records). [2025-10-01T18:17:42.879386] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-01T18:17:43.283148] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-01T18:17:43.283266] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-01T18:17:43.284231] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-01T18:17:43.284297] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-01T18:17:43.285508] [DEBUG] [LOCAL ] CURV: Trimmed 39120 records to 26720 (keeping 200 days of data) [2025-10-01T18:17:43.332093] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-01T18:17:43.462044] [DEBUG] [LOCAL ] CURV: Primary data saved (26720 records). [2025-10-01T18:17:43.462232] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-01T18:17:43.462372] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 27.9s. Estimated remaining: 4h 10m 0s. Rate: 7.2 symbols/min [2025-10-01T18:17:43.672902] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:17:43.688361] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T18:17:43.715315] [DEBUG] [LOCAL ] CVLG: Loaded 15513 existing records from primary storage. [2025-10-01T18:17:43.715677] [INFO ] [MAIN ] CVLG: Loaded 15513 existing records. [2025-10-01T18:17:43.910045] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:17:43.910367] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-01T18:17:43.910424] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-01T18:17:43.911202] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-01T18:17:43.911265] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-01T18:17:44.119486] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-01T18:17:44.314471] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:17:44.353562] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T18:17:44.838783] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T18:17:44.902391] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-01T18:17:45.712113] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-01T18:17:45.718347] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T18:17:46.324059] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T18:17:46.502417] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-01T18:17:47.302368] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-01T18:17:47.341093] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T18:17:47.516747] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T18:17:48.102404] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-01T18:17:48.907532] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-01T18:17:48.920310] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T18:17:49.702390] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-01T18:17:49.911724] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T18:17:49.955444] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T18:17:50.502408] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-01T18:17:51.302422] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-01T18:17:51.533864] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T18:17:51.898774] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T18:17:52.102376] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-01T18:17:52.161094] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T18:17:52.902387] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-01T18:17:53.702410] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-01T18:17:53.799231] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T18:17:53.913100] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-01T18:17:53.915041] [INFO ] [REMOTE ] CUZ: Full fetch complete (70807 records). [2025-10-01T18:17:53.915185] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-01T18:17:54.322319] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-01T18:17:54.322510] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-01T18:17:54.323797] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-01T18:17:54.323873] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-01T18:17:54.325951] [DEBUG] [LOCAL ] CUZ: Trimmed 70807 records to 49353 (keeping 200 days of data) [2025-10-01T18:17:54.513869] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-01T18:17:54.647198] [DEBUG] [LOCAL ] CUZ: Primary data saved (49353 records). [2025-10-01T18:17:54.647381] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-01T18:17:54.647505] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 39.1s. Estimated remaining: 4h 10m 1s. Rate: 7.2 symbols/min [2025-10-01T18:17:54.819944] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:17:54.880399] [DEBUG] [LOCAL ] CVNA: Loaded 52980 existing records from primary storage. [2025-10-01T18:17:54.880893] [INFO ] [MAIN ] CVNA: Loaded 52980 existing records. [2025-10-01T18:17:55.066734] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:17:55.067132] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-01T18:17:55.067194] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-01T18:17:55.068605] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-01T18:17:55.068692] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-01T18:17:55.310850] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-01T18:17:55.460301] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:17:55.491967] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T18:17:55.553182] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T18:17:56.102417] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-01T18:17:56.902428] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-01T18:17:57.170960] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T18:17:57.284506] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T18:17:57.702426] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-01T18:17:58.502380] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-01T18:17:58.612062] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T18:17:59.302431] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-01T18:17:59.688484] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T18:17:59.894847] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-01T18:17:59.897003] [INFO ] [REMOTE ] CVE: Full fetch complete (77558 records). [2025-10-01T18:17:59.897149] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-01T18:18:00.113137] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-01T18:18:00.353260] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-01T18:18:00.353417] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-01T18:18:00.354995] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-01T18:18:00.355101] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-01T18:18:00.357749] [DEBUG] [LOCAL ] CVE: Trimmed 77558 records to 53556 (keeping 200 days of data) [2025-10-01T18:18:00.783958] [DEBUG] [LOCAL ] CVE: Primary data saved (53556 records). [2025-10-01T18:18:00.784311] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-01T18:18:00.784454] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 45.2s. Estimated remaining: 4h 9m 46s. Rate: 7.2 symbols/min [2025-10-01T18:18:00.913223] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-01T18:18:00.980068] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:18:01.065592] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T18:18:01.102238] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-01T18:18:01.102838] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-10-01T18:18:01.293155] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:18:01.293553] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-01T18:18:01.293612] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-01T18:18:01.295637] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-01T18:18:01.295751] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-01T18:18:01.711951] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:18:01.712099] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-01T18:18:01.744700] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T18:18:02.053797] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T18:18:02.502417] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-01T18:18:03.278149] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T18:18:03.302381] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-01T18:18:03.808297] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-01T18:18:04.102351] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-01T18:18:04.305807] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T18:18:04.902401] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-01T18:18:05.702477] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-01T18:18:05.885623] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T18:18:06.000857] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-01T18:18:06.001757] [INFO ] [REMOTE ] CVLG: Full fetch complete (20903 records). [2025-10-01T18:18:06.001867] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-01T18:18:06.413927] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-01T18:18:06.414028] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-01T18:18:06.414477] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-01T18:18:06.414548] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-01T18:18:06.415301] [DEBUG] [LOCAL ] CVLG: Trimmed 20903 records to 15428 (keeping 200 days of data) [2025-10-01T18:18:06.502548] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-01T18:18:06.517933] [DEBUG] [LOCAL ] CVLG: Primary data saved (15428 records). [2025-10-01T18:18:06.518095] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-01T18:18:06.518184] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 23.1s. Estimated remaining: 4h 9m 29s. Rate: 7.2 symbols/min [2025-10-01T18:18:06.754621] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:18:06.819957] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-01T18:18:06.820298] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-01T18:18:07.014874] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:18:07.015149] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-01T18:18:07.015199] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-01T18:18:07.015841] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-01T18:18:07.015905] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-01T18:18:07.304473] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-01T18:18:07.434368] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:18:07.468233] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T18:18:08.102396] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-01T18:18:08.174125] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T18:18:08.902387] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-01T18:18:09.419782] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T18:18:09.702443] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-01T18:18:10.242982] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T18:18:10.287118] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-01T18:18:10.502418] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-01T18:18:11.302407] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-01T18:18:11.553973] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T18:18:12.102467] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-01T18:18:12.240520] [DEBUG] [REMOTE ] CVI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:18:12.240958] [WARN ] [REMOTE ] CVI: No data returned for month 2025-10 [2025-10-01T18:18:12.241073] [FATAL] [REMOTE ] CVI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:18:12.241193] [FATAL] [MAIN ] CVI: Failed to fetch primary data. [2025-10-01T18:18:12.241280] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:18:12.241377] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-01T18:18:12.241488] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-01T18:18:12.241546] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-01T18:18:12.242230] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-01T18:18:12.242345] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 34.8s. Estimated remaining: 4h 9m 13s. Rate: 7.2 symbols/min [2025-10-01T18:18:12.534378] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:18:12.588916] [DEBUG] [LOCAL ] CW: Loaded 22254 existing records from primary storage. [2025-10-01T18:18:12.590113] [INFO ] [MAIN ] CW: Loaded 22254 existing records. [2025-10-01T18:18:12.878804] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:18:12.879083] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-01T18:18:12.879314] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-01T18:18:12.880414] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-01T18:18:12.880484] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-01T18:18:12.906814] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-01T18:18:13.114834] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-01T18:18:13.424333] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:18:13.702401] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-01T18:18:14.212436] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-01T18:18:14.502397] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-01T18:18:14.570268] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T18:18:15.242967] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-01T18:18:15.302365] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-01T18:18:16.102415] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-01T18:18:16.568780] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-01T18:18:16.902374] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-01T18:18:17.107209] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T18:18:17.289967] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-01T18:18:17.702437] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-01T18:18:18.502400] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-01T18:18:18.972578] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-01T18:18:19.076822] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T18:18:19.302424] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-01T18:18:20.102383] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-01T18:18:20.617497] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-01T18:18:20.651761] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T18:18:20.902386] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-01T18:18:21.702438] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-01T18:18:22.234372] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-01T18:18:22.502395] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-01T18:18:23.264788] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-01T18:18:23.302346] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-01T18:18:23.875174] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-01T18:18:24.102395] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-01T18:18:24.844387] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-01T18:18:24.902367] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-01T18:18:25.069062] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T18:18:25.371051] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-01T18:18:25.702434] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-01T18:18:26.502432] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-01T18:18:27.023919] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T18:18:27.204838] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-01T18:18:27.302431] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-01T18:18:28.102358] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-01T18:18:28.207321] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T18:18:28.576288] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T18:18:28.902391] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-01T18:18:29.702390] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-01T18:18:30.344313] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-01T18:18:30.502442] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-01T18:18:30.671868] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T18:18:30.799434] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T18:18:31.302392] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-01T18:18:32.102409] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-01T18:18:32.902368] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-01T18:18:32.956546] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-01T18:18:33.255448] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T18:18:33.654452] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T18:18:33.702384] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-01T18:18:34.031184] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T18:18:34.502401] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-01T18:18:34.704022] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T18:18:35.302394] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-01T18:18:36.102357] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-01T18:18:36.160631] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T18:18:36.817107] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T18:18:36.818555] [INFO ] [REMOTE ] CW: Full fetch complete (33395 records). [2025-10-01T18:18:36.818690] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-01T18:18:36.907457] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-01T18:18:37.258128] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-01T18:18:37.258220] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-01T18:18:37.258774] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-01T18:18:37.258839] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-01T18:18:37.259802] [DEBUG] [LOCAL ] CW: Trimmed 33395 records to 22276 (keeping 200 days of data) [2025-10-01T18:18:37.416497] [DEBUG] [LOCAL ] CW: Primary data saved (22276 records). [2025-10-01T18:18:37.416630] [INFO ] [MAIN ] CW: Full history saved. [2025-10-01T18:18:37.416754] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CW took 25.2s. Estimated remaining: 4h 9m 58s. Rate: 7.2 symbols/min [2025-10-01T18:18:37.611300] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:18:37.668438] [DEBUG] [LOCAL ] CWAN: Loaded 52400 existing records from primary storage. [2025-10-01T18:18:37.668819] [INFO ] [MAIN ] CWAN: Loaded 52400 existing records. [2025-10-01T18:18:37.716047] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-01T18:18:37.892050] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:18:37.892426] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-01T18:18:37.892482] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-01T18:18:37.892828] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-01T18:18:37.892888] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-01T18:18:38.305077] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:18:38.353116] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-01T18:18:38.502385] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-01T18:18:38.761262] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-01T18:18:39.302445] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-01T18:18:39.752457] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-01T18:18:39.956959] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T18:18:40.102386] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-01T18:18:40.902377] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-01T18:18:41.370182] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T18:18:41.702392] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-01T18:18:42.098532] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.80 seconds). [2025-10-01T18:18:42.100120] [INFO ] [REMOTE ] CVNA: Full fetch complete (76667 records). [2025-10-01T18:18:42.100223] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-01T18:18:42.503674] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-01T18:18:42.528481] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-01T18:18:42.528569] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-01T18:18:42.529448] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-01T18:18:42.529516] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-01T18:18:42.530986] [DEBUG] [LOCAL ] CVNA: Trimmed 76667 records to 52972 (keeping 200 days of data) [2025-10-01T18:18:42.870338] [DEBUG] [LOCAL ] CVNA: Primary data saved (52972 records). [2025-10-01T18:18:42.870480] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-01T18:18:42.870580] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVNA took 48.2s. Estimated remaining: 4h 9m 41s. Rate: 7.2 symbols/min [2025-10-01T18:18:43.073321] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:18:43.120444] [DEBUG] [LOCAL ] CWEN: Loaded 44975 existing records from primary storage. [2025-10-01T18:18:43.120871] [INFO ] [MAIN ] CWEN: Loaded 44975 existing records. [2025-10-01T18:18:43.328085] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:18:43.328372] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-01T18:18:43.328482] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-01T18:18:43.329002] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-01T18:18:43.329065] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-01T18:18:43.467480] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-01T18:18:43.524361] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-01T18:18:43.807611] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:18:43.837485] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T18:18:44.051378] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-01T18:18:44.053098] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-10-01T18:18:44.053208] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-01T18:18:44.107515] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-01T18:18:44.494695] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-01T18:18:44.494805] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-01T18:18:44.495795] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-01T18:18:44.495863] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-01T18:18:44.497568] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 53696 (keeping 200 days of data) [2025-10-01T18:18:44.849968] [DEBUG] [LOCAL ] CVS: Primary data saved (53696 records). [2025-10-01T18:18:44.850108] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-01T18:18:44.850207] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVS took 44.1s. Estimated remaining: 4h 9m 13s. Rate: 7.2 symbols/min [2025-10-01T18:18:44.914502] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-01T18:18:45.047118] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:18:45.105195] [DEBUG] [LOCAL ] CWH: Loaded 51357 existing records from primary storage. [2025-10-01T18:18:45.105528] [INFO ] [MAIN ] CWH: Loaded 51357 existing records. [2025-10-01T18:18:45.214072] [DEBUG] [REMOTE ] CVX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:18:45.217208] [WARN ] [REMOTE ] CVX: No data returned for month 2025-10 [2025-10-01T18:18:45.228289] [FATAL] [REMOTE ] CVX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:18:45.238759] [FATAL] [MAIN ] CVX: Failed to fetch primary data. [2025-10-01T18:18:45.249144] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:18:45.261112] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-01T18:18:45.282477] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-01T18:18:45.298218] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-10-01T18:18:45.303752] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:18:45.304010] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-01T18:18:45.304059] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-01T18:18:45.304471] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-10-01T18:18:45.306104] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-01T18:18:45.306050] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 38.8s. Estimated remaining: 4h 8m 40s. Rate: 7.2 symbols/min [2025-10-01T18:18:45.306272] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-01T18:18:45.674041] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:18:45.965234] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:18:45.965751] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-01T18:18:46.003455] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T18:18:46.029261] [DEBUG] [LOCAL ] CWK: Loaded 49415 existing records from primary storage. [2025-10-01T18:18:46.029689] [INFO ] [MAIN ] CWK: Loaded 49415 existing records. [2025-10-01T18:18:46.229925] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:18:46.230158] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-01T18:18:46.230208] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-01T18:18:46.231819] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-01T18:18:46.231881] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-01T18:18:46.503128] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-01T18:18:46.646805] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:18:46.685204] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T18:18:47.302376] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-01T18:18:47.876182] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-01T18:18:48.102380] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-01T18:18:48.225125] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T18:18:48.902359] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-01T18:18:49.004661] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T18:18:49.702384] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-01T18:18:49.847447] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T18:18:50.149696] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T18:18:50.502379] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-01T18:18:51.152442] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T18:18:51.302384] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-01T18:18:52.107500] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-01T18:18:52.125065] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T18:18:52.902372] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-01T18:18:53.025819] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T18:18:53.702403] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-01T18:18:53.811144] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T18:18:54.276974] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T18:18:54.502436] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-01T18:18:55.222039] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T18:18:55.302405] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-01T18:18:55.874405] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T18:18:56.102391] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-01T18:18:56.753630] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T18:18:56.902368] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-01T18:18:57.704224] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-01T18:18:57.707231] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T18:18:58.502385] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-01T18:18:58.849666] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T18:18:59.302372] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-01T18:18:59.530161] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T18:19:00.102435] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-01T18:19:00.371501] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T18:19:00.902374] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-01T18:19:01.128012] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T18:19:01.702453] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-01T18:19:02.012048] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T18:19:02.322880] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T18:19:02.502377] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-01T18:19:03.302378] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-01T18:19:03.432195] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T18:19:03.750423] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T18:19:04.102435] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-01T18:19:04.770800] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T18:19:04.902389] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-01T18:19:05.625397] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T18:19:05.702385] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-01T18:19:06.043161] [DEBUG] [REMOTE ] CWAN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:19:06.043502] [WARN ] [REMOTE ] CWAN: No data returned for month 2025-10 [2025-10-01T18:19:06.043594] [FATAL] [REMOTE ] CWAN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:19:06.043719] [FATAL] [MAIN ] CWAN: Failed to fetch primary data. [2025-10-01T18:19:06.043788] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:19:06.043861] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-01T18:19:06.043925] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-01T18:19:06.043962] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-10-01T18:19:06.044426] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-10-01T18:19:06.044519] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWAN took 28.6s. Estimated remaining: 4h 9m 11s. Rate: 7.2 symbols/min [2025-10-01T18:19:06.231057] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:06.262131] [DEBUG] [LOCAL ] CWT: Loaded 27865 existing records from primary storage. [2025-10-01T18:19:06.262421] [INFO ] [MAIN ] CWT: Loaded 27865 existing records. [2025-10-01T18:19:06.456202] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:06.456435] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-01T18:19:06.456483] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-01T18:19:06.457113] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-01T18:19:06.457174] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-01T18:19:06.507498] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-01T18:19:06.889765] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:07.279861] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T18:19:07.302357] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-01T18:19:07.564043] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T18:19:08.102425] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-01T18:19:08.712761] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T18:19:08.902354] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-01T18:19:09.265055] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T18:19:09.702390] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-01T18:19:10.461993] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T18:19:10.502373] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-01T18:19:10.992339] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T18:19:11.302419] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-01T18:19:12.102379] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-01T18:19:12.168308] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T18:19:12.902606] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-01T18:19:13.166199] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T18:19:13.648785] [DEBUG] [REMOTE ] CWEN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:19:13.649061] [WARN ] [REMOTE ] CWEN: No data returned for month 2025-10 [2025-10-01T18:19:13.649154] [FATAL] [REMOTE ] CWEN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:19:13.649244] [FATAL] [MAIN ] CWEN: Failed to fetch primary data. [2025-10-01T18:19:13.649284] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:19:13.649325] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-01T18:19:13.649380] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-01T18:19:13.649418] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-01T18:19:13.649789] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-10-01T18:19:13.649890] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWEN took 30.8s. Estimated remaining: 4h 9m 0s. Rate: 7.2 symbols/min [2025-10-01T18:19:13.711133] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-01T18:19:13.874374] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:13.929908] [DEBUG] [LOCAL ] CX: Loaded 52828 existing records from primary storage. [2025-10-01T18:19:13.930327] [INFO ] [MAIN ] CX: Loaded 52828 existing records. [2025-10-01T18:19:14.120871] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:14.121148] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-01T18:19:14.121213] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-01T18:19:14.122391] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-01T18:19:14.122462] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-01T18:19:14.509790] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-01T18:19:14.516189] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:14.663795] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T18:19:15.302399] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-01T18:19:15.434699] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T18:19:15.584572] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T18:19:16.102395] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-01T18:19:16.680325] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T18:19:16.902403] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-01T18:19:17.702374] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-01T18:19:17.775620] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T18:19:18.502398] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-01T18:19:18.840771] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T18:19:18.842269] [INFO ] [REMOTE ] CWK: Full fetch complete (70958 records). [2025-10-01T18:19:18.842360] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-01T18:19:19.291894] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-01T18:19:19.292160] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-01T18:19:19.293148] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-01T18:19:19.293235] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-01T18:19:19.303966] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-01T18:19:19.325008] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T18:19:19.323698] [DEBUG] [LOCAL ] CWK: Trimmed 70958 records to 49410 (keeping 200 days of data) [2025-10-01T18:19:19.640095] [DEBUG] [LOCAL ] CWK: Primary data saved (49410 records). [2025-10-01T18:19:19.640235] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-01T18:19:19.640322] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWK took 34.3s. Estimated remaining: 4h 8m 44s. Rate: 7.2 symbols/min [2025-10-01T18:19:19.848406] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:19.857263] [DEBUG] [LOCAL ] CXE: Loaded 6726 existing records from primary storage. [2025-10-01T18:19:19.857471] [INFO ] [MAIN ] CXE: Loaded 6726 existing records. [2025-10-01T18:19:20.069245] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:20.069574] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-01T18:19:20.069731] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-01T18:19:20.070108] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-01T18:19:20.070170] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-01T18:19:20.106119] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-01T18:19:20.375218] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T18:19:20.545213] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:20.680373] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:19:20.902412] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-01T18:19:21.702417] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-01T18:19:21.949441] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T18:19:21.949064] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T18:19:22.502384] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-01T18:19:22.801664] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T18:19:23.048123] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T18:19:23.302396] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-01T18:19:24.044085] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T18:19:24.102382] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-01T18:19:24.902418] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-01T18:19:25.517537] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T18:19:25.702438] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-01T18:19:26.108920] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T18:19:26.502379] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-01T18:19:26.539198] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T18:19:27.302407] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-01T18:19:28.102415] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-01T18:19:28.829004] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T18:19:28.902442] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-01T18:19:28.940177] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-01T18:19:28.941747] [INFO ] [REMOTE ] CWH: Full fetch complete (72955 records). [2025-10-01T18:19:28.941858] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-01T18:19:29.378876] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-01T18:19:29.379080] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-01T18:19:29.380080] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-01T18:19:29.380148] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-01T18:19:29.381874] [DEBUG] [LOCAL ] CWH: Trimmed 72955 records to 51374 (keeping 200 days of data) [2025-10-01T18:19:29.608078] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T18:19:29.703230] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-01T18:19:29.725564] [DEBUG] [LOCAL ] CWH: Primary data saved (51374 records). [2025-10-01T18:19:29.725748] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-01T18:19:29.725861] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWH took 44.9s. Estimated remaining: 4h 8m 42s. Rate: 7.2 symbols/min [2025-10-01T18:19:29.923395] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:29.929943] [DEBUG] [LOCAL ] CXH: Loaded 4412 existing records from primary storage. [2025-10-01T18:19:29.930129] [INFO ] [MAIN ] CXH: Loaded 4412 existing records. [2025-10-01T18:19:30.136424] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:30.136890] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-01T18:19:30.136997] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-01T18:19:30.155294] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-01T18:19:30.170894] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-01T18:19:30.196737] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-10-01T18:19:30.282410] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-01T18:19:30.507522] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-01T18:19:30.614355] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:31.302407] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-01T18:19:31.658592] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T18:19:32.102432] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-01T18:19:32.908586] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-01T18:19:32.929914] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T18:19:33.059202] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T18:19:33.632770] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T18:19:33.702424] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-01T18:19:34.502384] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-01T18:19:35.105507] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T18:19:35.181783] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T18:19:35.302384] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-01T18:19:36.102406] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-01T18:19:36.581959] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T18:19:36.612383] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T18:19:36.902379] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-01T18:19:37.702375] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-01T18:19:38.190377] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-01T18:19:38.502362] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-01T18:19:38.773334] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T18:19:39.302385] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-01T18:19:39.655367] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T18:19:40.102372] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-01T18:19:40.909078] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-01T18:19:40.930798] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T18:19:41.356178] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T18:19:41.552561] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T18:19:41.702403] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-01T18:19:42.502377] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-01T18:19:43.153385] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T18:19:43.302370] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-01T18:19:43.616742] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T18:19:43.617887] [INFO ] [REMOTE ] CWT: Full fetch complete (40390 records). [2025-10-01T18:19:43.617972] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-01T18:19:44.020247] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-01T18:19:44.020334] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-01T18:19:44.021016] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-01T18:19:44.021080] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-01T18:19:44.022003] [DEBUG] [LOCAL ] CWT: Trimmed 40390 records to 27897 (keeping 200 days of data) [2025-10-01T18:19:44.115146] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-01T18:19:44.203755] [DEBUG] [LOCAL ] CWT: Primary data saved (27897 records). [2025-10-01T18:19:44.203894] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-01T18:19:44.203978] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWT took 38.2s. Estimated remaining: 4h 8m 53s. Rate: 7.2 symbols/min [2025-10-01T18:19:44.399170] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:44.445396] [DEBUG] [LOCAL ] CXM: Loaded 47695 existing records from primary storage. [2025-10-01T18:19:44.445743] [INFO ] [MAIN ] CXM: Loaded 47695 existing records. [2025-10-01T18:19:44.654221] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:44.654742] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-01T18:19:44.654820] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-01T18:19:44.655907] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-01T18:19:44.655996] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-01T18:19:44.913598] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T18:19:44.906165] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-01T18:19:45.087728] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:45.119768] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T18:19:45.508806] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T18:19:45.702374] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-01T18:19:46.112562] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-01T18:19:46.502379] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-01T18:19:47.302384] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-01T18:19:48.109184] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-01T18:19:48.114952] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T18:19:48.320312] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T18:19:48.321310] [INFO ] [REMOTE ] CXE: Full fetch complete (11917 records). [2025-10-01T18:19:48.321381] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-01T18:19:48.713979] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T18:19:48.763368] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-01T18:19:48.763460] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-01T18:19:48.763803] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-01T18:19:48.763866] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-01T18:19:48.764410] [DEBUG] [LOCAL ] CXE: Trimmed 11917 records to 6571 (keeping 200 days of data) [2025-10-01T18:19:48.805178] [DEBUG] [LOCAL ] CXE: Primary data saved (6571 records). [2025-10-01T18:19:48.805313] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-01T18:19:48.805461] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXE took 29.2s. Estimated remaining: 4h 8m 33s. Rate: 7.2 symbols/min [2025-10-01T18:19:48.907495] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-01T18:19:48.999013] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:49.033091] [DEBUG] [LOCAL ] CXT: Loaded 30998 existing records from primary storage. [2025-10-01T18:19:49.033387] [INFO ] [MAIN ] CXT: Loaded 30998 existing records. [2025-10-01T18:19:49.235912] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:49.236198] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-01T18:19:49.236262] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-01T18:19:49.237258] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-01T18:19:49.237331] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-01T18:19:49.639459] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:49.702372] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-01T18:19:50.502389] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-01T18:19:51.046112] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T18:19:51.302407] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-01T18:19:51.340052] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-01T18:19:51.341761] [INFO ] [REMOTE ] CX: Full fetch complete (76390 records). [2025-10-01T18:19:51.341872] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-01T18:19:51.795043] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-01T18:19:51.795245] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-01T18:19:51.796261] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-01T18:19:51.796363] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-01T18:19:51.798134] [DEBUG] [LOCAL ] CX: Trimmed 76390 records to 52827 (keeping 200 days of data) [2025-10-01T18:19:52.056978] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T18:19:52.125101] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-01T18:19:52.196307] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T18:19:52.209113] [DEBUG] [LOCAL ] CX: Primary data saved (52827 records). [2025-10-01T18:19:52.209287] [INFO ] [MAIN ] CX: Full history saved. [2025-10-01T18:19:52.209387] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CX took 38.6s. Estimated remaining: 4h 8m 9s. Rate: 7.2 symbols/min [2025-10-01T18:19:52.395557] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:52.439444] [DEBUG] [LOCAL ] CXW: Loaded 44024 existing records from primary storage. [2025-10-01T18:19:52.439774] [INFO ] [MAIN ] CXW: Loaded 44024 existing records. [2025-10-01T18:19:52.636789] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:52.637050] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-01T18:19:52.637107] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-01T18:19:52.637629] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-01T18:19:52.637724] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-01T18:19:52.908439] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-01T18:19:52.968419] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T18:19:53.056504] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:53.702393] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-01T18:19:54.064710] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-01T18:19:54.437198] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:19:54.502436] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-01T18:19:55.120397] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T18:19:55.302400] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-01T18:19:56.102437] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-01T18:19:56.602020] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T18:19:56.902461] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-01T18:19:57.147633] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T18:19:57.152003] [INFO ] [REMOTE ] CXH: Full fetch complete (5472 records). [2025-10-01T18:19:57.152213] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-01T18:19:57.565071] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-01T18:19:57.565153] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-01T18:19:57.565335] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-01T18:19:57.565381] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-01T18:19:57.565931] [DEBUG] [LOCAL ] CXH: Trimmed 5472 records to 4413 (keeping 200 days of data) [2025-10-01T18:19:57.595040] [DEBUG] [LOCAL ] CXH: Primary data saved (4413 records). [2025-10-01T18:19:57.595215] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-01T18:19:57.595316] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 27.9s. Estimated remaining: 4h 7m 52s. Rate: 7.2 symbols/min [2025-10-01T18:19:57.708748] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-01T18:19:57.788611] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:19:57.819138] [DEBUG] [LOCAL ] CYD: Loaded 26499 existing records from primary storage. [2025-10-01T18:19:57.819434] [INFO ] [MAIN ] CYD: Loaded 26499 existing records. [2025-10-01T18:19:58.015979] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:19:58.016215] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-01T18:19:58.016342] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-01T18:19:58.016932] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-01T18:19:58.016995] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-01T18:19:58.422002] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:19:58.442315] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T18:19:58.502360] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-01T18:19:59.174966] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T18:19:59.302377] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-01T18:19:59.554459] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T18:20:00.102439] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-01T18:20:00.615883] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T18:20:00.631366] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-01T18:20:00.902398] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-01T18:20:01.634419] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T18:20:01.702394] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-01T18:20:02.502450] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-01T18:20:03.209275] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T18:20:03.302393] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-01T18:20:04.102415] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-01T18:20:04.258541] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T18:20:04.901601] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T18:20:04.910384] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-01T18:20:05.708944] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-01T18:20:05.716091] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T18:20:05.977226] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T18:20:06.502349] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-01T18:20:06.912734] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:20:07.302389] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-01T18:20:07.975421] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T18:20:08.102394] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-01T18:20:08.505512] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T18:20:08.902437] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-01T18:20:09.493403] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T18:20:09.702402] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-01T18:20:10.502399] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-01T18:20:10.545796] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T18:20:11.049466] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T18:20:11.302454] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-01T18:20:11.654680] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T18:20:12.102427] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-01T18:20:12.893218] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T18:20:12.902951] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-01T18:20:13.577011] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T18:20:13.702375] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-01T18:20:14.502456] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-01T18:20:14.579202] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T18:20:14.827096] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T18:20:15.302390] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-01T18:20:15.950893] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T18:20:16.102402] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-01T18:20:16.876026] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T18:20:16.902379] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-01T18:20:16.973009] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T18:20:17.702400] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-01T18:20:18.136927] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T18:20:18.502391] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-01T18:20:19.189937] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T18:20:19.302402] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-01T18:20:19.680962] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T18:20:20.102432] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-01T18:20:20.902392] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-01T18:20:20.977331] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T18:20:21.431134] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T18:20:21.702400] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-01T18:20:22.502453] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-01T18:20:22.522189] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-01T18:20:22.523793] [INFO ] [REMOTE ] CXT: Full fetch complete (45423 records). [2025-10-01T18:20:22.523919] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-01T18:20:22.941816] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-01T18:20:22.941907] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-01T18:20:22.942586] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-01T18:20:22.942632] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-01T18:20:22.943827] [DEBUG] [LOCAL ] CXT: Trimmed 45423 records to 30989 (keeping 200 days of data) [2025-10-01T18:20:23.151813] [DEBUG] [LOCAL ] CXT: Primary data saved (30989 records). [2025-10-01T18:20:23.152119] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-01T18:20:23.152225] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXT took 34.3s. Estimated remaining: 4h 8m 37s. Rate: 7.2 symbols/min [2025-10-01T18:20:23.310545] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-01T18:20:23.349361] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:20:23.401420] [DEBUG] [LOCAL ] CYH: Loaded 47503 existing records from primary storage. [2025-10-01T18:20:23.401858] [INFO ] [MAIN ] CYH: Loaded 47503 existing records. [2025-10-01T18:20:23.608020] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:20:23.608343] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-01T18:20:23.608407] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-01T18:20:23.609235] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-01T18:20:23.609298] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-01T18:20:23.785806] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-01T18:20:23.818450] [INFO ] [REMOTE ] CXM: Full fetch complete (68797 records). [2025-10-01T18:20:23.827378] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-01T18:20:24.132398] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:20:24.176826] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-01T18:20:24.322741] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T18:20:24.522466] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-01T18:20:24.522755] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-01T18:20:24.523733] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-01T18:20:24.523941] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-01T18:20:24.542611] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T18:20:24.549605] [DEBUG] [LOCAL ] CXM: Trimmed 68797 records to 47646 (keeping 200 days of data) [2025-10-01T18:20:24.837091] [DEBUG] [LOCAL ] CXM: Primary data saved (47646 records). [2025-10-01T18:20:24.837239] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-01T18:20:24.837339] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXM took 40.6s. Estimated remaining: 4h 8m 8s. Rate: 7.2 symbols/min [2025-10-01T18:20:24.907574] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-01T18:20:25.028921] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:20:25.083352] [DEBUG] [LOCAL ] D: Loaded 53645 existing records from primary storage. [2025-10-01T18:20:25.083706] [INFO ] [MAIN ] D: Loaded 53645 existing records. [2025-10-01T18:20:25.278240] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:20:25.278505] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-01T18:20:25.278564] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-01T18:20:25.279061] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-01T18:20:25.279121] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-01T18:20:25.696860] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:20:25.702360] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-01T18:20:25.827637] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T18:20:25.893401] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T18:20:26.502369] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-01T18:20:26.985015] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T18:20:27.302421] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-01T18:20:28.102368] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-01T18:20:28.231825] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T18:20:28.902383] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-01T18:20:29.014167] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T18:20:29.702394] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-01T18:20:30.128129] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-01T18:20:30.129730] [INFO ] [REMOTE ] CXW: Full fetch complete (64854 records). [2025-10-01T18:20:30.129936] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-01T18:20:30.506538] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-01T18:20:30.583842] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-01T18:20:30.584035] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-01T18:20:30.584839] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-01T18:20:30.584930] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-01T18:20:30.613507] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T18:20:30.613668] [DEBUG] [LOCAL ] CXW: Trimmed 64854 records to 44030 (keeping 200 days of data) [2025-10-01T18:20:30.891736] [DEBUG] [LOCAL ] CXW: Primary data saved (44030 records). [2025-10-01T18:20:30.891881] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-01T18:20:30.891968] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXW took 38.7s. Estimated remaining: 4h 7m 53s. Rate: 7.2 symbols/min [2025-10-01T18:20:31.080324] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:20:31.097598] [DEBUG] [LOCAL ] DAC: Loaded 12536 existing records from primary storage. [2025-10-01T18:20:31.097931] [INFO ] [MAIN ] DAC: Loaded 12536 existing records. [2025-10-01T18:20:31.301958] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:20:31.302381] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-01T18:20:31.303423] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-01T18:20:31.304298] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-01T18:20:31.305129] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-01T18:20:31.305219] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-01T18:20:31.500519] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T18:20:31.567342] [INFO ] [REMOTE ] CYD: Full fetch complete (33126 records). [2025-10-01T18:20:31.590399] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-01T18:20:31.867425] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:20:32.116847] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-01T18:20:32.117977] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-01T18:20:32.118059] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-01T18:20:32.118734] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-01T18:20:32.118814] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-01T18:20:32.119922] [DEBUG] [LOCAL ] CYD: Trimmed 33126 records to 26522 (keeping 200 days of data) [2025-10-01T18:20:32.296609] [DEBUG] [LOCAL ] CYD: Primary data saved (26522 records). [2025-10-01T18:20:32.296773] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-01T18:20:32.296866] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 34.7s. Estimated remaining: 4h 7m 23s. Rate: 7.2 symbols/min [2025-10-01T18:20:32.460274] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-01T18:20:32.529533] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:20:32.587060] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-01T18:20:32.587397] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-01T18:20:32.788918] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:20:32.789200] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-01T18:20:32.789277] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-01T18:20:32.789780] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-01T18:20:32.789844] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-01T18:20:32.903448] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-01T18:20:33.204489] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:20:33.245104] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T18:20:33.246846] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T18:20:33.702381] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-01T18:20:34.502386] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-01T18:20:34.736868] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T18:20:35.302338] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-01T18:20:35.461568] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T18:20:35.900431] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-01T18:20:36.102383] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-01T18:20:36.902374] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-01T18:20:37.031010] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T18:20:37.072502] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T18:20:37.702384] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-01T18:20:38.502394] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-01T18:20:39.121102] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-01T18:20:39.302360] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-01T18:20:39.561139] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T18:20:40.102360] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-01T18:20:40.213551] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T18:20:40.902393] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-01T18:20:41.342633] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-01T18:20:41.553183] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T18:20:41.702393] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-01T18:20:41.775466] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T18:20:42.502378] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-01T18:20:43.068467] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T18:20:43.302387] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-01T18:20:44.102389] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-01T18:20:44.822014] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-01T18:20:44.902380] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-01T18:20:45.101203] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T18:20:45.329353] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-01T18:20:45.702380] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-01T18:20:46.502388] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-01T18:20:46.516752] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T18:20:47.302412] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-01T18:20:47.400326] [DEBUG] [REMOTE ] D: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-01T18:20:47.400721] [WARN ] [REMOTE ] D: No data returned for month 2025-06 [2025-10-01T18:20:47.400817] [FATAL] [REMOTE ] D: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:20:47.400904] [FATAL] [MAIN ] D: Failed to fetch primary data. [2025-10-01T18:20:47.400972] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:20:47.401048] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-01T18:20:47.401115] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-01T18:20:47.401154] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-01T18:20:47.401752] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-10-01T18:20:47.401844] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. D took 22.6s. Estimated remaining: 4h 7m 36s. Rate: 7.2 symbols/min [2025-10-01T18:20:47.595567] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-01T18:20:47.677460] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:20:47.729426] [DEBUG] [LOCAL ] DAN: Loaded 48978 existing records from primary storage. [2025-10-01T18:20:47.729849] [INFO ] [MAIN ] DAN: Loaded 48978 existing records. [2025-10-01T18:20:47.937750] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:20:47.937999] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-01T18:20:47.938049] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-01T18:20:47.942773] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-01T18:20:47.942860] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-01T18:20:48.109442] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-01T18:20:48.158369] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T18:20:48.416810] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:20:48.902396] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-01T18:20:49.702397] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-01T18:20:50.467672] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T18:20:50.508158] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-01T18:20:50.526850] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-01T18:20:51.302371] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-01T18:20:51.428626] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T18:20:51.485305] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T18:20:52.102424] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-01T18:20:52.902380] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-01T18:20:52.972973] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T18:20:53.406678] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-01T18:20:53.702358] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-01T18:20:54.218326] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T18:20:54.502407] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-01T18:20:54.667484] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T18:20:55.302419] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-01T18:20:56.102383] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-01T18:20:56.148731] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T18:20:56.902387] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-01T18:20:57.126796] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-01T18:20:57.695045] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T18:20:57.704592] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-01T18:20:58.502517] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-01T18:20:58.503504] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T18:20:58.596514] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T18:20:58.597490] [INFO ] [REMOTE ] DAC: Full fetch complete (19449 records). [2025-10-01T18:20:58.597573] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-01T18:20:59.025923] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-01T18:20:59.026003] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-01T18:20:59.026463] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-01T18:20:59.026505] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-01T18:20:59.027215] [DEBUG] [LOCAL ] DAC: Trimmed 19449 records to 12526 (keeping 200 days of data) [2025-10-01T18:20:59.110528] [DEBUG] [LOCAL ] DAC: Primary data saved (12526 records). [2025-10-01T18:20:59.110714] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-01T18:20:59.110858] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAC took 28.2s. Estimated remaining: 4h 7m 38s. Rate: 7.2 symbols/min [2025-10-01T18:20:59.301754] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:20:59.301928] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-01T18:20:59.302011] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-01T18:20:59.302094] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-01T18:20:59.302131] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-01T18:20:59.302173] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-01T18:20:59.302205] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-01T18:20:59.307638] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-01T18:20:59.734480] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:21:00.102395] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-01T18:21:00.454422] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-01T18:21:00.456826] [INFO ] [REMOTE ] CYH: Full fetch complete (70027 records). [2025-10-01T18:21:00.456949] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-01T18:21:00.918929] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-01T18:21:00.915120] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-01T18:21:00.919963] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-01T18:21:00.920975] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-01T18:21:00.921138] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-01T18:21:00.922772] [DEBUG] [LOCAL ] CYH: Trimmed 70027 records to 47530 (keeping 200 days of data) [2025-10-01T18:21:01.192151] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T18:21:01.244320] [DEBUG] [LOCAL ] CYH: Primary data saved (47530 records). [2025-10-01T18:21:01.244509] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-01T18:21:01.244606] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. CYH took 38.1s. Estimated remaining: 4h 7m 11s. Rate: 7.2 symbols/min [2025-10-01T18:21:01.450774] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:21:01.504493] [DEBUG] [LOCAL ] DAR: Loaded 51847 existing records from primary storage. [2025-10-01T18:21:01.504833] [INFO ] [MAIN ] DAR: Loaded 51847 existing records. [2025-10-01T18:21:01.704530] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-01T18:21:01.710812] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:21:01.712257] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-01T18:21:01.712344] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-01T18:21:01.724422] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-01T18:21:01.743117] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-01T18:21:01.789756] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-01T18:21:02.173729] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:21:02.502355] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-01T18:21:02.598900] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T18:21:02.705294] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T18:21:03.302409] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-01T18:21:04.077610] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T18:21:04.102392] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-01T18:21:04.560981] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T18:21:04.902402] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-01T18:21:05.702362] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-01T18:21:05.822735] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T18:21:06.186688] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T18:21:06.502404] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-01T18:21:07.066624] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T18:21:07.302424] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-01T18:21:08.111036] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-01T18:21:08.133966] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T18:21:08.902491] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-01T18:21:09.399719] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-01T18:21:09.476469] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T18:21:09.702406] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-01T18:21:10.293621] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T18:21:10.502396] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-01T18:21:11.302405] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-01T18:21:12.102362] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-01T18:21:12.261117] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T18:21:12.765228] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-01T18:21:12.766915] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-01T18:21:12.767064] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-01T18:21:12.907537] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-01T18:21:13.249211] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-01T18:21:13.249458] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-01T18:21:13.250676] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-01T18:21:13.267058] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-01T18:21:13.269185] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T18:21:13.300802] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-10-01T18:21:13.306208] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T18:21:13.656786] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-01T18:21:13.656960] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-01T18:21:13.657053] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAL took 41.4s. Estimated remaining: 4h 7m 15s. Rate: 7.2 symbols/min [2025-10-01T18:21:13.707479] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-01T18:21:13.852612] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:21:13.895723] [DEBUG] [LOCAL ] DAVA: Loaded 40904 existing records from primary storage. [2025-10-01T18:21:13.896075] [INFO ] [MAIN ] DAVA: Loaded 40904 existing records. [2025-10-01T18:21:14.098441] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:21:14.098689] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-01T18:21:14.098767] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-01T18:21:14.099860] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-01T18:21:14.099963] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-01T18:21:14.502845] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-01T18:21:14.528493] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:21:14.860272] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T18:21:15.302405] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-01T18:21:15.675831] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T18:21:15.721285] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-01T18:21:16.102403] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-01T18:21:16.740926] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T18:21:16.902402] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-01T18:21:17.074224] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T18:21:17.702384] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-01T18:21:18.064756] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T18:21:18.502351] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-01T18:21:18.649046] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T18:21:19.302383] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-01T18:21:20.102432] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-01T18:21:20.713431] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-01T18:21:20.715663] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T18:21:20.727378] [INFO ] [REMOTE ] DAN: Full fetch complete (70792 records). [2025-10-01T18:21:20.727966] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-01T18:21:20.907465] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-01T18:21:21.176355] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-01T18:21:21.176487] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-01T18:21:21.177339] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-01T18:21:21.177482] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-01T18:21:21.178970] [DEBUG] [LOCAL ] DAN: Trimmed 70792 records to 48976 (keeping 200 days of data) [2025-10-01T18:21:21.325018] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T18:21:21.537804] [DEBUG] [LOCAL ] DAN: Primary data saved (48976 records). [2025-10-01T18:21:21.537980] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-01T18:21:21.538074] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAN took 34.1s. Estimated remaining: 4h 7m 6s. Rate: 7.2 symbols/min [2025-10-01T18:21:21.707788] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-01T18:21:21.739301] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:21:21.786063] [DEBUG] [LOCAL ] DAY: Loaded 49614 existing records from primary storage. [2025-10-01T18:21:21.786411] [INFO ] [MAIN ] DAY: Loaded 49614 existing records. [2025-10-01T18:21:21.995513] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:21:21.995839] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-01T18:21:21.995895] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-01T18:21:21.996904] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-01T18:21:21.996967] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-01T18:21:22.135104] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T18:21:22.432721] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:21:22.502364] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-01T18:21:22.724788] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T18:21:23.302415] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-01T18:21:24.102394] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-01T18:21:24.362022] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T18:21:24.713093] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T18:21:24.902429] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-01T18:21:25.642870] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T18:21:25.702388] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-01T18:21:26.314542] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T18:21:26.502428] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-01T18:21:26.652198] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T18:21:27.302387] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-01T18:21:28.102419] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-01T18:21:28.144300] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T18:21:28.449755] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T18:21:28.450684] [INFO ] [REMOTE ] DAO: Full fetch complete (32918 records). [2025-10-01T18:21:28.450810] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-01T18:21:28.897107] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-01T18:21:28.897196] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-01T18:21:28.897834] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-01T18:21:28.897937] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-01T18:21:28.898932] [DEBUG] [LOCAL ] DAO: Trimmed 32918 records to 20913 (keeping 200 days of data) [2025-10-01T18:21:28.902395] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-01T18:21:29.029898] [DEBUG] [LOCAL ] DAO: Primary data saved (20913 records). [2025-10-01T18:21:29.030025] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-01T18:21:29.030097] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAO took 29.9s. Estimated remaining: 4h 6m 55s. Rate: 7.2 symbols/min [2025-10-01T18:21:29.218565] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:21:29.274460] [DEBUG] [LOCAL ] DB: Loaded 52581 existing records from primary storage. [2025-10-01T18:21:29.274821] [INFO ] [MAIN ] DB: Loaded 52581 existing records. [2025-10-01T18:21:29.511594] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:21:29.512009] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-01T18:21:29.512071] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-01T18:21:29.513316] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-01T18:21:29.513386] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-01T18:21:29.703219] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-01T18:21:29.972241] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:21:30.007348] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T18:21:30.300258] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T18:21:30.502390] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-01T18:21:31.302425] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-01T18:21:31.513006] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T18:21:32.102409] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-01T18:21:32.278509] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T18:21:32.627142] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T18:21:32.902391] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-01T18:21:33.702407] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-01T18:21:33.849420] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T18:21:34.502400] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-01T18:21:34.650162] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T18:21:35.153504] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T18:21:35.302377] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-01T18:21:36.102359] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-01T18:21:36.200113] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T18:21:36.902357] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-01T18:21:37.080362] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T18:21:37.693989] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T18:21:37.704728] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-01T18:21:38.502386] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-01T18:21:38.976055] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-01T18:21:38.977688] [INFO ] [REMOTE ] DAR: Full fetch complete (74615 records). [2025-10-01T18:21:38.977907] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-01T18:21:39.305397] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-01T18:21:39.456307] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-01T18:21:39.456437] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-01T18:21:39.457602] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-01T18:21:39.457736] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-01T18:21:39.476437] [DEBUG] [LOCAL ] DAR: Trimmed 74615 records to 51846 (keeping 200 days of data) [2025-10-01T18:21:39.495976] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-01T18:21:39.835731] [DEBUG] [LOCAL ] DAR: Primary data saved (51846 records). [2025-10-01T18:21:39.835897] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-01T18:21:39.835989] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 38.6s. Estimated remaining: 4h 6m 54s. Rate: 7.2 symbols/min [2025-10-01T18:21:40.044552] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:21:40.044882] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-01T18:21:40.045045] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-01T18:21:40.045338] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-01T18:21:40.045449] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-01T18:21:40.045558] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-01T18:21:40.045718] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-01T18:21:40.108730] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-01T18:21:40.319805] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T18:21:40.491871] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:21:40.724788] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T18:21:40.902377] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-01T18:21:41.702363] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-01T18:21:41.914577] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T18:21:42.502422] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-01T18:21:42.606977] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T18:21:43.302364] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-01T18:21:43.494418] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T18:21:44.102352] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-01T18:21:44.195368] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T18:21:44.458124] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T18:21:44.902389] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-01T18:21:45.380452] [DEBUG] [REMOTE ] DAVA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:21:45.380890] [WARN ] [REMOTE ] DAVA: No data returned for month 2025-10 [2025-10-01T18:21:45.380994] [FATAL] [REMOTE ] DAVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:21:45.381121] [FATAL] [MAIN ] DAVA: Failed to fetch primary data. [2025-10-01T18:21:45.381187] [WARN ] [MAIN ] DAVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:21:45.381260] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-01T18:21:45.381510] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-01T18:21:45.381809] [INFO ] [LOCAL ] DAVA: Starting deletion of derivative data. [2025-10-01T18:21:45.382228] [DEBUG] [LOCAL ] DAVA: Deleted derivative data file. [2025-10-01T18:21:45.382358] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 31.7s. Estimated remaining: 4h 6m 37s. Rate: 7.2 symbols/min [2025-10-01T18:21:45.586432] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:21:45.629820] [DEBUG] [LOCAL ] DBI: Loaded 44637 existing records from primary storage. [2025-10-01T18:21:45.630174] [INFO ] [MAIN ] DBI: Loaded 44637 existing records. [2025-10-01T18:21:45.707613] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-01T18:21:45.828379] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:21:45.828587] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-01T18:21:45.828635] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-01T18:21:45.829824] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-01T18:21:45.829885] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-01T18:21:46.231248] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:21:46.502401] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-01T18:21:47.083838] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-01T18:21:47.302383] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-01T18:21:47.479285] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T18:21:47.492509] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T18:21:48.102370] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-01T18:21:48.750173] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T18:21:48.902474] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-01T18:21:49.702405] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-01T18:21:49.922830] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T18:21:50.320500] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T18:21:50.502428] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-01T18:21:50.899614] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T18:21:51.242625] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T18:21:51.302396] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-01T18:21:52.102431] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-01T18:21:52.858967] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T18:21:52.902362] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-01T18:21:53.702356] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-01T18:21:53.790447] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T18:21:54.502369] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-01T18:21:54.568321] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T18:21:54.595869] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T18:21:55.302432] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-01T18:21:56.102406] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-01T18:21:56.272456] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T18:21:56.657086] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T18:21:56.902392] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-01T18:21:57.702424] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-01T18:21:58.018355] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T18:21:58.176007] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-01T18:21:58.177978] [INFO ] [REMOTE ] DAY: Full fetch complete (71604 records). [2025-10-01T18:21:58.178134] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-01T18:21:58.512238] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-01T18:21:58.630576] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-01T18:21:58.630703] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-01T18:21:58.631837] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-01T18:21:58.631925] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-01T18:21:58.633553] [DEBUG] [LOCAL ] DAY: Trimmed 71604 records to 49528 (keeping 200 days of data) [2025-10-01T18:21:58.936685] [DEBUG] [LOCAL ] DAY: Primary data saved (49528 records). [2025-10-01T18:21:58.936822] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-01T18:21:58.936919] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 37.4s. Estimated remaining: 4h 6m 45s. Rate: 7.2 symbols/min [2025-10-01T18:21:59.141691] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:21:59.153686] [DEBUG] [LOCAL ] DBL: Loaded 9317 existing records from primary storage. [2025-10-01T18:21:59.153926] [INFO ] [MAIN ] DBL: Loaded 9317 existing records. [2025-10-01T18:21:59.302554] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-01T18:21:59.365515] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:21:59.366003] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-01T18:21:59.366091] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-01T18:21:59.393585] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-01T18:21:59.397095] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-01T18:21:59.400090] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T18:21:59.653381] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T18:21:59.878955] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:22:00.102450] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-01T18:22:00.902461] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-01T18:22:01.003385] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T18:22:01.461318] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-01T18:22:01.702397] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-01T18:22:02.502358] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-01T18:22:02.720897] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T18:22:03.302398] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-01T18:22:03.332014] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T18:22:03.362909] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T18:22:04.102383] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-01T18:22:04.902427] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-01T18:22:05.321586] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T18:22:05.535834] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T18:22:05.537404] [INFO ] [REMOTE ] DB: Full fetch complete (74578 records). [2025-10-01T18:22:05.537505] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-01T18:22:05.706474] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-01T18:22:05.986859] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-01T18:22:05.986964] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-01T18:22:05.987976] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-01T18:22:05.988043] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-01T18:22:05.989528] [DEBUG] [LOCAL ] DB: Trimmed 74578 records to 52580 (keeping 200 days of data) [2025-10-01T18:22:06.340590] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T18:22:06.372106] [DEBUG] [LOCAL ] DB: Primary data saved (52580 records). [2025-10-01T18:22:06.372289] [INFO ] [MAIN ] DB: Full history saved. [2025-10-01T18:22:06.372391] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 37.3s. Estimated remaining: 4h 6m 34s. Rate: 7.2 symbols/min [2025-10-01T18:22:06.507617] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-01T18:22:06.583771] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:22:06.637320] [DEBUG] [LOCAL ] DBRG: Loaded 49722 existing records from primary storage. [2025-10-01T18:22:06.637950] [INFO ] [MAIN ] DBRG: Loaded 49722 existing records. [2025-10-01T18:22:06.852574] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:22:06.853127] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-01T18:22:06.853313] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-01T18:22:06.856070] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-01T18:22:06.856151] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-01T18:22:07.120891] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T18:22:07.305338] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-01T18:22:07.309551] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:22:08.102437] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-01T18:22:08.192780] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T18:22:08.335520] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T18:22:08.902402] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-01T18:22:09.612728] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T18:22:09.702402] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-01T18:22:10.464501] [DEBUG] [REMOTE ] DBD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:22:10.464947] [WARN ] [REMOTE ] DBD: No data returned for month 2025-10 [2025-10-01T18:22:10.465210] [FATAL] [REMOTE ] DBD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:22:10.465418] [FATAL] [MAIN ] DBD: Failed to fetch primary data. [2025-10-01T18:22:10.465497] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:22:10.465570] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-01T18:22:10.465637] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-01T18:22:10.465719] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-01T18:22:10.465782] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-01T18:22:10.465878] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 30.6s. Estimated remaining: 4h 6m 13s. Rate: 7.2 symbols/min [2025-10-01T18:22:10.502553] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-01T18:22:10.688474] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T18:22:10.692120] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:22:10.738959] [DEBUG] [LOCAL ] DCI: Loaded 37357 existing records from primary storage. [2025-10-01T18:22:10.739280] [INFO ] [MAIN ] DCI: Loaded 37357 existing records. [2025-10-01T18:22:10.934569] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:22:10.934832] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-01T18:22:10.934883] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-01T18:22:10.936428] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-01T18:22:10.936495] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-01T18:22:11.307548] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-01T18:22:11.353574] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:22:12.102402] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-01T18:22:12.201422] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T18:22:12.826694] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T18:22:12.902399] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-01T18:22:12.991676] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T18:22:13.702401] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-01T18:22:14.486535] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T18:22:14.502344] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-01T18:22:15.302431] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-01T18:22:15.338395] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T18:22:16.104060] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-01T18:22:16.108759] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T18:22:16.194912] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T18:22:16.902414] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-01T18:22:17.702390] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-01T18:22:18.000074] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-01T18:22:18.001683] [INFO ] [REMOTE ] DBI: Full fetch complete (65921 records). [2025-10-01T18:22:18.001807] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-01T18:22:18.454352] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-01T18:22:18.454472] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-01T18:22:18.455478] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-01T18:22:18.455624] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-01T18:22:18.457416] [DEBUG] [LOCAL ] DBI: Trimmed 65921 records to 44591 (keeping 200 days of data) [2025-10-01T18:22:18.509522] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-01T18:22:18.741884] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T18:22:18.796173] [DEBUG] [LOCAL ] DBI: Primary data saved (44591 records). [2025-10-01T18:22:18.796366] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-01T18:22:18.796464] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBI took 33.4s. Estimated remaining: 4h 6m 5s. Rate: 7.2 symbols/min [2025-10-01T18:22:19.010111] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:22:19.025078] [DEBUG] [LOCAL ] DCO: Loaded 13877 existing records from primary storage. [2025-10-01T18:22:19.045895] [INFO ] [MAIN ] DCO: Loaded 13877 existing records. [2025-10-01T18:22:19.085217] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:22:19.163253] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T18:22:19.273302] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:22:19.273537] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-01T18:22:19.273625] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-01T18:22:19.274312] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-01T18:22:19.274375] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-01T18:22:19.307537] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-01T18:22:19.679500] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:22:20.102375] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-01T18:22:20.902361] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-01T18:22:21.237763] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T18:22:21.660788] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T18:22:21.702389] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-01T18:22:21.721545] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T18:22:22.502416] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-01T18:22:23.302378] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-01T18:22:23.464670] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T18:22:23.517916] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T18:22:23.894172] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T18:22:24.102432] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-01T18:22:24.839545] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T18:22:24.902407] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-01T18:22:25.702439] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-01T18:22:26.500951] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T18:22:26.509870] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-01T18:22:26.661169] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T18:22:27.302401] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-01T18:22:27.816630] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T18:22:28.102366] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-01T18:22:28.172460] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T18:22:28.902428] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-01T18:22:29.438737] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-01T18:22:29.702385] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-01T18:22:29.783212] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T18:22:30.502381] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-01T18:22:30.528136] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T18:22:31.040833] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T18:22:31.302398] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-01T18:22:32.065197] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T18:22:32.102388] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-01T18:22:32.615889] [DEBUG] [REMOTE ] DBL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:22:32.616301] [WARN ] [REMOTE ] DBL: No data returned for month 2025-10 [2025-10-01T18:22:32.616416] [FATAL] [REMOTE ] DBL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:22:32.616553] [FATAL] [MAIN ] DBL: Failed to fetch primary data. [2025-10-01T18:22:32.616638] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:22:32.616748] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-01T18:22:32.616830] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-01T18:22:32.616878] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-01T18:22:32.617349] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-01T18:22:32.617479] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBL took 33.7s. Estimated remaining: 4h 6m 13s. Rate: 7.2 symbols/min [2025-10-01T18:22:32.842900] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:22:32.896784] [DEBUG] [LOCAL ] DD: Loaded 52829 existing records from primary storage. [2025-10-01T18:22:32.897186] [INFO ] [MAIN ] DD: Loaded 52829 existing records. [2025-10-01T18:22:32.911097] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-01T18:22:33.112971] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:22:33.113202] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-01T18:22:33.113254] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-01T18:22:33.114893] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-01T18:22:33.114960] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-01T18:22:33.534794] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:22:33.702422] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-01T18:22:33.843028] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T18:22:34.502475] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-01T18:22:35.302406] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-01T18:22:35.644804] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T18:22:36.102390] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-01T18:22:36.340095] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T18:22:36.788973] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T18:22:36.902350] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-01T18:22:37.016074] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T18:22:37.702392] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-01T18:22:38.502394] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-01T18:22:38.716475] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T18:22:39.156918] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T18:22:39.277514] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T18:22:39.302377] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-01T18:22:40.102367] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-01T18:22:40.331157] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T18:22:40.902629] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-01T18:22:41.702375] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-01T18:22:41.918917] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T18:22:42.061508] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T18:22:42.356044] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T18:22:42.502436] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-01T18:22:43.302636] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-01T18:22:44.102384] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-01T18:22:44.510615] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T18:22:44.580608] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-01T18:22:44.582453] [INFO ] [REMOTE ] DBRG: Full fetch complete (72310 records). [2025-10-01T18:22:44.582596] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-01T18:22:44.907463] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-01T18:22:45.024491] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-01T18:22:45.024636] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-01T18:22:45.025763] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-01T18:22:45.025845] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-01T18:22:45.027638] [DEBUG] [LOCAL ] DBRG: Trimmed 72310 records to 49736 (keeping 200 days of data) [2025-10-01T18:22:45.354161] [DEBUG] [LOCAL ] DBRG: Primary data saved (49736 records). [2025-10-01T18:22:45.354303] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-01T18:22:45.354442] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 39.0s. Estimated remaining: 4h 6m 18s. Rate: 7.2 symbols/min [2025-10-01T18:22:45.437881] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-01T18:22:45.464742] [INFO ] [REMOTE ] DCO: Full fetch complete (19183 records). [2025-10-01T18:22:45.467950] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-01T18:22:45.685143] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:22:45.721269] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-01T18:22:46.000154] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-01T18:22:46.000295] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-01T18:22:46.000811] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-01T18:22:46.001851] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-01T18:22:46.019026] [DEBUG] [LOCAL ] DCO: Trimmed 19183 records to 13871 (keeping 200 days of data) [2025-10-01T18:22:46.020257] [DEBUG] [LOCAL ] DDD: Loaded 50892 existing records from primary storage. [2025-10-01T18:22:46.021229] [INFO ] [MAIN ] DDD: Loaded 50892 existing records. [2025-10-01T18:22:46.326952] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:22:46.328511] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-01T18:22:46.329104] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-01T18:22:46.332862] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-01T18:22:46.334857] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-01T18:22:46.355761] [DEBUG] [LOCAL ] DCO: Primary data saved (13871 records). [2025-10-01T18:22:46.451392] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-01T18:22:46.486066] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCO took 27.7s. Estimated remaining: 4h 5m 48s. Rate: 7.2 symbols/min [2025-10-01T18:22:46.498055] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T18:22:46.547792] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-01T18:22:46.781175] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:22:47.251034] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:22:47.302390] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-01T18:22:48.102437] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-01T18:22:48.695561] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-01T18:22:48.696915] [INFO ] [REMOTE ] DCI: Full fetch complete (53945 records). [2025-10-01T18:22:48.697043] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-01T18:22:49.152455] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-01T18:22:49.152616] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-01T18:22:49.153796] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-01T18:22:49.153907] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-01T18:22:49.155846] [DEBUG] [LOCAL ] DCI: Trimmed 53945 records to 37344 (keeping 200 days of data) [2025-10-01T18:22:49.300732] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-01T18:22:49.314462] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-01T18:22:49.466682] [DEBUG] [LOCAL ] DCI: Primary data saved (37344 records). [2025-10-01T18:22:49.466834] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-01T18:22:49.466920] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCI took 39.0s. Estimated remaining: 4h 5m 24s. Rate: 7.2 symbols/min [2025-10-01T18:22:49.744510] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T18:22:49.756393] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-01T18:22:51.426358] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-01T18:22:51.437161] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-01T18:22:51.785081] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T18:22:51.797428] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-01T18:23:07.287029] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (15.49 seconds). [2025-10-01T18:23:07.299197] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-01T18:23:08.548901] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (17.11 seconds). [2025-10-01T18:23:08.560046] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-01T18:23:10.108916] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-10-01T18:23:10.152504] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T18:23:10.151217] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-01T18:23:10.165192] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-01T18:23:11.736500] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T18:23:11.748524] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-01T18:23:11.838577] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T18:23:11.850671] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-01T18:23:13.637919] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T18:23:13.649301] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-01T18:23:13.746817] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T18:23:13.758703] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-01T18:23:15.593085] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T18:23:15.639196] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T18:23:15.639783] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-01T18:23:15.652758] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-01T18:23:17.365563] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T18:23:17.377296] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-01T18:23:18.378519] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-01T18:23:18.382637] [INFO ] [REMOTE ] DD: Full fetch complete (76323 records). [2025-10-01T18:23:18.382792] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-01T18:23:18.823430] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-01T18:23:18.823503] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-01T18:23:18.824555] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-01T18:23:18.824626] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-01T18:23:18.827183] [DEBUG] [LOCAL ] DD: Trimmed 76323 records to 52826 (keeping 200 days of data) [2025-10-01T18:23:19.194011] [DEBUG] [LOCAL ] DD: Primary data saved (52826 records). [2025-10-01T18:23:19.194244] [INFO ] [MAIN ] DD: Full history saved. [2025-10-01T18:23:19.194441] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 46.6s. Estimated remaining: 4h 6m 19s. Rate: 7.2 symbols/min [2025-10-01T18:23:19.420898] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T18:23:19.439277] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-01T18:23:21.319281] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T18:23:21.331785] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-01T18:23:24.052752] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-01T18:23:24.054316] [INFO ] [REMOTE ] DDD: Full fetch complete (73702 records). [2025-10-01T18:23:24.054426] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-01T18:23:24.502031] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-01T18:23:24.502145] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-01T18:23:24.503235] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-01T18:23:24.503307] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-01T18:23:24.505110] [DEBUG] [LOCAL ] DDD: Trimmed 73702 records to 50889 (keeping 200 days of data) [2025-10-01T18:23:24.817098] [DEBUG] [LOCAL ] DDD: Primary data saved (50889 records). [2025-10-01T18:23:24.817267] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-01T18:23:24.817365] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 39.5s. Estimated remaining: 4h 6m 2s. Rate: 7.2 symbols/min [2025-10-01T18:23:25.644627] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:25.643321] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:25.646577] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:25.641866] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:25.654839] [DEBUG] [LOCAL ] DDT: Loaded 2083 existing records from primary storage. [2025-10-01T18:23:25.655306] [INFO ] [MAIN ] DDT: Loaded 2083 existing records. [2025-10-01T18:23:25.779943] [DEBUG] [LOCAL ] DDS: Loaded 13079 existing records from primary storage. [2025-10-01T18:23:25.793996] [INFO ] [MAIN ] DDS: Loaded 13079 existing records. [2025-10-01T18:23:25.981139] [DEBUG] [LOCAL ] DDL: Loaded 36643 existing records from primary storage. [2025-10-01T18:23:25.984924] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:23:26.026618] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-01T18:23:26.009497] [INFO ] [MAIN ] DDL: Loaded 36643 existing records. [2025-10-01T18:23:26.052860] [DEBUG] [LOCAL ] DE: Loaded 47556 existing records from primary storage. [2025-10-01T18:23:26.051889] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-01T18:23:26.095682] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-01T18:23:26.089877] [INFO ] [MAIN ] DE: Loaded 47556 existing records. [2025-10-01T18:23:26.121715] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-01T18:23:26.462575] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:23:26.565107] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-01T18:23:26.675105] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-01T18:23:26.728852] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:23:26.740790] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:23:26.774508] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-01T18:23:26.787809] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-01T18:23:26.787377] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-01T18:23:26.816721] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-01T18:23:26.822100] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-01T18:23:26.816444] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-01T18:23:26.822000] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-01T18:23:26.888225] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-01T18:23:26.872308] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-01T18:23:26.921958] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-01T18:23:27.495941] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:27.546296] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-01T18:23:28.372403] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T18:23:28.381954] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-01T18:23:28.372034] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:28.365255] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:28.398956] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-01T18:23:28.398568] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-01T18:23:28.409866] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:28.413006] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-01T18:23:28.844784] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-01T18:23:28.846029] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-01T18:23:29.252434] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T18:23:29.256006] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-01T18:23:29.304829] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T18:23:29.306176] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-01T18:23:29.636304] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-01T18:23:29.638122] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-01T18:23:29.747073] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T18:23:29.756007] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-01T18:23:30.208351] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T18:23:30.209965] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-01T18:23:30.312240] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T18:23:30.322510] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-01T18:23:30.353221] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T18:23:30.356359] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-01T18:23:30.551347] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-01T18:23:30.552574] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-01T18:23:31.005707] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T18:23:31.007048] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-01T18:23:31.049921] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T18:23:31.057592] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-01T18:23:31.358095] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T18:23:31.361688] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-01T18:23:31.483414] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-01T18:23:31.485044] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-01T18:23:31.847797] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T18:23:31.857943] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-01T18:23:31.988494] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T18:23:31.989783] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-01T18:23:32.308051] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-01T18:23:32.309468] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-01T18:23:32.330780] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T18:23:32.338289] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-01T18:23:32.356291] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T18:23:32.360322] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-01T18:23:33.004994] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-01T18:23:33.005702] [INFO ] [REMOTE ] DDT: Full fetch complete (2908 records). [2025-10-01T18:23:33.005775] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-01T18:23:33.424170] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-01T18:23:33.424464] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-01T18:23:33.424755] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-01T18:23:33.424935] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-01T18:23:33.434050] [DEBUG] [LOCAL ] DDT: Trimmed 2908 records to 2079 (keeping 200 days of data) [2025-10-01T18:23:33.437581] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T18:23:33.442530] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-01T18:23:33.457373] [DEBUG] [LOCAL ] DDT: Primary data saved (2079 records). [2025-10-01T18:23:33.457475] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-01T18:23:33.457556] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 8.6s. Estimated remaining: 4h 5m 55s. Rate: 7.2 symbols/min [2025-10-01T18:23:33.648470] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:33.694481] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T18:23:33.705390] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-01T18:23:33.740229] [DEBUG] [LOCAL ] DEA: Loaded 40928 existing records from primary storage. [2025-10-01T18:23:33.740616] [INFO ] [MAIN ] DEA: Loaded 40928 existing records. [2025-10-01T18:23:33.938055] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T18:23:33.985677] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:23:33.986366] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-01T18:23:33.986421] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-01T18:23:33.986905] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-01T18:23:33.988135] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-01T18:23:33.988203] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-01T18:23:34.344894] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-01T18:23:34.383114] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-01T18:23:34.421150] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:34.421564] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-01T18:23:35.301614] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T18:23:35.305361] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-01T18:23:35.598167] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T18:23:35.609873] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-01T18:23:35.678319] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T18:23:35.689529] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-01T18:23:36.032541] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T18:23:36.036737] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-01T18:23:36.278473] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T18:23:36.290013] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-01T18:23:37.072459] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T18:23:37.082108] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-01T18:23:37.115438] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T18:23:37.119517] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-01T18:23:37.301869] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T18:23:37.312782] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-01T18:23:37.809052] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T18:23:37.819288] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-01T18:23:37.845128] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T18:23:37.849134] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-01T18:23:38.149946] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T18:23:38.156586] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-01T18:23:38.906813] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T18:23:38.907970] [INFO ] [REMOTE ] DDS: Full fetch complete (19091 records). [2025-10-01T18:23:38.908074] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-01T18:23:39.376188] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-01T18:23:39.376348] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-01T18:23:39.377113] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-01T18:23:39.400940] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-01T18:23:39.406854] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-01T18:23:39.407489] [DEBUG] [LOCAL ] DDS: Trimmed 19091 records to 13050 (keeping 200 days of data) [2025-10-01T18:23:39.419190] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-01T18:23:39.516323] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T18:23:39.564637] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T18:23:39.573412] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-01T18:23:39.582495] [DEBUG] [LOCAL ] DDS: Primary data saved (13050 records). [2025-10-01T18:23:39.582667] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-01T18:23:39.582830] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 14.8s. Estimated remaining: 4h 5m 40s. Rate: 7.2 symbols/min [2025-10-01T18:23:39.574561] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-01T18:23:39.807524] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:39.807745] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-01T18:23:39.807794] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-01T18:23:39.807943] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-01T18:23:39.807988] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-01T18:23:39.808064] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-01T18:23:39.808106] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-01T18:23:40.242635] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:40.243063] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-01T18:23:40.978726] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T18:23:40.985946] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-01T18:23:41.291054] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T18:23:41.301889] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-01T18:23:41.347392] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-01T18:23:41.353244] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-01T18:23:41.357066] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T18:23:41.368433] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-01T18:23:42.223515] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T18:23:42.229173] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-01T18:23:42.413501] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T18:23:42.423159] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-01T18:23:42.869992] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T18:23:42.881353] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-01T18:23:43.139232] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-01T18:23:43.150313] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-01T18:23:43.191593] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T18:23:43.302396] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-01T18:23:44.137734] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T18:23:44.146856] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-01T18:23:44.352015] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T18:23:44.354054] [INFO ] [REMOTE ] DDL: Full fetch complete (53287 records). [2025-10-01T18:23:44.354201] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-01T18:23:44.952416] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T18:23:44.978838] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-01T18:23:45.099335] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-01T18:23:45.099486] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-01T18:23:45.100728] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-01T18:23:45.101869] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-01T18:23:45.105964] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-01T18:23:45.126200] [DEBUG] [LOCAL ] DDL: Trimmed 53287 records to 36749 (keeping 200 days of data) [2025-10-01T18:23:45.450287] [DEBUG] [LOCAL ] DDL: Primary data saved (36749 records). [2025-10-01T18:23:45.450494] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-01T18:23:45.450720] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 20.6s. Estimated remaining: 4h 5m 25s. Rate: 7.2 symbols/min [2025-10-01T18:23:45.721317] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:45.721509] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-01T18:23:45.748742] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T18:23:45.812014] [DEBUG] [LOCAL ] DECK: Loaded 53295 existing records from primary storage. [2025-10-01T18:23:45.812373] [INFO ] [MAIN ] DECK: Loaded 53295 existing records. [2025-10-01T18:23:46.018775] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:23:46.019114] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-01T18:23:46.019255] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-01T18:23:46.021680] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-01T18:23:46.021746] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-01T18:23:46.352627] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T18:23:46.456459] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:46.502404] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-01T18:23:47.307588] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-01T18:23:47.326186] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T18:23:48.102370] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-01T18:23:48.610078] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T18:23:48.672234] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T18:23:48.902386] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-01T18:23:49.702403] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-01T18:23:50.502367] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-01T18:23:50.535340] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-01T18:23:50.537259] [INFO ] [REMOTE ] DE: Full fetch complete (69577 records). [2025-10-01T18:23:50.537372] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-01T18:23:50.976897] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-01T18:23:50.977127] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-01T18:23:50.978272] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-01T18:23:50.978378] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-01T18:23:51.017984] [DEBUG] [LOCAL ] DE: Trimmed 69577 records to 47563 (keeping 200 days of data) [2025-10-01T18:23:51.021527] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-01T18:23:51.302716] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-01T18:23:51.360939] [DEBUG] [LOCAL ] DE: Primary data saved (47563 records). [2025-10-01T18:23:51.361151] [INFO ] [MAIN ] DE: Full history saved. [2025-10-01T18:23:51.361373] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 26.5s. Estimated remaining: 4h 5m 9s. Rate: 7.2 symbols/min [2025-10-01T18:23:51.596822] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T18:23:51.594574] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:23:51.627522] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T18:23:51.679550] [DEBUG] [LOCAL ] DEI: Loaded 48388 existing records from primary storage. [2025-10-01T18:23:51.679903] [INFO ] [MAIN ] DEI: Loaded 48388 existing records. [2025-10-01T18:23:51.868871] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:23:51.869112] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-01T18:23:51.869181] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-01T18:23:51.869785] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-01T18:23:51.869880] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-01T18:23:52.107492] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-01T18:23:52.275145] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:23:52.902393] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-01T18:23:53.160886] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T18:23:53.444265] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T18:23:53.702424] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-01T18:23:54.416251] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T18:23:54.502397] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-01T18:23:54.791748] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T18:23:55.302401] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-01T18:23:56.107943] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-01T18:23:56.125932] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T18:23:56.735288] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T18:23:56.902413] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-01T18:23:57.702407] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-01T18:23:57.946836] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T18:23:58.348907] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T18:23:58.502427] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-01T18:23:59.018506] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T18:23:59.302381] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-01T18:23:59.919943] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T18:24:00.102409] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-01T18:24:00.902389] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-01T18:24:01.078256] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-01T18:24:01.079465] [INFO ] [REMOTE ] DEC: Full fetch complete (43158 records). [2025-10-01T18:24:01.079576] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-01T18:24:01.524212] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-01T18:24:01.524321] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-01T18:24:01.525184] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-01T18:24:01.525259] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-01T18:24:01.526707] [DEBUG] [LOCAL ] DEC: Trimmed 43158 records to 30451 (keeping 200 days of data) [2025-10-01T18:24:01.713229] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-01T18:24:01.755275] [DEBUG] [LOCAL ] DEC: Primary data saved (30451 records). [2025-10-01T18:24:01.755397] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-01T18:24:01.755471] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEC took 22.2s. Estimated remaining: 4h 5m 7s. Rate: 7.2 symbols/min [2025-10-01T18:24:01.940778] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:01.941101] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-01T18:24:01.941259] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-01T18:24:01.941392] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-01T18:24:01.941437] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-01T18:24:01.941480] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-01T18:24:01.941514] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-01T18:24:02.376188] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:02.407715] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-01T18:24:02.502377] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-01T18:24:02.955684] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T18:24:02.957126] [INFO ] [REMOTE ] DEA: Full fetch complete (62545 records). [2025-10-01T18:24:02.957241] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-01T18:24:03.306104] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-01T18:24:03.402396] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-01T18:24:03.402787] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-01T18:24:03.403759] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-01T18:24:03.403921] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-01T18:24:03.405863] [DEBUG] [LOCAL ] DEA: Trimmed 62545 records to 40853 (keeping 200 days of data) [2025-10-01T18:24:03.438450] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T18:24:03.711127] [DEBUG] [LOCAL ] DEA: Primary data saved (40853 records). [2025-10-01T18:24:03.711320] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-01T18:24:03.711439] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEA took 30.3s. Estimated remaining: 4h 4m 40s. Rate: 7.2 symbols/min [2025-10-01T18:24:03.903045] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:03.953194] [DEBUG] [LOCAL ] DEO: Loaded 49007 existing records from primary storage. [2025-10-01T18:24:03.953514] [INFO ] [MAIN ] DEO: Loaded 49007 existing records. [2025-10-01T18:24:04.116903] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-01T18:24:04.162291] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:24:04.162489] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-01T18:24:04.162559] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-01T18:24:04.164030] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-01T18:24:04.164095] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-01T18:24:04.618084] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:04.902436] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-01T18:24:05.018061] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-01T18:24:05.182757] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T18:24:05.483234] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T18:24:05.702400] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-01T18:24:06.502412] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-01T18:24:06.873940] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T18:24:07.302363] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-01T18:24:07.638746] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T18:24:08.102435] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-01T18:24:08.796680] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-01T18:24:08.902375] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-01T18:24:09.184160] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T18:24:09.702369] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-01T18:24:09.974569] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T18:24:10.502382] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-01T18:24:10.915229] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-01T18:24:11.302456] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-01T18:24:11.679059] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-01T18:24:12.102356] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-01T18:24:12.299486] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T18:24:12.902384] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-01T18:24:13.629445] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-01T18:24:13.671501] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T18:24:13.702365] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-01T18:24:14.502410] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-01T18:24:14.928983] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-01T18:24:15.302383] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-01T18:24:15.373919] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T18:24:16.102406] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-01T18:24:16.592034] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T18:24:16.902404] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-01T18:24:16.966435] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-01T18:24:17.702374] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-01T18:24:17.960778] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T18:24:18.094693] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T18:24:18.502410] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-01T18:24:19.302350] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-01T18:24:19.421004] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T18:24:20.102388] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-01T18:24:20.434406] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T18:24:20.902386] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-01T18:24:20.958725] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T18:24:21.702381] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-01T18:24:21.879443] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T18:24:22.502436] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-01T18:24:22.966472] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T18:24:23.302394] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-01T18:24:23.680970] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-01T18:24:23.682596] [INFO ] [REMOTE ] DEI: Full fetch complete (69677 records). [2025-10-01T18:24:23.682723] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-01T18:24:24.116736] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-01T18:24:24.143680] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-01T18:24:24.143790] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-01T18:24:24.145041] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-01T18:24:24.145181] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-01T18:24:24.146804] [DEBUG] [LOCAL ] DEI: Trimmed 69677 records to 48359 (keeping 200 days of data) [2025-10-01T18:24:24.487315] [DEBUG] [LOCAL ] DEI: Primary data saved (48359 records). [2025-10-01T18:24:24.487526] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-01T18:24:24.487895] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DEI took 33.1s. Estimated remaining: 4h 5m 8s. Rate: 7.2 symbols/min [2025-10-01T18:24:24.563532] [DEBUG] [REMOTE ] DECK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:24:24.595803] [WARN ] [REMOTE ] DECK: No data returned for month 2025-10 [2025-10-01T18:24:24.617021] [FATAL] [REMOTE ] DECK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:24:24.628966] [FATAL] [MAIN ] DECK: Failed to fetch primary data. [2025-10-01T18:24:24.645538] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:24:24.650877] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-01T18:24:24.661730] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-01T18:24:24.689431] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-01T18:24:24.722745] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:24.723935] [DEBUG] [LOCAL ] DECK: Deleted derivative data file. [2025-10-01T18:24:24.748469] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DECK took 39.3s. Estimated remaining: 4h 4m 36s. Rate: 7.2 symbols/min [2025-10-01T18:24:24.809050] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-01T18:24:24.907489] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-01T18:24:24.983809] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:24.981787] [DEBUG] [LOCAL ] DFH: Loaded 32312 existing records from primary storage. [2025-10-01T18:24:24.984465] [INFO ] [MAIN ] DFH: Loaded 32312 existing records. [2025-10-01T18:24:25.201277] [DEBUG] [LOCAL ] DFIN: Loaded 23061 existing records from primary storage. [2025-10-01T18:24:25.203399] [INFO ] [MAIN ] DFIN: Loaded 23061 existing records. [2025-10-01T18:24:25.262510] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:24:25.318893] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-01T18:24:25.347818] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-01T18:24:25.354716] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-01T18:24:25.365044] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-01T18:24:25.544193] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:24:25.556585] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-01T18:24:25.562364] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-01T18:24:25.605164] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-01T18:24:25.614908] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-01T18:24:26.047950] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:26.075904] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-01T18:24:26.280437] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:26.333912] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-01T18:24:26.502382] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-01T18:24:26.672098] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T18:24:27.302362] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-01T18:24:27.712831] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T18:24:28.102386] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-01T18:24:28.849856] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-01T18:24:28.902344] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-01T18:24:29.075518] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T18:24:29.126687] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T18:24:29.702378] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-01T18:24:30.502459] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-01T18:24:30.877748] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-01T18:24:31.239512] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-01T18:24:31.302381] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-01T18:24:31.353189] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T18:24:32.102493] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-01T18:24:32.902408] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-01T18:24:33.550362] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T18:24:33.702731] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-01T18:24:34.502429] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-01T18:24:34.718553] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T18:24:34.718822] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (3.42 seconds). [2025-10-01T18:24:34.727058] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-01T18:24:34.727307] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-01T18:24:35.122318] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-01T18:24:35.244813] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-01T18:24:35.244907] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-01T18:24:35.245970] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-01T18:24:35.246041] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-01T18:24:35.247726] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53735 (keeping 200 days of data) [2025-10-01T18:24:35.308223] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-01T18:24:35.604411] [DEBUG] [LOCAL ] DELL: Primary data saved (53735 records). [2025-10-01T18:24:35.604560] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-01T18:24:35.604717] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 33.8s. Estimated remaining: 4h 4m 35s. Rate: 7.2 symbols/min [2025-10-01T18:24:35.796245] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:35.796535] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-10-01T18:24:35.796704] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-10-01T18:24:35.796963] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-01T18:24:35.797061] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-01T18:24:35.797162] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-01T18:24:35.797340] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-01T18:24:35.977221] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T18:24:36.114067] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-01T18:24:36.254118] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:36.547836] [DEBUG] [REMOTE ] DEO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:24:36.548210] [WARN ] [REMOTE ] DEO: No data returned for month 2025-10 [2025-10-01T18:24:36.548328] [FATAL] [REMOTE ] DEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:24:36.548444] [FATAL] [MAIN ] DEO: Failed to fetch primary data. [2025-10-01T18:24:36.548515] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:24:36.548585] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-01T18:24:36.548719] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-01T18:24:36.548779] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-01T18:24:36.549187] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-10-01T18:24:36.549288] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 32.8s. Estimated remaining: 4h 4m 6s. Rate: 7.2 symbols/min [2025-10-01T18:24:36.732179] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:36.784422] [DEBUG] [LOCAL ] DG: Loaded 53284 existing records from primary storage. [2025-10-01T18:24:36.784788] [INFO ] [MAIN ] DG: Loaded 53284 existing records. [2025-10-01T18:24:36.907503] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-01T18:24:36.976164] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:24:36.976379] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-01T18:24:36.976429] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-01T18:24:36.978338] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-01T18:24:36.978404] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-01T18:24:37.474838] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:37.478788] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T18:24:37.702362] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-01T18:24:38.112455] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:24:38.502421] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-01T18:24:39.302347] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-01T18:24:39.419923] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T18:24:39.731140] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-01T18:24:40.102393] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-01T18:24:40.609132] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T18:24:40.871091] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T18:24:40.902378] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-01T18:24:41.702415] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-01T18:24:42.266303] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T18:24:42.502429] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-01T18:24:43.135399] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T18:24:43.302371] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-01T18:24:43.437555] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T18:24:44.105339] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-01T18:24:44.109538] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T18:24:44.902410] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-01T18:24:45.702358] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-01T18:24:45.714738] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T18:24:45.744566] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T18:24:46.502353] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-01T18:24:47.187008] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:24:47.302373] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-01T18:24:47.404239] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-01T18:24:48.102411] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-01T18:24:48.902373] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-01T18:24:49.105557] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T18:24:49.143758] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T18:24:49.702415] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-01T18:24:50.252240] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T18:24:50.502381] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-01T18:24:50.738564] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T18:24:51.302367] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-01T18:24:51.352388] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T18:24:52.102392] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-01T18:24:52.902466] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-01T18:24:53.049160] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T18:24:53.394799] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T18:24:53.702417] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-01T18:24:53.985806] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T18:24:54.502471] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-01T18:24:54.553496] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T18:24:55.302416] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-01T18:24:56.102374] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-01T18:24:56.517343] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T18:24:56.755781] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T18:24:56.755617] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T18:24:56.760332] [INFO ] [REMOTE ] DFH: Full fetch complete (48769 records). [2025-10-01T18:24:56.760818] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-01T18:24:56.907513] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-01T18:24:57.212754] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-01T18:24:57.212884] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-01T18:24:57.213813] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-01T18:24:57.213880] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-01T18:24:57.215190] [DEBUG] [LOCAL ] DFH: Trimmed 48769 records to 32278 (keeping 200 days of data) [2025-10-01T18:24:57.409076] [DEBUG] [LOCAL ] DFH: Primary data saved (32278 records). [2025-10-01T18:24:57.409252] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-01T18:24:57.409345] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFH took 32.9s. Estimated remaining: 4h 4m 33s. Rate: 7.2 symbols/min [2025-10-01T18:24:57.616874] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:57.617056] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-01T18:24:57.617096] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-01T18:24:57.617210] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-01T18:24:57.617251] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-01T18:24:57.617292] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-01T18:24:57.617326] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-01T18:24:57.707584] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-01T18:24:57.909828] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T18:24:57.922324] [INFO ] [REMOTE ] DFP: Full fetch complete (16152 records). [2025-10-01T18:24:57.949391] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-01T18:24:58.170091] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:58.460471] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-01T18:24:58.460569] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-01T18:24:58.460994] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-01T18:24:58.461057] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-01T18:24:58.461605] [DEBUG] [LOCAL ] DFP: Trimmed 16152 records to 11445 (keeping 200 days of data) [2025-10-01T18:24:58.513272] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-01T18:24:58.537590] [DEBUG] [LOCAL ] DFP: Primary data saved (11445 records). [2025-10-01T18:24:58.537768] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-01T18:24:58.537888] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFP took 22.9s. Estimated remaining: 4h 4m 4s. Rate: 7.2 symbols/min [2025-10-01T18:24:58.726623] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:24:58.746989] [DEBUG] [LOCAL ] DHF: Loaded 20733 existing records from primary storage. [2025-10-01T18:24:58.747287] [INFO ] [MAIN ] DHF: Loaded 20733 existing records. [2025-10-01T18:24:58.937377] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:24:58.937686] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-01T18:24:58.937746] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-01T18:24:58.938710] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-01T18:24:58.938774] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-01T18:24:59.313870] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-01T18:24:59.335662] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:24:59.744905] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T18:24:59.829772] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T18:25:00.102444] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-01T18:25:00.902421] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-01T18:25:00.996541] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T18:25:01.285444] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T18:25:01.702418] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-01T18:25:02.502424] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-01T18:25:03.116308] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-01T18:25:03.302412] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-01T18:25:03.358889] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T18:25:03.812375] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T18:25:04.102356] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-01T18:25:04.427785] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T18:25:04.902405] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-01T18:25:05.702382] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-01T18:25:06.025410] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T18:25:06.339957] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T18:25:06.502427] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-01T18:25:06.578660] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T18:25:07.302379] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-01T18:25:07.508432] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T18:25:08.102396] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-01T18:25:08.902370] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-01T18:25:09.036442] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T18:25:09.537941] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-01T18:25:09.539062] [INFO ] [REMOTE ] DFIN: Full fetch complete (33618 records). [2025-10-01T18:25:09.539203] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-01T18:25:09.706969] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-01T18:25:09.963302] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-01T18:25:09.963448] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-01T18:25:09.964107] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-01T18:25:09.969385] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-01T18:25:09.979348] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T18:25:09.985339] [DEBUG] [LOCAL ] DFIN: Trimmed 33618 records to 23029 (keeping 200 days of data) [2025-10-01T18:25:10.139767] [DEBUG] [LOCAL ] DFIN: Primary data saved (23029 records). [2025-10-01T18:25:10.140227] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-01T18:25:10.140339] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 45.4s. Estimated remaining: 4h 4m 5s. Rate: 7.2 symbols/min [2025-10-01T18:25:10.330425] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:25:10.393516] [DEBUG] [LOCAL ] DHI: Loaded 53349 existing records from primary storage. [2025-10-01T18:25:10.393919] [INFO ] [MAIN ] DHI: Loaded 53349 existing records. [2025-10-01T18:25:10.506404] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-01T18:25:10.602898] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:25:10.603150] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-01T18:25:10.603274] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-01T18:25:10.605412] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-01T18:25:10.605488] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-01T18:25:11.019453] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:25:11.302358] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-01T18:25:11.459512] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T18:25:12.026400] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T18:25:12.102380] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-01T18:25:12.385330] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T18:25:12.902377] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-01T18:25:13.420438] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T18:25:13.702368] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-01T18:25:14.502425] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-01T18:25:14.719159] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T18:25:15.302437] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-01T18:25:15.656424] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-01T18:25:15.951394] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T18:25:16.102390] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-01T18:25:16.902395] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-01T18:25:17.577172] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T18:25:17.702386] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-01T18:25:17.942905] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-01T18:25:17.947373] [INFO ] [REMOTE ] DG: Full fetch complete (77215 records). [2025-10-01T18:25:17.947504] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-01T18:25:18.389712] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-01T18:25:18.389815] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-01T18:25:18.390701] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-01T18:25:18.390767] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-01T18:25:18.392971] [DEBUG] [LOCAL ] DG: Trimmed 77215 records to 53283 (keeping 200 days of data) [2025-10-01T18:25:18.502577] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-01T18:25:18.844053] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T18:25:18.867879] [DEBUG] [LOCAL ] DG: Primary data saved (53283 records). [2025-10-01T18:25:18.868038] [INFO ] [MAIN ] DG: Full history saved. [2025-10-01T18:25:18.868142] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 42.3s. Estimated remaining: 4h 3m 58s. Rate: 7.2 symbols/min [2025-10-01T18:25:19.084636] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:25:19.114922] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T18:25:19.177999] [DEBUG] [LOCAL ] DHR: Loaded 53365 existing records from primary storage. [2025-10-01T18:25:19.178433] [INFO ] [MAIN ] DHR: Loaded 53365 existing records. [2025-10-01T18:25:19.307544] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-01T18:25:19.387791] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:25:19.388214] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-01T18:25:19.388276] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-01T18:25:19.390257] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-01T18:25:19.390322] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-01T18:25:19.745579] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T18:25:19.863897] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:25:20.102395] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-01T18:25:20.902401] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-01T18:25:20.950517] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T18:25:21.008115] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T18:25:21.702384] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-01T18:25:22.502406] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-01T18:25:22.785692] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T18:25:23.072918] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-01T18:25:23.302401] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-01T18:25:24.102382] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-01T18:25:24.322708] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T18:25:24.834915] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T18:25:24.902402] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-01T18:25:25.158631] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T18:25:25.702379] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-01T18:25:26.502398] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-01T18:25:26.684321] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T18:25:26.737979] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-01T18:25:26.740877] [INFO ] [REMOTE ] DGX: Full fetch complete (65107 records). [2025-10-01T18:25:26.741053] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-01T18:25:27.179559] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-01T18:25:27.179676] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-01T18:25:27.180709] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-01T18:25:27.180776] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-01T18:25:27.182215] [DEBUG] [LOCAL ] DGX: Trimmed 65107 records to 44915 (keeping 200 days of data) [2025-10-01T18:25:27.302923] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-01T18:25:27.483746] [DEBUG] [LOCAL ] DGX: Primary data saved (44915 records). [2025-10-01T18:25:27.483889] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-01T18:25:27.483964] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DGX took 30.1s. Estimated remaining: 4h 3m 51s. Rate: 7.2 symbols/min [2025-10-01T18:25:27.673398] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:25:27.673618] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-01T18:25:27.673732] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-01T18:25:27.673823] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-01T18:25:27.673865] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-01T18:25:27.673908] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-01T18:25:27.673962] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-01T18:25:28.073578] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:25:28.102380] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-01T18:25:28.247256] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T18:25:28.902403] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-01T18:25:29.122093] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T18:25:29.284384] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T18:25:29.286328] [INFO ] [REMOTE ] DHF: Full fetch complete (29913 records). [2025-10-01T18:25:29.286476] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-01T18:25:29.707597] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-01T18:25:29.759493] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-01T18:25:29.759612] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-01T18:25:29.760300] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-01T18:25:29.760541] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-01T18:25:29.762044] [DEBUG] [LOCAL ] DHF: Trimmed 29913 records to 20944 (keeping 200 days of data) [2025-10-01T18:25:29.895014] [DEBUG] [LOCAL ] DHF: Primary data saved (20944 records). [2025-10-01T18:25:29.895148] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-01T18:25:29.895250] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHF took 31.4s. Estimated remaining: 4h 3m 25s. Rate: 7.2 symbols/min [2025-10-01T18:25:30.099968] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:25:30.115854] [DEBUG] [LOCAL ] DHX: Loaded 13063 existing records from primary storage. [2025-10-01T18:25:30.116112] [INFO ] [MAIN ] DHX: Loaded 13063 existing records. [2025-10-01T18:25:30.316419] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:25:30.316689] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-01T18:25:30.316787] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-01T18:25:30.317255] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-01T18:25:30.317324] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-01T18:25:30.517396] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-01T18:25:30.762097] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:25:30.844158] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T18:25:31.238138] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T18:25:31.302422] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-01T18:25:31.945939] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T18:25:32.102377] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-01T18:25:32.564267] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T18:25:32.902402] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-01T18:25:33.702447] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-01T18:25:33.863530] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T18:25:34.488871] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T18:25:34.502406] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-01T18:25:34.866271] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T18:25:35.302402] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-01T18:25:35.903560] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T18:25:36.102466] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-01T18:25:36.902356] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-01T18:25:37.063331] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T18:25:37.702388] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-01T18:25:37.775970] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T18:25:37.998428] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T18:25:38.502451] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-01T18:25:39.277358] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T18:25:39.302406] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-01T18:25:39.346148] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T18:25:40.102388] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-01T18:25:40.173730] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T18:25:40.902380] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-01T18:25:41.702433] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-01T18:25:42.014783] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T18:25:42.502366] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-01T18:25:42.568016] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T18:25:43.178937] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:25:43.302398] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-01T18:25:44.102367] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-01T18:25:44.452033] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T18:25:44.902450] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-01T18:25:45.209523] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T18:25:45.296744] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T18:25:45.702463] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-01T18:25:46.411545] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T18:25:46.502410] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-01T18:25:47.102157] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-01T18:25:47.302419] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-01T18:25:47.921810] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T18:25:48.044587] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T18:25:48.102385] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-01T18:25:48.902451] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-01T18:25:49.524857] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T18:25:49.702429] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-01T18:25:50.502399] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-01T18:25:50.766175] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T18:25:51.027260] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T18:25:51.302383] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-01T18:25:51.470920] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T18:25:51.862665] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T18:25:52.102423] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-01T18:25:52.902388] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-01T18:25:53.702381] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-01T18:25:53.770990] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T18:25:53.963280] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T18:25:53.964191] [INFO ] [REMOTE ] DHX: Full fetch complete (20803 records). [2025-10-01T18:25:53.964283] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-01T18:25:54.417437] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-01T18:25:54.417533] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-01T18:25:54.418146] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-01T18:25:54.418214] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-01T18:25:54.419073] [DEBUG] [LOCAL ] DHX: Trimmed 20803 records to 13054 (keeping 200 days of data) [2025-10-01T18:25:54.495608] [DEBUG] [LOCAL ] DHX: Primary data saved (13054 records). [2025-10-01T18:25:54.495794] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-01T18:25:54.495887] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHX took 24.6s. Estimated remaining: 4h 4m 3s. Rate: 7.2 symbols/min [2025-10-01T18:25:54.507977] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-01T18:25:54.694469] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:25:54.694676] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-01T18:25:54.694733] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-01T18:25:54.694848] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-01T18:25:54.694894] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-01T18:25:54.694938] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-01T18:25:54.694973] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-01T18:25:55.109775] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:25:55.302429] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-01T18:25:56.102395] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-01T18:25:56.503550] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-01T18:25:56.559962] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-01T18:25:56.655805] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-01T18:25:56.780157] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T18:25:56.902404] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-01T18:25:57.702397] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-01T18:25:58.483578] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T18:25:58.502336] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-01T18:25:59.241525] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T18:25:59.247410] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-01T18:25:59.249175] [INFO ] [REMOTE ] DHR: Full fetch complete (77274 records). [2025-10-01T18:25:59.249302] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-01T18:25:59.310427] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-01T18:25:59.692603] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-01T18:25:59.692735] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-01T18:25:59.693712] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-01T18:25:59.693779] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-01T18:25:59.695427] [DEBUG] [LOCAL ] DHR: Trimmed 77274 records to 53366 (keeping 200 days of data) [2025-10-01T18:26:00.056398] [DEBUG] [LOCAL ] DHR: Primary data saved (53366 records). [2025-10-01T18:26:00.056545] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-01T18:26:00.056631] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHR took 41.2s. Estimated remaining: 4h 3m 47s. Rate: 7.2 symbols/min [2025-10-01T18:26:00.107546] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-01T18:26:00.245524] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:00.284599] [DEBUG] [LOCAL ] DIN: Loaded 37165 existing records from primary storage. [2025-10-01T18:26:00.284958] [INFO ] [MAIN ] DIN: Loaded 37165 existing records. [2025-10-01T18:26:00.478897] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:26:00.479177] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-01T18:26:00.479233] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-01T18:26:00.480362] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-01T18:26:00.480437] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-01T18:26:00.846071] [DEBUG] [REMOTE ] DHI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:26:00.878950] [WARN ] [REMOTE ] DHI: No data returned for month 2025-10 [2025-10-01T18:26:00.885188] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:00.885432] [FATAL] [REMOTE ] DHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:26:00.885906] [FATAL] [MAIN ] DHI: Failed to fetch primary data. [2025-10-01T18:26:00.885983] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:26:00.886061] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-01T18:26:00.886138] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-01T18:26:00.886177] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-01T18:26:00.886625] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-01T18:26:00.886752] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHI took 50.7s. Estimated remaining: 4h 3m 18s. Rate: 7.2 symbols/min [2025-10-01T18:26:00.910310] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-01T18:26:01.081306] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:01.081487] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-01T18:26:01.081575] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-01T18:26:01.081686] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-01T18:26:01.081746] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-01T18:26:01.081789] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-01T18:26:01.081824] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-01T18:26:01.483575] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:01.665943] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-01T18:26:01.702395] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-01T18:26:02.197721] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T18:26:02.199416] [INFO ] [REMOTE ] DHT: Full fetch complete (69972 records). [2025-10-01T18:26:02.199567] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-01T18:26:02.509753] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-01T18:26:02.646672] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-01T18:26:02.646777] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-01T18:26:02.647687] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-01T18:26:02.647754] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-01T18:26:02.649279] [DEBUG] [LOCAL ] DHT: Trimmed 69972 records to 47876 (keeping 200 days of data) [2025-10-01T18:26:02.963193] [DEBUG] [LOCAL ] DHT: Primary data saved (47876 records). [2025-10-01T18:26:02.963340] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-01T18:26:02.963421] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHT took 35.5s. Estimated remaining: 4h 2m 52s. Rate: 7.2 symbols/min [2025-10-01T18:26:03.169916] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:03.196300] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T18:26:03.257224] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-01T18:26:03.268636] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-01T18:26:03.274767] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T18:26:03.307518] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-01T18:26:03.487720] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:26:03.488050] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-01T18:26:03.488118] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-01T18:26:03.489625] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-01T18:26:03.489715] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-01T18:26:03.902050] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:04.102386] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-01T18:26:04.902413] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-01T18:26:04.918541] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T18:26:05.250962] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T18:26:05.702402] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-01T18:26:05.964619] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T18:26:06.502402] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-01T18:26:07.302436] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-01T18:26:08.102359] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-01T18:26:08.281205] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-01T18:26:08.302040] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T18:26:08.439855] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T18:26:08.902409] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-01T18:26:09.523582] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T18:26:09.702400] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-01T18:26:10.502402] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-01T18:26:10.589377] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T18:26:11.194513] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T18:26:11.302383] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-01T18:26:12.102391] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-01T18:26:12.694948] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T18:26:12.911440] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-01T18:26:12.918248] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-01T18:26:13.262741] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T18:26:13.702379] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-01T18:26:14.502434] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-01T18:26:14.597433] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T18:26:15.302384] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-01T18:26:15.973200] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-01T18:26:16.056838] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T18:26:16.102346] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-01T18:26:16.902387] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-01T18:26:16.982902] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T18:26:17.702410] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-01T18:26:17.744259] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-01T18:26:18.137208] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T18:26:18.502385] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-01T18:26:19.008575] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T18:26:19.302398] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-01T18:26:19.502852] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T18:26:20.102404] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-01T18:26:20.886474] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T18:26:20.902375] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-01T18:26:21.473741] [DEBUG] [REMOTE ] DIAX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:26:21.474116] [WARN ] [REMOTE ] DIAX: No data returned for month 2025-10 [2025-10-01T18:26:21.474194] [FATAL] [REMOTE ] DIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:26:21.474305] [FATAL] [MAIN ] DIAX: Failed to fetch primary data. [2025-10-01T18:26:21.474382] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:26:21.474459] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-01T18:26:21.474567] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-01T18:26:21.474627] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-10-01T18:26:21.474734] [DEBUG] [LOCAL ] DIAX: No derivative data file found to delete. [2025-10-01T18:26:21.474819] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 27.0s. Estimated remaining: 4h 3m 12s. Rate: 7.2 symbols/min [2025-10-01T18:26:21.680300] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:21.680477] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-01T18:26:21.680519] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-01T18:26:21.680683] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-01T18:26:21.680789] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-01T18:26:21.680855] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-01T18:26:21.680894] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-01T18:26:21.707567] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-01T18:26:22.091328] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:22.300011] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-01T18:26:22.502378] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-01T18:26:23.173142] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T18:26:23.302384] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-01T18:26:23.795986] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T18:26:24.102373] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-01T18:26:24.902375] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-01T18:26:25.602428] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T18:26:25.638344] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T18:26:25.703872] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-01T18:26:25.707139] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-01T18:26:26.028833] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-01T18:26:26.502451] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-01T18:26:26.852007] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-01T18:26:27.302399] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-01T18:26:28.102432] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-01T18:26:28.902426] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-01T18:26:29.533818] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-01T18:26:29.702397] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-01T18:26:29.794834] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T18:26:30.135225] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T18:26:30.232947] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T18:26:30.502401] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-01T18:26:31.302442] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-01T18:26:32.102423] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-01T18:26:32.545608] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T18:26:32.655740] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-01T18:26:32.657689] [INFO ] [REMOTE ] DIN: Full fetch complete (55233 records). [2025-10-01T18:26:32.657801] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-01T18:26:32.907525] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-01T18:26:33.109628] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-01T18:26:33.109799] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-01T18:26:33.110533] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-01T18:26:33.110617] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-01T18:26:33.146299] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T18:26:33.144475] [DEBUG] [LOCAL ] DIN: Trimmed 55233 records to 37210 (keeping 200 days of data) [2025-10-01T18:26:33.346967] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T18:26:33.404023] [DEBUG] [LOCAL ] DIN: Primary data saved (37210 records). [2025-10-01T18:26:33.404173] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-01T18:26:33.404259] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 33.3s. Estimated remaining: 4h 3m 14s. Rate: 7.2 symbols/min [2025-10-01T18:26:33.652900] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:33.706830] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-01T18:26:33.709524] [DEBUG] [LOCAL ] DK: Loaded 49340 existing records from primary storage. [2025-10-01T18:26:33.709971] [INFO ] [MAIN ] DK: Loaded 49340 existing records. [2025-10-01T18:26:33.927741] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:26:33.928038] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-01T18:26:33.928088] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-01T18:26:33.929260] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-01T18:26:33.929327] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-01T18:26:34.130817] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-01T18:26:34.360424] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:34.502455] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-01T18:26:35.302402] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-01T18:26:35.751589] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T18:26:35.795543] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T18:26:36.102378] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-01T18:26:36.441055] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-01T18:26:36.902466] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-01T18:26:37.287542] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-01T18:26:37.702433] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-01T18:26:38.254296] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-01T18:26:38.255204] [INFO ] [REMOTE ] DIVY: Full fetch complete (1725 records). [2025-10-01T18:26:38.255313] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-01T18:26:38.452965] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T18:26:38.453177] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:26:38.453249] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:26:38.453323] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-01T18:26:38.453389] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-01T18:26:38.453427] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-01T18:26:38.453470] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-01T18:26:38.453558] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIVY took 17.0s. Estimated remaining: 4h 2m 56s. Rate: 7.2 symbols/min [2025-10-01T18:26:38.512129] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-01T18:26:38.648289] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:38.648484] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-01T18:26:38.648523] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-01T18:26:38.648634] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-01T18:26:38.648714] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-01T18:26:38.648766] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-01T18:26:38.648801] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-01T18:26:39.058662] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:39.302383] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-01T18:26:40.102372] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-01T18:26:40.619147] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T18:26:40.822886] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-01T18:26:40.902361] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-01T18:26:41.595206] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T18:26:41.702423] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-01T18:26:42.502426] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-01T18:26:43.102477] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T18:26:43.310148] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-01T18:26:43.330936] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-01T18:26:43.910852] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T18:26:44.102400] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-01T18:26:44.883901] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T18:26:44.902344] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-01T18:26:45.702371] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-01T18:26:45.910287] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T18:26:46.075322] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T18:26:46.502435] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-01T18:26:47.302403] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-01T18:26:47.788854] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T18:26:47.791539] [INFO ] [REMOTE ] DINO: Full fetch complete (76671 records). [2025-10-01T18:26:47.791674] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-01T18:26:48.112781] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-01T18:26:48.221998] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-01T18:26:48.222089] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-01T18:26:48.222976] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-01T18:26:48.223042] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-01T18:26:48.224547] [DEBUG] [LOCAL ] DINO: Trimmed 76671 records to 52932 (keeping 200 days of data) [2025-10-01T18:26:48.556703] [DEBUG] [LOCAL ] DINO: Primary data saved (52932 records). [2025-10-01T18:26:48.556845] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-01T18:26:48.556931] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DINO took 47.7s. Estimated remaining: 4h 2m 53s. Rate: 7.2 symbols/min [2025-10-01T18:26:48.765764] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:48.846778] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T18:26:48.859028] [DEBUG] [LOCAL ] DKS: Loaded 49778 existing records from primary storage. [2025-10-01T18:26:48.859911] [INFO ] [MAIN ] DKS: Loaded 49778 existing records. [2025-10-01T18:26:48.907534] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-01T18:26:49.063722] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:26:49.064021] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-01T18:26:49.064083] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-01T18:26:49.065515] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-01T18:26:49.065592] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-01T18:26:49.361312] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T18:26:49.486134] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:49.489788] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-01T18:26:49.491457] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-10-01T18:26:49.491552] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-01T18:26:49.709249] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-01T18:26:49.934685] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-01T18:26:49.934785] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-01T18:26:49.935687] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-01T18:26:49.935753] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-01T18:26:49.937262] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 53788 (keeping 200 days of data) [2025-10-01T18:26:50.293365] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-01T18:26:50.293507] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-01T18:26:50.293614] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DIS took 47.3s. Estimated remaining: 4h 2m 26s. Rate: 7.2 symbols/min [2025-10-01T18:26:50.504473] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-01T18:26:50.504356] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:26:50.536275] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T18:26:50.575159] [DEBUG] [LOCAL ] DLB: Loaded 31999 existing records from primary storage. [2025-10-01T18:26:50.575441] [INFO ] [MAIN ] DLB: Loaded 31999 existing records. [2025-10-01T18:26:50.771224] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:26:50.771460] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-01T18:26:50.771575] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-01T18:26:50.772823] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-01T18:26:50.772887] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-01T18:26:51.180776] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:26:51.302390] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-01T18:26:51.491527] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T18:26:51.773762] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T18:26:52.102404] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-01T18:26:52.514329] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T18:26:52.902379] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-01T18:26:53.702355] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-01T18:26:53.793769] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T18:26:54.393847] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T18:26:54.502387] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-01T18:26:55.302377] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-01T18:26:55.392077] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T18:26:55.787743] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T18:26:56.102410] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-01T18:26:56.739664] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T18:26:56.902390] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-01T18:26:57.536617] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T18:26:57.702403] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-01T18:26:58.502365] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-01T18:26:58.607691] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T18:26:59.177409] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T18:26:59.302418] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-01T18:26:59.872766] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T18:27:00.102424] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-01T18:27:00.834514] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T18:27:00.902371] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-01T18:27:01.702399] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-01T18:27:01.960197] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T18:27:02.502433] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-01T18:27:03.145192] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-01T18:27:03.184223] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:27:03.302368] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-01T18:27:03.493283] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T18:27:04.102383] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-01T18:27:04.506428] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T18:27:04.902379] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-01T18:27:05.166073] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T18:27:05.702375] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-01T18:27:06.502375] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-01T18:27:06.693692] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T18:27:07.199302] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T18:27:07.200846] [INFO ] [REMOTE ] DK: Full fetch complete (70820 records). [2025-10-01T18:27:07.200944] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-01T18:27:07.309183] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-01T18:27:07.632145] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-01T18:27:07.632230] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-01T18:27:07.633205] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-01T18:27:07.633273] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-01T18:27:07.634682] [DEBUG] [LOCAL ] DK: Trimmed 70820 records to 49338 (keeping 200 days of data) [2025-10-01T18:27:07.951195] [DEBUG] [LOCAL ] DK: Primary data saved (49338 records). [2025-10-01T18:27:07.951362] [INFO ] [MAIN ] DK: Full history saved. [2025-10-01T18:27:07.951478] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DK took 34.5s. Estimated remaining: 4h 2m 44s. Rate: 7.2 symbols/min [2025-10-01T18:27:08.108264] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-01T18:27:08.145377] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:27:08.146040] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-10-01T18:27:08.146245] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-10-01T18:27:08.146372] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-01T18:27:08.146418] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-01T18:27:08.146463] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-01T18:27:08.146498] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-01T18:27:08.554257] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:27:08.601109] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-01T18:27:08.602383] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T18:27:08.902362] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-01T18:27:09.038085] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T18:27:09.702451] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-01T18:27:10.297691] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T18:27:10.419759] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T18:27:10.502396] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-01T18:27:11.302380] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-01T18:27:11.357070] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T18:27:12.102397] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-01T18:27:12.729457] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T18:27:12.902385] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-01T18:27:13.076726] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T18:27:13.077626] [INFO ] [REMOTE ] DKL: Full fetch complete (28777 records). [2025-10-01T18:27:13.077732] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-01T18:27:13.492244] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-01T18:27:13.492344] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-01T18:27:13.492926] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-01T18:27:13.492990] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-01T18:27:13.493929] [DEBUG] [LOCAL ] DKL: Trimmed 28777 records to 18651 (keeping 200 days of data) [2025-10-01T18:27:13.613125] [DEBUG] [LOCAL ] DKL: Primary data saved (18651 records). [2025-10-01T18:27:13.613282] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-01T18:27:13.613361] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKL took 35.2s. Estimated remaining: 4h 2m 28s. Rate: 7.2 symbols/min [2025-10-01T18:27:13.707486] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-01T18:27:13.811251] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:27:13.883798] [DEBUG] [LOCAL ] DLR: Loaded 50973 existing records from primary storage. [2025-10-01T18:27:13.884143] [INFO ] [MAIN ] DLR: Loaded 50973 existing records. [2025-10-01T18:27:14.105247] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:27:14.107076] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T18:27:14.114133] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-01T18:27:14.114638] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-01T18:27:14.115756] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-01T18:27:14.115824] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-01T18:27:14.503801] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:27:14.503880] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-01T18:27:15.302362] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-01T18:27:15.792810] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-01T18:27:16.102384] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-01T18:27:16.331253] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-01T18:27:16.332567] [INFO ] [REMOTE ] DLB: Full fetch complete (46926 records). [2025-10-01T18:27:16.332713] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-01T18:27:16.781174] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-01T18:27:16.781319] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-01T18:27:16.782106] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-01T18:27:16.782172] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-01T18:27:16.783222] [DEBUG] [LOCAL ] DLB: Trimmed 46926 records to 32001 (keeping 200 days of data) [2025-10-01T18:27:16.902364] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-01T18:27:16.991774] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T18:27:17.004350] [DEBUG] [LOCAL ] DLB: Primary data saved (32001 records). [2025-10-01T18:27:17.004570] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-01T18:27:17.004692] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLB took 26.7s. Estimated remaining: 4h 2m 6s. Rate: 7.2 symbols/min [2025-10-01T18:27:17.192439] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:27:17.224007] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-01T18:27:17.260334] [DEBUG] [LOCAL ] DLX: Loaded 28553 existing records from primary storage. [2025-10-01T18:27:17.260670] [INFO ] [MAIN ] DLX: Loaded 28553 existing records. [2025-10-01T18:27:17.464057] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:27:17.464467] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-01T18:27:17.464548] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-01T18:27:17.465321] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-01T18:27:17.465385] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-01T18:27:17.707543] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-01T18:27:17.868751] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:27:18.502383] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-01T18:27:18.783082] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T18:27:18.783570] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T18:27:19.302374] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-01T18:27:20.102376] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-01T18:27:20.368521] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-01T18:27:20.902414] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-01T18:27:20.948946] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T18:27:21.349602] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-01T18:27:21.702376] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-01T18:27:22.022741] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T18:27:22.502378] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-01T18:27:23.302434] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-01T18:27:23.466461] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T18:27:23.930179] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T18:27:24.102419] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-01T18:27:24.276017] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-01T18:27:24.277590] [INFO ] [REMOTE ] DKS: Full fetch complete (71633 records). [2025-10-01T18:27:24.277723] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-01T18:27:24.714307] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-01T18:27:24.714391] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-01T18:27:24.715345] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-01T18:27:24.715411] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-01T18:27:24.717013] [DEBUG] [LOCAL ] DKS: Trimmed 71633 records to 49749 (keeping 200 days of data) [2025-10-01T18:27:24.907381] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-01T18:27:25.058294] [DEBUG] [LOCAL ] DKS: Primary data saved (49749 records). [2025-10-01T18:27:25.058590] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-01T18:27:25.058786] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DKS took 36.5s. Estimated remaining: 4h 1m 57s. Rate: 7.2 symbols/min [2025-10-01T18:27:25.245486] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:27:25.269264] [DEBUG] [LOCAL ] DLY: Loaded 19680 existing records from primary storage. [2025-10-01T18:27:25.269503] [INFO ] [MAIN ] DLY: Loaded 19680 existing records. [2025-10-01T18:27:25.470247] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:27:25.470915] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-01T18:27:25.471165] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-01T18:27:25.496578] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-01T18:27:25.498621] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-01T18:27:25.499453] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T18:27:25.513033] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T18:27:25.707696] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-01T18:27:25.932238] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:27:26.502432] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-01T18:27:27.114117] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T18:27:27.208727] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T18:27:27.302396] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-01T18:27:27.907160] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T18:27:28.102441] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-01T18:27:28.902448] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-01T18:27:29.504354] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T18:27:29.702683] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-01T18:27:30.018231] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T18:27:30.502409] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-01T18:27:31.152147] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T18:27:31.302445] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-01T18:27:32.102382] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-01T18:27:32.202200] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T18:27:32.399616] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T18:27:32.547226] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-01T18:27:32.902408] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-01T18:27:33.521766] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T18:27:33.702410] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-01T18:27:34.502422] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-01T18:27:34.630590] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T18:27:35.302388] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-01T18:27:35.985115] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T18:27:35.986406] [INFO ] [REMOTE ] DLNG: Full fetch complete (11978 records). [2025-10-01T18:27:35.986495] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-01T18:27:36.107575] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-01T18:27:36.401237] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-01T18:27:36.401383] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-01T18:27:36.401933] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-01T18:27:36.402035] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-01T18:27:36.403400] [DEBUG] [LOCAL ] DLNG: Trimmed 11978 records to 6106 (keeping 200 days of data) [2025-10-01T18:27:36.444198] [DEBUG] [LOCAL ] DLNG: Primary data saved (6106 records). [2025-10-01T18:27:36.444359] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-01T18:27:36.444604] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLNG took 28.5s. Estimated remaining: 4h 1m 57s. Rate: 7.2 symbols/min [2025-10-01T18:27:36.589145] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T18:27:36.725192] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:27:36.732409] [DEBUG] [LOCAL ] DMA: Loaded 4549 existing records from primary storage. [2025-10-01T18:27:36.732621] [INFO ] [MAIN ] DMA: Loaded 4549 existing records. [2025-10-01T18:27:36.912440] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-01T18:27:36.948778] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:27:36.949035] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-01T18:27:36.949092] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-01T18:27:36.949431] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-01T18:27:36.949492] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-01T18:27:37.368475] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:27:37.649385] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T18:27:37.683179] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T18:27:37.702379] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-01T18:27:38.502441] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-01T18:27:38.772896] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T18:27:38.964349] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-01T18:27:39.302409] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-01T18:27:39.699360] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-01T18:27:40.102391] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-01T18:27:40.507536] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T18:27:40.902421] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-01T18:27:41.349292] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T18:27:41.702390] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-01T18:27:42.071971] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-01T18:27:42.502386] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-01T18:27:42.975016] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T18:27:43.302386] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-01T18:27:43.627819] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-01T18:27:44.102423] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-01T18:27:44.902396] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-01T18:27:45.702349] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-01T18:27:45.805237] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T18:27:45.825507] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-01T18:27:46.502465] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-01T18:27:46.869221] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T18:27:47.302423] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-01T18:27:47.802773] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-01T18:27:48.102405] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-01T18:27:48.163164] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T18:27:48.902409] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-01T18:27:49.131068] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T18:27:49.702393] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-01T18:27:50.507484] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-01T18:27:50.517444] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T18:27:50.701589] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T18:27:51.302399] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-01T18:27:51.948627] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T18:27:52.102400] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-01T18:27:52.312318] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T18:27:52.902398] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-01T18:27:53.204832] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T18:27:53.702365] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-01T18:27:54.029700] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T18:27:54.486158] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T18:27:54.502413] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-01T18:27:55.302360] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-01T18:27:55.771705] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T18:27:56.102404] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-01T18:27:56.581785] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T18:27:56.879722] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T18:27:56.902390] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-01T18:27:57.702358] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-01T18:27:58.133811] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T18:27:58.404001] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-01T18:27:58.404853] [INFO ] [REMOTE ] DMA: Full fetch complete (6642 records). [2025-10-01T18:27:58.404931] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-01T18:27:58.510100] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-01T18:27:58.796802] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-01T18:27:58.796883] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-01T18:27:58.797079] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-01T18:27:58.797139] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-01T18:27:58.797521] [DEBUG] [LOCAL ] DMA: Trimmed 6642 records to 4559 (keeping 200 days of data) [2025-10-01T18:27:58.825405] [DEBUG] [LOCAL ] DMA: Primary data saved (4559 records). [2025-10-01T18:27:58.825533] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-01T18:27:58.825639] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DMA took 22.4s. Estimated remaining: 4h 2m 27s. Rate: 7.2 symbols/min [2025-10-01T18:27:59.008521] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:27:59.008949] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-01T18:27:59.009024] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-01T18:27:59.009143] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-01T18:27:59.009231] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-01T18:27:59.009301] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-01T18:27:59.009341] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-01T18:27:59.307458] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-01T18:27:59.397536] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:27:59.865975] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T18:27:59.867083] [INFO ] [REMOTE ] DLX: Full fetch complete (41358 records). [2025-10-01T18:27:59.867164] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-01T18:28:00.112632] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-01T18:28:00.300353] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-01T18:28:00.300445] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-01T18:28:00.301276] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-01T18:28:00.301351] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-01T18:28:00.302505] [DEBUG] [LOCAL ] DLX: Trimmed 41358 records to 28490 (keeping 200 days of data) [2025-10-01T18:28:00.492736] [DEBUG] [LOCAL ] DLX: Primary data saved (28490 records). [2025-10-01T18:28:00.492877] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-01T18:28:00.492961] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLX took 43.5s. Estimated remaining: 4h 2m 0s. Rate: 7.2 symbols/min [2025-10-01T18:28:00.687426] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:28:00.699442] [DEBUG] [LOCAL ] DMO: Loaded 9860 existing records from primary storage. [2025-10-01T18:28:00.699811] [INFO ] [MAIN ] DMO: Loaded 9860 existing records. [2025-10-01T18:28:00.911384] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-01T18:28:00.911231] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:28:00.911710] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-01T18:28:00.912584] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-01T18:28:00.913009] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-01T18:28:00.913286] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-01T18:28:01.023889] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-01T18:28:01.029168] [INFO ] [REMOTE ] DLY: Full fetch complete (28345 records). [2025-10-01T18:28:01.034911] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-01T18:28:01.392321] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T18:28:01.626498] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:28:01.707466] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-01T18:28:01.813599] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-01T18:28:01.813739] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-01T18:28:01.814310] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-01T18:28:01.814379] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-01T18:28:01.815470] [DEBUG] [LOCAL ] DLY: Trimmed 28345 records to 19878 (keeping 200 days of data) [2025-10-01T18:28:01.954125] [DEBUG] [LOCAL ] DLY: Primary data saved (19878 records). [2025-10-01T18:28:01.954283] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-01T18:28:01.954395] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLY took 36.9s. Estimated remaining: 4h 1m 33s. Rate: 7.2 symbols/min [2025-10-01T18:28:02.148111] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:28:02.200386] [DEBUG] [LOCAL ] DNA: Loaded 48267 existing records from primary storage. [2025-10-01T18:28:02.200782] [INFO ] [MAIN ] DNA: Loaded 48267 existing records. [2025-10-01T18:28:02.402738] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:28:02.402964] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-01T18:28:02.403126] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-01T18:28:02.404516] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-01T18:28:02.404581] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-01T18:28:02.527813] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-01T18:28:02.754115] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T18:28:02.796624] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T18:28:02.889548] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:28:03.302404] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-01T18:28:03.461686] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T18:28:04.102387] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-01T18:28:04.904882] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-01T18:28:04.907370] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T18:28:05.278831] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T18:28:05.702382] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-01T18:28:06.502390] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-01T18:28:07.042794] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T18:28:07.302356] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-01T18:28:07.420223] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T18:28:07.505622] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-01T18:28:07.507637] [INFO ] [REMOTE ] DLR: Full fetch complete (74112 records). [2025-10-01T18:28:07.507895] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-01T18:28:07.837890] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-01T18:28:07.973478] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-01T18:28:07.973571] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-01T18:28:07.974498] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-01T18:28:07.974566] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-01T18:28:07.976111] [DEBUG] [LOCAL ] DLR: Trimmed 74112 records to 50958 (keeping 200 days of data) [2025-10-01T18:28:08.102373] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-01T18:28:08.332616] [DEBUG] [LOCAL ] DLR: Primary data saved (50958 records). [2025-10-01T18:28:08.332797] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-01T18:28:08.332920] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLR took 54.7s. Estimated remaining: 4h 1m 19s. Rate: 7.2 symbols/min [2025-10-01T18:28:08.537347] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:28:08.592738] [DEBUG] [LOCAL ] DNOW: Loaded 43657 existing records from primary storage. [2025-10-01T18:28:08.593206] [INFO ] [MAIN ] DNOW: Loaded 43657 existing records. [2025-10-01T18:28:08.813237] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:28:08.813482] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-01T18:28:08.813537] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-01T18:28:08.814517] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-01T18:28:08.814580] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-01T18:28:08.907476] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-01T18:28:09.216982] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:28:09.560427] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T18:28:09.702389] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-01T18:28:10.117617] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-01T18:28:10.502391] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-01T18:28:11.282442] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T18:28:11.302344] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-01T18:28:12.102367] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-01T18:28:12.363622] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T18:28:12.462541] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T18:28:12.902387] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-01T18:28:13.105393] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T18:28:13.702377] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-01T18:28:14.346461] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T18:28:14.502380] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-01T18:28:15.302377] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-01T18:28:15.478935] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T18:28:15.890134] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T18:28:16.102382] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-01T18:28:16.316855] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T18:28:16.902369] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-01T18:28:17.702378] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-01T18:28:17.882284] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T18:28:17.927454] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T18:28:18.502408] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-01T18:28:19.001615] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-01T18:28:19.302427] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-01T18:28:19.454142] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T18:28:20.102418] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-01T18:28:20.827996] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T18:28:20.902415] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-01T18:28:21.110606] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T18:28:21.535425] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T18:28:21.702403] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-01T18:28:22.402058] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T18:28:22.502385] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-01T18:28:23.302394] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-01T18:28:23.322583] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T18:28:24.102400] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-01T18:28:24.556056] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T18:28:24.902420] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-01T18:28:25.621068] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T18:28:25.702421] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-01T18:28:26.418620] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-01T18:28:26.502386] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-01T18:28:26.899041] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T18:28:27.288853] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T18:28:27.302386] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-01T18:28:28.102404] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-01T18:28:28.902394] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-01T18:28:29.080727] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T18:28:29.503614] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T18:28:29.672171] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T18:28:29.702353] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-01T18:28:30.502351] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-01T18:28:30.512394] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T18:28:31.302389] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-01T18:28:32.004630] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T18:28:32.102377] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-01T18:28:32.902416] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-01T18:28:33.268711] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T18:28:33.575510] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T18:28:33.671498] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T18:28:33.702398] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-01T18:28:34.502428] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-01T18:28:35.157158] [DEBUG] [REMOTE ] DNA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:28:35.157526] [WARN ] [REMOTE ] DNA: No data returned for month 2025-10 [2025-10-01T18:28:35.157631] [FATAL] [REMOTE ] DNA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:28:35.157759] [FATAL] [MAIN ] DNA: Failed to fetch primary data. [2025-10-01T18:28:35.157898] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:28:35.157978] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-01T18:28:35.158047] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-01T18:28:35.158094] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-10-01T18:28:35.158488] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-10-01T18:28:35.158584] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DNA took 33.2s. Estimated remaining: 4h 2m 2s. Rate: 7.2 symbols/min [2025-10-01T18:28:35.314537] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-01T18:28:35.350799] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:28:35.386026] [DEBUG] [LOCAL ] DNP: Loaded 33200 existing records from primary storage. [2025-10-01T18:28:35.386306] [INFO ] [MAIN ] DNP: Loaded 33200 existing records. [2025-10-01T18:28:35.525345] [DEBUG] [REMOTE ] DNOW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:28:35.554119] [WARN ] [REMOTE ] DNOW: No data returned for month 2025-10 [2025-10-01T18:28:35.556239] [FATAL] [REMOTE ] DNOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:28:35.570120] [FATAL] [MAIN ] DNOW: Failed to fetch primary data. [2025-10-01T18:28:35.573616] [WARN ] [MAIN ] DNOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:28:35.599012] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-01T18:28:35.598911] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:28:35.599359] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-01T18:28:35.599465] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-01T18:28:35.599620] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-01T18:28:35.599565] [INFO ] [LOCAL ] DNOW: Starting deletion of derivative data. [2025-10-01T18:28:35.600062] [DEBUG] [LOCAL ] DNOW: Deleted derivative data file. [2025-10-01T18:28:35.600217] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DNOW took 27.3s. Estimated remaining: 4h 1m 32s. Rate: 7.2 symbols/min [2025-10-01T18:28:35.636007] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-01T18:28:35.661630] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-01T18:28:35.953525] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:28:36.107517] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-01T18:28:36.215057] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:28:36.239144] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-10-01T18:28:36.239572] [INFO ] [MAIN ] DOC: Loaded 53542 existing records. [2025-10-01T18:28:36.392759] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T18:28:36.427571] [INFO ] [REMOTE ] DMB: Full fetch complete (14989 records). [2025-10-01T18:28:36.457613] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-01T18:28:36.466539] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:28:36.466966] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-01T18:28:36.467028] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-01T18:28:36.529780] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-01T18:28:36.553406] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-01T18:28:36.605784] [DEBUG] [REMOTE ] DMO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:28:36.666593] [WARN ] [REMOTE ] DMO: No data returned for month 2025-10 [2025-10-01T18:28:36.693773] [FATAL] [REMOTE ] DMO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:28:36.726271] [FATAL] [MAIN ] DMO: Failed to fetch primary data. [2025-10-01T18:28:36.736702] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:28:36.736899] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-01T18:28:36.770040] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-01T18:28:36.862335] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-10-01T18:28:36.910036] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-01T18:28:36.925002] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-10-01T18:28:36.976786] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DMO took 36.5s. Estimated remaining: 4h 1m 4s. Rate: 7.2 symbols/min [2025-10-01T18:28:37.338243] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-01T18:28:37.364494] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-01T18:28:37.379993] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-01T18:28:37.380157] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-01T18:28:37.414135] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:28:37.415087] [DEBUG] [LOCAL ] DMB: Trimmed 14989 records to 10218 (keeping 200 days of data) [2025-10-01T18:28:37.528904] [DEBUG] [LOCAL ] DMB: Primary data saved (10218 records). [2025-10-01T18:28:37.529150] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-01T18:28:37.529279] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DMB took 38.7s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-01T18:28:37.702436] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-01T18:28:38.524534] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T18:28:38.533054] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-01T18:28:39.637209] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T18:28:39.645300] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-01T18:28:39.722144] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-01T18:28:40.102404] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-01T18:28:41.024325] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:28:41.031026] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-01T18:28:41.903758] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T18:28:41.915531] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-01T18:28:42.068895] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T18:28:42.502376] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-01T18:28:43.349946] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T18:28:43.360990] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-01T18:28:43.955500] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T18:28:44.102406] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-01T18:28:45.160107] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T18:28:45.172544] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-01T18:28:45.297839] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T18:28:45.702426] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-01T18:28:46.655466] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T18:28:46.662438] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-01T18:28:46.763498] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T18:28:47.302388] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-01T18:28:48.118144] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T18:28:48.125830] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-01T18:28:49.131094] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T18:28:49.142794] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-01T18:28:49.199166] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T18:28:49.702433] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-01T18:28:50.827806] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T18:28:50.839012] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-01T18:28:50.981267] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T18:28:51.302386] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-01T18:28:52.662266] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T18:28:52.674671] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-01T18:28:52.936174] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-01T18:28:52.937885] [INFO ] [REMOTE ] DNP: Full fetch complete (49349 records). [2025-10-01T18:28:52.937999] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-01T18:28:53.375450] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-01T18:28:53.375537] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-01T18:28:53.376299] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-01T18:28:53.376365] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-01T18:28:53.377441] [DEBUG] [LOCAL ] DNP: Trimmed 49349 records to 33239 (keeping 200 days of data) [2025-10-01T18:28:53.582543] [DEBUG] [LOCAL ] DNP: Primary data saved (33239 records). [2025-10-01T18:28:53.582742] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-01T18:28:53.582853] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNP took 18.4s. Estimated remaining: 4h 0m 47s. Rate: 7.2 symbols/min [2025-10-01T18:28:54.766967] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T18:28:54.778890] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-01T18:28:56.648938] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T18:28:56.661000] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-01T18:28:59.108183] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-01T18:28:59.109848] [INFO ] [REMOTE ] DOC: Full fetch complete (77390 records). [2025-10-01T18:28:59.109951] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-01T18:28:59.557166] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-01T18:28:59.557258] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-01T18:28:59.558289] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-01T18:28:59.558357] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-01T18:28:59.560055] [DEBUG] [LOCAL ] DOC: Trimmed 77390 records to 53542 (keeping 200 days of data) [2025-10-01T18:28:59.914495] [DEBUG] [LOCAL ] DOC: Primary data saved (53542 records). [2025-10-01T18:28:59.914660] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-01T18:28:59.914766] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 24.3s. Estimated remaining: 4h 0m 34s. Rate: 7.2 symbols/min [2025-10-01T18:29:00.706248] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:00.742993] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:00.784483] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-01T18:29:00.784284] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:00.764856] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:00.785765] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-01T18:29:00.785928] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-01T18:29:00.785987] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-01T18:29:00.786049] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-01T18:29:00.786088] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-01T18:29:01.019966] [DEBUG] [LOCAL ] DOUG: Loaded 34546 existing records from primary storage. [2025-10-01T18:29:01.057300] [INFO ] [MAIN ] DOUG: Loaded 34546 existing records. [2025-10-01T18:29:01.156311] [DEBUG] [LOCAL ] DOLE: Loaded 38292 existing records from primary storage. [2025-10-01T18:29:01.214696] [DEBUG] [LOCAL ] DOCN: Loaded 50539 existing records from primary storage. [2025-10-01T18:29:01.231538] [INFO ] [MAIN ] DOCN: Loaded 50539 existing records. [2025-10-01T18:29:01.249598] [INFO ] [MAIN ] DOLE: Loaded 38292 existing records. [2025-10-01T18:29:01.770427] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:29:01.779277] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-01T18:29:01.789627] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-01T18:29:01.925736] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-01T18:29:01.910781] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:01.965182] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-01T18:29:01.963576] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-01T18:29:01.969871] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:29:02.016024] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:29:02.029416] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-01T18:29:02.034692] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-01T18:29:02.040145] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-01T18:29:02.052605] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-01T18:29:02.075616] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-01T18:29:02.052757] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-01T18:29:02.165231] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-01T18:29:02.213900] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-01T18:29:03.005864] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:03.046072] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-01T18:29:03.208157] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:03.218091] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-01T18:29:03.311130] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:03.311583] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-01T18:29:03.475889] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T18:29:03.488859] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-01T18:29:04.421106] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T18:29:04.428697] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-01T18:29:04.689921] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T18:29:04.731165] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T18:29:04.741036] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-01T18:29:04.741485] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-01T18:29:04.836704] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T18:29:04.846324] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-01T18:29:05.507971] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T18:29:05.515836] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-01T18:29:05.788712] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T18:29:05.796307] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-01T18:29:06.354112] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T18:29:06.361832] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-01T18:29:06.608478] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T18:29:06.618679] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-01T18:29:06.652803] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T18:29:06.663258] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-01T18:29:07.178584] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:29:07.186124] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-01T18:29:08.118755] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T18:29:08.127145] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-01T18:29:08.360705] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T18:29:08.370896] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-01T18:29:08.560234] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T18:29:08.568496] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-01T18:29:08.722177] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-01T18:29:08.902383] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-01T18:29:09.195534] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T18:29:09.627029] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T18:29:09.702353] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-01T18:29:09.830986] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-01T18:29:10.438698] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T18:29:10.502410] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-01T18:29:10.809353] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T18:29:11.302376] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-01T18:29:12.102374] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-01T18:29:12.158746] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T18:29:12.768044] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T18:29:12.902377] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-01T18:29:13.668756] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T18:29:13.702348] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-01T18:29:14.508979] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-01T18:29:14.525669] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T18:29:15.098760] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T18:29:15.302395] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-01T18:29:16.102362] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-01T18:29:16.463553] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T18:29:16.597396] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T18:29:16.902390] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-01T18:29:17.702387] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-01T18:29:17.741785] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T18:29:18.502369] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-01T18:29:18.748082] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T18:29:18.860165] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-01T18:29:19.302391] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-01T18:29:20.102436] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-01T18:29:20.366404] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T18:29:20.902426] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-01T18:29:21.017065] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T18:29:21.420362] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T18:29:21.702418] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-01T18:29:22.375455] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T18:29:22.502385] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-01T18:29:23.302406] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-01T18:29:23.716531] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-01T18:29:23.718122] [INFO ] [REMOTE ] DOLE: Full fetch complete (53796 records). [2025-10-01T18:29:23.718232] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-01T18:29:24.126960] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-01T18:29:24.148213] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-01T18:29:24.148315] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-01T18:29:24.149210] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-01T18:29:24.149397] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-01T18:29:24.151275] [DEBUG] [LOCAL ] DOLE: Trimmed 53796 records to 38416 (keeping 200 days of data) [2025-10-01T18:29:24.217962] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-01T18:29:24.247066] [INFO ] [REMOTE ] DOUG: Full fetch complete (51170 records). [2025-10-01T18:29:24.248005] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-01T18:29:24.729895] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-01T18:29:24.730524] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-01T18:29:24.732424] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-01T18:29:24.732854] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-01T18:29:24.736012] [DEBUG] [LOCAL ] DOUG: Trimmed 51170 records to 34405 (keeping 200 days of data) [2025-10-01T18:29:25.054627] [DEBUG] [LOCAL ] DOLE: Primary data saved (38416 records). [2025-10-01T18:29:25.055689] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-01T18:29:25.056975] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOLE took 25.1s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-01T18:29:25.270569] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:25.271513] [DEBUG] [LOCAL ] DOV: No existing data file found in primary storage. [2025-10-01T18:29:25.271924] [WARN ] [MAIN ] DOV: No existing data found, performing full refresh instead. [2025-10-01T18:29:25.274098] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-01T18:29:25.274518] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-01T18:29:25.275077] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-01T18:29:25.276062] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-01T18:29:25.290787] [DEBUG] [LOCAL ] DOUG: Primary data saved (34405 records). [2025-10-01T18:29:25.300709] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-01T18:29:25.300865] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOUG took 25.4s. Estimated remaining: 4h 0m 40s. Rate: 7.2 symbols/min [2025-10-01T18:29:25.612336] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-01T18:29:25.739705] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-01T18:29:25.793147] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:25.964940] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:25.965457] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-01T18:29:26.002389] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T18:29:26.053520] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-01T18:29:26.053906] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-01T18:29:26.259451] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:29:26.259766] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-01T18:29:26.259833] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-01T18:29:26.261997] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-01T18:29:26.262061] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-01T18:29:26.520199] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-01T18:29:26.663838] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:27.302401] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-01T18:29:27.492871] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T18:29:27.586977] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T18:29:28.102366] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-01T18:29:28.562330] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T18:29:28.902441] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-01T18:29:29.226916] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-01T18:29:29.441284] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T18:29:29.702457] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-01T18:29:30.502462] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-01T18:29:30.784044] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T18:29:31.085570] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:29:31.302419] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-01T18:29:32.102371] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-01T18:29:32.443685] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T18:29:32.584875] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-01T18:29:32.902388] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-01T18:29:33.702466] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-01T18:29:34.262507] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-01T18:29:34.266958] [INFO ] [REMOTE ] DOCS: Full fetch complete (74177 records). [2025-10-01T18:29:34.267079] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-01T18:29:34.516317] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-01T18:29:34.659596] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T18:29:34.775228] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-01T18:29:34.775312] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-01T18:29:34.776194] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-01T18:29:34.776264] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-01T18:29:34.777753] [DEBUG] [LOCAL ] DOCS: Trimmed 74177 records to 51126 (keeping 200 days of data) [2025-10-01T18:29:35.108223] [DEBUG] [LOCAL ] DOCS: Primary data saved (51126 records). [2025-10-01T18:29:35.108363] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-01T18:29:35.108473] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCS took 35.2s. Estimated remaining: 4h 0m 36s. Rate: 7.2 symbols/min [2025-10-01T18:29:35.297345] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:35.297710] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-10-01T18:29:35.297814] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-10-01T18:29:35.298018] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-01T18:29:35.298092] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-01T18:29:35.298157] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-01T18:29:35.298205] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-01T18:29:35.332847] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-01T18:29:35.713106] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:35.746203] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-01T18:29:36.102408] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-01T18:29:36.351876] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T18:29:36.902377] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-01T18:29:37.636739] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-01T18:29:37.658578] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-01T18:29:37.702357] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-01T18:29:38.502387] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-01T18:29:38.515395] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-01T18:29:38.517124] [INFO ] [REMOTE ] DOCN: Full fetch complete (71655 records). [2025-10-01T18:29:38.517256] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-01T18:29:38.947222] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-01T18:29:38.947310] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-01T18:29:38.948194] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-01T18:29:38.948299] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-01T18:29:38.949826] [DEBUG] [LOCAL ] DOCN: Trimmed 71655 records to 50567 (keeping 200 days of data) [2025-10-01T18:29:39.265825] [DEBUG] [LOCAL ] DOCN: Primary data saved (50567 records). [2025-10-01T18:29:39.265976] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-01T18:29:39.271898] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 39.4s. Estimated remaining: 4h 0m 16s. Rate: 7.2 symbols/min [2025-10-01T18:29:39.302721] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-01T18:29:39.389573] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T18:29:39.489507] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:39.549218] [DEBUG] [LOCAL ] DQ: Loaded 43336 existing records from primary storage. [2025-10-01T18:29:39.549695] [INFO ] [MAIN ] DQ: Loaded 43336 existing records. [2025-10-01T18:29:39.714580] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T18:29:39.790104] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:29:39.790303] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-01T18:29:39.790352] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-01T18:29:39.791639] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-01T18:29:39.791774] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-01T18:29:40.107469] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-01T18:29:40.179001] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:40.832622] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T18:29:40.902395] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-01T18:29:41.702394] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-01T18:29:42.040223] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T18:29:42.176029] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T18:29:42.456205] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T18:29:42.502344] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-01T18:29:43.302397] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-01T18:29:44.102431] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-01T18:29:44.227952] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T18:29:44.626082] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T18:29:44.902382] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-01T18:29:44.948392] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T18:29:45.702422] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-01T18:29:46.261155] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T18:29:46.502398] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-01T18:29:46.782037] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T18:29:47.302405] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-01T18:29:47.760208] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T18:29:48.102396] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-01T18:29:48.277476] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T18:29:48.902400] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-01T18:29:49.702378] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-01T18:29:50.268743] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T18:29:50.270112] [INFO ] [REMOTE ] DOV: Full fetch complete (65218 records). [2025-10-01T18:29:50.270200] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-01T18:29:50.502824] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-01T18:29:50.665597] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T18:29:50.717286] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T18:29:50.809819] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-01T18:29:50.809917] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-01T18:29:50.810796] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-01T18:29:50.810866] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-01T18:29:50.812422] [DEBUG] [LOCAL ] DOV: Trimmed 65218 records to 45454 (keeping 200 days of data) [2025-10-01T18:29:51.111664] [DEBUG] [LOCAL ] DOV: Primary data saved (45454 records). [2025-10-01T18:29:51.111822] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-01T18:29:51.111907] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 26.1s. Estimated remaining: 4h 0m 17s. Rate: 7.2 symbols/min [2025-10-01T18:29:51.302925] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:29:51.303002] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-01T18:29:51.343632] [DEBUG] [LOCAL ] DRD: Loaded 36875 existing records from primary storage. [2025-10-01T18:29:51.344505] [INFO ] [MAIN ] DRD: Loaded 36875 existing records. [2025-10-01T18:29:51.541734] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:29:51.541940] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-01T18:29:51.541990] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-01T18:29:51.542310] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-01T18:29:51.542373] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-01T18:29:51.921822] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:29:52.030493] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T18:29:52.102371] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-01T18:29:52.275474] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T18:29:52.902392] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-01T18:29:53.305106] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:29:53.702421] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-01T18:29:54.168217] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:29:54.412758] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-01T18:29:54.502382] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-01T18:29:55.302384] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-01T18:29:56.102363] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-01T18:29:56.170374] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T18:29:56.423809] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T18:29:56.902376] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-01T18:29:56.989029] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T18:29:57.702478] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-01T18:29:58.502360] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-01T18:29:58.665439] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T18:29:58.990958] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T18:29:59.302379] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-01T18:29:59.964001] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-01T18:30:00.102374] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-01T18:30:00.377495] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T18:30:00.378604] [INFO ] [REMOTE ] DPG: Full fetch complete (19063 records). [2025-10-01T18:30:00.378760] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-01T18:30:00.815940] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-01T18:30:00.816052] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-01T18:30:00.816637] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-01T18:30:00.816745] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-01T18:30:00.817432] [DEBUG] [LOCAL ] DPG: Trimmed 19063 records to 13579 (keeping 200 days of data) [2025-10-01T18:30:00.905174] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-01T18:30:00.911016] [DEBUG] [LOCAL ] DPG: Primary data saved (13579 records). [2025-10-01T18:30:00.912061] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-01T18:30:00.912151] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 25.8s. Estimated remaining: 4h 0m 13s. Rate: 7.2 symbols/min [2025-10-01T18:30:01.119672] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:30:01.178266] [DEBUG] [LOCAL ] DRH: Loaded 50465 existing records from primary storage. [2025-10-01T18:30:01.178624] [INFO ] [MAIN ] DRH: Loaded 50465 existing records. [2025-10-01T18:30:01.379772] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:30:01.380040] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-01T18:30:01.380091] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-01T18:30:01.381497] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-01T18:30:01.381595] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-01T18:30:01.709369] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-01T18:30:01.976992] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:30:02.030610] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T18:30:02.502399] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-01T18:30:02.625995] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T18:30:03.175909] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T18:30:03.302379] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-01T18:30:04.102362] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-01T18:30:04.659551] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-01T18:30:04.883987] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T18:30:04.902353] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-01T18:30:05.702402] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-01T18:30:06.437249] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T18:30:06.502403] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-01T18:30:06.667697] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-01T18:30:06.670000] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-01T18:30:06.670154] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-01T18:30:07.194742] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T18:30:07.227802] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-01T18:30:07.228048] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-01T18:30:07.229194] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-01T18:30:07.229282] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-01T18:30:07.230918] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-10-01T18:30:07.326743] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-01T18:30:07.585253] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-01T18:30:07.585397] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-01T18:30:07.585490] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOW took 42.3s. Estimated remaining: 3h 59m 60s. Rate: 7.2 symbols/min [2025-10-01T18:30:07.773476] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:30:07.825740] [DEBUG] [LOCAL ] DRI: Loaded 47780 existing records from primary storage. [2025-10-01T18:30:07.826085] [INFO ] [MAIN ] DRI: Loaded 47780 existing records. [2025-10-01T18:30:08.035893] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:30:08.036192] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-01T18:30:08.036250] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-01T18:30:08.038003] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-01T18:30:08.038071] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-01T18:30:08.109293] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-01T18:30:08.367374] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T18:30:08.525580] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:30:08.585952] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T18:30:08.902379] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-01T18:30:09.702411] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-01T18:30:09.705302] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T18:30:10.389583] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T18:30:10.502375] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-01T18:30:10.816112] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T18:30:11.302387] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-01T18:30:11.861947] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T18:30:12.102376] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-01T18:30:12.902363] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-01T18:30:12.997342] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T18:30:13.703909] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-01T18:30:13.707020] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T18:30:14.502399] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-01T18:30:14.578384] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T18:30:14.957783] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T18:30:15.302424] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-01T18:30:16.029949] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T18:30:16.102444] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-01T18:30:16.902364] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-01T18:30:17.015901] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T18:30:17.571359] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T18:30:17.702398] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-01T18:30:18.280192] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T18:30:18.502397] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-01T18:30:19.225303] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T18:30:19.302377] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-01T18:30:19.972438] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T18:30:20.102412] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-01T18:30:20.548205] [DEBUG] [REMOTE ] DQ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:30:20.548540] [WARN ] [REMOTE ] DQ: No data returned for month 2025-10 [2025-10-01T18:30:20.548634] [FATAL] [REMOTE ] DQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:30:20.548759] [FATAL] [MAIN ] DQ: Failed to fetch primary data. [2025-10-01T18:30:20.548827] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:30:20.548903] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-01T18:30:20.548969] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-01T18:30:20.549007] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-10-01T18:30:20.549434] [DEBUG] [LOCAL ] DQ: Deleted derivative data file. [2025-10-01T18:30:20.549524] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 41.3s. Estimated remaining: 4h 0m 4s. Rate: 7.2 symbols/min [2025-10-01T18:30:20.750276] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:30:20.762632] [DEBUG] [LOCAL ] DRLL: Loaded 9497 existing records from primary storage. [2025-10-01T18:30:20.762881] [INFO ] [MAIN ] DRLL: Loaded 9497 existing records. [2025-10-01T18:30:20.916591] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-01T18:30:20.968236] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:30:20.968564] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-01T18:30:20.968637] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-01T18:30:20.969054] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-01T18:30:20.969118] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-01T18:30:21.368491] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:30:21.702424] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-01T18:30:22.293916] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T18:30:22.335049] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T18:30:22.337389] [INFO ] [REMOTE ] DRD: Full fetch complete (49740 records). [2025-10-01T18:30:22.337561] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-01T18:30:22.518250] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-01T18:30:22.801319] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-01T18:30:22.801670] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-01T18:30:22.802438] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-01T18:30:22.802490] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-01T18:30:22.803712] [DEBUG] [LOCAL ] DRD: Trimmed 49740 records to 36953 (keeping 200 days of data) [2025-10-01T18:30:22.918478] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T18:30:23.066481] [DEBUG] [LOCAL ] DRD: Primary data saved (36953 records). [2025-10-01T18:30:23.066631] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-01T18:30:23.066769] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 32.0s. Estimated remaining: 3h 59m 40s. Rate: 7.2 symbols/min [2025-10-01T18:30:23.260082] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:30:23.294157] [DEBUG] [LOCAL ] DSL: Loaded 28412 existing records from primary storage. [2025-10-01T18:30:23.294465] [INFO ] [MAIN ] DSL: Loaded 28412 existing records. [2025-10-01T18:30:23.307722] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-01T18:30:23.493434] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:30:23.493704] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-01T18:30:23.493770] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-01T18:30:23.495324] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-01T18:30:23.495390] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-01T18:30:23.927018] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:30:24.102432] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-01T18:30:24.139999] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T18:30:24.902425] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-01T18:30:25.338353] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T18:30:25.351295] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T18:30:25.702385] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-01T18:30:26.282500] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T18:30:26.502411] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-01T18:30:26.859491] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T18:30:27.302396] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-01T18:30:28.102431] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-01T18:30:28.116241] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T18:30:28.327137] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T18:30:28.902403] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-01T18:30:29.306985] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:30:29.373477] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T18:30:29.702405] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-01T18:30:30.502354] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-01T18:30:30.564268] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T18:30:31.302416] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-01T18:30:32.102357] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-01T18:30:32.150419] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T18:30:32.570240] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T18:30:32.902391] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-01T18:30:33.401184] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T18:30:33.702416] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-01T18:30:33.926634] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T18:30:34.502385] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-01T18:30:35.020673] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T18:30:35.302366] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-01T18:30:35.548033] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T18:30:36.102429] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-01T18:30:36.591376] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T18:30:36.902386] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-01T18:30:37.702397] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-01T18:30:37.904035] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T18:30:38.012601] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T18:30:38.014114] [INFO ] [REMOTE ] DRH: Full fetch complete (71889 records). [2025-10-01T18:30:38.014221] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-01T18:30:38.477600] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-01T18:30:38.477734] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-01T18:30:38.478734] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-01T18:30:38.478799] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-01T18:30:38.480476] [DEBUG] [LOCAL ] DRH: Trimmed 71889 records to 50489 (keeping 200 days of data) [2025-10-01T18:30:38.537608] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-01T18:30:38.737310] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T18:30:38.844733] [DEBUG] [LOCAL ] DRH: Primary data saved (50489 records). [2025-10-01T18:30:38.844923] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-01T18:30:38.845028] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 37.9s. Estimated remaining: 3h 59m 51s. Rate: 7.2 symbols/min [2025-10-01T18:30:39.026261] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:30:39.026461] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-01T18:30:39.026503] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-01T18:30:39.026620] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-01T18:30:39.026700] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-01T18:30:39.026770] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-01T18:30:39.026814] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-01T18:30:39.313080] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-01T18:30:39.448122] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:30:40.102368] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-01T18:30:40.151775] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T18:30:40.563721] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T18:30:40.662777] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T18:30:40.902400] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-01T18:30:41.702409] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-01T18:30:42.187929] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T18:30:42.502345] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-01T18:30:42.809846] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T18:30:43.302382] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-01T18:30:44.102389] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-01T18:30:44.288909] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T18:30:44.538243] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T18:30:44.865804] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T18:30:44.902393] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-01T18:30:45.702434] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-01T18:30:46.420455] [DEBUG] [REMOTE ] DRI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:30:46.420825] [WARN ] [REMOTE ] DRI: No data returned for month 2025-10 [2025-10-01T18:30:46.420916] [FATAL] [REMOTE ] DRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:30:46.420995] [FATAL] [MAIN ] DRI: Failed to fetch primary data. [2025-10-01T18:30:46.421032] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:30:46.421070] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-01T18:30:46.421126] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-01T18:30:46.421162] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-01T18:30:46.421479] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-01T18:30:46.421567] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRI took 38.8s. Estimated remaining: 3h 59m 41s. Rate: 7.2 symbols/min [2025-10-01T18:30:46.507463] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-01T18:30:46.610983] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:30:46.614836] [DEBUG] [LOCAL ] DSMC: Loaded 1896 existing records from primary storage. [2025-10-01T18:30:46.614990] [INFO ] [MAIN ] DSMC: Loaded 1896 existing records. [2025-10-01T18:30:46.819011] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:30:46.819247] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-01T18:30:46.819300] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-01T18:30:46.819548] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-01T18:30:46.819608] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-01T18:30:47.211663] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:30:47.302408] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-01T18:30:47.364325] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-01T18:30:47.365762] [INFO ] [REMOTE ] DSL: Full fetch complete (41475 records). [2025-10-01T18:30:47.365875] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-01T18:30:47.522458] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T18:30:47.844012] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-01T18:30:47.844110] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-01T18:30:47.844767] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-01T18:30:47.844834] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-01T18:30:47.845929] [DEBUG] [LOCAL ] DSL: Trimmed 41475 records to 28410 (keeping 200 days of data) [2025-10-01T18:30:48.035981] [DEBUG] [LOCAL ] DSL: Primary data saved (28410 records). [2025-10-01T18:30:48.036130] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-01T18:30:48.036236] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DSL took 25.0s. Estimated remaining: 3h 59m 15s. Rate: 7.2 symbols/min [2025-10-01T18:30:48.102608] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-01T18:30:48.116443] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T18:30:48.240097] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:30:48.265407] [DEBUG] [LOCAL ] DSU: Loaded 22526 existing records from primary storage. [2025-10-01T18:30:48.265733] [INFO ] [MAIN ] DSU: Loaded 22526 existing records. [2025-10-01T18:30:48.485036] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:30:48.485280] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-01T18:30:48.485331] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-01T18:30:48.486487] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-01T18:30:48.486552] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-01T18:30:48.904048] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-01T18:30:48.937007] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:30:48.939001] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T18:30:49.279365] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-01T18:30:49.702384] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-01T18:30:50.019020] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-01T18:30:50.502395] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-01T18:30:51.302357] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-01T18:30:51.384358] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T18:30:52.102405] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-01T18:30:52.400970] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T18:30:52.887239] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T18:30:52.902331] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-01T18:30:53.702395] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-01T18:30:53.894314] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T18:30:54.502439] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-01T18:30:54.951182] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T18:30:55.302430] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-01T18:30:55.528425] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T18:30:56.038001] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T18:30:56.102394] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-01T18:30:56.902366] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-01T18:30:57.044018] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T18:30:57.702469] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-01T18:30:57.978087] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T18:30:58.502424] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-01T18:30:58.777190] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T18:30:59.030565] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-01T18:30:59.302385] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-01T18:30:59.769816] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T18:31:00.102435] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-01T18:31:00.610945] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T18:31:00.902448] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-01T18:31:01.702413] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-01T18:31:02.063134] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T18:31:02.064613] [INFO ] [REMOTE ] DRLL: Full fetch complete (15530 records). [2025-10-01T18:31:02.064748] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-01T18:31:02.423172] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T18:31:02.496930] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-01T18:31:02.497032] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-01T18:31:02.497420] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-01T18:31:02.497485] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-01T18:31:02.498180] [DEBUG] [LOCAL ] DRLL: Trimmed 15530 records to 9443 (keeping 200 days of data) [2025-10-01T18:31:02.524938] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-01T18:31:02.564265] [DEBUG] [LOCAL ] DRLL: Primary data saved (9443 records). [2025-10-01T18:31:02.564412] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-01T18:31:02.564499] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DRLL took 42.0s. Estimated remaining: 3h 59m 23s. Rate: 7.2 symbols/min [2025-10-01T18:31:02.761186] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:02.794352] [DEBUG] [LOCAL ] DSX: Loaded 24002 existing records from primary storage. [2025-10-01T18:31:02.794742] [INFO ] [MAIN ] DSX: Loaded 24002 existing records. [2025-10-01T18:31:03.005846] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:31:03.006097] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-01T18:31:03.006147] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-01T18:31:03.006894] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-01T18:31:03.006958] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-01T18:31:03.307457] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-01T18:31:03.410608] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:03.521056] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T18:31:04.086479] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T18:31:04.102372] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-01T18:31:04.435834] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-01T18:31:04.902395] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-01T18:31:05.262044] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-01T18:31:05.702377] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-01T18:31:06.125869] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-01T18:31:06.502394] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-01T18:31:07.257292] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T18:31:07.302381] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-01T18:31:07.618324] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-01T18:31:08.102381] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-01T18:31:08.902374] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-01T18:31:09.237995] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T18:31:09.535375] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T18:31:09.536152] [INFO ] [REMOTE ] DSMC: Full fetch complete (2887 records). [2025-10-01T18:31:09.536224] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-01T18:31:09.706489] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-01T18:31:09.958254] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-01T18:31:09.958335] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-01T18:31:09.958454] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-01T18:31:09.958517] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-01T18:31:09.958965] [DEBUG] [LOCAL ] DSMC: Trimmed 2887 records to 1887 (keeping 200 days of data) [2025-10-01T18:31:09.972078] [DEBUG] [LOCAL ] DSMC: Primary data saved (1887 records). [2025-10-01T18:31:09.972204] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-01T18:31:09.972290] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSMC took 23.6s. Estimated remaining: 3h 59m 12s. Rate: 7.2 symbols/min [2025-10-01T18:31:10.185490] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:10.244904] [DEBUG] [LOCAL ] DT: Loaded 52925 existing records from primary storage. [2025-10-01T18:31:10.245330] [INFO ] [MAIN ] DT: Loaded 52925 existing records. [2025-10-01T18:31:10.451490] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:31:10.451736] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-01T18:31:10.451793] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-01T18:31:10.453173] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-01T18:31:10.453237] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-01T18:31:10.507548] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-01T18:31:10.607627] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T18:31:10.900547] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:11.302396] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-01T18:31:11.685993] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T18:31:12.102420] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-01T18:31:12.452173] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T18:31:12.902393] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-01T18:31:13.702421] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-01T18:31:13.849682] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T18:31:13.908882] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T18:31:14.270031] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T18:31:14.502529] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-01T18:31:15.302699] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-01T18:31:16.102454] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-01T18:31:16.270456] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T18:31:16.450183] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T18:31:16.677270] [DEBUG] [REMOTE ] DSM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:31:16.677606] [WARN ] [REMOTE ] DSM: No data returned for month 2025-10 [2025-10-01T18:31:16.677737] [FATAL] [REMOTE ] DSM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:31:16.680330] [FATAL] [MAIN ] DSM: Failed to fetch primary data. [2025-10-01T18:31:16.680470] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:31:16.680569] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-01T18:31:16.680719] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-01T18:31:16.680797] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-10-01T18:31:16.680881] [DEBUG] [LOCAL ] DSM: No derivative data file found to delete. [2025-10-01T18:31:16.680964] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSM took 37.8s. Estimated remaining: 3h 58m 59s. Rate: 7.2 symbols/min [2025-10-01T18:31:16.889154] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:16.889384] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-01T18:31:16.889472] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-01T18:31:16.889633] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-01T18:31:16.889756] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-01T18:31:16.889849] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-01T18:31:16.889942] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-01T18:31:16.907451] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-01T18:31:17.327184] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:17.702397] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-01T18:31:18.398020] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T18:31:18.502413] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-01T18:31:18.601740] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T18:31:19.302437] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-01T18:31:20.042444] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T18:31:20.062517] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T18:31:20.102358] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-01T18:31:20.489408] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-01T18:31:20.902385] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-01T18:31:21.263993] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-01T18:31:21.702409] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-01T18:31:22.502441] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-01T18:31:23.047878] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T18:31:23.302379] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-01T18:31:23.741898] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T18:31:24.102400] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-01T18:31:24.793941] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-01T18:31:24.794978] [INFO ] [REMOTE ] DSU: Full fetch complete (32764 records). [2025-10-01T18:31:24.795057] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-01T18:31:24.905638] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-01T18:31:25.247959] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-01T18:31:25.247624] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T18:31:25.248133] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-01T18:31:25.255618] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-01T18:31:25.256083] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-01T18:31:25.260141] [DEBUG] [LOCAL ] DSU: Trimmed 32764 records to 22542 (keeping 200 days of data) [2025-10-01T18:31:25.410846] [DEBUG] [LOCAL ] DSU: Primary data saved (22542 records). [2025-10-01T18:31:25.410985] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-01T18:31:25.411088] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 37.4s. Estimated remaining: 3h 58m 52s. Rate: 7.2 symbols/min [2025-10-01T18:31:25.596781] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:25.596999] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-01T18:31:25.597060] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-01T18:31:25.597253] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-01T18:31:25.597353] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-01T18:31:25.597447] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-01T18:31:25.597498] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-01T18:31:25.707712] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-01T18:31:26.001795] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:26.502436] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-01T18:31:26.732413] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T18:31:26.858358] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T18:31:27.143567] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-01T18:31:27.302419] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-01T18:31:28.102404] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-01T18:31:28.902425] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-01T18:31:28.954994] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T18:31:29.588007] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T18:31:29.702425] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-01T18:31:30.079189] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T18:31:30.502461] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-01T18:31:31.302367] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-01T18:31:31.424598] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T18:31:31.866637] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T18:31:32.102376] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-01T18:31:32.197762] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T18:31:32.902394] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-01T18:31:33.702368] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-01T18:31:33.748310] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T18:31:34.136474] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T18:31:34.194876] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T18:31:34.502405] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-01T18:31:35.302357] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-01T18:31:35.661437] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T18:31:36.102428] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-01T18:31:36.902348] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-01T18:31:36.948157] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T18:31:37.051540] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T18:31:37.702384] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-01T18:31:38.105772] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:31:38.502432] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-01T18:31:39.084587] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-01T18:31:39.307478] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-01T18:31:39.327299] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T18:31:40.102438] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-01T18:31:40.902380] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-01T18:31:41.013524] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T18:31:41.014693] [INFO ] [REMOTE ] DSX: Full fetch complete (36646 records). [2025-10-01T18:31:41.014774] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-01T18:31:41.438189] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-01T18:31:41.438275] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-01T18:31:41.438941] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-01T18:31:41.439015] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-01T18:31:41.440185] [DEBUG] [LOCAL ] DSX: Trimmed 36646 records to 24050 (keeping 200 days of data) [2025-10-01T18:31:41.603008] [DEBUG] [LOCAL ] DSX: Primary data saved (24050 records). [2025-10-01T18:31:41.603150] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-01T18:31:41.603275] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 39.0s. Estimated remaining: 3h 59m 4s. Rate: 7.2 symbols/min [2025-10-01T18:31:41.712972] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-01T18:31:41.803558] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:41.803881] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-01T18:31:41.803989] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-01T18:31:41.804146] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-01T18:31:41.804219] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-01T18:31:41.804265] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-01T18:31:41.804344] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-01T18:31:42.177795] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-01T18:31:42.206434] [INFO ] [REMOTE ] DT: Full fetch complete (76666 records). [2025-10-01T18:31:42.251407] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-01T18:31:42.285339] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:42.357835] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-01T18:31:42.503290] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-01T18:31:42.767365] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-01T18:31:42.767482] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-01T18:31:42.768585] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-01T18:31:42.768694] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-01T18:31:42.770609] [DEBUG] [LOCAL ] DT: Trimmed 76666 records to 52927 (keeping 200 days of data) [2025-10-01T18:31:42.893253] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-01T18:31:43.147499] [DEBUG] [LOCAL ] DT: Primary data saved (52927 records). [2025-10-01T18:31:43.147681] [INFO ] [MAIN ] DT: Full history saved. [2025-10-01T18:31:43.147790] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DT took 33.2s. Estimated remaining: 3h 58m 38s. Rate: 7.2 symbols/min [2025-10-01T18:31:43.280038] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T18:31:43.307513] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-01T18:31:43.366413] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:43.366750] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-01T18:31:43.366809] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-01T18:31:43.366924] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-01T18:31:43.366971] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-01T18:31:43.367017] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-01T18:31:43.367053] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-01T18:31:43.765008] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:43.904027] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T18:31:44.102384] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-01T18:31:44.708569] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T18:31:44.902402] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-01T18:31:45.368834] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-01T18:31:45.702420] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-01T18:31:46.502399] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-01T18:31:47.086553] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T18:31:47.148756] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T18:31:47.302440] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-01T18:31:48.085544] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T18:31:48.102380] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-01T18:31:48.796200] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T18:31:48.796950] [INFO ] [REMOTE ] DTB: Full fetch complete (6868 records). [2025-10-01T18:31:48.797022] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-01T18:31:48.907460] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-01T18:31:49.190192] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-01T18:31:49.190279] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-01T18:31:49.190486] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-01T18:31:49.190532] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-01T18:31:49.191018] [DEBUG] [LOCAL ] DTB: Trimmed 6868 records to 4913 (keeping 200 days of data) [2025-10-01T18:31:49.224883] [DEBUG] [LOCAL ] DTB: Primary data saved (4913 records). [2025-10-01T18:31:49.225031] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-01T18:31:49.225186] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DTB took 32.5s. Estimated remaining: 3h 58m 23s. Rate: 7.2 symbols/min [2025-10-01T18:31:49.421593] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:49.421896] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-01T18:31:49.421969] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-01T18:31:49.422127] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-01T18:31:49.422276] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-01T18:31:49.422404] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-01T18:31:49.422458] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-01T18:31:49.544954] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T18:31:49.707585] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-01T18:31:49.839544] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:50.456605] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T18:31:50.502366] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-01T18:31:50.689000] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:31:50.689371] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-01T18:31:50.689487] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:31:50.689551] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-01T18:31:50.689614] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:31:50.689721] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-01T18:31:50.689788] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-01T18:31:50.689827] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-01T18:31:50.689886] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-01T18:31:50.689958] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTK took 1.5s. Estimated remaining: 3h 57m 57s. Rate: 7.2 symbols/min [2025-10-01T18:31:50.877223] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:31:50.931967] [DEBUG] [LOCAL ] DTM: Loaded 44156 existing records from primary storage. [2025-10-01T18:31:50.932312] [INFO ] [MAIN ] DTM: Loaded 44156 existing records. [2025-10-01T18:31:51.136355] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:31:51.136852] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-01T18:31:51.136915] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-01T18:31:51.139191] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-01T18:31:51.139259] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-01T18:31:51.307506] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-01T18:31:51.587329] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:31:52.053741] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T18:31:52.102383] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-01T18:31:52.442697] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-01T18:31:52.902425] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-01T18:31:53.702379] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-01T18:31:54.034503] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-01T18:31:54.502389] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-01T18:31:54.728768] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T18:31:55.302430] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-01T18:31:55.948884] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T18:31:56.102388] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-01T18:31:56.479114] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T18:31:56.902375] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-01T18:31:57.402308] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T18:31:57.702405] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-01T18:31:58.265926] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T18:31:58.315176] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-01T18:31:58.502488] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-01T18:31:58.846303] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-01T18:31:59.302378] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-01T18:32:00.102386] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-01T18:32:00.533120] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T18:32:00.534555] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T18:32:00.902381] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-01T18:32:01.163520] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-01T18:32:01.702410] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-01T18:32:02.502422] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-01T18:32:03.099245] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T18:32:03.144613] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T18:32:03.302384] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-01T18:32:03.995583] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T18:32:04.102386] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-01T18:32:04.555181] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T18:32:04.902431] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-01T18:32:05.702401] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-01T18:32:06.307884] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T18:32:06.433721] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T18:32:06.502425] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-01T18:32:07.302428] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-01T18:32:08.090927] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T18:32:08.102359] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-01T18:32:08.607753] [DEBUG] [REMOTE ] DTF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:32:08.608129] [WARN ] [REMOTE ] DTF: No data returned for month 2025-10 [2025-10-01T18:32:08.608269] [FATAL] [REMOTE ] DTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:32:08.608350] [FATAL] [MAIN ] DTF: Failed to fetch primary data. [2025-10-01T18:32:08.608412] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:32:08.608470] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-01T18:32:08.608560] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-01T18:32:08.608619] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-01T18:32:08.608725] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-01T18:32:08.608781] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTF took 27.0s. Estimated remaining: 3h 58m 14s. Rate: 7.2 symbols/min [2025-10-01T18:32:08.799634] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:32:08.799877] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-01T18:32:08.799935] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-01T18:32:08.800051] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-01T18:32:08.800094] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-01T18:32:08.800136] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-01T18:32:08.800169] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-01T18:32:08.907942] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-01T18:32:09.215154] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:32:09.245954] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T18:32:09.702394] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-01T18:32:10.069811] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-01T18:32:10.502419] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-01T18:32:10.909459] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-01T18:32:10.910980] [INFO ] [REMOTE ] DTE: Full fetch complete (68999 records). [2025-10-01T18:32:10.911122] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-01T18:32:11.309051] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-01T18:32:11.364255] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-01T18:32:11.364382] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-01T18:32:11.365458] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-01T18:32:11.365554] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-01T18:32:11.368377] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T18:32:11.371746] [DEBUG] [LOCAL ] DTE: Trimmed 68999 records to 47740 (keeping 200 days of data) [2025-10-01T18:32:11.694743] [DEBUG] [LOCAL ] DTE: Primary data saved (47740 records). [2025-10-01T18:32:11.694893] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-01T18:32:11.695015] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 46.3s. Estimated remaining: 3h 57m 52s. Rate: 7.2 symbols/min [2025-10-01T18:32:11.889263] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:32:11.889451] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-01T18:32:11.889489] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-01T18:32:11.889604] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-01T18:32:11.889669] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-01T18:32:11.889736] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-01T18:32:11.889812] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-01T18:32:12.115402] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-01T18:32:12.324476] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:32:12.770527] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T18:32:12.902392] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-01T18:32:12.927351] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T18:32:13.702394] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-01T18:32:14.216954] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-01T18:32:14.502414] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-01T18:32:14.690084] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T18:32:15.302383] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-01T18:32:15.733626] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-01T18:32:15.967323] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T18:32:16.102392] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-01T18:32:16.585977] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T18:32:16.902424] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-01T18:32:17.702431] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-01T18:32:18.321205] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-01T18:32:18.502381] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-01T18:32:18.711764] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T18:32:19.011465] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-01T18:32:19.302390] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-01T18:32:19.888096] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T18:32:20.102409] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-01T18:32:20.902382] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-01T18:32:20.937473] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-01T18:32:20.938362] [INFO ] [REMOTE ] DTG: Full fetch complete (9015 records). [2025-10-01T18:32:20.938435] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-01T18:32:21.358421] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-01T18:32:21.358511] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-01T18:32:21.358802] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-01T18:32:21.358930] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-01T18:32:21.359577] [DEBUG] [LOCAL ] DTG: Trimmed 9015 records to 5956 (keeping 200 days of data) [2025-10-01T18:32:21.407747] [DEBUG] [LOCAL ] DTG: Primary data saved (5956 records). [2025-10-01T18:32:21.407965] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-01T18:32:21.408064] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTG took 38.3s. Estimated remaining: 3h 57m 47s. Rate: 7.2 symbols/min [2025-10-01T18:32:21.637291] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:32:21.651560] [DEBUG] [LOCAL ] DUKB: Loaded 6380 existing records from primary storage. [2025-10-01T18:32:21.651893] [INFO ] [MAIN ] DUKB: Loaded 6380 existing records. [2025-10-01T18:32:21.707666] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-01T18:32:21.974147] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:32:21.974434] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-01T18:32:21.974508] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-01T18:32:21.975090] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-01T18:32:21.975171] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-01T18:32:22.503996] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-01T18:32:22.543415] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:32:22.582432] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T18:32:23.140356] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T18:32:23.142583] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T18:32:23.302380] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-01T18:32:24.102364] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-01T18:32:24.174905] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T18:32:24.902422] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-01T18:32:25.517369] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T18:32:25.708466] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-01T18:32:25.725235] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T18:32:26.259991] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T18:32:26.502400] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-01T18:32:27.302449] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-01T18:32:27.810695] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T18:32:28.102413] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-01T18:32:28.902423] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-01T18:32:29.170861] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T18:32:29.365688] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-01T18:32:29.525921] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T18:32:29.702380] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-01T18:32:30.502414] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-01T18:32:30.743834] [DEBUG] [REMOTE ] DTM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:32:30.744193] [WARN ] [REMOTE ] DTM: No data returned for month 2025-10 [2025-10-01T18:32:30.744297] [FATAL] [REMOTE ] DTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:32:30.744423] [FATAL] [MAIN ] DTM: Failed to fetch primary data. [2025-10-01T18:32:30.744508] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:32:30.744600] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-01T18:32:30.744725] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-01T18:32:30.744785] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-01T18:32:30.745291] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-10-01T18:32:30.745381] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTM took 40.1s. Estimated remaining: 3h 57m 41s. Rate: 7.2 symbols/min [2025-10-01T18:32:30.937684] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:32:30.937952] [DEBUG] [LOCAL ] DV: No existing data file found in primary storage. [2025-10-01T18:32:30.938001] [WARN ] [MAIN ] DV: No existing data found, performing full refresh instead. [2025-10-01T18:32:30.938080] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-01T18:32:30.938117] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-01T18:32:30.938159] [DEBUG] [LOCAL ] DV: No primary data file found to delete. [2025-10-01T18:32:30.938193] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-01T18:32:31.110184] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T18:32:31.324812] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-01T18:32:31.415237] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:32:32.102411] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-01T18:32:32.702986] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T18:32:32.902368] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-01T18:32:33.206015] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T18:32:33.702401] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-01T18:32:34.474594] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T18:32:34.502393] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-01T18:32:34.726760] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T18:32:35.035852] [DEBUG] [REMOTE ] DTW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:32:35.036165] [WARN ] [REMOTE ] DTW: No data returned for month 2025-10 [2025-10-01T18:32:35.036260] [FATAL] [REMOTE ] DTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:32:35.036342] [FATAL] [MAIN ] DTW: Failed to fetch primary data. [2025-10-01T18:32:35.036406] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:32:35.036493] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-01T18:32:35.036621] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-01T18:32:35.036723] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-01T18:32:35.036791] [DEBUG] [LOCAL ] DTW: No derivative data file found to delete. [2025-10-01T18:32:35.036886] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTW took 26.4s. Estimated remaining: 3h 57m 22s. Rate: 7.2 symbols/min [2025-10-01T18:32:35.229093] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:32:35.278537] [DEBUG] [LOCAL ] DVA: Loaded 41035 existing records from primary storage. [2025-10-01T18:32:35.278916] [INFO ] [MAIN ] DVA: Loaded 41035 existing records. [2025-10-01T18:32:35.309007] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-01T18:32:35.474336] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:32:35.474581] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-01T18:32:35.474632] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-01T18:32:35.475906] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-01T18:32:35.475973] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-01T18:32:35.910620] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:32:36.102429] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-01T18:32:36.894495] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T18:32:36.904332] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-01T18:32:37.490200] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T18:32:37.702440] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-01T18:32:38.112672] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T18:32:38.503013] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-01T18:32:38.504202] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T18:32:39.302382] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-01T18:32:39.999910] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T18:32:40.102394] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-01T18:32:40.902393] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-01T18:32:41.161863] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T18:32:41.305775] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-01T18:32:41.702415] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-01T18:32:42.502388] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-01T18:32:42.905161] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-01T18:32:42.920932] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T18:32:43.302407] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-01T18:32:44.102357] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-01T18:32:44.158833] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T18:32:44.902409] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-01T18:32:45.702359] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-01T18:32:45.738583] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-01T18:32:45.824524] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T18:32:46.502404] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-01T18:32:46.524939] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T18:32:46.630900] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T18:32:47.302386] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-01T18:32:48.055233] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T18:32:48.102429] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-01T18:32:48.617188] [DEBUG] [REMOTE ] DUK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:32:48.617566] [WARN ] [REMOTE ] DUK: No data returned for month 2025-10 [2025-10-01T18:32:48.617677] [FATAL] [REMOTE ] DUK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:32:48.617772] [FATAL] [MAIN ] DUK: Failed to fetch primary data. [2025-10-01T18:32:48.617872] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:32:48.617949] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-01T18:32:48.618017] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-01T18:32:48.618056] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-10-01T18:32:48.618098] [DEBUG] [LOCAL ] DUK: No derivative data file found to delete. [2025-10-01T18:32:48.618145] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUK took 36.9s. Estimated remaining: 3h 57m 27s. Rate: 7.2 symbols/min [2025-10-01T18:32:48.746077] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-01T18:32:48.828990] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:32:48.889469] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-01T18:32:48.889842] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-01T18:32:48.912416] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-01T18:32:49.100462] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:32:49.100725] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-01T18:32:49.100783] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-01T18:32:49.103896] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-01T18:32:49.103963] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-01T18:32:49.500102] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:32:49.702398] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-01T18:32:50.446507] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T18:32:50.502419] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-01T18:32:50.992533] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T18:32:51.302360] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-01T18:32:51.430990] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T18:32:51.718883] [DEBUG] [REMOTE ] DUKB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:32:51.719196] [WARN ] [REMOTE ] DUKB: No data returned for month 2025-10 [2025-10-01T18:32:51.719286] [FATAL] [REMOTE ] DUKB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:32:51.719375] [FATAL] [MAIN ] DUKB: Failed to fetch primary data. [2025-10-01T18:32:51.719440] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:32:51.719512] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-01T18:32:51.719576] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-01T18:32:51.719614] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-01T18:32:51.720150] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-01T18:32:51.720253] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUKB took 30.3s. Estimated remaining: 3h 57m 5s. Rate: 7.2 symbols/min [2025-10-01T18:32:51.982333] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:32:52.048259] [DEBUG] [LOCAL ] DX: Loaded 52469 existing records from primary storage. [2025-10-01T18:32:52.048699] [INFO ] [MAIN ] DX: Loaded 52469 existing records. [2025-10-01T18:32:52.109514] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-01T18:32:52.255327] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:32:52.255561] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-01T18:32:52.255609] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-01T18:32:52.257232] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-01T18:32:52.257296] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-01T18:32:52.664107] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:32:52.902385] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-01T18:32:53.702361] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-01T18:32:53.737603] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T18:32:54.507530] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-01T18:32:54.526391] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T18:32:55.302399] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-01T18:32:55.463583] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T18:32:56.102380] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-01T18:32:56.480071] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T18:32:56.720383] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T18:32:56.902385] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-01T18:32:57.702387] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-01T18:32:57.762914] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T18:32:58.063414] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T18:32:58.502374] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-01T18:32:59.302353] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-01T18:32:59.561953] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T18:33:00.092037] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T18:33:00.102405] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-01T18:33:00.814056] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T18:33:00.902370] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-01T18:33:01.702374] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-01T18:33:01.800497] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T18:33:02.093709] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T18:33:02.502419] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-01T18:33:03.302362] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-01T18:33:03.468194] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T18:33:04.072918] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T18:33:04.102433] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-01T18:33:04.902396] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-01T18:33:05.001847] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T18:33:05.416475] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T18:33:05.702398] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-01T18:33:06.502376] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-01T18:33:06.896165] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T18:33:07.302396] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-01T18:33:07.631058] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T18:33:07.632444] [INFO ] [REMOTE ] DVA: Full fetch complete (59738 records). [2025-10-01T18:33:07.632553] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-01T18:33:08.054991] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-01T18:33:08.055088] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-01T18:33:08.056039] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-01T18:33:08.056107] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-01T18:33:08.057387] [DEBUG] [LOCAL ] DVA: Trimmed 59738 records to 41054 (keeping 200 days of data) [2025-10-01T18:33:08.112559] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-01T18:33:08.327823] [DEBUG] [LOCAL ] DVA: Primary data saved (41054 records). [2025-10-01T18:33:08.327987] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-01T18:33:08.328075] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 33.3s. Estimated remaining: 3h 57m 18s. Rate: 7.2 symbols/min [2025-10-01T18:33:08.539522] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:33:08.595745] [DEBUG] [LOCAL ] DXC: Loaded 49776 existing records from primary storage. [2025-10-01T18:33:08.596105] [INFO ] [MAIN ] DXC: Loaded 49776 existing records. [2025-10-01T18:33:08.839771] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:33:08.843124] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-01T18:33:08.843190] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-01T18:33:08.845294] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-01T18:33:08.845354] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-01T18:33:08.845583] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-01T18:33:08.907716] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-01T18:33:09.270858] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:33:09.495930] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-01T18:33:09.702372] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-01T18:33:09.788241] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T18:33:10.502428] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-01T18:33:11.006857] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T18:33:11.010989] [INFO ] [REMOTE ] DV: Full fetch complete (73464 records). [2025-10-01T18:33:11.011132] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-01T18:33:11.314863] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-01T18:33:11.468362] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-01T18:33:11.468457] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-01T18:33:11.469415] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-01T18:33:11.469543] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-01T18:33:11.471113] [DEBUG] [LOCAL ] DV: Trimmed 73464 records to 51286 (keeping 200 days of data) [2025-10-01T18:33:11.809757] [DEBUG] [LOCAL ] DV: Primary data saved (51286 records). [2025-10-01T18:33:11.809908] [INFO ] [MAIN ] DV: Full history saved. [2025-10-01T18:33:11.809985] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DV took 41.1s. Estimated remaining: 3h 56m 57s. Rate: 7.2 symbols/min [2025-10-01T18:33:12.020013] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:33:12.053736] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-01T18:33:12.100939] [DEBUG] [LOCAL ] DXYZ: Loaded 36771 existing records from primary storage. [2025-10-01T18:33:12.101231] [INFO ] [MAIN ] DXYZ: Loaded 36771 existing records. [2025-10-01T18:33:12.107519] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-01T18:33:12.322391] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:33:12.322904] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-01T18:33:12.323042] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-01T18:33:12.334881] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-01T18:33:12.340154] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-01T18:33:12.438428] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T18:33:12.794680] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:33:12.902399] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-01T18:33:13.065354] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T18:33:13.702505] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-01T18:33:14.305478] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-01T18:33:14.502474] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-01T18:33:14.698563] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T18:33:14.786395] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T18:33:15.302388] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-01T18:33:16.102412] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-01T18:33:16.792742] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-01T18:33:16.902424] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-01T18:33:17.268996] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-01T18:33:17.353470] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T18:33:17.702387] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-01T18:33:18.502397] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-01T18:33:19.058156] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-01T18:33:19.302400] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-01T18:33:19.998591] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T18:33:20.102352] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-01T18:33:20.608046] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-01T18:33:20.902386] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-01T18:33:21.427245] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-01T18:33:21.702363] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-01T18:33:21.979054] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T18:33:22.502399] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-01T18:33:22.929337] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-01T18:33:23.231154] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T18:33:23.302421] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-01T18:33:24.102384] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-01T18:33:24.895058] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-01T18:33:24.896761] [INFO ] [REMOTE ] DX: Full fetch complete (75457 records). [2025-10-01T18:33:24.896907] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-01T18:33:24.935519] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-01T18:33:25.329088] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-01T18:33:25.329173] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-01T18:33:25.330160] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-01T18:33:25.330230] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-01T18:33:25.331785] [DEBUG] [LOCAL ] DX: Trimmed 75457 records to 52464 (keeping 200 days of data) [2025-10-01T18:33:25.678924] [DEBUG] [LOCAL ] DX: Primary data saved (52464 records). [2025-10-01T18:33:25.679218] [INFO ] [MAIN ] DX: Full history saved. [2025-10-01T18:33:25.679321] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DX took 34.0s. Estimated remaining: 3h 57m 3s. Rate: 7.2 symbols/min [2025-10-01T18:33:25.796420] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-01T18:33:25.817164] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-01T18:33:25.832834] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-01T18:33:25.901498] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:33:26.024344] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T18:33:26.058945] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-01T18:33:26.249776] [DEBUG] [LOCAL ] DY: Loaded 29287 existing records from primary storage. [2025-10-01T18:33:26.275578] [INFO ] [MAIN ] DY: Loaded 29287 existing records. [2025-10-01T18:33:26.611406] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-01T18:33:26.611305] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:33:26.611624] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-01T18:33:26.611732] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-01T18:33:26.611852] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-01T18:33:26.613294] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-01T18:33:26.613244] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-01T18:33:26.613423] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-01T18:33:26.613517] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-01T18:33:26.734912] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 53699 (keeping 200 days of data) [2025-10-01T18:33:27.145300] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:33:27.146011] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-01T18:33:27.182862] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-01T18:33:27.302393] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-01T18:33:27.431931] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-10-01T18:33:27.432136] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-01T18:33:27.432245] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DVN took 38.8s. Estimated remaining: 3h 56m 38s. Rate: 7.2 symbols/min [2025-10-01T18:33:27.622377] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:33:27.656670] [DEBUG] [LOCAL ] E: Loaded 33253 existing records from primary storage. [2025-10-01T18:33:27.657155] [INFO ] [MAIN ] E: Loaded 33253 existing records. [2025-10-01T18:33:27.857349] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:33:27.857808] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-01T18:33:27.857917] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-01T18:33:27.886746] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T18:33:27.886807] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-01T18:33:27.897161] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-01T18:33:28.128278] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-01T18:33:28.318125] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:33:28.817954] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T18:33:28.884779] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T18:33:28.902385] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-01T18:33:29.543511] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T18:33:29.702415] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-01T18:33:29.936341] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T18:33:30.502395] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-01T18:33:30.937213] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T18:33:31.302397] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-01T18:33:32.102389] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-01T18:33:32.290999] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T18:33:32.401143] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T18:33:32.902367] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-01T18:33:33.702388] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-01T18:33:34.171541] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T18:33:34.401889] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T18:33:34.502357] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-01T18:33:34.835701] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T18:33:35.302408] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-01T18:33:36.102408] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-01T18:33:36.202282] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T18:33:36.612969] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T18:33:36.902415] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-01T18:33:37.596488] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T18:33:37.702447] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-01T18:33:38.502346] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-01T18:33:38.768206] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T18:33:39.154569] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T18:33:39.302385] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-01T18:33:40.102391] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-01T18:33:40.165981] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T18:33:40.842978] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T18:33:40.902353] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-01T18:33:41.624481] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T18:33:41.702385] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-01T18:33:42.502439] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-01T18:33:42.715369] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T18:33:43.302385] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-01T18:33:43.589198] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T18:33:43.590838] [INFO ] [REMOTE ] DXC: Full fetch complete (69168 records). [2025-10-01T18:33:43.590934] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-01T18:33:44.062077] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-01T18:33:44.062571] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-01T18:33:44.063639] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-01T18:33:44.063749] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-01T18:33:44.084852] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T18:33:44.092188] [DEBUG] [LOCAL ] DXC: Trimmed 69168 records to 49790 (keeping 200 days of data) [2025-10-01T18:33:44.144093] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-01T18:33:44.402333] [DEBUG] [LOCAL ] DXC: Primary data saved (49790 records). [2025-10-01T18:33:44.402492] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-01T18:33:44.402592] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 36.1s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-01T18:33:44.607493] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:33:44.658315] [DEBUG] [LOCAL ] EAF: Loaded 43066 existing records from primary storage. [2025-10-01T18:33:44.658756] [INFO ] [MAIN ] EAF: Loaded 43066 existing records. [2025-10-01T18:33:44.862028] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:33:44.862488] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-01T18:33:44.862564] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-01T18:33:44.870394] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-01T18:33:44.882780] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-01T18:33:44.907532] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-01T18:33:44.919752] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T18:33:45.298048] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:33:45.702398] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-01T18:33:45.763474] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T18:33:46.502433] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-01T18:33:46.645920] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T18:33:47.216666] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T18:33:47.302407] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-01T18:33:47.776699] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T18:33:48.102377] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-01T18:33:48.902387] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-01T18:33:48.965325] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T18:33:49.152787] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T18:33:49.702385] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-01T18:33:50.502408] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-01T18:33:50.894128] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-01T18:33:51.062750] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T18:33:51.300807] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T18:33:51.306971] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-01T18:33:52.102369] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-01T18:33:52.759316] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T18:33:52.902392] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-01T18:33:53.510538] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T18:33:53.702405] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-01T18:33:54.323892] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T18:33:54.502384] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-01T18:33:55.302387] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-01T18:33:55.311633] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-01T18:33:55.313496] [INFO ] [REMOTE ] E: Full fetch complete (48331 records). [2025-10-01T18:33:55.313689] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-01T18:33:55.751501] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-01T18:33:55.751595] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-01T18:33:55.752360] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-01T18:33:55.752427] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-01T18:33:55.754041] [DEBUG] [LOCAL ] E: Trimmed 48331 records to 33300 (keeping 200 days of data) [2025-10-01T18:33:55.988345] [DEBUG] [LOCAL ] E: Primary data saved (33300 records). [2025-10-01T18:33:55.988604] [INFO ] [MAIN ] E: Full history saved. [2025-10-01T18:33:55.988823] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. E took 28.6s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-01T18:33:56.108631] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-01T18:33:56.190419] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:33:56.197127] [DEBUG] [LOCAL ] EAI: Loaded 3945 existing records from primary storage. [2025-10-01T18:33:56.197365] [INFO ] [MAIN ] EAI: Loaded 3945 existing records. [2025-10-01T18:33:56.392841] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:33:56.393183] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-01T18:33:56.393259] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-01T18:33:56.393723] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-01T18:33:56.393788] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-01T18:33:56.864205] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:33:56.892999] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T18:33:56.902990] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-01T18:33:57.413161] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T18:33:57.575245] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-01T18:33:57.577093] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57808 records). [2025-10-01T18:33:57.577241] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-01T18:33:57.707486] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-01T18:33:57.855148] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T18:33:58.005305] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-01T18:33:58.005437] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-01T18:33:58.006320] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-01T18:33:58.006392] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-01T18:33:58.007747] [DEBUG] [LOCAL ] DXYZ: Trimmed 57808 records to 36866 (keeping 200 days of data) [2025-10-01T18:33:58.232245] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36866 records). [2025-10-01T18:33:58.232390] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-01T18:33:58.232476] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DXYZ took 46.4s. Estimated remaining: 3h 56m 27s. Rate: 7.2 symbols/min [2025-10-01T18:33:58.419258] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:33:58.450448] [DEBUG] [LOCAL ] EARN: Loaded 29751 existing records from primary storage. [2025-10-01T18:33:58.450746] [INFO ] [MAIN ] EARN: Loaded 29751 existing records. [2025-10-01T18:33:58.504681] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-01T18:33:58.645730] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:33:58.645932] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-01T18:33:58.645982] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-01T18:33:58.646908] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-01T18:33:58.646973] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-01T18:33:59.097746] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:33:59.193049] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T18:33:59.302379] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-01T18:34:00.102370] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-01T18:34:00.182282] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T18:34:00.382562] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T18:34:00.802210] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T18:34:00.902429] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-01T18:34:01.702428] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-01T18:34:02.502399] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-01T18:34:02.782914] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T18:34:02.924833] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T18:34:03.208712] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T18:34:03.209845] [INFO ] [REMOTE ] DY: Full fetch complete (44783 records). [2025-10-01T18:34:03.209957] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-01T18:34:03.307535] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-01T18:34:03.624471] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-01T18:34:03.624563] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-01T18:34:03.625241] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-01T18:34:03.625306] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-01T18:34:03.626458] [DEBUG] [LOCAL ] DY: Trimmed 44783 records to 29088 (keeping 200 days of data) [2025-10-01T18:34:03.808493] [DEBUG] [LOCAL ] DY: Primary data saved (29088 records). [2025-10-01T18:34:03.808635] [INFO ] [MAIN ] DY: Full history saved. [2025-10-01T18:34:03.808806] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. DY took 38.1s. Estimated remaining: 3h 56m 12s. Rate: 7.2 symbols/min [2025-10-01T18:34:03.990066] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:34:03.990276] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-10-01T18:34:03.990333] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-10-01T18:34:03.990457] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-01T18:34:03.990504] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-01T18:34:03.990547] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-01T18:34:03.990592] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-01T18:34:04.107579] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-01T18:34:04.373938] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:34:04.735872] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T18:34:04.848226] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T18:34:04.902368] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-01T18:34:05.702448] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-01T18:34:06.174059] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T18:34:06.185835] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-01T18:34:06.502452] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-01T18:34:07.302404] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-01T18:34:08.102370] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-01T18:34:08.588188] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-01T18:34:08.902405] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-01T18:34:08.904633] [DEBUG] [REMOTE ] EAF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:34:08.905020] [WARN ] [REMOTE ] EAF: No data returned for month 2025-10 [2025-10-01T18:34:08.905131] [FATAL] [REMOTE ] EAF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:34:08.905245] [FATAL] [MAIN ] EAF: Failed to fetch primary data. [2025-10-01T18:34:08.905316] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:34:08.905390] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-01T18:34:08.905458] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-01T18:34:08.905498] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-01T18:34:08.906103] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-10-01T18:34:08.906225] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAF took 24.5s. Estimated remaining: 3h 55m 55s. Rate: 7.2 symbols/min [2025-10-01T18:34:09.123153] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:34:09.160194] [DEBUG] [LOCAL ] EB: Loaded 37197 existing records from primary storage. [2025-10-01T18:34:09.160517] [INFO ] [MAIN ] EB: Loaded 37197 existing records. [2025-10-01T18:34:09.413959] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:34:09.416197] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T18:34:09.416329] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-01T18:34:09.419416] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-01T18:34:09.426516] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-01T18:34:09.426624] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-01T18:34:09.708932] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-01T18:34:09.825499] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:34:10.490558] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T18:34:10.502344] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-01T18:34:10.745476] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T18:34:11.302428] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-01T18:34:11.946043] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T18:34:12.102373] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-01T18:34:12.902434] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-01T18:34:12.959204] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T18:34:13.625068] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T18:34:13.702417] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-01T18:34:14.344579] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T18:34:14.418174] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T18:34:14.502427] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-01T18:34:15.302408] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-01T18:34:16.102355] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-01T18:34:16.134073] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T18:34:16.902443] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-01T18:34:16.902370] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T18:34:17.597348] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-01T18:34:17.702351] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-01T18:34:17.728326] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T18:34:18.502388] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-01T18:34:19.133891] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T18:34:19.264118] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T18:34:19.302374] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-01T18:34:20.102383] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-01T18:34:20.844172] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T18:34:20.902370] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-01T18:34:20.982531] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T18:34:21.617328] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T18:34:21.618238] [INFO ] [REMOTE ] EAI: Full fetch complete (6175 records). [2025-10-01T18:34:21.618355] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-01T18:34:21.707502] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-01T18:34:22.023286] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-01T18:34:22.023365] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-01T18:34:22.023538] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-01T18:34:22.023578] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-01T18:34:22.024006] [DEBUG] [LOCAL ] EAI: Trimmed 6175 records to 3969 (keeping 200 days of data) [2025-10-01T18:34:22.050869] [DEBUG] [LOCAL ] EAI: Primary data saved (3969 records). [2025-10-01T18:34:22.050993] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-01T18:34:22.051078] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAI took 26.1s. Estimated remaining: 3h 55m 59s. Rate: 7.2 symbols/min [2025-10-01T18:34:22.502408] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-01T18:34:23.138791] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T18:34:23.302397] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-01T18:34:24.102364] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-01T18:34:24.490395] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T18:34:24.568162] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T18:34:24.902417] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-01T18:34:25.490529] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T18:34:25.702394] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-01T18:34:26.031494] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T18:34:26.502360] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-01T18:34:26.820856] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T18:34:27.302493] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-01T18:34:28.102378] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-01T18:34:28.165680] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T18:34:28.214953] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T18:34:28.902424] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-01T18:34:29.566287] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T18:34:29.702430] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-01T18:34:30.122440] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T18:34:30.502394] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-01T18:34:31.302413] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-01T18:34:31.357273] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T18:34:32.059397] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T18:34:32.102355] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-01T18:34:32.395743] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T18:34:32.902377] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-01T18:34:33.702369] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-01T18:34:33.902427] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T18:34:34.502385] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-01T18:34:34.569763] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-01T18:34:34.571126] [INFO ] [REMOTE ] EARN: Full fetch complete (46104 records). [2025-10-01T18:34:34.571237] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-01T18:34:34.987348] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-01T18:34:34.987484] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-01T18:34:34.988591] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-01T18:34:34.988785] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-01T18:34:35.013550] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T18:34:35.013742] [DEBUG] [LOCAL ] EARN: Trimmed 46104 records to 29659 (keeping 200 days of data) [2025-10-01T18:34:35.198620] [DEBUG] [LOCAL ] EARN: Primary data saved (29659 records). [2025-10-01T18:34:35.198788] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-01T18:34:35.198890] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 37.0s. Estimated remaining: 3h 56m 3s. Rate: 7.2 symbols/min [2025-10-01T18:34:35.302417] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-01T18:34:36.348951] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T18:34:36.360018] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-01T18:34:36.547063] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T18:34:36.902442] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-01T18:34:38.398041] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-01T18:34:38.409227] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-01T18:34:38.442116] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-01T18:34:38.443309] [INFO ] [REMOTE ] EB: Full fetch complete (56206 records). [2025-10-01T18:34:38.443392] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-01T18:34:38.862581] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-01T18:34:38.862692] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-01T18:34:38.863513] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-01T18:34:38.863578] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-01T18:34:38.864955] [DEBUG] [LOCAL ] EB: Trimmed 56206 records to 37100 (keeping 200 days of data) [2025-10-01T18:34:39.079200] [DEBUG] [LOCAL ] EB: Primary data saved (37100 records). [2025-10-01T18:34:39.079352] [INFO ] [MAIN ] EB: Full history saved. [2025-10-01T18:34:39.079437] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EB took 30.2s. Estimated remaining: 3h 55m 43s. Rate: 7.2 symbols/min [2025-10-01T18:34:40.660799] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T18:34:40.662440] [INFO ] [REMOTE ] EAT: Full fetch complete (71933 records). [2025-10-01T18:34:40.662602] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-01T18:34:41.118372] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-01T18:34:41.118477] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-01T18:34:41.119475] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-01T18:34:41.119547] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-01T18:34:41.121092] [DEBUG] [LOCAL ] EAT: Trimmed 71933 records to 49771 (keeping 200 days of data) [2025-10-01T18:34:41.429127] [DEBUG] [LOCAL ] EAT: Primary data saved (49771 records). [2025-10-01T18:34:41.429280] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-01T18:34:41.429426] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EAT took 37.6s. Estimated remaining: 3h 55m 20s. Rate: 7.2 symbols/min [2025-10-01T18:34:42.113358] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:34:42.112415] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:34:42.137501] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:34:42.215108] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:34:42.240849] [DEBUG] [LOCAL ] EBF: Loaded 19235 existing records from primary storage. [2025-10-01T18:34:42.250552] [INFO ] [MAIN ] EBF: Loaded 19235 existing records. [2025-10-01T18:34:42.379481] [DEBUG] [LOCAL ] EBR: Loaded 43075 existing records from primary storage. [2025-10-01T18:34:42.407469] [INFO ] [MAIN ] EBR: Loaded 43075 existing records. [2025-10-01T18:34:42.522866] [DEBUG] [LOCAL ] EC: Loaded 49276 existing records from primary storage. [2025-10-01T18:34:42.584405] [INFO ] [MAIN ] EC: Loaded 49276 existing records. [2025-10-01T18:34:42.684581] [DEBUG] [LOCAL ] EBS: Loaded 46630 existing records from primary storage. [2025-10-01T18:34:42.658031] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:34:42.704972] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-01T18:34:42.716433] [INFO ] [MAIN ] EBS: Loaded 46630 existing records. [2025-10-01T18:34:42.732138] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-01T18:34:42.859311] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-01T18:34:42.864577] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-01T18:34:43.005206] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:34:43.117548] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-01T18:34:43.181415] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-01T18:34:43.184731] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:34:43.227875] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-01T18:34:43.227781] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-01T18:34:43.260118] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-01T18:34:43.238688] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-01T18:34:43.275674] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-01T18:34:43.319065] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-01T18:34:43.535031] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:34:43.594813] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-01T18:34:43.632034] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-01T18:34:43.733338] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-01T18:34:43.775909] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-01T18:34:44.045174] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:34:44.118523] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-01T18:34:44.596938] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:34:44.626627] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-01T18:34:44.693984] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:34:44.723274] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-01T18:34:44.849501] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:34:44.849886] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-01T18:34:45.309375] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T18:34:45.313145] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-01T18:34:46.146609] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T18:34:46.150637] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-01T18:34:46.559937] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T18:34:46.570991] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-01T18:34:46.659101] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T18:34:46.669070] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-01T18:34:46.963581] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T18:34:46.968223] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-01T18:34:47.920347] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T18:34:47.930325] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-01T18:34:48.152353] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T18:34:48.158616] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-01T18:34:48.269535] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T18:34:48.280032] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-01T18:34:48.853757] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T18:34:48.858900] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-01T18:34:49.540452] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T18:34:49.550206] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-01T18:34:49.629635] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T18:34:49.702369] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-01T18:34:50.149482] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T18:34:50.507196] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-01T18:34:50.512951] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (5.89 seconds). [2025-10-01T18:34:50.861430] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T18:34:51.005562] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T18:34:51.302369] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-01T18:34:51.635403] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T18:34:52.102399] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-01T18:34:52.645462] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T18:34:52.765335] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T18:34:52.902365] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-01T18:34:53.702365] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-01T18:34:53.785455] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T18:34:54.502376] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-01T18:34:55.302378] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-01T18:34:55.621573] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T18:34:55.680954] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T18:34:56.102383] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-01T18:34:56.902375] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-01T18:34:57.055285] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T18:34:57.702435] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-01T18:34:57.908779] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-01T18:34:57.910042] [INFO ] [REMOTE ] EBF: Full fetch complete (27440 records). [2025-10-01T18:34:57.910145] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-01T18:34:58.507538] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-01T18:34:58.690055] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-01T18:34:58.690595] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-01T18:34:58.692283] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-01T18:34:58.692433] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-01T18:34:58.696690] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T18:34:58.713898] [DEBUG] [LOCAL ] EBF: Trimmed 27440 records to 19238 (keeping 200 days of data) [2025-10-01T18:34:58.869325] [DEBUG] [LOCAL ] EBF: Primary data saved (19238 records). [2025-10-01T18:34:58.869515] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-01T18:34:58.869638] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 17.4s. Estimated remaining: 3h 55m 34s. Rate: 7.2 symbols/min [2025-10-01T18:34:59.096091] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:34:59.129808] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T18:34:59.172808] [DEBUG] [LOCAL ] ECAT: Loaded 29602 existing records from primary storage. [2025-10-01T18:34:59.173162] [INFO ] [MAIN ] ECAT: Loaded 29602 existing records. [2025-10-01T18:34:59.307611] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-01T18:34:59.378886] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:34:59.379148] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-01T18:34:59.379200] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-01T18:34:59.380714] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-01T18:34:59.380794] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-01T18:34:59.798192] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:34:59.823765] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T18:35:00.102382] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-01T18:35:00.902352] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-01T18:35:01.057796] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T18:35:01.675059] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T18:35:01.702388] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-01T18:35:02.502403] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-01T18:35:02.573706] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T18:35:03.302420] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-01T18:35:03.367081] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T18:35:04.053296] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T18:35:04.102341] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-01T18:35:04.902406] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-01T18:35:05.043862] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T18:35:05.346426] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T18:35:05.702406] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-01T18:35:06.326207] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T18:35:06.502380] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-01T18:35:07.302356] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-01T18:35:07.573616] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T18:35:07.879420] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T18:35:08.102393] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-01T18:35:08.902468] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-01T18:35:09.100877] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T18:35:09.528416] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T18:35:09.702420] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-01T18:35:10.343801] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T18:35:10.502430] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-01T18:35:11.302385] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-01T18:35:11.649028] [DEBUG] [REMOTE ] EBS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:35:11.649413] [WARN ] [REMOTE ] EBS: No data returned for month 2025-10 [2025-10-01T18:35:11.649512] [FATAL] [REMOTE ] EBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:35:11.649600] [FATAL] [MAIN ] EBS: Failed to fetch primary data. [2025-10-01T18:35:11.649700] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:35:11.649776] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-01T18:35:11.649842] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-01T18:35:11.649880] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-10-01T18:35:11.650939] [DEBUG] [LOCAL ] EBS: Deleted derivative data file. [2025-10-01T18:35:11.651058] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBS took 30.2s. Estimated remaining: 3h 55m 37s. Rate: 7.2 symbols/min [2025-10-01T18:35:11.849485] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:35:11.899372] [DEBUG] [LOCAL ] ECC: Loaded 43260 existing records from primary storage. [2025-10-01T18:35:11.899868] [INFO ] [MAIN ] ECC: Loaded 43260 existing records. [2025-10-01T18:35:12.107576] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-01T18:35:12.111451] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:35:12.111856] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-01T18:35:12.112503] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-01T18:35:12.113714] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-01T18:35:12.113804] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-01T18:35:12.529692] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:35:12.547630] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T18:35:12.902411] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-01T18:35:13.207418] [DEBUG] [REMOTE ] EC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:35:13.207802] [WARN ] [REMOTE ] EC: No data returned for month 2025-10 [2025-10-01T18:35:13.207926] [FATAL] [REMOTE ] EC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:35:13.208026] [FATAL] [MAIN ] EC: Failed to fetch primary data. [2025-10-01T18:35:13.208097] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:35:13.208173] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-01T18:35:13.208252] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-01T18:35:13.208294] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-01T18:35:13.208788] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-01T18:35:13.208907] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EC took 31.8s. Estimated remaining: 3h 55m 11s. Rate: 7.2 symbols/min [2025-10-01T18:35:13.400602] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:35:13.400810] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-01T18:35:13.400854] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-01T18:35:13.400965] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-01T18:35:13.401006] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-01T18:35:13.401048] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-01T18:35:13.401080] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-01T18:35:13.713765] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-01T18:35:13.805719] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:35:13.847335] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T18:35:14.098618] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:35:14.502438] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-01T18:35:14.846395] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-01T18:35:15.302382] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-01T18:35:15.480536] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-01T18:35:15.704498] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-01T18:35:16.102379] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-01T18:35:16.902428] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-01T18:35:17.573533] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T18:35:17.702385] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-01T18:35:18.312544] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T18:35:18.502409] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-01T18:35:18.830485] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-01T18:35:19.095585] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T18:35:19.302412] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-01T18:35:20.102368] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-01T18:35:20.377029] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-01T18:35:20.584453] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T18:35:20.902482] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-01T18:35:21.702404] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-01T18:35:22.502376] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-01T18:35:22.573486] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T18:35:22.648355] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T18:35:23.302406] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-01T18:35:23.911737] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T18:35:24.102372] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-01T18:35:24.902430] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-01T18:35:25.223332] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-01T18:35:25.225683] [INFO ] [REMOTE ] EBR: Full fetch complete (62644 records). [2025-10-01T18:35:25.225825] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-01T18:35:25.670175] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-01T18:35:25.670388] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-01T18:35:25.671307] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-01T18:35:25.671399] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-01T18:35:25.672908] [DEBUG] [LOCAL ] EBR: Trimmed 62644 records to 43061 (keeping 200 days of data) [2025-10-01T18:35:25.734905] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-01T18:35:25.819298] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T18:35:25.991106] [DEBUG] [LOCAL ] EBR: Primary data saved (43061 records). [2025-10-01T18:35:25.991249] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-01T18:35:25.991344] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBR took 44.6s. Estimated remaining: 3h 55m 14s. Rate: 7.2 symbols/min [2025-10-01T18:35:26.204288] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:35:26.207562] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T18:35:26.210751] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-01T18:35:26.216949] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-01T18:35:26.218459] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-01T18:35:26.218624] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-01T18:35:26.218709] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-01T18:35:26.218767] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-01T18:35:26.218806] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-01T18:35:26.507545] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-01T18:35:26.628215] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:35:27.302417] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-01T18:35:27.856228] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-01T18:35:28.102359] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-01T18:35:28.283912] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T18:35:28.454424] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-01T18:35:28.902420] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-01T18:35:29.702375] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-01T18:35:30.164288] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T18:35:30.248857] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-01T18:35:30.502408] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-01T18:35:31.302440] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-01T18:35:32.090790] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T18:35:32.102351] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-01T18:35:32.683210] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T18:35:32.902386] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-01T18:35:33.330063] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T18:35:33.482732] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T18:35:33.702410] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-01T18:35:34.502441] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-01T18:35:34.869142] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-01T18:35:35.302396] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-01T18:35:35.430581] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T18:35:35.670275] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-01T18:35:36.102411] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-01T18:35:36.902406] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-01T18:35:37.398002] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T18:35:37.400515] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T18:35:37.702427] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-01T18:35:38.173281] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-01T18:35:38.502414] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-01T18:35:38.749572] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-01T18:35:39.302399] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-01T18:35:40.102384] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-01T18:35:40.533883] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T18:35:40.734675] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T18:35:40.735378] [INFO ] [REMOTE ] ECCC: Full fetch complete (1292 records). [2025-10-01T18:35:40.735451] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-01T18:35:40.906407] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-01T18:35:40.940121] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-01T18:35:40.940294] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:35:40.940363] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:35:40.940443] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-01T18:35:40.940511] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-01T18:35:40.940596] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-01T18:35:40.940689] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-01T18:35:40.940766] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECCC took 27.7s. Estimated remaining: 3h 55m 22s. Rate: 7.2 symbols/min [2025-10-01T18:35:41.133958] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:35:41.134146] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-01T18:35:41.134185] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-01T18:35:41.134296] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-01T18:35:41.134337] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-01T18:35:41.134383] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-01T18:35:41.134418] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-01T18:35:41.523728] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:35:41.702419] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-01T18:35:42.502390] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-01T18:35:42.981469] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-01T18:35:43.227932] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T18:35:43.300943] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-01T18:35:43.302356] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-01T18:35:43.302622] [INFO ] [REMOTE ] ECC: Full fetch complete (61068 records). [2025-10-01T18:35:43.303604] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-01T18:35:43.731636] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-01T18:35:43.731761] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-01T18:35:43.732532] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-01T18:35:43.732574] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-01T18:35:43.733923] [DEBUG] [LOCAL ] ECC: Trimmed 61068 records to 43320 (keeping 200 days of data) [2025-10-01T18:35:43.799332] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-01T18:35:44.002435] [DEBUG] [LOCAL ] ECC: Primary data saved (43320 records). [2025-10-01T18:35:44.002577] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-01T18:35:44.002689] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECC took 32.4s. Estimated remaining: 3h 55m 0s. Rate: 7.2 symbols/min [2025-10-01T18:35:44.107454] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-01T18:35:44.185631] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:35:44.185830] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-01T18:35:44.185921] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-01T18:35:44.186069] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-01T18:35:44.186140] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-01T18:35:44.186202] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-01T18:35:44.186239] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-01T18:35:44.450731] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-01T18:35:44.602215] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:35:44.902383] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-01T18:35:45.167085] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-01T18:35:45.702403] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-01T18:35:46.183121] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-01T18:35:46.502382] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-01T18:35:46.943609] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T18:35:47.302378] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-01T18:35:47.708625] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-01T18:35:48.102377] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-01T18:35:48.902368] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-01T18:35:49.233559] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-01T18:35:49.698914] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-01T18:35:49.700170] [INFO ] [REMOTE ] ECAT: Full fetch complete (42871 records). [2025-10-01T18:35:49.700264] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-01T18:35:49.707526] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-01T18:35:50.158848] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-01T18:35:50.158936] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-01T18:35:50.159598] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-01T18:35:50.159685] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-01T18:35:50.161272] [DEBUG] [LOCAL ] ECAT: Trimmed 42871 records to 29543 (keeping 200 days of data) [2025-10-01T18:35:50.261440] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T18:35:50.364589] [DEBUG] [LOCAL ] ECAT: Primary data saved (29543 records). [2025-10-01T18:35:50.364764] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-01T18:35:50.364871] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECAT took 51.5s. Estimated remaining: 3h 54m 47s. Rate: 7.2 symbols/min [2025-10-01T18:35:50.507489] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-01T18:35:50.563883] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:35:50.600088] [DEBUG] [LOCAL ] ECG: Loaded 33853 existing records from primary storage. [2025-10-01T18:35:50.600402] [INFO ] [MAIN ] ECG: Loaded 33853 existing records. [2025-10-01T18:35:50.802577] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:35:50.802827] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-01T18:35:50.802879] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-01T18:35:50.803949] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-01T18:35:50.804013] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-01T18:35:51.116740] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T18:35:51.224999] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:35:51.302417] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-01T18:35:52.102363] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-01T18:35:52.455766] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-01T18:35:52.902371] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-01T18:35:52.976490] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T18:35:53.178153] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-01T18:35:53.702388] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-01T18:35:54.103927] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-01T18:35:54.502445] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-01T18:35:54.941126] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T18:35:55.302393] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-01T18:35:55.887766] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T18:35:56.102389] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-01T18:35:56.681472] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T18:35:56.682198] [INFO ] [REMOTE ] ECCU: Full fetch complete (4480 records). [2025-10-01T18:35:56.682270] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-01T18:35:56.883913] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-01T18:35:56.884148] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:35:56.884221] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:35:56.884295] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-01T18:35:56.884363] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-01T18:35:56.884400] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-01T18:35:56.884440] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-10-01T18:35:56.884500] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCU took 30.9s. Estimated remaining: 3h 54m 34s. Rate: 7.2 symbols/min [2025-10-01T18:35:56.907484] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-01T18:35:57.089062] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:35:57.143344] [DEBUG] [LOCAL ] ECL: Loaded 46764 existing records from primary storage. [2025-10-01T18:35:57.143757] [INFO ] [MAIN ] ECL: Loaded 46764 existing records. [2025-10-01T18:35:57.342673] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:35:57.342922] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-01T18:35:57.342972] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-01T18:35:57.345019] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-01T18:35:57.345089] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-01T18:35:57.707609] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-01T18:35:57.749731] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:35:58.198675] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-01T18:35:58.425299] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T18:35:58.502402] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-01T18:35:59.302424] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-01T18:35:59.638410] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-01T18:35:59.851113] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T18:36:00.102365] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-01T18:36:00.902391] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-01T18:36:01.702446] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-01T18:36:01.938488] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T18:36:02.134103] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T18:36:02.390453] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T18:36:02.502415] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-01T18:36:03.302420] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-01T18:36:04.102413] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-01T18:36:04.149096] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T18:36:04.387790] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-01T18:36:04.903084] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-01T18:36:04.913267] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T18:36:05.702393] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-01T18:36:06.360412] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T18:36:06.412611] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T18:36:06.502458] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-01T18:36:06.775292] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-01T18:36:07.302351] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-01T18:36:08.102412] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-01T18:36:08.532884] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T18:36:08.603066] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T18:36:08.902392] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-01T18:36:09.230767] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-01T18:36:09.702406] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-01T18:36:10.502362] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-01T18:36:10.531018] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T18:36:10.856898] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-01T18:36:11.302438] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-01T18:36:12.102421] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-01T18:36:12.612760] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T18:36:12.629970] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T18:36:12.630686] [INFO ] [REMOTE ] ECCX: Full fetch complete (1521 records). [2025-10-01T18:36:12.630759] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-01T18:36:12.849421] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-01T18:36:12.849678] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:36:12.849755] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:36:12.849830] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-01T18:36:12.849899] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-01T18:36:12.849937] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-01T18:36:12.849979] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-01T18:36:12.850041] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCX took 28.8s. Estimated remaining: 3h 54m 44s. Rate: 7.2 symbols/min [2025-10-01T18:36:12.910529] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-01T18:36:13.041779] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:36:13.060423] [DEBUG] [LOCAL ] ECO: Loaded 18384 existing records from primary storage. [2025-10-01T18:36:13.060760] [INFO ] [MAIN ] ECO: Loaded 18384 existing records. [2025-10-01T18:36:13.261945] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:36:13.262247] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-01T18:36:13.262304] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-01T18:36:13.262994] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-01T18:36:13.263055] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-01T18:36:13.700306] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:36:13.702348] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-01T18:36:14.502416] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-01T18:36:14.932812] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T18:36:15.067167] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T18:36:15.120194] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-01T18:36:15.302384] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-01T18:36:16.102400] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-01T18:36:16.548875] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T18:36:16.902356] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-01T18:36:16.969407] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T18:36:17.702429] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-01T18:36:18.172431] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T18:36:18.237139] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T18:36:18.237852] [INFO ] [REMOTE ] ECCW: Full fetch complete (1423 records). [2025-10-01T18:36:18.237926] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-01T18:36:18.441630] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-01T18:36:18.441875] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:36:18.441930] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:36:18.442024] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-01T18:36:18.442129] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-01T18:36:18.442187] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-01T18:36:18.442234] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-01T18:36:18.442320] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCW took 37.5s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-01T18:36:18.511726] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-01T18:36:18.635841] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:36:18.680339] [DEBUG] [LOCAL ] ECVT: Loaded 43021 existing records from primary storage. [2025-10-01T18:36:18.680699] [INFO ] [MAIN ] ECVT: Loaded 43021 existing records. [2025-10-01T18:36:18.871610] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:36:18.871865] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-01T18:36:18.871965] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-01T18:36:18.874169] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-01T18:36:18.874232] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-01T18:36:19.282896] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:36:19.302375] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-01T18:36:20.102391] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-01T18:36:20.240398] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T18:36:20.902409] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-01T18:36:21.174383] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T18:36:21.366407] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T18:36:21.702370] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-01T18:36:22.012153] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T18:36:22.502399] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-01T18:36:23.299702] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T18:36:23.308756] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-01T18:36:23.371617] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T18:36:24.102444] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-01T18:36:24.378248] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T18:36:24.902417] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-01T18:36:24.986776] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T18:36:25.702385] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-01T18:36:26.278487] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T18:36:26.279886] [INFO ] [REMOTE ] ECG: Full fetch complete (51417 records). [2025-10-01T18:36:26.279994] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-01T18:36:26.504857] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-01T18:36:26.733806] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-01T18:36:26.733896] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-01T18:36:26.734592] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-01T18:36:26.734634] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-01T18:36:26.736047] [DEBUG] [LOCAL ] ECG: Trimmed 51417 records to 33834 (keeping 200 days of data) [2025-10-01T18:36:26.750951] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T18:36:26.963421] [DEBUG] [LOCAL ] ECG: Primary data saved (33834 records). [2025-10-01T18:36:26.963608] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-01T18:36:26.963743] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 36.6s. Estimated remaining: 3h 54m 21s. Rate: 7.2 symbols/min [2025-10-01T18:36:27.155286] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:36:27.209740] [DEBUG] [LOCAL ] ED: Loaded 52759 existing records from primary storage. [2025-10-01T18:36:27.210141] [INFO ] [MAIN ] ED: Loaded 52759 existing records. [2025-10-01T18:36:27.307923] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-01T18:36:27.428953] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:36:27.429286] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-01T18:36:27.429394] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-01T18:36:27.432502] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-01T18:36:27.432572] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-01T18:36:27.837291] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:36:27.860522] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T18:36:28.102387] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-01T18:36:28.902388] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-01T18:36:29.137705] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T18:36:29.501515] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T18:36:29.702377] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-01T18:36:30.340362] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T18:36:30.502385] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-01T18:36:31.302366] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-01T18:36:31.334706] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T18:36:32.102407] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-01T18:36:32.452088] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-01T18:36:32.902341] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-01T18:36:33.016065] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T18:36:33.605628] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T18:36:33.702347] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-01T18:36:33.869942] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T18:36:34.502399] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-01T18:36:35.302384] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-01T18:36:35.950934] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T18:36:35.953930] [INFO ] [REMOTE ] ECL: Full fetch complete (67960 records). [2025-10-01T18:36:35.954087] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-01T18:36:36.114126] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-01T18:36:36.387251] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T18:36:36.439883] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-01T18:36:36.440299] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-01T18:36:36.441839] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-01T18:36:36.442589] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-01T18:36:36.470148] [DEBUG] [LOCAL ] ECL: Trimmed 67960 records to 46734 (keeping 200 days of data) [2025-10-01T18:36:36.471953] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T18:36:36.790823] [DEBUG] [LOCAL ] ECL: Primary data saved (46734 records). [2025-10-01T18:36:36.790972] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-01T18:36:36.791073] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECL took 39.9s. Estimated remaining: 3h 54m 16s. Rate: 7.2 symbols/min [2025-10-01T18:36:36.907501] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-01T18:36:36.979811] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:36:37.006584] [DEBUG] [LOCAL ] EDD: Loaded 27088 existing records from primary storage. [2025-10-01T18:36:37.006903] [INFO ] [MAIN ] EDD: Loaded 27088 existing records. [2025-10-01T18:36:37.209701] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:36:37.215264] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-01T18:36:37.223113] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-01T18:36:37.224219] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T18:36:37.229245] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-01T18:36:37.229758] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-01T18:36:37.671459] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:36:37.702346] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-01T18:36:38.366420] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T18:36:38.502377] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-01T18:36:38.839697] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T18:36:39.302396] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-01T18:36:40.102356] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-01T18:36:40.376905] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T18:36:40.709893] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-01T18:36:40.902357] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-01T18:36:41.189089] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T18:36:41.702387] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-01T18:36:41.993051] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T18:36:42.502344] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-01T18:36:42.740570] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T18:36:43.295571] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T18:36:43.302336] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-01T18:36:44.102386] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-01T18:36:44.431762] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T18:36:44.432804] [INFO ] [REMOTE ] ECO: Full fetch complete (29097 records). [2025-10-01T18:36:44.432884] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-01T18:36:44.829007] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-01T18:36:44.829086] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-01T18:36:44.829680] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-01T18:36:44.829744] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-01T18:36:44.830463] [DEBUG] [LOCAL ] ECO: Trimmed 29097 records to 18402 (keeping 200 days of data) [2025-10-01T18:36:44.916099] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-01T18:36:44.953706] [DEBUG] [LOCAL ] ECO: Primary data saved (18402 records). [2025-10-01T18:36:44.953858] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-01T18:36:44.953967] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECO took 32.1s. Estimated remaining: 3h 54m 8s. Rate: 7.2 symbols/min [2025-10-01T18:36:45.140373] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:36:45.154007] [DEBUG] [LOCAL ] EDF: Loaded 13382 existing records from primary storage. [2025-10-01T18:36:45.154253] [INFO ] [MAIN ] EDF: Loaded 13382 existing records. [2025-10-01T18:36:45.368982] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:36:45.369463] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-01T18:36:45.369540] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-01T18:36:45.370436] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-01T18:36:45.370507] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-01T18:36:45.726758] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-01T18:36:45.771024] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:36:45.792256] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T18:36:46.502390] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-01T18:36:46.927550] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T18:36:47.198828] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-01T18:36:47.302368] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-01T18:36:48.102414] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-01T18:36:48.160193] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T18:36:48.211465] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T18:36:48.902377] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-01T18:36:49.445326] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T18:36:49.702364] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-01T18:36:50.072561] [DEBUG] [REMOTE ] ECVT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:36:50.072927] [WARN ] [REMOTE ] ECVT: No data returned for month 2025-10 [2025-10-01T18:36:50.073039] [FATAL] [REMOTE ] ECVT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:36:50.073145] [FATAL] [MAIN ] ECVT: Failed to fetch primary data. [2025-10-01T18:36:50.073214] [WARN ] [MAIN ] ECVT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:36:50.073308] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-01T18:36:50.073398] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-01T18:36:50.073446] [INFO ] [LOCAL ] ECVT: Starting deletion of derivative data. [2025-10-01T18:36:50.074351] [DEBUG] [LOCAL ] ECVT: Deleted derivative data file. [2025-10-01T18:36:50.074483] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 31.6s. Estimated remaining: 3h 53m 51s. Rate: 7.2 symbols/min [2025-10-01T18:36:50.273466] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:36:50.295012] [DEBUG] [LOCAL ] EDN: Loaded 18137 existing records from primary storage. [2025-10-01T18:36:50.295256] [INFO ] [MAIN ] EDN: Loaded 18137 existing records. [2025-10-01T18:36:50.504304] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-01T18:36:50.507695] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:36:50.510141] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-01T18:36:50.508872] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T18:36:50.514289] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-01T18:36:50.515540] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-01T18:36:50.515608] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-01T18:36:50.896405] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:36:51.302396] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-01T18:36:52.060739] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T18:36:52.102364] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-01T18:36:52.444541] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T18:36:52.902402] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-01T18:36:53.092484] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T18:36:53.702390] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-01T18:36:54.097617] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T18:36:54.502418] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-01T18:36:55.302349] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-01T18:36:55.431878] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T18:36:55.823010] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T18:36:56.102403] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-01T18:36:56.274045] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T18:36:56.902378] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-01T18:36:57.702362] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-01T18:36:57.825985] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T18:36:58.032637] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T18:36:58.502418] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-01T18:36:58.604677] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-01T18:36:59.302445] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-01T18:36:59.522232] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T18:37:00.102387] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-01T18:37:00.902398] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-01T18:37:01.113216] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T18:37:01.279199] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T18:37:01.702374] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-01T18:37:01.990811] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T18:37:02.502368] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-01T18:37:02.829601] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T18:37:03.302381] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-01T18:37:04.102388] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-01T18:37:04.339286] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T18:37:04.419202] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T18:37:04.902383] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-01T18:37:04.926080] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T18:37:05.702422] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-01T18:37:06.502397] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-01T18:37:06.680244] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T18:37:07.055852] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-01T18:37:07.057575] [INFO ] [REMOTE ] ED: Full fetch complete (76347 records). [2025-10-01T18:37:07.057732] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-01T18:37:07.307685] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-01T18:37:07.498086] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-01T18:37:07.498177] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-01T18:37:07.499131] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-01T18:37:07.499201] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-01T18:37:07.500810] [DEBUG] [LOCAL ] ED: Trimmed 76347 records to 52758 (keeping 200 days of data) [2025-10-01T18:37:07.854775] [DEBUG] [LOCAL ] ED: Primary data saved (52758 records). [2025-10-01T18:37:07.854919] [INFO ] [MAIN ] ED: Full history saved. [2025-10-01T18:37:07.855020] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. ED took 40.9s. Estimated remaining: 3h 54m 6s. Rate: 7.2 symbols/min [2025-10-01T18:37:08.041528] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T18:37:08.069191] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:37:08.086783] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T18:37:08.111025] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-01T18:37:08.130715] [DEBUG] [LOCAL ] EDU: Loaded 44992 existing records from primary storage. [2025-10-01T18:37:08.131021] [INFO ] [MAIN ] EDU: Loaded 44992 existing records. [2025-10-01T18:37:08.328511] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:37:08.328790] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-01T18:37:08.328848] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-01T18:37:08.329262] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-01T18:37:08.329349] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-01T18:37:08.708017] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:37:08.833572] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T18:37:08.902398] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-01T18:37:09.702396] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-01T18:37:10.502365] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-01T18:37:10.645512] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T18:37:10.668835] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T18:37:11.130248] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-01T18:37:11.302394] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-01T18:37:12.102393] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-01T18:37:12.819148] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T18:37:12.902342] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-01T18:37:13.084593] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T18:37:13.702376] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-01T18:37:13.883474] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T18:37:13.884403] [INFO ] [REMOTE ] EDF: Full fetch complete (20945 records). [2025-10-01T18:37:13.884508] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-01T18:37:14.294065] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-01T18:37:14.294195] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-01T18:37:14.294712] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-01T18:37:14.294775] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-01T18:37:14.295425] [DEBUG] [LOCAL ] EDF: Trimmed 20945 records to 13369 (keeping 200 days of data) [2025-10-01T18:37:14.376401] [DEBUG] [LOCAL ] EDF: Primary data saved (13369 records). [2025-10-01T18:37:14.376572] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-01T18:37:14.376724] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDF took 29.4s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-10-01T18:37:14.507478] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-01T18:37:14.571442] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:37:14.571688] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-10-01T18:37:14.571749] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-10-01T18:37:14.571869] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-01T18:37:14.571913] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-01T18:37:14.571957] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-01T18:37:14.571992] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-01T18:37:14.972676] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:37:15.302385] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-01T18:37:15.372814] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T18:37:15.592754] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T18:37:15.593965] [INFO ] [REMOTE ] EDD: Full fetch complete (38866 records). [2025-10-01T18:37:15.594061] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-01T18:37:15.997139] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-01T18:37:15.997229] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-01T18:37:15.997914] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-01T18:37:15.997980] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-01T18:37:15.999039] [DEBUG] [LOCAL ] EDD: Trimmed 38866 records to 27172 (keeping 200 days of data) [2025-10-01T18:37:16.102464] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-01T18:37:16.162316] [DEBUG] [LOCAL ] EDD: Primary data saved (27172 records). [2025-10-01T18:37:16.162468] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-01T18:37:16.162557] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDD took 39.4s. Estimated remaining: 3h 53m 29s. Rate: 7.2 symbols/min [2025-10-01T18:37:16.351314] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:37:16.351515] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-01T18:37:16.351560] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-01T18:37:16.351703] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-01T18:37:16.351756] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-01T18:37:16.351801] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-01T18:37:16.351843] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-01T18:37:16.776336] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:37:16.837453] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T18:37:16.902337] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-01T18:37:17.369723] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:37:17.702379] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-01T18:37:18.509631] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-01T18:37:18.516491] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T18:37:18.540816] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T18:37:19.145260] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T18:37:19.302401] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-01T18:37:20.102400] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-01T18:37:20.902396] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-01T18:37:21.023817] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T18:37:21.161824] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T18:37:21.607035] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T18:37:21.702443] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-01T18:37:22.502381] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-01T18:37:23.109736] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T18:37:23.122820] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T18:37:23.302408] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-01T18:37:23.722920] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T18:37:24.102387] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-01T18:37:24.688213] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T18:37:24.902405] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-01T18:37:25.533667] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T18:37:25.702389] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-01T18:37:26.502447] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-01T18:37:26.942735] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T18:37:26.982381] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-01T18:37:27.302390] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-01T18:37:28.102391] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-01T18:37:28.705548] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T18:37:28.902394] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-01T18:37:29.407981] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T18:37:29.408982] [INFO ] [REMOTE ] EDN: Full fetch complete (30174 records). [2025-10-01T18:37:29.409058] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-01T18:37:29.711872] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-01T18:37:29.817700] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-01T18:37:29.817798] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-01T18:37:29.818370] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-01T18:37:29.818433] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-01T18:37:29.819167] [DEBUG] [LOCAL ] EDN: Trimmed 30174 records to 18154 (keeping 200 days of data) [2025-10-01T18:37:29.931511] [DEBUG] [LOCAL ] EDN: Primary data saved (18154 records). [2025-10-01T18:37:29.931684] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-01T18:37:29.931794] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 39.9s. Estimated remaining: 3h 53m 33s. Rate: 7.2 symbols/min [2025-10-01T18:37:30.118476] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:37:30.131425] [DEBUG] [LOCAL ] EEX: Loaded 11608 existing records from primary storage. [2025-10-01T18:37:30.131683] [INFO ] [MAIN ] EEX: Loaded 11608 existing records. [2025-10-01T18:37:30.332116] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:37:30.332620] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-01T18:37:30.332777] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-01T18:37:30.333059] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-01T18:37:30.333236] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-01T18:37:30.410237] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T18:37:30.450294] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T18:37:30.507435] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-01T18:37:30.771556] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:37:31.302385] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-01T18:37:31.705134] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-01T18:37:32.102428] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-01T18:37:32.311428] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T18:37:32.902379] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-01T18:37:32.965729] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T18:37:33.702369] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-01T18:37:34.142494] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T18:37:34.421406] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-01T18:37:34.502370] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-01T18:37:35.302399] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-01T18:37:35.534104] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T18:37:35.769946] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-01T18:37:36.102390] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-01T18:37:36.902380] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-01T18:37:37.306322] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-01T18:37:37.671735] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T18:37:37.702352] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-01T18:37:38.197485] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-01T18:37:38.198281] [INFO ] [REMOTE ] EEA: Full fetch complete (3920 records). [2025-10-01T18:37:38.198358] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-01T18:37:38.392959] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T18:37:38.393206] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:37:38.393277] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:37:38.393352] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-01T18:37:38.393419] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-01T18:37:38.393457] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-01T18:37:38.393559] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-01T18:37:38.393639] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EEA took 22.2s. Estimated remaining: 3h 53m 25s. Rate: 7.2 symbols/min [2025-10-01T18:37:38.504431] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-01T18:37:38.582230] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:37:38.634669] [DEBUG] [LOCAL ] EFC: Loaded 46224 existing records from primary storage. [2025-10-01T18:37:38.635073] [INFO ] [MAIN ] EFC: Loaded 46224 existing records. [2025-10-01T18:37:38.830084] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:37:38.830305] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-01T18:37:38.830391] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-01T18:37:38.831772] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-01T18:37:38.831838] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-01T18:37:39.220195] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:37:39.302378] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-01T18:37:40.013077] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T18:37:40.102371] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-01T18:37:40.907925] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-01T18:37:40.928021] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T18:37:41.340607] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T18:37:41.702396] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-01T18:37:42.502398] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-01T18:37:42.997914] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T18:37:43.253776] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-01T18:37:43.256500] [INFO ] [REMOTE ] EDU: Full fetch complete (66496 records). [2025-10-01T18:37:43.256628] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-01T18:37:43.308267] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-01T18:37:43.686318] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-01T18:37:43.686479] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-01T18:37:43.687448] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-01T18:37:43.687515] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-01T18:37:43.689113] [DEBUG] [LOCAL ] EDU: Trimmed 66496 records to 44983 (keeping 200 days of data) [2025-10-01T18:37:43.953366] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T18:37:44.005235] [DEBUG] [LOCAL ] EDU: Primary data saved (44983 records). [2025-10-01T18:37:44.005370] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-01T18:37:44.005466] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EDU took 36.2s. Estimated remaining: 3h 53m 10s. Rate: 7.2 symbols/min [2025-10-01T18:37:44.108079] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-01T18:37:44.202815] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:37:44.202977] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-10-01T18:37:44.203013] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-10-01T18:37:44.203143] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-01T18:37:44.203203] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-01T18:37:44.203247] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-01T18:37:44.203299] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-01T18:37:44.644730] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T18:37:44.691919] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:37:44.902376] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-01T18:37:45.487818] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:37:45.702410] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-01T18:37:46.233011] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T18:37:46.502432] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-01T18:37:46.745531] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T18:37:47.302375] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-01T18:37:47.724321] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T18:37:48.102387] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-01T18:37:48.200523] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T18:37:48.902386] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-01T18:37:49.486278] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T18:37:49.488208] [INFO ] [REMOTE ] EE: Full fetch complete (43650 records). [2025-10-01T18:37:49.488296] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-01T18:37:49.702414] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-01T18:37:49.687796] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T18:37:49.960493] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-01T18:37:49.960623] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-01T18:37:49.962327] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-01T18:37:49.962426] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-01T18:37:49.964212] [DEBUG] [LOCAL ] EE: Trimmed 43650 records to 32474 (keeping 200 days of data) [2025-10-01T18:37:50.277721] [DEBUG] [LOCAL ] EE: Primary data saved (32474 records). [2025-10-01T18:37:50.277940] [INFO ] [MAIN ] EE: Full history saved. [2025-10-01T18:37:50.278068] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EE took 35.9s. Estimated remaining: 3h 52m 57s. Rate: 7.2 symbols/min [2025-10-01T18:37:50.508248] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-01T18:37:50.589385] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:37:50.614464] [DEBUG] [LOCAL ] EFT: Loaded 12856 existing records from primary storage. [2025-10-01T18:37:50.614879] [INFO ] [MAIN ] EFT: Loaded 12856 existing records. [2025-10-01T18:37:50.888486] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:37:50.888757] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-01T18:37:50.888866] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-01T18:37:50.889264] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-01T18:37:50.889340] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-01T18:37:51.306480] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-01T18:37:51.358950] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:37:51.375042] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T18:37:51.639785] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T18:37:52.107755] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-01T18:37:52.111119] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T18:37:52.902421] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-01T18:37:53.077579] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T18:37:53.696049] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T18:37:53.702347] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-01T18:37:54.502432] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-01T18:37:55.302433] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-01T18:37:55.503903] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T18:37:55.528849] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T18:37:55.954883] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T18:37:56.102407] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-01T18:37:56.902414] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-01T18:37:57.049124] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T18:37:57.702387] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-01T18:37:57.790418] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T18:37:58.502395] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-01T18:37:58.582553] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T18:37:59.134919] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T18:37:59.302408] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-01T18:38:00.045505] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T18:38:00.102478] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-01T18:38:00.902367] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-01T18:38:01.024275] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T18:38:01.702402] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-01T18:38:01.942752] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T18:38:02.502381] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-01T18:38:03.208628] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-01T18:38:03.302378] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-01T18:38:03.594592] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T18:38:04.056163] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T18:38:04.102376] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-01T18:38:04.902414] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-01T18:38:04.922044] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T18:38:04.923241] [INFO ] [REMOTE ] EEX: Full fetch complete (19467 records). [2025-10-01T18:38:04.923318] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-01T18:38:05.320884] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-01T18:38:05.320973] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-01T18:38:05.321430] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-01T18:38:05.321473] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-01T18:38:05.322138] [DEBUG] [LOCAL ] EEX: Trimmed 19467 records to 11493 (keeping 200 days of data) [2025-10-01T18:38:05.394210] [DEBUG] [LOCAL ] EEX: Primary data saved (11493 records). [2025-10-01T18:38:05.394354] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-01T18:38:05.394438] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EEX took 35.5s. Estimated remaining: 3h 53m 4s. Rate: 7.2 symbols/min [2025-10-01T18:38:05.582032] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:38:05.636894] [DEBUG] [LOCAL ] EFX: Loaded 44541 existing records from primary storage. [2025-10-01T18:38:05.637196] [INFO ] [MAIN ] EFX: Loaded 44541 existing records. [2025-10-01T18:38:05.708154] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-01T18:38:05.846834] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:38:05.852355] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-01T18:38:05.858851] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-01T18:38:05.860115] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T18:38:05.864286] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-01T18:38:05.864575] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-01T18:38:06.261397] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:38:06.502425] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-01T18:38:07.302384] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-01T18:38:07.416962] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T18:38:07.829495] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T18:38:08.102373] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-01T18:38:08.189778] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T18:38:08.902404] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-01T18:38:09.702356] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-01T18:38:09.830978] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T18:38:09.831629] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T18:38:10.502411] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-01T18:38:10.945534] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T18:38:11.302361] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-01T18:38:11.450254] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T18:38:12.102422] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-01T18:38:12.908670] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-01T18:38:12.925881] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T18:38:13.225717] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T18:38:13.226716] [INFO ] [REMOTE ] EFR: Full fetch complete (18928 records). [2025-10-01T18:38:13.226814] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-01T18:38:13.643197] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-01T18:38:13.648504] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-01T18:38:13.655008] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-01T18:38:13.655195] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-01T18:38:13.656874] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T18:38:13.661956] [DEBUG] [LOCAL ] EFR: Trimmed 18928 records to 14641 (keeping 200 days of data) [2025-10-01T18:38:13.711162] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-01T18:38:13.771050] [DEBUG] [LOCAL ] EFR: Primary data saved (14641 records). [2025-10-01T18:38:13.771223] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-01T18:38:13.771316] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFR took 29.8s. Estimated remaining: 3h 52m 56s. Rate: 7.2 symbols/min [2025-10-01T18:38:13.955520] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:38:13.984817] [DEBUG] [LOCAL ] EFXT: Loaded 29194 existing records from primary storage. [2025-10-01T18:38:13.985123] [INFO ] [MAIN ] EFXT: Loaded 29194 existing records. [2025-10-01T18:38:14.178967] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:38:14.179218] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-01T18:38:14.179281] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-01T18:38:14.180488] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-01T18:38:14.180551] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-01T18:38:14.507465] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-01T18:38:14.587472] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:38:15.302350] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-01T18:38:15.352300] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T18:38:15.474394] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T18:38:16.102397] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-01T18:38:16.809253] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T18:38:16.902406] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-01T18:38:17.710430] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-01T18:38:17.717671] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T18:38:18.258413] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T18:38:18.502416] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-01T18:38:19.302419] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-01T18:38:19.461988] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T18:38:19.591073] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T18:38:20.102390] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-01T18:38:20.570367] [DEBUG] [REMOTE ] EFC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:38:20.570811] [WARN ] [REMOTE ] EFC: No data returned for month 2025-10 [2025-10-01T18:38:20.570919] [FATAL] [REMOTE ] EFC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:38:20.571026] [FATAL] [MAIN ] EFC: Failed to fetch primary data. [2025-10-01T18:38:20.571161] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:38:20.571286] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-01T18:38:20.571366] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-01T18:38:20.571415] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-01T18:38:20.572113] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-10-01T18:38:20.572264] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFC took 42.2s. Estimated remaining: 3h 52m 44s. Rate: 7.2 symbols/min [2025-10-01T18:38:20.801342] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:38:20.801533] [DEBUG] [LOCAL ] EG: No existing data file found in primary storage. [2025-10-01T18:38:20.801574] [WARN ] [MAIN ] EG: No existing data found, performing full refresh instead. [2025-10-01T18:38:20.801714] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-01T18:38:20.801765] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-01T18:38:20.801826] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-01T18:38:20.801900] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-01T18:38:20.909123] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-01T18:38:21.235183] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:38:21.653086] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T18:38:21.695435] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T18:38:21.702342] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-01T18:38:22.502372] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-01T18:38:22.513107] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T18:38:23.302365] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-01T18:38:23.840386] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T18:38:24.102412] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-01T18:38:24.856214] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T18:38:24.902400] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-01T18:38:25.669318] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T18:38:25.702344] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-01T18:38:25.756983] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T18:38:26.502373] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-01T18:38:27.302360] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-01T18:38:27.348315] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T18:38:27.476481] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T18:38:27.477437] [INFO ] [REMOTE ] EFT: Full fetch complete (17726 records). [2025-10-01T18:38:27.477513] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-01T18:38:27.883532] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-01T18:38:27.883620] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-01T18:38:27.884087] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-01T18:38:27.884145] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-01T18:38:27.885417] [DEBUG] [LOCAL ] EFT: Trimmed 17726 records to 12910 (keeping 200 days of data) [2025-10-01T18:38:27.970301] [DEBUG] [LOCAL ] EFT: Primary data saved (12910 records). [2025-10-01T18:38:27.970448] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-01T18:38:27.970583] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFT took 37.7s. Estimated remaining: 3h 52m 33s. Rate: 7.2 symbols/min [2025-10-01T18:38:28.107472] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-01T18:38:28.167566] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:38:28.167900] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-10-01T18:38:28.168010] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-10-01T18:38:28.168126] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-01T18:38:28.168169] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-01T18:38:28.168259] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-01T18:38:28.168301] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-01T18:38:28.555795] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:38:28.686320] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T18:38:28.902427] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-01T18:38:29.702368] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-01T18:38:29.978709] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T18:38:30.502381] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-01T18:38:30.682842] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T18:38:30.875560] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-01T18:38:31.302379] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-01T18:38:31.829454] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T18:38:32.102405] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-01T18:38:32.902372] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-01T18:38:33.057226] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T18:38:33.674731] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T18:38:33.702347] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-01T18:38:34.330285] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T18:38:34.502396] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-01T18:38:35.307523] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-01T18:38:35.336068] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T18:38:35.812286] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T18:38:36.102400] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-01T18:38:36.902379] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-01T18:38:37.472574] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T18:38:37.500340] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-01T18:38:37.501927] [INFO ] [REMOTE ] EFX: Full fetch complete (64410 records). [2025-10-01T18:38:37.502100] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-01T18:38:37.705022] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-01T18:38:37.937230] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-01T18:38:37.937327] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-01T18:38:37.938295] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-01T18:38:37.938363] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-01T18:38:37.939844] [DEBUG] [LOCAL ] EFX: Trimmed 64410 records to 44522 (keeping 200 days of data) [2025-10-01T18:38:38.253321] [DEBUG] [LOCAL ] EFX: Primary data saved (44522 records). [2025-10-01T18:38:38.253474] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-01T18:38:38.253683] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFX took 32.9s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-01T18:38:38.482452] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:38:38.486369] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T18:38:38.502344] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-01T18:38:38.531243] [DEBUG] [LOCAL ] EGP: Loaded 30925 existing records from primary storage. [2025-10-01T18:38:38.531581] [INFO ] [MAIN ] EGP: Loaded 30925 existing records. [2025-10-01T18:38:38.732943] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:38:38.733152] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-01T18:38:38.733201] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-01T18:38:38.734857] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-01T18:38:38.734922] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-01T18:38:39.178353] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:38:39.180061] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T18:38:39.302380] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-01T18:38:40.102364] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-01T18:38:40.359588] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T18:38:40.603880] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T18:38:40.902382] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-01T18:38:41.378185] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T18:38:41.702385] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-01T18:38:42.145206] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T18:38:42.502407] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-01T18:38:42.852319] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T18:38:43.302364] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-01T18:38:43.753419] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T18:38:44.102354] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-01T18:38:44.571292] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T18:38:44.902384] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-01T18:38:45.195466] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T18:38:45.702379] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-01T18:38:46.502373] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-01T18:38:46.770846] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T18:38:47.024905] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T18:38:47.302395] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-01T18:38:47.712918] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T18:38:48.102382] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-01T18:38:48.902378] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-01T18:38:49.010436] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T18:38:49.467254] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T18:38:49.702422] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-01T18:38:50.449506] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T18:38:50.502356] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-01T18:38:50.706874] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T18:38:51.302388] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-01T18:38:52.102447] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-01T18:38:52.356411] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T18:38:52.902401] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-01T18:38:52.920554] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-01T18:38:52.921844] [INFO ] [REMOTE ] EFXT: Full fetch complete (44108 records). [2025-10-01T18:38:52.921928] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-01T18:38:53.384202] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-01T18:38:53.385428] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T18:38:53.385684] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-01T18:38:53.392690] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-01T18:38:53.393124] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-01T18:38:53.394408] [DEBUG] [LOCAL ] EFXT: Trimmed 44108 records to 29191 (keeping 200 days of data) [2025-10-01T18:38:53.587786] [DEBUG] [LOCAL ] EFXT: Primary data saved (29191 records). [2025-10-01T18:38:53.587978] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-01T18:38:53.588086] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFXT took 39.8s. Estimated remaining: 3h 52m 37s. Rate: 7.2 symbols/min [2025-10-01T18:38:53.709322] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-01T18:38:53.792471] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:38:53.832373] [DEBUG] [LOCAL ] EGY: Loaded 42167 existing records from primary storage. [2025-10-01T18:38:53.832738] [INFO ] [MAIN ] EGY: Loaded 42167 existing records. [2025-10-01T18:38:54.027405] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:38:54.027616] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-01T18:38:54.027696] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-01T18:38:54.029089] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-01T18:38:54.029151] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-01T18:38:54.446819] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:38:54.477603] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T18:38:54.502350] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-01T18:38:55.207191] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T18:38:55.302389] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-01T18:38:55.902113] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T18:38:56.102374] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-01T18:38:56.480490] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T18:38:56.902421] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-01T18:38:57.702380] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-01T18:38:58.002383] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T18:38:58.043458] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T18:38:58.502427] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-01T18:38:59.254492] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T18:38:59.302338] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-01T18:38:59.455376] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T18:39:00.102424] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-01T18:39:00.902438] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-01T18:39:01.702395] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-01T18:39:01.726296] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T18:39:01.791529] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-01T18:39:01.793308] [INFO ] [REMOTE ] EGO: Full fetch complete (73671 records). [2025-10-01T18:39:01.793432] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-01T18:39:02.239501] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-01T18:39:02.239634] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-01T18:39:02.240684] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-01T18:39:02.248839] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-01T18:39:02.262875] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T18:39:02.271075] [DEBUG] [LOCAL ] EGO: Trimmed 73671 records to 51595 (keeping 200 days of data) [2025-10-01T18:39:02.502949] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-01T18:39:02.607843] [DEBUG] [LOCAL ] EGO: Primary data saved (51595 records). [2025-10-01T18:39:02.608003] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-01T18:39:02.608110] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGO took 34.6s. Estimated remaining: 3h 52m 30s. Rate: 7.2 symbols/min [2025-10-01T18:39:02.799067] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:02.799330] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-01T18:39:02.799389] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-01T18:39:02.799515] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-01T18:39:02.799561] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-01T18:39:02.799609] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-01T18:39:02.799684] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-01T18:39:03.123427] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T18:39:03.220467] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:03.302384] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-01T18:39:04.102430] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-01T18:39:04.310186] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-01T18:39:04.311373] [INFO ] [REMOTE ] EGP: Full fetch complete (45423 records). [2025-10-01T18:39:04.311458] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-01T18:39:04.798917] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T18:39:04.801510] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-01T18:39:04.801803] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-01T18:39:04.802515] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-01T18:39:04.808228] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-01T18:39:04.810385] [DEBUG] [LOCAL ] EGP: Trimmed 45423 records to 30897 (keeping 200 days of data) [2025-10-01T18:39:04.904548] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-01T18:39:05.020260] [DEBUG] [LOCAL ] EGP: Primary data saved (30897 records). [2025-10-01T18:39:05.020416] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-01T18:39:05.020508] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGP took 26.8s. Estimated remaining: 3h 52m 8s. Rate: 7.2 symbols/min [2025-10-01T18:39:05.223496] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:05.223715] [DEBUG] [LOCAL ] EHC: No existing data file found in primary storage. [2025-10-01T18:39:05.223766] [WARN ] [MAIN ] EHC: No existing data found, performing full refresh instead. [2025-10-01T18:39:05.223894] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-01T18:39:05.223939] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-01T18:39:05.223983] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-01T18:39:05.224016] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-01T18:39:05.636571] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:05.702406] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-01T18:39:05.786274] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T18:39:06.351069] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T18:39:06.502389] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-01T18:39:06.589121] [DEBUG] [REMOTE ] EG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:39:06.589615] [WARN ] [REMOTE ] EG: No data returned for month 2025-10 [2025-10-01T18:39:06.589781] [FATAL] [REMOTE ] EG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:39:06.589941] [FATAL] [MAIN ] EG: Failed to fetch primary data. [2025-10-01T18:39:06.590025] [WARN ] [MAIN ] EG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:39:06.590107] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-01T18:39:06.590186] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-01T18:39:06.590263] [INFO ] [LOCAL ] EG: Starting deletion of derivative data. [2025-10-01T18:39:06.590365] [DEBUG] [LOCAL ] EG: No derivative data file found to delete. [2025-10-01T18:39:06.590437] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EG took 46.0s. Estimated remaining: 3h 51m 44s. Rate: 7.2 symbols/min [2025-10-01T18:39:06.827058] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:06.827259] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-10-01T18:39:06.827315] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-10-01T18:39:06.827428] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-01T18:39:06.827472] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-01T18:39:06.827515] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-10-01T18:39:06.827549] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-01T18:39:07.236132] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:07.302416] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-01T18:39:07.988433] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T18:39:08.102422] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-01T18:39:08.440914] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T18:39:08.902355] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-01T18:39:09.138874] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T18:39:09.702365] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-01T18:39:09.933006] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T18:39:10.490436] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T18:39:10.502349] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-01T18:39:11.138854] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T18:39:11.302426] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-01T18:39:12.102398] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-01T18:39:12.902367] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-01T18:39:13.017810] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T18:39:13.606927] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T18:39:13.637722] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-01T18:39:13.702376] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-01T18:39:14.502400] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-01T18:39:15.048010] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T18:39:15.302430] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-01T18:39:15.814632] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T18:39:16.102398] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-01T18:39:16.778136] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T18:39:16.836507] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T18:39:16.902371] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-01T18:39:17.702394] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-01T18:39:18.446223] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T18:39:18.502355] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-01T18:39:19.302369] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-01T18:39:19.444829] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T18:39:20.103381] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-01T18:39:20.109228] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T18:39:20.374714] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T18:39:20.902424] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-01T18:39:21.535165] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T18:39:21.702404] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-01T18:39:22.510437] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-01T18:39:22.513569] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T18:39:22.802276] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T18:39:23.302379] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-01T18:39:23.820510] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T18:39:24.102376] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-01T18:39:24.632971] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T18:39:24.902393] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-01T18:39:25.345922] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T18:39:25.702409] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-01T18:39:25.723698] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T18:39:26.502390] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-01T18:39:27.163211] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T18:39:27.302391] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-01T18:39:27.374725] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T18:39:28.102401] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-01T18:39:28.902397] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-01T18:39:29.299174] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-01T18:39:29.300750] [INFO ] [REMOTE ] EGY: Full fetch complete (61482 records). [2025-10-01T18:39:29.300866] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-01T18:39:29.578711] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T18:39:29.706243] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-01T18:39:29.775010] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-01T18:39:29.775274] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-01T18:39:29.776259] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-01T18:39:29.776416] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-01T18:39:29.805944] [DEBUG] [LOCAL ] EGY: Trimmed 61482 records to 42122 (keeping 200 days of data) [2025-10-01T18:39:29.807211] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T18:39:30.071210] [DEBUG] [LOCAL ] EGY: Primary data saved (42122 records). [2025-10-01T18:39:30.071343] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-01T18:39:30.071432] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 36.5s. Estimated remaining: 3h 52m 11s. Rate: 7.1 symbols/min [2025-10-01T18:39:30.265284] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:30.290263] [DEBUG] [LOCAL ] EIC: Loaded 23631 existing records from primary storage. [2025-10-01T18:39:30.290519] [INFO ] [MAIN ] EIC: Loaded 23631 existing records. [2025-10-01T18:39:30.486974] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:39:30.487543] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-01T18:39:30.496060] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-01T18:39:30.497131] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T18:39:30.500078] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-01T18:39:30.500551] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-01T18:39:30.506218] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-01T18:39:30.914710] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:31.302395] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-01T18:39:31.530462] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T18:39:31.531828] [INFO ] [REMOTE ] EHI: Full fetch complete (16336 records). [2025-10-01T18:39:31.531911] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-01T18:39:31.983441] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-01T18:39:31.983521] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-01T18:39:31.983910] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-01T18:39:31.984012] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-01T18:39:31.985270] [DEBUG] [LOCAL ] EHI: Trimmed 16336 records to 10613 (keeping 200 days of data) [2025-10-01T18:39:32.050869] [DEBUG] [LOCAL ] EHI: Primary data saved (10613 records). [2025-10-01T18:39:32.051018] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-01T18:39:32.051120] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHI took 25.5s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-01T18:39:32.109513] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-01T18:39:32.243141] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:32.243430] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-01T18:39:32.243596] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-01T18:39:32.243887] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-01T18:39:32.243934] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-01T18:39:32.243979] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-01T18:39:32.244013] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-01T18:39:32.572249] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:39:32.674430] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:32.902388] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-01T18:39:33.373847] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-01T18:39:33.480681] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T18:39:33.702422] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-01T18:39:34.502380] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-01T18:39:34.965153] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-01T18:39:35.074336] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T18:39:35.302393] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-01T18:39:36.102382] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-01T18:39:36.444269] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-01T18:39:36.896398] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T18:39:36.905256] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-01T18:39:37.702379] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-01T18:39:38.041503] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-01T18:39:38.375127] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T18:39:38.502381] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-01T18:39:38.871782] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-01T18:39:39.302387] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-01T18:39:40.102366] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-01T18:39:40.315552] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T18:39:40.902371] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-01T18:39:41.334367] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T18:39:41.609145] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T18:39:41.702382] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-01T18:39:42.044634] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-01T18:39:42.502416] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-01T18:39:43.302379] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-01T18:39:44.102412] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-01T18:39:44.359618] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T18:39:44.361020] [INFO ] [REMOTE ] EHC: Full fetch complete (58857 records). [2025-10-01T18:39:44.361103] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-01T18:39:44.581850] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T18:39:44.650841] [INFO ] [REMOTE ] EHAB: Full fetch complete (41101 records). [2025-10-01T18:39:44.663093] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-01T18:39:44.909402] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-01T18:39:45.000728] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-01T18:39:45.052179] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-01T18:39:45.065570] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-01T18:39:45.065698] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-01T18:39:45.158831] [DEBUG] [LOCAL ] EHC: Trimmed 58857 records to 41099 (keeping 200 days of data) [2025-10-01T18:39:45.330039] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-01T18:39:45.330963] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-01T18:39:45.332086] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-01T18:39:45.332454] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-01T18:39:45.351143] [DEBUG] [LOCAL ] EHAB: Trimmed 41101 records to 29662 (keeping 200 days of data) [2025-10-01T18:39:45.352008] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T18:39:45.553441] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T18:39:45.588188] [DEBUG] [LOCAL ] EHAB: Primary data saved (29662 records). [2025-10-01T18:39:45.589849] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-01T18:39:45.590298] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHAB took 43.0s. Estimated remaining: 3h 51m 51s. Rate: 7.2 symbols/min [2025-10-01T18:39:45.732720] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-01T18:39:45.890706] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:45.892016] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-01T18:39:45.892078] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-01T18:39:45.893987] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-01T18:39:45.894365] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-01T18:39:45.894943] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-01T18:39:45.896079] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-01T18:39:46.327773] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:46.342173] [DEBUG] [LOCAL ] EHC: Primary data saved (41099 records). [2025-10-01T18:39:46.342310] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-01T18:39:46.342382] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 41.3s. Estimated remaining: 3h 51m 25s. Rate: 7.2 symbols/min [2025-10-01T18:39:46.503376] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-01T18:39:46.530357] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:46.531445] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-01T18:39:46.531502] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-01T18:39:46.531688] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-01T18:39:46.531743] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-01T18:39:46.531788] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-01T18:39:46.531821] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-01T18:39:46.946858] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:46.960072] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T18:39:47.075188] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T18:39:47.302402] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-01T18:39:48.102349] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-01T18:39:48.125683] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T18:39:48.671734] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-01T18:39:48.902413] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-01T18:39:49.702398] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-01T18:39:49.954863] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-01T18:39:50.057214] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T18:39:50.502428] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-01T18:39:51.280630] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-01T18:39:51.302423] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-01T18:39:51.894524] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T18:39:52.102443] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-01T18:39:52.550143] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T18:39:52.902388] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-01T18:39:53.353507] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-01T18:39:53.702386] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-01T18:39:54.030379] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-01T18:39:54.502436] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-01T18:39:54.836410] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-01T18:39:55.302405] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-01T18:39:55.806424] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-01T18:39:56.102431] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-01T18:39:56.807978] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T18:39:56.808640] [INFO ] [REMOTE ] EICA: Full fetch complete (1281 records). [2025-10-01T18:39:56.808735] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-01T18:39:56.907608] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-01T18:39:57.009982] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-01T18:39:57.010152] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:39:57.010223] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:39:57.010298] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-01T18:39:57.010363] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-01T18:39:57.010453] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-01T18:39:57.010518] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-01T18:39:57.010578] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICA took 25.0s. Estimated remaining: 3h 51m 22s. Rate: 7.2 symbols/min [2025-10-01T18:39:57.201913] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:39:57.223664] [DEBUG] [LOCAL ] EIG: Loaded 20286 existing records from primary storage. [2025-10-01T18:39:57.223933] [INFO ] [MAIN ] EIG: Loaded 20286 existing records. [2025-10-01T18:39:57.428789] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-01T18:39:57.435307] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:39:57.435591] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-01T18:39:57.436921] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-01T18:39:57.438094] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-01T18:39:57.438156] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-01T18:39:57.707544] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-01T18:39:57.836635] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:39:58.502411] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-01T18:39:58.979922] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T18:39:59.302379] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-01T18:39:59.488176] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-01T18:39:59.746570] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-01T18:40:00.102420] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-01T18:40:00.677858] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T18:40:00.902398] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-01T18:40:01.702378] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-01T18:40:01.785225] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T18:40:02.502388] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-01T18:40:02.662700] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T18:40:02.990315] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T18:40:03.302405] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-01T18:40:03.684217] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-01T18:40:04.102384] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-01T18:40:04.524675] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-01T18:40:04.902427] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-01T18:40:05.595931] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T18:40:05.702388] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-01T18:40:06.434468] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T18:40:06.502415] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-01T18:40:07.302352] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-01T18:40:07.531409] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T18:40:08.002628] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T18:40:08.102375] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-01T18:40:08.714119] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T18:40:08.902423] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-01T18:40:09.482671] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T18:40:09.483353] [INFO ] [REMOTE ] EICB: Full fetch complete (2720 records). [2025-10-01T18:40:09.483422] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-01T18:40:09.677148] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T18:40:09.677368] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:40:09.677438] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:40:09.677513] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-01T18:40:09.677666] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-01T18:40:09.677731] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-01T18:40:09.677778] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-01T18:40:09.677866] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICB took 24.1s. Estimated remaining: 3h 51m 23s. Rate: 7.2 symbols/min [2025-10-01T18:40:09.707843] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-01T18:40:09.864093] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:40:09.864321] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-10-01T18:40:09.864379] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-10-01T18:40:09.864492] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-01T18:40:09.864537] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-01T18:40:09.864580] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-01T18:40:09.864614] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-01T18:40:10.257425] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:40:10.502374] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-01T18:40:10.892396] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T18:40:11.018688] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-01T18:40:11.302447] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-01T18:40:12.102377] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-01T18:40:12.321273] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T18:40:12.902394] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-01T18:40:13.702401] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-01T18:40:13.955431] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T18:40:14.502424] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-01T18:40:14.683503] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T18:40:14.885366] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-01T18:40:15.288714] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T18:40:15.302354] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-01T18:40:16.102377] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-01T18:40:16.385684] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T18:40:16.664940] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-01T18:40:16.902386] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-01T18:40:17.702362] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-01T18:40:17.863952] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T18:40:18.502378] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-01T18:40:19.302385] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-01T18:40:19.711414] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-01T18:40:20.010237] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T18:40:20.102381] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-01T18:40:20.902419] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-01T18:40:21.325973] [DEBUG] [REMOTE ] EIC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:40:21.326336] [WARN ] [REMOTE ] EIC: No data returned for month 2025-10 [2025-10-01T18:40:21.326455] [FATAL] [REMOTE ] EIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:40:21.326571] [FATAL] [MAIN ] EIC: Failed to fetch primary data. [2025-10-01T18:40:21.326682] [WARN ] [MAIN ] EIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:40:21.326764] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-01T18:40:21.326832] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-01T18:40:21.326870] [INFO ] [LOCAL ] EIC: Starting deletion of derivative data. [2025-10-01T18:40:21.327356] [DEBUG] [LOCAL ] EIC: Deleted derivative data file. [2025-10-01T18:40:21.327461] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIC took 51.3s. Estimated remaining: 3h 51m 22s. Rate: 7.1 symbols/min [2025-10-01T18:40:21.633517] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:40:21.702354] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-01T18:40:22.097801] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T18:40:22.502426] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-01T18:40:22.906140] [DEBUG] [REMOTE ] EICC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:40:22.906513] [WARN ] [REMOTE ] EICC: No data returned for month 2025-10 [2025-10-01T18:40:22.906606] [FATAL] [REMOTE ] EICC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:40:22.906724] [FATAL] [MAIN ] EICC: Failed to fetch primary data. [2025-10-01T18:40:22.906794] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:40:22.906867] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-01T18:40:22.906937] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-01T18:40:22.907003] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-01T18:40:22.907089] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-01T18:40:22.907160] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 36.6s. Estimated remaining: 3h 50m 58s. Rate: 7.2 symbols/min [2025-10-01T18:40:23.302370] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-01T18:40:23.672460] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T18:40:24.102430] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-01T18:40:24.316204] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T18:40:24.902378] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-01T18:40:25.911856] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T18:40:25.923788] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-01T18:40:26.132595] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-01T18:40:26.133582] [INFO ] [REMOTE ] EIG: Full fetch complete (27052 records). [2025-10-01T18:40:26.133683] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-01T18:40:26.554207] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-01T18:40:26.554308] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-01T18:40:26.554911] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-01T18:40:26.554980] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-01T18:40:26.555950] [DEBUG] [LOCAL ] EIG: Trimmed 27052 records to 20325 (keeping 200 days of data) [2025-10-01T18:40:26.693021] [DEBUG] [LOCAL ] EIG: Primary data saved (20325 records). [2025-10-01T18:40:26.693153] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-01T18:40:26.693233] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 29.7s. Estimated remaining: 3h 50m 39s. Rate: 7.2 symbols/min [2025-10-01T18:40:27.793473] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T18:40:27.805663] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-01T18:40:29.523294] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T18:40:29.534886] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-01T18:40:31.391051] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T18:40:31.403724] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-01T18:40:33.039547] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T18:40:33.052009] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-01T18:40:34.987191] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T18:40:34.999443] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-01T18:40:37.409426] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-01T18:40:37.411875] [INFO ] [REMOTE ] EIX: Full fetch complete (77005 records). [2025-10-01T18:40:37.412020] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-01T18:40:37.873015] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-01T18:40:37.873114] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-01T18:40:37.874133] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-01T18:40:37.874204] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-01T18:40:37.875920] [DEBUG] [LOCAL ] EIX: Trimmed 77005 records to 53338 (keeping 200 days of data) [2025-10-01T18:40:38.210866] [DEBUG] [LOCAL ] EIX: Primary data saved (53338 records). [2025-10-01T18:40:38.211026] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-01T18:40:38.211103] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 28.5s. Estimated remaining: 3h 50m 38s. Rate: 7.2 symbols/min [2025-10-01T18:40:38.981579] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:40:38.928847] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:40:39.023166] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:40:39.044752] [DEBUG] [LOCAL ] EL: No existing data file found in primary storage. [2025-10-01T18:40:39.080375] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:40:39.081204] [WARN ] [MAIN ] EL: No existing data found, performing full refresh instead. [2025-10-01T18:40:39.082324] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-01T18:40:39.082535] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-01T18:40:39.082615] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-01T18:40:39.082692] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-01T18:40:39.151471] [DEBUG] [LOCAL ] ELC: Loaded 3479 existing records from primary storage. [2025-10-01T18:40:39.167361] [INFO ] [MAIN ] ELC: Loaded 3479 existing records. [2025-10-01T18:40:39.602400] [DEBUG] [LOCAL ] ELAN: Loaded 53230 existing records from primary storage. [2025-10-01T18:40:39.611393] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:40:39.617088] [INFO ] [MAIN ] ELAN: Loaded 53230 existing records. [2025-10-01T18:40:39.640366] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-01T18:40:39.696233] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-01T18:40:39.774950] [DEBUG] [LOCAL ] ELF: Loaded 52207 existing records from primary storage. [2025-10-01T18:40:39.809207] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-01T18:40:39.809115] [INFO ] [MAIN ] ELF: Loaded 52207 existing records. [2025-10-01T18:40:39.830962] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-01T18:40:40.211636] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:40:40.229890] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:40:40.265242] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-01T18:40:40.321418] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-01T18:40:40.359016] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-01T18:40:40.405616] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:40:40.412313] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-01T18:40:40.412400] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-01T18:40:40.412546] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-01T18:40:40.460249] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-01T18:40:40.547318] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-01T18:40:40.629319] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-01T18:40:41.016837] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:40:41.120234] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-01T18:40:41.370781] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:40:41.383268] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-01T18:40:41.468328] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:40:41.468683] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-01T18:40:41.969507] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T18:40:41.971076] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-01T18:40:42.236082] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T18:40:42.247321] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-01T18:40:42.558565] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T18:40:42.560111] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-01T18:40:43.265756] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-01T18:40:43.268203] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T18:40:43.270831] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-01T18:40:43.289763] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-01T18:40:43.327726] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T18:40:43.344713] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-01T18:40:43.660466] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-01T18:40:43.666477] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-01T18:40:44.122620] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T18:40:44.134930] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-01T18:40:44.328442] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-01T18:40:44.330943] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-01T18:40:44.706148] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T18:40:44.717082] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-01T18:40:44.782927] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T18:40:44.784483] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-01T18:40:44.971072] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T18:40:44.984122] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-01T18:40:45.183439] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-01T18:40:45.185035] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-01T18:40:45.671934] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T18:40:45.673701] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-01T18:40:45.909200] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T18:40:45.920408] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-01T18:40:46.321419] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T18:40:46.323160] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-01T18:40:46.364472] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T18:40:46.502407] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-01T18:40:46.934107] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T18:40:46.985813] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-01T18:40:47.302392] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-01T18:40:47.608363] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T18:40:47.715192] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T18:40:47.891155] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-01T18:40:47.891994] [INFO ] [REMOTE ] ELC: Full fetch complete (5101 records). [2025-10-01T18:40:47.892109] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-01T18:40:48.108002] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-01T18:40:48.330686] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-01T18:40:48.330792] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-01T18:40:48.331048] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-01T18:40:48.331112] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-01T18:40:48.331536] [DEBUG] [LOCAL ] ELC: Trimmed 5101 records to 3482 (keeping 200 days of data) [2025-10-01T18:40:48.354579] [DEBUG] [LOCAL ] ELC: Primary data saved (3482 records). [2025-10-01T18:40:48.354752] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-01T18:40:48.354850] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 10.1s. Estimated remaining: 3h 50m 34s. Rate: 7.2 symbols/min [2025-10-01T18:40:48.545776] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:40:48.601973] [DEBUG] [LOCAL ] ELME: Loaded 39204 existing records from primary storage. [2025-10-01T18:40:48.602288] [INFO ] [MAIN ] ELME: Loaded 39204 existing records. [2025-10-01T18:40:48.811450] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:40:48.811708] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-01T18:40:48.811790] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-01T18:40:48.812035] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-01T18:40:48.812108] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-01T18:40:48.911469] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-01T18:40:49.218552] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:40:49.702395] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-01T18:40:50.364525] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-01T18:40:50.502414] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-01T18:40:51.051748] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-01T18:40:51.156196] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T18:40:51.302420] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-01T18:40:52.004196] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T18:40:52.102433] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-01T18:40:52.902380] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-01T18:40:53.604802] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-01T18:40:53.651134] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T18:40:53.702380] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-01T18:40:54.502437] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-01T18:40:55.209455] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-01T18:40:55.253617] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T18:40:55.302431] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-01T18:40:55.948994] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T18:40:56.102434] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-01T18:40:56.902386] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-01T18:40:57.471885] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-01T18:40:57.566203] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T18:40:57.702396] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-01T18:40:58.349809] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T18:40:58.502416] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-01T18:40:59.302381] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-01T18:40:59.886228] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T18:40:59.933568] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-01T18:41:00.102391] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-01T18:41:00.902371] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-01T18:41:01.096684] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T18:41:01.519596] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T18:41:01.702435] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-01T18:41:02.502364] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-01T18:41:02.869856] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-01T18:41:03.302439] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-01T18:41:03.785870] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-01T18:41:03.912393] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T18:41:04.102421] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-01T18:41:04.891556] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T18:41:04.902327] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-01T18:41:05.702456] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-01T18:41:06.167274] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T18:41:06.378087] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T18:41:06.502371] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-01T18:41:07.302410] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-01T18:41:07.855001] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T18:41:08.035742] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T18:41:08.037551] [INFO ] [REMOTE ] ELAN: Full fetch complete (76867 records). [2025-10-01T18:41:08.037770] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-01T18:41:08.109725] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-01T18:41:08.477806] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-01T18:41:08.477958] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-01T18:41:08.479037] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-01T18:41:08.479106] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-01T18:41:08.481412] [DEBUG] [LOCAL ] ELAN: Trimmed 76867 records to 53254 (keeping 200 days of data) [2025-10-01T18:41:08.848552] [DEBUG] [LOCAL ] ELAN: Primary data saved (53254 records). [2025-10-01T18:41:08.848863] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-01T18:41:08.849090] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELAN took 30.6s. Estimated remaining: 3h 50m 53s. Rate: 7.1 symbols/min [2025-10-01T18:41:08.910121] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-01T18:41:09.048921] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:09.083166] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T18:41:09.115383] [DEBUG] [LOCAL ] ELP: Loaded 25714 existing records from primary storage. [2025-10-01T18:41:09.115691] [INFO ] [MAIN ] ELP: Loaded 25714 existing records. [2025-10-01T18:41:09.312423] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:41:09.312807] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-01T18:41:09.312865] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-01T18:41:09.313136] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-01T18:41:09.313197] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-01T18:41:09.703375] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-01T18:41:09.728800] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:09.755047] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T18:41:10.502384] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-01T18:41:11.068708] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-01T18:41:11.302475] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-01T18:41:12.072096] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T18:41:12.102347] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-01T18:41:12.401005] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-01T18:41:12.402617] [INFO ] [REMOTE ] EL: Full fetch complete (77316 records). [2025-10-01T18:41:12.402760] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-01T18:41:12.833041] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-01T18:41:12.833130] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-01T18:41:12.834081] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-01T18:41:12.834149] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-01T18:41:12.835745] [DEBUG] [LOCAL ] EL: Trimmed 77316 records to 53392 (keeping 200 days of data) [2025-10-01T18:41:12.906718] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-01T18:41:13.193611] [DEBUG] [LOCAL ] EL: Primary data saved (53392 records). [2025-10-01T18:41:13.193788] [INFO ] [MAIN ] EL: Full history saved. [2025-10-01T18:41:13.193871] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. EL took 35.0s. Estimated remaining: 3h 50m 35s. Rate: 7.1 symbols/min [2025-10-01T18:41:13.386695] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:13.387018] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-01T18:41:13.387168] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-01T18:41:13.387320] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-01T18:41:13.387402] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-01T18:41:13.387507] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-01T18:41:13.387560] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-01T18:41:13.661526] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-01T18:41:13.754066] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-01T18:41:13.948746] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:13.953940] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-01T18:41:14.025771] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T18:41:14.502398] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-01T18:41:15.302402] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-01T18:41:16.102436] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-01T18:41:16.446107] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T18:41:16.447777] [INFO ] [REMOTE ] ELME: Full fetch complete (56010 records). [2025-10-01T18:41:16.447937] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-01T18:41:16.512661] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T18:41:16.589745] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-01T18:41:16.817573] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-01T18:41:16.839971] [INFO ] [REMOTE ] ELF: Full fetch complete (75338 records). [2025-10-01T18:41:16.850434] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-01T18:41:16.909222] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-01T18:41:16.996568] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-01T18:41:17.021025] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-01T18:41:17.042171] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-01T18:41:17.042327] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-01T18:41:17.092543] [DEBUG] [LOCAL ] ELME: Trimmed 56010 records to 39181 (keeping 200 days of data) [2025-10-01T18:41:17.482243] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-01T18:41:17.482971] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-01T18:41:17.485341] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-01T18:41:17.485761] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-01T18:41:17.495395] [DEBUG] [LOCAL ] ELF: Trimmed 75338 records to 52195 (keeping 200 days of data) [2025-10-01T18:41:17.571069] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-01T18:41:17.711489] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-01T18:41:17.871386] [DEBUG] [LOCAL ] ELME: Primary data saved (39181 records). [2025-10-01T18:41:17.872127] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-01T18:41:17.872881] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELME took 29.5s. Estimated remaining: 3h 50m 19s. Rate: 7.2 symbols/min [2025-10-01T18:41:18.078783] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:18.079212] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-01T18:41:18.079260] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-01T18:41:18.080903] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-01T18:41:18.081750] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-01T18:41:18.082236] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-01T18:41:18.082537] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-01T18:41:18.548537] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-01T18:41:18.556293] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:18.579175] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T18:41:18.602505] [DEBUG] [LOCAL ] ELF: Primary data saved (52195 records). [2025-10-01T18:41:18.602627] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-01T18:41:18.602752] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 40.4s. Estimated remaining: 3h 49m 53s. Rate: 7.2 symbols/min [2025-10-01T18:41:18.793926] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:18.794139] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-01T18:41:18.794196] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-01T18:41:18.794312] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-01T18:41:18.794407] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-01T18:41:18.794473] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-01T18:41:18.794509] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-01T18:41:18.940775] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-01T18:41:19.218865] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:19.302364] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-01T18:41:19.668754] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T18:41:20.102416] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-01T18:41:20.902379] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-01T18:41:21.217559] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-01T18:41:21.243096] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T18:41:21.702415] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-01T18:41:22.016078] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-01T18:41:22.502406] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-01T18:41:23.302416] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-01T18:41:24.102400] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-01T18:41:24.173535] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T18:41:24.292004] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T18:41:24.457913] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-01T18:41:24.902408] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-01T18:41:25.702386] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-01T18:41:26.502407] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-01T18:41:26.583244] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T18:41:26.965304] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T18:41:27.207547] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T18:41:27.302376] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-01T18:41:27.674249] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-01T18:41:28.102387] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-01T18:41:28.902384] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-01T18:41:29.473235] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T18:41:29.702376] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-01T18:41:30.502352] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-01T18:41:30.701182] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T18:41:30.743766] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-01T18:41:31.256520] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T18:41:31.302387] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-01T18:41:32.102389] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-01T18:41:32.902371] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-01T18:41:32.967990] [DEBUG] [REMOTE ] ELPC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:41:32.968334] [WARN ] [REMOTE ] ELPC: No data returned for month 2025-10 [2025-10-01T18:41:32.968481] [FATAL] [REMOTE ] ELPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:41:32.968606] [FATAL] [MAIN ] ELPC: Failed to fetch primary data. [2025-10-01T18:41:32.968716] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:41:32.968811] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-01T18:41:32.968895] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-01T18:41:32.968947] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-01T18:41:32.969023] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-01T18:41:32.969116] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELPC took 19.8s. Estimated remaining: 3h 49m 58s. Rate: 7.2 symbols/min [2025-10-01T18:41:33.172272] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:33.172612] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-01T18:41:33.172713] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-01T18:41:33.200826] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-01T18:41:33.200999] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-01T18:41:33.201587] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-01T18:41:33.202691] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T18:41:33.202776] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-01T18:41:33.626263] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:33.702341] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-01T18:41:33.799999] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-01T18:41:33.908138] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:41:33.908460] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-01T18:41:33.908551] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:41:33.908675] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-01T18:41:33.908745] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:41:33.908818] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-01T18:41:33.908882] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-01T18:41:33.908918] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-01T18:41:33.908958] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-01T18:41:33.909004] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. EMA took 0.9s. Estimated remaining: 3h 49m 33s. Rate: 7.2 symbols/min [2025-10-01T18:41:34.113772] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:34.113950] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-01T18:41:34.113993] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-01T18:41:34.114066] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-01T18:41:34.114103] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-01T18:41:34.114144] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-01T18:41:34.114176] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-01T18:41:34.514589] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-01T18:41:34.521776] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:35.302393] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-01T18:41:36.102436] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-01T18:41:36.342854] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T18:41:36.759425] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T18:41:36.902427] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-01T18:41:37.086606] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T18:41:37.702410] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-01T18:41:38.514299] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-01T18:41:38.521508] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T18:41:38.944890] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T18:41:39.302391] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-01T18:41:39.656939] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T18:41:40.102380] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-01T18:41:40.396015] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T18:41:40.902426] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-01T18:41:41.619078] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T18:41:41.702374] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-01T18:41:42.035573] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T18:41:42.502357] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-01T18:41:42.917911] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T18:41:43.302406] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-01T18:41:44.102413] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-01T18:41:44.198022] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T18:41:44.211205] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T18:41:44.902384] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-01T18:41:44.920319] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T18:41:45.702423] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-01T18:41:46.469796] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T18:41:46.502432] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-01T18:41:46.954822] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T18:41:46.956210] [INFO ] [REMOTE ] ELP: Full fetch complete (37259 records). [2025-10-01T18:41:46.956296] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-01T18:41:47.315734] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-01T18:41:47.371560] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-01T18:41:47.371686] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-01T18:41:47.372449] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-01T18:41:47.372534] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-01T18:41:47.373601] [DEBUG] [LOCAL ] ELP: Trimmed 37259 records to 25670 (keeping 200 days of data) [2025-10-01T18:41:47.541745] [DEBUG] [LOCAL ] ELP: Primary data saved (25670 records). [2025-10-01T18:41:47.541905] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-01T18:41:47.542001] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELP took 38.7s. Estimated remaining: 3h 49m 36s. Rate: 7.2 symbols/min [2025-10-01T18:41:47.746975] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:47.762222] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-10-01T18:41:47.763835] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T18:41:47.762965] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-10-01T18:41:47.769867] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-01T18:41:47.770336] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-01T18:41:47.770404] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-01T18:41:47.770444] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-01T18:41:48.107537] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-01T18:41:48.179496] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:48.902393] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-01T18:41:49.269184] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T18:41:49.702405] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-01T18:41:49.917402] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T18:41:50.334487] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T18:41:50.502434] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-01T18:41:51.302423] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-01T18:41:51.934518] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T18:41:51.936328] [INFO ] [REMOTE ] ELS: Full fetch complete (70782 records). [2025-10-01T18:41:51.936487] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-01T18:41:52.104577] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-01T18:41:52.149129] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T18:41:52.379032] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T18:41:52.458154] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-01T18:41:52.458248] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-01T18:41:52.459251] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-01T18:41:52.459331] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-01T18:41:52.462169] [DEBUG] [LOCAL ] ELS: Trimmed 70782 records to 49457 (keeping 200 days of data) [2025-10-01T18:41:52.793599] [DEBUG] [LOCAL ] ELS: Primary data saved (49457 records). [2025-10-01T18:41:52.793823] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-01T18:41:52.793938] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 34.9s. Estimated remaining: 3h 49m 21s. Rate: 7.2 symbols/min [2025-10-01T18:41:52.905457] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-01T18:41:52.978101] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:41:52.984879] [DEBUG] [LOCAL ] EMF: Loaded 3427 existing records from primary storage. [2025-10-01T18:41:52.985112] [INFO ] [MAIN ] EMF: Loaded 3427 existing records. [2025-10-01T18:41:53.183461] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:41:53.183729] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-01T18:41:53.183827] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-01T18:41:53.184195] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-01T18:41:53.184271] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-01T18:41:53.582322] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:41:53.702356] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-01T18:41:53.732919] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T18:41:54.035684] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T18:41:54.502421] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-01T18:41:55.053987] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T18:41:55.302381] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-01T18:41:55.779351] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T18:41:56.102418] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-01T18:41:56.489631] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T18:41:56.906051] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-01T18:41:56.909182] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T18:41:57.702425] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-01T18:41:58.341347] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T18:41:58.373952] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T18:41:58.502407] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-01T18:41:58.996709] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-01T18:41:59.302391] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-01T18:41:59.798670] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T18:42:00.102388] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-01T18:42:00.902387] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-01T18:42:01.371882] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T18:42:01.702418] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-01T18:42:02.502418] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-01T18:42:03.290251] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T18:42:03.302334] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-01T18:42:03.536172] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-01T18:42:03.562810] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T18:42:04.102429] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-01T18:42:04.363888] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T18:42:04.902352] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-01T18:42:05.013406] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T18:42:05.244838] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-01T18:42:05.702430] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-01T18:42:06.189046] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T18:42:06.502390] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-01T18:42:07.127432] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T18:42:07.302372] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-01T18:42:08.102402] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-01T18:42:08.712939] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T18:42:08.902385] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-01T18:42:09.484787] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T18:42:09.638783] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T18:42:09.702368] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-01T18:42:10.502390] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-01T18:42:11.203228] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T18:42:11.302391] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-01T18:42:11.834830] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T18:42:12.102409] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-01T18:42:12.753540] [DEBUG] [REMOTE ] EMD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:42:12.753961] [WARN ] [REMOTE ] EMD: No data returned for month 2025-10 [2025-10-01T18:42:12.754056] [FATAL] [REMOTE ] EMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:42:12.754147] [FATAL] [MAIN ] EMD: Failed to fetch primary data. [2025-10-01T18:42:12.754190] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:42:12.754266] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-01T18:42:12.754333] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-01T18:42:12.754372] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-01T18:42:12.754430] [DEBUG] [LOCAL ] EMD: No derivative data file found to delete. [2025-10-01T18:42:12.754504] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. EMD took 38.8s. Estimated remaining: 3h 49m 38s. Rate: 7.1 symbols/min [2025-10-01T18:42:12.915176] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-01T18:42:12.951351] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:42:13.010964] [DEBUG] [LOCAL ] EMN: Loaded 50415 existing records from primary storage. [2025-10-01T18:42:13.011369] [INFO ] [MAIN ] EMN: Loaded 50415 existing records. [2025-10-01T18:42:13.209939] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:42:13.210171] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-01T18:42:13.210221] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-01T18:42:13.210789] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-01T18:42:13.210852] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-01T18:42:13.505738] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T18:42:13.604285] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:42:13.702378] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-01T18:42:13.822388] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-01T18:42:13.824051] [INFO ] [REMOTE ] ELV: Full fetch complete (73170 records). [2025-10-01T18:42:13.824162] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-01T18:42:14.258570] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-01T18:42:14.258683] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-01T18:42:14.259552] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-01T18:42:14.259597] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-01T18:42:14.261070] [DEBUG] [LOCAL ] ELV: Trimmed 73170 records to 50546 (keeping 200 days of data) [2025-10-01T18:42:14.502623] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-01T18:42:14.600836] [DEBUG] [LOCAL ] ELV: Primary data saved (50546 records). [2025-10-01T18:42:14.601054] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-01T18:42:14.601145] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. ELV took 56.0s. Estimated remaining: 3h 49m 15s. Rate: 7.2 symbols/min [2025-10-01T18:42:14.786376] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:42:14.786575] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-10-01T18:42:14.786622] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-10-01T18:42:14.786796] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-01T18:42:14.786848] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-01T18:42:14.786896] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-01T18:42:14.786934] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-01T18:42:15.163503] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-01T18:42:15.191245] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:42:15.302368] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-01T18:42:15.570295] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T18:42:16.102388] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-01T18:42:16.541066] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T18:42:16.902382] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-01T18:42:17.011359] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T18:42:17.702389] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-01T18:42:18.482614] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-01T18:42:18.483400] [INFO ] [REMOTE ] EMF: Full fetch complete (7115 records). [2025-10-01T18:42:18.483474] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-01T18:42:18.507619] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-01T18:42:18.922304] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T18:42:18.928937] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-01T18:42:18.938466] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-01T18:42:18.938939] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-01T18:42:18.939388] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-01T18:42:18.940422] [DEBUG] [LOCAL ] EMF: Trimmed 7115 records to 3414 (keeping 200 days of data) [2025-10-01T18:42:18.966040] [DEBUG] [LOCAL ] EMF: Primary data saved (3414 records). [2025-10-01T18:42:18.966176] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-01T18:42:18.966277] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMF took 26.2s. Estimated remaining: 3h 48m 58s. Rate: 7.2 symbols/min [2025-10-01T18:42:19.168383] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:42:19.168584] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-01T18:42:19.168632] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-01T18:42:19.168781] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-01T18:42:19.168827] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-01T18:42:19.168873] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-01T18:42:19.168966] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-01T18:42:19.307461] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-01T18:42:19.566208] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:42:19.635186] [DEBUG] [REMOTE ] EME: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:42:19.635504] [WARN ] [REMOTE ] EME: No data returned for month 2025-10 [2025-10-01T18:42:19.635597] [FATAL] [REMOTE ] EME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:42:19.635701] [FATAL] [MAIN ] EME: Failed to fetch primary data. [2025-10-01T18:42:19.635765] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:42:19.635834] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-01T18:42:19.635911] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-01T18:42:19.635965] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-10-01T18:42:19.636011] [DEBUG] [LOCAL ] EME: No derivative data file found to delete. [2025-10-01T18:42:19.636058] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EME took 32.1s. Estimated remaining: 3h 48m 32s. Rate: 7.2 symbols/min [2025-10-01T18:42:19.844235] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:42:19.844428] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-10-01T18:42:19.844467] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-10-01T18:42:19.844580] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-01T18:42:19.844621] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-01T18:42:19.844701] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-01T18:42:19.844748] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-01T18:42:20.111243] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-01T18:42:20.266707] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:42:20.262170] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T18:42:20.902385] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-01T18:42:21.702635] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-01T18:42:22.030158] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T18:42:22.369070] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T18:42:22.502409] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-01T18:42:22.829478] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-01T18:42:23.302400] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-01T18:42:24.093487] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T18:42:24.103591] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-01T18:42:24.143745] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T18:42:24.578841] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T18:42:24.902402] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-01T18:42:25.702382] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-01T18:42:26.502406] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-01T18:42:26.627606] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T18:42:27.302360] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-01T18:42:27.390166] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T18:42:27.618702] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T18:42:28.102385] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-01T18:42:28.863857] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T18:42:28.902358] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-01T18:42:28.991897] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T18:42:29.702402] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-01T18:42:30.170222] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T18:42:30.502373] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-01T18:42:30.968781] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T18:42:31.302386] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-01T18:42:31.408494] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T18:42:31.781471] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T18:42:32.102434] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-01T18:42:32.880341] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T18:42:32.902402] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-01T18:42:33.702390] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-01T18:42:33.729817] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T18:42:34.292695] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T18:42:34.502423] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-01T18:42:35.049708] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T18:42:35.302447] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-01T18:42:36.102426] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-01T18:42:36.902408] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-01T18:42:37.195262] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T18:42:37.206627] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T18:42:37.274431] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-01T18:42:37.702401] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-01T18:42:38.502437] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-01T18:42:38.837343] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T18:42:39.302397] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-01T18:42:39.883136] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T18:42:40.102384] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-01T18:42:40.379811] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T18:42:40.902388] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-01T18:42:41.212383] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T18:42:41.437472] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T18:42:41.702393] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-01T18:42:42.502401] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-01T18:42:43.302403] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-01T18:42:43.469300] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T18:42:44.102399] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-01T18:42:44.286344] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T18:42:44.490469] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T18:42:44.491374] [INFO ] [REMOTE ] EMO: Full fetch complete (17154 records). [2025-10-01T18:42:44.491456] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-01T18:42:44.631904] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T18:42:44.907592] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-01T18:42:44.917700] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-01T18:42:44.918581] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-01T18:42:44.919007] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-01T18:42:44.919070] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-01T18:42:44.919932] [DEBUG] [LOCAL ] EMO: Trimmed 17154 records to 12527 (keeping 200 days of data) [2025-10-01T18:42:45.001813] [DEBUG] [LOCAL ] EMO: Primary data saved (12527 records). [2025-10-01T18:42:45.001966] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-01T18:42:45.002059] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMO took 30.4s. Estimated remaining: 3h 49m 2s. Rate: 7.1 symbols/min [2025-10-01T18:42:45.213403] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:42:45.271882] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-01T18:42:45.272284] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-01T18:42:45.482014] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:42:45.482293] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-01T18:42:45.482353] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-01T18:42:45.482850] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-01T18:42:45.482914] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-01T18:42:45.709571] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-01T18:42:45.897464] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:42:46.502374] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-01T18:42:46.557284] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T18:42:47.304412] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-01T18:42:47.310557] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T18:42:47.923664] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-01T18:42:47.924370] [INFO ] [REMOTE ] EMP: Full fetch complete (4308 records). [2025-10-01T18:42:47.924438] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-01T18:42:48.106728] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-01T18:42:48.340394] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-01T18:42:48.340668] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-01T18:42:48.340850] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-01T18:42:48.341018] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-01T18:42:48.341700] [DEBUG] [LOCAL ] EMP: Trimmed 4308 records to 3063 (keeping 200 days of data) [2025-10-01T18:42:48.382716] [DEBUG] [LOCAL ] EMP: Primary data saved (3063 records). [2025-10-01T18:42:48.391261] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-01T18:42:48.391485] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMP took 29.4s. Estimated remaining: 3h 48m 42s. Rate: 7.2 symbols/min [2025-10-01T18:42:48.393702] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T18:42:48.593932] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:42:48.600289] [DEBUG] [LOCAL ] ENFY: Loaded 3099 existing records from primary storage. [2025-10-01T18:42:48.600515] [INFO ] [MAIN ] ENFY: Loaded 3099 existing records. [2025-10-01T18:42:48.792888] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:42:48.793128] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-01T18:42:48.793179] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-01T18:42:48.793455] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-01T18:42:48.793517] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-01T18:42:48.907481] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-01T18:42:49.248480] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:42:49.702428] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-01T18:42:50.361767] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-01T18:42:50.369671] [INFO ] [REMOTE ] EMN: Full fetch complete (72081 records). [2025-10-01T18:42:50.369869] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-01T18:42:50.494363] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T18:42:50.502767] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-01T18:42:50.833532] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-01T18:42:50.833772] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-01T18:42:50.834870] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-01T18:42:50.834956] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-01T18:42:50.837670] [DEBUG] [LOCAL ] EMN: Trimmed 72081 records to 50458 (keeping 200 days of data) [2025-10-01T18:42:50.969559] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T18:42:51.226400] [DEBUG] [LOCAL ] EMN: Primary data saved (50458 records). [2025-10-01T18:42:51.226549] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-01T18:42:51.226682] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMN took 38.5s. Estimated remaining: 3h 48m 22s. Rate: 7.2 symbols/min [2025-10-01T18:42:51.307599] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-01T18:42:51.433877] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:42:51.434051] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-01T18:42:51.434090] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-01T18:42:51.434235] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-01T18:42:51.434292] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-01T18:42:51.434361] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-01T18:42:51.434399] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-01T18:42:51.910732] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:42:52.102392] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-01T18:42:52.115789] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T18:42:52.430157] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T18:42:52.902425] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-01T18:42:53.702431] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-01T18:42:54.171039] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T18:42:54.237915] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-01T18:42:54.509525] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-01T18:42:54.533377] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T18:42:55.302404] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-01T18:42:56.103686] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-01T18:42:56.109390] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T18:42:56.839546] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T18:42:56.902400] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-01T18:42:57.324740] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-01T18:42:57.529045] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T18:42:57.702399] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-01T18:42:57.995676] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-01T18:42:58.502404] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-01T18:42:59.302379] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-01T18:43:00.102427] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-01T18:43:00.378365] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T18:43:00.578603] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-01T18:43:00.814635] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T18:43:00.902402] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-01T18:43:01.537293] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T18:43:01.702407] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-01T18:43:02.502398] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-01T18:43:02.786261] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T18:43:03.302420] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-01T18:43:04.102401] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-01T18:43:04.649507] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-01T18:43:04.675543] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T18:43:04.902382] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-01T18:43:05.518376] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T18:43:05.702403] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-01T18:43:06.186542] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-01T18:43:06.435127] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T18:43:06.436818] [INFO ] [REMOTE ] EMR: Full fetch complete (77109 records). [2025-10-01T18:43:06.436933] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-01T18:43:06.507515] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-01T18:43:06.895770] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-01T18:43:06.895878] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-01T18:43:06.896939] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-01T18:43:06.897068] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-01T18:43:06.898823] [DEBUG] [LOCAL ] EMR: Trimmed 77109 records to 53250 (keeping 200 days of data) [2025-10-01T18:43:07.134091] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T18:43:07.259546] [DEBUG] [LOCAL ] EMR: Primary data saved (53250 records). [2025-10-01T18:43:07.259719] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-01T18:43:07.259827] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMR took 47.6s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-01T18:43:07.307613] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-01T18:43:07.503178] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:43:07.503376] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-01T18:43:07.503422] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-01T18:43:07.503538] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-01T18:43:07.503581] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-01T18:43:07.503624] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-01T18:43:07.503704] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-01T18:43:07.912658] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:43:08.001447] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T18:43:08.002323] [INFO ] [REMOTE ] ENFY: Full fetch complete (5610 records). [2025-10-01T18:43:08.002403] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-01T18:43:08.107533] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-01T18:43:08.421379] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-01T18:43:08.421460] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-01T18:43:08.421631] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-01T18:43:08.421721] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-01T18:43:08.422117] [DEBUG] [LOCAL ] ENFY: Trimmed 5610 records to 3099 (keeping 200 days of data) [2025-10-01T18:43:08.440447] [DEBUG] [LOCAL ] ENFY: Primary data saved (3099 records). [2025-10-01T18:43:08.440528] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-01T18:43:08.440611] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENFY took 20.0s. Estimated remaining: 3h 48m 6s. Rate: 7.2 symbols/min [2025-10-01T18:43:08.630369] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:43:08.677206] [DEBUG] [LOCAL ] ENOV: Loaded 44995 existing records from primary storage. [2025-10-01T18:43:08.677585] [INFO ] [MAIN ] ENOV: Loaded 44995 existing records. [2025-10-01T18:43:08.886249] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:43:08.886521] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-01T18:43:08.886578] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-01T18:43:08.886924] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-01T18:43:08.887018] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-01T18:43:08.909330] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-01T18:43:09.292491] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:43:09.494321] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-01T18:43:09.690014] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T18:43:09.702343] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-01T18:43:10.502374] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-01T18:43:10.876531] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T18:43:11.302385] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-01T18:43:12.097054] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T18:43:12.104783] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-01T18:43:12.902392] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-01T18:43:13.148883] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T18:43:13.379896] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T18:43:13.702390] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-01T18:43:14.439036] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T18:43:14.502403] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-01T18:43:14.944385] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T18:43:15.302386] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-01T18:43:15.578878] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T18:43:16.102380] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-01T18:43:16.658806] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T18:43:16.902385] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-01T18:43:17.702413] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-01T18:43:18.042836] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-01T18:43:18.045260] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T18:43:18.175020] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T18:43:18.502376] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-01T18:43:19.302402] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-01T18:43:19.379620] [DEBUG] [REMOTE ] ENIC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:43:19.379978] [WARN ] [REMOTE ] ENIC: No data returned for month 2025-10 [2025-10-01T18:43:19.380101] [FATAL] [REMOTE ] ENIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:43:19.380201] [FATAL] [MAIN ] ENIC: Failed to fetch primary data. [2025-10-01T18:43:19.380271] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:43:19.380347] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-01T18:43:19.380418] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-01T18:43:19.380463] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-10-01T18:43:19.380508] [DEBUG] [LOCAL ] ENIC: No derivative data file found to delete. [2025-10-01T18:43:19.380558] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 28.2s. Estimated remaining: 3h 48m 3s. Rate: 7.2 symbols/min [2025-10-01T18:43:19.572348] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:43:19.572538] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-10-01T18:43:19.572577] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-10-01T18:43:19.572722] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-01T18:43:19.572834] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-01T18:43:19.572900] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-10-01T18:43:19.572936] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-01T18:43:19.965170] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:43:20.102409] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-01T18:43:20.679779] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T18:43:20.902380] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-01T18:43:21.626211] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T18:43:21.702372] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-01T18:43:22.502365] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-01T18:43:22.639874] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T18:43:23.052925] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T18:43:23.302382] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-01T18:43:23.877004] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T18:43:23.891087] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T18:43:24.102388] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-01T18:43:24.429129] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-01T18:43:24.902381] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-01T18:43:25.702477] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-01T18:43:26.306304] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T18:43:26.502404] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-01T18:43:27.302405] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-01T18:43:27.464447] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T18:43:28.095561] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T18:43:28.104223] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-01T18:43:28.598596] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-01T18:43:28.727408] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T18:43:28.902411] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-01T18:43:29.702386] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-01T18:43:30.502370] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-01T18:43:30.829815] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T18:43:31.219304] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T18:43:31.302412] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-01T18:43:32.001391] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T18:43:32.102412] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-01T18:43:32.824322] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T18:43:32.902390] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-01T18:43:33.608750] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T18:43:33.702409] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-01T18:43:34.502381] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-01T18:43:34.582816] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T18:43:34.990376] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T18:43:35.302446] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-01T18:43:35.756084] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T18:43:35.955527] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T18:43:35.957442] [INFO ] [REMOTE ] ENB: Full fetch complete (77490 records). [2025-10-01T18:43:35.957740] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-01T18:43:36.107570] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-01T18:43:36.490754] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-01T18:43:36.490854] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-01T18:43:36.491880] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-01T18:43:36.491968] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-01T18:43:36.493802] [DEBUG] [LOCAL ] ENB: Trimmed 77490 records to 53512 (keeping 200 days of data) [2025-10-01T18:43:36.853634] [DEBUG] [LOCAL ] ENB: Primary data saved (53512 records). [2025-10-01T18:43:36.853837] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-01T18:43:36.853945] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENB took 51.9s. Estimated remaining: 3h 48m 15s. Rate: 7.1 symbols/min [2025-10-01T18:43:36.914089] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-01T18:43:37.062866] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:43:37.096700] [DEBUG] [LOCAL ] ENS: Loaded 29303 existing records from primary storage. [2025-10-01T18:43:37.097012] [INFO ] [MAIN ] ENS: Loaded 29303 existing records. [2025-10-01T18:43:37.305690] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:43:37.306034] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-01T18:43:37.306087] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-01T18:43:37.306377] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-01T18:43:37.306449] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-01T18:43:37.726748] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-01T18:43:37.734626] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:43:37.765440] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T18:43:38.150432] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-01T18:43:38.465236] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T18:43:38.502410] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-01T18:43:39.302436] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-01T18:43:39.888725] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T18:43:40.102381] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-01T18:43:40.902401] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-01T18:43:41.395851] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T18:43:41.397405] [INFO ] [REMOTE ] ENOV: Full fetch complete (63157 records). [2025-10-01T18:43:41.397507] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-01T18:43:41.709273] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-01T18:43:41.882564] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-01T18:43:41.882738] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-01T18:43:41.883962] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-01T18:43:41.884482] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-01T18:43:41.886113] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T18:43:41.897620] [DEBUG] [LOCAL ] ENOV: Trimmed 63157 records to 44921 (keeping 200 days of data) [2025-10-01T18:43:42.193163] [DEBUG] [LOCAL ] ENOV: Primary data saved (44921 records). [2025-10-01T18:43:42.193296] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-01T18:43:42.193395] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENOV took 33.8s. Estimated remaining: 3h 47m 60s. Rate: 7.1 symbols/min [2025-10-01T18:43:42.315434] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T18:43:42.403662] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T18:43:42.407111] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:43:42.442285] [DEBUG] [LOCAL ] ENVA: Loaded 25406 existing records from primary storage. [2025-10-01T18:43:42.442666] [INFO ] [MAIN ] ENVA: Loaded 25406 existing records. [2025-10-01T18:43:42.507542] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-01T18:43:42.667780] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:43:42.668018] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-01T18:43:42.668246] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-01T18:43:42.668580] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-01T18:43:42.668665] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-01T18:43:43.092878] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:43:43.302409] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-01T18:43:43.622699] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-01T18:43:43.843518] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T18:43:44.102425] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-01T18:43:44.761929] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T18:43:44.762633] [INFO ] [REMOTE ] ENO: Full fetch complete (3118 records). [2025-10-01T18:43:44.762738] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-01T18:43:44.913883] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-01T18:43:45.169285] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-01T18:43:45.169366] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-01T18:43:45.169497] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-01T18:43:45.169543] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-01T18:43:45.169929] [DEBUG] [LOCAL ] ENO: Trimmed 3118 records to 1915 (keeping 200 days of data) [2025-10-01T18:43:45.183704] [DEBUG] [LOCAL ] ENO: Primary data saved (1915 records). [2025-10-01T18:43:45.183831] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-01T18:43:45.183904] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENO took 37.9s. Estimated remaining: 3h 47m 39s. Rate: 7.2 symbols/min [2025-10-01T18:43:45.377783] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:43:45.396954] [DEBUG] [LOCAL ] EOD: Loaded 14203 existing records from primary storage. [2025-10-01T18:43:45.397196] [INFO ] [MAIN ] EOD: Loaded 14203 existing records. [2025-10-01T18:43:45.597000] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:43:45.597266] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-01T18:43:45.597323] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-01T18:43:45.597557] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-01T18:43:45.597615] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-01T18:43:45.706681] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-01T18:43:46.003768] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:43:46.502405] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-01T18:43:46.674274] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-01T18:43:46.676622] [INFO ] [REMOTE ] ENR: Full fetch complete (58571 records). [2025-10-01T18:43:46.676836] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-01T18:43:47.113574] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T18:43:47.172067] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-01T18:43:47.172164] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-01T18:43:47.172980] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-01T18:43:47.173045] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-01T18:43:47.174265] [DEBUG] [LOCAL ] ENR: Trimmed 58571 records to 42858 (keeping 200 days of data) [2025-10-01T18:43:47.285181] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-01T18:43:47.303146] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-01T18:43:47.476756] [DEBUG] [LOCAL ] ENR: Primary data saved (42858 records). [2025-10-01T18:43:47.476890] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-01T18:43:47.476975] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENR took 28.1s. Estimated remaining: 3h 47m 18s. Rate: 7.2 symbols/min [2025-10-01T18:43:47.663619] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:43:47.719784] [DEBUG] [LOCAL ] EOG: Loaded 53343 existing records from primary storage. [2025-10-01T18:43:47.720107] [INFO ] [MAIN ] EOG: Loaded 53343 existing records. [2025-10-01T18:43:47.916443] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:43:47.916679] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-01T18:43:47.916741] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-01T18:43:47.917019] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-01T18:43:47.917081] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-01T18:43:48.109701] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-01T18:43:48.337700] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:43:48.352450] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T18:43:48.902388] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-01T18:43:49.307232] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T18:43:49.702425] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-01T18:43:50.491937] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T18:43:50.502951] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-01T18:43:50.576061] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T18:43:51.076824] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T18:43:51.302412] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-01T18:43:52.102364] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-01T18:43:52.188883] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T18:43:52.902387] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-01T18:43:53.702480] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-01T18:43:53.764307] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T18:43:53.984063] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T18:43:54.502386] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-01T18:43:54.821080] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T18:43:55.204210] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T18:43:55.302387] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-01T18:43:56.102361] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-01T18:43:56.134229] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T18:43:56.902384] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-01T18:43:57.523302] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T18:43:57.702442] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-01T18:43:57.752085] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T18:43:58.502453] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-01T18:43:59.302443] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-01T18:43:59.543014] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T18:43:59.923094] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T18:44:00.102395] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-01T18:44:00.190070] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T18:44:00.902384] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-01T18:44:01.647250] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T18:44:01.702391] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-01T18:44:02.252138] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T18:44:02.502383] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-01T18:44:02.927765] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T18:44:03.302396] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-01T18:44:03.819051] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T18:44:04.102375] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-01T18:44:04.641250] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T18:44:04.902414] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-01T18:44:05.683365] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T18:44:05.702342] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-01T18:44:06.271180] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T18:44:06.502384] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-01T18:44:07.302354] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-01T18:44:07.541043] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T18:44:07.702572] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-01T18:44:08.098316] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T18:44:08.102337] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-01T18:44:08.884981] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T18:44:08.902383] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-01T18:44:09.702406] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-01T18:44:10.502427] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-01T18:44:10.704441] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T18:44:10.775213] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T18:44:10.776377] [INFO ] [REMOTE ] EOD: Full fetch complete (20371 records). [2025-10-01T18:44:10.776453] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-01T18:44:11.232899] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-01T18:44:11.232991] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-01T18:44:11.233465] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-01T18:44:11.233511] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-01T18:44:11.234248] [DEBUG] [LOCAL ] EOD: Trimmed 20371 records to 14412 (keeping 200 days of data) [2025-10-01T18:44:11.302582] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-01T18:44:11.325493] [DEBUG] [LOCAL ] EOD: Primary data saved (14412 records). [2025-10-01T18:44:11.325689] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-01T18:44:11.325838] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. EOD took 26.1s. Estimated remaining: 3h 47m 43s. Rate: 7.1 symbols/min [2025-10-01T18:44:11.515181] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:44:11.528693] [DEBUG] [LOCAL ] EOI: Loaded 10647 existing records from primary storage. [2025-10-01T18:44:11.528940] [INFO ] [MAIN ] EOI: Loaded 10647 existing records. [2025-10-01T18:44:11.662209] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T18:44:11.753750] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:44:11.754036] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-01T18:44:11.754107] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-01T18:44:11.754369] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-01T18:44:11.754429] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-01T18:44:12.107585] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-01T18:44:12.182779] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:44:12.782212] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T18:44:12.902391] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-01T18:44:13.076298] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T18:44:13.702392] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-01T18:44:14.502421] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-01T18:44:14.674097] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T18:44:14.869675] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T18:44:15.302382] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-01T18:44:15.426184] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T18:44:16.102398] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-01T18:44:16.902401] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-01T18:44:16.950930] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-01T18:44:16.952212] [INFO ] [REMOTE ] ENVA: Full fetch complete (36757 records). [2025-10-01T18:44:16.952309] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-01T18:44:17.092281] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T18:44:17.385250] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-01T18:44:17.385361] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-01T18:44:17.386114] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-01T18:44:17.386190] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-01T18:44:17.387162] [DEBUG] [LOCAL ] ENVA: Trimmed 36757 records to 25283 (keeping 200 days of data) [2025-10-01T18:44:17.552523] [DEBUG] [LOCAL ] ENVA: Primary data saved (25283 records). [2025-10-01T18:44:17.552696] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-01T18:44:17.552796] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 35.4s. Estimated remaining: 3h 47m 30s. Rate: 7.1 symbols/min [2025-10-01T18:44:17.707354] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-01T18:44:17.745474] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:44:17.764046] [DEBUG] [LOCAL ] EOS: Loaded 15187 existing records from primary storage. [2025-10-01T18:44:17.764314] [INFO ] [MAIN ] EOS: Loaded 15187 existing records. [2025-10-01T18:44:17.989844] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:44:17.990186] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-01T18:44:17.990255] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-01T18:44:17.990590] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-01T18:44:17.990724] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-01T18:44:18.127171] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T18:44:18.426131] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:44:18.443108] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T18:44:18.502379] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-01T18:44:19.296098] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T18:44:19.302381] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-01T18:44:20.102379] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-01T18:44:20.902359] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-01T18:44:21.077233] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T18:44:21.285153] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T18:44:21.702403] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-01T18:44:21.979929] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T18:44:22.502384] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-01T18:44:22.627076] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T18:44:23.302419] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-01T18:44:24.111115] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-01T18:44:24.136253] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T18:44:24.161283] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T18:44:24.902416] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-01T18:44:25.065311] [DEBUG] [REMOTE ] ENS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:44:25.065698] [WARN ] [REMOTE ] ENS: No data returned for month 2025-10 [2025-10-01T18:44:25.065785] [FATAL] [REMOTE ] ENS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:44:25.065890] [FATAL] [MAIN ] ENS: Failed to fetch primary data. [2025-10-01T18:44:25.065981] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:44:25.066059] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-01T18:44:25.066126] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-01T18:44:25.066164] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-10-01T18:44:25.067614] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-10-01T18:44:25.067740] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. ENS took 48.2s. Estimated remaining: 3h 47m 20s. Rate: 7.1 symbols/min [2025-10-01T18:44:25.263220] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:44:25.263405] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-10-01T18:44:25.263446] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-10-01T18:44:25.263567] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-01T18:44:25.263611] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-01T18:44:25.263691] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-01T18:44:25.263742] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-01T18:44:25.659163] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:44:25.702449] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-01T18:44:26.449001] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T18:44:26.502391] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-01T18:44:27.302391] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-01T18:44:27.419821] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-01T18:44:27.421532] [INFO ] [REMOTE ] EOG: Full fetch complete (77275 records). [2025-10-01T18:44:27.421689] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-01T18:44:27.842387] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T18:44:27.959182] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-01T18:44:27.959295] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-01T18:44:27.960581] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-01T18:44:27.960701] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-01T18:44:27.963154] [DEBUG] [LOCAL ] EOG: Trimmed 77275 records to 53344 (keeping 200 days of data) [2025-10-01T18:44:28.102587] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-01T18:44:28.309434] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T18:44:28.512536] [DEBUG] [LOCAL ] EOG: Primary data saved (53344 records). [2025-10-01T18:44:28.512855] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-01T18:44:28.512994] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOG took 41.0s. Estimated remaining: 3h 47m 1s. Rate: 7.2 symbols/min [2025-10-01T18:44:28.766420] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:44:28.795798] [DEBUG] [LOCAL ] EPAC: Loaded 26979 existing records from primary storage. [2025-10-01T18:44:28.796202] [INFO ] [MAIN ] EPAC: Loaded 26979 existing records. [2025-10-01T18:44:28.907571] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-01T18:44:29.032713] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:44:29.032950] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-01T18:44:29.032999] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-01T18:44:29.033214] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-01T18:44:29.033363] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-01T18:44:29.167958] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T18:44:29.470443] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:44:29.702429] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-01T18:44:29.727636] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T18:44:30.502446] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-01T18:44:31.044626] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T18:44:31.302420] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-01T18:44:31.342535] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T18:44:32.102373] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-01T18:44:32.130462] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T18:44:32.902403] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-01T18:44:33.047088] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-01T18:44:33.452180] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T18:44:33.702417] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-01T18:44:34.209583] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T18:44:34.502389] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-01T18:44:35.302409] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-01T18:44:35.457771] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T18:44:36.102387] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-01T18:44:36.343452] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T18:44:36.902396] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-01T18:44:37.405236] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T18:44:37.702372] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-01T18:44:37.817614] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T18:44:38.502400] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-01T18:44:38.841325] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T18:44:39.213886] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T18:44:39.302414] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-01T18:44:40.102381] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-01T18:44:40.375788] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T18:44:40.376721] [INFO ] [REMOTE ] EOI: Full fetch complete (16194 records). [2025-10-01T18:44:40.376797] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-01T18:44:40.782403] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-01T18:44:40.782592] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-01T18:44:40.783066] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-01T18:44:40.783130] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-01T18:44:40.783701] [DEBUG] [LOCAL ] EOI: Trimmed 16194 records to 10683 (keeping 200 days of data) [2025-10-01T18:44:40.852230] [DEBUG] [LOCAL ] EOI: Primary data saved (10683 records). [2025-10-01T18:44:40.852376] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-01T18:44:40.852461] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOI took 29.5s. Estimated remaining: 3h 47m 1s. Rate: 7.1 symbols/min [2025-10-01T18:44:40.907427] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-01T18:44:41.036859] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T18:44:41.056884] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:44:41.110022] [DEBUG] [LOCAL ] EPAM: Loaded 39781 existing records from primary storage. [2025-10-01T18:44:41.110435] [INFO ] [MAIN ] EPAM: Loaded 39781 existing records. [2025-10-01T18:44:41.322707] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:44:41.322956] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-01T18:44:41.323070] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-01T18:44:41.323912] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-01T18:44:41.323981] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-01T18:44:41.715471] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-01T18:44:41.723207] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:44:42.333147] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T18:44:42.346319] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T18:44:42.502398] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-01T18:44:43.121017] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T18:44:43.302387] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-01T18:44:44.102400] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-01T18:44:44.301935] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T18:44:44.902387] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-01T18:44:45.348493] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T18:44:45.702390] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-01T18:44:46.392665] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-01T18:44:46.502399] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-01T18:44:46.627026] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T18:44:47.273843] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T18:44:47.302346] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-01T18:44:48.102374] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-01T18:44:48.339194] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T18:44:48.902427] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-01T18:44:49.058067] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T18:44:49.058993] [INFO ] [REMOTE ] EOT: Full fetch complete (10781 records). [2025-10-01T18:44:49.059068] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-01T18:44:49.507419] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-01T18:44:49.507502] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-01T18:44:49.507808] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-01T18:44:49.507903] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-01T18:44:49.508490] [DEBUG] [LOCAL ] EOT: Trimmed 10781 records to 6873 (keeping 200 days of data) [2025-10-01T18:44:49.559224] [DEBUG] [LOCAL ] EOT: Primary data saved (6873 records). [2025-10-01T18:44:49.559416] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-01T18:44:49.559529] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 24.5s. Estimated remaining: 3h 46m 53s. Rate: 7.1 symbols/min [2025-10-01T18:44:49.707487] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-01T18:44:49.775952] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:44:49.776677] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-01T18:44:49.776821] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-01T18:44:49.784512] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-01T18:44:49.785343] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T18:44:49.785433] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-01T18:44:49.788722] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-01T18:44:49.789079] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-01T18:44:50.197970] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:44:50.502373] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-01T18:44:50.785692] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T18:44:51.302397] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-01T18:44:51.771414] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:44:52.035054] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T18:44:52.102379] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-01T18:44:52.902383] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-01T18:44:53.142328] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T18:44:53.143611] [INFO ] [REMOTE ] EOS: Full fetch complete (23307 records). [2025-10-01T18:44:53.143718] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-01T18:44:53.547098] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-01T18:44:53.547190] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-01T18:44:53.547747] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-01T18:44:53.547811] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-01T18:44:53.548505] [DEBUG] [LOCAL ] EOS: Trimmed 23307 records to 15225 (keeping 200 days of data) [2025-10-01T18:44:53.649077] [DEBUG] [LOCAL ] EOS: Primary data saved (15225 records). [2025-10-01T18:44:53.649273] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-01T18:44:53.649395] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOS took 36.1s. Estimated remaining: 3h 46m 35s. Rate: 7.2 symbols/min [2025-10-01T18:44:53.711290] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-01T18:44:53.845184] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:44:53.905324] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-10-01T18:44:53.905799] [INFO ] [MAIN ] EPD: Loaded 53610 existing records. [2025-10-01T18:44:54.120601] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:44:54.120954] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-01T18:44:54.121015] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-01T18:44:54.121436] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-01T18:44:54.121503] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-01T18:44:54.523101] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T18:44:54.516288] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-01T18:44:54.574885] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:44:55.064739] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T18:44:55.302388] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-01T18:44:55.616478] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T18:44:56.102389] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-01T18:44:56.902360] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-01T18:44:57.339453] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T18:44:57.664170] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T18:44:57.702385] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-01T18:44:58.312929] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T18:44:58.502403] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-01T18:44:59.302358] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-01T18:44:59.346714] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T18:44:59.625788] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T18:45:00.102412] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-01T18:45:00.902456] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-01T18:45:01.202152] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T18:45:01.702409] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-01T18:45:01.897752] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T18:45:02.190530] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T18:45:02.502363] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-01T18:45:03.302372] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-01T18:45:03.701019] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-01T18:45:03.934706] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T18:45:04.102430] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-01T18:45:04.902386] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-01T18:45:04.976131] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-01T18:45:04.978000] [INFO ] [REMOTE ] EPAC: Full fetch complete (39038 records). [2025-10-01T18:45:04.978087] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-01T18:45:05.419793] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-01T18:45:05.419984] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-01T18:45:05.421105] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-01T18:45:05.421181] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-01T18:45:05.424399] [DEBUG] [LOCAL ] EPAC: Trimmed 39038 records to 26946 (keeping 200 days of data) [2025-10-01T18:45:05.593319] [DEBUG] [LOCAL ] EPAC: Primary data saved (26946 records). [2025-10-01T18:45:05.593462] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-01T18:45:05.593663] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 37.1s. Estimated remaining: 3h 46m 35s. Rate: 7.1 symbols/min [2025-10-01T18:45:05.707607] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-01T18:45:05.795338] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:45:05.820200] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T18:45:05.866971] [DEBUG] [LOCAL ] EPR: Loaded 43924 existing records from primary storage. [2025-10-01T18:45:05.867303] [INFO ] [MAIN ] EPR: Loaded 43924 existing records. [2025-10-01T18:45:06.057573] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:45:06.057888] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-01T18:45:06.057963] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-01T18:45:06.058251] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-01T18:45:06.058320] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-01T18:45:06.462256] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:45:06.502364] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-01T18:45:06.589972] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T18:45:07.302384] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-01T18:45:07.756390] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T18:45:07.977893] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T18:45:08.102387] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-01T18:45:08.902355] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-01T18:45:09.022014] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T18:45:09.681515] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T18:45:09.702341] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-01T18:45:10.088597] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T18:45:10.502386] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-01T18:45:11.208398] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T18:45:11.302377] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-01T18:45:11.721899] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T18:45:12.102393] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-01T18:45:12.902391] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-01T18:45:13.429127] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-01T18:45:13.513629] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T18:45:13.702380] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-01T18:45:13.893889] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T18:45:14.502389] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-01T18:45:15.302398] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-01T18:45:15.632853] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T18:45:16.102388] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-01T18:45:16.224637] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T18:45:16.890088] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T18:45:16.902340] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-01T18:45:17.702407] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-01T18:45:17.761855] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T18:45:18.502400] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-01T18:45:18.567275] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T18:45:19.302365] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-01T18:45:19.684548] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-01T18:45:20.102459] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-01T18:45:20.293482] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T18:45:20.909726] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-01T18:45:20.941352] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T18:45:21.702445] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-01T18:45:22.392330] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-01T18:45:22.393989] [INFO ] [REMOTE ] EPAM: Full fetch complete (56145 records). [2025-10-01T18:45:22.394160] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-01T18:45:22.507494] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-01T18:45:22.886049] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-01T18:45:22.926166] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-01T18:45:22.926268] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-01T18:45:22.927552] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-01T18:45:22.927616] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-01T18:45:22.929401] [DEBUG] [LOCAL ] EPAM: Trimmed 56145 records to 39752 (keeping 200 days of data) [2025-10-01T18:45:23.194627] [DEBUG] [LOCAL ] EPAM: Primary data saved (39752 records). [2025-10-01T18:45:23.194830] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-01T18:45:23.194939] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAM took 42.3s. Estimated remaining: 3h 46m 46s. Rate: 7.1 symbols/min [2025-10-01T18:45:23.309397] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-01T18:45:23.397588] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:45:23.446418] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-10-01T18:45:23.446768] [INFO ] [MAIN ] EPRT: Loaded 48479 existing records. [2025-10-01T18:45:23.650477] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:45:23.651007] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-01T18:45:23.651193] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-01T18:45:23.651748] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-01T18:45:23.651827] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-01T18:45:23.936862] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-01T18:45:24.106814] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-01T18:45:24.150751] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:45:24.179571] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T18:45:24.737436] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T18:45:24.902394] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-01T18:45:25.702362] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-01T18:45:26.289566] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-01T18:45:26.367788] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T18:45:26.502389] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-01T18:45:26.891782] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T18:45:27.302423] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-01T18:45:28.102436] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-01T18:45:28.454231] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T18:45:28.902438] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-01T18:45:28.909787] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T18:45:29.702362] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-01T18:45:30.019498] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-01T18:45:30.020924] [INFO ] [REMOTE ] EPC: Full fetch complete (56861 records). [2025-10-01T18:45:30.021018] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-01T18:45:30.442514] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-01T18:45:30.442676] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-01T18:45:30.443549] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-01T18:45:30.443618] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-01T18:45:30.445194] [DEBUG] [LOCAL ] EPC: Trimmed 56861 records to 39811 (keeping 200 days of data) [2025-10-01T18:45:30.507430] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-01T18:45:30.717095] [DEBUG] [LOCAL ] EPC: Primary data saved (39811 records). [2025-10-01T18:45:30.717385] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-01T18:45:30.717495] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 41.2s. Estimated remaining: 3h 46m 36s. Rate: 7.1 symbols/min [2025-10-01T18:45:30.929208] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:45:30.964722] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T18:45:30.988132] [DEBUG] [LOCAL ] EQBK: Loaded 10919 existing records from primary storage. [2025-10-01T18:45:30.988435] [INFO ] [MAIN ] EQBK: Loaded 10919 existing records. [2025-10-01T18:45:31.206389] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:45:31.206739] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-01T18:45:31.206796] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-01T18:45:31.207179] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-01T18:45:31.207280] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-01T18:45:31.310262] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-01T18:45:31.644089] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-01T18:45:31.650970] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:45:31.657796] [INFO ] [REMOTE ] EPD: Full fetch complete (77640 records). [2025-10-01T18:45:31.658016] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-01T18:45:32.103507] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-01T18:45:32.126266] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-01T18:45:32.126486] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-01T18:45:32.127625] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-01T18:45:32.127957] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-01T18:45:32.130014] [DEBUG] [LOCAL ] EPD: Trimmed 77640 records to 53610 (keeping 200 days of data) [2025-10-01T18:45:32.402051] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T18:45:32.540583] [DEBUG] [LOCAL ] EPD: Primary data saved (53610 records). [2025-10-01T18:45:32.540771] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-01T18:45:32.540884] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 38.9s. Estimated remaining: 3h 46m 13s. Rate: 7.1 symbols/min [2025-10-01T18:45:32.752366] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:45:32.780126] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T18:45:32.840091] [DEBUG] [LOCAL ] EQH: Loaded 52651 existing records from primary storage. [2025-10-01T18:45:32.840417] [INFO ] [MAIN ] EQH: Loaded 52651 existing records. [2025-10-01T18:45:32.913527] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-01T18:45:33.054378] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T18:45:33.060433] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:45:33.063996] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-01T18:45:33.064059] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-01T18:45:33.065192] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-01T18:45:33.065256] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-01T18:45:33.449204] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:45:33.702385] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-01T18:45:34.502467] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-01T18:45:34.531397] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T18:45:34.881045] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-01T18:45:34.882698] [INFO ] [REMOTE ] EPR: Full fetch complete (62944 records). [2025-10-01T18:45:34.882858] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-01T18:45:35.303255] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-01T18:45:35.303463] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-01T18:45:35.303603] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-01T18:45:35.305395] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-01T18:45:35.305574] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-01T18:45:35.307278] [DEBUG] [LOCAL ] EPR: Trimmed 62944 records to 43923 (keeping 200 days of data) [2025-10-01T18:45:35.599761] [DEBUG] [LOCAL ] EPR: Primary data saved (43923 records). [2025-10-01T18:45:35.599893] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-01T18:45:35.599978] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 30.0s. Estimated remaining: 3h 45m 53s. Rate: 7.2 symbols/min [2025-10-01T18:45:35.787910] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:45:35.844365] [DEBUG] [LOCAL ] EQNR: Loaded 53023 existing records from primary storage. [2025-10-01T18:45:35.844765] [INFO ] [MAIN ] EQNR: Loaded 53023 existing records. [2025-10-01T18:45:36.047348] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:45:36.047769] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-01T18:45:36.047910] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-01T18:45:36.049692] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-01T18:45:36.049759] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-01T18:45:36.113787] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-01T18:45:36.457104] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T18:45:36.508200] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:45:36.722733] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T18:45:36.902401] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-01T18:45:37.198971] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T18:45:37.702382] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-01T18:45:38.502368] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-01T18:45:38.619824] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T18:45:38.986247] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T18:45:39.302398] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-01T18:45:39.520542] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T18:45:40.102373] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-01T18:45:40.175840] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T18:45:40.902396] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-01T18:45:41.702399] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-01T18:45:41.915912] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T18:45:42.439822] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T18:45:42.505849] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-01T18:45:42.520793] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T18:45:43.302381] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-01T18:45:43.446232] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T18:45:44.102423] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-01T18:45:44.902381] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-01T18:45:45.011837] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T18:45:45.139720] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T18:45:45.702394] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-01T18:45:46.502380] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-01T18:45:46.547635] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T18:45:46.587569] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T18:45:47.302387] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-01T18:45:47.930933] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T18:45:48.102358] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-01T18:45:48.366601] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T18:45:48.902388] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-01T18:45:49.702427] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-01T18:45:50.258244] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-01T18:45:50.488295] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T18:45:50.502362] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-01T18:45:51.005813] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T18:45:51.302380] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-01T18:45:51.898620] [DEBUG] [REMOTE ] EQBK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:45:51.899063] [WARN ] [REMOTE ] EQBK: No data returned for month 2025-10 [2025-10-01T18:45:51.899141] [FATAL] [REMOTE ] EQBK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:45:51.899231] [FATAL] [MAIN ] EQBK: Failed to fetch primary data. [2025-10-01T18:45:51.899276] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:45:51.899326] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-01T18:45:51.899388] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-01T18:45:51.899427] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-01T18:45:51.900082] [DEBUG] [LOCAL ] EQBK: Deleted derivative data file. [2025-10-01T18:45:51.900181] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQBK took 21.2s. Estimated remaining: 3h 46m 2s. Rate: 7.1 symbols/min [2025-10-01T18:45:52.099372] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:45:52.102456] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-01T18:45:52.163785] [DEBUG] [LOCAL ] EQR: Loaded 51489 existing records from primary storage. [2025-10-01T18:45:52.164170] [INFO ] [MAIN ] EQR: Loaded 51489 existing records. [2025-10-01T18:45:52.381363] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:45:52.381760] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-01T18:45:52.381931] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-01T18:45:52.384156] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-01T18:45:52.384409] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-01T18:45:52.530818] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T18:45:52.824764] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:45:52.902378] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-01T18:45:53.702391] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-01T18:45:54.469572] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T18:45:54.502482] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-01T18:45:55.302458] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-01T18:45:55.634692] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T18:45:56.109505] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-01T18:45:56.115403] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T18:45:56.902398] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-01T18:45:56.956425] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T18:45:57.575636] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T18:45:57.702364] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-01T18:45:57.883882] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (5.78 seconds). [2025-10-01T18:45:58.291962] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T18:45:58.502424] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-01T18:45:59.302407] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-01T18:45:59.365026] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T18:46:00.102360] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-01T18:46:00.136309] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T18:46:00.902379] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-01T18:46:01.110050] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T18:46:01.712804] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-01T18:46:01.745217] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T18:46:02.502359] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-01T18:46:02.589410] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T18:46:03.302423] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-01T18:46:03.468584] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T18:46:04.102383] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-01T18:46:04.495156] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-01T18:46:04.830587] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T18:46:04.902399] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-01T18:46:05.702393] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-01T18:46:06.041849] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T18:46:06.043598] [INFO ] [REMOTE ] EPRT: Full fetch complete (68731 records). [2025-10-01T18:46:06.043734] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-01T18:46:06.485883] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-01T18:46:06.486077] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-01T18:46:06.487429] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-01T18:46:06.487679] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-01T18:46:06.489223] [DEBUG] [LOCAL ] EPRT: Trimmed 68731 records to 48479 (keeping 200 days of data) [2025-10-01T18:46:06.549243] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-01T18:46:06.781588] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T18:46:06.879796] [DEBUG] [LOCAL ] EPRT: Primary data saved (48479 records). [2025-10-01T18:46:06.879950] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-01T18:46:06.880097] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 43.7s. Estimated remaining: 3h 46m 8s. Rate: 7.1 symbols/min [2025-10-01T18:46:07.302411] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-01T18:46:07.476024] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T18:46:08.029103] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:46:08.102379] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-01T18:46:08.690971] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T18:46:08.902390] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-01T18:46:09.702380] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-01T18:46:09.779175] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T18:46:10.502374] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-01T18:46:11.229703] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T18:46:11.234446] [INFO ] [REMOTE ] EQH: Full fetch complete (76363 records). [2025-10-01T18:46:11.234623] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-01T18:46:11.696701] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-01T18:46:11.696813] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-01T18:46:11.698016] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-01T18:46:11.698089] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-01T18:46:11.699908] [DEBUG] [LOCAL ] EQH: Trimmed 76363 records to 52653 (keeping 200 days of data) [2025-10-01T18:46:12.141110] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T18:46:12.171087] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-01T18:46:12.188213] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-01T18:46:12.192174] [INFO ] [REMOTE ] EQNR: Full fetch complete (76814 records). [2025-10-01T18:46:12.194613] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-01T18:46:12.304399] [DEBUG] [LOCAL ] EQH: Primary data saved (52653 records). [2025-10-01T18:46:12.311582] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-01T18:46:12.311815] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 39.8s. Estimated remaining: 3h 45m 53s. Rate: 7.1 symbols/min [2025-10-01T18:46:12.852389] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-01T18:46:12.852517] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-01T18:46:12.853785] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-01T18:46:12.853872] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-01T18:46:12.856330] [DEBUG] [LOCAL ] EQNR: Trimmed 76814 records to 53033 (keeping 200 days of data) [2025-10-01T18:46:13.215349] [DEBUG] [LOCAL ] EQNR: Primary data saved (53033 records). [2025-10-01T18:46:13.215507] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-01T18:46:13.215617] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 37.6s. Estimated remaining: 3h 45m 28s. Rate: 7.1 symbols/min [2025-10-01T18:46:13.750966] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T18:46:13.762949] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-01T18:46:15.477887] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T18:46:15.489754] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-01T18:46:17.252948] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T18:46:17.264581] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-01T18:46:19.802347] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-01T18:46:19.804060] [INFO ] [REMOTE ] EQR: Full fetch complete (73973 records). [2025-10-01T18:46:19.804170] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-01T18:46:20.251420] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-01T18:46:20.251549] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-01T18:46:20.252564] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-01T18:46:20.252664] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-01T18:46:20.254351] [DEBUG] [LOCAL ] EQR: Trimmed 73973 records to 51509 (keeping 200 days of data) [2025-10-01T18:46:20.601239] [DEBUG] [LOCAL ] EQR: Primary data saved (51509 records). [2025-10-01T18:46:20.601403] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-01T18:46:20.601493] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 28.7s. Estimated remaining: 3h 45m 18s. Rate: 7.2 symbols/min [2025-10-01T18:46:21.314314] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:46:21.362386] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:46:21.361259] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:46:21.388601] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-01T18:46:21.418938] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:46:21.419098] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-01T18:46:21.420511] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-01T18:46:21.420710] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-01T18:46:21.420819] [DEBUG] [LOCAL ] ERJ: No existing data file found in primary storage. [2025-10-01T18:46:21.423558] [DEBUG] [LOCAL ] EQV: Loaded 2737 existing records from primary storage. [2025-10-01T18:46:21.423782] [WARN ] [MAIN ] ERJ: No existing data found, performing full refresh instead. [2025-10-01T18:46:21.424230] [INFO ] [MAIN ] EQV: Loaded 2737 existing records. [2025-10-01T18:46:21.423870] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-01T18:46:21.424468] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-01T18:46:21.436293] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-01T18:46:21.429695] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-01T18:46:21.463704] [DEBUG] [LOCAL ] ERJ: No primary data file found to delete. [2025-10-01T18:46:21.486322] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-01T18:46:21.938466] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:46:22.025341] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-01T18:46:22.040335] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-01T18:46:22.081557] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-01T18:46:22.081667] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-01T18:46:22.150615] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-01T18:46:22.221678] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-01T18:46:22.751102] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:46:22.829406] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-01T18:46:22.834768] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-01T18:46:22.823901] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:46:22.873950] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-01T18:46:22.855592] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-01T18:46:22.903918] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-01T18:46:23.000338] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:46:23.034894] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-01T18:46:23.498778] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:46:23.523110] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-01T18:46:23.522854] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-01T18:46:23.541111] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-01T18:46:23.632198] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:46:23.632552] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-01T18:46:23.951585] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-01T18:46:23.952808] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-01T18:46:24.127162] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T18:46:24.129260] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-01T18:46:24.301095] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-01T18:46:24.302041] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-01T18:46:24.458265] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T18:46:24.468003] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-01T18:46:24.566392] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-01T18:46:24.567363] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-01T18:46:24.795754] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T18:46:24.798377] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-01T18:46:24.821417] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-01T18:46:24.822783] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-01T18:46:25.186880] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-01T18:46:25.187977] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-01T18:46:25.313571] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T18:46:25.325139] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-01T18:46:25.466263] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-01T18:46:25.702438] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-01T18:46:25.746446] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T18:46:25.794012] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T18:46:26.266004] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-01T18:46:26.502411] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-01T18:46:27.236697] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-01T18:46:27.302362] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-01T18:46:28.107801] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-01T18:46:28.119388] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T18:46:28.637117] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T18:46:28.902370] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-01T18:46:29.159841] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T18:46:29.356318] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-01T18:46:29.702402] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-01T18:46:30.212378] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T18:46:30.502425] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-01T18:46:31.081822] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-01T18:46:31.302435] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-01T18:46:31.773236] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T18:46:32.102401] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-01T18:46:32.665432] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T18:46:32.902396] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-01T18:46:33.621345] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T18:46:33.622134] [INFO ] [REMOTE ] EQS: Full fetch complete (2536 records). [2025-10-01T18:46:33.622230] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-01T18:46:33.707507] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-01T18:46:33.838894] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-01T18:46:33.839062] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:46:33.839132] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:46:33.839205] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-01T18:46:33.839275] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-01T18:46:33.839317] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-01T18:46:33.839359] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-01T18:46:33.839418] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 13.2s. Estimated remaining: 3h 45m 20s. Rate: 7.1 symbols/min [2025-10-01T18:46:34.023802] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:46:34.066427] [DEBUG] [LOCAL ] ERO: Loaded 41233 existing records from primary storage. [2025-10-01T18:46:34.066780] [INFO ] [MAIN ] ERO: Loaded 41233 existing records. [2025-10-01T18:46:34.263351] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:46:34.263551] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-01T18:46:34.263601] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-01T18:46:34.263907] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-01T18:46:34.263968] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-01T18:46:34.507515] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-01T18:46:34.671490] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:46:35.025468] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-01T18:46:35.302376] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-01T18:46:35.583980] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T18:46:36.102393] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-01T18:46:36.902407] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-01T18:46:37.163055] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T18:46:37.702344] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-01T18:46:38.111260] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T18:46:38.397027] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T18:46:38.502410] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-01T18:46:39.302362] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-01T18:46:39.674710] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T18:46:39.729957] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T18:46:40.102382] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-01T18:46:40.902376] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-01T18:46:40.992891] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T18:46:41.306099] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T18:46:41.702415] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-01T18:46:42.244444] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T18:46:42.502363] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-01T18:46:42.571064] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T18:46:42.953305] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T18:46:43.302432] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-01T18:46:43.962536] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T18:46:43.963386] [INFO ] [REMOTE ] EQV: Full fetch complete (5777 records). [2025-10-01T18:46:43.963467] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-01T18:46:44.107533] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-01T18:46:44.403936] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-01T18:46:44.404018] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-01T18:46:44.404192] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-01T18:46:44.404234] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-01T18:46:44.404611] [DEBUG] [LOCAL ] EQV: Trimmed 5777 records to 2736 (keeping 200 days of data) [2025-10-01T18:46:44.421675] [DEBUG] [LOCAL ] EQV: Primary data saved (2736 records). [2025-10-01T18:46:44.421769] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-01T18:46:44.421860] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQV took 23.8s. Estimated remaining: 3h 45m 16s. Rate: 7.1 symbols/min [2025-10-01T18:46:44.621977] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:46:44.676216] [DEBUG] [LOCAL ] ES: Loaded 52556 existing records from primary storage. [2025-10-01T18:46:44.676566] [INFO ] [MAIN ] ES: Loaded 52556 existing records. [2025-10-01T18:46:44.877603] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:46:44.877882] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-01T18:46:44.877941] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-01T18:46:44.878237] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-01T18:46:44.878297] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-01T18:46:44.913452] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-01T18:46:45.304549] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:46:45.702364] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-01T18:46:45.794540] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T18:46:46.002813] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T18:46:46.502407] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-01T18:46:47.302360] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-01T18:46:47.383701] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T18:46:48.102382] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-01T18:46:48.226877] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T18:46:48.902355] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-01T18:46:48.936023] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T18:46:49.702419] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-01T18:46:49.797914] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T18:46:50.374332] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T18:46:50.502413] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-01T18:46:51.204763] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T18:46:51.302366] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-01T18:46:52.102394] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-01T18:46:52.558674] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T18:46:52.902399] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-01T18:46:52.945755] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T18:46:53.119257] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T18:46:53.702388] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-01T18:46:54.411164] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T18:46:54.502393] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-01T18:46:55.021164] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T18:46:55.302393] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-01T18:46:56.102453] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-01T18:46:56.308043] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T18:46:56.777441] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T18:46:56.902378] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-01T18:46:57.702386] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-01T18:46:57.760725] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T18:46:58.502429] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-01T18:46:58.763805] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T18:46:59.032605] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T18:46:59.302373] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-01T18:47:00.102408] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-01T18:47:00.466837] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-01T18:47:00.759184] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T18:47:00.902390] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-01T18:47:01.702361] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-01T18:47:01.873771] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T18:47:02.502444] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-01T18:47:03.031267] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-01T18:47:03.032711] [INFO ] [REMOTE ] ERO: Full fetch complete (59491 records). [2025-10-01T18:47:03.032818] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-01T18:47:03.314222] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-01T18:47:03.488840] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-01T18:47:03.488972] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-01T18:47:03.491181] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-01T18:47:03.491309] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-01T18:47:03.493956] [DEBUG] [LOCAL ] ERO: Trimmed 59491 records to 41247 (keeping 200 days of data) [2025-10-01T18:47:03.743816] [DEBUG] [LOCAL ] ERO: Primary data saved (41247 records). [2025-10-01T18:47:03.744018] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-01T18:47:03.744165] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERO took 29.9s. Estimated remaining: 3h 45m 31s. Rate: 7.1 symbols/min [2025-10-01T18:47:03.935972] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T18:47:03.935779] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:03.938852] [INFO ] [REMOTE ] ERJ: Full fetch complete (72338 records). [2025-10-01T18:47:03.939150] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-01T18:47:04.112387] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T18:47:04.196505] [DEBUG] [LOCAL ] ESAB: Loaded 26186 existing records from primary storage. [2025-10-01T18:47:04.229120] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-01T18:47:04.229538] [INFO ] [MAIN ] ESAB: Loaded 26186 existing records. [2025-10-01T18:47:04.682694] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:47:04.686477] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-01T18:47:04.686596] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-01T18:47:04.686730] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-01T18:47:04.686809] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-01T18:47:04.688030] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-01T18:47:04.687981] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-01T18:47:04.688150] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-01T18:47:04.688227] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-01T18:47:04.801111] [DEBUG] [LOCAL ] ERJ: Trimmed 72338 records to 50627 (keeping 200 days of data) [2025-10-01T18:47:05.217268] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:05.218169] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-01T18:47:05.444279] [DEBUG] [LOCAL ] ERJ: Primary data saved (50627 records). [2025-10-01T18:47:05.444445] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-01T18:47:05.444544] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERJ took 44.7s. Estimated remaining: 3h 45m 8s. Rate: 7.1 symbols/min [2025-10-01T18:47:05.632035] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:05.652407] [DEBUG] [LOCAL ] ESE: Loaded 16678 existing records from primary storage. [2025-10-01T18:47:05.652734] [INFO ] [MAIN ] ESE: Loaded 16678 existing records. [2025-10-01T18:47:05.855607] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:47:05.856033] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-01T18:47:05.856144] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-01T18:47:05.856355] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-01T18:47:05.856414] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-01T18:47:06.202717] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-01T18:47:06.231298] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-10-01T18:47:06.256708] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-01T18:47:06.299070] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:06.299951] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-01T18:47:06.508977] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T18:47:06.526915] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-01T18:47:06.533167] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-01T18:47:06.813807] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-01T18:47:06.813898] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-01T18:47:06.814863] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-01T18:47:06.814933] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-01T18:47:06.817135] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-10-01T18:47:07.070011] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T18:47:07.173735] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-10-01T18:47:07.173878] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-01T18:47:07.173998] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. EQT took 46.6s. Estimated remaining: 3h 44m 46s. Rate: 7.1 symbols/min [2025-10-01T18:47:07.305236] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-01T18:47:07.383110] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:07.436113] [DEBUG] [LOCAL ] ESI: Loaded 50750 existing records from primary storage. [2025-10-01T18:47:07.436526] [INFO ] [MAIN ] ESI: Loaded 50750 existing records. [2025-10-01T18:47:07.641282] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:47:07.641750] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-01T18:47:07.641818] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-01T18:47:07.642335] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-01T18:47:07.642410] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-01T18:47:07.803944] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T18:47:08.084996] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:08.102341] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-01T18:47:08.133726] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T18:47:08.902398] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-01T18:47:09.702370] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-01T18:47:09.745436] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T18:47:09.768240] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T18:47:10.502401] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-01T18:47:10.732047] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T18:47:11.302391] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-01T18:47:12.087552] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T18:47:12.102352] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-01T18:47:12.912401] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-01T18:47:12.939513] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T18:47:12.965806] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T18:47:13.702420] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-01T18:47:14.177722] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T18:47:14.502373] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-01T18:47:14.720141] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T18:47:15.302383] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-01T18:47:15.660185] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T18:47:16.102401] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-01T18:47:16.863173] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T18:47:16.902355] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-01T18:47:16.986482] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T18:47:17.702367] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-01T18:47:17.716070] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T18:47:18.502370] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-01T18:47:19.266010] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T18:47:19.302413] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-01T18:47:19.451306] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T18:47:20.102452] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-01T18:47:20.748987] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T18:47:20.902370] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-01T18:47:21.183253] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T18:47:21.702401] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-01T18:47:22.502401] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-01T18:47:22.815937] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T18:47:23.302369] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-01T18:47:23.319766] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-01T18:47:23.321394] [INFO ] [REMOTE ] ES: Full fetch complete (76183 records). [2025-10-01T18:47:23.321578] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-01T18:47:23.687868] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T18:47:23.798612] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-01T18:47:23.798732] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-01T18:47:23.799684] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-01T18:47:23.799752] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-01T18:47:23.801232] [DEBUG] [LOCAL ] ES: Trimmed 76183 records to 52572 (keeping 200 days of data) [2025-10-01T18:47:24.108384] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-01T18:47:24.159593] [DEBUG] [LOCAL ] ES: Primary data saved (52572 records). [2025-10-01T18:47:24.159791] [INFO ] [MAIN ] ES: Full history saved. [2025-10-01T18:47:24.159908] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 39.7s. Estimated remaining: 3h 44m 55s. Rate: 7.1 symbols/min [2025-10-01T18:47:24.349316] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:24.375952] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T18:47:24.408430] [DEBUG] [LOCAL ] ESNT: Loaded 38357 existing records from primary storage. [2025-10-01T18:47:24.408762] [INFO ] [MAIN ] ESNT: Loaded 38357 existing records. [2025-10-01T18:47:24.602027] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:47:24.602313] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-01T18:47:24.602370] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-01T18:47:24.603220] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-01T18:47:24.603284] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-01T18:47:24.905298] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-01T18:47:24.989819] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:25.702417] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-01T18:47:25.903507] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T18:47:26.254426] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T18:47:26.502403] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-01T18:47:26.797607] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T18:47:27.302371] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-01T18:47:27.644945] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T18:47:28.102418] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-01T18:47:28.524152] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T18:47:28.525109] [INFO ] [REMOTE ] ESE: Full fetch complete (22343 records). [2025-10-01T18:47:28.525181] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-01T18:47:28.916345] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-01T18:47:28.969481] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-01T18:47:28.969552] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-01T18:47:28.970127] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-01T18:47:28.970192] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-01T18:47:28.970942] [DEBUG] [LOCAL ] ESE: Trimmed 22343 records to 16706 (keeping 200 days of data) [2025-10-01T18:47:29.078345] [DEBUG] [LOCAL ] ESE: Primary data saved (16706 records). [2025-10-01T18:47:29.078523] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-01T18:47:29.078686] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESE took 23.6s. Estimated remaining: 3h 44m 40s. Rate: 7.1 symbols/min [2025-10-01T18:47:29.258551] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:29.302140] [DEBUG] [LOCAL ] ESRT: Loaded 46441 existing records from primary storage. [2025-10-01T18:47:29.302481] [INFO ] [MAIN ] ESRT: Loaded 46441 existing records. [2025-10-01T18:47:29.495551] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:47:29.495823] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-01T18:47:29.495874] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-01T18:47:29.496255] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-01T18:47:29.496317] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-01T18:47:29.606075] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-01T18:47:29.621540] [INFO ] [REMOTE ] ESAB: Full fetch complete (35769 records). [2025-10-01T18:47:29.652259] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-01T18:47:29.707497] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-01T18:47:30.191000] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:30.318695] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-01T18:47:30.318852] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-01T18:47:30.319491] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-01T18:47:30.319688] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-01T18:47:30.320791] [DEBUG] [LOCAL ] ESAB: Trimmed 35769 records to 26110 (keeping 200 days of data) [2025-10-01T18:47:30.490766] [DEBUG] [LOCAL ] ESAB: Primary data saved (26110 records). [2025-10-01T18:47:30.490897] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-01T18:47:30.491003] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESAB took 26.7s. Estimated remaining: 3h 44m 17s. Rate: 7.1 symbols/min [2025-10-01T18:47:30.528016] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-01T18:47:30.704341] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:30.719539] [DEBUG] [LOCAL ] ESS: No existing data file found in primary storage. [2025-10-01T18:47:30.722394] [WARN ] [MAIN ] ESS: No existing data found, performing full refresh instead. [2025-10-01T18:47:30.722562] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-01T18:47:30.722858] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-01T18:47:30.723084] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-10-01T18:47:30.723411] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-01T18:47:30.724739] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T18:47:31.157779] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:31.180883] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T18:47:31.302387] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-01T18:47:32.102389] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-01T18:47:32.158409] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T18:47:32.567660] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T18:47:32.902416] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-01T18:47:33.435423] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T18:47:33.702403] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-01T18:47:34.441772] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T18:47:34.502354] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-01T18:47:35.141337] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T18:47:35.302382] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-01T18:47:35.684094] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T18:47:36.102401] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-01T18:47:36.912488] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-01T18:47:36.915156] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T18:47:37.470927] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T18:47:37.702384] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-01T18:47:37.907347] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T18:47:38.502391] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-01T18:47:38.785432] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T18:47:39.302370] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-01T18:47:39.850222] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T18:47:40.102411] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-01T18:47:40.796629] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T18:47:40.902358] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-01T18:47:41.709109] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-01T18:47:41.733162] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T18:47:42.249725] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T18:47:42.502381] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-01T18:47:43.302361] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-01T18:47:43.330528] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T18:47:43.712435] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T18:47:44.102396] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-01T18:47:44.902370] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-01T18:47:45.123080] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T18:47:45.702386] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-01T18:47:45.892987] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T18:47:46.090686] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T18:47:46.502382] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-01T18:47:47.159373] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T18:47:47.302369] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-01T18:47:47.519122] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T18:47:48.102386] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-01T18:47:48.841327] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T18:47:48.902398] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-01T18:47:49.516555] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T18:47:49.702393] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-01T18:47:50.237155] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T18:47:50.502378] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-01T18:47:51.302395] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-01T18:47:51.384937] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T18:47:51.477425] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T18:47:52.102387] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-01T18:47:52.349527] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T18:47:52.902375] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-01T18:47:53.520992] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T18:47:53.702384] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-01T18:47:54.502396] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-01T18:47:54.749902] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-01T18:47:54.751415] [INFO ] [REMOTE ] ESI: Full fetch complete (72612 records). [2025-10-01T18:47:54.751523] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-01T18:47:55.188514] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-01T18:47:55.188704] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-01T18:47:55.189597] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-01T18:47:55.189693] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-01T18:47:55.191309] [DEBUG] [LOCAL ] ESI: Trimmed 72612 records to 50725 (keeping 200 days of data) [2025-10-01T18:47:55.308311] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-01T18:47:55.331791] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T18:47:55.570878] [DEBUG] [LOCAL ] ESI: Primary data saved (50725 records). [2025-10-01T18:47:55.571043] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-01T18:47:55.571136] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESI took 48.4s. Estimated remaining: 3h 44m 43s. Rate: 7.1 symbols/min [2025-10-01T18:47:55.758974] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:55.806324] [DEBUG] [LOCAL ] ESTC: Loaded 49963 existing records from primary storage. [2025-10-01T18:47:55.806698] [INFO ] [MAIN ] ESTC: Loaded 49963 existing records. [2025-10-01T18:47:55.997163] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:47:55.997400] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-01T18:47:55.997451] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-01T18:47:55.997782] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-01T18:47:55.997871] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-01T18:47:56.109940] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-01T18:47:56.397133] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:56.422911] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-01T18:47:56.424279] [INFO ] [REMOTE ] ESNT: Full fetch complete (57114 records). [2025-10-01T18:47:56.424368] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-01T18:47:56.853038] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T18:47:56.879777] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-01T18:47:56.879855] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-01T18:47:56.881102] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-01T18:47:56.881171] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-01T18:47:56.882275] [DEBUG] [LOCAL ] ESNT: Trimmed 57114 records to 38358 (keeping 200 days of data) [2025-10-01T18:47:56.936358] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-01T18:47:57.131459] [DEBUG] [LOCAL ] ESNT: Primary data saved (38358 records). [2025-10-01T18:47:57.131720] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-01T18:47:57.131816] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESNT took 33.0s. Estimated remaining: 3h 44m 20s. Rate: 7.1 symbols/min [2025-10-01T18:47:57.329487] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:47:57.392149] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-01T18:47:57.392569] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-01T18:47:57.600081] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:47:57.600608] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-01T18:47:57.600724] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-01T18:47:57.601160] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-01T18:47:57.601239] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-01T18:47:57.705572] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-01T18:47:57.728437] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T18:47:58.030346] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:47:58.502363] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-01T18:47:58.810624] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T18:47:59.267876] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T18:47:59.302356] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-01T18:48:00.102382] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-01T18:48:00.709465] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-01T18:48:00.856084] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-01T18:48:00.857326] [INFO ] [REMOTE ] ESS: Full fetch complete (43423 records). [2025-10-01T18:48:00.857419] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-01T18:48:00.907478] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-01T18:48:01.320330] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-01T18:48:01.320415] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-01T18:48:01.321136] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-01T18:48:01.321202] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-01T18:48:01.322325] [DEBUG] [LOCAL ] ESS: Trimmed 43423 records to 29988 (keeping 200 days of data) [2025-10-01T18:48:01.534624] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T18:48:01.569040] [DEBUG] [LOCAL ] ESS: Primary data saved (29988 records). [2025-10-01T18:48:01.569244] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-01T18:48:01.569383] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESS took 31.1s. Estimated remaining: 3h 44m 4s. Rate: 7.1 symbols/min [2025-10-01T18:48:01.707470] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-01T18:48:01.779328] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:48:01.797093] [DEBUG] [LOCAL ] ETB: Loaded 12062 existing records from primary storage. [2025-10-01T18:48:01.797414] [INFO ] [MAIN ] ETB: Loaded 12062 existing records. [2025-10-01T18:48:02.022028] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:48:02.022299] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-01T18:48:02.022348] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-01T18:48:02.022588] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-01T18:48:02.022709] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-01T18:48:02.462149] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T18:48:02.505526] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:48:02.505597] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-01T18:48:03.302372] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-01T18:48:03.731737] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T18:48:04.080504] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T18:48:04.102338] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-01T18:48:04.902383] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-01T18:48:05.146604] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-01T18:48:05.148825] [INFO ] [REMOTE ] ESRT: Full fetch complete (66533 records). [2025-10-01T18:48:05.149045] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-01T18:48:05.604577] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-01T18:48:05.604737] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-01T18:48:05.605757] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-01T18:48:05.605830] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-01T18:48:05.607730] [DEBUG] [LOCAL ] ESRT: Trimmed 66533 records to 46454 (keeping 200 days of data) [2025-10-01T18:48:05.706268] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-01T18:48:05.879223] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T18:48:05.950221] [DEBUG] [LOCAL ] ESRT: Primary data saved (46454 records). [2025-10-01T18:48:05.950375] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-01T18:48:05.950482] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESRT took 36.9s. Estimated remaining: 3h 43m 47s. Rate: 7.1 symbols/min [2025-10-01T18:48:06.146301] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:48:06.175684] [DEBUG] [LOCAL ] ETD: Loaded 27384 existing records from primary storage. [2025-10-01T18:48:06.175958] [INFO ] [MAIN ] ETD: Loaded 27384 existing records. [2025-10-01T18:48:06.369443] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:48:06.369705] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-01T18:48:06.369767] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-01T18:48:06.370190] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-01T18:48:06.370284] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-01T18:48:06.507557] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-01T18:48:06.769827] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T18:48:06.815133] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:48:06.846243] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-01T18:48:07.302381] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-01T18:48:08.102419] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-01T18:48:08.407616] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T18:48:08.902443] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-01T18:48:09.377403] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:48:09.674331] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-01T18:48:09.702353] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-01T18:48:09.843216] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T18:48:10.502422] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-01T18:48:11.302444] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-01T18:48:11.664924] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T18:48:12.041317] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-01T18:48:12.102431] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-01T18:48:12.372108] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T18:48:12.902405] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-01T18:48:13.410203] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T18:48:13.702393] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-01T18:48:14.502448] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-01T18:48:14.874336] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-01T18:48:15.302362] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-01T18:48:15.358451] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T18:48:15.632092] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T18:48:16.102384] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-01T18:48:16.902400] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-01T18:48:17.070506] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T18:48:17.521637] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-01T18:48:17.702432] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-01T18:48:18.369789] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T18:48:18.502458] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-01T18:48:18.904078] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T18:48:19.258124] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T18:48:19.302355] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-01T18:48:19.891794] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T18:48:20.102384] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-01T18:48:20.902422] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-01T18:48:21.702404] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-01T18:48:21.986321] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T18:48:22.502426] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-01T18:48:23.071362] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T18:48:23.272450] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-01T18:48:23.302340] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-01T18:48:24.064044] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T18:48:24.102403] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-01T18:48:24.725614] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T18:48:24.902369] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-01T18:48:25.573540] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-01T18:48:25.595742] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-01T18:48:25.702418] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-01T18:48:26.502404] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-01T18:48:26.717726] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T18:48:27.229968] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T18:48:27.302416] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-01T18:48:27.863289] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T18:48:28.102405] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-01T18:48:28.902399] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-01T18:48:29.462575] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T18:48:29.702390] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-01T18:48:30.502412] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-01T18:48:31.178099] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-01T18:48:31.181459] [INFO ] [REMOTE ] ESTC: Full fetch complete (71988 records). [2025-10-01T18:48:31.181605] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-01T18:48:31.307537] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-01T18:48:31.645617] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-01T18:48:31.646014] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-01T18:48:31.647110] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-01T18:48:31.647202] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-01T18:48:31.648998] [DEBUG] [LOCAL ] ESTC: Trimmed 71988 records to 49968 (keeping 200 days of data) [2025-10-01T18:48:31.791125] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-01T18:48:31.836575] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T18:48:32.036181] [DEBUG] [LOCAL ] ESTC: Primary data saved (49968 records). [2025-10-01T18:48:32.036322] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-01T18:48:32.036422] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ESTC took 36.5s. Estimated remaining: 3h 44m 15s. Rate: 7.1 symbols/min [2025-10-01T18:48:32.107548] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-01T18:48:32.222699] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:48:32.225735] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-01T18:48:32.227152] [INFO ] [REMOTE ] ETB: Full fetch complete (18074 records). [2025-10-01T18:48:32.227234] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-01T18:48:32.400039] [DEBUG] [LOCAL ] ETG: Loaded 16446 existing records from primary storage. [2025-10-01T18:48:32.416221] [INFO ] [MAIN ] ETG: Loaded 16446 existing records. [2025-10-01T18:48:32.861299] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-01T18:48:32.867399] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-01T18:48:32.867299] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:48:32.867572] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-01T18:48:32.868214] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-01T18:48:32.868300] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-01T18:48:32.867674] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-01T18:48:32.868777] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-01T18:48:32.868902] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-01T18:48:32.910756] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-01T18:48:32.918825] [DEBUG] [LOCAL ] ETB: Trimmed 18074 records to 12077 (keeping 200 days of data) [2025-10-01T18:48:33.419919] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:48:33.428549] [DEBUG] [LOCAL ] ETB: Primary data saved (12077 records). [2025-10-01T18:48:33.428752] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-01T18:48:33.428879] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETB took 31.9s. Estimated remaining: 3h 43m 52s. Rate: 7.1 symbols/min [2025-10-01T18:48:33.617839] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:48:33.635440] [DEBUG] [LOCAL ] ETJ: Loaded 16740 existing records from primary storage. [2025-10-01T18:48:33.635708] [INFO ] [MAIN ] ETJ: Loaded 16740 existing records. [2025-10-01T18:48:33.713066] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-01T18:48:33.855468] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:48:33.855741] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-01T18:48:33.855803] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-01T18:48:33.856081] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-01T18:48:33.856141] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-01T18:48:34.235574] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:48:34.287272] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T18:48:34.502370] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-01T18:48:34.569162] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T18:48:35.277295] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-01T18:48:35.279347] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-01T18:48:35.279486] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-01T18:48:35.307596] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-01T18:48:35.657284] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T18:48:35.754799] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-01T18:48:35.754901] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-01T18:48:35.756000] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-01T18:48:35.756066] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-01T18:48:35.757858] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-10-01T18:48:36.103406] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-01T18:48:36.122942] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-01T18:48:36.123165] [INFO ] [MAIN ] ET: Full history saved. [2025-10-01T18:48:36.123279] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ET took 39.0s. Estimated remaining: 3h 43m 32s. Rate: 7.1 symbols/min [2025-10-01T18:48:36.319673] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:48:36.379281] [DEBUG] [LOCAL ] ETN: Loaded 52783 existing records from primary storage. [2025-10-01T18:48:36.379674] [INFO ] [MAIN ] ETN: Loaded 52783 existing records. [2025-10-01T18:48:36.539445] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T18:48:36.621785] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:48:36.622019] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-01T18:48:36.622072] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-01T18:48:36.622364] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-01T18:48:36.622444] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-01T18:48:36.907588] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-01T18:48:37.030032] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:48:37.482758] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T18:48:37.483995] [INFO ] [REMOTE ] ETD: Full fetch complete (38398 records). [2025-10-01T18:48:37.484079] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-01T18:48:37.706768] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-01T18:48:37.759388] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T18:48:37.927305] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-01T18:48:37.927389] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-01T18:48:37.928030] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-01T18:48:37.928094] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-01T18:48:37.929274] [DEBUG] [LOCAL ] ETD: Trimmed 38398 records to 27426 (keeping 200 days of data) [2025-10-01T18:48:38.102954] [DEBUG] [LOCAL ] ETD: Primary data saved (27426 records). [2025-10-01T18:48:38.103089] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-01T18:48:38.103171] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETD took 32.2s. Estimated remaining: 3h 43m 10s. Rate: 7.1 symbols/min [2025-10-01T18:48:38.309202] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:48:38.320008] [DEBUG] [LOCAL ] ETO: Loaded 6485 existing records from primary storage. [2025-10-01T18:48:38.320233] [INFO ] [MAIN ] ETO: Loaded 6485 existing records. [2025-10-01T18:48:38.508192] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-01T18:48:38.535680] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:48:38.537572] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-01T18:48:38.537764] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-01T18:48:38.538137] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-01T18:48:38.538209] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-01T18:48:38.686099] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T18:48:38.976333] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:48:39.302403] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-01T18:48:39.911320] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T18:48:40.102354] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-01T18:48:40.565581] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T18:48:40.829070] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T18:48:40.902404] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-01T18:48:41.515222] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T18:48:41.702409] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-01T18:48:42.502375] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-01T18:48:42.712551] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T18:48:43.302366] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-01T18:48:43.549964] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T18:48:44.102406] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-01T18:48:44.902371] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-01T18:48:45.184525] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T18:48:45.269274] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-01T18:48:45.702371] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-01T18:48:45.930139] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T18:48:46.502384] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-01T18:48:46.704574] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T18:48:47.302395] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-01T18:48:48.003158] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-01T18:48:48.102383] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-01T18:48:48.309874] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T18:48:48.902349] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-01T18:48:48.980860] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T18:48:49.702356] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-01T18:48:49.732848] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T18:48:50.442929] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T18:48:50.502360] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-01T18:48:51.302399] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-01T18:48:52.102400] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-01T18:48:52.385776] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T18:48:52.678831] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-01T18:48:52.902389] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-01T18:48:53.088739] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T18:48:53.461027] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T18:48:53.702398] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-01T18:48:54.435678] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T18:48:54.502378] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-01T18:48:55.302349] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-01T18:48:55.370476] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T18:48:56.102374] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-01T18:48:56.301382] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T18:48:56.902381] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-01T18:48:57.671234] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T18:48:57.702361] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-01T18:48:58.004837] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T18:48:58.350025] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T18:48:58.502378] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-01T18:48:59.230827] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-01T18:48:59.302376] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-01T18:49:00.102379] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-01T18:49:00.902365] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-01T18:49:00.988862] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T18:49:01.036479] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T18:49:01.413463] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T18:49:01.702376] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-01T18:49:02.502402] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-01T18:49:03.302389] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-01T18:49:03.660383] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T18:49:03.668687] [INFO ] [REMOTE ] ETG: Full fetch complete (24801 records). [2025-10-01T18:49:03.671695] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-01T18:49:03.682832] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-01T18:49:03.859094] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T18:49:04.107998] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-01T18:49:04.318507] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-01T18:49:04.318619] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-01T18:49:04.319703] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-01T18:49:04.319785] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-01T18:49:04.320750] [DEBUG] [LOCAL ] ETG: Trimmed 24801 records to 16472 (keeping 200 days of data) [2025-10-01T18:49:04.455603] [DEBUG] [LOCAL ] ETG: Primary data saved (16472 records). [2025-10-01T18:49:04.455825] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-01T18:49:04.455953] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETG took 32.4s. Estimated remaining: 3h 43m 39s. Rate: 7.1 symbols/min [2025-10-01T18:49:04.687017] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:04.745269] [DEBUG] [LOCAL ] ETR: Loaded 53225 existing records from primary storage. [2025-10-01T18:49:04.745865] [INFO ] [MAIN ] ETR: Loaded 53225 existing records. [2025-10-01T18:49:04.916023] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-01T18:49:04.963191] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:04.963470] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-01T18:49:04.963522] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-01T18:49:04.963799] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-01T18:49:04.963861] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-01T18:49:05.170317] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T18:49:05.377319] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:05.702402] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-01T18:49:06.502442] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-01T18:49:06.933605] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T18:49:07.302369] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-01T18:49:07.419313] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T18:49:07.498560] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T18:49:08.102367] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-01T18:49:08.144698] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-01T18:49:08.145513] [INFO ] [REMOTE ] ETO: Full fetch complete (9380 records). [2025-10-01T18:49:08.145590] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-01T18:49:08.543036] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-01T18:49:08.543135] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-01T18:49:08.543430] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-01T18:49:08.543495] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-01T18:49:08.543972] [DEBUG] [LOCAL ] ETO: Trimmed 9380 records to 6515 (keeping 200 days of data) [2025-10-01T18:49:08.584856] [DEBUG] [LOCAL ] ETO: Primary data saved (6515 records). [2025-10-01T18:49:08.584988] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-01T18:49:08.585075] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETO took 30.5s. Estimated remaining: 3h 43m 22s. Rate: 7.1 symbols/min [2025-10-01T18:49:08.766907] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:08.789902] [DEBUG] [LOCAL ] ETV: Loaded 21445 existing records from primary storage. [2025-10-01T18:49:08.790159] [INFO ] [MAIN ] ETV: Loaded 21445 existing records. [2025-10-01T18:49:08.907532] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-01T18:49:08.989984] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:08.990195] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-01T18:49:08.990246] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-01T18:49:08.990465] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-01T18:49:08.990526] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-01T18:49:09.380947] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:09.702371] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-01T18:49:09.814023] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T18:49:10.080040] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T18:49:10.081378] [INFO ] [REMOTE ] ETJ: Full fetch complete (25411 records). [2025-10-01T18:49:10.081503] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-01T18:49:10.484794] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-01T18:49:10.484883] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-01T18:49:10.485464] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-01T18:49:10.485573] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-01T18:49:10.486428] [DEBUG] [LOCAL ] ETJ: Trimmed 25411 records to 16671 (keeping 200 days of data) [2025-10-01T18:49:10.529486] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-01T18:49:10.592365] [DEBUG] [LOCAL ] ETJ: Primary data saved (16671 records). [2025-10-01T18:49:10.592551] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-01T18:49:10.592731] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETJ took 37.2s. Estimated remaining: 3h 43m 0s. Rate: 7.1 symbols/min [2025-10-01T18:49:10.781996] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:10.807514] [DEBUG] [LOCAL ] ETW: Loaded 25073 existing records from primary storage. [2025-10-01T18:49:10.807838] [INFO ] [MAIN ] ETW: Loaded 25073 existing records. [2025-10-01T18:49:10.974735] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T18:49:11.022783] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:11.023016] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-01T18:49:11.023065] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-01T18:49:11.023273] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-01T18:49:11.023332] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-01T18:49:11.307457] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-01T18:49:11.421872] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:12.102436] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-01T18:49:12.646378] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T18:49:12.747065] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-01T18:49:12.902428] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-01T18:49:13.264472] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T18:49:13.702368] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-01T18:49:13.899501] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T18:49:14.502437] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-01T18:49:15.032096] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T18:49:15.302393] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-01T18:49:15.610621] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T18:49:16.102398] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-01T18:49:16.359366] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T18:49:16.902418] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-01T18:49:17.702353] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-01T18:49:17.924408] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T18:49:18.500305] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T18:49:18.506573] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-01T18:49:18.618379] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T18:49:19.302426] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-01T18:49:20.102367] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-01T18:49:20.902372] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-01T18:49:20.991460] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T18:49:21.025999] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T18:49:21.119600] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-01T18:49:21.121123] [INFO ] [REMOTE ] ETN: Full fetch complete (76553 records). [2025-10-01T18:49:21.121236] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-01T18:49:21.555255] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-01T18:49:21.555343] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-01T18:49:21.556272] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-01T18:49:21.556340] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-01T18:49:21.557866] [DEBUG] [LOCAL ] ETN: Trimmed 76553 records to 52758 (keeping 200 days of data) [2025-10-01T18:49:21.750602] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-01T18:49:21.910486] [DEBUG] [LOCAL ] ETN: Primary data saved (52758 records). [2025-10-01T18:49:21.910633] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-01T18:49:21.910754] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 45.8s. Estimated remaining: 3h 42m 58s. Rate: 7.1 symbols/min [2025-10-01T18:49:22.113528] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:22.114895] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T18:49:22.128496] [DEBUG] [LOCAL ] ETX: Loaded 5053 existing records from primary storage. [2025-10-01T18:49:22.128750] [INFO ] [MAIN ] ETX: Loaded 5053 existing records. [2025-10-01T18:49:22.347733] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:22.348375] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-01T18:49:22.348437] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-01T18:49:22.348710] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-01T18:49:22.348772] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-01T18:49:22.510528] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-01T18:49:22.730273] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:23.302362] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-01T18:49:23.603843] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T18:49:23.655576] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T18:49:23.914871] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T18:49:24.102395] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-01T18:49:24.663585] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T18:49:24.902384] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-01T18:49:25.702389] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-01T18:49:26.261712] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T18:49:26.402870] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T18:49:26.502403] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-01T18:49:27.302376] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-01T18:49:27.537531] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T18:49:28.102381] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-01T18:49:28.341140] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T18:49:28.902347] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-01T18:49:28.920600] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T18:49:29.374907] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T18:49:29.702409] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-01T18:49:30.502383] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-01T18:49:30.822319] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T18:49:31.047262] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-01T18:49:31.302380] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-01T18:49:31.861029] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-01T18:49:32.102393] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-01T18:49:32.809925] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T18:49:32.902395] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-01T18:49:33.702384] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-01T18:49:33.930321] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T18:49:34.502374] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-01T18:49:34.667228] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T18:49:35.302390] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-01T18:49:35.855740] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T18:49:36.102386] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-01T18:49:36.175548] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T18:49:36.902374] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-01T18:49:37.314994] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T18:49:37.316141] [INFO ] [REMOTE ] ETV: Full fetch complete (32004 records). [2025-10-01T18:49:37.316249] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-01T18:49:37.708594] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-01T18:49:37.754046] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-01T18:49:37.754151] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-01T18:49:37.754816] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-01T18:49:37.754882] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-01T18:49:37.755879] [DEBUG] [LOCAL ] ETV: Trimmed 32004 records to 21526 (keeping 200 days of data) [2025-10-01T18:49:37.925230] [DEBUG] [LOCAL ] ETV: Primary data saved (21526 records). [2025-10-01T18:49:37.925398] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-01T18:49:37.925542] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETV took 29.3s. Estimated remaining: 3h 43m 5s. Rate: 7.1 symbols/min [2025-10-01T18:49:38.181068] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:38.205965] [DEBUG] [LOCAL ] ETY: Loaded 22683 existing records from primary storage. [2025-10-01T18:49:38.206266] [INFO ] [MAIN ] ETY: Loaded 22683 existing records. [2025-10-01T18:49:38.401670] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:38.401878] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-01T18:49:38.401925] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-01T18:49:38.402205] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-01T18:49:38.402264] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-01T18:49:38.505539] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-01T18:49:38.822359] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:38.856417] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T18:49:38.890674] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T18:49:39.073964] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T18:49:39.302384] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-01T18:49:40.102403] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-01T18:49:40.477637] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T18:49:40.902381] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-01T18:49:41.593999] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-01T18:49:41.702376] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-01T18:49:41.826226] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T18:49:42.442947] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-01T18:49:42.443782] [INFO ] [REMOTE ] ETX: Full fetch complete (7087 records). [2025-10-01T18:49:42.443853] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-01T18:49:42.509434] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-01T18:49:42.829023] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-01T18:49:42.829099] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-01T18:49:42.829285] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-01T18:49:42.829386] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-01T18:49:42.829828] [DEBUG] [LOCAL ] ETX: Trimmed 7087 records to 5134 (keeping 200 days of data) [2025-10-01T18:49:42.862562] [DEBUG] [LOCAL ] ETX: Primary data saved (5134 records). [2025-10-01T18:49:42.862699] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-01T18:49:42.862791] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETX took 21.0s. Estimated remaining: 3h 42m 49s. Rate: 7.1 symbols/min [2025-10-01T18:49:43.047134] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:43.065590] [DEBUG] [LOCAL ] EVC: Loaded 18717 existing records from primary storage. [2025-10-01T18:49:43.065882] [INFO ] [MAIN ] EVC: Loaded 18717 existing records. [2025-10-01T18:49:43.256292] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:43.256554] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-01T18:49:43.256606] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-01T18:49:43.256844] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-01T18:49:43.256904] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-01T18:49:43.307481] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-01T18:49:43.669118] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:44.102406] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-01T18:49:44.459663] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T18:49:44.812759] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T18:49:44.813948] [INFO ] [REMOTE ] ETW: Full fetch complete (36401 records). [2025-10-01T18:49:44.814029] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-01T18:49:44.907469] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-01T18:49:45.221849] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-01T18:49:45.221927] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-01T18:49:45.222510] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-01T18:49:45.222551] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-01T18:49:45.223325] [DEBUG] [LOCAL ] ETW: Trimmed 36401 records to 25087 (keeping 200 days of data) [2025-10-01T18:49:45.383062] [DEBUG] [LOCAL ] ETW: Primary data saved (25087 records). [2025-10-01T18:49:45.383212] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-01T18:49:45.383299] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETW took 34.8s. Estimated remaining: 3h 42m 29s. Rate: 7.1 symbols/min [2025-10-01T18:49:45.573884] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:45.585842] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T18:49:45.623670] [DEBUG] [LOCAL ] EVEX: Loaded 30362 existing records from primary storage. [2025-10-01T18:49:45.623998] [INFO ] [MAIN ] EVEX: Loaded 30362 existing records. [2025-10-01T18:49:45.707536] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-01T18:49:45.822103] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:45.822611] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-01T18:49:45.822744] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-01T18:49:45.822979] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-01T18:49:45.823039] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-01T18:49:46.197502] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T18:49:46.235402] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:46.502392] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-01T18:49:47.000693] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T18:49:47.302379] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-01T18:49:47.499165] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T18:49:48.102374] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-01T18:49:48.455514] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T18:49:48.902371] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-01T18:49:49.184946] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T18:49:49.702382] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-01T18:49:49.814237] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T18:49:50.502380] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-01T18:49:51.302384] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-01T18:49:51.466322] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T18:49:51.493796] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T18:49:52.102345] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-01T18:49:52.337442] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T18:49:52.902378] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-01T18:49:53.424557] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T18:49:53.702419] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-01T18:49:54.502383] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-01T18:49:54.926710] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T18:49:55.302394] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-01T18:49:55.338435] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-01T18:49:55.340017] [INFO ] [REMOTE ] ETR: Full fetch complete (77069 records). [2025-10-01T18:49:55.340135] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-01T18:49:55.917743] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-01T18:49:55.917925] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-01T18:49:55.919876] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-01T18:49:55.920016] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-01T18:49:55.916552] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T18:49:55.931987] [DEBUG] [LOCAL ] ETR: Trimmed 77069 records to 53225 (keeping 200 days of data) [2025-10-01T18:49:56.102514] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-01T18:49:56.312318] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T18:49:56.466834] [DEBUG] [LOCAL ] ETR: Primary data saved (53225 records). [2025-10-01T18:49:56.467071] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-01T18:49:56.467202] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETR took 52.0s. Estimated remaining: 3h 42m 26s. Rate: 7.1 symbols/min [2025-10-01T18:49:56.681258] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:49:56.693438] [DEBUG] [LOCAL ] EVF: Loaded 9402 existing records from primary storage. [2025-10-01T18:49:56.693731] [INFO ] [MAIN ] EVF: Loaded 9402 existing records. [2025-10-01T18:49:56.902437] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:49:56.902588] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-01T18:49:56.904004] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-01T18:49:56.904079] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-01T18:49:56.904312] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-01T18:49:56.904371] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-01T18:49:57.322896] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:49:57.338821] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T18:49:57.702406] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-01T18:49:58.092338] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T18:49:58.186728] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-01T18:49:58.502390] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-01T18:49:59.103864] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T18:49:59.302430] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-01T18:49:59.903815] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T18:50:00.102406] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-01T18:50:00.902748] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-01T18:50:01.372362] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T18:50:01.654369] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T18:50:01.702379] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-01T18:50:02.502384] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-01T18:50:02.531882] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T18:50:03.302398] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-01T18:50:03.384285] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T18:50:04.102379] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-01T18:50:04.532011] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T18:50:04.902358] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-01T18:50:05.150782] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T18:50:05.702383] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-01T18:50:05.838853] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T18:50:06.502431] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-01T18:50:06.758168] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T18:50:07.302365] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-01T18:50:07.615416] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T18:50:07.977674] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T18:50:08.102421] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-01T18:50:08.667391] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T18:50:08.902449] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-01T18:50:09.702411] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-01T18:50:09.943928] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T18:50:10.502382] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-01T18:50:10.877139] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T18:50:11.138910] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-01T18:50:11.302412] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-01T18:50:12.102396] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-01T18:50:12.356720] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T18:50:12.537579] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-01T18:50:12.902438] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-01T18:50:13.453805] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T18:50:13.702381] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-01T18:50:14.502387] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-01T18:50:14.648812] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-01T18:50:14.649691] [INFO ] [REMOTE ] EVF: Full fetch complete (12198 records). [2025-10-01T18:50:14.649771] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-01T18:50:15.065458] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-01T18:50:15.065546] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-01T18:50:15.066004] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-01T18:50:15.066094] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-01T18:50:15.066741] [DEBUG] [LOCAL ] EVF: Trimmed 12198 records to 9403 (keeping 200 days of data) [2025-10-01T18:50:15.128616] [DEBUG] [LOCAL ] EVF: Primary data saved (9403 records). [2025-10-01T18:50:15.128792] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-01T18:50:15.128916] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. EVF took 18.7s. Estimated remaining: 3h 42m 38s. Rate: 7.1 symbols/min [2025-10-01T18:50:15.302604] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-01T18:50:15.321820] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:50:15.332244] [DEBUG] [LOCAL ] EVG: Loaded 5828 existing records from primary storage. [2025-10-01T18:50:15.332463] [INFO ] [MAIN ] EVG: Loaded 5828 existing records. [2025-10-01T18:50:15.536104] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:50:15.536335] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-01T18:50:15.536398] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-01T18:50:15.536597] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-01T18:50:15.536695] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-01T18:50:15.955340] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:50:16.021480] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T18:50:16.102387] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-01T18:50:16.528539] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T18:50:16.902361] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-01T18:50:17.390494] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-01T18:50:17.391916] [INFO ] [REMOTE ] ETY: Full fetch complete (34248 records). [2025-10-01T18:50:17.392070] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-01T18:50:17.616728] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-01T18:50:17.707445] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-01T18:50:17.889279] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-01T18:50:17.889371] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-01T18:50:17.890092] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-01T18:50:17.890161] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-01T18:50:17.891174] [DEBUG] [LOCAL ] ETY: Trimmed 34248 records to 22753 (keeping 200 days of data) [2025-10-01T18:50:18.041751] [DEBUG] [LOCAL ] ETY: Primary data saved (22753 records). [2025-10-01T18:50:18.041887] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-01T18:50:18.042020] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. ETY took 40.1s. Estimated remaining: 3h 42m 19s. Rate: 7.1 symbols/min [2025-10-01T18:50:18.239448] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:50:18.287476] [DEBUG] [LOCAL ] EVH: Loaded 49371 existing records from primary storage. [2025-10-01T18:50:18.288005] [INFO ] [MAIN ] EVH: Loaded 49371 existing records. [2025-10-01T18:50:18.489937] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:50:18.490172] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-01T18:50:18.490222] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-01T18:50:18.490488] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-01T18:50:18.490547] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-01T18:50:18.507490] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-01T18:50:18.914734] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:50:19.302439] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-01T18:50:19.420260] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T18:50:19.449613] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T18:50:20.102379] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-01T18:50:20.902439] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-01T18:50:21.252032] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-01T18:50:21.444125] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T18:50:21.535624] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T18:50:21.702386] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-01T18:50:22.150280] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T18:50:22.502420] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-01T18:50:23.302403] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-01T18:50:23.512254] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T18:50:24.027057] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T18:50:24.102402] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-01T18:50:24.902437] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-01T18:50:25.281887] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T18:50:25.282833] [INFO ] [REMOTE ] EVC: Full fetch complete (30336 records). [2025-10-01T18:50:25.282913] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-01T18:50:25.702508] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-01T18:50:25.702918] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-01T18:50:25.704156] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-01T18:50:25.704879] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-01T18:50:25.704946] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-01T18:50:25.705884] [DEBUG] [LOCAL ] EVC: Trimmed 30336 records to 18618 (keeping 200 days of data) [2025-10-01T18:50:25.821372] [DEBUG] [LOCAL ] EVC: Primary data saved (18618 records). [2025-10-01T18:50:25.821517] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-01T18:50:25.821613] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVC took 43.0s. Estimated remaining: 3h 42m 9s. Rate: 7.1 symbols/min [2025-10-01T18:50:26.023235] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:50:26.023406] [DEBUG] [LOCAL ] EVN: No existing data file found in primary storage. [2025-10-01T18:50:26.023446] [WARN ] [MAIN ] EVN: No existing data found, performing full refresh instead. [2025-10-01T18:50:26.023601] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-01T18:50:26.023676] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-01T18:50:26.023757] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-10-01T18:50:26.023824] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-01T18:50:26.439751] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:50:26.441352] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T18:50:26.507551] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-01T18:50:26.520512] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T18:50:27.302403] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-01T18:50:28.102394] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-01T18:50:28.221060] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T18:50:28.760449] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T18:50:28.765680] [INFO ] [REMOTE ] EVEX: Full fetch complete (42014 records). [2025-10-01T18:50:28.766380] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T18:50:28.766513] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-01T18:50:28.907755] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-01T18:50:29.186568] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-01T18:50:29.186676] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-01T18:50:29.187442] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-01T18:50:29.187506] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-01T18:50:29.188596] [DEBUG] [LOCAL ] EVEX: Trimmed 42014 records to 30504 (keeping 200 days of data) [2025-10-01T18:50:29.365227] [DEBUG] [LOCAL ] EVEX: Primary data saved (30504 records). [2025-10-01T18:50:29.365371] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-01T18:50:29.365496] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVEX took 44.0s. Estimated remaining: 3h 41m 51s. Rate: 7.1 symbols/min [2025-10-01T18:50:29.549130] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:50:29.592170] [DEBUG] [LOCAL ] EVR: Loaded 35004 existing records from primary storage. [2025-10-01T18:50:29.592466] [INFO ] [MAIN ] EVR: Loaded 35004 existing records. [2025-10-01T18:50:29.707534] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-01T18:50:29.785592] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:50:29.785899] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-01T18:50:29.785984] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-01T18:50:29.786303] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-01T18:50:29.786362] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-01T18:50:30.173997] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:50:30.378441] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T18:50:30.502346] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-01T18:50:30.536060] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T18:50:31.074243] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T18:50:31.302459] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-01T18:50:32.102429] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-01T18:50:32.902386] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-01T18:50:32.970709] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T18:50:33.081744] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T18:50:33.702393] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-01T18:50:34.066723] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T18:50:34.492875] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T18:50:34.502337] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-01T18:50:35.302360] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-01T18:50:35.403424] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T18:50:36.102390] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-01T18:50:36.781330] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:50:36.902396] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-01T18:50:36.965022] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T18:50:37.342544] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T18:50:37.702399] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-01T18:50:38.502405] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-01T18:50:39.307490] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-01T18:50:39.324742] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T18:50:39.935423] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T18:50:39.942962] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T18:50:40.102401] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-01T18:50:40.902387] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-01T18:50:41.649818] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T18:50:41.702370] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-01T18:50:42.451309] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T18:50:42.502348] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-01T18:50:43.243405] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T18:50:43.302410] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-01T18:50:44.102388] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-01T18:50:44.178917] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T18:50:44.619907] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T18:50:44.817235] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T18:50:44.902381] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-01T18:50:45.702379] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-01T18:50:46.394286] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T18:50:46.502521] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-01T18:50:46.504610] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T18:50:47.302372] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-01T18:50:47.459527] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T18:50:47.460409] [INFO ] [REMOTE ] EVG: Full fetch complete (8232 records). [2025-10-01T18:50:47.460478] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-01T18:50:47.871930] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-01T18:50:47.872026] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-01T18:50:47.872354] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-01T18:50:47.872421] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-01T18:50:47.873227] [DEBUG] [LOCAL ] EVG: Trimmed 8232 records to 5952 (keeping 200 days of data) [2025-10-01T18:50:47.917505] [DEBUG] [LOCAL ] EVG: Primary data saved (5952 records). [2025-10-01T18:50:47.917676] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-01T18:50:47.917840] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVG took 32.8s. Estimated remaining: 3h 42m 3s. Rate: 7.1 symbols/min [2025-10-01T18:50:48.108634] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-01T18:50:48.146052] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:50:48.146508] [DEBUG] [LOCAL ] EVT: No existing data file found in primary storage. [2025-10-01T18:50:48.146670] [WARN ] [MAIN ] EVT: No existing data found, performing full refresh instead. [2025-10-01T18:50:48.146819] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-01T18:50:48.146872] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-01T18:50:48.146918] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-10-01T18:50:48.146950] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-01T18:50:48.327357] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T18:50:48.551755] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:50:48.902386] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-01T18:50:49.702425] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-01T18:50:49.828669] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T18:50:49.916068] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T18:50:50.334924] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T18:50:50.502375] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-01T18:50:51.302378] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-01T18:50:52.099416] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T18:50:52.109528] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-01T18:50:52.327693] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T18:50:52.902406] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-01T18:50:53.702379] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-01T18:50:53.804945] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T18:50:53.950481] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T18:50:53.951407] [INFO ] [REMOTE ] EVN: Full fetch complete (17791 records). [2025-10-01T18:50:53.951479] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-01T18:50:54.367951] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-01T18:50:54.368034] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-01T18:50:54.368551] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-01T18:50:54.369048] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-01T18:50:54.369822] [DEBUG] [LOCAL ] EVN: Trimmed 17791 records to 11144 (keeping 200 days of data) [2025-10-01T18:50:54.449434] [DEBUG] [LOCAL ] EVN: Primary data saved (11144 records). [2025-10-01T18:50:54.449699] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-01T18:50:54.449795] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVN took 28.6s. Estimated remaining: 3h 41m 50s. Rate: 7.1 symbols/min [2025-10-01T18:50:54.513020] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-01T18:50:54.651107] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:50:54.680589] [DEBUG] [LOCAL ] EVTC: Loaded 26224 existing records from primary storage. [2025-10-01T18:50:54.680998] [INFO ] [MAIN ] EVTC: Loaded 26224 existing records. [2025-10-01T18:50:54.850913] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T18:50:54.920289] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:50:54.920526] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-01T18:50:54.920576] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-01T18:50:54.920914] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-01T18:50:54.920976] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-01T18:50:55.304094] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-01T18:50:55.327166] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:50:56.102391] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-01T18:50:56.277337] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T18:50:56.813102] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T18:50:56.815082] [INFO ] [REMOTE ] EVH: Full fetch complete (71790 records). [2025-10-01T18:50:56.815190] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-01T18:50:56.907579] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-01T18:50:57.256932] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-01T18:50:57.257026] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-01T18:50:57.258151] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-01T18:50:57.258220] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-01T18:50:57.259675] [DEBUG] [LOCAL ] EVH: Trimmed 71790 records to 49369 (keeping 200 days of data) [2025-10-01T18:50:57.571434] [DEBUG] [LOCAL ] EVH: Primary data saved (49369 records). [2025-10-01T18:50:57.571587] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-01T18:50:57.571735] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 39.5s. Estimated remaining: 3h 41m 31s. Rate: 7.1 symbols/min [2025-10-01T18:50:57.689794] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T18:50:57.711638] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-01T18:50:57.809289] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:50:57.823418] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T18:50:57.862617] [DEBUG] [LOCAL ] EVTL: Loaded 38020 existing records from primary storage. [2025-10-01T18:50:57.862960] [INFO ] [MAIN ] EVTL: Loaded 38020 existing records. [2025-10-01T18:50:58.054161] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:50:58.054373] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-01T18:50:58.054421] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-01T18:50:58.054740] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-01T18:50:58.054800] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-01T18:50:58.451720] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:50:58.502358] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-01T18:50:58.898839] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T18:50:59.302383] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-01T18:51:00.057761] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T18:51:00.102360] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-01T18:51:00.301696] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T18:51:00.902424] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-01T18:51:01.312776] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T18:51:01.702389] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-01T18:51:02.502428] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-01T18:51:02.703399] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T18:51:02.704862] [INFO ] [REMOTE ] EVR: Full fetch complete (50796 records). [2025-10-01T18:51:02.704965] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-01T18:51:02.897096] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T18:51:03.157043] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-01T18:51:03.157128] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-01T18:51:03.157949] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-01T18:51:03.158014] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-01T18:51:03.159202] [DEBUG] [LOCAL ] EVR: Trimmed 50796 records to 34906 (keeping 200 days of data) [2025-10-01T18:51:03.302972] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-01T18:51:03.418443] [DEBUG] [LOCAL ] EVR: Primary data saved (34906 records). [2025-10-01T18:51:03.418638] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-01T18:51:03.418809] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 34.1s. Estimated remaining: 3h 41m 18s. Rate: 7.1 symbols/min [2025-10-01T18:51:03.629462] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:51:03.629687] [DEBUG] [LOCAL ] EVTR: No existing data file found in primary storage. [2025-10-01T18:51:03.629745] [WARN ] [MAIN ] EVTR: No existing data found, performing full refresh instead. [2025-10-01T18:51:03.629862] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-01T18:51:03.629907] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-01T18:51:03.629956] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-10-01T18:51:03.629991] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-01T18:51:04.045468] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:51:04.069612] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T18:51:04.102439] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-01T18:51:04.401042] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T18:51:04.902452] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-01T18:51:05.240003] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T18:51:05.702369] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-01T18:51:06.407545] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T18:51:06.502430] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-01T18:51:06.759637] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T18:51:07.302351] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-01T18:51:07.471769] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T18:51:08.102358] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-01T18:51:08.257395] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T18:51:08.844948] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T18:51:08.902421] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-01T18:51:09.702380] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-01T18:51:10.398792] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T18:51:10.502385] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-01T18:51:10.644742] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T18:51:11.302362] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-01T18:51:11.460086] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T18:51:12.102455] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-01T18:51:12.291712] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T18:51:12.902384] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-01T18:51:13.063404] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T18:51:13.702415] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-01T18:51:14.155789] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T18:51:14.502379] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-01T18:51:15.146694] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T18:51:15.302373] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-01T18:51:15.346440] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T18:51:16.102386] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-01T18:51:16.714002] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T18:51:16.902427] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-01T18:51:16.925893] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T18:51:17.702391] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-01T18:51:18.502361] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-01T18:51:18.682889] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T18:51:18.937434] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-01T18:51:19.302423] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-01T18:51:19.604230] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T18:51:20.102442] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-01T18:51:20.349361] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T18:51:20.350579] [INFO ] [REMOTE ] EVT: Full fetch complete (25313 records). [2025-10-01T18:51:20.350727] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-01T18:51:20.767772] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-01T18:51:20.767911] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-01T18:51:20.769016] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-01T18:51:20.769082] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-01T18:51:20.769971] [DEBUG] [LOCAL ] EVT: Trimmed 25313 records to 16951 (keeping 200 days of data) [2025-10-01T18:51:20.894463] [DEBUG] [LOCAL ] EVT: Primary data saved (16951 records). [2025-10-01T18:51:20.894700] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-01T18:51:20.894808] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 33.0s. Estimated remaining: 3h 41m 28s. Rate: 7.1 symbols/min [2025-10-01T18:51:20.908829] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-01T18:51:21.045402] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T18:51:21.106852] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:51:21.169556] [DEBUG] [LOCAL ] EW: Loaded 53400 existing records from primary storage. [2025-10-01T18:51:21.169942] [INFO ] [MAIN ] EW: Loaded 53400 existing records. [2025-10-01T18:51:21.363418] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:51:21.363667] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-01T18:51:21.363738] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-01T18:51:21.364083] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-01T18:51:21.364144] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-01T18:51:21.715148] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-01T18:51:21.761681] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:51:22.502394] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-01T18:51:22.748376] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T18:51:22.923710] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T18:51:23.302392] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-01T18:51:24.102360] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-01T18:51:24.288996] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T18:51:24.758399] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T18:51:24.784757] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T18:51:24.902412] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-01T18:51:25.702384] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-01T18:51:26.502397] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-01T18:51:26.690771] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T18:51:27.302365] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-01T18:51:27.578866] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T18:51:28.102342] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-01T18:51:28.262161] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-01T18:51:28.264620] [INFO ] [REMOTE ] EVTL: Full fetch complete (51842 records). [2025-10-01T18:51:28.264848] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-01T18:51:28.506694] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T18:51:28.752723] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-01T18:51:28.752831] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-01T18:51:28.753696] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-01T18:51:28.753768] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-01T18:51:28.755069] [DEBUG] [LOCAL ] EVTL: Trimmed 51842 records to 38254 (keeping 200 days of data) [2025-10-01T18:51:28.917051] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-01T18:51:28.984162] [DEBUG] [LOCAL ] EVTL: Primary data saved (38254 records). [2025-10-01T18:51:28.984308] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-01T18:51:28.984395] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTL took 31.4s. Estimated remaining: 3h 41m 19s. Rate: 7.1 symbols/min [2025-10-01T18:51:29.168763] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:51:29.203314] [DEBUG] [LOCAL ] EXG: Loaded 34116 existing records from primary storage. [2025-10-01T18:51:29.203614] [INFO ] [MAIN ] EXG: Loaded 34116 existing records. [2025-10-01T18:51:29.399921] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:51:29.400334] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-01T18:51:29.400391] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-01T18:51:29.400634] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-01T18:51:29.400727] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-01T18:51:29.706329] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-01T18:51:29.833727] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:51:29.868293] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T18:51:30.026919] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T18:51:30.502356] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-01T18:51:30.533296] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T18:51:31.302367] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-01T18:51:32.102410] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-01T18:51:32.586876] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-01T18:51:32.634155] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T18:51:32.902356] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-01T18:51:33.217912] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T18:51:33.702384] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-01T18:51:34.502412] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-01T18:51:34.779059] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T18:51:35.074186] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T18:51:35.302385] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-01T18:51:35.870945] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-01T18:51:35.872472] [INFO ] [REMOTE ] EVTC: Full fetch complete (37915 records). [2025-10-01T18:51:35.872545] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-01T18:51:36.111741] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-01T18:51:36.310494] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-01T18:51:36.310592] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-01T18:51:36.311279] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-01T18:51:36.311345] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-01T18:51:36.312394] [DEBUG] [LOCAL ] EVTC: Trimmed 37915 records to 26228 (keeping 200 days of data) [2025-10-01T18:51:36.487625] [DEBUG] [LOCAL ] EVTC: Primary data saved (26228 records). [2025-10-01T18:51:36.487804] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-01T18:51:36.487958] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTC took 42.0s. Estimated remaining: 3h 41m 8s. Rate: 7.1 symbols/min [2025-10-01T18:51:36.688458] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:51:36.746432] [DEBUG] [LOCAL ] EXK: Loaded 53127 existing records from primary storage. [2025-10-01T18:51:36.746881] [INFO ] [MAIN ] EXK: Loaded 53127 existing records. [2025-10-01T18:51:36.902723] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-01T18:51:36.944901] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:51:36.945251] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-01T18:51:36.945367] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-01T18:51:36.945737] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-01T18:51:36.962211] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-01T18:51:37.072899] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T18:51:37.422240] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:51:37.424330] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T18:51:37.702414] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-01T18:51:38.328190] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T18:51:38.502388] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-01T18:51:39.078834] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T18:51:39.302374] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-01T18:51:40.102443] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-01T18:51:40.794238] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T18:51:40.838929] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-01T18:51:40.902385] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-01T18:51:41.618461] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T18:51:41.702366] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-01T18:51:42.502433] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-01T18:51:42.711739] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T18:51:42.809468] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T18:51:43.302408] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-01T18:51:44.102380] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-01T18:51:44.410710] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T18:51:44.709586] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T18:51:44.902379] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-01T18:51:45.636546] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-01T18:51:45.637636] [INFO ] [REMOTE ] EVTR: Full fetch complete (32438 records). [2025-10-01T18:51:45.637751] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-01T18:51:45.708571] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-01T18:51:46.052616] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-01T18:51:46.052748] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-01T18:51:46.053365] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-01T18:51:46.053429] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-01T18:51:46.054359] [DEBUG] [LOCAL ] EVTR: Trimmed 32438 records to 23681 (keeping 200 days of data) [2025-10-01T18:51:46.209309] [DEBUG] [LOCAL ] EVTR: Primary data saved (23681 records). [2025-10-01T18:51:46.209442] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-01T18:51:46.209520] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTR took 42.8s. Estimated remaining: 3h 41m 2s. Rate: 7.1 symbols/min [2025-10-01T18:51:46.395456] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:51:46.430095] [DEBUG] [LOCAL ] EXP: Loaded 29652 existing records from primary storage. [2025-10-01T18:51:46.430397] [INFO ] [MAIN ] EXP: Loaded 29652 existing records. [2025-10-01T18:51:46.505691] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-01T18:51:46.634570] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:51:46.634913] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-01T18:51:46.634998] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-01T18:51:46.635318] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-01T18:51:46.635480] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-01T18:51:46.831745] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T18:51:47.086537] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:51:47.302359] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-01T18:51:47.461639] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T18:51:47.905798] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T18:51:48.102380] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-01T18:51:48.902377] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-01T18:51:49.095282] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T18:51:49.702386] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-01T18:51:49.912942] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T18:51:50.273029] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T18:51:50.502421] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-01T18:51:50.856189] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T18:51:51.302364] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-01T18:51:52.102391] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-01T18:51:52.735068] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T18:51:52.736693] [INFO ] [REMOTE ] EW: Full fetch complete (77351 records). [2025-10-01T18:51:52.736851] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-01T18:51:52.906839] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-01T18:51:53.181522] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-01T18:51:53.181785] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-01T18:51:53.182878] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-01T18:51:53.183041] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-01T18:51:53.185126] [DEBUG] [LOCAL ] EW: Trimmed 77351 records to 53402 (keeping 200 days of data) [2025-10-01T18:51:53.309777] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T18:51:53.354341] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T18:51:53.588177] [DEBUG] [LOCAL ] EW: Primary data saved (53402 records). [2025-10-01T18:51:53.588324] [INFO ] [MAIN ] EW: Full history saved. [2025-10-01T18:51:53.588410] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 32.7s. Estimated remaining: 3h 40m 52s. Rate: 7.1 symbols/min [2025-10-01T18:51:53.702402] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-01T18:51:53.983755] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T18:51:54.502444] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-01T18:51:55.101869] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-01T18:51:55.103132] [INFO ] [REMOTE ] EXG: Full fetch complete (49973 records). [2025-10-01T18:51:55.103209] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-01T18:51:55.307550] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-01T18:51:55.540882] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-01T18:51:55.540968] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-01T18:51:55.541763] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-01T18:51:55.541830] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-01T18:51:55.542941] [DEBUG] [LOCAL ] EXG: Trimmed 49973 records to 34113 (keeping 200 days of data) [2025-10-01T18:51:55.752955] [DEBUG] [LOCAL ] EXG: Primary data saved (34113 records). [2025-10-01T18:51:55.753132] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-01T18:51:55.753236] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 26.8s. Estimated remaining: 3h 40m 31s. Rate: 7.1 symbols/min [2025-10-01T18:51:56.018172] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T18:51:56.102441] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-01T18:51:56.660910] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T18:51:56.902418] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-01T18:51:57.959212] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-01T18:51:57.966585] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-01T18:51:57.998418] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T18:51:58.502388] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-01T18:51:59.402824] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T18:51:59.410192] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-01T18:52:00.159981] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T18:52:00.172218] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-01T18:52:00.957001] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T18:52:00.964512] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-01T18:52:02.148042] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T18:52:02.159887] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-01T18:52:02.211301] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T18:52:02.502388] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-01T18:52:03.921001] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T18:52:03.929432] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-01T18:52:03.991455] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T18:52:04.102437] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-01T18:52:05.141690] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T18:52:05.148022] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-01T18:52:06.370840] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T18:52:06.377446] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-01T18:52:06.765912] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-01T18:52:06.767522] [INFO ] [REMOTE ] EXK: Full fetch complete (76526 records). [2025-10-01T18:52:06.767666] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-01T18:52:07.226542] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-01T18:52:07.226771] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-01T18:52:07.227734] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-01T18:52:07.227800] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-01T18:52:07.229414] [DEBUG] [LOCAL ] EXK: Trimmed 76526 records to 53136 (keeping 200 days of data) [2025-10-01T18:52:07.556050] [DEBUG] [LOCAL ] EXK: Primary data saved (53136 records). [2025-10-01T18:52:07.556203] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-01T18:52:07.556338] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXK took 31.1s. Estimated remaining: 3h 40m 29s. Rate: 7.1 symbols/min [2025-10-01T18:52:07.992072] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-01T18:52:07.993266] [INFO ] [REMOTE ] EXP: Full fetch complete (42924 records). [2025-10-01T18:52:07.993351] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-01T18:52:08.398011] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-01T18:52:08.398105] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-01T18:52:08.398787] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-01T18:52:08.398853] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-01T18:52:08.399928] [DEBUG] [LOCAL ] EXP: Trimmed 42924 records to 29652 (keeping 200 days of data) [2025-10-01T18:52:08.602277] [DEBUG] [LOCAL ] EXP: Primary data saved (29652 records). [2025-10-01T18:52:08.602426] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-01T18:52:08.602511] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXP took 22.4s. Estimated remaining: 3h 40m 7s. Rate: 7.1 symbols/min [2025-10-01T18:52:09.237553] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:09.327682] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:09.326737] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:09.412356] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:09.465322] [DEBUG] [LOCAL ] FAF: Loaded 41733 existing records from primary storage. [2025-10-01T18:52:09.465812] [INFO ] [MAIN ] FAF: Loaded 41733 existing records. [2025-10-01T18:52:09.597598] [DEBUG] [LOCAL ] EXR: Loaded 45275 existing records from primary storage. [2025-10-01T18:52:09.648154] [INFO ] [MAIN ] EXR: Loaded 45275 existing records. [2025-10-01T18:52:09.649603] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-01T18:52:09.654918] [DEBUG] [LOCAL ] EXPD: Loaded 47976 existing records from primary storage. [2025-10-01T18:52:09.655032] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-01T18:52:09.671606] [INFO ] [MAIN ] EXPD: Loaded 47976 existing records. [2025-10-01T18:52:10.002436] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:10.078961] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-01T18:52:10.091461] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-01T18:52:10.180884] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-01T18:52:10.282400] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:10.321787] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-01T18:52:10.325293] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-01T18:52:10.325093] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:10.264265] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-01T18:52:10.332728] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-01T18:52:10.325578] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-01T18:52:10.370845] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-01T18:52:10.376117] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-01T18:52:10.359853] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:10.396638] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-01T18:52:10.418175] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-01T18:52:10.444511] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-01T18:52:10.502923] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-01T18:52:10.606323] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-01T18:52:10.699172] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-01T18:52:11.835061] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:11.927631] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:11.928561] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-01T18:52:11.946612] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-01T18:52:12.107574] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:12.133694] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-01T18:52:12.133388] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:12.133972] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-01T18:52:13.229426] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T18:52:13.239531] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-01T18:52:13.427359] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T18:52:13.434626] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-01T18:52:13.591053] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T18:52:13.600489] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-01T18:52:14.575807] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T18:52:14.587404] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-01T18:52:14.627245] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-01T18:52:14.639784] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-01T18:52:14.661398] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T18:52:14.671574] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-01T18:52:15.230700] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T18:52:15.240449] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-01T18:52:15.779074] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T18:52:15.787011] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-01T18:52:15.830548] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T18:52:16.102442] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-01T18:52:16.934678] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T18:52:16.946215] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-01T18:52:17.023234] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T18:52:17.260693] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-01T18:52:17.702395] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-01T18:52:17.808742] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T18:52:18.424149] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T18:52:18.502396] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-01T18:52:19.302378] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-01T18:52:20.102426] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-01T18:52:20.145921] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-01T18:52:20.238584] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T18:52:20.784029] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:52:20.902409] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-01T18:52:21.704025] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-01T18:52:21.709931] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T18:52:22.502392] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-01T18:52:22.619313] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T18:52:23.307465] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-01T18:52:23.319449] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T18:52:24.102444] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-01T18:52:24.584571] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T18:52:24.675416] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-01T18:52:24.902385] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-01T18:52:25.231484] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T18:52:25.702390] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-01T18:52:26.437348] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T18:52:26.502425] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-01T18:52:27.302369] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-01T18:52:27.945697] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T18:52:28.102367] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-01T18:52:28.301538] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-01T18:52:28.773959] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T18:52:28.902431] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-01T18:52:29.472921] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T18:52:29.702409] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-01T18:52:30.502383] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-01T18:52:30.606356] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T18:52:31.302383] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-01T18:52:31.438630] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T18:52:32.102407] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-01T18:52:32.902405] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-01T18:52:32.978073] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T18:52:33.256440] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-01T18:52:33.590140] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T18:52:33.702374] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-01T18:52:34.296938] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T18:52:34.502430] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-01T18:52:35.302377] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-01T18:52:35.756084] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T18:52:35.757792] [INFO ] [REMOTE ] EXPD: Full fetch complete (69328 records). [2025-10-01T18:52:35.758045] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-01T18:52:36.103579] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-01T18:52:36.240456] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-01T18:52:36.242787] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T18:52:36.242975] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-01T18:52:36.253231] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-01T18:52:36.253339] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-01T18:52:36.255783] [DEBUG] [LOCAL ] EXPD: Trimmed 69328 records to 47959 (keeping 200 days of data) [2025-10-01T18:52:36.578566] [DEBUG] [LOCAL ] EXPD: Primary data saved (47959 records). [2025-10-01T18:52:36.578755] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-01T18:52:36.578882] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXPD took 28.0s. Estimated remaining: 3h 40m 37s. Rate: 7.1 symbols/min [2025-10-01T18:52:36.778888] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:36.804628] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T18:52:36.858557] [DEBUG] [LOCAL ] FBIN: Loaded 50325 existing records from primary storage. [2025-10-01T18:52:36.859071] [INFO ] [MAIN ] FBIN: Loaded 50325 existing records. [2025-10-01T18:52:36.907505] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-01T18:52:37.074713] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:37.075010] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-01T18:52:37.075077] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-01T18:52:37.075357] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-01T18:52:37.075428] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-01T18:52:37.506958] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:37.702411] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-01T18:52:38.305596] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-01T18:52:38.502389] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-01T18:52:38.771194] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-01T18:52:38.772534] [INFO ] [REMOTE ] FAF: Full fetch complete (57593 records). [2025-10-01T18:52:38.772625] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-01T18:52:39.191426] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-01T18:52:39.191524] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-01T18:52:39.192311] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-01T18:52:39.192374] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-01T18:52:39.193679] [DEBUG] [LOCAL ] FAF: Trimmed 57593 records to 41688 (keeping 200 days of data) [2025-10-01T18:52:39.302460] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-01T18:52:39.475238] [DEBUG] [LOCAL ] FAF: Primary data saved (41688 records). [2025-10-01T18:52:39.475366] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-01T18:52:39.475497] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. FAF took 30.9s. Estimated remaining: 3h 40m 17s. Rate: 7.1 symbols/min [2025-10-01T18:52:39.659151] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:39.685250] [DEBUG] [LOCAL ] FBK: Loaded 25945 existing records from primary storage. [2025-10-01T18:52:39.685522] [INFO ] [MAIN ] FBK: Loaded 25945 existing records. [2025-10-01T18:52:39.883693] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:39.883916] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-01T18:52:39.883968] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-01T18:52:39.884184] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-01T18:52:39.884246] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-01T18:52:40.113575] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-01T18:52:40.168965] [INFO ] [REMOTE ] EXR: Full fetch complete (65901 records). [2025-10-01T18:52:40.182377] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-01T18:52:40.412702] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:40.417755] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-01T18:52:40.512628] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-01T18:52:40.767402] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-01T18:52:40.767493] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-01T18:52:40.768473] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-01T18:52:40.768544] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-01T18:52:40.769984] [DEBUG] [LOCAL ] EXR: Trimmed 65901 records to 45268 (keeping 200 days of data) [2025-10-01T18:52:40.903613] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-01T18:52:41.072291] [DEBUG] [LOCAL ] EXR: Primary data saved (45268 records). [2025-10-01T18:52:41.072435] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-01T18:52:41.072563] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXR took 32.5s. Estimated remaining: 3h 39m 56s. Rate: 7.1 symbols/min [2025-10-01T18:52:41.257952] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:41.301796] [DEBUG] [LOCAL ] FBP: Loaded 46045 existing records from primary storage. [2025-10-01T18:52:41.302224] [INFO ] [MAIN ] FBP: Loaded 46045 existing records. [2025-10-01T18:52:41.506287] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:41.506872] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-01T18:52:41.507027] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-01T18:52:41.507589] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-01T18:52:41.507786] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-01T18:52:41.634197] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T18:52:41.722766] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-01T18:52:41.903791] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-01T18:52:41.991846] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:42.414757] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T18:52:42.502395] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-01T18:52:42.645740] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T18:52:43.302377] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-01T18:52:44.102373] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-01T18:52:44.260477] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T18:52:44.611327] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-01T18:52:44.902397] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-01T18:52:45.559342] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T18:52:45.702392] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-01T18:52:46.478590] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T18:52:46.502403] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-01T18:52:46.777430] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T18:52:47.302369] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-01T18:52:48.102412] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-01T18:52:48.363183] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T18:52:48.876217] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-01T18:52:48.902408] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-01T18:52:49.321694] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T18:52:49.702402] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-01T18:52:50.502354] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-01T18:52:50.828482] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T18:52:51.302366] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-01T18:52:52.102363] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-01T18:52:52.176194] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T18:52:52.572924] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (3.67 seconds). [2025-10-01T18:52:52.575069] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-01T18:52:52.575226] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-01T18:52:52.902551] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-01T18:52:53.001297] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T18:52:53.053600] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-01T18:52:53.054149] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-01T18:52:53.055346] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-01T18:52:53.055417] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-01T18:52:53.057159] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-01T18:52:53.423832] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T18:52:53.454072] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-01T18:52:53.454284] [INFO ] [MAIN ] F: Full history saved. [2025-10-01T18:52:53.454413] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 44.9s. Estimated remaining: 3h 39m 55s. Rate: 7.1 symbols/min [2025-10-01T18:52:53.662474] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:52:53.699353] [DEBUG] [LOCAL ] FBRT: Loaded 34527 existing records from primary storage. [2025-10-01T18:52:53.699716] [INFO ] [MAIN ] FBRT: Loaded 34527 existing records. [2025-10-01T18:52:53.711482] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-01T18:52:53.902221] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:52:53.902509] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-01T18:52:53.902560] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-01T18:52:53.902817] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-01T18:52:53.902877] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-01T18:52:54.281538] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:52:54.502361] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-01T18:52:54.947487] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T18:52:55.302389] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-01T18:52:55.761852] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T18:52:56.102391] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-01T18:52:56.587624] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T18:52:56.902405] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-01T18:52:57.047777] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T18:52:57.366748] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T18:52:57.702395] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-01T18:52:58.514589] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-01T18:52:58.536242] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T18:52:59.117669] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T18:52:59.302385] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-01T18:52:59.514879] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T18:53:00.102482] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-01T18:53:00.527595] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T18:53:00.902431] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-01T18:53:01.462363] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T18:53:01.702413] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-01T18:53:02.502426] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-01T18:53:03.302365] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-01T18:53:03.413737] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-01T18:53:04.047719] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-01T18:53:04.052835] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T18:53:04.102375] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-01T18:53:04.622450] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-01T18:53:04.623794] [INFO ] [REMOTE ] FBK: Full fetch complete (33545 records). [2025-10-01T18:53:04.623872] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-01T18:53:04.907632] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-01T18:53:05.006799] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-01T18:53:05.007015] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-01T18:53:05.008141] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-01T18:53:05.008276] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-01T18:53:05.009367] [DEBUG] [LOCAL ] FBK: Trimmed 33545 records to 26076 (keeping 200 days of data) [2025-10-01T18:53:05.176077] [DEBUG] [LOCAL ] FBK: Primary data saved (26076 records). [2025-10-01T18:53:05.176440] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-01T18:53:05.176607] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBK took 25.7s. Estimated remaining: 3h 39m 53s. Rate: 7.1 symbols/min [2025-10-01T18:53:05.322907] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T18:53:05.387328] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:53:05.407388] [DEBUG] [LOCAL ] FC: Loaded 15429 existing records from primary storage. [2025-10-01T18:53:05.407719] [INFO ] [MAIN ] FC: Loaded 15429 existing records. [2025-10-01T18:53:05.586185] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:53:05.586452] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-01T18:53:05.586506] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-01T18:53:05.586819] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-01T18:53:05.586880] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-01T18:53:05.707588] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-01T18:53:05.956922] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:53:06.502350] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-01T18:53:06.551681] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T18:53:07.302409] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-01T18:53:07.933225] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-01T18:53:08.102527] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-01T18:53:08.635429] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-01T18:53:08.902400] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-01T18:53:09.120806] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T18:53:09.339224] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T18:53:09.702384] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-01T18:53:10.267240] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T18:53:10.502416] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-01T18:53:10.746105] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T18:53:11.302382] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-01T18:53:12.066027] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T18:53:12.102349] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-01T18:53:12.578984] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-01T18:53:12.580460] [INFO ] [REMOTE ] FBIN: Full fetch complete (72550 records). [2025-10-01T18:53:12.580596] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-01T18:53:12.907528] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-01T18:53:13.000334] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-01T18:53:13.000438] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-01T18:53:13.001723] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-01T18:53:13.001859] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-01T18:53:13.003578] [DEBUG] [LOCAL ] FBIN: Trimmed 72550 records to 50327 (keeping 200 days of data) [2025-10-01T18:53:13.333227] [DEBUG] [LOCAL ] FBIN: Primary data saved (50327 records). [2025-10-01T18:53:13.333373] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-01T18:53:13.333484] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBIN took 36.8s. Estimated remaining: 3h 39m 44s. Rate: 7.1 symbols/min [2025-10-01T18:53:13.443095] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T18:53:13.533579] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:53:13.574749] [DEBUG] [LOCAL ] FCF: Loaded 39428 existing records from primary storage. [2025-10-01T18:53:13.575072] [INFO ] [MAIN ] FCF: Loaded 39428 existing records. [2025-10-01T18:53:13.707472] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-01T18:53:13.778698] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:53:13.778957] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-01T18:53:13.779009] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-01T18:53:13.779526] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-01T18:53:13.779599] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-01T18:53:14.169842] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:53:14.502433] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-01T18:53:14.773776] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T18:53:15.302420] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-01T18:53:16.053334] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T18:53:16.102376] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-01T18:53:16.281787] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T18:53:16.443679] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-01T18:53:16.902416] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-01T18:53:17.691052] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T18:53:17.702394] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-01T18:53:17.779601] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T18:53:18.502430] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-01T18:53:19.302382] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-01T18:53:20.037348] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-01T18:53:20.082213] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T18:53:20.102360] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-01T18:53:20.198509] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T18:53:20.902357] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-01T18:53:20.957751] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T18:53:21.702383] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-01T18:53:22.022004] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T18:53:22.502381] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-01T18:53:22.731181] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T18:53:23.302401] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-01T18:53:24.086444] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T18:53:24.102338] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-01T18:53:24.563617] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T18:53:24.902383] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-01T18:53:25.702399] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-01T18:53:25.838725] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T18:53:25.899824] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T18:53:25.901223] [INFO ] [REMOTE ] FBRT: Full fetch complete (48924 records). [2025-10-01T18:53:25.901307] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-01T18:53:26.331588] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-01T18:53:26.331721] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-01T18:53:26.332550] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-01T18:53:26.332621] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-01T18:53:26.334235] [DEBUG] [LOCAL ] FBRT: Trimmed 48924 records to 34730 (keeping 200 days of data) [2025-10-01T18:53:26.506339] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-01T18:53:26.562715] [DEBUG] [LOCAL ] FBRT: Primary data saved (34730 records). [2025-10-01T18:53:26.562870] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-01T18:53:26.562974] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBRT took 33.1s. Estimated remaining: 3h 39m 45s. Rate: 7.1 symbols/min [2025-10-01T18:53:26.747608] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:53:26.777585] [DEBUG] [LOCAL ] FCN: Loaded 26000 existing records from primary storage. [2025-10-01T18:53:26.777929] [INFO ] [MAIN ] FCN: Loaded 26000 existing records. [2025-10-01T18:53:26.966065] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:53:26.966271] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-01T18:53:26.966320] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-01T18:53:26.967166] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-01T18:53:26.967243] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-01T18:53:27.307768] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-01T18:53:27.351176] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:53:27.767719] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-01T18:53:27.769673] [INFO ] [REMOTE ] FBP: Full fetch complete (66357 records). [2025-10-01T18:53:27.769780] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-01T18:53:27.866179] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T18:53:27.895612] [INFO ] [REMOTE ] FC: Full fetch complete (21749 records). [2025-10-01T18:53:27.895791] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-01T18:53:28.116334] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-01T18:53:28.669799] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-01T18:53:28.670485] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-01T18:53:28.670591] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-01T18:53:28.670725] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-01T18:53:28.671890] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-01T18:53:28.672258] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-01T18:53:28.672774] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-01T18:53:28.673148] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-01T18:53:28.674892] [DEBUG] [LOCAL ] FC: Trimmed 21749 records to 15437 (keeping 200 days of data) [2025-10-01T18:53:28.675464] [DEBUG] [LOCAL ] FBP: Trimmed 66357 records to 45961 (keeping 200 days of data) [2025-10-01T18:53:28.872790] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T18:53:28.902801] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-01T18:53:28.935016] [DEBUG] [LOCAL ] FC: Primary data saved (15437 records). [2025-10-01T18:53:28.935616] [INFO ] [MAIN ] FC: Full history saved. [2025-10-01T18:53:28.935978] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FC took 23.8s. Estimated remaining: 3h 39m 25s. Rate: 7.1 symbols/min [2025-10-01T18:53:29.194136] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:53:29.286616] [DEBUG] [LOCAL ] FCPT: Loaded 37298 existing records from primary storage. [2025-10-01T18:53:29.288636] [INFO ] [MAIN ] FCPT: Loaded 37298 existing records. [2025-10-01T18:53:29.524634] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:53:29.525923] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-01T18:53:29.526017] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-01T18:53:29.527740] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-01T18:53:29.527991] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-01T18:53:29.623668] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T18:53:29.697333] [DEBUG] [LOCAL ] FBP: Primary data saved (45961 records). [2025-10-01T18:53:29.703180] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-01T18:53:29.703297] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-01T18:53:29.725714] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FBP took 48.7s. Estimated remaining: 3h 39m 1s. Rate: 7.1 symbols/min [2025-10-01T18:53:30.164739] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:53:30.176422] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-01T18:53:30.209828] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:53:30.187397] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-01T18:53:30.210524] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-01T18:53:30.210586] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-01T18:53:30.210636] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-01T18:53:30.210731] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-01T18:53:30.503490] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-01T18:53:30.639387] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:53:30.683150] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T18:53:30.683590] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T18:53:31.302433] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-01T18:53:32.107771] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-01T18:53:32.124000] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T18:53:32.474076] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-01T18:53:32.902408] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-01T18:53:33.463066] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T18:53:33.702411] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-01T18:53:33.965832] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T18:53:34.502413] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-01T18:53:35.137699] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T18:53:35.302394] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-01T18:53:35.573910] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-01T18:53:35.801390] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T18:53:36.102382] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-01T18:53:36.902358] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-01T18:53:37.101260] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T18:53:37.328630] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-01T18:53:37.702378] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-01T18:53:38.502433] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-01T18:53:39.017704] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T18:53:39.302384] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-01T18:53:39.723617] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T18:53:39.902543] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T18:53:40.102384] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-01T18:53:40.902424] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-01T18:53:41.702447] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-01T18:53:41.761061] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T18:53:42.199077] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T18:53:42.231440] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T18:53:42.502395] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-01T18:53:42.924002] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-01T18:53:43.302395] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-01T18:53:43.627066] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-01T18:53:44.102394] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-01T18:53:44.513786] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-01T18:53:44.902386] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-01T18:53:45.245453] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-01T18:53:45.702381] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-01T18:53:46.047518] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-01T18:53:46.502398] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-01T18:53:46.955089] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T18:53:47.302387] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-01T18:53:47.840707] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-01T18:53:47.841367] [INFO ] [REMOTE ] FCRX: Full fetch complete (1691 records). [2025-10-01T18:53:47.841436] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-01T18:53:48.035550] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-01T18:53:48.035766] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:53:48.035819] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:53:48.035886] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-01T18:53:48.035950] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-01T18:53:48.035987] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-01T18:53:48.036027] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-01T18:53:48.036085] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCRX took 18.3s. Estimated remaining: 3h 39m 12s. Rate: 7.1 symbols/min [2025-10-01T18:53:48.107501] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-01T18:53:48.228061] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:53:48.246612] [DEBUG] [LOCAL ] FCT: Loaded 14501 existing records from primary storage. [2025-10-01T18:53:48.246911] [INFO ] [MAIN ] FCT: Loaded 14501 existing records. [2025-10-01T18:53:48.475367] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:53:48.475592] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-01T18:53:48.475669] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-01T18:53:48.476068] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-01T18:53:48.476129] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-01T18:53:48.873481] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:53:48.902391] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-01T18:53:49.552416] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T18:53:49.571111] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T18:53:49.702388] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-01T18:53:50.502383] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-01T18:53:51.302404] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-01T18:53:51.341827] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T18:53:51.408965] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-01T18:53:52.102372] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-01T18:53:52.731501] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T18:53:52.902399] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-01T18:53:53.583385] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T18:53:53.702375] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-01T18:53:54.502391] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-01T18:53:54.696900] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T18:53:54.698418] [INFO ] [REMOTE ] FCF: Full fetch complete (58069 records). [2025-10-01T18:53:54.698519] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-01T18:53:55.031536] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T18:53:55.183314] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-01T18:53:55.183399] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-01T18:53:55.184208] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-01T18:53:55.184275] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-01T18:53:55.185530] [DEBUG] [LOCAL ] FCF: Trimmed 58069 records to 39411 (keeping 200 days of data) [2025-10-01T18:53:55.303673] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-01T18:53:55.449282] [DEBUG] [LOCAL ] FCF: Primary data saved (39411 records). [2025-10-01T18:53:55.449432] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-01T18:53:55.449517] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCF took 42.1s. Estimated remaining: 3h 39m 2s. Rate: 7.1 symbols/min [2025-10-01T18:53:55.598022] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T18:53:55.656243] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:53:55.656432] [DEBUG] [LOCAL ] FCX: No existing data file found in primary storage. [2025-10-01T18:53:55.656471] [WARN ] [MAIN ] FCX: No existing data found, performing full refresh instead. [2025-10-01T18:53:55.656588] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-01T18:53:55.656631] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-01T18:53:55.656717] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-10-01T18:53:55.656761] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-01T18:53:56.060955] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:53:56.102384] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-01T18:53:56.801845] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T18:53:56.902400] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-01T18:53:57.702370] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-01T18:53:58.040009] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T18:53:58.181206] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T18:53:58.473864] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T18:53:58.502432] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-01T18:53:59.302401] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-01T18:53:59.567291] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T18:54:00.102440] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-01T18:54:00.472761] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T18:54:00.902383] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-01T18:54:00.982004] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T18:54:01.702412] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-01T18:54:02.502374] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-01T18:54:02.644939] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T18:54:02.793684] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T18:54:03.302424] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-01T18:54:04.102383] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-01T18:54:04.294156] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T18:54:04.295525] [INFO ] [REMOTE ] FCPT: Full fetch complete (53709 records). [2025-10-01T18:54:04.295614] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-01T18:54:04.506340] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T18:54:04.739450] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-01T18:54:04.739551] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-01T18:54:04.740434] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-01T18:54:04.740504] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-01T18:54:04.741802] [DEBUG] [LOCAL ] FCPT: Trimmed 53709 records to 37301 (keeping 200 days of data) [2025-10-01T18:54:04.922208] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-01T18:54:04.993685] [DEBUG] [LOCAL ] FCPT: Primary data saved (37301 records). [2025-10-01T18:54:04.993840] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-01T18:54:04.993927] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCPT took 36.1s. Estimated remaining: 3h 38m 56s. Rate: 7.1 symbols/min [2025-10-01T18:54:05.180794] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:54:05.214355] [DEBUG] [LOCAL ] FDP: Loaded 30158 existing records from primary storage. [2025-10-01T18:54:05.214711] [INFO ] [MAIN ] FDP: Loaded 30158 existing records. [2025-10-01T18:54:05.404770] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:54:05.405004] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-01T18:54:05.405052] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-01T18:54:05.405737] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-01T18:54:05.405822] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-01T18:54:05.707517] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-01T18:54:05.811124] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:54:05.827361] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T18:54:06.060397] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-01T18:54:06.502362] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-01T18:54:06.803290] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T18:54:07.302390] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-01T18:54:07.949504] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T18:54:07.950555] [INFO ] [REMOTE ] FCN: Full fetch complete (35666 records). [2025-10-01T18:54:07.950638] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-01T18:54:08.089682] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T18:54:08.108067] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-01T18:54:08.393242] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-01T18:54:08.393332] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-01T18:54:08.394020] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-01T18:54:08.394089] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-01T18:54:08.395136] [DEBUG] [LOCAL ] FCN: Trimmed 35666 records to 25935 (keeping 200 days of data) [2025-10-01T18:54:08.565951] [DEBUG] [LOCAL ] FCN: Primary data saved (25935 records). [2025-10-01T18:54:08.566127] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-01T18:54:08.566235] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCN took 42.0s. Estimated remaining: 3h 38m 38s. Rate: 7.1 symbols/min [2025-10-01T18:54:08.761842] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:54:08.792097] [DEBUG] [LOCAL ] FDS: Loaded 26508 existing records from primary storage. [2025-10-01T18:54:08.792364] [INFO ] [MAIN ] FDS: Loaded 26508 existing records. [2025-10-01T18:54:08.907536] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-01T18:54:08.992513] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:54:08.992945] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-01T18:54:08.992999] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-01T18:54:08.993411] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-01T18:54:08.993493] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-01T18:54:09.424249] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:54:09.702404] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-01T18:54:10.261560] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T18:54:10.443294] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-01T18:54:10.502359] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-01T18:54:10.834555] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T18:54:11.302381] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-01T18:54:12.102348] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-01T18:54:12.249153] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T18:54:12.676305] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-01T18:54:12.902350] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-01T18:54:13.032430] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T18:54:13.702392] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-01T18:54:14.088925] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T18:54:14.502359] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-01T18:54:14.704924] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T18:54:15.302354] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-01T18:54:15.617743] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T18:54:16.102386] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-01T18:54:16.613023] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T18:54:16.902397] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-01T18:54:17.702406] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-01T18:54:17.839678] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T18:54:18.393742] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-01T18:54:18.502396] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-01T18:54:18.802593] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T18:54:19.302421] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-01T18:54:20.102371] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-01T18:54:20.126356] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T18:54:20.415331] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T18:54:20.902419] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-01T18:54:21.431171] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T18:54:21.702416] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-01T18:54:22.243368] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T18:54:22.502415] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-01T18:54:23.255236] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T18:54:23.302365] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-01T18:54:24.102377] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-01T18:54:24.146625] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-01T18:54:24.276705] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T18:54:24.902389] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-01T18:54:25.367554] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T18:54:25.702388] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-01T18:54:26.219151] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T18:54:26.502413] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-01T18:54:26.765583] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T18:54:26.766620] [INFO ] [REMOTE ] FCT: Full fetch complete (21051 records). [2025-10-01T18:54:26.766737] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-01T18:54:27.190509] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-01T18:54:27.190597] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-01T18:54:27.191124] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-01T18:54:27.191187] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-01T18:54:27.191862] [DEBUG] [LOCAL ] FCT: Trimmed 21051 records to 14609 (keeping 200 days of data) [2025-10-01T18:54:27.289791] [DEBUG] [LOCAL ] FCT: Primary data saved (14609 records). [2025-10-01T18:54:27.289941] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-01T18:54:27.290027] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCT took 39.3s. Estimated remaining: 3h 38m 49s. Rate: 7.1 symbols/min [2025-10-01T18:54:27.312458] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-01T18:54:27.482442] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:54:27.536894] [DEBUG] [LOCAL ] FDX: Loaded 51595 existing records from primary storage. [2025-10-01T18:54:27.537238] [INFO ] [MAIN ] FDX: Loaded 51595 existing records. [2025-10-01T18:54:27.751624] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:54:27.752081] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-01T18:54:27.752240] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-01T18:54:27.753494] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-01T18:54:27.753560] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-01T18:54:27.939210] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T18:54:28.107519] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-01T18:54:28.184246] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:54:28.902472] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-01T18:54:29.156275] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T18:54:29.157528] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T18:54:29.702381] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-01T18:54:30.024720] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T18:54:30.502380] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-01T18:54:31.302387] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-01T18:54:31.432625] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T18:54:31.672736] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T18:54:32.102382] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-01T18:54:32.902411] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-01T18:54:33.528584] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-01T18:54:33.702376] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-01T18:54:33.851952] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T18:54:34.015987] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-01T18:54:34.502416] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-01T18:54:35.302415] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-01T18:54:35.339006] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T18:54:35.340335] [INFO ] [REMOTE ] FDP: Full fetch complete (42798 records). [2025-10-01T18:54:35.340521] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-01T18:54:35.768446] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-01T18:54:35.768584] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-01T18:54:35.769380] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-01T18:54:35.769455] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-01T18:54:35.770619] [DEBUG] [LOCAL ] FDP: Trimmed 42798 records to 30111 (keeping 200 days of data) [2025-10-01T18:54:35.964038] [DEBUG] [LOCAL ] FDP: Primary data saved (30111 records). [2025-10-01T18:54:35.964182] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-01T18:54:35.964281] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDP took 31.0s. Estimated remaining: 3h 38m 41s. Rate: 7.1 symbols/min [2025-10-01T18:54:36.115964] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-01T18:54:36.153192] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:54:36.206490] [DEBUG] [LOCAL ] FE: Loaded 53429 existing records from primary storage. [2025-10-01T18:54:36.206902] [INFO ] [MAIN ] FE: Loaded 53429 existing records. [2025-10-01T18:54:36.397134] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:54:36.397409] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-01T18:54:36.397459] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-01T18:54:36.398031] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-01T18:54:36.398094] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-01T18:54:36.799249] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:54:36.835333] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:54:36.902426] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-01T18:54:37.364312] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T18:54:37.465362] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.96 seconds). [2025-10-01T18:54:37.467068] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-01T18:54:37.467189] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-01T18:54:37.707523] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-01T18:54:37.934873] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-01T18:54:37.934956] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-01T18:54:37.935897] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-01T18:54:37.935962] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-01T18:54:37.937415] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-10-01T18:54:38.278608] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-01T18:54:38.278781] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-01T18:54:38.278864] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCX took 42.8s. Estimated remaining: 3h 38m 21s. Rate: 7.1 symbols/min [2025-10-01T18:54:38.464921] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:54:38.465222] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-01T18:54:38.465273] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-01T18:54:38.465386] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-01T18:54:38.465429] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-01T18:54:38.465471] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-01T18:54:38.465509] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-01T18:54:38.511848] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-01T18:54:38.886176] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T18:54:38.892163] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:54:39.302368] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-01T18:54:39.674542] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-01T18:54:39.738339] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T18:54:39.821310] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T18:54:40.102407] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-01T18:54:40.902387] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-01T18:54:41.211315] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-01T18:54:41.702399] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-01T18:54:42.140695] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-01T18:54:42.143401] [INFO ] [REMOTE ] FDS: Full fetch complete (37571 records). [2025-10-01T18:54:42.143575] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-01T18:54:42.507511] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-01T18:54:42.558019] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-01T18:54:42.558192] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-01T18:54:42.558924] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-01T18:54:42.558990] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-01T18:54:42.560044] [DEBUG] [LOCAL ] FDS: Trimmed 37571 records to 26623 (keeping 200 days of data) [2025-10-01T18:54:42.738514] [DEBUG] [LOCAL ] FDS: Primary data saved (26623 records). [2025-10-01T18:54:42.738727] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-01T18:54:42.738846] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDS took 34.2s. Estimated remaining: 3h 38m 5s. Rate: 7.1 symbols/min [2025-10-01T18:54:42.956578] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:54:42.961752] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-01T18:54:43.014252] [DEBUG] [LOCAL ] FERG: Loaded 48873 existing records from primary storage. [2025-10-01T18:54:43.014606] [INFO ] [MAIN ] FERG: Loaded 48873 existing records. [2025-10-01T18:54:43.232356] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:54:43.233628] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-01T18:54:43.233769] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-01T18:54:43.236189] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-01T18:54:43.236282] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-01T18:54:43.311113] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-01T18:54:43.466873] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T18:54:43.678009] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:54:43.877750] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-01T18:54:44.102380] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-01T18:54:44.621490] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-01T18:54:44.902397] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-01T18:54:45.234400] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-01T18:54:45.702377] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-01T18:54:46.243276] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-01T18:54:46.502374] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-01T18:54:47.103902] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T18:54:47.302402] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-01T18:54:48.102383] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-01T18:54:48.902377] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-01T18:54:49.063771] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T18:54:49.187582] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-01T18:54:49.702419] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-01T18:54:50.063209] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T18:54:50.502391] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-01T18:54:50.967204] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T18:54:51.312672] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-01T18:54:51.318307] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T18:54:52.102388] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-01T18:54:52.902384] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-01T18:54:53.054235] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T18:54:53.563291] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T18:54:53.702380] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-01T18:54:54.457059] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-01T18:54:54.457788] [INFO ] [REMOTE ] FENG: Full fetch complete (2269 records). [2025-10-01T18:54:54.457892] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-01T18:54:54.505747] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-01T18:54:54.687288] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T18:54:54.699098] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-01T18:54:54.699226] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-01T18:54:54.699317] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-01T18:54:54.699506] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-01T18:54:54.699676] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-01T18:54:54.701175] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T18:54:54.710150] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-01T18:54:54.710865] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FENG took 16.4s. Estimated remaining: 3h 38m 3s. Rate: 7.1 symbols/min [2025-10-01T18:54:54.904874] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:54:54.921397] [DEBUG] [LOCAL ] FET: Loaded 12840 existing records from primary storage. [2025-10-01T18:54:54.921709] [INFO ] [MAIN ] FET: Loaded 12840 existing records. [2025-10-01T18:54:55.125873] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:54:55.126092] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-01T18:54:55.126140] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-01T18:54:55.126431] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-01T18:54:55.126490] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-01T18:54:55.307602] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-01T18:54:55.524207] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:54:56.102388] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-01T18:54:56.321533] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T18:54:56.902386] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-01T18:54:57.221797] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T18:54:57.702421] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-01T18:54:57.926211] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T18:54:58.342843] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T18:54:58.502423] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-01T18:54:58.777030] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T18:54:59.302400] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-01T18:54:59.405193] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T18:55:00.102440] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-01T18:55:00.902365] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-01T18:55:01.308939] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T18:55:01.703876] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-01T18:55:01.706822] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T18:55:01.950489] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T18:55:02.502397] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-01T18:55:03.302394] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-01T18:55:03.332804] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T18:55:03.545781] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T18:55:04.102409] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-01T18:55:04.902377] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-01T18:55:05.128871] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T18:55:05.702434] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-01T18:55:05.870754] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T18:55:05.966269] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T18:55:06.502407] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-01T18:55:07.237109] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T18:55:07.302388] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-01T18:55:07.447757] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T18:55:07.896871] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T18:55:08.102392] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-01T18:55:08.902404] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-01T18:55:09.702364] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-01T18:55:09.979972] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-01T18:55:10.502424] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-01T18:55:10.637482] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T18:55:11.302387] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-01T18:55:12.102393] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-01T18:55:12.317106] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T18:55:12.422396] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-01T18:55:12.423906] [INFO ] [REMOTE ] FDX: Full fetch complete (74481 records). [2025-10-01T18:55:12.424040] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-01T18:55:12.871967] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-01T18:55:12.872199] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-01T18:55:12.873564] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-01T18:55:12.873772] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-01T18:55:12.884629] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T18:55:12.889575] [DEBUG] [LOCAL ] FDX: Trimmed 74481 records to 51582 (keeping 200 days of data) [2025-10-01T18:55:12.948009] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-01T18:55:13.024043] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T18:55:13.279865] [DEBUG] [LOCAL ] FDX: Primary data saved (51582 records). [2025-10-01T18:55:13.280013] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-01T18:55:13.280101] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FDX took 46.0s. Estimated remaining: 3h 38m 14s. Rate: 7.1 symbols/min [2025-10-01T18:55:13.469438] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:13.469626] [DEBUG] [LOCAL ] FF: No existing data file found in primary storage. [2025-10-01T18:55:13.469701] [WARN ] [MAIN ] FF: No existing data found, performing full refresh instead. [2025-10-01T18:55:13.469819] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-01T18:55:13.469864] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-01T18:55:13.469907] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-10-01T18:55:13.469942] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-01T18:55:13.707558] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-01T18:55:13.860188] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:14.502355] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-01T18:55:14.665138] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T18:55:14.720036] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T18:55:15.302493] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-01T18:55:16.102399] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-01T18:55:16.320583] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T18:55:16.501296] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T18:55:16.902401] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-01T18:55:17.629063] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T18:55:17.702350] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-01T18:55:17.988209] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T18:55:18.502386] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-01T18:55:18.824451] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T18:55:18.825351] [INFO ] [REMOTE ] FET: Full fetch complete (18309 records). [2025-10-01T18:55:18.825421] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-01T18:55:19.236961] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-01T18:55:19.237045] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-01T18:55:19.237565] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-01T18:55:19.237661] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-01T18:55:19.238298] [DEBUG] [LOCAL ] FET: Trimmed 18309 records to 12872 (keeping 200 days of data) [2025-10-01T18:55:19.302664] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-01T18:55:19.322593] [DEBUG] [LOCAL ] FET: Primary data saved (12872 records). [2025-10-01T18:55:19.322744] [INFO ] [MAIN ] FET: Full history saved. [2025-10-01T18:55:19.322854] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FET took 24.6s. Estimated remaining: 3h 38m 1s. Rate: 7.1 symbols/min [2025-10-01T18:55:19.513446] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:19.513713] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-10-01T18:55:19.513769] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-10-01T18:55:19.513897] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-01T18:55:19.513951] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-01T18:55:19.514010] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-01T18:55:19.514056] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-01T18:55:19.905137] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:20.102383] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-01T18:55:20.235543] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T18:55:20.513869] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-01T18:55:20.902415] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-01T18:55:21.702418] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-01T18:55:21.897713] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-01T18:55:21.899317] [INFO ] [REMOTE ] FERG: Full fetch complete (70953 records). [2025-10-01T18:55:21.899419] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-01T18:55:22.323046] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T18:55:22.373987] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-01T18:55:22.374073] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-01T18:55:22.374983] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-01T18:55:22.375048] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-01T18:55:22.376454] [DEBUG] [LOCAL ] FERG: Trimmed 70953 records to 48853 (keeping 200 days of data) [2025-10-01T18:55:22.502416] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-01T18:55:22.712311] [DEBUG] [LOCAL ] FERG: Primary data saved (48853 records). [2025-10-01T18:55:22.712446] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-01T18:55:22.712527] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FERG took 40.0s. Estimated remaining: 3h 37m 43s. Rate: 7.1 symbols/min [2025-10-01T18:55:22.903061] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:22.903250] [DEBUG] [LOCAL ] FFC: No existing data file found in primary storage. [2025-10-01T18:55:22.903288] [WARN ] [MAIN ] FFC: No existing data found, performing full refresh instead. [2025-10-01T18:55:22.903451] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-01T18:55:22.903504] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-01T18:55:22.903556] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-10-01T18:55:22.903591] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-01T18:55:23.182668] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T18:55:23.219932] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-01T18:55:23.229958] [INFO ] [REMOTE ] FE: Full fetch complete (77260 records). [2025-10-01T18:55:23.240399] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-01T18:55:23.308582] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-01T18:55:23.330346] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:23.756778] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-01T18:55:23.756910] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-01T18:55:23.758049] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-01T18:55:23.758117] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-01T18:55:23.759665] [DEBUG] [LOCAL ] FE: Trimmed 77260 records to 53430 (keeping 200 days of data) [2025-10-01T18:55:24.022890] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T18:55:24.102410] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-01T18:55:24.125919] [DEBUG] [LOCAL ] FE: Primary data saved (53430 records). [2025-10-01T18:55:24.126459] [INFO ] [MAIN ] FE: Full history saved. [2025-10-01T18:55:24.126593] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FE took 48.2s. Estimated remaining: 3h 37m 22s. Rate: 7.1 symbols/min [2025-10-01T18:55:24.320366] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:24.357916] [DEBUG] [LOCAL ] FFWM: Loaded 35772 existing records from primary storage. [2025-10-01T18:55:24.358238] [INFO ] [MAIN ] FFWM: Loaded 35772 existing records. [2025-10-01T18:55:24.551917] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:55:24.552170] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-01T18:55:24.552221] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-01T18:55:24.552983] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-01T18:55:24.553047] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-01T18:55:24.903686] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-01T18:55:24.945767] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:25.218073] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T18:55:25.702361] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-01T18:55:26.101428] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T18:55:26.456513] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T18:55:26.502418] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-01T18:55:27.302380] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-01T18:55:27.493692] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T18:55:28.085810] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T18:55:28.102341] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-01T18:55:28.902414] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-01T18:55:29.492894] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T18:55:29.702389] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-01T18:55:30.165436] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-01T18:55:30.372588] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T18:55:30.502393] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-01T18:55:31.102090] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T18:55:31.302378] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-01T18:55:31.970477] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T18:55:32.102428] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-01T18:55:32.790917] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-01T18:55:32.902378] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-01T18:55:33.702407] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-01T18:55:33.963456] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T18:55:34.502429] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-01T18:55:34.593201] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T18:55:34.594123] [INFO ] [REMOTE ] FFA: Full fetch complete (8466 records). [2025-10-01T18:55:34.594237] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-01T18:55:35.000485] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-01T18:55:35.000585] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-01T18:55:35.000841] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-01T18:55:35.000913] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-01T18:55:35.001347] [DEBUG] [LOCAL ] FFA: Trimmed 8466 records to 5856 (keeping 200 days of data) [2025-10-01T18:55:35.039097] [DEBUG] [LOCAL ] FFA: Primary data saved (5856 records). [2025-10-01T18:55:35.039231] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-01T18:55:35.039320] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFA took 15.7s. Estimated remaining: 3h 37m 18s. Rate: 7.1 symbols/min [2025-10-01T18:55:35.226417] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:35.252766] [DEBUG] [LOCAL ] FG: Loaded 22827 existing records from primary storage. [2025-10-01T18:55:35.253058] [INFO ] [MAIN ] FG: Loaded 22827 existing records. [2025-10-01T18:55:35.313161] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-01T18:55:35.453368] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:55:35.453592] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-01T18:55:35.453661] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-01T18:55:35.454724] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-01T18:55:35.454798] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-01T18:55:35.694457] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T18:55:35.878031] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:36.102381] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-01T18:55:36.478055] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T18:55:36.689613] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-01T18:55:36.902440] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-01T18:55:37.708261] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-01T18:55:37.710580] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T18:55:38.479290] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T18:55:38.502350] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-01T18:55:39.302354] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-01T18:55:39.435002] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T18:55:40.102385] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-01T18:55:40.129867] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-01T18:55:40.873015] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T18:55:40.902424] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-01T18:55:41.702455] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-01T18:55:41.937625] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T18:55:42.502398] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-01T18:55:42.867756] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T18:55:43.302385] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-01T18:55:43.482504] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T18:55:44.102400] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-01T18:55:44.365321] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T18:55:44.786785] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T18:55:44.902407] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-01T18:55:45.702377] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-01T18:55:45.960307] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T18:55:46.502376] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-01T18:55:46.819555] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T18:55:47.302377] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-01T18:55:48.102414] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-01T18:55:48.171732] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T18:55:48.333839] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T18:55:48.902384] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-01T18:55:48.930368] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T18:55:49.702373] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-01T18:55:50.271957] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T18:55:50.502391] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-01T18:55:50.887257] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T18:55:50.888521] [INFO ] [REMOTE ] FF: Full fetch complete (36758 records). [2025-10-01T18:55:50.888602] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-01T18:55:51.303219] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-01T18:55:51.303506] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-01T18:55:51.303613] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-01T18:55:51.305224] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-01T18:55:51.305292] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-01T18:55:51.306417] [DEBUG] [LOCAL ] FF: Trimmed 36758 records to 24977 (keeping 200 days of data) [2025-10-01T18:55:51.470338] [DEBUG] [LOCAL ] FF: Primary data saved (24977 records). [2025-10-01T18:55:51.470480] [INFO ] [MAIN ] FF: Full history saved. [2025-10-01T18:55:51.470567] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FF took 38.2s. Estimated remaining: 3h 37m 24s. Rate: 7.1 symbols/min [2025-10-01T18:55:51.673383] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:51.673629] [DEBUG] [LOCAL ] FGN: No existing data file found in primary storage. [2025-10-01T18:55:51.673738] [WARN ] [MAIN ] FGN: No existing data found, performing full refresh instead. [2025-10-01T18:55:51.689110] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T18:55:51.688577] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-01T18:55:51.694319] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-01T18:55:51.694752] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-01T18:55:51.694816] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-01T18:55:52.104756] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-01T18:55:52.104689] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:52.285632] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T18:55:52.902394] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-01T18:55:53.612839] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T18:55:53.702398] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-01T18:55:53.977871] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T18:55:53.978768] [INFO ] [REMOTE ] FFC: Full fetch complete (24756 records). [2025-10-01T18:55:53.978844] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-01T18:55:54.417374] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-01T18:55:54.417455] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-01T18:55:54.418215] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-01T18:55:54.418279] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-01T18:55:54.418956] [DEBUG] [LOCAL ] FFC: Trimmed 24756 records to 16765 (keeping 200 days of data) [2025-10-01T18:55:54.505350] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-01T18:55:54.542760] [DEBUG] [LOCAL ] FFC: Primary data saved (16765 records). [2025-10-01T18:55:54.542891] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-01T18:55:54.542966] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFC took 31.8s. Estimated remaining: 3h 37m 6s. Rate: 7.1 symbols/min [2025-10-01T18:55:54.731316] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:54.731617] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-01T18:55:54.731718] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-01T18:55:54.731862] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-01T18:55:54.731932] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-01T18:55:54.731995] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-01T18:55:54.732053] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-01T18:55:55.149422] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T18:55:55.171124] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:55.173297] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T18:55:55.302429] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-01T18:55:55.525128] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:55:55.525360] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-01T18:55:55.525445] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:55:55.525516] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-01T18:55:55.525582] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:55:55.525684] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-01T18:55:55.525787] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-01T18:55:55.525846] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-01T18:55:55.525892] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-01T18:55:55.525939] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 1.0s. Estimated remaining: 3h 36m 44s. Rate: 7.1 symbols/min [2025-10-01T18:55:55.711489] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:55:55.757286] [DEBUG] [LOCAL ] FHI: Loaded 40285 existing records from primary storage. [2025-10-01T18:55:55.757596] [INFO ] [MAIN ] FHI: Loaded 40285 existing records. [2025-10-01T18:55:55.960044] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:55:55.960266] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-01T18:55:55.960342] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-01T18:55:55.962181] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-01T18:55:55.962244] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-01T18:55:56.107546] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-01T18:55:56.372850] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:55:56.902393] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-01T18:55:57.341881] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T18:55:57.702438] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-01T18:55:58.287202] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T18:55:58.319346] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T18:55:58.502438] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-01T18:55:59.302416] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-01T18:55:59.691763] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T18:56:00.102386] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-01T18:56:00.537475] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T18:56:00.902399] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-01T18:56:01.195632] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T18:56:01.702399] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-01T18:56:02.064129] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-01T18:56:02.399115] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T18:56:02.502388] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-01T18:56:03.302403] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-01T18:56:03.828106] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T18:56:04.102367] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-01T18:56:04.296636] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T18:56:04.902381] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-01T18:56:05.695774] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T18:56:05.705219] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-01T18:56:06.117615] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-01T18:56:06.502400] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-01T18:56:07.097733] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T18:56:07.169847] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T18:56:07.302386] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-01T18:56:07.878325] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T18:56:08.102386] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-01T18:56:08.902423] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-01T18:56:09.586272] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T18:56:09.702429] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-01T18:56:10.338213] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T18:56:10.424809] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T18:56:10.502403] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-01T18:56:11.302397] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-01T18:56:11.560774] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T18:56:12.102398] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-01T18:56:12.827263] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T18:56:12.902368] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-01T18:56:13.094825] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T18:56:13.096093] [INFO ] [REMOTE ] FFWM: Full fetch complete (51675 records). [2025-10-01T18:56:13.096216] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-01T18:56:13.525403] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-01T18:56:13.525510] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-01T18:56:13.526307] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-01T18:56:13.526400] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-01T18:56:13.528746] [DEBUG] [LOCAL ] FFWM: Trimmed 51675 records to 35720 (keeping 200 days of data) [2025-10-01T18:56:13.714925] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-01T18:56:13.743822] [DEBUG] [LOCAL ] FFWM: Primary data saved (35720 records). [2025-10-01T18:56:13.743954] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-01T18:56:13.744052] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FFWM took 49.6s. Estimated remaining: 3h 36m 54s. Rate: 7.1 symbols/min [2025-10-01T18:56:13.934064] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:56:13.990995] [DEBUG] [LOCAL ] FHN: Loaded 53366 existing records from primary storage. [2025-10-01T18:56:13.991372] [INFO ] [MAIN ] FHN: Loaded 53366 existing records. [2025-10-01T18:56:14.154773] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T18:56:14.232533] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:56:14.232831] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-01T18:56:14.232892] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-01T18:56:14.235403] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-01T18:56:14.235470] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-01T18:56:14.367048] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-01T18:56:14.508462] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-01T18:56:14.676783] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:56:15.302429] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-01T18:56:15.806874] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T18:56:16.008301] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-01T18:56:16.102426] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-01T18:56:16.902405] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-01T18:56:17.702361] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-01T18:56:17.900413] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-01T18:56:18.238901] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T18:56:18.500948] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T18:56:18.508738] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-01T18:56:18.966658] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T18:56:19.302405] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-01T18:56:20.102410] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-01T18:56:20.530714] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T18:56:20.681798] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T18:56:20.682555] [INFO ] [REMOTE ] FGN: Full fetch complete (5801 records). [2025-10-01T18:56:20.682630] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-01T18:56:20.907609] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-01T18:56:21.096931] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-01T18:56:21.097022] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-01T18:56:21.097183] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-01T18:56:21.097223] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-01T18:56:21.097740] [DEBUG] [LOCAL ] FGN: Trimmed 5801 records to 3895 (keeping 200 days of data) [2025-10-01T18:56:21.123031] [DEBUG] [LOCAL ] FGN: Primary data saved (3895 records). [2025-10-01T18:56:21.123203] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-01T18:56:21.123322] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FGN took 29.7s. Estimated remaining: 3h 36m 43s. Rate: 7.1 symbols/min [2025-10-01T18:56:21.327194] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:56:21.391393] [DEBUG] [LOCAL ] FI: Loaded 53499 existing records from primary storage. [2025-10-01T18:56:21.391858] [INFO ] [MAIN ] FI: Loaded 53499 existing records. [2025-10-01T18:56:21.591855] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:56:21.592065] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-01T18:56:21.592116] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-01T18:56:21.595761] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-01T18:56:21.595857] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-01T18:56:21.709518] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-01T18:56:22.020947] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:56:22.502439] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-01T18:56:22.794331] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T18:56:23.144775] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T18:56:23.302394] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-01T18:56:24.102381] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-01T18:56:24.205680] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T18:56:24.881842] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-01T18:56:24.883566] [INFO ] [REMOTE ] FHI: Full fetch complete (57760 records). [2025-10-01T18:56:24.883793] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-01T18:56:24.907512] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-01T18:56:25.333770] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-01T18:56:25.333506] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-01T18:56:25.335023] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-01T18:56:25.336211] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-01T18:56:25.336454] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-01T18:56:25.336357] [INFO ] [REMOTE ] FG: Full fetch complete (27611 records). [2025-10-01T18:56:25.336837] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-01T18:56:25.395450] [DEBUG] [LOCAL ] FHI: Trimmed 57760 records to 40247 (keeping 200 days of data) [2025-10-01T18:56:25.710358] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-01T18:56:25.898226] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-01T18:56:25.898678] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-01T18:56:25.899603] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-01T18:56:25.900251] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-01T18:56:25.902778] [DEBUG] [LOCAL ] FG: Trimmed 27611 records to 22819 (keeping 200 days of data) [2025-10-01T18:56:26.178517] [DEBUG] [LOCAL ] FHI: Primary data saved (40247 records). [2025-10-01T18:56:26.179169] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-01T18:56:26.179505] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FHI took 30.7s. Estimated remaining: 3h 36m 28s. Rate: 7.1 symbols/min [2025-10-01T18:56:26.396623] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:56:26.398100] [DEBUG] [LOCAL ] FG: Primary data saved (22819 records). [2025-10-01T18:56:26.398265] [INFO ] [MAIN ] FG: Full history saved. [2025-10-01T18:56:26.398820] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FG took 51.4s. Estimated remaining: 3h 36m 5s. Rate: 7.1 symbols/min [2025-10-01T18:56:26.600369] [DEBUG] [LOCAL ] FICO: Loaded 20420 existing records from primary storage. [2025-10-01T18:56:26.621097] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:56:26.621541] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-01T18:56:26.621445] [INFO ] [MAIN ] FICO: Loaded 20420 existing records. [2025-10-01T18:56:26.621732] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-01T18:56:26.643705] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-01T18:56:26.672873] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-01T18:56:26.709079] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T18:56:26.707235] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-01T18:56:26.742937] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-01T18:56:26.797181] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-01T18:56:27.000845] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:56:27.005159] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-01T18:56:27.005471] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-01T18:56:27.022300] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-01T18:56:27.032599] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-01T18:56:27.550722] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:56:27.574131] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-01T18:56:27.701551] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:56:27.733683] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T18:56:27.981016] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-01T18:56:28.102386] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-01T18:56:28.315753] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T18:56:28.902386] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-01T18:56:29.146553] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-01T18:56:29.702394] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-01T18:56:29.920809] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T18:56:30.182234] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T18:56:30.502401] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-01T18:56:31.302386] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-01T18:56:32.073285] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T18:56:32.102373] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-01T18:56:32.302317] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T18:56:32.335120] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-01T18:56:32.902391] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-01T18:56:33.235312] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-01T18:56:33.702451] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-01T18:56:34.502432] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-01T18:56:34.843797] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-01T18:56:35.178876] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T18:56:35.302404] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-01T18:56:36.102422] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-01T18:56:36.902352] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-01T18:56:37.082893] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T18:56:37.504295] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T18:56:37.702394] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-01T18:56:38.193572] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T18:56:38.502377] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-01T18:56:38.688482] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:56:38.688879] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-01T18:56:38.688989] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:56:38.689072] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-01T18:56:38.689142] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:56:38.689221] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-01T18:56:38.689293] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-01T18:56:38.689332] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-01T18:56:38.689392] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-01T18:56:38.689546] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FIG took 12.3s. Estimated remaining: 3h 36m 4s. Rate: 7.1 symbols/min [2025-10-01T18:56:38.891701] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:56:38.945063] [DEBUG] [LOCAL ] FIGS: Loaded 48853 existing records from primary storage. [2025-10-01T18:56:38.945403] [INFO ] [MAIN ] FIGS: Loaded 48853 existing records. [2025-10-01T18:56:39.138150] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:56:39.138355] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-01T18:56:39.138401] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-01T18:56:39.141019] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-01T18:56:39.141080] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-01T18:56:39.304939] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-01T18:56:39.559960] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:56:39.595405] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T18:56:40.102385] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-01T18:56:40.539550] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T18:56:40.902375] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-01T18:56:41.460765] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T18:56:41.702353] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-01T18:56:42.010306] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T18:56:42.502389] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-01T18:56:43.302380] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-01T18:56:43.509458] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T18:56:43.533032] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T18:56:44.102379] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-01T18:56:44.702993] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T18:56:44.902372] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-01T18:56:45.363571] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T18:56:45.702398] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-01T18:56:46.502382] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-01T18:56:46.900718] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-01T18:56:47.251785] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T18:56:47.302345] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-01T18:56:48.077194] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T18:56:48.102348] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-01T18:56:48.683755] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T18:56:48.902378] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-01T18:56:49.691796] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T18:56:49.702283] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-01T18:56:49.760409] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T18:56:50.502415] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-01T18:56:51.302378] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-01T18:56:51.431210] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T18:56:51.886804] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T18:56:52.102418] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-01T18:56:52.901706] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T18:56:52.912235] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-01T18:56:53.702363] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-01T18:56:53.756521] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T18:56:54.328666] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T18:56:54.502405] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-01T18:56:55.302392] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-01T18:56:55.672397] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T18:56:55.828320] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T18:56:56.102419] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-01T18:56:56.902406] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-01T18:56:57.538361] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T18:56:57.540068] [INFO ] [REMOTE ] FHN: Full fetch complete (77279 records). [2025-10-01T18:56:57.540194] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-01T18:56:57.707535] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-01T18:56:57.983896] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-01T18:56:57.984145] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-01T18:56:57.996867] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-01T18:56:57.998128] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T18:56:57.997555] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-01T18:56:58.004629] [DEBUG] [LOCAL ] FHN: Trimmed 77279 records to 53365 (keeping 200 days of data) [2025-10-01T18:56:58.384275] [DEBUG] [LOCAL ] FHN: Primary data saved (53365 records). [2025-10-01T18:56:58.384474] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-01T18:56:58.384586] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FHN took 44.6s. Estimated remaining: 3h 36m 16s. Rate: 7.1 symbols/min [2025-10-01T18:56:58.507479] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-01T18:56:58.577939] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:56:58.618815] [DEBUG] [LOCAL ] FIHL: Loaded 39905 existing records from primary storage. [2025-10-01T18:56:58.619116] [INFO ] [MAIN ] FIHL: Loaded 39905 existing records. [2025-10-01T18:56:58.812235] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:56:58.812428] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-01T18:56:58.812476] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-01T18:56:58.812844] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-01T18:56:58.812904] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-01T18:56:58.921702] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-01T18:56:58.931283] [INFO ] [REMOTE ] FI: Full fetch complete (77173 records). [2025-10-01T18:56:58.946896] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-01T18:56:59.445058] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:56:59.467472] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-01T18:56:59.652091] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T18:56:59.722387] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-01T18:56:59.722472] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-01T18:56:59.723366] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-01T18:56:59.723432] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-01T18:56:59.725023] [DEBUG] [LOCAL ] FI: Trimmed 77173 records to 53499 (keeping 200 days of data) [2025-10-01T18:57:00.038408] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-01T18:57:00.040508] [INFO ] [REMOTE ] FICO: Full fetch complete (28458 records). [2025-10-01T18:57:00.040911] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-01T18:57:00.104679] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-01T18:57:00.474626] [DEBUG] [LOCAL ] FI: Primary data saved (53499 records). [2025-10-01T18:57:00.479903] [INFO ] [MAIN ] FI: Full history saved. [2025-10-01T18:57:00.487143] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FI took 39.4s. Estimated remaining: 3h 35m 56s. Rate: 7.1 symbols/min [2025-10-01T18:57:00.499768] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-01T18:57:00.499930] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-01T18:57:00.535332] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-01T18:57:00.563947] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-01T18:57:00.641387] [DEBUG] [LOCAL ] FICO: Trimmed 28458 records to 20486 (keeping 200 days of data) [2025-10-01T18:57:00.803752] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:00.821137] [DEBUG] [LOCAL ] FINS: Loaded 8282 existing records from primary storage. [2025-10-01T18:57:00.822295] [INFO ] [MAIN ] FINS: Loaded 8282 existing records. [2025-10-01T18:57:01.041677] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:57:01.043828] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-01T18:57:01.044164] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-01T18:57:01.045916] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-01T18:57:01.046535] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-01T18:57:01.189671] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T18:57:01.214941] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-01T18:57:01.307002] [DEBUG] [LOCAL ] FICO: Primary data saved (20486 records). [2025-10-01T18:57:01.334075] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-01T18:57:01.348390] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FICO took 35.2s. Estimated remaining: 3h 35m 34s. Rate: 7.1 symbols/min [2025-10-01T18:57:01.714986] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:01.751713] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-01T18:57:01.751420] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:01.798518] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T18:57:01.851112] [DEBUG] [LOCAL ] FINV: Loaded 45240 existing records from primary storage. [2025-10-01T18:57:01.851547] [INFO ] [MAIN ] FINV: Loaded 45240 existing records. [2025-10-01T18:57:02.056973] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:57:02.057266] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-01T18:57:02.057337] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-01T18:57:02.058066] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-01T18:57:02.058126] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-01T18:57:02.432814] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T18:57:02.507442] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:02.502952] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-01T18:57:02.679142] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T18:57:03.302376] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-01T18:57:04.107848] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-01T18:57:04.113358] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T18:57:04.626333] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T18:57:04.654312] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T18:57:04.902396] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-01T18:57:05.702776] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-01T18:57:06.306860] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T18:57:06.502388] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-01T18:57:07.081427] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T18:57:07.302428] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-01T18:57:07.530006] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T18:57:08.102416] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-01T18:57:08.548917] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T18:57:08.902404] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-01T18:57:09.581914] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T18:57:09.632623] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:57:09.702386] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-01T18:57:10.502405] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-01T18:57:11.302363] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-01T18:57:11.346212] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T18:57:11.702153] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T18:57:12.102384] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-01T18:57:12.720429] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T18:57:12.902391] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-01T18:57:13.481284] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T18:57:13.702390] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-01T18:57:14.502394] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-01T18:57:14.767188] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T18:57:15.123726] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T18:57:15.302400] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-01T18:57:16.034747] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T18:57:16.102369] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-01T18:57:16.382395] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T18:57:16.902394] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-01T18:57:17.629015] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T18:57:17.702366] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-01T18:57:18.502394] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-01T18:57:19.159890] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-01T18:57:19.161513] [INFO ] [REMOTE ] FIGS: Full fetch complete (71004 records). [2025-10-01T18:57:19.161617] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-01T18:57:19.307182] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-01T18:57:19.528605] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T18:57:19.628320] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-01T18:57:19.628406] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-01T18:57:19.629296] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-01T18:57:19.629362] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-01T18:57:19.630740] [DEBUG] [LOCAL ] FIGS: Trimmed 71004 records to 48826 (keeping 200 days of data) [2025-10-01T18:57:19.917542] [DEBUG] [LOCAL ] FIGS: Primary data saved (48826 records). [2025-10-01T18:57:19.917700] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-01T18:57:19.917853] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 41.2s. Estimated remaining: 3h 35m 44s. Rate: 7.1 symbols/min [2025-10-01T18:57:20.062884] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-01T18:57:20.117525] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-01T18:57:20.125620] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:20.181249] [DEBUG] [LOCAL ] FIS: Loaded 53363 existing records from primary storage. [2025-10-01T18:57:20.181592] [INFO ] [MAIN ] FIS: Loaded 53363 existing records. [2025-10-01T18:57:20.400518] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:57:20.415940] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T18:57:20.414718] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-01T18:57:20.426374] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-01T18:57:20.431945] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-01T18:57:20.432060] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-01T18:57:20.830079] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:20.897361] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T18:57:20.902326] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-01T18:57:21.702367] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-01T18:57:21.741877] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T18:57:22.502378] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-01T18:57:22.934135] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T18:57:23.270368] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T18:57:23.302353] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-01T18:57:24.099791] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T18:57:24.102422] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-01T18:57:24.857399] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T18:57:24.902370] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-01T18:57:25.702476] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-01T18:57:26.321298] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T18:57:26.437844] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T18:57:26.502374] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-01T18:57:27.302387] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-01T18:57:27.898697] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T18:57:28.102410] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-01T18:57:28.120901] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T18:57:28.121828] [INFO ] [REMOTE ] FINS: Full fetch complete (12382 records). [2025-10-01T18:57:28.121900] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-01T18:57:28.503785] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-01T18:57:28.503864] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-01T18:57:28.504154] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-01T18:57:28.504194] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-01T18:57:28.504703] [DEBUG] [LOCAL ] FINS: Trimmed 12382 records to 8293 (keeping 200 days of data) [2025-10-01T18:57:28.557705] [DEBUG] [LOCAL ] FINS: Primary data saved (8293 records). [2025-10-01T18:57:28.557898] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-01T18:57:28.557992] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 28.1s. Estimated remaining: 3h 35m 36s. Rate: 7.1 symbols/min [2025-10-01T18:57:28.738445] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:28.768740] [DEBUG] [LOCAL ] FIX: Loaded 29896 existing records from primary storage. [2025-10-01T18:57:28.769003] [INFO ] [MAIN ] FIX: Loaded 29896 existing records. [2025-10-01T18:57:28.907482] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-01T18:57:28.967958] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:57:28.968176] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-01T18:57:28.968226] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-01T18:57:28.969392] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-01T18:57:28.969458] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-01T18:57:29.349117] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:29.702388] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-01T18:57:30.148530] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T18:57:30.150124] [INFO ] [REMOTE ] FINV: Full fetch complete (63515 records). [2025-10-01T18:57:30.150247] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-01T18:57:30.509915] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-01T18:57:30.571416] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-01T18:57:30.571535] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-01T18:57:30.572616] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-01T18:57:30.572800] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-01T18:57:30.574504] [DEBUG] [LOCAL ] FINV: Trimmed 63515 records to 45304 (keeping 200 days of data) [2025-10-01T18:57:30.827326] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-01T18:57:30.894241] [DEBUG] [LOCAL ] FINV: Primary data saved (45304 records). [2025-10-01T18:57:30.894377] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-01T18:57:30.894487] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FINV took 29.5s. Estimated remaining: 3h 35m 16s. Rate: 7.1 symbols/min [2025-10-01T18:57:31.302364] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-01T18:57:31.355044] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-01T18:57:31.356479] [INFO ] [REMOTE ] FIHL: Full fetch complete (55817 records). [2025-10-01T18:57:31.356597] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-01T18:57:31.783309] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-01T18:57:31.783440] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-01T18:57:31.784308] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-01T18:57:31.784375] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-01T18:57:31.785725] [DEBUG] [LOCAL ] FIHL: Trimmed 55817 records to 39863 (keeping 200 days of data) [2025-10-01T18:57:31.891592] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T18:57:32.064099] [DEBUG] [LOCAL ] FIHL: Primary data saved (39863 records). [2025-10-01T18:57:32.064249] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-01T18:57:32.064336] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIHL took 33.7s. Estimated remaining: 3h 34m 54s. Rate: 7.1 symbols/min [2025-10-01T18:57:32.102451] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-01T18:57:33.015874] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T18:57:33.032447] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-01T18:57:33.593042] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T18:57:33.702382] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-01T18:57:34.565663] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T18:57:34.579721] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-01T18:57:34.908616] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T18:57:35.302400] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-01T18:57:36.031566] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T18:57:36.102420] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-01T18:57:36.823437] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T18:57:36.902374] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-01T18:57:37.763365] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T18:57:37.774762] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-01T18:57:38.515910] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T18:57:38.524238] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-01T18:57:39.345837] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T18:57:39.357236] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-01T18:57:39.577097] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T18:57:40.102380] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-01T18:57:40.752510] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T18:57:40.902380] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-01T18:57:41.329909] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T18:57:41.702380] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-01T18:57:42.750280] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T18:57:42.762281] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-01T18:57:42.844453] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T18:57:43.302378] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-01T18:57:44.509666] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T18:57:44.522286] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-01T18:57:44.545433] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T18:57:44.902390] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-01T18:57:46.178144] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T18:57:46.185071] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-01T18:57:46.283727] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T18:57:46.502382] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-01T18:57:47.789949] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-01T18:57:47.791094] [INFO ] [REMOTE ] FIX: Full fetch complete (45550 records). [2025-10-01T18:57:47.791185] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-01T18:57:48.205607] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-01T18:57:48.205719] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-01T18:57:48.206441] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-01T18:57:48.206504] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-01T18:57:48.207580] [DEBUG] [LOCAL ] FIX: Trimmed 45550 records to 29792 (keeping 200 days of data) [2025-10-01T18:57:48.402441] [DEBUG] [LOCAL ] FIX: Primary data saved (29792 records). [2025-10-01T18:57:48.402587] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-01T18:57:48.402701] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 19.8s. Estimated remaining: 3h 35m 1s. Rate: 7.1 symbols/min [2025-10-01T18:57:48.769180] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T18:57:48.771353] [INFO ] [REMOTE ] FIS: Full fetch complete (77176 records). [2025-10-01T18:57:48.771485] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-01T18:57:49.228942] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-01T18:57:49.229073] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-01T18:57:49.230151] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-01T18:57:49.230216] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-01T18:57:49.231752] [DEBUG] [LOCAL ] FIS: Trimmed 77176 records to 53361 (keeping 200 days of data) [2025-10-01T18:57:49.594905] [DEBUG] [LOCAL ] FIS: Primary data saved (53361 records). [2025-10-01T18:57:49.595067] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-01T18:57:49.595167] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIS took 29.7s. Estimated remaining: 3h 34m 39s. Rate: 7.1 symbols/min [2025-10-01T18:57:50.292926] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:50.350470] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:50.372636] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:50.411264] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-01T18:57:50.411193] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:50.411673] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-01T18:57:50.412054] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-01T18:57:50.412122] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-01T18:57:50.412201] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-01T18:57:50.412394] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-01T18:57:50.515108] [DEBUG] [LOCAL ] FLC: Loaded 5462 existing records from primary storage. [2025-10-01T18:57:50.543517] [INFO ] [MAIN ] FLC: Loaded 5462 existing records. [2025-10-01T18:57:50.795822] [DEBUG] [LOCAL ] FLNG: Loaded 33756 existing records from primary storage. [2025-10-01T18:57:50.828610] [INFO ] [MAIN ] FLNG: Loaded 33756 existing records. [2025-10-01T18:57:51.001409] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:57:51.070413] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-01T18:57:51.111911] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-01T18:57:51.156338] [DEBUG] [LOCAL ] FLG: Loaded 53321 existing records from primary storage. [2025-10-01T18:57:51.199073] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-01T18:57:51.203318] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-01T18:57:51.203233] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:51.208747] [INFO ] [MAIN ] FLG: Loaded 53321 existing records. [2025-10-01T18:57:51.216264] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-01T18:57:51.461447] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:57:51.505147] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-01T18:57:51.510615] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-01T18:57:51.545561] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:57:51.556172] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-01T18:57:51.597933] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-01T18:57:51.631935] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:57:51.637360] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:57:51.647929] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-01T18:57:51.648359] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-01T18:57:51.653680] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-01T18:57:51.648050] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-01T18:57:51.694075] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:57:51.693958] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-01T18:57:51.706007] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-01T18:57:51.744150] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-01T18:57:51.743992] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-01T18:57:51.787013] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-01T18:57:51.863782] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-01T18:57:51.942902] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.3s. Estimated remaining: 3h 34m 20s. Rate: 7.1 symbols/min [2025-10-01T18:57:52.493045] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:52.633606] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-01T18:57:52.896102] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:57:52.968170] [DEBUG] [LOCAL ] FLO: No existing data file found in primary storage. [2025-10-01T18:57:52.945977] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:52.983843] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-01T18:57:52.974351] [WARN ] [MAIN ] FLO: No existing data found, performing full refresh instead. [2025-10-01T18:57:53.012504] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-01T18:57:53.012832] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-01T18:57:53.017210] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:53.017595] [DEBUG] [LOCAL ] FLO: No primary data file found to delete. [2025-10-01T18:57:53.017945] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-01T18:57:53.024174] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-01T18:57:53.359189] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T18:57:53.361538] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-01T18:57:53.483311] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:57:53.483624] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-01T18:57:53.995603] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T18:57:53.998261] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-01T18:57:54.433498] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-01T18:57:54.435160] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-01T18:57:54.508177] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T18:57:54.516939] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-01T18:57:54.637382] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T18:57:54.648551] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-01T18:57:54.990791] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-01T18:57:55.200961] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T18:57:55.302375] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-01T18:57:55.851702] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T18:57:55.929378] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T18:57:56.102398] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-01T18:57:56.454142] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T18:57:56.902390] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-01T18:57:57.321827] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T18:57:57.702406] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-01T18:57:58.469392] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T18:57:58.502406] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-01T18:57:59.039992] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T18:57:59.223378] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T18:57:59.302420] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-01T18:58:00.102398] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-01T18:58:00.902359] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-01T18:58:01.129613] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T18:58:01.672361] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T18:58:01.702331] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-01T18:58:02.345115] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T18:58:02.502398] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-01T18:58:03.302405] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-01T18:58:04.102390] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-01T18:58:06.418690] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (3.92 seconds). [2025-10-01T18:58:06.420562] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-01T18:58:07.135929] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T18:58:07.137686] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-01T18:58:07.581324] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-01T18:58:07.584194] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-01T18:58:07.736131] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (3.63 seconds). [2025-10-01T18:58:07.747373] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-01T18:58:07.993252] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (6.29 seconds). [2025-10-01T18:58:08.102420] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-01T18:58:09.365843] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T18:58:09.379088] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-01T18:58:09.400327] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T18:58:09.444724] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T18:58:09.702429] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-01T18:58:10.106130] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (6.80 seconds). [2025-10-01T18:58:10.502354] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-01T18:58:10.984988] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T18:58:11.012071] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T18:58:11.302421] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-01T18:58:12.102356] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-01T18:58:12.358635] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T18:58:12.850036] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T18:58:12.874072] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T18:58:12.902371] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-01T18:58:13.702373] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-01T18:58:14.502402] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-01T18:58:15.302450] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-01T18:58:16.178450] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-10-01T18:58:16.189814] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-01T18:58:16.618884] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-01T18:58:16.619895] [INFO ] [REMOTE ] FLC: Full fetch complete (7958 records). [2025-10-01T18:58:16.620174] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-01T18:58:17.042151] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-01T18:58:17.065878] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-01T18:58:17.070706] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-01T18:58:17.071119] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-01T18:58:17.072635] [DEBUG] [LOCAL ] FLC: Trimmed 7958 records to 5422 (keeping 200 days of data) [2025-10-01T18:58:17.076547] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-10-01T18:58:17.091967] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-01T18:58:17.130372] [DEBUG] [LOCAL ] FLC: Primary data saved (5422 records). [2025-10-01T18:58:17.130518] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-01T18:58:17.130603] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 27.5s. Estimated remaining: 3h 34m 42s. Rate: 7.1 symbols/min [2025-10-01T18:58:17.311049] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:58:17.311311] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-01T18:58:17.311363] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-01T18:58:17.311550] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-01T18:58:17.311600] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-01T18:58:17.311683] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-01T18:58:17.311759] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-01T18:58:17.709347] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:58:17.709665] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-01T18:58:18.207692] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T18:58:18.255082] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T18:58:18.255515] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-01T18:58:18.255620] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T18:58:18.255722] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-01T18:58:18.255792] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T18:58:18.255881] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-01T18:58:18.255958] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-01T18:58:18.255997] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-01T18:58:18.256038] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-01T18:58:18.256085] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 1.1s. Estimated remaining: 3h 34m 20s. Rate: 7.1 symbols/min [2025-10-01T18:58:18.434624] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (3.93 seconds). [2025-10-01T18:58:18.492468] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:58:18.510599] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-01T18:58:18.537133] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T18:58:18.603294] [DEBUG] [LOCAL ] FLR: Loaded 53116 existing records from primary storage. [2025-10-01T18:58:18.603639] [INFO ] [MAIN ] FLR: Loaded 53116 existing records. [2025-10-01T18:58:18.798757] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:58:18.799013] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-01T18:58:18.799064] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-01T18:58:18.800902] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-01T18:58:18.800968] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-01T18:58:19.197911] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:58:19.302369] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-01T18:58:20.102407] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-01T18:58:20.549382] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T18:58:20.902445] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-01T18:58:20.984797] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T18:58:21.345853] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T18:58:21.702403] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-01T18:58:22.511841] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-01T18:58:22.537118] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T18:58:23.302425] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-01T18:58:23.549860] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-01T18:58:23.551286] [INFO ] [REMOTE ] FLNG: Full fetch complete (50635 records). [2025-10-01T18:58:23.551417] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-01T18:58:24.007226] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-01T18:58:24.007397] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-01T18:58:24.008245] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-01T18:58:24.008328] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-01T18:58:24.009758] [DEBUG] [LOCAL ] FLNG: Trimmed 50635 records to 33707 (keeping 200 days of data) [2025-10-01T18:58:24.104761] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-01T18:58:24.151953] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T18:58:24.279591] [DEBUG] [LOCAL ] FLNG: Primary data saved (33707 records). [2025-10-01T18:58:24.279765] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-01T18:58:24.279861] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLNG took 34.7s. Estimated remaining: 3h 34m 7s. Rate: 7.1 symbols/min [2025-10-01T18:58:24.488523] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:58:24.542847] [DEBUG] [LOCAL ] FLS: Loaded 50162 existing records from primary storage. [2025-10-01T18:58:24.543213] [INFO ] [MAIN ] FLS: Loaded 50162 existing records. [2025-10-01T18:58:24.775762] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:58:24.775980] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-01T18:58:24.776030] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-01T18:58:24.777462] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-01T18:58:24.777533] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-01T18:58:24.903820] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-01T18:58:25.203062] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:58:25.237493] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T18:58:25.702391] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-01T18:58:26.502405] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-01T18:58:26.677395] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-01T18:58:26.680467] [INFO ] [REMOTE ] FLO: Full fetch complete (75016 records). [2025-10-01T18:58:26.680594] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-01T18:58:27.104602] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-01T18:58:27.104719] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-01T18:58:27.105749] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-01T18:58:27.105842] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-01T18:58:27.107376] [DEBUG] [LOCAL ] FLO: Trimmed 75016 records to 51910 (keeping 200 days of data) [2025-10-01T18:58:27.446754] [DEBUG] [LOCAL ] FLO: Primary data saved (51910 records). [2025-10-01T18:58:27.446905] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-01T18:58:27.446982] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLO took 35.4s. Estimated remaining: 3h 33m 49s. Rate: 7.1 symbols/min [2025-10-01T18:58:27.636570] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:58:27.673072] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-01T18:58:27.676157] [INFO ] [REMOTE ] FLG: Full fetch complete (77303 records). [2025-10-01T18:58:27.676397] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-01T18:58:27.825588] [DEBUG] [LOCAL ] FLUT: Loaded 50769 existing records from primary storage. [2025-10-01T18:58:27.837049] [INFO ] [MAIN ] FLUT: Loaded 50769 existing records. [2025-10-01T18:58:28.318278] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:58:28.377879] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-01T18:58:28.401529] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-01T18:58:28.401781] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-01T18:58:28.402285] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-01T18:58:28.403486] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-01T18:58:28.403625] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-01T18:58:28.403889] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-01T18:58:28.404487] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-01T18:58:28.536268] [DEBUG] [LOCAL ] FLG: Trimmed 77303 records to 53320 (keeping 200 days of data) [2025-10-01T18:58:28.530575] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-10-01T18:58:28.584733] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-01T18:58:28.840436] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-01T18:58:28.894007] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-01T18:58:29.014265] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:58:29.014932] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-01T18:58:29.260667] [DEBUG] [LOCAL ] FLG: Primary data saved (53320 records). [2025-10-01T18:58:29.260819] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-01T18:58:29.260920] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLG took 39.7s. Estimated remaining: 3h 33m 29s. Rate: 7.1 symbols/min [2025-10-01T18:58:29.446387] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:58:29.467603] [DEBUG] [LOCAL ] FLXR: Loaded 20265 existing records from primary storage. [2025-10-01T18:58:29.467917] [INFO ] [MAIN ] FLXR: Loaded 20265 existing records. [2025-10-01T18:58:29.660795] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:58:29.661054] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-01T18:58:29.661115] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-01T18:58:29.661785] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-01T18:58:29.661846] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-01T18:58:30.057721] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:58:30.058103] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-01T18:58:30.433151] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T18:58:30.492537] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T18:58:30.502703] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-01T18:58:30.597209] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T18:58:30.849497] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T18:58:31.302407] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-01T18:58:31.897056] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T18:58:32.065389] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T18:58:32.102384] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-01T18:58:32.867119] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T18:58:32.902406] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-01T18:58:33.702409] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-01T18:58:34.262970] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T18:58:34.502434] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-01T18:58:35.307962] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-01T18:58:35.323627] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T18:58:35.837529] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T18:58:36.102382] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-01T18:58:36.271052] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T18:58:36.902402] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-01T18:58:37.642768] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T18:58:37.702394] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-01T18:58:38.204495] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T18:58:38.502393] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-01T18:58:39.302401] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-01T18:58:39.519105] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T18:58:39.857574] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T18:58:40.102385] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-01T18:58:40.886704] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T18:58:40.902332] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-01T18:58:41.702392] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-01T18:58:41.942002] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T18:58:42.319014] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T18:58:42.352573] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T18:58:42.502392] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-01T18:58:43.302386] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-01T18:58:43.526418] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T18:58:44.102403] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-01T18:58:44.824828] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T18:58:44.902359] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-01T18:58:45.702392] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-01T18:58:45.859375] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T18:58:46.200015] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T18:58:46.502409] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-01T18:58:46.682695] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T18:58:47.302381] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-01T18:58:48.072999] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T18:58:48.102396] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-01T18:58:48.902419] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-01T18:58:49.194156] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T18:58:49.580555] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T18:58:49.702428] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-01T18:58:50.374715] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T18:58:50.473602] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T18:58:50.502339] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-01T18:58:51.302409] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-01T18:58:51.600474] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T18:58:52.102376] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-01T18:58:52.902415] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-01T18:58:53.024720] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T18:58:53.702425] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-01T18:58:54.303292] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-01T18:58:54.305196] [INFO ] [REMOTE ] FLS: Full fetch complete (71575 records). [2025-10-01T18:58:54.305319] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-01T18:58:54.505174] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-01T18:58:54.749023] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-01T18:58:54.749192] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-01T18:58:54.750327] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-01T18:58:54.750476] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-01T18:58:54.752418] [DEBUG] [LOCAL ] FLS: Trimmed 71575 records to 50175 (keeping 200 days of data) [2025-10-01T18:58:54.785922] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T18:58:54.915447] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T18:58:55.157325] [DEBUG] [LOCAL ] FLS: Primary data saved (50175 records). [2025-10-01T18:58:55.157503] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-01T18:58:55.157612] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLS took 30.9s. Estimated remaining: 3h 33m 52s. Rate: 7.1 symbols/min [2025-10-01T18:58:55.307553] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-01T18:58:55.342856] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:58:55.393159] [DEBUG] [LOCAL ] FMC: Loaded 51779 existing records from primary storage. [2025-10-01T18:58:55.393543] [INFO ] [MAIN ] FMC: Loaded 51779 existing records. [2025-10-01T18:58:55.584881] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:58:55.585177] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-01T18:58:55.585236] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-01T18:58:55.586710] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-01T18:58:55.586772] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-01T18:58:55.979119] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:58:56.102393] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-01T18:58:56.166525] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T18:58:56.902378] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-01T18:58:57.034254] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T18:58:57.483532] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T18:58:57.485080] [INFO ] [REMOTE ] FLXR: Full fetch complete (25599 records). [2025-10-01T18:58:57.485167] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-01T18:58:57.712929] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-01T18:58:57.894248] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-01T18:58:57.894333] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-01T18:58:57.894941] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-01T18:58:57.895005] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-01T18:58:57.895782] [DEBUG] [LOCAL ] FLXR: Trimmed 25599 records to 20437 (keeping 200 days of data) [2025-10-01T18:58:58.026185] [DEBUG] [LOCAL ] FLXR: Primary data saved (20437 records). [2025-10-01T18:58:58.026320] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-01T18:58:58.026405] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLXR took 28.8s. Estimated remaining: 3h 33m 34s. Rate: 7.1 symbols/min [2025-10-01T18:58:58.216274] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:58:58.225281] [DEBUG] [LOCAL ] FMN: Loaded 5711 existing records from primary storage. [2025-10-01T18:58:58.225543] [INFO ] [MAIN ] FMN: Loaded 5711 existing records. [2025-10-01T18:58:58.425020] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:58:58.425265] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-01T18:58:58.425446] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-01T18:58:58.425891] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-01T18:58:58.425966] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-01T18:58:58.503186] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-01T18:58:58.838227] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T18:58:58.860564] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:58:59.302369] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-01T18:58:59.635356] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-01T18:59:00.102370] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-01T18:59:00.902467] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-01T18:59:00.998710] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-01T18:59:01.000474] [INFO ] [REMOTE ] FLR: Full fetch complete (76425 records). [2025-10-01T18:59:01.000577] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-01T18:59:01.453117] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-01T18:59:01.453230] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-01T18:59:01.454226] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-01T18:59:01.454312] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-01T18:59:01.456664] [DEBUG] [LOCAL ] FLR: Trimmed 76425 records to 53125 (keeping 200 days of data) [2025-10-01T18:59:01.579484] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T18:59:01.717018] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-01T18:59:01.717570] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-01T18:59:01.821973] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-01T18:59:01.826440] [INFO ] [REMOTE ] FLUT: Full fetch complete (72852 records). [2025-10-01T18:59:01.834074] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-01T18:59:01.896299] [DEBUG] [LOCAL ] FLR: Primary data saved (53125 records). [2025-10-01T18:59:01.919429] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-01T18:59:01.932035] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLR took 43.7s. Estimated remaining: 3h 33m 17s. Rate: 7.1 symbols/min [2025-10-01T18:59:02.353992] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:59:02.504266] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-01T18:59:02.530207] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-01T18:59:02.530312] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-01T18:59:02.531342] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-01T18:59:02.532357] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-01T18:59:02.544059] [DEBUG] [LOCAL ] FMS: Loaded 30147 existing records from primary storage. [2025-10-01T18:59:02.544499] [INFO ] [MAIN ] FMS: Loaded 30147 existing records. [2025-10-01T18:59:02.557330] [DEBUG] [LOCAL ] FLUT: Trimmed 72852 records to 50788 (keeping 200 days of data) [2025-10-01T18:59:02.850631] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:59:02.856871] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-01T18:59:02.868836] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-01T18:59:02.873769] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-01T18:59:02.875468] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-01T18:59:03.480713] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:59:03.482398] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T18:59:03.483427] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-01T18:59:03.506386] [DEBUG] [LOCAL ] FLUT: Primary data saved (50788 records). [2025-10-01T18:59:03.506529] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-01T18:59:03.506709] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 36.1s. Estimated remaining: 3h 32m 57s. Rate: 7.1 symbols/min [2025-10-01T18:59:03.675639] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-01T18:59:03.737373] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:59:03.777319] [DEBUG] [LOCAL ] FMX: Loaded 40706 existing records from primary storage. [2025-10-01T18:59:03.777672] [INFO ] [MAIN ] FMX: Loaded 40706 existing records. [2025-10-01T18:59:03.981843] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:59:03.982049] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-01T18:59:03.982097] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-01T18:59:03.983701] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-01T18:59:03.983766] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-01T18:59:04.107528] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-01T18:59:04.376443] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:59:04.737453] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T18:59:04.902359] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-01T18:59:04.964728] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T18:59:05.702379] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-01T18:59:06.359530] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T18:59:06.375212] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-01T18:59:06.502382] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-01T18:59:07.215998] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T18:59:07.302416] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-01T18:59:07.866909] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-01T18:59:08.102375] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-01T18:59:08.902434] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-01T18:59:09.702348] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-01T18:59:09.752173] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T18:59:10.034142] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T18:59:10.082253] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-01T18:59:10.502389] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-01T18:59:11.302427] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-01T18:59:12.112728] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-01T18:59:12.119908] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T18:59:12.374961] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T18:59:12.902392] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-01T18:59:12.923260] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T18:59:13.702367] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-01T18:59:13.991511] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T18:59:14.502376] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-01T18:59:14.583280] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T18:59:15.302407] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-01T18:59:15.888198] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T18:59:15.900299] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T18:59:16.102387] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-01T18:59:16.902389] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-01T18:59:17.508439] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T18:59:17.702377] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-01T18:59:18.276487] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T18:59:18.377504] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T18:59:18.502389] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-01T18:59:19.302414] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-01T18:59:19.768622] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T18:59:20.102444] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-01T18:59:20.864183] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-01T18:59:20.864985] [INFO ] [REMOTE ] FMN: Full fetch complete (9960 records). [2025-10-01T18:59:20.865061] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-01T18:59:20.912416] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-01T18:59:21.122090] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T18:59:21.340439] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-01T18:59:21.340562] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-01T18:59:21.340839] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-01T18:59:21.340914] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-01T18:59:21.341434] [DEBUG] [LOCAL ] FMN: Trimmed 9960 records to 5591 (keeping 200 days of data) [2025-10-01T18:59:21.376968] [DEBUG] [LOCAL ] FMN: Primary data saved (5591 records). [2025-10-01T18:59:21.377111] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-01T18:59:21.377210] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 23.4s. Estimated remaining: 3h 33m 5s. Rate: 7.1 symbols/min [2025-10-01T18:59:21.573400] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:59:21.578040] [DEBUG] [LOCAL ] FMY: Loaded 1401 existing records from primary storage. [2025-10-01T18:59:21.578310] [INFO ] [MAIN ] FMY: Loaded 1401 existing records. [2025-10-01T18:59:21.707553] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-01T18:59:21.771534] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:59:21.771762] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-01T18:59:21.771816] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-01T18:59:21.772052] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-01T18:59:21.772110] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-01T18:59:22.170846] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:59:22.469358] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T18:59:22.502361] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-01T18:59:22.615285] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T18:59:23.302400] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-01T18:59:23.787563] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T18:59:24.102381] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-01T18:59:24.380515] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-01T18:59:24.902437] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-01T18:59:25.106118] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T18:59:25.702396] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-01T18:59:26.502385] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-01T18:59:26.608540] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T18:59:26.894859] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T18:59:27.302488] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-01T18:59:28.101422] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T18:59:28.111339] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-01T18:59:28.770520] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T18:59:28.902380] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-01T18:59:29.258885] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-01T18:59:29.404751] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T18:59:29.702383] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-01T18:59:30.343926] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T18:59:30.502385] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-01T18:59:30.726615] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-01T18:59:31.302388] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-01T18:59:31.906723] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T18:59:32.102390] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-01T18:59:32.902383] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-01T18:59:33.702356] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-01T18:59:33.984513] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T18:59:34.321350] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T18:59:34.502367] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-01T18:59:34.853620] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-01T18:59:35.189991] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-01T18:59:35.191246] [INFO ] [REMOTE ] FMS: Full fetch complete (42419 records). [2025-10-01T18:59:35.191330] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-01T18:59:35.307520] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-01T18:59:35.637379] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-01T18:59:35.637484] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-01T18:59:35.638365] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-01T18:59:35.638447] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-01T18:59:35.639702] [DEBUG] [LOCAL ] FMS: Trimmed 42419 records to 30083 (keeping 200 days of data) [2025-10-01T18:59:35.830180] [DEBUG] [LOCAL ] FMS: Primary data saved (30083 records). [2025-10-01T18:59:35.830375] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-01T18:59:35.830513] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMS took 33.9s. Estimated remaining: 3h 33m 7s. Rate: 7.1 symbols/min [2025-10-01T18:59:36.041167] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:59:36.081217] [DEBUG] [LOCAL ] FN: Loaded 38754 existing records from primary storage. [2025-10-01T18:59:36.081510] [INFO ] [MAIN ] FN: Loaded 38754 existing records. [2025-10-01T18:59:36.107535] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-01T18:59:36.286922] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:59:36.287197] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-01T18:59:36.287262] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-01T18:59:36.288788] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-01T18:59:36.288863] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-01T18:59:36.685859] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:59:36.902387] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-01T18:59:37.262615] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-01T18:59:37.508192] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T18:59:37.605227] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T18:59:37.607209] [INFO ] [REMOTE ] FMC: Full fetch complete (75099 records). [2025-10-01T18:59:37.607401] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-01T18:59:37.707542] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-01T18:59:38.057057] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-01T18:59:38.057153] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-01T18:59:38.058176] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-01T18:59:38.058248] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-01T18:59:38.059783] [DEBUG] [LOCAL ] FMC: Trimmed 75099 records to 51782 (keeping 200 days of data) [2025-10-01T18:59:38.408508] [DEBUG] [LOCAL ] FMC: Primary data saved (51782 records). [2025-10-01T18:59:38.408676] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-01T18:59:38.408807] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMC took 43.3s. Estimated remaining: 3h 32m 49s. Rate: 7.1 symbols/min [2025-10-01T18:59:38.509639] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-01T18:59:38.601325] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:59:38.663158] [DEBUG] [LOCAL ] FNB: Loaded 52455 existing records from primary storage. [2025-10-01T18:59:38.663634] [INFO ] [MAIN ] FNB: Loaded 52455 existing records. [2025-10-01T18:59:38.908414] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:59:38.909322] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-01T18:59:38.909465] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-01T18:59:38.911023] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-01T18:59:38.911101] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-01T18:59:39.158405] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T18:59:39.214612] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T18:59:39.307495] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-01T18:59:39.412209] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:59:40.102380] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-01T18:59:40.470702] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-01T18:59:40.900145] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T18:59:40.908637] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-01T18:59:41.702380] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-01T18:59:42.141952] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T18:59:42.502374] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-01T18:59:42.668808] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T18:59:43.302388] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-01T18:59:43.715076] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T18:59:44.102380] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-01T18:59:44.902371] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-01T18:59:44.980328] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T18:59:45.650985] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T18:59:45.702380] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-01T18:59:46.502398] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-01T18:59:46.567416] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T18:59:47.302392] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-01T18:59:47.868636] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T18:59:47.870101] [INFO ] [REMOTE ] FMX: Full fetch complete (57849 records). [2025-10-01T18:59:47.870222] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-01T18:59:48.109415] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-01T18:59:48.309242] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T18:59:48.374524] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-01T18:59:48.374616] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-01T18:59:48.375803] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-01T18:59:48.375872] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-01T18:59:48.377207] [DEBUG] [LOCAL ] FMX: Trimmed 57849 records to 40731 (keeping 200 days of data) [2025-10-01T18:59:48.644898] [DEBUG] [LOCAL ] FMX: Primary data saved (40731 records). [2025-10-01T18:59:48.645026] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-01T18:59:48.645126] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 45.1s. Estimated remaining: 3h 32m 43s. Rate: 7.1 symbols/min [2025-10-01T18:59:48.761584] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T18:59:48.778624] [INFO ] [REMOTE ] FMY: Full fetch complete (1975 records). [2025-10-01T18:59:48.789117] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-01T18:59:48.866502] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:59:48.907379] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-01T18:59:49.271088] [DEBUG] [LOCAL ] FND: Loaded 52101 existing records from primary storage. [2025-10-01T18:59:49.296617] [INFO ] [MAIN ] FND: Loaded 52101 existing records. [2025-10-01T18:59:49.303814] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-01T18:59:49.309163] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-01T18:59:49.316753] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-01T18:59:49.346162] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-01T18:59:49.383340] [DEBUG] [LOCAL ] FMY: Trimmed 1975 records to 1397 (keeping 200 days of data) [2025-10-01T18:59:49.458807] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-01T18:59:49.532379] [DEBUG] [LOCAL ] FMY: Primary data saved (1397 records). [2025-10-01T18:59:49.550414] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-01T18:59:49.564751] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 28.2s. Estimated remaining: 3h 32m 22s. Rate: 7.1 symbols/min [2025-10-01T18:59:49.576758] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:59:49.611309] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-01T18:59:49.638620] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-01T18:59:49.660161] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-01T18:59:49.677524] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-01T18:59:49.711692] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-01T18:59:49.862194] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T18:59:50.202441] [DEBUG] [LOCAL ] FNF: Loaded 49101 existing records from primary storage. [2025-10-01T18:59:50.223974] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:59:50.224406] [INFO ] [MAIN ] FNF: Loaded 49101 existing records. [2025-10-01T18:59:50.427173] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T18:59:50.427477] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-01T18:59:50.427578] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-01T18:59:50.429088] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-01T18:59:50.429153] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-01T18:59:50.512990] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-01T18:59:50.768912] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T18:59:50.891143] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T18:59:51.302382] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-01T18:59:51.441179] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T18:59:52.102381] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-01T18:59:52.189158] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T18:59:52.705735] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T18:59:52.902381] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-01T18:59:53.687557] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T18:59:53.702343] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-01T18:59:54.502361] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-01T18:59:54.592570] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T18:59:54.795495] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T18:59:55.302407] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-01T18:59:55.959101] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T18:59:56.102378] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-01T18:59:56.575979] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T18:59:56.902432] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-01T18:59:57.702380] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-01T18:59:57.829933] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T18:59:58.304341] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T18:59:58.502393] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-01T18:59:59.211354] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T18:59:59.302422] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-01T19:00:00.102388] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-01T19:00:00.454724] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T19:00:00.902357] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-01T19:00:00.996695] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T19:00:01.386163] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T19:00:01.702438] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-01T19:00:02.502433] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-01T19:00:02.883276] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T19:00:03.302424] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-01T19:00:03.638618] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T19:00:04.051632] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T19:00:04.102401] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-01T19:00:04.902361] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-01T19:00:05.237892] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T19:00:05.702398] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-01T19:00:06.100553] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T19:00:06.502381] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-01T19:00:06.849386] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T19:00:07.302426] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-01T19:00:08.113392] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-01T19:00:08.137542] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-01T19:00:08.695542] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-01T19:00:08.902388] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-01T19:00:09.429602] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-01T19:00:09.702384] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-01T19:00:10.379972] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T19:00:10.495450] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T19:00:10.497179] [INFO ] [REMOTE ] FNB: Full fetch complete (75820 records). [2025-10-01T19:00:10.497300] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-01T19:00:10.509707] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-01T19:00:10.927056] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-01T19:00:10.927151] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-01T19:00:10.928143] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-01T19:00:10.928256] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-01T19:00:10.930530] [DEBUG] [LOCAL ] FNB: Trimmed 75820 records to 52458 (keeping 200 days of data) [2025-10-01T19:00:11.282068] [DEBUG] [LOCAL ] FNB: Primary data saved (52458 records). [2025-10-01T19:00:11.282218] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-01T19:00:11.282333] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FNB took 32.9s. Estimated remaining: 3h 32m 37s. Rate: 7.1 symbols/min [2025-10-01T19:00:11.316516] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-01T19:00:11.481621] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:00:11.561196] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T19:00:11.574172] [DEBUG] [LOCAL ] FNV: Loaded 46188 existing records from primary storage. [2025-10-01T19:00:11.575132] [INFO ] [MAIN ] FNV: Loaded 46188 existing records. [2025-10-01T19:00:11.767082] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:00:11.767325] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-01T19:00:11.767414] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-01T19:00:11.767784] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-01T19:00:11.767875] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-01T19:00:12.112585] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-01T19:00:12.181943] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:00:12.248222] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T19:00:12.902428] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-01T19:00:13.321546] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-01T19:00:13.322800] [INFO ] [REMOTE ] FN: Full fetch complete (56368 records). [2025-10-01T19:00:13.322892] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-01T19:00:13.703001] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-01T19:00:13.774397] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-01T19:00:13.774510] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-01T19:00:13.775425] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-01T19:00:13.775548] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-01T19:00:13.777354] [DEBUG] [LOCAL ] FN: Trimmed 56368 records to 38577 (keeping 200 days of data) [2025-10-01T19:00:13.886709] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T19:00:14.096032] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T19:00:14.122235] [DEBUG] [LOCAL ] FN: Primary data saved (38577 records). [2025-10-01T19:00:14.122390] [INFO ] [MAIN ] FN: Full history saved. [2025-10-01T19:00:14.122479] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FN took 38.3s. Estimated remaining: 3h 32m 19s. Rate: 7.1 symbols/min [2025-10-01T19:00:14.321205] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:00:14.337452] [DEBUG] [LOCAL ] FOA: Loaded 13156 existing records from primary storage. [2025-10-01T19:00:14.337756] [INFO ] [MAIN ] FOA: Loaded 13156 existing records. [2025-10-01T19:00:14.507514] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-01T19:00:14.549766] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:00:14.550249] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-01T19:00:14.550344] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-01T19:00:14.550602] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-01T19:00:14.550686] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-01T19:00:14.958735] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:00:15.302393] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-01T19:00:15.390055] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T19:00:16.017289] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T19:00:16.102391] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-01T19:00:16.902397] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-01T19:00:17.035077] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T19:00:17.371445] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T19:00:17.690397] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T19:00:17.702333] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-01T19:00:18.502440] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-01T19:00:18.637674] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T19:00:19.302444] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-01T19:00:20.102392] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-01T19:00:20.893474] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T19:00:20.902353] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-01T19:00:21.079887] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T19:00:21.495920] [DEBUG] [REMOTE ] FNF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:00:21.496258] [WARN ] [REMOTE ] FNF: No data returned for month 2025-10 [2025-10-01T19:00:21.496372] [FATAL] [REMOTE ] FNF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:00:21.496489] [FATAL] [MAIN ] FNF: Failed to fetch primary data. [2025-10-01T19:00:21.496563] [WARN ] [MAIN ] FNF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:00:21.496638] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-01T19:00:21.496784] [DEBUG] [LOCAL ] FNF: No primary data file found to delete. [2025-10-01T19:00:21.496839] [INFO ] [LOCAL ] FNF: Starting deletion of derivative data. [2025-10-01T19:00:21.497339] [DEBUG] [LOCAL ] FNF: Deleted derivative data file. [2025-10-01T19:00:21.497429] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNF took 31.9s. Estimated remaining: 3h 32m 8s. Rate: 7.1 symbols/min [2025-10-01T19:00:21.709737] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-01T19:00:21.713676] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:00:21.726800] [DEBUG] [LOCAL ] FOF: Loaded 8432 existing records from primary storage. [2025-10-01T19:00:21.727038] [INFO ] [MAIN ] FOF: Loaded 8432 existing records. [2025-10-01T19:00:21.948939] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:00:21.949333] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-01T19:00:21.949458] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-01T19:00:21.964160] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-01T19:00:21.964095] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-01T19:00:21.964341] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-01T19:00:22.381708] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:00:22.502384] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-01T19:00:23.184687] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T19:00:23.302387] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-01T19:00:23.457050] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T19:00:24.102396] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-01T19:00:24.882342] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T19:00:24.902346] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-01T19:00:25.702390] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-01T19:00:26.280146] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-01T19:00:26.283067] [INFO ] [REMOTE ] FND: Full fetch complete (74536 records). [2025-10-01T19:00:26.283250] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-01T19:00:26.470971] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T19:00:26.506576] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-01T19:00:26.774973] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T19:00:26.863222] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-01T19:00:26.863336] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-01T19:00:26.864715] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-01T19:00:26.864794] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-01T19:00:26.868978] [DEBUG] [LOCAL ] FND: Trimmed 74536 records to 52101 (keeping 200 days of data) [2025-10-01T19:00:27.201493] [DEBUG] [LOCAL ] FND: Primary data saved (52101 records). [2025-10-01T19:00:27.201676] [INFO ] [MAIN ] FND: Full history saved. [2025-10-01T19:00:27.201804] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FND took 38.6s. Estimated remaining: 3h 31m 55s. Rate: 7.1 symbols/min [2025-10-01T19:00:27.307518] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-01T19:00:27.412376] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:00:27.432773] [DEBUG] [LOCAL ] FOR: Loaded 19856 existing records from primary storage. [2025-10-01T19:00:27.433064] [INFO ] [MAIN ] FOR: Loaded 19856 existing records. [2025-10-01T19:00:27.655905] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T19:00:27.660822] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:00:27.661197] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-01T19:00:27.663333] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-01T19:00:27.664279] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-01T19:00:27.664360] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-01T19:00:28.066103] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:00:28.102390] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-01T19:00:28.866363] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T19:00:28.902390] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-01T19:00:29.236465] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T19:00:29.578935] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T19:00:29.702399] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-01T19:00:30.381807] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T19:00:30.502393] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-01T19:00:31.195596] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T19:00:31.302383] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-01T19:00:32.091848] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T19:00:32.102328] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-01T19:00:32.784199] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T19:00:32.902385] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-01T19:00:33.702403] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-01T19:00:34.449580] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T19:00:34.507362] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-01T19:00:34.510190] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T19:00:35.302383] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-01T19:00:36.053012] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T19:00:36.107512] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-01T19:00:36.122939] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T19:00:36.902366] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-01T19:00:37.052801] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T19:00:37.702379] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-01T19:00:38.451163] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T19:00:38.502365] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-01T19:00:38.680868] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T19:00:39.295515] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T19:00:39.302336] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-01T19:00:40.102358] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-01T19:00:40.412394] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T19:00:40.822904] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T19:00:40.902372] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-01T19:00:41.701906] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T19:00:41.704050] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-01T19:00:42.502376] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-01T19:00:42.766858] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T19:00:43.283587] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T19:00:43.302350] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-01T19:00:43.913135] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T19:00:44.102395] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-01T19:00:44.902416] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-01T19:00:45.344558] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T19:00:45.702395] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-01T19:00:46.017243] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T19:00:46.018245] [INFO ] [REMOTE ] FOA: Full fetch complete (22446 records). [2025-10-01T19:00:46.018348] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-01T19:00:46.432714] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-01T19:00:46.432806] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-01T19:00:46.433320] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-01T19:00:46.433373] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-01T19:00:46.434088] [DEBUG] [LOCAL ] FOA: Trimmed 22446 records to 13079 (keeping 200 days of data) [2025-10-01T19:00:46.505860] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-01T19:00:46.516878] [DEBUG] [LOCAL ] FOA: Primary data saved (13079 records). [2025-10-01T19:00:46.517039] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-01T19:00:46.517178] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FOA took 32.4s. Estimated remaining: 3h 32m 6s. Rate: 7.1 symbols/min [2025-10-01T19:00:46.724408] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:00:46.743176] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T19:00:46.801707] [DEBUG] [LOCAL ] FOUR: Loaded 49547 existing records from primary storage. [2025-10-01T19:00:46.802081] [INFO ] [MAIN ] FOUR: Loaded 49547 existing records. [2025-10-01T19:00:46.997827] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:00:46.998049] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-01T19:00:46.998097] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-01T19:00:46.998311] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-01T19:00:46.998370] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-01T19:00:47.302400] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-01T19:00:47.391364] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:00:48.093253] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T19:00:48.102448] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-01T19:00:48.162734] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T19:00:48.163583] [INFO ] [REMOTE ] FOF: Full fetch complete (11855 records). [2025-10-01T19:00:48.163690] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-01T19:00:48.573797] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-01T19:00:48.573899] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-01T19:00:48.574222] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-01T19:00:48.574266] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-01T19:00:48.574748] [DEBUG] [LOCAL ] FOF: Trimmed 11855 records to 8431 (keeping 200 days of data) [2025-10-01T19:00:48.630025] [DEBUG] [LOCAL ] FOF: Primary data saved (8431 records). [2025-10-01T19:00:48.630165] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-01T19:00:48.630248] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOF took 27.1s. Estimated remaining: 3h 31m 46s. Rate: 7.1 symbols/min [2025-10-01T19:00:48.810488] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:00:48.830196] [DEBUG] [LOCAL ] FPF: Loaded 18101 existing records from primary storage. [2025-10-01T19:00:48.830487] [INFO ] [MAIN ] FPF: Loaded 18101 existing records. [2025-10-01T19:00:48.910832] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-01T19:00:49.041117] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:00:49.041389] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-01T19:00:49.041439] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-01T19:00:49.041681] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-01T19:00:49.041757] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-01T19:00:49.477626] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:00:49.702380] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-01T19:00:49.893227] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T19:00:50.396594] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T19:00:50.502407] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-01T19:00:50.721719] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T19:00:51.302379] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-01T19:00:51.629072] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T19:00:52.102370] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-01T19:00:52.424941] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T19:00:52.902360] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-01T19:00:52.947884] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:00:53.702371] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-01T19:00:53.896984] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T19:00:54.502425] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-01T19:00:55.247476] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T19:00:55.307481] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-01T19:00:55.325330] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T19:00:56.102367] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-01T19:00:56.407864] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T19:00:56.902393] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-01T19:00:57.105973] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T19:00:57.702451] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-01T19:00:58.502451] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-01T19:00:59.046862] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-01T19:00:59.049166] [INFO ] [REMOTE ] FNV: Full fetch complete (66249 records). [2025-10-01T19:00:59.049271] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-01T19:00:59.165757] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T19:00:59.188224] [INFO ] [REMOTE ] FOR: Full fetch complete (29971 records). [2025-10-01T19:00:59.221073] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-01T19:00:59.313747] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-01T19:00:59.767050] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-01T19:00:59.795550] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-01T19:00:59.829911] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-01T19:00:59.853931] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-01T19:00:59.877402] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T19:00:59.929411] [DEBUG] [LOCAL ] FNV: Trimmed 66249 records to 46148 (keeping 200 days of data) [2025-10-01T19:01:00.078031] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-01T19:01:00.078521] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-01T19:01:00.078961] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-01T19:01:00.079046] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-01T19:01:00.115139] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-01T19:01:00.119441] [DEBUG] [LOCAL ] FOR: Trimmed 29971 records to 19842 (keeping 200 days of data) [2025-10-01T19:01:00.396163] [DEBUG] [LOCAL ] FOR: Primary data saved (19842 records). [2025-10-01T19:01:00.397114] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-01T19:01:00.397245] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOR took 33.2s. Estimated remaining: 3h 31m 44s. Rate: 7.1 symbols/min [2025-10-01T19:01:00.595760] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:00.624557] [DEBUG] [LOCAL ] FPH: Loaded 19466 existing records from primary storage. [2025-10-01T19:01:00.626412] [INFO ] [MAIN ] FPH: Loaded 19466 existing records. [2025-10-01T19:01:00.836728] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:00.838125] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-01T19:01:00.839282] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-01T19:01:00.841928] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-01T19:01:00.843478] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-01T19:01:01.036405] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-01T19:01:01.090314] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-01T19:01:01.109765] [DEBUG] [LOCAL ] FNV: Primary data saved (46148 records). [2025-10-01T19:01:01.110388] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-01T19:01:01.143871] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FNV took 49.9s. Estimated remaining: 3h 31m 22s. Rate: 7.1 symbols/min [2025-10-01T19:01:01.573696] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:01.607991] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:01.612691] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-01T19:01:01.667698] [DEBUG] [LOCAL ] FPI: Loaded 31004 existing records from primary storage. [2025-10-01T19:01:01.668156] [INFO ] [MAIN ] FPI: Loaded 31004 existing records. [2025-10-01T19:01:01.707598] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-01T19:01:01.931300] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:01.931863] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-01T19:01:01.931925] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-01T19:01:01.932337] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-01T19:01:01.932433] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-01T19:01:02.352034] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T19:01:02.374401] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:02.502407] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-01T19:01:03.302386] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-01T19:01:03.424570] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T19:01:03.648834] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T19:01:04.102365] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-01T19:01:04.389736] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T19:01:04.902397] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-01T19:01:05.682601] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T19:01:05.702340] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-01T19:01:06.014849] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T19:01:06.502439] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-01T19:01:07.302367] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-01T19:01:07.404758] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T19:01:07.789152] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T19:01:08.102396] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-01T19:01:08.353688] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T19:01:08.902381] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-01T19:01:09.065732] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T19:01:09.702361] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-01T19:01:09.871151] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T19:01:10.502454] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-01T19:01:11.185506] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T19:01:11.302409] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-01T19:01:11.640261] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T19:01:12.102451] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-01T19:01:12.398683] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T19:01:12.902385] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-01T19:01:13.126029] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T19:01:13.702386] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-01T19:01:14.353197] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T19:01:14.354462] [INFO ] [REMOTE ] FPF: Full fetch complete (26599 records). [2025-10-01T19:01:14.354545] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-01T19:01:14.519104] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-01T19:01:14.782778] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-01T19:01:14.782879] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-01T19:01:14.783495] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-01T19:01:14.783541] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-01T19:01:14.784347] [DEBUG] [LOCAL ] FPF: Trimmed 26599 records to 18186 (keeping 200 days of data) [2025-10-01T19:01:14.916137] [DEBUG] [LOCAL ] FPF: Primary data saved (18186 records). [2025-10-01T19:01:14.916379] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-01T19:01:14.916600] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPF took 26.3s. Estimated remaining: 3h 31m 23s. Rate: 7.1 symbols/min [2025-10-01T19:01:15.118918] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:15.170054] [DEBUG] [LOCAL ] FR: Loaded 46417 existing records from primary storage. [2025-10-01T19:01:15.170459] [INFO ] [MAIN ] FR: Loaded 46417 existing records. [2025-10-01T19:01:15.306708] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-01T19:01:15.409103] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:15.409684] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-01T19:01:15.409792] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-01T19:01:15.410418] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-01T19:01:15.410551] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-01T19:01:15.653660] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T19:01:15.853444] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T19:01:15.900238] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:16.102384] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-01T19:01:16.382574] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T19:01:16.902393] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-01T19:01:17.702417] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-01T19:01:17.739017] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T19:01:17.901685] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T19:01:18.502385] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-01T19:01:18.814192] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T19:01:19.302382] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-01T19:01:19.878988] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T19:01:20.102396] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-01T19:01:20.637857] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T19:01:20.902393] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-01T19:01:21.702453] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-01T19:01:21.945976] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T19:01:22.163096] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T19:01:22.502415] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-01T19:01:22.661996] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T19:01:23.302413] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-01T19:01:24.102414] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-01T19:01:24.902391] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-01T19:01:24.969541] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T19:01:25.109590] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-01T19:01:25.111236] [INFO ] [REMOTE ] FOUR: Full fetch complete (71971 records). [2025-10-01T19:01:25.111348] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-01T19:01:25.542276] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-01T19:01:25.542458] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-01T19:01:25.543635] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-01T19:01:25.543777] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-01T19:01:25.545668] [DEBUG] [LOCAL ] FOUR: Trimmed 71971 records to 49533 (keeping 200 days of data) [2025-10-01T19:01:25.688389] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T19:01:25.703123] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-01T19:01:25.924614] [DEBUG] [LOCAL ] FOUR: Primary data saved (49533 records). [2025-10-01T19:01:25.924802] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-01T19:01:25.924984] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FOUR took 39.4s. Estimated remaining: 3h 31m 19s. Rate: 7.1 symbols/min [2025-10-01T19:01:26.160155] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T19:01:26.164467] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:26.187542] [DEBUG] [LOCAL ] FRA: Loaded 14539 existing records from primary storage. [2025-10-01T19:01:26.187922] [INFO ] [MAIN ] FRA: Loaded 14539 existing records. [2025-10-01T19:01:26.408346] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:26.408600] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-01T19:01:26.408677] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-01T19:01:26.408928] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-01T19:01:26.408998] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-01T19:01:26.512691] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-01T19:01:26.823893] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:26.841829] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T19:01:27.302381] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-01T19:01:27.554606] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T19:01:28.102395] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-01T19:01:28.323824] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T19:01:28.902406] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-01T19:01:29.316109] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T19:01:29.702385] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-01T19:01:30.184778] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T19:01:30.502397] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-01T19:01:30.679581] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T19:01:31.302429] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-01T19:01:32.075488] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T19:01:32.077126] [INFO ] [REMOTE ] FPI: Full fetch complete (44297 records). [2025-10-01T19:01:32.077268] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-01T19:01:32.108154] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-01T19:01:32.588012] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-01T19:01:32.588783] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-01T19:01:32.589837] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T19:01:32.590762] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-01T19:01:32.596240] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-01T19:01:32.598172] [DEBUG] [LOCAL ] FPI: Trimmed 44297 records to 31045 (keeping 200 days of data) [2025-10-01T19:01:32.805834] [DEBUG] [LOCAL ] FPI: Primary data saved (31045 records). [2025-10-01T19:01:32.805997] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-01T19:01:32.806093] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPI took 31.6s. Estimated remaining: 3h 31m 8s. Rate: 7.1 symbols/min [2025-10-01T19:01:32.908504] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-01T19:01:33.011294] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:33.031727] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T19:01:33.052413] [DEBUG] [LOCAL ] FRGE: Loaded 17802 existing records from primary storage. [2025-10-01T19:01:33.052712] [INFO ] [MAIN ] FRGE: Loaded 17802 existing records. [2025-10-01T19:01:33.250416] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:33.250706] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-01T19:01:33.250768] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-01T19:01:33.251005] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-01T19:01:33.251065] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-01T19:01:33.669432] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:33.702386] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-01T19:01:33.971463] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T19:01:34.502391] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-01T19:01:35.099357] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T19:01:35.302381] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-01T19:01:36.104725] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-01T19:01:36.112086] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T19:01:36.249019] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T19:01:36.902357] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-01T19:01:37.062635] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T19:01:37.702382] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-01T19:01:38.512847] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-01T19:01:38.518858] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T19:01:38.685692] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T19:01:39.302361] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-01T19:01:39.746222] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-01T19:01:39.747188] [INFO ] [REMOTE ] FPH: Full fetch complete (31366 records). [2025-10-01T19:01:39.747324] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-01T19:01:40.110768] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-01T19:01:40.164965] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-01T19:01:40.165093] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-01T19:01:40.175145] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T19:01:40.174851] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-01T19:01:40.175289] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-01T19:01:40.179440] [DEBUG] [LOCAL ] FPH: Trimmed 31366 records to 19419 (keeping 200 days of data) [2025-10-01T19:01:40.296696] [DEBUG] [LOCAL ] FPH: Primary data saved (19419 records). [2025-10-01T19:01:40.296871] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-01T19:01:40.296994] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPH took 39.9s. Estimated remaining: 3h 30m 58s. Rate: 7.1 symbols/min [2025-10-01T19:01:40.491187] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:40.546184] [DEBUG] [LOCAL ] FRO: Loaded 51794 existing records from primary storage. [2025-10-01T19:01:40.546556] [INFO ] [MAIN ] FRO: Loaded 51794 existing records. [2025-10-01T19:01:40.747000] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:40.747254] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-01T19:01:40.747330] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-01T19:01:40.747723] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-01T19:01:40.747824] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-01T19:01:40.907521] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-01T19:01:41.168977] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:41.692836] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T19:01:41.702354] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-01T19:01:42.285138] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T19:01:42.502452] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-01T19:01:43.302356] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-01T19:01:43.457636] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T19:01:43.565163] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T19:01:44.102398] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-01T19:01:44.902407] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-01T19:01:44.976102] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T19:01:45.428420] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T19:01:45.611923] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-01T19:01:45.702396] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-01T19:01:46.502367] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-01T19:01:46.959680] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T19:01:47.169708] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T19:01:47.302395] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-01T19:01:48.102359] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-01T19:01:48.502777] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T19:01:48.797541] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T19:01:48.902398] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-01T19:01:49.702394] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-01T19:01:50.502376] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-01T19:01:50.934174] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-01T19:01:51.302373] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-01T19:01:51.335525] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T19:01:51.377074] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T19:01:52.102429] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-01T19:01:52.828547] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T19:01:52.902381] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-01T19:01:53.702467] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-01T19:01:54.280362] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-01T19:01:54.282895] [INFO ] [REMOTE ] FR: Full fetch complete (66670 records). [2025-10-01T19:01:54.283059] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-01T19:01:54.509528] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-01T19:01:54.724309] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T19:01:54.745897] [INFO ] [REMOTE ] FRA: Full fetch complete (24126 records). [2025-10-01T19:01:54.749510] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-01T19:01:54.749778] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-01T19:01:54.749703] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-01T19:01:54.751389] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-01T19:01:54.751497] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-01T19:01:54.821603] [DEBUG] [LOCAL ] FR: Trimmed 66670 records to 46429 (keeping 200 days of data) [2025-10-01T19:01:55.318380] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T19:01:55.389332] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-01T19:01:55.389961] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-01T19:01:55.394119] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-01T19:01:55.394504] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-01T19:01:55.395751] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-01T19:01:55.404583] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-01T19:01:55.414485] [DEBUG] [LOCAL ] FRA: Trimmed 24126 records to 14571 (keeping 200 days of data) [2025-10-01T19:01:55.615724] [DEBUG] [LOCAL ] FRA: Primary data saved (14571 records). [2025-10-01T19:01:55.617092] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-01T19:01:55.617851] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRA took 29.7s. Estimated remaining: 3h 31m 2s. Rate: 7.1 symbols/min [2025-10-01T19:01:55.840499] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:55.932133] [DEBUG] [LOCAL ] FR: Primary data saved (46429 records). [2025-10-01T19:01:55.929896] [DEBUG] [LOCAL ] FRT: Loaded 42039 existing records from primary storage. [2025-10-01T19:01:55.932462] [INFO ] [MAIN ] FR: Full history saved. [2025-10-01T19:01:55.932612] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FR took 41.0s. Estimated remaining: 3h 30m 39s. Rate: 7.1 symbols/min [2025-10-01T19:01:55.938861] [INFO ] [MAIN ] FRT: Loaded 42039 existing records. [2025-10-01T19:01:56.127837] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-01T19:01:56.343847] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:56.371168] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-01T19:01:56.376274] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-01T19:01:56.376111] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:01:56.376822] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-01T19:01:56.377149] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-01T19:01:56.442236] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T19:01:56.710922] [DEBUG] [LOCAL ] FSCO: Loaded 37393 existing records from primary storage. [2025-10-01T19:01:56.736785] [INFO ] [MAIN ] FSCO: Loaded 37393 existing records. [2025-10-01T19:01:56.918775] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-01T19:01:56.995191] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:57.086003] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:01:57.086288] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-01T19:01:57.086342] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-01T19:01:57.086602] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-01T19:01:57.086699] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-01T19:01:57.496674] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:01:57.702396] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-01T19:01:57.785003] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T19:01:57.916555] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T19:01:58.502421] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-01T19:01:59.181309] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T19:01:59.302384] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-01T19:02:00.102431] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-01T19:02:00.462729] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-01T19:02:00.902431] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-01T19:02:01.132743] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T19:02:01.243977] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T19:02:01.702429] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-01T19:02:02.502436] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-01T19:02:02.877947] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-01T19:02:03.079001] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T19:02:03.162111] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-01T19:02:03.302379] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-01T19:02:04.102394] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-01T19:02:04.277245] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T19:02:04.278290] [INFO ] [REMOTE ] FRGE: Full fetch complete (32769 records). [2025-10-01T19:02:04.278393] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-01T19:02:04.715130] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-01T19:02:04.715243] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-01T19:02:04.715976] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-01T19:02:04.716046] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-01T19:02:04.717043] [DEBUG] [LOCAL ] FRGE: Trimmed 32769 records to 17691 (keeping 200 days of data) [2025-10-01T19:02:04.839263] [DEBUG] [LOCAL ] FRGE: Primary data saved (17691 records). [2025-10-01T19:02:04.839416] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-01T19:02:04.839527] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 32.0s. Estimated remaining: 3h 30m 32s. Rate: 7.1 symbols/min [2025-10-01T19:02:04.907486] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-01T19:02:05.038528] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:02:05.098605] [DEBUG] [LOCAL ] FSK: Loaded 49397 existing records from primary storage. [2025-10-01T19:02:05.099005] [INFO ] [MAIN ] FSK: Loaded 49397 existing records. [2025-10-01T19:02:05.304822] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:02:05.305045] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-01T19:02:05.305096] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-01T19:02:05.305455] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-01T19:02:05.305515] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-01T19:02:05.707870] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-01T19:02:05.715678] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:02:06.097193] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T19:02:06.163889] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T19:02:06.502407] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-01T19:02:06.969463] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T19:02:07.302393] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-01T19:02:08.102395] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-01T19:02:08.254200] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T19:02:08.850541] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T19:02:08.902400] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-01T19:02:09.123323] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T19:02:09.702480] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-01T19:02:10.387843] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T19:02:10.502416] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-01T19:02:11.254169] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T19:02:11.302400] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-01T19:02:12.102385] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-01T19:02:12.791018] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T19:02:12.902421] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-01T19:02:12.998592] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-01T19:02:13.001037] [INFO ] [REMOTE ] FRO: Full fetch complete (75277 records). [2025-10-01T19:02:13.001189] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-01T19:02:13.464705] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-01T19:02:13.464853] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-01T19:02:13.466023] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-01T19:02:13.466181] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-01T19:02:13.467963] [DEBUG] [LOCAL ] FRO: Trimmed 75277 records to 51761 (keeping 200 days of data) [2025-10-01T19:02:13.710300] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-01T19:02:13.738780] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T19:02:13.868464] [DEBUG] [LOCAL ] FRO: Primary data saved (51761 records). [2025-10-01T19:02:13.868620] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-01T19:02:13.868756] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 33.6s. Estimated remaining: 3h 30m 24s. Rate: 7.1 symbols/min [2025-10-01T19:02:14.066291] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:02:14.123457] [DEBUG] [LOCAL ] FSLY: Loaded 51207 existing records from primary storage. [2025-10-01T19:02:14.123873] [INFO ] [MAIN ] FSLY: Loaded 51207 existing records. [2025-10-01T19:02:14.342136] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:02:14.342752] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-01T19:02:14.342818] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-01T19:02:14.353698] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-01T19:02:14.369840] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-01T19:02:14.404451] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T19:02:14.511429] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-01T19:02:14.889740] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:02:14.912332] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T19:02:15.302389] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-01T19:02:15.959327] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T19:02:16.102406] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-01T19:02:16.902382] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-01T19:02:17.317049] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-01T19:02:17.443327] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T19:02:17.702438] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-01T19:02:18.502459] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-01T19:02:18.613066] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T19:02:19.302443] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-01T19:02:19.416468] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T19:02:20.102359] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-01T19:02:20.191046] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T19:02:20.363223] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T19:02:20.902380] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-01T19:02:21.455109] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T19:02:21.702393] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-01T19:02:22.430237] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T19:02:22.502407] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-01T19:02:23.215628] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T19:02:23.302393] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-01T19:02:24.102449] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-01T19:02:24.384781] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T19:02:24.902388] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-01T19:02:25.071493] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T19:02:25.702395] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-01T19:02:25.889632] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T19:02:25.891097] [INFO ] [REMOTE ] FSCO: Full fetch complete (54293 records). [2025-10-01T19:02:25.891195] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-01T19:02:26.348541] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-01T19:02:26.348639] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-01T19:02:26.349673] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-01T19:02:26.349740] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-01T19:02:26.351136] [DEBUG] [LOCAL ] FSCO: Trimmed 54293 records to 37554 (keeping 200 days of data) [2025-10-01T19:02:26.528440] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-01T19:02:26.600537] [DEBUG] [LOCAL ] FSCO: Primary data saved (37554 records). [2025-10-01T19:02:26.600743] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-01T19:02:26.600876] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FSCO took 30.7s. Estimated remaining: 3h 30m 23s. Rate: 7.1 symbols/min [2025-10-01T19:02:26.839187] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:02:26.841352] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T19:02:26.905096] [DEBUG] [LOCAL ] FSM: Loaded 53286 existing records from primary storage. [2025-10-01T19:02:26.905410] [INFO ] [MAIN ] FSM: Loaded 53286 existing records. [2025-10-01T19:02:27.125798] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:02:27.126026] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-01T19:02:27.126081] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-01T19:02:27.126345] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-01T19:02:27.126404] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-01T19:02:27.309272] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-01T19:02:27.576722] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:02:27.598039] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T19:02:27.801989] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T19:02:28.102416] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-01T19:02:28.902410] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-01T19:02:29.059673] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T19:02:29.702393] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-01T19:02:29.834720] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:02:30.509612] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-01T19:02:30.528802] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T19:02:31.302371] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-01T19:02:31.305256] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T19:02:31.840127] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T19:02:32.102381] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-01T19:02:32.700741] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T19:02:32.902380] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-01T19:02:33.703799] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-01T19:02:33.706705] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T19:02:34.234791] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T19:02:34.502371] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-01T19:02:35.138772] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:02:35.302403] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-01T19:02:36.103499] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-01T19:02:36.107221] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T19:02:36.754937] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T19:02:36.902384] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-01T19:02:37.702451] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-01T19:02:37.850061] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T19:02:38.502432] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-01T19:02:38.807392] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T19:02:38.808891] [INFO ] [REMOTE ] FRT: Full fetch complete (60320 records). [2025-10-01T19:02:38.808981] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-01T19:02:39.240215] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-01T19:02:39.240304] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-01T19:02:39.241256] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-01T19:02:39.241322] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-01T19:02:39.242686] [DEBUG] [LOCAL ] FRT: Trimmed 60320 records to 41996 (keeping 200 days of data) [2025-10-01T19:02:39.310402] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-01T19:02:39.522136] [DEBUG] [LOCAL ] FRT: Primary data saved (41996 records). [2025-10-01T19:02:39.522266] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-01T19:02:39.522350] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FRT took 43.9s. Estimated remaining: 3h 30m 23s. Rate: 7.1 symbols/min [2025-10-01T19:02:39.704527] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:02:39.741345] [DEBUG] [LOCAL ] FSS: Loaded 34149 existing records from primary storage. [2025-10-01T19:02:39.741878] [INFO ] [MAIN ] FSS: Loaded 34149 existing records. [2025-10-01T19:02:39.941998] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:02:39.942233] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-01T19:02:39.942282] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-01T19:02:39.942603] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-01T19:02:39.942700] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-01T19:02:40.273710] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-01T19:02:40.294870] [INFO ] [REMOTE ] FSK: Full fetch complete (71492 records). [2025-10-01T19:02:40.310630] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-01T19:02:40.378301] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:02:40.397510] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-01T19:02:40.705454] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-01T19:02:40.890980] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-01T19:02:40.891156] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-01T19:02:40.892205] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-01T19:02:40.892324] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-01T19:02:40.894037] [DEBUG] [LOCAL ] FSK: Trimmed 71492 records to 49410 (keeping 200 days of data) [2025-10-01T19:02:40.954666] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-01T19:02:41.056478] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T19:02:41.269873] [DEBUG] [LOCAL ] FSK: Primary data saved (49410 records). [2025-10-01T19:02:41.270042] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-01T19:02:41.270172] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 36.4s. Estimated remaining: 3h 30m 3s. Rate: 7.1 symbols/min [2025-10-01T19:02:41.485915] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:02:41.495440] [DEBUG] [LOCAL ] FT: Loaded 6495 existing records from primary storage. [2025-10-01T19:02:41.495691] [INFO ] [MAIN ] FT: Loaded 6495 existing records. [2025-10-01T19:02:41.707471] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-01T19:02:41.713123] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:02:41.714592] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-01T19:02:41.714692] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-01T19:02:41.714896] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-01T19:02:41.714954] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-01T19:02:41.887192] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T19:02:42.183610] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:02:42.502386] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-01T19:02:42.762347] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T19:02:42.940867] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T19:02:43.302366] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-01T19:02:43.381670] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:02:43.946121] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T19:02:44.102425] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-01T19:02:44.626449] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T19:02:44.902390] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-01T19:02:45.591096] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T19:02:45.702401] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-01T19:02:46.502398] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-01T19:02:47.302419] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-01T19:02:47.662257] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T19:02:47.981240] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-01T19:02:47.983066] [INFO ] [REMOTE ] FSLY: Full fetch complete (74887 records). [2025-10-01T19:02:47.983184] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-01T19:02:48.107672] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-01T19:02:48.464252] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-01T19:02:48.464346] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-01T19:02:48.465389] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-01T19:02:48.465459] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-01T19:02:48.467045] [DEBUG] [LOCAL ] FSLY: Trimmed 74887 records to 51231 (keeping 200 days of data) [2025-10-01T19:02:48.792903] [DEBUG] [LOCAL ] FSLY: Primary data saved (51231 records). [2025-10-01T19:02:48.793052] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-01T19:02:48.793144] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 34.9s. Estimated remaining: 3h 29m 53s. Rate: 7.1 symbols/min [2025-10-01T19:02:48.879407] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T19:02:48.903671] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-01T19:02:49.021757] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:02:49.055205] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:02:49.074767] [DEBUG] [LOCAL ] FTHY: Loaded 11914 existing records from primary storage. [2025-10-01T19:02:49.074996] [INFO ] [MAIN ] FTHY: Loaded 11914 existing records. [2025-10-01T19:02:49.291118] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:02:49.291457] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-01T19:02:49.291546] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-01T19:02:49.291875] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-01T19:02:49.291954] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-01T19:02:49.707856] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-01T19:02:49.707758] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:02:50.252929] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T19:02:50.502386] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-01T19:02:51.287425] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T19:02:51.306330] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-01T19:02:51.935799] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-01T19:02:52.012531] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T19:02:52.102393] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-01T19:02:52.616333] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-01T19:02:52.902460] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-01T19:02:53.702395] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-01T19:02:54.500955] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:02:54.509736] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-01T19:02:54.668324] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T19:02:55.302386] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-01T19:02:56.102355] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-01T19:02:56.133930] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T19:02:56.708863] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T19:02:56.880107] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T19:02:56.902364] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-01T19:02:57.395699] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T19:02:57.702384] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-01T19:02:58.444766] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T19:02:58.502412] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-01T19:02:59.302393] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-01T19:03:00.102360] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-01T19:03:00.412512] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T19:03:00.413905] [INFO ] [REMOTE ] FT: Full fetch complete (9156 records). [2025-10-01T19:03:00.414088] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-01T19:03:00.665949] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-01T19:03:00.903120] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-01T19:03:00.923023] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-01T19:03:00.923109] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-01T19:03:00.923356] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-01T19:03:00.923399] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-01T19:03:00.923940] [DEBUG] [LOCAL ] FT: Trimmed 9156 records to 6535 (keeping 200 days of data) [2025-10-01T19:03:00.968310] [DEBUG] [LOCAL ] FT: Primary data saved (6535 records). [2025-10-01T19:03:00.968463] [INFO ] [MAIN ] FT: Full history saved. [2025-10-01T19:03:00.968555] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FT took 19.7s. Estimated remaining: 3h 29m 51s. Rate: 7.1 symbols/min [2025-10-01T19:03:01.163564] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:03:01.221534] [DEBUG] [LOCAL ] FTI: Loaded 53297 existing records from primary storage. [2025-10-01T19:03:01.221936] [INFO ] [MAIN ] FTI: Loaded 53297 existing records. [2025-10-01T19:03:01.433962] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:03:01.434279] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-01T19:03:01.434356] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-01T19:03:01.434860] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-01T19:03:01.434928] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-01T19:03:01.715009] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-01T19:03:01.776460] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T19:03:01.978584] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:03:02.507492] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-01T19:03:02.537300] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T19:03:02.560757] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:03:03.302408] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-01T19:03:04.071994] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T19:03:04.102365] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-01T19:03:04.229325] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T19:03:04.902381] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-01T19:03:05.702362] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-01T19:03:06.055995] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T19:03:06.493828] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T19:03:06.505164] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-01T19:03:06.859160] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T19:03:07.302379] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-01T19:03:08.102380] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-01T19:03:08.695183] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T19:03:08.741186] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T19:03:08.902436] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-01T19:03:09.016037] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-01T19:03:09.017685] [INFO ] [REMOTE ] FSM: Full fetch complete (76751 records). [2025-10-01T19:03:09.017831] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-01T19:03:09.483628] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-01T19:03:09.483843] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-01T19:03:09.484897] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-01T19:03:09.484965] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-01T19:03:09.486523] [DEBUG] [LOCAL ] FSM: Trimmed 76751 records to 53292 (keeping 200 days of data) [2025-10-01T19:03:09.702522] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-01T19:03:09.825828] [DEBUG] [LOCAL ] FSM: Primary data saved (53292 records). [2025-10-01T19:03:09.826182] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-01T19:03:09.826343] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 43.2s. Estimated remaining: 3h 29m 43s. Rate: 7.1 symbols/min [2025-10-01T19:03:09.845017] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T19:03:10.502408] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-01T19:03:11.241482] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T19:03:11.302414] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-01T19:03:11.503956] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T19:03:12.102414] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-01T19:03:12.220352] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T19:03:12.905584] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-01T19:03:12.907289] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T19:03:13.702400] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-01T19:03:14.337222] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-01T19:03:14.338567] [INFO ] [REMOTE ] FSS: Full fetch complete (48377 records). [2025-10-01T19:03:14.338695] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-01T19:03:14.507518] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-01T19:03:14.775882] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-01T19:03:14.775981] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-01T19:03:14.776962] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-01T19:03:14.777070] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-01T19:03:14.778436] [DEBUG] [LOCAL ] FSS: Trimmed 48377 records to 34065 (keeping 200 days of data) [2025-10-01T19:03:15.016035] [DEBUG] [LOCAL ] FSS: Primary data saved (34065 records). [2025-10-01T19:03:15.016186] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-01T19:03:15.016277] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSS took 35.5s. Estimated remaining: 3h 29m 29s. Rate: 7.1 symbols/min [2025-10-01T19:03:15.199872] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-01T19:03:15.302433] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-01T19:03:15.494839] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T19:03:16.102440] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-01T19:03:16.152036] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T19:03:16.902439] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-01T19:03:17.719871] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T19:03:17.723691] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-01T19:03:17.877685] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:03:18.502443] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-01T19:03:18.681743] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T19:03:18.682588] [INFO ] [REMOTE ] FTHY: Full fetch complete (17531 records). [2025-10-01T19:03:18.682694] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-01T19:03:19.104840] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-01T19:03:19.104919] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-01T19:03:19.105362] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-01T19:03:19.105430] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-01T19:03:19.106097] [DEBUG] [LOCAL ] FTHY: Trimmed 17531 records to 11958 (keeping 200 days of data) [2025-10-01T19:03:19.189311] [DEBUG] [LOCAL ] FTHY: Primary data saved (11958 records). [2025-10-01T19:03:19.189464] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-01T19:03:19.189577] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 30.4s. Estimated remaining: 3h 29m 13s. Rate: 7.1 symbols/min [2025-10-01T19:03:20.030446] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T19:03:20.042690] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-01T19:03:21.889459] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T19:03:21.900954] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-01T19:03:23.715299] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T19:03:23.727565] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-01T19:03:25.679467] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T19:03:25.691961] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-01T19:03:27.566029] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T19:03:27.579089] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-01T19:03:29.911928] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T19:03:29.913672] [INFO ] [REMOTE ] FTI: Full fetch complete (77129 records). [2025-10-01T19:03:29.913792] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-01T19:03:30.359569] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-01T19:03:30.359693] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-01T19:03:30.360770] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-01T19:03:30.360845] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-01T19:03:30.362535] [DEBUG] [LOCAL ] FTI: Trimmed 77129 records to 53299 (keeping 200 days of data) [2025-10-01T19:03:30.725207] [DEBUG] [LOCAL ] FTI: Primary data saved (53299 records). [2025-10-01T19:03:30.725362] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-01T19:03:30.725489] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 29.8s. Estimated remaining: 3h 29m 10s. Rate: 7.1 symbols/min [2025-10-01T19:03:31.382306] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:03:31.506105] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:03:31.582756] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:03:31.597488] [DEBUG] [LOCAL ] FTWO: Loaded 1807 existing records from primary storage. [2025-10-01T19:03:31.614506] [INFO ] [MAIN ] FTWO: Loaded 1807 existing records. [2025-10-01T19:03:31.635831] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:03:31.896898] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:03:31.915046] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-01T19:03:31.914909] [DEBUG] [LOCAL ] FTK: Loaded 32180 existing records from primary storage. [2025-10-01T19:03:31.915379] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-01T19:03:31.915559] [INFO ] [MAIN ] FTK: Loaded 32180 existing records. [2025-10-01T19:03:31.920989] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-01T19:03:31.973148] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-01T19:03:32.111225] [DEBUG] [LOCAL ] FTS: Loaded 42106 existing records from primary storage. [2025-10-01T19:03:32.142257] [DEBUG] [LOCAL ] FTV: Loaded 52927 existing records from primary storage. [2025-10-01T19:03:32.154881] [INFO ] [MAIN ] FTS: Loaded 42106 existing records. [2025-10-01T19:03:32.199119] [INFO ] [MAIN ] FTV: Loaded 52927 existing records. [2025-10-01T19:03:32.536436] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:03:32.624997] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-01T19:03:32.664855] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-01T19:03:32.760507] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-01T19:03:32.812104] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:03:32.827908] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-01T19:03:32.864338] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-01T19:03:32.890384] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-01T19:03:32.941687] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-01T19:03:32.987859] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:03:32.984636] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-01T19:03:32.993266] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-01T19:03:33.119758] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-01T19:03:33.263356] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-01T19:03:33.376806] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:03:33.409934] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-01T19:03:33.425440] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-01T19:03:34.030172] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:03:34.061926] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-01T19:03:34.157862] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T19:03:34.213436] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:03:34.209723] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-01T19:03:34.230397] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-01T19:03:34.327817] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:03:34.328167] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-01T19:03:34.826959] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T19:03:34.828950] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-01T19:03:35.290446] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T19:03:35.291978] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-01T19:03:35.464369] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T19:03:35.469784] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-01T19:03:35.585485] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T19:03:35.594199] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-01T19:03:35.722364] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T19:03:35.723625] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-01T19:03:35.761417] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T19:03:35.771918] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-01T19:03:36.100878] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-01T19:03:36.102018] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-01T19:03:36.382118] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-01T19:03:36.383298] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-01T19:03:36.632751] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T19:03:36.638367] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-01T19:03:36.696170] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-01T19:03:36.697418] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-01T19:03:37.080153] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T19:03:37.089522] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-01T19:03:37.128342] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-01T19:03:37.129756] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-01T19:03:37.277597] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T19:03:37.282363] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-01T19:03:37.464604] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T19:03:37.621365] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T19:03:37.702419] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-01T19:03:38.051204] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-01T19:03:38.442299] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T19:03:38.480978] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T19:03:38.502383] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-01T19:03:39.302354] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-01T19:03:39.395946] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T19:03:40.102396] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-01T19:03:40.710597] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-01T19:03:40.711312] [INFO ] [REMOTE ] FTWO: Full fetch complete (3448 records). [2025-10-01T19:03:40.711381] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-01T19:03:40.912284] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-01T19:03:41.109866] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-01T19:03:41.110031] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-01T19:03:41.110184] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-01T19:03:41.110256] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-01T19:03:41.110864] [DEBUG] [LOCAL ] FTWO: Trimmed 3448 records to 1816 (keeping 200 days of data) [2025-10-01T19:03:41.150354] [DEBUG] [LOCAL ] FTWO: Primary data saved (1816 records). [2025-10-01T19:03:41.150578] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-01T19:03:41.150768] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 10.4s. Estimated remaining: 3h 29m 5s. Rate: 7.1 symbols/min [2025-10-01T19:03:41.158137] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T19:03:41.355963] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:03:41.405607] [DEBUG] [LOCAL ] FUBO: Loaded 53697 existing records from primary storage. [2025-10-01T19:03:41.405989] [INFO ] [MAIN ] FUBO: Loaded 53697 existing records. [2025-10-01T19:03:41.605722] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:03:41.605953] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-01T19:03:41.606003] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-01T19:03:41.606232] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-01T19:03:41.606290] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-01T19:03:41.712419] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-01T19:03:41.997949] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:03:42.353634] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T19:03:42.502446] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-01T19:03:43.302388] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-01T19:03:43.616394] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T19:03:44.091248] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T19:03:44.102335] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-01T19:03:44.902391] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-01T19:03:45.325837] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-01T19:03:45.704361] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-01T19:03:45.707835] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T19:03:46.408709] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T19:03:46.502376] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-01T19:03:47.302430] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-01T19:03:47.841253] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-01T19:03:47.908434] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T19:03:48.102393] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-01T19:03:48.629462] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T19:03:48.902398] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-01T19:03:49.702390] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-01T19:03:50.139553] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-01T19:03:50.347030] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:03:50.502401] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-01T19:03:51.302381] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-01T19:03:51.469252] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T19:03:52.102375] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-01T19:03:52.460106] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-01T19:03:52.903612] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-01T19:03:52.907068] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T19:03:53.295144] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T19:03:53.702385] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-01T19:03:54.360212] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T19:03:54.502381] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-01T19:03:54.850352] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T19:03:55.302415] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-01T19:03:56.102403] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-01T19:03:56.715766] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-01T19:03:56.902360] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-01T19:03:57.093598] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T19:03:57.398552] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-01T19:03:57.702431] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-01T19:03:58.502378] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-01T19:03:58.918098] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T19:03:59.166859] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-01T19:03:59.302383] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-01T19:04:00.007507] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T19:04:00.102410] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-01T19:04:00.902471] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-01T19:04:01.431170] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-01T19:04:01.702397] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-01T19:04:01.829473] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T19:04:02.242301] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T19:04:02.502367] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-01T19:04:03.302498] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-01T19:04:04.102378] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-01T19:04:04.279053] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-01T19:04:04.827961] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T19:04:04.829750] [INFO ] [REMOTE ] FTV: Full fetch complete (76315 records). [2025-10-01T19:04:04.829920] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-01T19:04:04.906174] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-01T19:04:04.990161] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-01T19:04:05.023610] [INFO ] [REMOTE ] FTK: Full fetch complete (42996 records). [2025-10-01T19:04:05.040065] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-01T19:04:05.596414] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-01T19:04:05.613926] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-01T19:04:05.626595] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-01T19:04:05.648434] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-01T19:04:05.705628] [DEBUG] [LOCAL ] FTV: Trimmed 76315 records to 52928 (keeping 200 days of data) [2025-10-01T19:04:05.750817] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-01T19:04:05.750913] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-01T19:04:05.751325] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-01T19:04:05.751373] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-01T19:04:05.752487] [DEBUG] [LOCAL ] FTK: Trimmed 42996 records to 32200 (keeping 200 days of data) [2025-10-01T19:04:05.980392] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-01T19:04:05.985510] [INFO ] [REMOTE ] FTS: Full fetch complete (60189 records). [2025-10-01T19:04:05.986887] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-01T19:04:06.616638] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-01T19:04:06.617750] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-01T19:04:06.619462] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-01T19:04:06.619565] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-01T19:04:06.625408] [DEBUG] [LOCAL ] FTS: Trimmed 60189 records to 42138 (keeping 200 days of data) [2025-10-01T19:04:06.745014] [DEBUG] [LOCAL ] FTK: Primary data saved (32200 records). [2025-10-01T19:04:06.745910] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-01T19:04:06.746818] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 36.0s. Estimated remaining: 3h 29m 26s. Rate: 7.1 symbols/min [2025-10-01T19:04:06.963043] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:07.017909] [DEBUG] [LOCAL ] FUL: Loaded 33034 existing records from primary storage. [2025-10-01T19:04:07.019990] [INFO ] [MAIN ] FUL: Loaded 33034 existing records. [2025-10-01T19:04:07.394848] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:07.398630] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-01T19:04:07.399145] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-01T19:04:07.401253] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-01T19:04:07.402038] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-01T19:04:07.546341] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-01T19:04:07.586702] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-01T19:04:07.872769] [DEBUG] [LOCAL ] FTV: Primary data saved (52928 records). [2025-10-01T19:04:07.894784] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-01T19:04:07.918524] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:07.919431] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-01T19:04:07.921552] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTV took 37.2s. Estimated remaining: 3h 29m 5s. Rate: 7.1 symbols/min [2025-10-01T19:04:08.127022] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:08.148181] [DEBUG] [LOCAL ] FTS: Primary data saved (42138 records). [2025-10-01T19:04:08.148380] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-01T19:04:08.148482] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTS took 37.4s. Estimated remaining: 3h 28m 43s. Rate: 7.1 symbols/min [2025-10-01T19:04:08.377971] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:08.398267] [DEBUG] [LOCAL ] FUN: Loaded 51596 existing records from primary storage. [2025-10-01T19:04:08.398729] [INFO ] [MAIN ] FUN: Loaded 51596 existing records. [2025-10-01T19:04:08.560308] [DEBUG] [LOCAL ] FVR: Loaded 21794 existing records from primary storage. [2025-10-01T19:04:08.582953] [INFO ] [MAIN ] FVR: Loaded 21794 existing records. [2025-10-01T19:04:08.715174] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:08.730876] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-01T19:04:08.730948] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-01T19:04:08.736878] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-01T19:04:08.758128] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-01T19:04:08.970696] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:08.995878] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-01T19:04:08.996387] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-01T19:04:09.027880] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-01T19:04:09.061682] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-01T19:04:09.243002] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T19:04:09.335323] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-01T19:04:09.515198] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:09.565699] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-01T19:04:09.727556] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:09.728081] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-01T19:04:09.846089] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-01T19:04:09.858010] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-01T19:04:10.426086] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T19:04:10.502356] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-01T19:04:10.907056] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T19:04:11.169608] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T19:04:11.302401] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-01T19:04:11.833043] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T19:04:12.102382] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-01T19:04:12.870745] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T19:04:12.902373] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-01T19:04:13.136730] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T19:04:13.222286] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (3.36 seconds). [2025-10-01T19:04:13.224090] [INFO ] [REMOTE ] FUBO: Full fetch complete (77764 records). [2025-10-01T19:04:13.224209] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-01T19:04:13.666910] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-01T19:04:13.667052] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-01T19:04:13.668098] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-01T19:04:13.668176] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-01T19:04:13.671066] [DEBUG] [LOCAL ] FUBO: Trimmed 77764 records to 53697 (keeping 200 days of data) [2025-10-01T19:04:13.720231] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-01T19:04:13.996093] [DEBUG] [LOCAL ] FUBO: Primary data saved (53697 records). [2025-10-01T19:04:13.996320] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-01T19:04:13.996572] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 32.8s. Estimated remaining: 3h 28m 30s. Rate: 7.1 symbols/min [2025-10-01T19:04:14.213030] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:14.259755] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T19:04:14.283075] [DEBUG] [LOCAL ] FVRR: Loaded 40051 existing records from primary storage. [2025-10-01T19:04:14.283397] [INFO ] [MAIN ] FVRR: Loaded 40051 existing records. [2025-10-01T19:04:14.476224] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:14.476543] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-01T19:04:14.476597] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-01T19:04:14.477780] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-01T19:04:14.477869] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-01T19:04:14.509305] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-01T19:04:14.829809] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T19:04:14.898216] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:15.302409] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-01T19:04:16.102507] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-01T19:04:16.130078] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T19:04:16.902356] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-01T19:04:17.023003] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T19:04:17.052841] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T19:04:17.702378] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-01T19:04:18.152802] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T19:04:18.502350] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-01T19:04:18.596136] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T19:04:19.302352] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-01T19:04:19.615453] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T19:04:20.102381] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-01T19:04:20.788204] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T19:04:20.902391] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-01T19:04:21.702404] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-01T19:04:21.850293] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:04:21.984062] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T19:04:22.502371] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-01T19:04:22.725282] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T19:04:23.302349] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-01T19:04:23.538954] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T19:04:24.102384] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-01T19:04:24.860927] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T19:04:24.902356] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-01T19:04:24.932192] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T19:04:25.702374] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-01T19:04:26.365290] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:04:26.502382] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-01T19:04:26.623885] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T19:04:27.302429] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-01T19:04:27.946548] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:04:28.102380] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-01T19:04:28.902366] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-01T19:04:28.993522] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T19:04:29.022131] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T19:04:29.702355] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-01T19:04:30.502349] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-01T19:04:30.572042] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-01T19:04:30.574005] [INFO ] [REMOTE ] FUL: Full fetch complete (47534 records). [2025-10-01T19:04:30.574147] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-01T19:04:31.025329] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-01T19:04:31.025433] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-01T19:04:31.026241] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-01T19:04:31.026323] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-01T19:04:31.027517] [DEBUG] [LOCAL ] FUL: Trimmed 47534 records to 32983 (keeping 200 days of data) [2025-10-01T19:04:31.250123] [DEBUG] [LOCAL ] FUL: Primary data saved (32983 records). [2025-10-01T19:04:31.250292] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-01T19:04:31.250414] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUL took 24.5s. Estimated remaining: 3h 28m 37s. Rate: 7.1 symbols/min [2025-10-01T19:04:31.305116] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-01T19:04:31.459470] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T19:04:31.486680] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:31.501921] [DEBUG] [LOCAL ] FXED: Loaded 1236 existing records from primary storage. [2025-10-01T19:04:31.502177] [INFO ] [MAIN ] FXED: Loaded 1236 existing records. [2025-10-01T19:04:31.659722] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T19:04:31.723701] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:31.723923] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-01T19:04:31.723972] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-01T19:04:31.724158] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-01T19:04:31.724227] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-01T19:04:32.109288] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-01T19:04:32.109221] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:32.602612] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T19:04:32.902387] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-01T19:04:33.259352] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-01T19:04:33.702384] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-01T19:04:33.918941] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T19:04:34.502424] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-01T19:04:35.034913] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T19:04:35.302359] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-01T19:04:35.539370] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T19:04:35.642319] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-01T19:04:36.102379] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-01T19:04:36.812525] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T19:04:36.902439] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-01T19:04:37.702389] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-01T19:04:38.033225] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-01T19:04:38.441074] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T19:04:38.502408] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-01T19:04:39.302424] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-01T19:04:40.011273] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T19:04:40.102418] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-01T19:04:40.754920] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T19:04:40.902372] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-01T19:04:41.243876] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-01T19:04:41.245117] [INFO ] [REMOTE ] FVR: Full fetch complete (30300 records). [2025-10-01T19:04:41.245225] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-01T19:04:41.668628] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-01T19:04:41.668742] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-01T19:04:41.669323] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-01T19:04:41.669383] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-01T19:04:41.670605] [DEBUG] [LOCAL ] FVR: Trimmed 30300 records to 21768 (keeping 200 days of data) [2025-10-01T19:04:41.733109] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-01T19:04:41.824089] [DEBUG] [LOCAL ] FVR: Primary data saved (21768 records). [2025-10-01T19:04:41.824236] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-01T19:04:41.824339] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 33.7s. Estimated remaining: 3h 28m 32s. Rate: 7.1 symbols/min [2025-10-01T19:04:42.007309] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:42.056477] [DEBUG] [LOCAL ] G: Loaded 49805 existing records from primary storage. [2025-10-01T19:04:42.056862] [INFO ] [MAIN ] G: Loaded 49805 existing records. [2025-10-01T19:04:42.251963] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:42.252201] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-01T19:04:42.252250] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-01T19:04:42.252547] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-01T19:04:42.252678] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-01T19:04:42.512816] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-01T19:04:42.654516] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:42.911733] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-01T19:04:43.086470] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T19:04:43.302370] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-01T19:04:43.350312] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-01T19:04:43.352853] [INFO ] [REMOTE ] FUN: Full fetch complete (72864 records). [2025-10-01T19:04:43.352982] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-01T19:04:43.820380] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-01T19:04:43.820484] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-01T19:04:43.821712] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-01T19:04:43.821794] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-01T19:04:43.823498] [DEBUG] [LOCAL ] FUN: Trimmed 72864 records to 51609 (keeping 200 days of data) [2025-10-01T19:04:44.111865] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-01T19:04:44.158779] [DEBUG] [LOCAL ] FUN: Primary data saved (51609 records). [2025-10-01T19:04:44.158967] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-01T19:04:44.159098] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUN took 36.2s. Estimated remaining: 3h 28m 13s. Rate: 7.1 symbols/min [2025-10-01T19:04:44.345309] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:44.374226] [DEBUG] [LOCAL ] GAB: Loaded 28043 existing records from primary storage. [2025-10-01T19:04:44.374518] [INFO ] [MAIN ] GAB: Loaded 28043 existing records. [2025-10-01T19:04:44.587557] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:44.587827] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-01T19:04:44.587889] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-01T19:04:44.588148] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-01T19:04:44.588208] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-01T19:04:44.644205] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-01T19:04:44.902463] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-01T19:04:45.009288] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:45.038626] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T19:04:45.702399] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-01T19:04:46.330475] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T19:04:46.502384] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-01T19:04:46.957975] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T19:04:47.302414] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-01T19:04:47.983775] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T19:04:48.102416] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-01T19:04:48.345970] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T19:04:48.446160] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-01T19:04:48.902388] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-01T19:04:49.702422] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-01T19:04:50.054794] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-01T19:04:50.502441] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-01T19:04:50.636509] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T19:04:51.302401] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-01T19:04:51.755490] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T19:04:52.102440] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-01T19:04:52.530099] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-01T19:04:52.534229] [INFO ] [REMOTE ] FVRR: Full fetch complete (58954 records). [2025-10-01T19:04:52.534452] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-01T19:04:52.911204] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-01T19:04:52.961584] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-01T19:04:52.961701] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-01T19:04:52.962590] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-01T19:04:52.962667] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-01T19:04:52.964093] [DEBUG] [LOCAL ] FVRR: Trimmed 58954 records to 40034 (keeping 200 days of data) [2025-10-01T19:04:53.227167] [DEBUG] [LOCAL ] FVRR: Primary data saved (40034 records). [2025-10-01T19:04:53.227291] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-01T19:04:53.227369] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FVRR took 39.2s. Estimated remaining: 3h 28m 6s. Rate: 7.1 symbols/min [2025-10-01T19:04:53.416628] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T19:04:53.424311] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T19:04:53.452805] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:04:53.459605] [DEBUG] [LOCAL ] GAM: Loaded 4066 existing records from primary storage. [2025-10-01T19:04:53.459827] [INFO ] [MAIN ] GAM: Loaded 4066 existing records. [2025-10-01T19:04:53.656155] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:04:53.656358] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-01T19:04:53.656407] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-01T19:04:53.656598] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-01T19:04:53.656686] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-01T19:04:53.707474] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-01T19:04:54.059482] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:04:54.502382] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-01T19:04:55.302443] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-01T19:04:55.346153] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T19:04:55.415000] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T19:04:55.629011] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-01T19:04:56.102397] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-01T19:04:56.902373] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-01T19:04:57.698800] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:04:57.709111] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-01T19:04:58.186754] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-01T19:04:58.351457] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T19:04:58.502385] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-01T19:04:59.302387] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-01T19:05:00.102438] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-01T19:05:00.231633] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:05:00.614007] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T19:05:00.757951] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-01T19:05:00.902427] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-01T19:05:01.510383] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-01T19:05:01.511158] [INFO ] [REMOTE ] FXED: Full fetch complete (1798 records). [2025-10-01T19:05:01.511234] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-01T19:05:01.708757] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-01T19:05:01.987741] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-01T19:05:01.987869] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-01T19:05:01.987976] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-01T19:05:01.988017] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-01T19:05:01.988413] [DEBUG] [LOCAL ] FXED: Trimmed 1798 records to 1241 (keeping 200 days of data) [2025-10-01T19:05:01.998510] [DEBUG] [LOCAL ] FXED: Primary data saved (1241 records). [2025-10-01T19:05:01.998678] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-01T19:05:01.998852] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FXED took 30.7s. Estimated remaining: 3h 27m 58s. Rate: 7.1 symbols/min [2025-10-01T19:05:02.195358] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:05:02.254070] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-10-01T19:05:02.254459] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-10-01T19:05:02.470287] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:05:02.470523] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-01T19:05:02.470583] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-01T19:05:02.470977] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-01T19:05:02.471248] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-01T19:05:02.512308] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-01T19:05:02.920841] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:05:02.943874] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T19:05:03.117984] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T19:05:03.302387] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-01T19:05:04.102422] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-01T19:05:04.680937] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-01T19:05:04.903767] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-01T19:05:04.906794] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T19:05:05.702406] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-01T19:05:06.208758] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-01T19:05:06.423509] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T19:05:06.502375] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-01T19:05:07.302393] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-01T19:05:08.110558] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-01T19:05:08.135381] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T19:05:08.552059] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T19:05:08.902422] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-01T19:05:09.702360] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-01T19:05:09.982840] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-01T19:05:10.180297] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T19:05:10.284885] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T19:05:10.502382] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-01T19:05:11.302381] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-01T19:05:11.995244] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T19:05:12.102411] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-01T19:05:12.661571] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T19:05:12.731702] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T19:05:12.902403] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-01T19:05:13.702407] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-01T19:05:14.502380] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-01T19:05:14.854230] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T19:05:15.040272] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-01T19:05:15.302361] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-01T19:05:15.341584] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T19:05:16.102377] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-01T19:05:16.202485] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T19:05:16.902416] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-01T19:05:17.702386] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-01T19:05:18.155937] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T19:05:18.241226] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-01T19:05:18.278976] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T19:05:18.502387] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-01T19:05:19.302380] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-01T19:05:19.759906] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T19:05:20.102382] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-01T19:05:20.228455] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:05:20.902375] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-01T19:05:21.702392] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-01T19:05:22.330866] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T19:05:22.332436] [INFO ] [REMOTE ] G: Full fetch complete (71616 records). [2025-10-01T19:05:22.332577] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-01T19:05:22.527910] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-01T19:05:22.779032] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-01T19:05:22.779176] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-01T19:05:22.780295] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-01T19:05:22.780381] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-01T19:05:22.781967] [DEBUG] [LOCAL ] G: Trimmed 71616 records to 49838 (keeping 200 days of data) [2025-10-01T19:05:22.911674] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-01T19:05:23.146158] [DEBUG] [LOCAL ] G: Primary data saved (49838 records). [2025-10-01T19:05:23.146311] [INFO ] [MAIN ] G: Full history saved. [2025-10-01T19:05:23.146398] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. G took 41.3s. Estimated remaining: 3h 28m 11s. Rate: 7.1 symbols/min [2025-10-01T19:05:23.240008] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-01T19:05:23.267812] [INFO ] [REMOTE ] GAB: Full fetch complete (39711 records). [2025-10-01T19:05:23.273637] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-01T19:05:23.309150] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-01T19:05:23.309364] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-01T19:05:23.355072] [INFO ] [REMOTE ] GAM: Full fetch complete (6753 records). [2025-10-01T19:05:23.408086] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-01T19:05:23.412178] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:05:23.883394] [DEBUG] [LOCAL ] GATX: Loaded 18178 existing records from primary storage. [2025-10-01T19:05:23.911714] [INFO ] [MAIN ] GATX: Loaded 18178 existing records. [2025-10-01T19:05:24.413473] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-01T19:05:24.443364] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-01T19:05:24.443688] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-01T19:05:24.483041] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-01T19:05:24.482925] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:05:24.479632] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-01T19:05:24.483568] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-01T19:05:24.483801] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-01T19:05:24.483337] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-01T19:05:24.483721] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-01T19:05:24.483927] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-01T19:05:24.485003] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-01T19:05:24.484963] [DEBUG] [LOCAL ] GAM: Trimmed 6753 records to 4061 (keeping 200 days of data) [2025-10-01T19:05:24.485306] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-01T19:05:24.497361] [DEBUG] [LOCAL ] GAB: Trimmed 39711 records to 27976 (keeping 200 days of data) [2025-10-01T19:05:24.900680] [DEBUG] [LOCAL ] GAM: Primary data saved (4061 records). [2025-10-01T19:05:24.918058] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-01T19:05:24.924300] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 31.7s. Estimated remaining: 3h 27m 51s. Rate: 7.1 symbols/min [2025-10-01T19:05:25.095008] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:05:25.112361] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-01T19:05:25.236479] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:05:25.260194] [DEBUG] [LOCAL ] GBAB: Loaded 13066 existing records from primary storage. [2025-10-01T19:05:25.261879] [INFO ] [MAIN ] GBAB: Loaded 13066 existing records. [2025-10-01T19:05:25.566259] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:05:25.569559] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-01T19:05:25.577825] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-01T19:05:25.577540] [DEBUG] [LOCAL ] GAB: Primary data saved (27976 records). [2025-10-01T19:05:25.586201] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-01T19:05:25.586344] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAB took 41.4s. Estimated remaining: 3h 27m 30s. Rate: 7.1 symbols/min [2025-10-01T19:05:25.586115] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-01T19:05:25.595903] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-01T19:05:25.625706] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-01T19:05:25.625364] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-01T19:05:25.910218] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:05:26.212718] [DEBUG] [LOCAL ] GBCI: Loaded 40042 existing records from primary storage. [2025-10-01T19:05:26.249701] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:05:26.250182] [INFO ] [MAIN ] GBCI: Loaded 40042 existing records. [2025-10-01T19:05:26.255896] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-01T19:05:26.361494] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T19:05:26.483774] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:05:26.484044] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-01T19:05:26.484114] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-01T19:05:26.484447] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-01T19:05:26.484523] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-01T19:05:26.517377] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-01T19:05:26.917879] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:05:27.302361] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-01T19:05:27.352702] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-01T19:05:27.581969] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T19:05:27.720832] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-01T19:05:28.102394] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-01T19:05:28.693381] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T19:05:28.902407] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-01T19:05:29.523837] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T19:05:29.702400] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-01T19:05:29.941684] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T19:05:30.502396] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-01T19:05:30.518465] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-01T19:05:31.302375] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-01T19:05:32.102484] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-01T19:05:32.559067] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T19:05:32.841532] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T19:05:32.902341] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-01T19:05:32.995115] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-01T19:05:32.997540] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-10-01T19:05:32.997890] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-01T19:05:33.434393] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-01T19:05:33.434481] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-01T19:05:33.435456] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-01T19:05:33.435524] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-01T19:05:33.437029] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 53655 (keeping 200 days of data) [2025-10-01T19:05:33.675909] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T19:05:33.702540] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-01T19:05:33.808153] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-10-01T19:05:33.808317] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-01T19:05:33.808420] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 31.8s. Estimated remaining: 3h 27m 21s. Rate: 7.1 symbols/min [2025-10-01T19:05:33.993327] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:05:33.993524] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-01T19:05:33.993580] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-01T19:05:33.993727] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-01T19:05:33.993774] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-01T19:05:33.993816] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-01T19:05:33.993859] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-01T19:05:34.377935] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:05:34.387894] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T19:05:34.502432] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-01T19:05:34.939175] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T19:05:35.302427] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-01T19:05:36.102425] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-01T19:05:36.810097] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T19:05:36.859321] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T19:05:36.902392] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-01T19:05:37.702432] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-01T19:05:37.758283] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T19:05:38.005600] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-01T19:05:38.502451] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-01T19:05:39.302428] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-01T19:05:39.467180] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T19:05:40.102435] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-01T19:05:40.525876] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T19:05:40.613105] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T19:05:40.902387] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-01T19:05:41.191968] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-01T19:05:41.702398] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-01T19:05:42.319265] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-01T19:05:42.502434] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-01T19:05:43.302391] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-01T19:05:43.565199] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T19:05:44.102368] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-01T19:05:44.223630] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T19:05:44.539743] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T19:05:44.902419] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-01T19:05:45.316276] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-01T19:05:45.702403] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-01T19:05:45.947461] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-01T19:05:46.502376] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-01T19:05:47.178801] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T19:05:47.302400] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-01T19:05:48.102384] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-01T19:05:48.902371] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-01T19:05:49.010010] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T19:05:49.099870] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T19:05:49.496951] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T19:05:49.702431] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-01T19:05:50.032295] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-01T19:05:50.502384] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-01T19:05:51.302379] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-01T19:05:51.622703] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T19:05:51.843927] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T19:05:52.102421] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-01T19:05:52.402378] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-01T19:05:52.902435] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-01T19:05:53.443328] [DEBUG] [REMOTE ] GBLI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:05:53.443637] [WARN ] [REMOTE ] GBLI: No data returned for month 2025-10 [2025-10-01T19:05:53.443754] [FATAL] [REMOTE ] GBLI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:05:53.443869] [FATAL] [MAIN ] GBLI: Failed to fetch primary data. [2025-10-01T19:05:53.443952] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:05:53.444042] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-01T19:05:53.444181] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-01T19:05:53.444254] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-01T19:05:53.444360] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-01T19:05:53.444450] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GBLI took 19.6s. Estimated remaining: 3h 27m 31s. Rate: 7.1 symbols/min [2025-10-01T19:05:53.671021] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:05:53.710801] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-01T19:05:53.713730] [DEBUG] [LOCAL ] GBTG: Loaded 40050 existing records from primary storage. [2025-10-01T19:05:53.714060] [INFO ] [MAIN ] GBTG: Loaded 40050 existing records. [2025-10-01T19:05:53.926971] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:05:53.927188] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-01T19:05:53.927242] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-01T19:05:53.928148] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-01T19:05:53.928212] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-01T19:05:54.342879] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:05:54.502393] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-01T19:05:55.103032] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T19:05:55.302431] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-01T19:05:55.890750] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T19:05:56.102407] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-01T19:05:56.155366] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T19:05:56.902394] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-01T19:05:57.543755] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:05:57.702412] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-01T19:05:58.061899] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T19:05:58.062911] [INFO ] [REMOTE ] GATX: Full fetch complete (25236 records). [2025-10-01T19:05:58.062988] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-01T19:05:58.484191] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-01T19:05:58.484300] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-01T19:05:58.484864] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-01T19:05:58.484929] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-01T19:05:58.485831] [DEBUG] [LOCAL ] GATX: Trimmed 25236 records to 18174 (keeping 200 days of data) [2025-10-01T19:05:58.538308] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-01T19:05:58.613870] [DEBUG] [LOCAL ] GATX: Primary data saved (18174 records). [2025-10-01T19:05:58.614035] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-01T19:05:58.614140] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GATX took 35.5s. Estimated remaining: 3h 27m 17s. Rate: 7.1 symbols/min [2025-10-01T19:05:58.809517] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:05:58.841968] [DEBUG] [LOCAL ] GBX: Loaded 29176 existing records from primary storage. [2025-10-01T19:05:58.842265] [INFO ] [MAIN ] GBX: Loaded 29176 existing records. [2025-10-01T19:05:59.047831] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:05:59.048263] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-01T19:05:59.048453] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-01T19:05:59.048751] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-01T19:05:59.048823] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-01T19:05:59.165889] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T19:05:59.307572] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-01T19:05:59.485285] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:05:59.766727] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T19:06:00.102426] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-01T19:06:00.430801] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T19:06:00.431760] [INFO ] [REMOTE ] GBAB: Full fetch complete (19791 records). [2025-10-01T19:06:00.431838] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-01T19:06:00.838828] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-01T19:06:00.838909] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-01T19:06:00.839407] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-01T19:06:00.839472] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-01T19:06:00.840153] [DEBUG] [LOCAL ] GBAB: Trimmed 19791 records to 13085 (keeping 200 days of data) [2025-10-01T19:06:00.902470] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-01T19:06:00.930076] [DEBUG] [LOCAL ] GBAB: Primary data saved (13085 records). [2025-10-01T19:06:00.930227] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-01T19:06:00.930322] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBAB took 36.0s. Estimated remaining: 3h 26m 59s. Rate: 7.1 symbols/min [2025-10-01T19:06:01.114585] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:06:01.161733] [DEBUG] [LOCAL ] GCI: Loaded 44090 existing records from primary storage. [2025-10-01T19:06:01.162139] [INFO ] [MAIN ] GCI: Loaded 44090 existing records. [2025-10-01T19:06:01.370710] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:06:01.371009] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-01T19:06:01.376456] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-01T19:06:01.387312] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-01T19:06:01.388189] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T19:06:01.388439] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-01T19:06:01.707533] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-01T19:06:01.851229] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:06:02.502366] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-01T19:06:02.609150] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T19:06:02.907510] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T19:06:03.302457] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-01T19:06:03.852679] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T19:06:04.102381] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-01T19:06:04.780346] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T19:06:04.902395] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-01T19:06:05.590491] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T19:06:05.702445] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-01T19:06:06.341886] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T19:06:06.502404] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-01T19:06:07.198231] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T19:06:07.302374] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-01T19:06:07.700424] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T19:06:08.102394] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-01T19:06:08.902402] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-01T19:06:09.116972] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-01T19:06:09.118615] [INFO ] [REMOTE ] GBCI: Full fetch complete (58157 records). [2025-10-01T19:06:09.118860] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-01T19:06:09.539188] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T19:06:09.578191] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-01T19:06:09.578285] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-01T19:06:09.580189] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-01T19:06:09.580456] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-01T19:06:09.586756] [DEBUG] [LOCAL ] GBCI: Trimmed 58157 records to 40011 (keeping 200 days of data) [2025-10-01T19:06:09.702685] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-01T19:06:09.844522] [DEBUG] [LOCAL ] GBCI: Primary data saved (40011 records). [2025-10-01T19:06:09.844733] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-01T19:06:09.844852] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBCI took 44.3s. Estimated remaining: 3h 26m 51s. Rate: 7.1 symbols/min [2025-10-01T19:06:10.034499] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:06:10.060951] [DEBUG] [LOCAL ] GCO: Loaded 24721 existing records from primary storage. [2025-10-01T19:06:10.061236] [INFO ] [MAIN ] GCO: Loaded 24721 existing records. [2025-10-01T19:06:10.286987] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:06:10.287742] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-01T19:06:10.287977] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-01T19:06:10.288531] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-01T19:06:10.288605] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-01T19:06:10.500900] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:06:10.518848] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-01T19:06:10.750717] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:06:10.997667] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T19:06:11.302390] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-01T19:06:12.025688] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T19:06:12.102377] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-01T19:06:12.579409] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T19:06:12.902398] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-01T19:06:13.676233] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T19:06:13.702398] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-01T19:06:13.972782] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T19:06:14.502394] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-01T19:06:15.302363] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-01T19:06:15.393969] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T19:06:16.107450] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-01T19:06:16.123589] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T19:06:16.470141] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T19:06:16.902384] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-01T19:06:17.646740] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:06:17.700521] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T19:06:17.705053] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-01T19:06:18.502359] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-01T19:06:19.307668] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-01T19:06:19.325318] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T19:06:19.633742] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T19:06:20.102396] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-01T19:06:20.702192] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T19:06:20.902385] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-01T19:06:21.702380] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-01T19:06:21.806668] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T19:06:22.250182] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T19:06:22.502357] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-01T19:06:22.823025] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T19:06:23.302377] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-01T19:06:23.921421] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T19:06:24.102378] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-01T19:06:24.328636] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T19:06:24.902387] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-01T19:06:25.702399] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-01T19:06:25.808044] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T19:06:25.809599] [INFO ] [REMOTE ] GBTG: Full fetch complete (56620 records). [2025-10-01T19:06:25.809810] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-01T19:06:26.164725] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T19:06:26.281123] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-01T19:06:26.281227] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-01T19:06:26.282116] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-01T19:06:26.282183] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-01T19:06:26.283422] [DEBUG] [LOCAL ] GBTG: Trimmed 56620 records to 40046 (keeping 200 days of data) [2025-10-01T19:06:26.502861] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-01T19:06:26.531570] [DEBUG] [LOCAL ] GBTG: Primary data saved (40046 records). [2025-10-01T19:06:26.531756] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-01T19:06:26.531854] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBTG took 33.1s. Estimated remaining: 3h 26m 56s. Rate: 7.1 symbols/min [2025-10-01T19:06:26.724415] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:06:26.746521] [DEBUG] [LOCAL ] GCTS: Loaded 19897 existing records from primary storage. [2025-10-01T19:06:26.746872] [INFO ] [MAIN ] GCTS: Loaded 19897 existing records. [2025-10-01T19:06:26.949435] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:06:26.949667] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-01T19:06:26.949731] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-01T19:06:26.949965] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-01T19:06:26.950024] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-01T19:06:27.312623] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-01T19:06:27.384354] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:06:27.386948] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T19:06:28.102403] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-01T19:06:28.170761] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T19:06:28.444759] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T19:06:28.902427] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-01T19:06:29.182215] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T19:06:29.702413] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-01T19:06:30.001413] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T19:06:30.502384] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-01T19:06:31.005081] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T19:06:31.083794] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T19:06:31.302424] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-01T19:06:32.102365] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-01T19:06:32.418747] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T19:06:32.902406] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-01T19:06:33.702411] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-01T19:06:33.932139] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-01T19:06:33.933778] [INFO ] [REMOTE ] GCI: Full fetch complete (63182 records). [2025-10-01T19:06:33.933883] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-01T19:06:34.384943] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T19:06:34.414625] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-01T19:06:34.414758] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-01T19:06:34.416598] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-01T19:06:34.416696] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-01T19:06:34.418159] [DEBUG] [LOCAL ] GCI: Trimmed 63182 records to 44121 (keeping 200 days of data) [2025-10-01T19:06:34.505193] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-01T19:06:34.700184] [DEBUG] [LOCAL ] GCI: Primary data saved (44121 records). [2025-10-01T19:06:34.700352] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-01T19:06:34.700457] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCI took 33.8s. Estimated remaining: 3h 26m 48s. Rate: 7.1 symbols/min [2025-10-01T19:06:34.901266] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:06:34.910221] [DEBUG] [LOCAL ] GCV: Loaded 7318 existing records from primary storage. [2025-10-01T19:06:34.910427] [INFO ] [MAIN ] GCV: Loaded 7318 existing records. [2025-10-01T19:06:35.041616] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T19:06:35.131353] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:06:35.131594] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-01T19:06:35.131668] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-01T19:06:35.131903] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-01T19:06:35.131965] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-01T19:06:35.295784] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T19:06:35.321384] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-01T19:06:35.555391] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:06:36.102366] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-01T19:06:36.268980] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T19:06:36.902422] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-01T19:06:37.437412] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-01T19:06:37.438598] [INFO ] [REMOTE ] GBX: Full fetch complete (42820 records). [2025-10-01T19:06:37.438719] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-01T19:06:37.707466] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-01T19:06:37.861947] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-01T19:06:37.862066] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-01T19:06:37.862870] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-01T19:06:37.863001] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-01T19:06:37.864220] [DEBUG] [LOCAL ] GBX: Trimmed 42820 records to 29152 (keeping 200 days of data) [2025-10-01T19:06:37.977913] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T19:06:38.071086] [DEBUG] [LOCAL ] GBX: Primary data saved (29152 records). [2025-10-01T19:06:38.071259] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-01T19:06:38.071385] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GBX took 39.5s. Estimated remaining: 3h 26m 31s. Rate: 7.1 symbols/min [2025-10-01T19:06:38.259766] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:06:38.266553] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-01T19:06:38.318988] [DEBUG] [LOCAL ] GD: Loaded 47170 existing records from primary storage. [2025-10-01T19:06:38.319316] [INFO ] [MAIN ] GD: Loaded 47170 existing records. [2025-10-01T19:06:38.515685] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-01T19:06:38.538949] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:06:38.540301] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-01T19:06:38.540365] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-01T19:06:38.540941] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-01T19:06:38.541062] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-01T19:06:38.947201] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:06:39.185081] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T19:06:39.302390] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-01T19:06:39.908958] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T19:06:40.102460] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-01T19:06:40.902403] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-01T19:06:41.702394] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-01T19:06:41.881370] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T19:06:42.041163] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T19:06:42.100768] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-01T19:06:42.502416] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-01T19:06:43.289575] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T19:06:43.302331] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-01T19:06:44.059694] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T19:06:44.102421] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-01T19:06:44.902411] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-01T19:06:45.587955] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T19:06:45.702377] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-01T19:06:45.797003] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T19:06:46.502398] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-01T19:06:46.870364] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T19:06:46.871461] [INFO ] [REMOTE ] GCO: Full fetch complete (35461 records). [2025-10-01T19:06:46.871598] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-01T19:06:47.100179] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T19:06:47.309291] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-01T19:06:47.326291] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-01T19:06:47.326411] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-01T19:06:47.327298] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-01T19:06:47.327365] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-01T19:06:47.328864] [DEBUG] [LOCAL ] GCO: Trimmed 35461 records to 24664 (keeping 200 days of data) [2025-10-01T19:06:47.481570] [DEBUG] [LOCAL ] GCO: Primary data saved (24664 records). [2025-10-01T19:06:47.481730] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-01T19:06:47.481824] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 37.6s. Estimated remaining: 3h 26m 24s. Rate: 7.1 symbols/min [2025-10-01T19:06:47.673940] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:06:47.726338] [DEBUG] [LOCAL ] GDDY: Loaded 49657 existing records from primary storage. [2025-10-01T19:06:47.726733] [INFO ] [MAIN ] GDDY: Loaded 49657 existing records. [2025-10-01T19:06:47.941436] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:06:47.941774] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-01T19:06:47.941850] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-01T19:06:47.942158] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-01T19:06:47.942218] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-01T19:06:48.116795] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-01T19:06:48.117107] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T19:06:48.374663] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:06:48.902372] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-01T19:06:49.702421] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-01T19:06:50.012866] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T19:06:50.330728] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T19:06:50.502357] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-01T19:06:50.607568] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T19:06:51.104742] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T19:06:51.302389] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-01T19:06:52.102360] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-01T19:06:52.307500] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T19:06:52.902393] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-01T19:06:53.530369] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T19:06:53.702428] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-01T19:06:53.832770] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-01T19:06:53.833607] [INFO ] [REMOTE ] GCV: Full fetch complete (9362 records). [2025-10-01T19:06:53.833716] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-01T19:06:54.240714] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-01T19:06:54.240799] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-01T19:06:54.241051] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-01T19:06:54.241097] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-01T19:06:54.241553] [DEBUG] [LOCAL ] GCV: Trimmed 9362 records to 7370 (keeping 200 days of data) [2025-10-01T19:06:54.289626] [DEBUG] [LOCAL ] GCV: Primary data saved (7370 records). [2025-10-01T19:06:54.289798] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-01T19:06:54.289890] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 19.6s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-01T19:06:54.479841] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:06:54.493556] [DEBUG] [LOCAL ] GDIV: Loaded 3635 existing records from primary storage. [2025-10-01T19:06:54.493828] [INFO ] [MAIN ] GDIV: Loaded 3635 existing records. [2025-10-01T19:06:54.507851] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-01T19:06:54.716961] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:06:54.717304] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-01T19:06:54.717412] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-01T19:06:54.717827] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-01T19:06:54.717914] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-01T19:06:55.309480] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-01T19:06:55.317704] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:06:55.364519] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T19:06:56.102422] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-01T19:06:56.551309] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T19:06:56.597176] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T19:06:56.902383] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-01T19:06:57.702397] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-01T19:06:57.765088] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T19:06:58.502383] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-01T19:06:58.802174] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T19:06:59.116949] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T19:06:59.302373] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-01T19:07:00.091579] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T19:07:00.102605] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-01T19:07:00.463092] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T19:07:00.522271] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-01T19:07:00.902380] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-01T19:07:01.702410] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-01T19:07:02.502362] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-01T19:07:02.621572] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T19:07:03.073124] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T19:07:03.302390] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-01T19:07:03.459346] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T19:07:04.102380] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-01T19:07:04.902369] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-01T19:07:04.973099] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T19:07:05.106385] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T19:07:05.702425] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-01T19:07:06.502358] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-01T19:07:06.551048] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T19:07:06.782442] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T19:07:06.941331] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-01T19:07:07.302421] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-01T19:07:07.757056] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T19:07:08.102403] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-01T19:07:08.902427] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-01T19:07:09.351619] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T19:07:09.352829] [INFO ] [REMOTE ] GCTS: Full fetch complete (26890 records). [2025-10-01T19:07:09.352910] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-01T19:07:09.707509] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-01T19:07:09.780152] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-01T19:07:09.780235] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-01T19:07:09.780930] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-01T19:07:09.780996] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-01T19:07:09.781857] [DEBUG] [LOCAL ] GCTS: Trimmed 26890 records to 19957 (keeping 200 days of data) [2025-10-01T19:07:09.907881] [DEBUG] [LOCAL ] GCTS: Primary data saved (19957 records). [2025-10-01T19:07:09.908030] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-01T19:07:09.908143] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 43.4s. Estimated remaining: 3h 26m 16s. Rate: 7.1 symbols/min [2025-10-01T19:07:10.089540] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:07:10.095051] [DEBUG] [LOCAL ] GDL: Loaded 2563 existing records from primary storage. [2025-10-01T19:07:10.095240] [INFO ] [MAIN ] GDL: Loaded 2563 existing records. [2025-10-01T19:07:10.291094] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:07:10.291392] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-01T19:07:10.291525] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-01T19:07:10.291761] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-01T19:07:10.291821] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-01T19:07:10.510252] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-01T19:07:10.620484] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T19:07:10.756479] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:07:10.758685] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T19:07:11.302387] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-01T19:07:12.078480] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T19:07:12.103809] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-01T19:07:12.109189] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T19:07:12.593147] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-01T19:07:12.902353] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-01T19:07:13.330781] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T19:07:13.702383] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-01T19:07:14.502411] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-01T19:07:15.302365] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-01T19:07:15.416895] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T19:07:15.811456] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-01T19:07:15.903990] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T19:07:16.102382] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-01T19:07:16.902379] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-01T19:07:17.302921] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-01T19:07:17.702366] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-01T19:07:17.816283] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T19:07:18.018379] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-01T19:07:18.502368] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-01T19:07:19.302383] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-01T19:07:19.573441] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-01T19:07:20.102376] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-01T19:07:20.467765] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T19:07:20.836391] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T19:07:20.837921] [INFO ] [REMOTE ] GD: Full fetch complete (70366 records). [2025-10-01T19:07:20.838028] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-01T19:07:20.908486] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-01T19:07:21.272228] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-01T19:07:21.272323] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-01T19:07:21.273324] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-01T19:07:21.273393] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-01T19:07:21.275038] [DEBUG] [LOCAL ] GD: Trimmed 70366 records to 47149 (keeping 200 days of data) [2025-10-01T19:07:21.511468] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T19:07:21.598217] [DEBUG] [LOCAL ] GD: Primary data saved (47149 records). [2025-10-01T19:07:21.598402] [INFO ] [MAIN ] GD: Full history saved. [2025-10-01T19:07:21.598501] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GD took 43.5s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-01T19:07:21.707532] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-01T19:07:21.788681] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:07:21.798093] [DEBUG] [LOCAL ] GDO: Loaded 5980 existing records from primary storage. [2025-10-01T19:07:21.798316] [INFO ] [MAIN ] GDO: Loaded 5980 existing records. [2025-10-01T19:07:22.003632] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:07:22.003923] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-01T19:07:22.003972] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-01T19:07:22.004200] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-01T19:07:22.004258] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-01T19:07:22.134792] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T19:07:22.415626] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:07:22.502370] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-01T19:07:22.973772] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-01T19:07:23.302412] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-01T19:07:23.937033] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T19:07:24.102377] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-01T19:07:24.772304] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-01T19:07:24.773050] [INFO ] [REMOTE ] GDIV: Full fetch complete (5462 records). [2025-10-01T19:07:24.773123] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-01T19:07:24.907515] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-01T19:07:25.169500] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-01T19:07:25.169595] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-01T19:07:25.169785] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-01T19:07:25.169843] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-01T19:07:25.170244] [DEBUG] [LOCAL ] GDIV: Trimmed 5462 records to 3623 (keeping 200 days of data) [2025-10-01T19:07:25.193171] [DEBUG] [LOCAL ] GDIV: Primary data saved (3623 records). [2025-10-01T19:07:25.193275] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-01T19:07:25.193359] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDIV took 30.9s. Estimated remaining: 3h 25m 57s. Rate: 7.1 symbols/min [2025-10-01T19:07:25.381834] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:07:25.432166] [DEBUG] [LOCAL ] GDOT: Loaded 38364 existing records from primary storage. [2025-10-01T19:07:25.432458] [INFO ] [MAIN ] GDOT: Loaded 38364 existing records. [2025-10-01T19:07:25.524877] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T19:07:25.643662] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:07:25.643890] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-01T19:07:25.643944] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-01T19:07:25.644363] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-01T19:07:25.644447] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-01T19:07:25.709134] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-01T19:07:26.068262] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:07:26.261787] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T19:07:26.502367] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-01T19:07:27.302398] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-01T19:07:27.893633] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T19:07:28.008259] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T19:07:28.102360] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-01T19:07:28.902399] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-01T19:07:29.397424] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-01T19:07:29.702382] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-01T19:07:30.162397] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-01T19:07:30.353872] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T19:07:30.355920] [INFO ] [REMOTE ] GDDY: Full fetch complete (71419 records). [2025-10-01T19:07:30.356035] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-01T19:07:30.507509] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-01T19:07:30.787934] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-01T19:07:30.788023] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-01T19:07:30.788953] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-01T19:07:30.789016] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-01T19:07:30.790663] [DEBUG] [LOCAL ] GDDY: Trimmed 71419 records to 49682 (keeping 200 days of data) [2025-10-01T19:07:31.106960] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T19:07:31.114519] [DEBUG] [LOCAL ] GDDY: Primary data saved (49682 records). [2025-10-01T19:07:31.114688] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-01T19:07:31.114790] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDDY took 43.6s. Estimated remaining: 3h 25m 44s. Rate: 7.1 symbols/min [2025-10-01T19:07:31.296427] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:07:31.302429] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-01T19:07:31.318177] [DEBUG] [LOCAL ] GDV: Loaded 19538 existing records from primary storage. [2025-10-01T19:07:31.318437] [INFO ] [MAIN ] GDV: Loaded 19538 existing records. [2025-10-01T19:07:31.527877] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:07:31.528142] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-01T19:07:31.528199] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-01T19:07:31.528843] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-01T19:07:31.528904] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-01T19:07:31.941795] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:07:32.102434] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-01T19:07:32.673387] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T19:07:32.727150] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-01T19:07:32.902408] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-01T19:07:33.702426] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-01T19:07:33.977544] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T19:07:34.098703] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-01T19:07:34.502370] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-01T19:07:35.276638] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T19:07:35.302347] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-01T19:07:36.102368] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-01T19:07:36.393536] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T19:07:36.902375] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-01T19:07:37.160228] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T19:07:37.628745] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-01T19:07:37.629894] [INFO ] [REMOTE ] GDL: Full fetch complete (3651 records). [2025-10-01T19:07:37.629992] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-01T19:07:37.707602] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-01T19:07:38.040521] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-01T19:07:38.040628] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-01T19:07:38.040844] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-01T19:07:38.040959] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-01T19:07:38.041400] [DEBUG] [LOCAL ] GDL: Trimmed 3651 records to 2566 (keeping 200 days of data) [2025-10-01T19:07:38.057473] [DEBUG] [LOCAL ] GDL: Primary data saved (2566 records). [2025-10-01T19:07:38.057607] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-01T19:07:38.057732] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDL took 28.1s. Estimated remaining: 3h 25m 33s. Rate: 7.1 symbols/min [2025-10-01T19:07:38.242340] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:07:38.248997] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-01T19:07:38.307126] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-10-01T19:07:38.307473] [INFO ] [MAIN ] GE: Loaded 53713 existing records. [2025-10-01T19:07:38.495307] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:07:38.495539] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-01T19:07:38.495608] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-01T19:07:38.496016] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-01T19:07:38.496079] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-01T19:07:38.507549] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-01T19:07:38.917207] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:07:39.177547] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T19:07:39.302384] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-01T19:07:40.102355] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-01T19:07:40.902383] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-01T19:07:41.231421] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-01T19:07:41.305157] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T19:07:41.702371] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-01T19:07:41.770045] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T19:07:42.502383] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-01T19:07:43.266491] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T19:07:43.302354] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-01T19:07:43.333077] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T19:07:44.102394] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-01T19:07:44.489892] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T19:07:44.902392] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-01T19:07:45.702364] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-01T19:07:45.944806] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T19:07:46.038142] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T19:07:46.383459] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T19:07:46.502387] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-01T19:07:47.302404] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-01T19:07:47.492263] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T19:07:48.041580] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T19:07:48.102399] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-01T19:07:48.902417] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-01T19:07:49.499636] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T19:07:49.531889] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T19:07:49.702366] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-01T19:07:50.470486] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-01T19:07:50.471271] [INFO ] [REMOTE ] GDO: Full fetch complete (9196 records). [2025-10-01T19:07:50.471357] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-01T19:07:50.508291] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-01T19:07:50.872310] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-01T19:07:50.872421] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-01T19:07:50.872714] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-01T19:07:50.872778] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-01T19:07:50.873249] [DEBUG] [LOCAL ] GDO: Trimmed 9196 records to 5984 (keeping 200 days of data) [2025-10-01T19:07:50.912436] [DEBUG] [LOCAL ] GDO: Primary data saved (5984 records). [2025-10-01T19:07:50.912629] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-01T19:07:50.912772] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 29.3s. Estimated remaining: 3h 25m 32s. Rate: 7.1 symbols/min [2025-10-01T19:07:51.091909] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:07:51.114248] [DEBUG] [LOCAL ] GEF: Loaded 20508 existing records from primary storage. [2025-10-01T19:07:51.114505] [INFO ] [MAIN ] GEF: Loaded 20508 existing records. [2025-10-01T19:07:51.307714] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-01T19:07:51.311976] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:07:51.312934] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-01T19:07:51.313009] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-01T19:07:51.313344] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-01T19:07:51.313408] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-01T19:07:51.712323] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:07:51.744582] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T19:07:52.102415] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-01T19:07:52.902392] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-01T19:07:53.105422] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T19:07:53.204166] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T19:07:53.628567] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T19:07:53.702411] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-01T19:07:54.502381] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-01T19:07:55.291076] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T19:07:55.302344] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-01T19:07:55.693676] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-01T19:07:56.102393] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-01T19:07:56.314613] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T19:07:56.315595] [INFO ] [REMOTE ] GDV: Full fetch complete (28533 records). [2025-10-01T19:07:56.315709] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-01T19:07:56.726925] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-01T19:07:56.727044] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-01T19:07:56.727718] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-01T19:07:56.727803] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-01T19:07:56.729120] [DEBUG] [LOCAL ] GDV: Trimmed 28533 records to 19475 (keeping 200 days of data) [2025-10-01T19:07:56.852488] [DEBUG] [LOCAL ] GDV: Primary data saved (19475 records). [2025-10-01T19:07:56.852639] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-01T19:07:56.852778] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDV took 25.7s. Estimated remaining: 3h 25m 20s. Rate: 7.1 symbols/min [2025-10-01T19:07:56.907518] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-01T19:07:57.052551] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:07:57.088534] [DEBUG] [LOCAL ] GEL: Loaded 33317 existing records from primary storage. [2025-10-01T19:07:57.088926] [INFO ] [MAIN ] GEL: Loaded 33317 existing records. [2025-10-01T19:07:57.278074] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T19:07:57.316829] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:07:57.316992] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-01T19:07:57.317042] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-01T19:07:57.317515] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-01T19:07:57.317577] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-01T19:07:57.706685] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-01T19:07:57.727842] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:07:58.376383] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T19:07:58.502405] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-01T19:07:59.302384] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-01T19:07:59.491419] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T19:07:59.979923] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-01T19:08:00.102377] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-01T19:08:00.476911] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T19:08:00.907441] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-01T19:08:00.914747] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T19:08:01.702433] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-01T19:08:02.502378] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-01T19:08:03.190091] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T19:08:03.302364] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-01T19:08:03.451200] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-01T19:08:03.731846] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T19:08:04.104287] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-01T19:08:04.108120] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T19:08:04.902384] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-01T19:08:05.562985] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:08:05.702427] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-01T19:08:06.502445] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-01T19:08:06.823402] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-01T19:08:07.216536] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T19:08:07.302353] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-01T19:08:08.102436] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-01T19:08:08.238000] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T19:08:08.834936] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T19:08:08.902398] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-01T19:08:09.016065] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-01T19:08:09.702381] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-01T19:08:10.502362] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-01T19:08:10.880758] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T19:08:10.880074] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-01T19:08:10.888670] [INFO ] [REMOTE ] GDOT: Full fetch complete (53060 records). [2025-10-01T19:08:10.889160] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-01T19:08:11.306716] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-01T19:08:11.346323] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-01T19:08:11.346453] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-01T19:08:11.347282] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-01T19:08:11.347349] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-01T19:08:11.348798] [DEBUG] [LOCAL ] GDOT: Trimmed 53060 records to 38324 (keeping 200 days of data) [2025-10-01T19:08:11.589227] [DEBUG] [LOCAL ] GDOT: Primary data saved (38324 records). [2025-10-01T19:08:11.589397] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-01T19:08:11.589522] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDOT took 46.4s. Estimated remaining: 3h 25m 21s. Rate: 7.1 symbols/min [2025-10-01T19:08:11.792090] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:08:11.849831] [DEBUG] [LOCAL ] GENI: Loaded 52925 existing records from primary storage. [2025-10-01T19:08:11.850165] [INFO ] [MAIN ] GENI: Loaded 52925 existing records. [2025-10-01T19:08:11.983703] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T19:08:12.080310] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:08:12.080582] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-01T19:08:12.080664] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-01T19:08:12.081359] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-01T19:08:12.081425] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-01T19:08:12.107596] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-01T19:08:12.527273] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:08:12.556900] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T19:08:12.902388] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-01T19:08:13.702386] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-01T19:08:14.367950] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T19:08:14.502397] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-01T19:08:14.550708] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-01T19:08:14.783994] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T19:08:15.302377] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-01T19:08:16.111297] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-01T19:08:16.139380] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T19:08:16.902395] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-01T19:08:17.596529] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-01T19:08:17.637088] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T19:08:17.702360] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-01T19:08:17.756722] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T19:08:18.502386] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-01T19:08:19.302357] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-01T19:08:19.342709] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T19:08:20.102442] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-01T19:08:20.439533] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T19:08:20.543148] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T19:08:20.902406] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-01T19:08:21.702407] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-01T19:08:21.801289] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T19:08:22.294491] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-01T19:08:22.295958] [INFO ] [REMOTE ] GEF: Full fetch complete (29532 records). [2025-10-01T19:08:22.296104] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-01T19:08:22.512984] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-01T19:08:22.719489] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-01T19:08:22.719597] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-01T19:08:22.720248] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-01T19:08:22.720312] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-01T19:08:22.721128] [DEBUG] [LOCAL ] GEF: Trimmed 29532 records to 20682 (keeping 200 days of data) [2025-10-01T19:08:22.856393] [DEBUG] [LOCAL ] GEF: Primary data saved (20682 records). [2025-10-01T19:08:22.856524] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-01T19:08:22.856630] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEF took 31.9s. Estimated remaining: 3h 25m 17s. Rate: 7.1 symbols/min [2025-10-01T19:08:23.039077] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:08:23.093278] [DEBUG] [LOCAL ] GEO: Loaded 51949 existing records from primary storage. [2025-10-01T19:08:23.093664] [INFO ] [MAIN ] GEO: Loaded 51949 existing records. [2025-10-01T19:08:23.306086] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-01T19:08:23.311446] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:08:23.312810] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-01T19:08:23.312912] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-01T19:08:23.313186] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-01T19:08:23.313294] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-01T19:08:23.715274] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:08:23.980420] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T19:08:24.102414] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-01T19:08:24.475524] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T19:08:24.729579] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-01T19:08:24.731221] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-10-01T19:08:24.731338] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-01T19:08:24.911477] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-01T19:08:25.173317] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-01T19:08:25.173425] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-01T19:08:25.174507] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-01T19:08:25.174684] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-01T19:08:25.176329] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 53714 (keeping 200 days of data) [2025-10-01T19:08:25.545103] [DEBUG] [LOCAL ] GE: Primary data saved (53714 records). [2025-10-01T19:08:25.545251] [INFO ] [MAIN ] GE: Full history saved. [2025-10-01T19:08:25.545381] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GE took 47.5s. Estimated remaining: 3h 24m 60s. Rate: 7.1 symbols/min [2025-10-01T19:08:25.705630] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-01T19:08:25.745012] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:08:25.779664] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T19:08:25.825802] [DEBUG] [LOCAL ] GES: Loaded 39447 existing records from primary storage. [2025-10-01T19:08:25.826141] [INFO ] [MAIN ] GES: Loaded 39447 existing records. [2025-10-01T19:08:26.015790] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:08:26.016007] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-01T19:08:26.016062] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-01T19:08:26.016334] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-01T19:08:26.016394] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-01T19:08:26.414341] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:08:26.502395] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-01T19:08:26.885475] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T19:08:27.167514] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T19:08:27.302401] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-01T19:08:27.894534] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T19:08:28.102387] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-01T19:08:28.878513] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T19:08:28.902351] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-01T19:08:29.209166] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T19:08:29.702392] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-01T19:08:30.502372] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-01T19:08:30.681281] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T19:08:31.023196] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T19:08:31.302396] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-01T19:08:31.697333] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T19:08:31.698536] [INFO ] [REMOTE ] GEL: Full fetch complete (48516 records). [2025-10-01T19:08:31.698637] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-01T19:08:32.106220] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-01T19:08:32.119130] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-01T19:08:32.119199] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-01T19:08:32.120032] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-01T19:08:32.120189] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-01T19:08:32.121371] [DEBUG] [LOCAL ] GEL: Trimmed 48516 records to 33118 (keeping 200 days of data) [2025-10-01T19:08:32.326547] [DEBUG] [LOCAL ] GEL: Primary data saved (33118 records). [2025-10-01T19:08:32.326745] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-01T19:08:32.326847] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEL took 35.5s. Estimated remaining: 3h 24m 49s. Rate: 7.1 symbols/min [2025-10-01T19:08:32.521427] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:08:32.558587] [DEBUG] [LOCAL ] GETY: Loaded 35567 existing records from primary storage. [2025-10-01T19:08:32.559055] [INFO ] [MAIN ] GETY: Loaded 35567 existing records. [2025-10-01T19:08:32.753515] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:08:32.753927] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-01T19:08:32.754095] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-01T19:08:32.754706] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-01T19:08:32.754892] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-01T19:08:32.904419] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-01T19:08:32.913591] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T19:08:33.220913] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:08:33.430922] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T19:08:33.702414] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-01T19:08:34.502372] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-01T19:08:34.591945] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T19:08:34.712176] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T19:08:35.302389] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-01T19:08:36.102347] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-01T19:08:36.198260] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T19:08:36.818857] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T19:08:36.902419] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-01T19:08:37.702397] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-01T19:08:37.778185] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T19:08:38.502378] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-01T19:08:38.692039] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T19:08:39.302537] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-01T19:08:39.406515] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T19:08:40.102367] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-01T19:08:40.485720] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-01T19:08:40.902351] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-01T19:08:41.109820] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T19:08:41.470795] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T19:08:41.702441] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-01T19:08:42.502424] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-01T19:08:42.632796] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T19:08:43.302414] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-01T19:08:44.102362] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-01T19:08:44.107247] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-01T19:08:44.112969] [INFO ] [REMOTE ] GENI: Full fetch complete (75472 records). [2025-10-01T19:08:44.113244] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-01T19:08:44.257194] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T19:08:44.598921] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-01T19:08:44.599059] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-01T19:08:44.600155] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-01T19:08:44.600240] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-01T19:08:44.615335] [DEBUG] [LOCAL ] GENI: Trimmed 75472 records to 52930 (keeping 200 days of data) [2025-10-01T19:08:44.628513] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T19:08:44.918911] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-01T19:08:44.974594] [DEBUG] [LOCAL ] GENI: Primary data saved (52930 records). [2025-10-01T19:08:44.974894] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-01T19:08:44.975015] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 33.4s. Estimated remaining: 3h 24m 47s. Rate: 7.1 symbols/min [2025-10-01T19:08:45.164127] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:08:45.224193] [DEBUG] [LOCAL ] GEV: Loaded 53059 existing records from primary storage. [2025-10-01T19:08:45.224534] [INFO ] [MAIN ] GEV: Loaded 53059 existing records. [2025-10-01T19:08:45.425125] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:08:45.425533] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-01T19:08:45.425623] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-01T19:08:45.426721] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-01T19:08:45.426782] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-01T19:08:45.720176] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-01T19:08:45.840568] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:08:45.834760] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T19:08:46.453191] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T19:08:46.502369] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-01T19:08:47.302367] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-01T19:08:47.397153] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:08:48.102417] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-01T19:08:48.527689] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T19:08:48.555919] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-01T19:08:48.902396] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-01T19:08:49.566290] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T19:08:49.702426] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-01T19:08:49.945082] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T19:08:50.502383] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-01T19:08:51.015258] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T19:08:51.302409] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-01T19:08:51.936784] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:08:52.102434] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-01T19:08:52.897117] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T19:08:52.907521] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-01T19:08:53.550469] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T19:08:53.702374] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-01T19:08:53.799691] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T19:08:54.502422] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-01T19:08:55.102072] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T19:08:55.302380] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-01T19:08:55.904256] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T19:08:56.102383] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-01T19:08:56.902394] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-01T19:08:57.360268] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-01T19:08:57.362926] [INFO ] [REMOTE ] GEO: Full fetch complete (75462 records). [2025-10-01T19:08:57.363072] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-01T19:08:57.707500] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-01T19:08:57.790304] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-01T19:08:57.790403] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-01T19:08:57.791354] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-01T19:08:57.791419] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-01T19:08:57.793054] [DEBUG] [LOCAL ] GEO: Trimmed 75462 records to 51950 (keeping 200 days of data) [2025-10-01T19:08:58.052884] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T19:08:58.169691] [DEBUG] [LOCAL ] GEO: Primary data saved (51950 records). [2025-10-01T19:08:58.169844] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-01T19:08:58.169989] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GEO took 35.3s. Estimated remaining: 3h 24m 46s. Rate: 7.1 symbols/min [2025-10-01T19:08:58.361564] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:08:58.366806] [DEBUG] [LOCAL ] GF: Loaded 2999 existing records from primary storage. [2025-10-01T19:08:58.366963] [INFO ] [MAIN ] GF: Loaded 2999 existing records. [2025-10-01T19:08:58.505758] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-01T19:08:58.574539] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:08:58.574877] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-01T19:08:58.574940] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-01T19:08:58.586200] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-01T19:08:58.601112] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-01T19:08:58.647593] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-01T19:08:59.012669] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:08:59.302427] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-01T19:08:59.418194] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T19:08:59.419732] [INFO ] [REMOTE ] GES: Full fetch complete (59548 records). [2025-10-01T19:08:59.419846] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-01T19:08:59.854933] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-01T19:08:59.855075] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-01T19:08:59.855990] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-01T19:08:59.856056] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-01T19:08:59.857495] [DEBUG] [LOCAL ] GES: Trimmed 59548 records to 39414 (keeping 200 days of data) [2025-10-01T19:09:00.102447] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-01T19:09:00.126185] [DEBUG] [LOCAL ] GES: Primary data saved (39414 records). [2025-10-01T19:09:00.126336] [INFO ] [MAIN ] GES: Full history saved. [2025-10-01T19:09:00.126432] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GES took 34.6s. Estimated remaining: 3h 24m 27s. Rate: 7.1 symbols/min [2025-10-01T19:09:00.284954] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-01T19:09:00.286506] [INFO ] [REMOTE ] GETY: Full fetch complete (55505 records). [2025-10-01T19:09:00.286613] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-01T19:09:00.704365] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-01T19:09:00.704444] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-01T19:09:00.705242] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-01T19:09:00.705387] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-01T19:09:00.706815] [DEBUG] [LOCAL ] GETY: Trimmed 55505 records to 35605 (keeping 200 days of data) [2025-10-01T19:09:00.797313] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T19:09:00.902351] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-01T19:09:00.926442] [DEBUG] [LOCAL ] GETY: Primary data saved (35605 records). [2025-10-01T19:09:00.926573] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-01T19:09:00.926685] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GETY took 28.6s. Estimated remaining: 3h 24m 7s. Rate: 7.1 symbols/min [2025-10-01T19:09:01.259122] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-01T19:09:01.497010] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T19:09:01.702348] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-01T19:09:02.311773] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T19:09:02.502359] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-01T19:09:03.302390] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-01T19:09:03.376375] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T19:09:04.102383] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-01T19:09:04.561793] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-01T19:09:04.902402] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-01T19:09:05.413851] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T19:09:05.567078] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-01T19:09:05.702381] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-01T19:09:06.502380] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-01T19:09:07.095872] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T19:09:07.302391] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-01T19:09:07.739913] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T19:09:07.772223] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-01T19:09:08.102381] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-01T19:09:08.487513] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-01T19:09:08.902384] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-01T19:09:09.702384] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-01T19:09:10.102634] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-01T19:09:10.502438] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-01T19:09:11.083811] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T19:09:11.084471] [INFO ] [REMOTE ] GF: Full fetch complete (5190 records). [2025-10-01T19:09:11.084539] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-01T19:09:11.489957] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-01T19:09:11.490180] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-01T19:09:11.490399] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-01T19:09:11.490481] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-01T19:09:11.491100] [DEBUG] [LOCAL ] GF: Trimmed 5190 records to 2967 (keeping 200 days of data) [2025-10-01T19:09:11.527349] [DEBUG] [LOCAL ] GF: Primary data saved (2967 records). [2025-10-01T19:09:11.548052] [INFO ] [MAIN ] GF: Full history saved. [2025-10-01T19:09:11.548217] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 13.4s. Estimated remaining: 3h 24m 2s. Rate: 7.1 symbols/min [2025-10-01T19:09:11.551459] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-01T19:09:11.563702] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-01T19:09:13.618705] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-01T19:09:13.629563] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-01T19:09:15.933081] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-01T19:09:15.944699] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-01T19:09:18.234712] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-01T19:09:18.246390] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-01T19:09:20.598792] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-01T19:09:20.612617] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-01T19:09:24.191597] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (3.58 seconds). [2025-10-01T19:09:24.193348] [INFO ] [REMOTE ] GEV: Full fetch complete (76919 records). [2025-10-01T19:09:24.193463] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-01T19:09:24.626018] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-01T19:09:24.626107] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-01T19:09:24.627262] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-01T19:09:24.627331] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-01T19:09:24.629109] [DEBUG] [LOCAL ] GEV: Trimmed 76919 records to 53053 (keeping 200 days of data) [2025-10-01T19:09:24.998798] [DEBUG] [LOCAL ] GEV: Primary data saved (53053 records). [2025-10-01T19:09:24.998952] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-01T19:09:24.999040] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 40.0s. Estimated remaining: 3h 24m 1s. Rate: 7.1 symbols/min [2025-10-01T19:09:25.538283] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:25.739246] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:25.774666] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:25.737493] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:25.806720] [DEBUG] [LOCAL ] GFR: Loaded 8366 existing records from primary storage. [2025-10-01T19:09:25.807847] [INFO ] [MAIN ] GFR: Loaded 8366 existing records. [2025-10-01T19:09:25.807553] [DEBUG] [LOCAL ] GFF: Loaded 30408 existing records from primary storage. [2025-10-01T19:09:25.825569] [INFO ] [MAIN ] GFF: Loaded 30408 existing records. [2025-10-01T19:09:26.244981] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:26.269563] [DEBUG] [LOCAL ] GFL: Loaded 47943 existing records from primary storage. [2025-10-01T19:09:26.270480] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-01T19:09:26.287317] [INFO ] [MAIN ] GFL: Loaded 47943 existing records. [2025-10-01T19:09:26.294057] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:26.288140] [DEBUG] [LOCAL ] GFI: Loaded 53102 existing records from primary storage. [2025-10-01T19:09:26.294619] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-01T19:09:26.294733] [INFO ] [MAIN ] GFI: Loaded 53102 existing records. [2025-10-01T19:09:26.294216] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-01T19:09:26.294886] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-01T19:09:26.360043] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-01T19:09:26.387942] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-01T19:09:26.449847] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-01T19:09:26.465522] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-01T19:09:26.897731] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:27.013008] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:27.013234] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-01T19:09:27.036692] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-01T19:09:27.046972] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-01T19:09:27.065754] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-01T19:09:27.067097] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-01T19:09:27.093931] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-01T19:09:27.146266] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-01T19:09:27.159873] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-01T19:09:27.873851] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:27.940925] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-01T19:09:28.036073] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:28.121388] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-01T19:09:28.348364] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:28.352389] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-01T19:09:28.443366] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:28.443808] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-01T19:09:28.731718] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T19:09:28.735204] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-01T19:09:29.385037] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T19:09:29.391233] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-01T19:09:29.714375] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T19:09:29.717092] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-01T19:09:29.904783] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T19:09:29.914079] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-01T19:09:29.995000] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T19:09:30.005496] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-01T19:09:30.215713] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-01T19:09:30.218302] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-01T19:09:30.714959] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T19:09:30.722133] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-01T19:09:30.734100] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-01T19:09:30.737427] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-01T19:09:31.454023] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T19:09:31.464137] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-01T19:09:31.535934] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T19:09:31.546975] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-01T19:09:31.677973] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T19:09:31.684532] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-01T19:09:31.839503] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T19:09:31.843115] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-01T19:09:32.601589] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T19:09:32.605146] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-01T19:09:32.666983] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T19:09:32.677500] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-01T19:09:32.867698] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T19:09:32.875025] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-01T19:09:33.017614] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T19:09:33.028254] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-01T19:09:33.082619] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-01T19:09:33.084867] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-01T19:09:33.586531] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-01T19:09:33.588987] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-01T19:09:34.165470] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T19:09:34.167378] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-01T19:09:34.328105] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T19:09:34.336541] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-01T19:09:34.577537] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T19:09:34.588846] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-01T19:09:34.628543] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T19:09:35.048899] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T19:09:35.302355] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-01T19:09:35.343343] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T19:09:35.954447] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T19:09:35.955576] [INFO ] [REMOTE ] GFR: Full fetch complete (12519 records). [2025-10-01T19:09:35.955672] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-01T19:09:36.109603] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-01T19:09:36.372939] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-01T19:09:36.373107] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-01T19:09:36.373615] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-01T19:09:36.373788] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-01T19:09:36.374765] [DEBUG] [LOCAL ] GFR: Trimmed 12519 records to 8335 (keeping 200 days of data) [2025-10-01T19:09:36.423698] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T19:09:36.467685] [DEBUG] [LOCAL ] GFR: Primary data saved (8335 records). [2025-10-01T19:09:36.467861] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-01T19:09:36.467969] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 11.5s. Estimated remaining: 3h 23m 58s. Rate: 7.1 symbols/min [2025-10-01T19:09:36.659390] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:36.715254] [DEBUG] [LOCAL ] GGB: Loaded 51085 existing records from primary storage. [2025-10-01T19:09:36.715577] [INFO ] [MAIN ] GGB: Loaded 51085 existing records. [2025-10-01T19:09:36.913859] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-01T19:09:36.920449] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:36.921414] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-01T19:09:36.921475] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-01T19:09:36.922006] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-01T19:09:36.922077] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-01T19:09:37.373372] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:37.389201] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T19:09:37.702425] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-01T19:09:38.502391] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-01T19:09:38.797199] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T19:09:38.871550] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T19:09:39.302389] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-01T19:09:40.004820] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:09:40.102347] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-01T19:09:40.902366] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-01T19:09:40.931586] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T19:09:41.702379] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-01T19:09:42.131359] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T19:09:42.186436] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-01T19:09:42.502365] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-01T19:09:43.014949] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T19:09:43.302411] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-01T19:09:44.102378] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-01T19:09:44.248208] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T19:09:44.764873] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T19:09:44.902361] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-01T19:09:45.157480] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T19:09:45.702401] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-01T19:09:46.335940] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T19:09:46.502402] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-01T19:09:47.302431] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-01T19:09:47.519210] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T19:09:47.809512] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T19:09:48.102420] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-01T19:09:48.902359] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-01T19:09:48.941264] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T19:09:48.942484] [INFO ] [REMOTE ] GFF: Full fetch complete (44107 records). [2025-10-01T19:09:48.942569] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-01T19:09:49.377447] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-01T19:09:49.377565] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-01T19:09:49.378356] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-01T19:09:49.378420] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-01T19:09:49.379442] [DEBUG] [LOCAL ] GFF: Trimmed 44107 records to 30368 (keeping 200 days of data) [2025-10-01T19:09:49.594577] [DEBUG] [LOCAL ] GFF: Primary data saved (30368 records). [2025-10-01T19:09:49.594749] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-01T19:09:49.594846] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 24.6s. Estimated remaining: 3h 23m 57s. Rate: 7.1 symbols/min [2025-10-01T19:09:49.706505] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-01T19:09:49.800590] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:49.841301] [DEBUG] [LOCAL ] GGG: Loaded 40945 existing records from primary storage. [2025-10-01T19:09:49.841630] [INFO ] [MAIN ] GGG: Loaded 40945 existing records. [2025-10-01T19:09:50.048125] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:50.048407] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-01T19:09:50.048602] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-01T19:09:50.048967] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-01T19:09:50.049038] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-01T19:09:50.447271] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-01T19:09:50.499362] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:50.502332] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-01T19:09:50.597494] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-01T19:09:50.599246] [INFO ] [REMOTE ] GFL: Full fetch complete (69057 records). [2025-10-01T19:09:50.599361] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-01T19:09:51.043800] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-01T19:09:51.043898] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-01T19:09:51.044857] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-01T19:09:51.044923] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-01T19:09:51.046296] [DEBUG] [LOCAL ] GFL: Trimmed 69057 records to 47938 (keeping 200 days of data) [2025-10-01T19:09:51.304302] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-01T19:09:51.340826] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T19:09:51.405360] [DEBUG] [LOCAL ] GFL: Primary data saved (47938 records). [2025-10-01T19:09:51.405517] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-01T19:09:51.405608] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 26.4s. Estimated remaining: 3h 23m 38s. Rate: 7.1 symbols/min [2025-10-01T19:09:51.592227] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:51.609120] [DEBUG] [LOCAL ] GGT: Loaded 14105 existing records from primary storage. [2025-10-01T19:09:51.609363] [INFO ] [MAIN ] GGT: Loaded 14105 existing records. [2025-10-01T19:09:51.809429] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:51.809720] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-01T19:09:51.809776] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-01T19:09:51.810055] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-01T19:09:51.810114] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-01T19:09:52.103998] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-01T19:09:52.212795] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:52.259521] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T19:09:52.847202] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T19:09:52.902388] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-01T19:09:53.647576] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T19:09:53.702366] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-01T19:09:53.733661] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T19:09:54.502377] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-01T19:09:55.302371] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-01T19:09:55.367620] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:09:56.102389] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-01T19:09:56.531033] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T19:09:56.902399] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-01T19:09:57.557716] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-01T19:09:57.559299] [INFO ] [REMOTE ] GFI: Full fetch complete (76390 records). [2025-10-01T19:09:57.559413] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-01T19:09:57.723847] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-01T19:09:57.999664] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-01T19:09:58.000060] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-01T19:09:58.001135] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-01T19:09:58.001390] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-01T19:09:58.003288] [DEBUG] [LOCAL ] GFI: Trimmed 76390 records to 53104 (keeping 200 days of data) [2025-10-01T19:09:58.154834] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T19:09:58.167711] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T19:09:58.429048] [DEBUG] [LOCAL ] GFI: Primary data saved (53104 records). [2025-10-01T19:09:58.429194] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-01T19:09:58.429283] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 33.4s. Estimated remaining: 3h 23m 27s. Rate: 7.1 symbols/min [2025-10-01T19:09:58.510346] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-01T19:09:58.536581] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:09:58.636553] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:09:58.641369] [DEBUG] [LOCAL ] GGZ: Loaded 2407 existing records from primary storage. [2025-10-01T19:09:58.641530] [INFO ] [MAIN ] GGZ: Loaded 2407 existing records. [2025-10-01T19:09:58.843024] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:09:58.843278] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-01T19:09:58.843329] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-01T19:09:58.843502] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-01T19:09:58.843561] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-01T19:09:59.272872] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:09:59.302351] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-01T19:10:00.102413] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-01T19:10:00.135341] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-01T19:10:00.350392] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T19:10:00.612972] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-01T19:10:00.902384] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-01T19:10:01.702430] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-01T19:10:02.315132] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T19:10:02.502374] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-01T19:10:02.742104] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T19:10:03.302451] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-01T19:10:04.013684] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T19:10:04.060687] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T19:10:04.102421] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-01T19:10:04.902384] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-01T19:10:05.230829] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-01T19:10:05.702380] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-01T19:10:05.892288] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T19:10:06.193065] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-01T19:10:06.502388] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-01T19:10:07.067825] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T19:10:07.302421] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-01T19:10:08.102392] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-01T19:10:08.902407] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-01T19:10:09.314932] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-01T19:10:09.363805] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T19:10:09.702468] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-01T19:10:09.813698] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T19:10:10.502367] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-01T19:10:10.517996] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T19:10:11.302417] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-01T19:10:11.675935] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-01T19:10:11.997059] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T19:10:12.102398] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-01T19:10:12.547400] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T19:10:12.902393] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-01T19:10:13.702393] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-01T19:10:13.902987] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T19:10:13.990885] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-01T19:10:14.502398] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-01T19:10:14.904073] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-01T19:10:15.302415] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-01T19:10:16.102381] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-01T19:10:16.318019] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T19:10:16.734450] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T19:10:16.735181] [INFO ] [REMOTE ] GGZ: Full fetch complete (4171 records). [2025-10-01T19:10:16.735253] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-01T19:10:16.907571] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-01T19:10:17.149973] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-01T19:10:17.150069] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-01T19:10:17.150255] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-01T19:10:17.150295] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-01T19:10:17.150677] [DEBUG] [LOCAL ] GGZ: Trimmed 4171 records to 2416 (keeping 200 days of data) [2025-10-01T19:10:17.167173] [DEBUG] [LOCAL ] GGZ: Primary data saved (2416 records). [2025-10-01T19:10:17.167284] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-01T19:10:17.167378] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGZ took 18.7s. Estimated remaining: 3h 23m 35s. Rate: 7.1 symbols/min [2025-10-01T19:10:17.354067] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:10:17.360100] [DEBUG] [LOCAL ] GHC: Loaded 2667 existing records from primary storage. [2025-10-01T19:10:17.360266] [INFO ] [MAIN ] GHC: Loaded 2667 existing records. [2025-10-01T19:10:17.549669] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:10:17.550039] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-01T19:10:17.550098] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-01T19:10:17.550516] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-01T19:10:17.550575] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-01T19:10:17.710054] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-01T19:10:17.960579] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:10:17.975210] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T19:10:18.502419] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-01T19:10:19.302404] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-01T19:10:19.386574] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:10:19.428423] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T19:10:20.102427] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-01T19:10:20.409859] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-01T19:10:20.902457] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-01T19:10:21.221291] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T19:10:21.702404] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-01T19:10:22.104469] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T19:10:22.502373] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-01T19:10:23.302366] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-01T19:10:23.477185] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T19:10:23.797694] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T19:10:24.032243] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T19:10:24.102347] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-01T19:10:24.902420] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-01T19:10:25.531799] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T19:10:25.702438] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-01T19:10:26.206583] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T19:10:26.207579] [INFO ] [REMOTE ] GGT: Full fetch complete (18789 records). [2025-10-01T19:10:26.207709] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-01T19:10:26.346271] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T19:10:26.507571] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-01T19:10:26.723071] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-01T19:10:26.723173] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-01T19:10:26.723730] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-01T19:10:26.723796] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-01T19:10:26.724798] [DEBUG] [LOCAL ] GGT: Trimmed 18789 records to 14063 (keeping 200 days of data) [2025-10-01T19:10:26.813706] [DEBUG] [LOCAL ] GGT: Primary data saved (14063 records). [2025-10-01T19:10:26.813856] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-01T19:10:26.813992] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGT took 35.4s. Estimated remaining: 3h 23m 28s. Rate: 7.1 symbols/min [2025-10-01T19:10:27.010531] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:10:27.018894] [DEBUG] [LOCAL ] GHG: Loaded 3182 existing records from primary storage. [2025-10-01T19:10:27.019130] [INFO ] [MAIN ] GHG: Loaded 3182 existing records. [2025-10-01T19:10:27.139494] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T19:10:27.230725] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:10:27.231015] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-01T19:10:27.231080] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-01T19:10:27.231349] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-01T19:10:27.231418] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-01T19:10:27.307621] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-01T19:10:27.633231] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:10:28.027941] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T19:10:28.102425] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-01T19:10:28.902394] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-01T19:10:29.702423] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-01T19:10:29.988772] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T19:10:29.990357] [INFO ] [REMOTE ] GGG: Full fetch complete (59321 records). [2025-10-01T19:10:29.990498] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-01T19:10:30.134979] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T19:10:30.470150] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-01T19:10:30.470246] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-01T19:10:30.471147] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-01T19:10:30.471215] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-01T19:10:30.472482] [DEBUG] [LOCAL ] GGG: Trimmed 59321 records to 40968 (keeping 200 days of data) [2025-10-01T19:10:30.529212] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-01T19:10:30.740302] [DEBUG] [LOCAL ] GGG: Primary data saved (40968 records). [2025-10-01T19:10:30.740439] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-01T19:10:30.740565] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGG took 41.1s. Estimated remaining: 3h 23m 13s. Rate: 7.1 symbols/min [2025-10-01T19:10:30.944818] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:10:30.955177] [DEBUG] [LOCAL ] GHI: Loaded 7001 existing records from primary storage. [2025-10-01T19:10:30.955414] [INFO ] [MAIN ] GHI: Loaded 7001 existing records. [2025-10-01T19:10:31.066284] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-01T19:10:31.167016] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:10:31.167259] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-01T19:10:31.167310] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-01T19:10:31.167523] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-01T19:10:31.167583] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-01T19:10:31.286232] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T19:10:31.305158] [INFO ] [REMOTE ] GGB: Full fetch complete (74063 records). [2025-10-01T19:10:31.310520] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-01T19:10:31.304893] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-01T19:10:31.898420] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:10:31.963972] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T19:10:32.069341] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-01T19:10:32.069462] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-01T19:10:32.070517] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-01T19:10:32.070585] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-01T19:10:32.073273] [DEBUG] [LOCAL ] GGB: Trimmed 74063 records to 51093 (keeping 200 days of data) [2025-10-01T19:10:32.126308] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-01T19:10:32.395695] [DEBUG] [LOCAL ] GGB: Primary data saved (51093 records). [2025-10-01T19:10:32.395866] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-01T19:10:32.395992] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGB took 55.9s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-01T19:10:32.507836] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-01T19:10:32.609760] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:10:32.618359] [DEBUG] [LOCAL ] GHLD: Loaded 4166 existing records from primary storage. [2025-10-01T19:10:32.618596] [INFO ] [MAIN ] GHLD: Loaded 4166 existing records. [2025-10-01T19:10:32.836023] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:10:32.836308] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-01T19:10:32.836373] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-01T19:10:32.836592] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-01T19:10:32.836689] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-01T19:10:32.907597] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-01T19:10:33.279862] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:10:33.542539] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T19:10:33.702383] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-01T19:10:34.211493] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T19:10:34.502425] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-01T19:10:35.172448] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T19:10:35.302423] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-01T19:10:35.911264] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T19:10:36.102383] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-01T19:10:36.793156] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T19:10:36.793908] [INFO ] [REMOTE ] GHC: Full fetch complete (3313 records). [2025-10-01T19:10:36.793979] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-01T19:10:36.907685] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-01T19:10:37.238616] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-01T19:10:37.238728] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-01T19:10:37.238856] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-01T19:10:37.238897] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-01T19:10:37.239267] [DEBUG] [LOCAL ] GHC: Trimmed 3313 records to 2669 (keeping 200 days of data) [2025-10-01T19:10:37.258108] [DEBUG] [LOCAL ] GHC: Primary data saved (2669 records). [2025-10-01T19:10:37.258272] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-01T19:10:37.258405] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 20.1s. Estimated remaining: 3h 22m 40s. Rate: 7.1 symbols/min [2025-10-01T19:10:37.372389] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-01T19:10:37.482932] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:10:37.500028] [DEBUG] [LOCAL ] GHM: Loaded 14041 existing records from primary storage. [2025-10-01T19:10:37.500322] [INFO ] [MAIN ] GHM: Loaded 14041 existing records. [2025-10-01T19:10:37.708047] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-01T19:10:37.713325] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:10:37.713662] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-01T19:10:37.714430] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-01T19:10:37.715203] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-01T19:10:37.715282] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-01T19:10:38.127095] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:10:38.502537] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-01T19:10:38.773528] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T19:10:39.302458] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-01T19:10:39.482275] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T19:10:39.999377] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T19:10:40.102414] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-01T19:10:40.732209] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T19:10:40.902381] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-01T19:10:41.251056] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-01T19:10:41.702372] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-01T19:10:42.065746] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-01T19:10:42.502378] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-01T19:10:43.302378] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-01T19:10:43.313235] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:10:43.924508] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-01T19:10:44.102399] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-01T19:10:44.902410] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-01T19:10:45.235003] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T19:10:45.344903] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-01T19:10:45.702387] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-01T19:10:46.502402] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-01T19:10:46.692590] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T19:10:47.072226] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T19:10:47.302393] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-01T19:10:47.947530] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T19:10:48.102386] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-01T19:10:48.801607] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T19:10:48.902395] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-01T19:10:49.702374] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-01T19:10:49.763311] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T19:10:50.276110] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T19:10:50.502395] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-01T19:10:51.302387] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-01T19:10:51.443839] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T19:10:51.684927] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-01T19:10:52.102406] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-01T19:10:52.820226] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T19:10:52.902386] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-01T19:10:53.702379] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-01T19:10:53.729794] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T19:10:54.375899] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T19:10:54.502435] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-01T19:10:54.970383] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T19:10:55.302398] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-01T19:10:55.963063] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T19:10:56.102400] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-01T19:10:56.550639] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T19:10:56.902378] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-01T19:10:57.658523] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T19:10:57.702412] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-01T19:10:58.312691] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T19:10:58.502385] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-01T19:10:59.290669] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T19:10:59.302370] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-01T19:11:00.099487] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-01T19:11:00.100368] [INFO ] [REMOTE ] GHI: Full fetch complete (11706 records). [2025-10-01T19:11:00.100493] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-01T19:11:00.112463] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-01T19:11:00.532242] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-01T19:11:00.532349] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-01T19:11:00.532696] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-01T19:11:00.532765] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-01T19:11:00.533225] [DEBUG] [LOCAL ] GHI: Trimmed 11706 records to 7020 (keeping 200 days of data) [2025-10-01T19:11:00.580382] [DEBUG] [LOCAL ] GHI: Primary data saved (7020 records). [2025-10-01T19:11:00.580521] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-01T19:11:00.580715] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 29.8s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-01T19:11:00.787535] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:11:00.812857] [DEBUG] [LOCAL ] GHY: Loaded 20887 existing records from primary storage. [2025-10-01T19:11:00.813195] [INFO ] [MAIN ] GHY: Loaded 20887 existing records. [2025-10-01T19:11:00.907685] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-01T19:11:00.952953] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T19:11:01.036864] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:11:01.037103] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-01T19:11:01.037153] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-01T19:11:01.037564] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-01T19:11:01.037638] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-01T19:11:01.473059] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:11:01.702385] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-01T19:11:02.011083] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T19:11:02.468987] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T19:11:02.502397] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-01T19:11:03.302421] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-01T19:11:03.496132] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T19:11:03.668479] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-01T19:11:04.102382] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-01T19:11:04.759739] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T19:11:04.760559] [INFO ] [REMOTE ] GHLD: Full fetch complete (4776 records). [2025-10-01T19:11:04.760728] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-01T19:11:04.907503] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-01T19:11:05.167153] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-01T19:11:05.167238] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-01T19:11:05.167436] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-01T19:11:05.167491] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-01T19:11:05.168073] [DEBUG] [LOCAL ] GHLD: Trimmed 4776 records to 4179 (keeping 200 days of data) [2025-10-01T19:11:05.197921] [DEBUG] [LOCAL ] GHLD: Primary data saved (4179 records). [2025-10-01T19:11:05.198153] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-01T19:11:05.198284] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHLD took 32.8s. Estimated remaining: 3h 22m 40s. Rate: 7.1 symbols/min [2025-10-01T19:11:05.387481] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:11:05.432498] [DEBUG] [LOCAL ] GIB: Loaded 32041 existing records from primary storage. [2025-10-01T19:11:05.432846] [INFO ] [MAIN ] GIB: Loaded 32041 existing records. [2025-10-01T19:11:05.627093] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:11:05.627330] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-01T19:11:05.627380] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-01T19:11:05.628499] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-01T19:11:05.628562] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-01T19:11:05.710974] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-01T19:11:06.031033] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:11:06.116036] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T19:11:06.204704] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-01T19:11:06.502377] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-01T19:11:07.302379] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-01T19:11:07.671348] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T19:11:07.791969] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T19:11:08.102386] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-01T19:11:08.902374] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-01T19:11:09.507281] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T19:11:09.702379] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-01T19:11:09.981515] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T19:11:10.399706] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T19:11:10.502403] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-01T19:11:11.302376] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-01T19:11:11.635254] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T19:11:12.102428] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-01T19:11:12.414826] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T19:11:12.416080] [INFO ] [REMOTE ] GHM: Full fetch complete (21761 records). [2025-10-01T19:11:12.416155] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-01T19:11:12.828449] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-01T19:11:12.828543] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-01T19:11:12.829256] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-01T19:11:12.829327] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-01T19:11:12.830972] [DEBUG] [LOCAL ] GHM: Trimmed 21761 records to 14066 (keeping 200 days of data) [2025-10-01T19:11:12.902509] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-01T19:11:12.931625] [DEBUG] [LOCAL ] GHM: Primary data saved (14066 records). [2025-10-01T19:11:12.931817] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-01T19:11:12.931952] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHM took 35.7s. Estimated remaining: 3h 22m 30s. Rate: 7.1 symbols/min [2025-10-01T19:11:13.131534] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:11:13.131757] [DEBUG] [LOCAL ] GIC: No existing data file found in primary storage. [2025-10-01T19:11:13.131814] [WARN ] [MAIN ] GIC: No existing data found, performing full refresh instead. [2025-10-01T19:11:13.131930] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-01T19:11:13.131974] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-01T19:11:13.132019] [DEBUG] [LOCAL ] GIC: No primary data file found to delete. [2025-10-01T19:11:13.132053] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-01T19:11:13.475064] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T19:11:13.565887] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:11:13.702414] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-01T19:11:14.013788] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T19:11:14.502381] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-01T19:11:14.818026] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T19:11:15.302387] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-01T19:11:15.708445] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T19:11:16.102352] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-01T19:11:16.339847] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T19:11:16.857465] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-01T19:11:16.902365] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-01T19:11:17.702416] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-01T19:11:17.926603] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T19:11:18.023743] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T19:11:18.502392] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-01T19:11:19.302397] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-01T19:11:20.102429] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-01T19:11:20.284714] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:11:20.379303] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T19:11:20.902402] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-01T19:11:20.945027] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T19:11:21.702442] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-01T19:11:22.245289] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T19:11:22.410030] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T19:11:22.502476] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-01T19:11:23.302436] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-01T19:11:23.564255] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T19:11:24.102401] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-01T19:11:24.160393] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T19:11:24.572148] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-01T19:11:24.902434] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-01T19:11:25.625486] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T19:11:25.626323] [INFO ] [REMOTE ] GHG: Full fetch complete (4030 records). [2025-10-01T19:11:25.626398] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-01T19:11:25.707601] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-01T19:11:26.027461] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-01T19:11:26.027542] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-01T19:11:26.027745] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-01T19:11:26.027838] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-01T19:11:26.028254] [DEBUG] [LOCAL ] GHG: Trimmed 4030 records to 3185 (keeping 200 days of data) [2025-10-01T19:11:26.048409] [DEBUG] [LOCAL ] GHG: Primary data saved (3185 records). [2025-10-01T19:11:26.048540] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-01T19:11:26.048674] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHG took 59.2s. Estimated remaining: 3h 22m 29s. Rate: 7.1 symbols/min [2025-10-01T19:11:26.232871] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:11:26.282247] [DEBUG] [LOCAL ] GIL: Loaded 43330 existing records from primary storage. [2025-10-01T19:11:26.282597] [INFO ] [MAIN ] GIL: Loaded 43330 existing records. [2025-10-01T19:11:26.486549] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:11:26.486884] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-01T19:11:26.486944] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-01T19:11:26.488689] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-01T19:11:26.488758] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-01T19:11:26.510803] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-01T19:11:26.895426] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:11:27.302430] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-01T19:11:28.102418] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-01T19:11:28.288345] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T19:11:28.450950] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-01T19:11:28.902392] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-01T19:11:29.366367] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T19:11:29.539519] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T19:11:29.556544] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-01T19:11:29.702422] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-01T19:11:30.502459] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-01T19:11:31.036807] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-01T19:11:31.041836] [INFO ] [REMOTE ] GHY: Full fetch complete (32212 records). [2025-10-01T19:11:31.042017] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-01T19:11:31.307774] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-01T19:11:31.583913] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-01T19:11:31.584077] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-01T19:11:31.584895] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-01T19:11:31.585037] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-01T19:11:31.586301] [DEBUG] [LOCAL ] GHY: Trimmed 32212 records to 20837 (keeping 200 days of data) [2025-10-01T19:11:31.718895] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T19:11:31.769904] [DEBUG] [LOCAL ] GHY: Primary data saved (20837 records). [2025-10-01T19:11:31.770038] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-01T19:11:31.770121] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHY took 31.2s. Estimated remaining: 3h 22m 17s. Rate: 7.1 symbols/min [2025-10-01T19:11:31.965347] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:11:32.021736] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-01T19:11:32.022204] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-01T19:11:32.107967] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-01T19:11:32.223319] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:11:32.223560] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-01T19:11:32.223610] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-01T19:11:32.225895] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-01T19:11:32.225964] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-01T19:11:32.635221] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:11:32.902808] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-01T19:11:32.905887] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T19:11:33.523152] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T19:11:33.702413] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-01T19:11:33.779700] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T19:11:34.502415] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-01T19:11:35.227013] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T19:11:35.302400] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-01T19:11:35.591896] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T19:11:36.102404] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-01T19:11:36.902389] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-01T19:11:37.502333] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-01T19:11:37.702433] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-01T19:11:38.350325] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T19:11:38.351771] [INFO ] [REMOTE ] GIB: Full fetch complete (45724 records). [2025-10-01T19:11:38.351870] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-01T19:11:38.507494] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-01T19:11:38.802501] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-01T19:11:38.802605] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-01T19:11:38.803373] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-01T19:11:38.803439] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-01T19:11:38.804626] [DEBUG] [LOCAL ] GIB: Trimmed 45724 records to 32101 (keeping 200 days of data) [2025-10-01T19:11:39.025422] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T19:11:39.052522] [DEBUG] [LOCAL ] GIB: Primary data saved (32101 records). [2025-10-01T19:11:39.052745] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-01T19:11:39.052883] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIB took 33.9s. Estimated remaining: 3h 22m 6s. Rate: 7.1 symbols/min [2025-10-01T19:11:39.244334] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:11:39.287036] [DEBUG] [LOCAL ] GKOS: Loaded 42680 existing records from primary storage. [2025-10-01T19:11:39.287381] [INFO ] [MAIN ] GKOS: Loaded 42680 existing records. [2025-10-01T19:11:39.322239] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-01T19:11:39.491985] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:11:39.492231] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-01T19:11:39.492284] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-01T19:11:39.493733] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-01T19:11:39.493795] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-01T19:11:39.905022] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:11:39.952933] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (3.05 seconds). [2025-10-01T19:11:40.104600] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-01T19:11:40.108907] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T19:11:40.198164] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T19:11:40.902393] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-01T19:11:41.344572] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T19:11:41.702398] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-01T19:11:41.966832] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T19:11:41.968132] [INFO ] [REMOTE ] GIC: Full fetch complete (20225 records). [2025-10-01T19:11:41.968246] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-01T19:11:42.399108] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-01T19:11:42.399195] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-01T19:11:42.399686] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-01T19:11:42.399750] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-01T19:11:42.400337] [DEBUG] [LOCAL ] GIC: Trimmed 20225 records to 13517 (keeping 200 days of data) [2025-10-01T19:11:42.487889] [DEBUG] [LOCAL ] GIC: Primary data saved (13517 records). [2025-10-01T19:11:42.488046] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-01T19:11:42.488127] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIC took 29.6s. Estimated remaining: 3h 21m 50s. Rate: 7.1 symbols/min [2025-10-01T19:11:42.510239] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-01T19:11:42.675710] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:11:42.722008] [DEBUG] [LOCAL ] GL: Loaded 37779 existing records from primary storage. [2025-10-01T19:11:42.722298] [INFO ] [MAIN ] GL: Loaded 37779 existing records. [2025-10-01T19:11:42.913608] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:11:42.913837] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-01T19:11:42.913886] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-01T19:11:42.915098] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-01T19:11:42.915160] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-01T19:11:43.315346] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:11:43.309341] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-01T19:11:43.347357] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T19:11:44.111717] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-01T19:11:44.132472] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T19:11:44.315683] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T19:11:44.902402] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-01T19:11:45.637811] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T19:11:45.702398] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-01T19:11:46.198763] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T19:11:46.502399] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-01T19:11:47.083023] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T19:11:47.302395] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-01T19:11:48.102439] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-01T19:11:48.765017] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-01T19:11:48.892358] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T19:11:48.903169] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-01T19:11:49.523061] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:11:49.702392] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-01T19:11:50.378105] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T19:11:50.502375] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-01T19:11:51.302374] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-01T19:11:51.361054] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T19:11:51.547131] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T19:11:52.102386] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-01T19:11:52.904017] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-01T19:11:52.910747] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T19:11:53.347915] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T19:11:53.702378] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-01T19:11:54.459953] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T19:11:54.502391] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-01T19:11:55.239930] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:11:55.302366] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-01T19:11:56.102389] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-01T19:11:56.443729] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T19:11:56.560608] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T19:11:56.902415] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-01T19:11:57.401726] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T19:11:57.702426] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-01T19:11:58.219534] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T19:11:58.502420] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-01T19:11:59.203602] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:11:59.302387] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-01T19:12:00.062361] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T19:12:00.102413] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-01T19:12:00.407106] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T19:12:00.902390] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-01T19:12:01.702415] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-01T19:12:01.750513] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T19:12:02.024961] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T19:12:02.502381] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-01T19:12:03.302366] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-01T19:12:03.790154] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-01T19:12:03.834789] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T19:12:04.102380] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-01T19:12:04.911092] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-01T19:12:04.916994] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T19:12:05.603639] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T19:12:05.702333] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-01T19:12:06.485085] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T19:12:06.502377] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-01T19:12:07.091359] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T19:12:07.302383] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-01T19:12:08.102372] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-01T19:12:08.446993] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T19:12:08.448413] [INFO ] [REMOTE ] GKOS: Full fetch complete (59950 records). [2025-10-01T19:12:08.448513] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-01T19:12:08.895166] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-01T19:12:08.895260] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-01T19:12:08.896168] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-01T19:12:08.896235] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-01T19:12:08.897758] [DEBUG] [LOCAL ] GKOS: Trimmed 59950 records to 42661 (keeping 200 days of data) [2025-10-01T19:12:08.948912] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-01T19:12:09.119675] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-01T19:12:09.123295] [INFO ] [REMOTE ] GL: Full fetch complete (55410 records). [2025-10-01T19:12:09.123957] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-01T19:12:09.633170] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-01T19:12:09.633932] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-01T19:12:09.635684] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-01T19:12:09.636665] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-01T19:12:09.656462] [DEBUG] [LOCAL ] GL: Trimmed 55410 records to 37783 (keeping 200 days of data) [2025-10-01T19:12:09.660358] [DEBUG] [LOCAL ] GKOS: Primary data saved (42661 records). [2025-10-01T19:12:09.660512] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-01T19:12:09.660636] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GKOS took 30.6s. Estimated remaining: 3h 22m 10s. Rate: 7.1 symbols/min [2025-10-01T19:12:09.981940] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:10.101283] [DEBUG] [LOCAL ] GLOB: Loaded 47516 existing records from primary storage. [2025-10-01T19:12:10.129413] [INFO ] [MAIN ] GLOB: Loaded 47516 existing records. [2025-10-01T19:12:10.392684] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-01T19:12:10.390588] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:10.410975] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-01T19:12:10.411498] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-01T19:12:10.413095] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-01T19:12:10.414185] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-01T19:12:10.415713] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-01T19:12:10.685629] [DEBUG] [LOCAL ] GL: Primary data saved (37783 records). [2025-10-01T19:12:10.693213] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T19:12:10.699544] [INFO ] [MAIN ] GL: Full history saved. [2025-10-01T19:12:10.738683] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GL took 28.3s. Estimated remaining: 3h 21m 51s. Rate: 7.1 symbols/min [2025-10-01T19:12:10.788562] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-01T19:12:11.004410] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:11.079232] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:11.089301] [DEBUG] [LOCAL ] GLP: Loaded 9370 existing records from primary storage. [2025-10-01T19:12:11.089542] [INFO ] [MAIN ] GLP: Loaded 9370 existing records. [2025-10-01T19:12:11.274986] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:11.275187] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-01T19:12:11.275235] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-01T19:12:11.275635] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-01T19:12:11.275725] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-01T19:12:11.309351] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-01T19:12:11.675097] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:12.102440] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-01T19:12:12.816750] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T19:12:12.904058] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-01T19:12:12.907864] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T19:12:12.984296] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-01T19:12:12.985769] [INFO ] [REMOTE ] GIL: Full fetch complete (61492 records). [2025-10-01T19:12:12.985862] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-01T19:12:13.086419] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (2.67 seconds). [2025-10-01T19:12:13.108059] [INFO ] [REMOTE ] GIS: Full fetch complete (77651 records). [2025-10-01T19:12:13.118889] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-01T19:12:13.723824] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-01T19:12:13.846609] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-01T19:12:13.857811] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-01T19:12:13.869399] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-01T19:12:13.884943] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-01T19:12:13.910795] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-01T19:12:13.910984] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-01T19:12:13.911743] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-01T19:12:13.911829] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-01T19:12:13.912609] [DEBUG] [LOCAL ] GIL: Trimmed 61492 records to 43388 (keeping 200 days of data) [2025-10-01T19:12:13.914099] [DEBUG] [LOCAL ] GIS: Trimmed 77651 records to 53672 (keeping 200 days of data) [2025-10-01T19:12:14.444524] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T19:12:14.508028] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-01T19:12:14.587011] [DEBUG] [LOCAL ] GIL: Primary data saved (43388 records). [2025-10-01T19:12:14.588739] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-01T19:12:14.588893] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIL took 48.5s. Estimated remaining: 3h 21m 35s. Rate: 7.1 symbols/min [2025-10-01T19:12:14.713550] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-10-01T19:12:14.735794] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-01T19:12:14.751500] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GIS took 43.0s. Estimated remaining: 3h 21m 14s. Rate: 7.1 symbols/min [2025-10-01T19:12:14.752047] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T19:12:14.937836] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:15.018900] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:15.078298] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-01T19:12:15.078773] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-01T19:12:15.229701] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-10-01T19:12:15.257076] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-10-01T19:12:15.313854] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-01T19:12:15.403920] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:15.427538] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-01T19:12:15.433442] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-01T19:12:15.455696] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-01T19:12:15.476737] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-01T19:12:15.580939] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:15.628417] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-01T19:12:15.631535] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-01T19:12:15.654922] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-01T19:12:15.680175] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-01T19:12:16.249076] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:16.277957] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-01T19:12:16.383829] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:16.385362] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T19:12:16.411627] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T19:12:16.902381] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-01T19:12:17.702397] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-01T19:12:17.765992] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T19:12:18.167318] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T19:12:18.502393] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-01T19:12:19.065378] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T19:12:19.302386] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-01T19:12:20.102365] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-01T19:12:20.447038] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T19:12:20.902424] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-01T19:12:20.903290] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T19:12:21.083915] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T19:12:21.702385] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-01T19:12:22.502388] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-01T19:12:22.572011] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T19:12:23.302443] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-01T19:12:23.475167] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T19:12:23.897358] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-01T19:12:24.102391] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-01T19:12:24.718147] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T19:12:24.867603] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T19:12:24.902376] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-01T19:12:25.702462] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-01T19:12:26.244605] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T19:12:26.437113] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T19:12:26.502401] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-01T19:12:27.107485] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T19:12:27.302428] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-01T19:12:28.102739] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-01T19:12:28.902387] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-01T19:12:28.978747] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T19:12:29.326437] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-01T19:12:29.702412] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-01T19:12:30.370683] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T19:12:30.502379] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-01T19:12:31.302385] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-01T19:12:31.685458] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T19:12:32.102555] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-01T19:12:32.309095] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T19:12:32.902426] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-01T19:12:33.530745] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-01T19:12:33.702426] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-01T19:12:34.018777] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T19:12:34.019619] [INFO ] [REMOTE ] GLP: Full fetch complete (14329 records). [2025-10-01T19:12:34.019720] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-01T19:12:34.402935] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-01T19:12:34.498558] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-01T19:12:34.498686] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-01T19:12:34.499180] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-01T19:12:34.499287] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-01T19:12:34.500056] [DEBUG] [LOCAL ] GLP: Trimmed 14329 records to 9351 (keeping 200 days of data) [2025-10-01T19:12:34.502415] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-01T19:12:34.568258] [DEBUG] [LOCAL ] GLP: Primary data saved (9351 records). [2025-10-01T19:12:34.568416] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-01T19:12:34.568555] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 23.8s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-01T19:12:34.757199] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:34.811721] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-10-01T19:12:34.812144] [INFO ] [MAIN ] GME: Loaded 53762 existing records. [2025-10-01T19:12:35.016754] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:35.017026] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-01T19:12:35.017088] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-01T19:12:35.018775] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-01T19:12:35.018863] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-01T19:12:35.303438] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-01T19:12:35.435190] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:35.467196] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T19:12:36.102423] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-01T19:12:36.800600] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-01T19:12:36.902395] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-01T19:12:37.387617] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-01T19:12:37.702397] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-01T19:12:38.502349] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-01T19:12:38.753360] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-01T19:12:39.302368] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-01T19:12:39.325845] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-01T19:12:39.327298] [INFO ] [REMOTE ] GLOB: Full fetch complete (64057 records). [2025-10-01T19:12:39.327419] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-01T19:12:39.792839] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-01T19:12:39.793170] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-01T19:12:39.794534] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-01T19:12:39.796159] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-01T19:12:39.806691] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-01T19:12:39.808623] [DEBUG] [LOCAL ] GLOB: Trimmed 64057 records to 47585 (keeping 200 days of data) [2025-10-01T19:12:40.102370] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-01T19:12:40.110944] [DEBUG] [LOCAL ] GLOB: Primary data saved (47585 records). [2025-10-01T19:12:40.111055] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-01T19:12:40.111135] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLOB took 30.5s. Estimated remaining: 3h 21m 10s. Rate: 7.1 symbols/min [2025-10-01T19:12:40.293815] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:40.338950] [DEBUG] [LOCAL ] GMED: Loaded 48335 existing records from primary storage. [2025-10-01T19:12:40.339262] [INFO ] [MAIN ] GMED: Loaded 48335 existing records. [2025-10-01T19:12:40.541873] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:40.542210] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-01T19:12:40.542337] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-01T19:12:40.543519] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-01T19:12:40.543581] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-01T19:12:40.905127] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-01T19:12:40.964171] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-01T19:12:40.998953] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:41.702393] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-01T19:12:41.804054] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-01T19:12:41.897285] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T19:12:42.502383] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-01T19:12:43.038529] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-01T19:12:43.272280] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T19:12:43.302360] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-01T19:12:44.102390] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-01T19:12:44.902618] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-01T19:12:44.905357] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-01T19:12:44.975594] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T19:12:45.702457] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-01T19:12:46.038778] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T19:12:46.502396] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-01T19:12:47.168310] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-01T19:12:47.302387] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-01T19:12:48.102354] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-01T19:12:48.255625] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-01T19:12:48.552540] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-01T19:12:48.902353] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-01T19:12:49.073486] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T19:12:49.702358] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-01T19:12:50.219703] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-01T19:12:50.502383] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-01T19:12:51.302397] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-01T19:12:51.550796] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T19:12:51.634171] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-01T19:12:52.102420] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-01T19:12:52.497336] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-01T19:12:52.902368] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-01T19:12:53.202964] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T19:12:53.457932] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T19:12:53.702404] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-01T19:12:54.502382] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-01T19:12:55.302394] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-01T19:12:55.710683] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-01T19:12:55.712365] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-01T19:12:55.712505] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-01T19:12:56.153234] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-01T19:12:56.153351] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-01T19:12:56.154632] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-01T19:12:56.154778] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-01T19:12:56.156512] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53728 (keeping 200 days of data) [2025-10-01T19:12:56.435417] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T19:12:56.450095] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-01T19:12:56.568439] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-10-01T19:12:56.568662] [INFO ] [MAIN ] GM: Full history saved. [2025-10-01T19:12:56.570002] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GM took 41.8s. Estimated remaining: 3h 21m 14s. Rate: 7.1 symbols/min [2025-10-01T19:12:56.693578] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-01T19:12:56.718722] [INFO ] [REMOTE ] GLW: Full fetch complete (77618 records). [2025-10-01T19:12:56.729227] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-01T19:12:56.885217] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:57.206222] [DEBUG] [LOCAL ] GMRE: Loaded 37497 existing records from primary storage. [2025-10-01T19:12:57.233220] [INFO ] [MAIN ] GMRE: Loaded 37497 existing records. [2025-10-01T19:12:57.263157] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-01T19:12:57.294007] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-01T19:12:57.320364] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-01T19:12:57.320482] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-01T19:12:57.378541] [DEBUG] [LOCAL ] GLW: Trimmed 77618 records to 53636 (keeping 200 days of data) [2025-10-01T19:12:57.564620] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:57.565868] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-01T19:12:57.566491] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-01T19:12:57.568700] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-01T19:12:57.569064] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-01T19:12:58.031824] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:58.032915] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-01T19:12:58.048046] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-01T19:12:58.189132] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-01T19:12:58.197512] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T19:12:58.336929] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-01T19:12:58.337081] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-01T19:12:58.337181] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GLW took 43.7s. Estimated remaining: 3h 20m 55s. Rate: 7.1 symbols/min [2025-10-01T19:12:58.505480] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-01T19:12:58.527637] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:12:58.551792] [DEBUG] [LOCAL ] GNE: Loaded 17787 existing records from primary storage. [2025-10-01T19:12:58.552085] [INFO ] [MAIN ] GNE: Loaded 17787 existing records. [2025-10-01T19:12:58.752701] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:12:58.752954] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-01T19:12:58.753065] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-01T19:12:58.753966] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-01T19:12:58.754031] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-01T19:12:59.156600] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:12:59.264404] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T19:12:59.302336] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-01T19:13:00.102396] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-01T19:13:00.212194] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T19:13:00.706484] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-01T19:13:00.707608] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T19:13:00.902389] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-01T19:13:00.938479] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T19:13:01.702403] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-01T19:13:02.502387] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-01T19:13:02.638214] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T19:13:02.990852] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T19:13:03.030571] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T19:13:03.302377] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-01T19:13:04.102381] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-01T19:13:04.888043] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T19:13:04.902335] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-01T19:13:05.526638] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T19:13:05.702376] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-01T19:13:06.502378] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-01T19:13:07.032614] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-01T19:13:07.034619] [INFO ] [REMOTE ] GMED: Full fetch complete (69621 records). [2025-10-01T19:13:07.034772] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-01T19:13:07.307555] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-01T19:13:07.546455] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-01T19:13:07.546556] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-01T19:13:07.547557] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-01T19:13:07.547626] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-01T19:13:07.549342] [DEBUG] [LOCAL ] GMED: Trimmed 69621 records to 48332 (keeping 200 days of data) [2025-10-01T19:13:07.859085] [DEBUG] [LOCAL ] GMED: Primary data saved (48332 records). [2025-10-01T19:13:07.859219] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-01T19:13:07.859301] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 27.7s. Estimated remaining: 3h 20m 48s. Rate: 7.1 symbols/min [2025-10-01T19:13:08.059966] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T19:13:08.064367] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:13:08.093380] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T19:13:08.102361] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-01T19:13:08.147240] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-01T19:13:08.186600] [DEBUG] [LOCAL ] GNK: Loaded 40237 existing records from primary storage. [2025-10-01T19:13:08.186943] [INFO ] [MAIN ] GNK: Loaded 40237 existing records. [2025-10-01T19:13:08.385297] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:13:08.385537] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-01T19:13:08.385588] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-01T19:13:08.386565] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-01T19:13:08.386627] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-01T19:13:08.776983] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:13:08.902352] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-01T19:13:08.943394] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T19:13:09.702409] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-01T19:13:10.502396] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-01T19:13:10.877139] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T19:13:11.302394] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-01T19:13:11.651392] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-01T19:13:11.961890] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T19:13:12.102379] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-01T19:13:12.844826] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T19:13:12.902402] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-01T19:13:12.949452] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T19:13:13.702387] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-01T19:13:14.502388] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-01T19:13:15.113729] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T19:13:15.302356] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-01T19:13:15.554119] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-01T19:13:16.068021] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T19:13:16.102348] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-01T19:13:16.369513] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T19:13:16.902422] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-01T19:13:17.366339] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T19:13:17.702359] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-01T19:13:17.893980] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T19:13:18.502421] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-01T19:13:19.117966] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T19:13:19.302378] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-01T19:13:20.102422] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-01T19:13:20.902422] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-01T19:13:21.031518] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-01T19:13:21.032969] [INFO ] [REMOTE ] GMRE: Full fetch complete (53386 records). [2025-10-01T19:13:21.033076] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-01T19:13:21.336803] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T19:13:21.490420] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-01T19:13:21.490503] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-01T19:13:21.491288] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-01T19:13:21.491355] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-01T19:13:21.492540] [DEBUG] [LOCAL ] GMRE: Trimmed 53386 records to 37396 (keeping 200 days of data) [2025-10-01T19:13:21.706879] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-01T19:13:21.740514] [DEBUG] [LOCAL ] GMRE: Primary data saved (37396 records). [2025-10-01T19:13:21.740678] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-01T19:13:21.740784] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMRE took 25.2s. Estimated remaining: 3h 20m 48s. Rate: 7.1 symbols/min [2025-10-01T19:13:21.923802] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:13:21.973288] [DEBUG] [LOCAL ] GNL: Loaded 46875 existing records from primary storage. [2025-10-01T19:13:21.973598] [INFO ] [MAIN ] GNL: Loaded 46875 existing records. [2025-10-01T19:13:22.168295] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:13:22.168742] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-01T19:13:22.168944] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-01T19:13:22.170148] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-01T19:13:22.170213] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-01T19:13:22.401595] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (3.90 seconds). [2025-10-01T19:13:22.427844] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-01T19:13:22.443129] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-01T19:13:22.702046] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:13:22.738873] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-01T19:13:22.807197] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T19:13:23.001127] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T19:13:23.109223] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-01T19:13:23.109311] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-01T19:13:23.110381] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-01T19:13:23.110453] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-01T19:13:23.112098] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53762 (keeping 200 days of data) [2025-10-01T19:13:23.324389] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-01T19:13:23.453863] [DEBUG] [LOCAL ] GME: Primary data saved (53762 records). [2025-10-01T19:13:23.454016] [INFO ] [MAIN ] GME: Full history saved. [2025-10-01T19:13:23.454102] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GME took 48.9s. Estimated remaining: 3h 20m 30s. Rate: 7.1 symbols/min [2025-10-01T19:13:23.642473] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:13:23.686513] [DEBUG] [LOCAL ] GNRC: Loaded 45193 existing records from primary storage. [2025-10-01T19:13:23.686868] [INFO ] [MAIN ] GNRC: Loaded 45193 existing records. [2025-10-01T19:13:23.886298] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:13:23.886511] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-01T19:13:23.886615] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-01T19:13:23.886894] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-01T19:13:23.886958] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-01T19:13:24.118934] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-01T19:13:24.340281] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:13:24.459045] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T19:13:24.527623] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T19:13:24.902372] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-01T19:13:25.702368] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-01T19:13:25.859110] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T19:13:25.879933] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T19:13:26.502389] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-01T19:13:27.302421] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-01T19:13:27.380874] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T19:13:27.682664] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T19:13:27.683549] [INFO ] [REMOTE ] GNE: Full fetch complete (22446 records). [2025-10-01T19:13:27.683687] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-01T19:13:28.093395] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-01T19:13:28.093509] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-01T19:13:28.094077] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-01T19:13:28.094143] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-01T19:13:28.095765] [DEBUG] [LOCAL ] GNE: Trimmed 22446 records to 17835 (keeping 200 days of data) [2025-10-01T19:13:28.144448] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-01T19:13:28.211086] [DEBUG] [LOCAL ] GNE: Primary data saved (17835 records). [2025-10-01T19:13:28.211221] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-01T19:13:28.211320] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 29.9s. Estimated remaining: 3h 20m 16s. Rate: 7.1 symbols/min [2025-10-01T19:13:28.397534] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:13:28.408225] [DEBUG] [LOCAL ] GNT: Loaded 8082 existing records from primary storage. [2025-10-01T19:13:28.408454] [INFO ] [MAIN ] GNT: Loaded 8082 existing records. [2025-10-01T19:13:28.619584] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:13:28.619831] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-01T19:13:28.619905] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-01T19:13:28.620556] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-01T19:13:28.620637] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-01T19:13:28.904711] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-01T19:13:29.032666] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:13:29.055868] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T19:13:29.703992] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-01T19:13:29.709228] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T19:13:30.502404] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-01T19:13:30.550707] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T19:13:30.579615] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T19:13:31.302410] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-01T19:13:31.919067] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:13:32.102440] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-01T19:13:32.902364] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-01T19:13:33.009673] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T19:13:33.707527] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-01T19:13:33.724612] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T19:13:34.330099] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T19:13:34.502377] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-01T19:13:35.302368] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-01T19:13:35.353515] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T19:13:36.102355] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-01T19:13:36.179285] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T19:13:36.750714] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T19:13:36.902369] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-01T19:13:37.341479] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-01T19:13:37.698071] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T19:13:37.707625] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-01T19:13:38.502377] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-01T19:13:39.034277] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T19:13:39.302443] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-01T19:13:39.820807] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T19:13:40.102368] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-01T19:13:40.902445] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-01T19:13:41.041434] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-01T19:13:41.042929] [INFO ] [REMOTE ] GNK: Full fetch complete (57105 records). [2025-10-01T19:13:41.043030] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-01T19:13:41.472099] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-01T19:13:41.472287] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-01T19:13:41.473694] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-01T19:13:41.473795] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-01T19:13:41.475915] [DEBUG] [LOCAL ] GNK: Trimmed 57105 records to 40264 (keeping 200 days of data) [2025-10-01T19:13:41.510537] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T19:13:41.634212] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-01T19:13:41.719997] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-01T19:13:41.798815] [DEBUG] [LOCAL ] GNK: Primary data saved (40264 records). [2025-10-01T19:13:41.798963] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-01T19:13:41.799049] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNK took 33.9s. Estimated remaining: 3h 20m 15s. Rate: 7.1 symbols/min [2025-10-01T19:13:42.002576] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:13:42.052797] [DEBUG] [LOCAL ] GNW: Loaded 51327 existing records from primary storage. [2025-10-01T19:13:42.053130] [INFO ] [MAIN ] GNW: Loaded 51327 existing records. [2025-10-01T19:13:42.245300] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:13:42.245530] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-01T19:13:42.245586] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-01T19:13:42.246516] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-01T19:13:42.246578] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-01T19:13:42.513313] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-01T19:13:42.639677] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:13:43.147932] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T19:13:43.179030] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T19:13:43.302378] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-01T19:13:44.102397] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-01T19:13:44.843297] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T19:13:44.902366] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-01T19:13:45.460108] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T19:13:45.702405] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-01T19:13:46.502417] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-01T19:13:46.869053] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-01T19:13:46.870818] [INFO ] [REMOTE ] GNL: Full fetch complete (68309 records). [2025-10-01T19:13:46.870952] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-01T19:13:47.307352] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-01T19:13:47.307110] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-01T19:13:47.308563] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-01T19:13:47.310109] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-01T19:13:47.310278] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-01T19:13:47.311773] [DEBUG] [LOCAL ] GNL: Trimmed 68309 records to 46827 (keeping 200 days of data) [2025-10-01T19:13:47.561715] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T19:13:47.650492] [DEBUG] [LOCAL ] GNL: Primary data saved (46827 records). [2025-10-01T19:13:47.650669] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-01T19:13:47.650773] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNL took 25.9s. Estimated remaining: 3h 20m 3s. Rate: 7.1 symbols/min [2025-10-01T19:13:47.841997] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:13:47.886835] [DEBUG] [LOCAL ] GOF: Loaded 42604 existing records from primary storage. [2025-10-01T19:13:47.887160] [INFO ] [MAIN ] GOF: Loaded 42604 existing records. [2025-10-01T19:13:48.010293] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T19:13:48.105530] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-01T19:13:48.105416] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:13:48.107423] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-01T19:13:48.107670] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-01T19:13:48.108095] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-01T19:13:48.108167] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-01T19:13:48.315154] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T19:13:48.542225] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:13:48.837277] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T19:13:48.902386] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-01T19:13:49.702381] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-01T19:13:50.050402] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T19:13:50.371791] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T19:13:50.502385] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-01T19:13:51.302409] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-01T19:13:51.894509] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T19:13:52.102366] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-01T19:13:52.167359] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T19:13:52.768898] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T19:13:52.902391] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-01T19:13:53.702431] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-01T19:13:54.252318] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T19:13:54.502385] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-01T19:13:55.302363] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-01T19:13:55.541485] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T19:13:56.028816] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T19:13:56.089291] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T19:13:56.102332] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-01T19:13:56.902413] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-01T19:13:57.702384] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-01T19:13:57.781374] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:13:57.808275] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-01T19:13:57.809095] [INFO ] [REMOTE ] GNT: Full fetch complete (10798 records). [2025-10-01T19:13:57.809166] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-01T19:13:58.220842] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-01T19:13:58.220922] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-01T19:13:58.221178] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-01T19:13:58.221228] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-01T19:13:58.221723] [DEBUG] [LOCAL ] GNT: Trimmed 10798 records to 8141 (keeping 200 days of data) [2025-10-01T19:13:58.270526] [DEBUG] [LOCAL ] GNT: Primary data saved (8141 records). [2025-10-01T19:13:58.270694] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-01T19:13:58.270812] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNT took 30.1s. Estimated remaining: 3h 19m 57s. Rate: 7.1 symbols/min [2025-10-01T19:13:58.453914] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:13:58.484544] [DEBUG] [LOCAL ] GOLF: Loaded 31236 existing records from primary storage. [2025-10-01T19:13:58.484849] [INFO ] [MAIN ] GOLF: Loaded 31236 existing records. [2025-10-01T19:13:58.507537] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-01T19:13:58.680121] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:13:58.680351] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-01T19:13:58.680401] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-01T19:13:58.680665] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-01T19:13:58.680729] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-01T19:13:59.103854] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:13:59.129411] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T19:13:59.302430] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-01T19:14:00.074422] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T19:14:00.102358] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-01T19:14:00.445345] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T19:14:00.902387] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-01T19:14:01.702378] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-01T19:14:01.779846] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T19:14:01.997591] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T19:14:02.502388] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-01T19:14:03.302361] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-01T19:14:03.340748] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T19:14:03.940898] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T19:14:04.102416] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-01T19:14:04.902411] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-01T19:14:05.028851] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T19:14:05.452405] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T19:14:05.702400] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-01T19:14:06.323911] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T19:14:06.502461] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-01T19:14:07.302365] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-01T19:14:07.406541] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T19:14:07.740070] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T19:14:08.102389] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-01T19:14:08.902419] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-01T19:14:09.396965] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T19:14:09.398449] [INFO ] [REMOTE ] GNRC: Full fetch complete (65268 records). [2025-10-01T19:14:09.398573] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-01T19:14:09.709992] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T19:14:09.707710] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-01T19:14:09.894753] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-01T19:14:09.894851] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-01T19:14:09.895769] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-01T19:14:09.895876] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-01T19:14:09.897248] [DEBUG] [LOCAL ] GNRC: Trimmed 65268 records to 45108 (keeping 200 days of data) [2025-10-01T19:14:10.191044] [DEBUG] [LOCAL ] GNRC: Primary data saved (45108 records). [2025-10-01T19:14:10.191189] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-01T19:14:10.191275] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNRC took 46.7s. Estimated remaining: 3h 19m 54s. Rate: 7.1 symbols/min [2025-10-01T19:14:10.378872] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:14:10.421270] [DEBUG] [LOCAL ] GOOS: Loaded 45062 existing records from primary storage. [2025-10-01T19:14:10.421580] [INFO ] [MAIN ] GOOS: Loaded 45062 existing records. [2025-10-01T19:14:10.504221] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-01T19:14:10.680932] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:14:10.683101] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T19:14:10.681690] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-01T19:14:10.691924] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-01T19:14:10.692801] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-01T19:14:10.692867] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-01T19:14:11.093701] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:14:11.187515] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T19:14:11.302431] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-01T19:14:12.102402] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-01T19:14:12.231091] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T19:14:12.661286] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T19:14:12.902389] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-01T19:14:13.646758] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T19:14:13.702360] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-01T19:14:14.502404] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-01T19:14:14.785175] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T19:14:15.044937] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T19:14:15.302398] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-01T19:14:16.102393] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-01T19:14:16.198241] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T19:14:16.502752] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T19:14:16.902429] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-01T19:14:17.643293] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T19:14:17.702372] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-01T19:14:18.288303] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T19:14:18.502388] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-01T19:14:19.302368] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-01T19:14:19.339927] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T19:14:20.102360] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-01T19:14:20.189342] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T19:14:20.902387] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-01T19:14:21.603296] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T19:14:21.628255] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-01T19:14:21.629912] [INFO ] [REMOTE ] GNW: Full fetch complete (73521 records). [2025-10-01T19:14:21.630018] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-01T19:14:21.707584] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-01T19:14:22.083214] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-01T19:14:22.083428] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-01T19:14:22.084536] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-01T19:14:22.084604] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-01T19:14:22.086139] [DEBUG] [LOCAL ] GNW: Trimmed 73521 records to 51326 (keeping 200 days of data) [2025-10-01T19:14:22.338082] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:14:22.435601] [DEBUG] [LOCAL ] GNW: Primary data saved (51326 records). [2025-10-01T19:14:22.435774] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-01T19:14:22.435897] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNW took 40.6s. Estimated remaining: 3h 19m 51s. Rate: 7.1 symbols/min [2025-10-01T19:14:22.514870] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-01T19:14:22.633341] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:14:22.670723] [DEBUG] [LOCAL ] GOTU: Loaded 38557 existing records from primary storage. [2025-10-01T19:14:22.671085] [INFO ] [MAIN ] GOTU: Loaded 38557 existing records. [2025-10-01T19:14:22.861332] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:14:22.861617] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-01T19:14:22.861707] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-01T19:14:22.862011] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-01T19:14:22.862070] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-01T19:14:23.307118] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-01T19:14:23.315054] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:14:23.363029] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T19:14:24.102421] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-01T19:14:24.552563] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T19:14:24.580494] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-01T19:14:24.581880] [INFO ] [REMOTE ] GOF: Full fetch complete (62159 records). [2025-10-01T19:14:24.581982] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-01T19:14:24.907568] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-01T19:14:25.031112] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-01T19:14:25.031202] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-01T19:14:25.032185] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-01T19:14:25.032287] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-01T19:14:25.033624] [DEBUG] [LOCAL ] GOF: Trimmed 62159 records to 42589 (keeping 200 days of data) [2025-10-01T19:14:25.300746] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T19:14:25.368015] [DEBUG] [LOCAL ] GOF: Primary data saved (42589 records). [2025-10-01T19:14:25.368219] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-01T19:14:25.368371] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 37.7s. Estimated remaining: 3h 19m 35s. Rate: 7.1 symbols/min [2025-10-01T19:14:25.562486] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:14:25.610514] [DEBUG] [LOCAL ] GPC: Loaded 46398 existing records from primary storage. [2025-10-01T19:14:25.610903] [INFO ] [MAIN ] GPC: Loaded 46398 existing records. [2025-10-01T19:14:25.707690] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-01T19:14:25.819946] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:14:25.820165] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-01T19:14:25.820215] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-01T19:14:25.820479] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-01T19:14:25.820539] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-01T19:14:26.241080] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:14:26.355520] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T19:14:26.502379] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-01T19:14:27.281832] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T19:14:27.302339] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-01T19:14:27.941010] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T19:14:28.102384] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-01T19:14:28.902356] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-01T19:14:29.031037] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T19:14:29.242784] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T19:14:29.702391] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-01T19:14:30.502404] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-01T19:14:30.664814] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T19:14:31.302392] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-01T19:14:31.426047] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T19:14:31.728483] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T19:14:32.102436] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-01T19:14:32.902366] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-01T19:14:33.016733] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T19:14:33.095382] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T19:14:33.702409] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-01T19:14:34.465415] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T19:14:34.502359] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-01T19:14:35.173063] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-01T19:14:35.174339] [INFO ] [REMOTE ] GOLF: Full fetch complete (45063 records). [2025-10-01T19:14:35.174463] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-01T19:14:35.307527] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-01T19:14:35.611846] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-01T19:14:35.611989] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-01T19:14:35.612742] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-01T19:14:35.612838] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-01T19:14:35.613813] [DEBUG] [LOCAL ] GOLF: Trimmed 45063 records to 31207 (keeping 200 days of data) [2025-10-01T19:14:35.824122] [DEBUG] [LOCAL ] GOLF: Primary data saved (31207 records). [2025-10-01T19:14:35.824269] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-01T19:14:35.824361] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOLF took 37.6s. Estimated remaining: 3h 19m 29s. Rate: 7.1 symbols/min [2025-10-01T19:14:36.016426] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:14:36.064038] [DEBUG] [LOCAL ] GPI: Loaded 14682 existing records from primary storage. [2025-10-01T19:14:36.066901] [INFO ] [MAIN ] GPI: Loaded 14682 existing records. [2025-10-01T19:14:36.066741] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T19:14:36.113172] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-01T19:14:36.297300] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:14:36.297553] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-01T19:14:36.297623] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-01T19:14:36.297984] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-01T19:14:36.298065] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-01T19:14:36.669520] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:14:36.715104] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T19:14:36.902385] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-01T19:14:37.696742] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T19:14:37.705440] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-01T19:14:37.978999] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T19:14:38.502404] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-01T19:14:39.299530] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T19:14:39.302419] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-01T19:14:39.379029] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:14:40.106660] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-01T19:14:40.109298] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:14:40.902387] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-01T19:14:41.581142] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T19:14:41.702390] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-01T19:14:42.502433] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-01T19:14:42.712904] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T19:14:42.948369] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T19:14:43.302422] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-01T19:14:43.418672] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T19:14:44.102398] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-01T19:14:44.723963] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T19:14:44.902408] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-01T19:14:45.239142] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T19:14:45.702391] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-01T19:14:46.244455] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T19:14:46.502362] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-01T19:14:47.163676] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T19:14:47.302380] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-01T19:14:47.953598] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T19:14:48.102378] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-01T19:14:48.534032] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T19:14:48.902389] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-01T19:14:49.597605] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T19:14:49.702398] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-01T19:14:49.762911] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T19:14:50.502429] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-01T19:14:51.302392] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-01T19:14:51.534519] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-01T19:14:51.535988] [INFO ] [REMOTE ] GOOS: Full fetch complete (65501 records). [2025-10-01T19:14:51.536106] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-01T19:14:51.962507] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-01T19:14:51.962604] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-01T19:14:51.963579] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-01T19:14:51.963677] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-01T19:14:51.965037] [DEBUG] [LOCAL ] GOOS: Trimmed 65501 records to 45028 (keeping 200 days of data) [2025-10-01T19:14:52.135413] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-01T19:14:52.245219] [DEBUG] [LOCAL ] GOOS: Primary data saved (45028 records). [2025-10-01T19:14:52.245382] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-01T19:14:52.245528] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 42.1s. Estimated remaining: 3h 19m 32s. Rate: 7.1 symbols/min [2025-10-01T19:14:52.352000] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-01T19:14:52.374523] [INFO ] [REMOTE ] GOTU: Full fetch complete (59240 records). [2025-10-01T19:14:52.375115] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-01T19:14:52.553087] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:14:52.596667] [DEBUG] [LOCAL ] GPJA: Loaded 4219 existing records from primary storage. [2025-10-01T19:14:52.627761] [INFO ] [MAIN ] GPJA: Loaded 4219 existing records. [2025-10-01T19:14:53.023776] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:14:53.045577] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-01T19:14:53.058429] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-01T19:14:53.121608] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-01T19:14:53.122519] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-01T19:14:53.122612] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-01T19:14:53.131052] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-01T19:14:53.151518] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-01T19:14:53.169015] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-01T19:14:53.191858] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T19:14:53.235861] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-01T19:14:53.288122] [DEBUG] [LOCAL ] GOTU: Trimmed 59240 records to 38435 (keeping 200 days of data) [2025-10-01T19:14:53.366293] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T19:14:53.690386] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:14:53.702468] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-01T19:14:53.827123] [DEBUG] [LOCAL ] GOTU: Primary data saved (38435 records). [2025-10-01T19:14:53.827258] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-01T19:14:53.827371] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOTU took 31.4s. Estimated remaining: 3h 19m 14s. Rate: 7.1 symbols/min [2025-10-01T19:14:54.235251] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T19:14:54.270406] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-01T19:14:54.502398] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-01T19:14:55.293514] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T19:14:55.302326] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-01T19:14:55.925339] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T19:14:56.102375] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-01T19:14:56.668947] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-01T19:14:56.902380] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-01T19:14:57.437463] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-01T19:14:57.702380] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-01T19:14:58.165692] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T19:14:58.502379] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-01T19:14:59.048416] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-01T19:14:59.302377] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-01T19:14:59.787506] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T19:15:00.102383] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-01T19:15:00.701529] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T19:15:00.902381] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-01T19:15:01.702398] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-01T19:15:01.806693] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T19:15:02.078621] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-01T19:15:02.502375] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-01T19:15:03.245435] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T19:15:03.302353] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-01T19:15:04.102374] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-01T19:15:04.480449] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T19:15:04.481436] [INFO ] [REMOTE ] GPI: Full fetch complete (21082 records). [2025-10-01T19:15:04.481516] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-01T19:15:04.878366] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-01T19:15:04.878464] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-01T19:15:04.878965] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-01T19:15:04.879037] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-01T19:15:04.879667] [DEBUG] [LOCAL ] GPI: Trimmed 21082 records to 14648 (keeping 200 days of data) [2025-10-01T19:15:04.921463] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-01T19:15:04.980472] [DEBUG] [LOCAL ] GPI: Primary data saved (14648 records). [2025-10-01T19:15:04.980611] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-01T19:15:04.980724] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPI took 29.2s. Estimated remaining: 3h 19m 9s. Rate: 7.1 symbols/min [2025-10-01T19:15:05.867265] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-01T19:15:05.868296] [INFO ] [REMOTE ] GPJA: Full fetch complete (7365 records). [2025-10-01T19:15:05.868371] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-01T19:15:06.068457] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-01T19:15:06.117086] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-01T19:15:06.314229] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-01T19:15:06.314310] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-01T19:15:06.314498] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-01T19:15:06.314540] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-01T19:15:06.314982] [DEBUG] [LOCAL ] GPJA: Trimmed 7365 records to 4229 (keeping 200 days of data) [2025-10-01T19:15:06.341042] [DEBUG] [LOCAL ] GPJA: Primary data saved (4229 records). [2025-10-01T19:15:06.341151] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-01T19:15:06.341235] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPJA took 14.1s. Estimated remaining: 3h 18m 50s. Rate: 7.1 symbols/min [2025-10-01T19:15:09.815261] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (3.70 seconds). [2025-10-01T19:15:09.825281] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-01T19:15:11.975701] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-01T19:15:11.977227] [INFO ] [REMOTE ] GPC: Full fetch complete (68937 records). [2025-10-01T19:15:11.977331] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-01T19:15:12.429200] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-01T19:15:12.429294] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-01T19:15:12.430261] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-01T19:15:12.430336] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-01T19:15:12.431912] [DEBUG] [LOCAL ] GPC: Trimmed 68937 records to 46349 (keeping 200 days of data) [2025-10-01T19:15:12.749166] [DEBUG] [LOCAL ] GPC: Primary data saved (46349 records). [2025-10-01T19:15:12.749304] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-01T19:15:12.749393] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 47.4s. Estimated remaining: 3h 18m 39s. Rate: 7.1 symbols/min [2025-10-01T19:15:13.345766] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:13.471377] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:13.567410] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:13.569277] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:13.591764] [DEBUG] [LOCAL ] GPMT: Loaded 26222 existing records from primary storage. [2025-10-01T19:15:13.592400] [INFO ] [MAIN ] GPMT: Loaded 26222 existing records. [2025-10-01T19:15:13.704590] [DEBUG] [LOCAL ] GPOR: Loaded 23091 existing records from primary storage. [2025-10-01T19:15:13.732554] [INFO ] [MAIN ] GPOR: Loaded 23091 existing records. [2025-10-01T19:15:13.954929] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:13.998103] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-01T19:15:14.010380] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-01T19:15:14.016097] [DEBUG] [LOCAL ] GPN: Loaded 52050 existing records from primary storage. [2025-10-01T19:15:14.016719] [INFO ] [MAIN ] GPN: Loaded 52050 existing records. [2025-10-01T19:15:14.017722] [DEBUG] [LOCAL ] GPK: Loaded 52664 existing records from primary storage. [2025-10-01T19:15:14.045753] [INFO ] [MAIN ] GPK: Loaded 52664 existing records. [2025-10-01T19:15:14.040244] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-01T19:15:14.126574] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-01T19:15:14.261213] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:14.345340] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-01T19:15:14.412140] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-01T19:15:14.470299] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-01T19:15:14.524013] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-01T19:15:14.762483] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:14.874072] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-01T19:15:14.908005] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-01T19:15:14.907832] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:14.964545] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-01T19:15:14.980334] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-01T19:15:15.054802] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-01T19:15:15.069984] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-01T19:15:15.143996] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-01T19:15:15.190904] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-01T19:15:15.813815] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:15.869532] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-01T19:15:16.317524] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:16.354593] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-01T19:15:16.628986] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:16.631403] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-01T19:15:16.635825] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:16.636998] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-01T19:15:17.149612] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T19:15:17.156469] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-01T19:15:17.699899] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T19:15:17.708219] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-01T19:15:18.768401] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T19:15:18.773851] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-01T19:15:19.142360] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-01T19:15:19.153472] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-01T19:15:19.608578] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-10-01T19:15:19.619514] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-01T19:15:20.081096] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-01T19:15:20.087486] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-01T19:15:20.473986] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T19:15:20.479591] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-01T19:15:20.706897] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T19:15:20.717433] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-01T19:15:21.310753] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T19:15:21.316792] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-01T19:15:21.349137] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T19:15:21.360697] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-01T19:15:21.508089] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T19:15:21.516418] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-01T19:15:21.963091] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T19:15:21.973296] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-01T19:15:22.471895] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T19:15:22.478203] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-01T19:15:22.825387] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T19:15:22.834385] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-01T19:15:22.924359] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T19:15:22.934519] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-01T19:15:23.182106] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T19:15:23.187539] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-01T19:15:23.739162] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T19:15:23.751057] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-01T19:15:23.789155] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T19:15:23.895753] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T19:15:24.102348] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-01T19:15:24.335331] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T19:15:24.902439] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-01T19:15:25.017081] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T19:15:25.200941] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T19:15:25.702393] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-01T19:15:26.056988] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T19:15:26.502422] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-01T19:15:27.302395] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-01T19:15:27.324999] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T19:15:27.364414] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T19:15:28.102415] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-01T19:15:28.902387] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-01T19:15:29.178063] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T19:15:29.702464] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-01T19:15:30.151087] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T19:15:30.235961] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-01T19:15:30.502399] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-01T19:15:31.300308] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T19:15:31.310909] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-01T19:15:32.102388] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-01T19:15:32.411762] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T19:15:32.438187] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T19:15:32.854778] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T19:15:32.902389] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-01T19:15:33.631744] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T19:15:33.702391] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-01T19:15:34.502408] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-01T19:15:35.298981] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T19:15:35.309251] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-01T19:15:35.877611] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T19:15:36.102392] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-01T19:15:36.587757] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T19:15:36.588742] [INFO ] [REMOTE ] GPMT: Full fetch complete (37374 records). [2025-10-01T19:15:36.588865] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-01T19:15:36.907518] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-01T19:15:37.006176] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-01T19:15:37.006270] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-01T19:15:37.006945] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-01T19:15:37.007025] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-01T19:15:37.008023] [DEBUG] [LOCAL ] GPMT: Trimmed 37374 records to 26086 (keeping 200 days of data) [2025-10-01T19:15:37.173091] [DEBUG] [LOCAL ] GPMT: Primary data saved (26086 records). [2025-10-01T19:15:37.173309] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-01T19:15:37.173556] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPMT took 24.4s. Estimated remaining: 3h 18m 54s. Rate: 7.1 symbols/min [2025-10-01T19:15:37.382538] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:37.425393] [DEBUG] [LOCAL ] GPRK: Loaded 39299 existing records from primary storage. [2025-10-01T19:15:37.425789] [INFO ] [MAIN ] GPRK: Loaded 39299 existing records. [2025-10-01T19:15:37.641928] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:37.642509] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-01T19:15:37.642628] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-01T19:15:37.642997] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-01T19:15:37.643067] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-01T19:15:37.703746] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-01T19:15:37.988008] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T19:15:38.103313] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:38.499093] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T19:15:38.504078] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-01T19:15:39.107288] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T19:15:39.302381] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-01T19:15:40.102389] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-01T19:15:40.246882] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T19:15:40.310182] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T19:15:40.902400] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-01T19:15:41.702386] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-01T19:15:42.502404] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-01T19:15:42.563443] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-01T19:15:42.566319] [INFO ] [REMOTE ] GPN: Full fetch complete (74877 records). [2025-10-01T19:15:42.566549] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-01T19:15:43.011298] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-01T19:15:43.082057] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-01T19:15:43.082156] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-01T19:15:43.083428] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-01T19:15:43.083499] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-01T19:15:43.085585] [DEBUG] [LOCAL ] GPN: Trimmed 74877 records to 52049 (keeping 200 days of data) [2025-10-01T19:15:43.195617] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-01T19:15:43.198187] [INFO ] [REMOTE ] GPOR: Full fetch complete (34938 records). [2025-10-01T19:15:43.198906] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-01T19:15:43.307977] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-01T19:15:43.653508] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-01T19:15:43.653978] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-01T19:15:43.655537] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-01T19:15:43.655622] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-01T19:15:43.663748] [DEBUG] [LOCAL ] GPOR: Trimmed 34938 records to 23138 (keeping 200 days of data) [2025-10-01T19:15:43.910777] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T19:15:44.045943] [DEBUG] [LOCAL ] GPN: Primary data saved (52049 records). [2025-10-01T19:15:44.046612] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-01T19:15:44.047260] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPN took 31.3s. Estimated remaining: 3h 18m 43s. Rate: 7.1 symbols/min [2025-10-01T19:15:44.110147] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-01T19:15:44.268243] [DEBUG] [LOCAL ] GPOR: Primary data saved (23138 records). [2025-10-01T19:15:44.268136] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:44.268503] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-01T19:15:44.268690] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPOR took 31.5s. Estimated remaining: 3h 18m 23s. Rate: 7.1 symbols/min [2025-10-01T19:15:44.499975] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:44.500905] [DEBUG] [LOCAL ] GRBK: Loaded 26887 existing records from primary storage. [2025-10-01T19:15:44.501437] [INFO ] [MAIN ] GRBK: Loaded 26887 existing records. [2025-10-01T19:15:44.621766] [DEBUG] [LOCAL ] GRC: Loaded 8931 existing records from primary storage. [2025-10-01T19:15:44.637706] [INFO ] [MAIN ] GRC: Loaded 8931 existing records. [2025-10-01T19:15:44.803184] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:44.827311] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-01T19:15:44.827379] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-01T19:15:44.827961] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-01T19:15:44.833156] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-01T19:15:45.034089] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:45.060275] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-01T19:15:45.092215] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-01T19:15:45.109797] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-01T19:15:45.160397] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-01T19:15:45.523639] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:45.558561] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-01T19:15:45.782570] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:45.783630] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-01T19:15:45.788231] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-01T19:15:45.816125] [INFO ] [REMOTE ] GPK: Full fetch complete (75526 records). [2025-10-01T19:15:45.819032] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-01T19:15:45.821404] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T19:15:46.277106] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-01T19:15:46.277240] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-01T19:15:46.278892] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-01T19:15:46.278962] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-01T19:15:46.280920] [DEBUG] [LOCAL ] GPK: Trimmed 75526 records to 52660 (keeping 200 days of data) [2025-10-01T19:15:46.524872] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-01T19:15:46.653224] [DEBUG] [LOCAL ] GPK: Primary data saved (52660 records). [2025-10-01T19:15:46.653395] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-01T19:15:46.653509] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPK took 33.9s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-01T19:15:46.843353] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T19:15:46.863916] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:15:46.889111] [DEBUG] [LOCAL ] GRDN: Loaded 20313 existing records from primary storage. [2025-10-01T19:15:46.889432] [INFO ] [MAIN ] GRDN: Loaded 20313 existing records. [2025-10-01T19:15:47.030016] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T19:15:47.128364] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:15:47.128584] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-01T19:15:47.128634] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-01T19:15:47.128993] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-01T19:15:47.129056] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-01T19:15:47.307751] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-01T19:15:47.537307] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:15:48.003343] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T19:15:48.102398] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-01T19:15:48.804353] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T19:15:48.902376] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-01T19:15:49.176398] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T19:15:49.702377] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-01T19:15:49.857409] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T19:15:50.256373] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T19:15:50.502377] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-01T19:15:51.274309] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T19:15:51.302365] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-01T19:15:52.102382] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-01T19:15:52.156434] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T19:15:52.902389] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-01T19:15:53.191609] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T19:15:53.704697] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-01T19:15:53.706792] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T19:15:54.502383] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-01T19:15:54.620574] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T19:15:55.251265] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T19:15:55.302380] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-01T19:15:56.102381] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-01T19:15:56.408922] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T19:15:56.902412] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-01T19:15:57.416460] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T19:15:57.702391] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-01T19:15:57.921535] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T19:15:58.502380] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-01T19:15:59.284726] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T19:15:59.302358] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-01T19:15:59.493431] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T19:15:59.758851] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T19:16:00.102377] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-01T19:16:00.902389] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-01T19:16:01.193258] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T19:16:01.347554] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T19:16:01.702420] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-01T19:16:02.502348] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-01T19:16:02.962801] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T19:16:03.302430] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-01T19:16:03.957674] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T19:16:04.102391] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-01T19:16:04.246884] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T19:16:04.647534] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T19:16:04.902383] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-01T19:16:05.702372] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-01T19:16:06.153392] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T19:16:06.502416] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-01T19:16:06.741555] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T19:16:07.302388] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-01T19:16:07.715079] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T19:16:08.102426] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-01T19:16:08.498767] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T19:16:08.902420] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-01T19:16:09.101435] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T19:16:09.670611] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T19:16:09.702394] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-01T19:16:10.502395] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-01T19:16:11.041156] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T19:16:11.302402] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-01T19:16:11.645794] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T19:16:12.102362] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-01T19:16:12.388337] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T19:16:12.902430] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-01T19:16:13.702401] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-01T19:16:13.748109] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-01T19:16:13.749356] [INFO ] [REMOTE ] GRBK: Full fetch complete (40550 records). [2025-10-01T19:16:13.749444] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-01T19:16:14.216753] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-01T19:16:14.217383] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-01T19:16:14.218206] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T19:16:14.219007] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-01T19:16:14.225494] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-01T19:16:14.227074] [DEBUG] [LOCAL ] GRBK: Trimmed 40550 records to 26888 (keeping 200 days of data) [2025-10-01T19:16:14.396519] [DEBUG] [LOCAL ] GRBK: Primary data saved (26888 records). [2025-10-01T19:16:14.396682] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-01T19:16:14.396794] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GRBK took 30.3s. Estimated remaining: 3h 18m 25s. Rate: 7.1 symbols/min [2025-10-01T19:16:14.508689] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-01T19:16:14.594125] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:16:14.638751] [DEBUG] [LOCAL ] GRMN: Loaded 41031 existing records from primary storage. [2025-10-01T19:16:14.639051] [INFO ] [MAIN ] GRMN: Loaded 41031 existing records. [2025-10-01T19:16:14.840094] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:16:14.840302] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-01T19:16:14.840352] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-01T19:16:14.840619] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-01T19:16:14.840711] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-01T19:16:15.251719] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:16:15.276311] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T19:16:15.302343] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-01T19:16:16.102407] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-01T19:16:16.163492] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-01T19:16:16.164936] [INFO ] [REMOTE ] GRDN: Full fetch complete (26333 records). [2025-10-01T19:16:16.165026] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-01T19:16:16.614502] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-01T19:16:16.614599] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-01T19:16:16.615311] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-01T19:16:16.615389] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-01T19:16:16.616323] [DEBUG] [LOCAL ] GRDN: Trimmed 26333 records to 20512 (keeping 200 days of data) [2025-10-01T19:16:16.753173] [DEBUG] [LOCAL ] GRDN: Primary data saved (20512 records). [2025-10-01T19:16:16.753322] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-01T19:16:16.753429] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRDN took 30.1s. Estimated remaining: 3h 18m 8s. Rate: 7.1 symbols/min [2025-10-01T19:16:16.907002] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-01T19:16:16.941619] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:16:16.965228] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T19:16:17.008717] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T19:16:17.008481] [DEBUG] [LOCAL ] GRND: Loaded 49918 existing records from primary storage. [2025-10-01T19:16:17.010533] [INFO ] [MAIN ] GRND: Loaded 49918 existing records. [2025-10-01T19:16:17.047872] [INFO ] [REMOTE ] GPRK: Full fetch complete (57381 records). [2025-10-01T19:16:17.087328] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-01T19:16:17.376597] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:16:17.423266] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-01T19:16:17.463989] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-01T19:16:17.553697] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-01T19:16:17.580418] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-01T19:16:17.702554] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-01T19:16:17.802984] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-01T19:16:17.803343] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-01T19:16:17.804555] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-01T19:16:17.810469] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-01T19:16:17.869598] [DEBUG] [LOCAL ] GPRK: Trimmed 57381 records to 39366 (keeping 200 days of data) [2025-10-01T19:16:18.209787] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:16:18.356612] [DEBUG] [LOCAL ] GPRK: Primary data saved (39366 records). [2025-10-01T19:16:18.356780] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-01T19:16:18.356868] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GPRK took 41.2s. Estimated remaining: 3h 17m 49s. Rate: 7.1 symbols/min [2025-10-01T19:16:18.512332] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-01T19:16:18.549474] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:16:18.594982] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T19:16:18.615330] [DEBUG] [LOCAL ] GRNT: Loaded 33750 existing records from primary storage. [2025-10-01T19:16:18.615594] [INFO ] [MAIN ] GRNT: Loaded 33750 existing records. [2025-10-01T19:16:18.777298] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T19:16:18.803405] [INFO ] [REMOTE ] GRC: Full fetch complete (13079 records). [2025-10-01T19:16:18.817665] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-01T19:16:18.817544] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:16:18.817978] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-01T19:16:18.818098] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-01T19:16:18.818319] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-01T19:16:18.818378] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-01T19:16:19.308759] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-01T19:16:19.662465] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:16:19.672427] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-01T19:16:19.672927] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-01T19:16:19.673253] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-01T19:16:19.673315] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-01T19:16:19.673938] [DEBUG] [LOCAL ] GRC: Trimmed 13079 records to 8958 (keeping 200 days of data) [2025-10-01T19:16:19.735328] [DEBUG] [LOCAL ] GRC: Primary data saved (8958 records). [2025-10-01T19:16:19.735473] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-01T19:16:19.735583] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 35.5s. Estimated remaining: 3h 17m 31s. Rate: 7.1 symbols/min [2025-10-01T19:16:19.923521] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:16:19.934918] [DEBUG] [LOCAL ] GROV: Loaded 8951 existing records from primary storage. [2025-10-01T19:16:19.935145] [INFO ] [MAIN ] GROV: Loaded 8951 existing records. [2025-10-01T19:16:20.104075] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-01T19:16:20.155534] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:16:20.156463] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-01T19:16:20.156670] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-01T19:16:20.166106] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-01T19:16:20.172399] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-01T19:16:20.260383] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T19:16:20.611602] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:16:20.637123] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T19:16:20.902438] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-01T19:16:21.524729] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T19:16:21.702428] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-01T19:16:21.813029] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T19:16:22.502403] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-01T19:16:23.241111] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T19:16:23.284910] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T19:16:23.302402] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-01T19:16:24.102441] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-01T19:16:24.761553] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:16:24.851144] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T19:16:24.902379] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-01T19:16:25.702402] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-01T19:16:26.331549] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T19:16:26.439321] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-01T19:16:26.502403] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-01T19:16:27.302437] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-01T19:16:28.096813] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T19:16:28.108721] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-01T19:16:28.125246] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T19:16:28.892280] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T19:16:28.902328] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-01T19:16:29.466446] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T19:16:29.702392] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-01T19:16:30.502394] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-01T19:16:30.737292] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T19:16:31.302401] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-01T19:16:32.102386] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-01T19:16:32.315163] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T19:16:32.346946] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T19:16:32.902408] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-01T19:16:33.314330] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T19:16:33.702403] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-01T19:16:34.281415] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T19:16:34.502386] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-01T19:16:35.302362] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-01T19:16:35.465803] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T19:16:35.834552] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T19:16:36.102416] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-01T19:16:36.805678] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:16:36.836450] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T19:16:36.902464] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-01T19:16:37.702377] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-01T19:16:38.123090] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T19:16:38.404850] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:16:38.502388] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-01T19:16:39.302396] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-01T19:16:39.803823] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T19:16:40.081972] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-01T19:16:40.083007] [INFO ] [REMOTE ] GROV: Full fetch complete (14391 records). [2025-10-01T19:16:40.083091] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-01T19:16:40.107592] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-01T19:16:40.494127] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-01T19:16:40.494220] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-01T19:16:40.494709] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-01T19:16:40.494775] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-01T19:16:40.495404] [DEBUG] [LOCAL ] GROV: Trimmed 14391 records to 8902 (keeping 200 days of data) [2025-10-01T19:16:40.549807] [DEBUG] [LOCAL ] GROV: Primary data saved (8902 records). [2025-10-01T19:16:40.549948] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-01T19:16:40.550033] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GROV took 20.8s. Estimated remaining: 3h 17m 40s. Rate: 7.1 symbols/min [2025-10-01T19:16:40.735353] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:16:40.743057] [DEBUG] [LOCAL ] GRX: Loaded 4617 existing records from primary storage. [2025-10-01T19:16:40.743257] [INFO ] [MAIN ] GRX: Loaded 4617 existing records. [2025-10-01T19:16:40.924233] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-01T19:16:40.938993] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:16:40.939948] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-01T19:16:40.940001] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-01T19:16:40.940208] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-01T19:16:40.940268] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-01T19:16:41.409278] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:16:41.609828] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T19:16:41.702381] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-01T19:16:42.066844] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-01T19:16:42.479605] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T19:16:42.502344] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-01T19:16:43.302383] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-01T19:16:44.102368] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-01T19:16:44.204639] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T19:16:44.490073] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T19:16:44.780426] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T19:16:44.902410] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-01T19:16:45.702381] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-01T19:16:46.247533] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T19:16:46.502373] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-01T19:16:46.922799] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T19:16:47.302380] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-01T19:16:47.714233] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T19:16:47.922130] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T19:16:48.102456] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-01T19:16:48.902380] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-01T19:16:49.530710] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T19:16:49.553985] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T19:16:49.702395] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-01T19:16:50.502382] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-01T19:16:51.110426] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T19:16:51.302425] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-01T19:16:51.610235] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T19:16:51.887383] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T19:16:52.102387] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-01T19:16:52.902379] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-01T19:16:53.702395] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-01T19:16:54.188879] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T19:16:54.190407] [INFO ] [REMOTE ] GRND: Full fetch complete (70744 records). [2025-10-01T19:16:54.190517] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-01T19:16:54.447199] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T19:16:54.425145] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-01T19:16:54.462516] [INFO ] [REMOTE ] GRNT: Full fetch complete (48543 records). [2025-10-01T19:16:54.479890] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-01T19:16:54.503133] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-01T19:16:54.804963] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-01T19:16:54.816728] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-01T19:16:54.823354] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-01T19:16:54.830731] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-01T19:16:54.940777] [DEBUG] [LOCAL ] GRND: Trimmed 70744 records to 49918 (keeping 200 days of data) [2025-10-01T19:16:55.066745] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T19:16:55.187908] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-01T19:16:55.188354] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-01T19:16:55.189960] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-01T19:16:55.190052] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-01T19:16:55.194343] [DEBUG] [LOCAL ] GRNT: Trimmed 48543 records to 33794 (keeping 200 days of data) [2025-10-01T19:16:55.302787] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-01T19:16:55.611833] [DEBUG] [LOCAL ] GRND: Primary data saved (49918 records). [2025-10-01T19:16:55.612539] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-01T19:16:55.613524] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRND took 38.9s. Estimated remaining: 3h 17m 41s. Rate: 7.1 symbols/min [2025-10-01T19:16:55.818530] [DEBUG] [LOCAL ] GRNT: Primary data saved (33794 records). [2025-10-01T19:16:55.820442] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-01T19:16:55.820576] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRNT took 37.5s. Estimated remaining: 3h 17m 21s. Rate: 7.1 symbols/min [2025-10-01T19:16:55.820261] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:16:55.957972] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T19:16:56.025919] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:16:56.066931] [DEBUG] [LOCAL ] GS: Loaded 51906 existing records from primary storage. [2025-10-01T19:16:56.067386] [INFO ] [MAIN ] GS: Loaded 51906 existing records. [2025-10-01T19:16:56.107606] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-01T19:16:56.293406] [DEBUG] [LOCAL ] GSBD: Loaded 39087 existing records from primary storage. [2025-10-01T19:16:56.317073] [INFO ] [MAIN ] GSBD: Loaded 39087 existing records. [2025-10-01T19:16:56.316466] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:16:56.335791] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-01T19:16:56.335913] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-01T19:16:56.368728] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-01T19:16:56.392192] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-01T19:16:56.721463] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:16:56.731677] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-01T19:16:56.749404] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-01T19:16:56.796666] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-01T19:16:56.802461] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-01T19:16:56.917759] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-01T19:16:56.963832] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T19:16:57.115767] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:16:57.393970] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:16:57.702378] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-01T19:16:58.483035] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T19:16:58.502342] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-01T19:16:59.302427] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-01T19:16:59.601192] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T19:16:59.725126] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T19:17:00.102403] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-01T19:17:00.127466] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T19:17:00.902383] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-01T19:17:01.606927] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T19:17:01.702395] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-01T19:17:01.746482] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-01T19:17:01.747283] [INFO ] [REMOTE ] GRX: Full fetch complete (6617 records). [2025-10-01T19:17:01.747355] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-01T19:17:02.165158] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-01T19:17:02.165242] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-01T19:17:02.165422] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-01T19:17:02.165462] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-01T19:17:02.165921] [DEBUG] [LOCAL ] GRX: Trimmed 6617 records to 4663 (keeping 200 days of data) [2025-10-01T19:17:02.195996] [DEBUG] [LOCAL ] GRX: Primary data saved (4663 records). [2025-10-01T19:17:02.196131] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-01T19:17:02.196281] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRX took 21.6s. Estimated remaining: 3h 17m 9s. Rate: 7.1 symbols/min [2025-10-01T19:17:02.380035] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:17:02.445427] [DEBUG] [LOCAL ] GSK: Loaded 53492 existing records from primary storage. [2025-10-01T19:17:02.446100] [INFO ] [MAIN ] GSK: Loaded 53492 existing records. [2025-10-01T19:17:02.509255] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-01T19:17:02.671491] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:17:02.671804] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-01T19:17:02.671869] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-01T19:17:02.672171] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-01T19:17:02.672238] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-01T19:17:03.063456] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:17:03.302401] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-01T19:17:03.700086] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-01T19:17:03.705102] [INFO ] [REMOTE ] GRMN: Full fetch complete (59922 records). [2025-10-01T19:17:03.705300] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-01T19:17:04.111168] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-01T19:17:04.172949] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-01T19:17:04.173036] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-01T19:17:04.173936] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-01T19:17:04.174008] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-01T19:17:04.176628] [DEBUG] [LOCAL ] GRMN: Trimmed 59922 records to 41016 (keeping 200 days of data) [2025-10-01T19:17:04.462353] [DEBUG] [LOCAL ] GRMN: Primary data saved (41016 records). [2025-10-01T19:17:04.462489] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-01T19:17:04.462574] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRMN took 50.1s. Estimated remaining: 3h 16m 52s. Rate: 7.1 symbols/min [2025-10-01T19:17:04.679684] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:17:04.712757] [DEBUG] [LOCAL ] GSL: Loaded 33345 existing records from primary storage. [2025-10-01T19:17:04.713186] [INFO ] [MAIN ] GSL: Loaded 33345 existing records. [2025-10-01T19:17:04.920441] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:17:04.921159] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-01T19:17:04.931591] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-01T19:17:04.950178] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-01T19:17:04.950344] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-01T19:17:05.007193] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-01T19:17:05.077038] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-01T19:17:05.380864] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:17:05.440536] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T19:17:05.442585] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-01T19:17:05.702404] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-01T19:17:06.502393] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-01T19:17:07.144801] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T19:17:07.159551] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T19:17:07.302378] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-01T19:17:07.816177] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T19:17:08.102394] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-01T19:17:08.395970] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T19:17:08.902416] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-01T19:17:09.702393] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-01T19:17:10.087677] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-01T19:17:10.322729] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T19:17:10.502390] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-01T19:17:11.086988] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T19:17:11.302393] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-01T19:17:11.882851] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T19:17:12.102386] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-01T19:17:12.902405] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-01T19:17:13.422746] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T19:17:13.678847] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-01T19:17:13.702368] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-01T19:17:14.250699] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T19:17:14.502381] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-01T19:17:15.284337] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T19:17:15.302343] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-01T19:17:16.102412] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-01T19:17:16.146896] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T19:17:16.902401] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-01T19:17:17.349584] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-01T19:17:17.461195] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T19:17:17.702452] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-01T19:17:18.394516] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T19:17:18.502465] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-01T19:17:19.201120] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:17:19.302407] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-01T19:17:20.102380] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-01T19:17:20.688305] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-01T19:17:20.902361] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-01T19:17:21.161995] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T19:17:21.534695] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:17:21.702447] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-01T19:17:21.896852] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T19:17:22.502416] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-01T19:17:23.302436] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-01T19:17:23.435022] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T19:17:24.043139] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T19:17:24.102446] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-01T19:17:24.640631] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T19:17:24.902407] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-01T19:17:25.702360] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-01T19:17:26.036247] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T19:17:26.085906] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T19:17:26.502427] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-01T19:17:27.302381] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-01T19:17:27.506924] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T19:17:27.957407] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T19:17:28.102394] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-01T19:17:28.352070] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T19:17:28.902382] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-01T19:17:29.702354] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-01T19:17:30.502362] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-01T19:17:30.601821] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T19:17:30.788301] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-01T19:17:30.789962] [INFO ] [REMOTE ] GS: Full fetch complete (75679 records). [2025-10-01T19:17:30.790081] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-01T19:17:31.226791] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-01T19:17:31.226978] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-01T19:17:31.228231] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-01T19:17:31.228318] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-01T19:17:31.251350] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T19:17:31.259073] [DEBUG] [LOCAL ] GS: Trimmed 75679 records to 51875 (keeping 200 days of data) [2025-10-01T19:17:31.318268] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-01T19:17:31.613255] [DEBUG] [LOCAL ] GS: Primary data saved (51875 records). [2025-10-01T19:17:31.613408] [INFO ] [MAIN ] GS: Full history saved. [2025-10-01T19:17:31.613500] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GS took 36.0s. Estimated remaining: 3h 17m 10s. Rate: 7.1 symbols/min [2025-10-01T19:17:31.798617] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:17:31.850800] [DEBUG] [LOCAL ] GTES: Loaded 50537 existing records from primary storage. [2025-10-01T19:17:31.851161] [INFO ] [MAIN ] GTES: Loaded 50537 existing records. [2025-10-01T19:17:32.049202] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:17:32.049474] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-01T19:17:32.049523] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-01T19:17:32.049970] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-01T19:17:32.050033] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-01T19:17:32.111425] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-01T19:17:32.192090] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-01T19:17:32.221591] [INFO ] [REMOTE ] GSL: Full fetch complete (47957 records). [2025-10-01T19:17:32.235466] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-01T19:17:32.733059] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:17:32.910784] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-01T19:17:32.931307] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-01T19:17:32.931468] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-01T19:17:32.932324] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-01T19:17:32.932405] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-01T19:17:32.934014] [DEBUG] [LOCAL ] GSL: Trimmed 47957 records to 33326 (keeping 200 days of data) [2025-10-01T19:17:33.158556] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T19:17:33.195305] [DEBUG] [LOCAL ] GSL: Primary data saved (33326 records). [2025-10-01T19:17:33.195461] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-01T19:17:33.195609] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSL took 28.7s. Estimated remaining: 3h 16m 52s. Rate: 7.1 symbols/min [2025-10-01T19:17:33.384705] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:17:33.427871] [DEBUG] [LOCAL ] GTLS: Loaded 42730 existing records from primary storage. [2025-10-01T19:17:33.428327] [INFO ] [MAIN ] GTLS: Loaded 42730 existing records. [2025-10-01T19:17:33.623793] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:17:33.624024] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-01T19:17:33.624181] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-01T19:17:33.624514] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-01T19:17:33.624601] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-01T19:17:33.709120] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-01T19:17:34.006200] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T19:17:34.079546] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:17:34.502348] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-01T19:17:34.716727] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T19:17:35.302399] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-01T19:17:35.755471] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T19:17:36.102407] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-01T19:17:36.398955] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-01T19:17:36.400399] [INFO ] [REMOTE ] GSBD: Full fetch complete (58438 records). [2025-10-01T19:17:36.400492] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-01T19:17:36.824382] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-01T19:17:36.824620] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-01T19:17:36.825472] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-01T19:17:36.825523] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-01T19:17:36.826741] [DEBUG] [LOCAL ] GSBD: Trimmed 58438 records to 39140 (keeping 200 days of data) [2025-10-01T19:17:36.916692] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-01T19:17:37.085667] [DEBUG] [LOCAL ] GSBD: Primary data saved (39140 records). [2025-10-01T19:17:37.085837] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-01T19:17:37.085941] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSBD took 41.3s. Estimated remaining: 3h 16m 37s. Rate: 7.1 symbols/min [2025-10-01T19:17:37.271790] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:17:37.302194] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-01T19:17:37.348169] [DEBUG] [LOCAL ] GTN: Loaded 45533 existing records from primary storage. [2025-10-01T19:17:37.348482] [INFO ] [MAIN ] GTN: Loaded 45533 existing records. [2025-10-01T19:17:37.539194] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:17:37.539429] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-01T19:17:37.539488] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-01T19:17:37.539786] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-01T19:17:37.539847] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-01T19:17:37.702913] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-01T19:17:37.962866] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:17:37.965338] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T19:17:38.502570] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-01T19:17:38.505589] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T19:17:39.302371] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-01T19:17:39.331867] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T19:17:39.791264] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T19:17:40.102389] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-01T19:17:40.909580] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-01T19:17:40.933685] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T19:17:41.702392] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-01T19:17:41.989332] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T19:17:42.502342] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-01T19:17:42.623235] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T19:17:43.195273] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T19:17:43.302389] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-01T19:17:44.102403] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-01T19:17:44.902367] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-01T19:17:45.082763] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:17:45.142699] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T19:17:45.380850] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-01T19:17:45.385665] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-10-01T19:17:45.385828] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-01T19:17:45.707488] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-01T19:17:45.833099] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-01T19:17:45.833197] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-01T19:17:45.834280] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-01T19:17:45.834365] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-01T19:17:45.836121] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 53493 (keeping 200 days of data) [2025-10-01T19:17:46.189612] [DEBUG] [LOCAL ] GSK: Primary data saved (53493 records). [2025-10-01T19:17:46.189776] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-01T19:17:46.189882] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSK took 44.0s. Estimated remaining: 3h 16m 29s. Rate: 7.1 symbols/min [2025-10-01T19:17:46.384764] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:17:46.410446] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T19:17:46.444408] [DEBUG] [LOCAL ] GTY: Loaded 30299 existing records from primary storage. [2025-10-01T19:17:46.444713] [INFO ] [MAIN ] GTY: Loaded 30299 existing records. [2025-10-01T19:17:46.512902] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-01T19:17:46.649890] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:17:46.650095] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-01T19:17:46.650146] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-01T19:17:46.650564] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-01T19:17:46.650638] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-01T19:17:47.052452] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:17:47.302363] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-01T19:17:47.457203] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T19:17:47.898034] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T19:17:48.102385] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-01T19:17:48.601325] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T19:17:48.902379] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-01T19:17:49.084869] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T19:17:49.702385] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-01T19:17:50.421761] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T19:17:50.502382] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-01T19:17:50.555111] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:17:51.302382] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-01T19:17:52.102399] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-01T19:17:52.169328] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T19:17:52.780767] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T19:17:52.902357] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-01T19:17:53.208081] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T19:17:53.702378] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-01T19:17:54.429848] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T19:17:54.502379] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-01T19:17:55.302394] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-01T19:17:55.343679] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T19:17:55.916004] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T19:17:56.102377] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-01T19:17:56.902354] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-01T19:17:57.001964] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T19:17:57.670187] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T19:17:57.702368] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-01T19:17:58.381572] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T19:17:58.502437] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-01T19:17:59.302367] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-01T19:17:59.381858] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T19:17:59.988031] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T19:18:00.102359] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-01T19:18:00.610217] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T19:18:00.902384] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-01T19:18:01.702359] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-01T19:18:01.839441] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T19:18:02.225595] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T19:18:02.502395] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-01T19:18:03.302410] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-01T19:18:03.955279] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T19:18:03.957854] [INFO ] [REMOTE ] GTES: Full fetch complete (73909 records). [2025-10-01T19:18:03.957985] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-01T19:18:04.124242] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-01T19:18:04.431610] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T19:18:04.476379] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-01T19:18:04.476756] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-01T19:18:04.478091] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-01T19:18:04.478800] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-01T19:18:04.480398] [DEBUG] [LOCAL ] GTES: Trimmed 73909 records to 50520 (keeping 200 days of data) [2025-10-01T19:18:04.724463] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T19:18:04.831751] [DEBUG] [LOCAL ] GTES: Primary data saved (50520 records). [2025-10-01T19:18:04.831898] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-01T19:18:04.831999] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTES took 33.2s. Estimated remaining: 3h 16m 36s. Rate: 7.1 symbols/min [2025-10-01T19:18:04.907450] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-01T19:18:05.029184] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:05.043107] [DEBUG] [LOCAL ] GUG: Loaded 12048 existing records from primary storage. [2025-10-01T19:18:05.043343] [INFO ] [MAIN ] GUG: Loaded 12048 existing records. [2025-10-01T19:18:05.241493] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:05.241734] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-01T19:18:05.241791] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-01T19:18:05.242086] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-01T19:18:05.242148] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-01T19:18:05.430570] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T19:18:05.654074] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:05.702412] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-01T19:18:06.502433] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-01T19:18:06.681529] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T19:18:06.682772] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T19:18:07.302431] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-01T19:18:07.858621] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T19:18:08.102428] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-01T19:18:08.821091] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T19:18:08.902413] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-01T19:18:09.168348] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T19:18:09.588021] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T19:18:09.702395] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-01T19:18:10.491541] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T19:18:10.502435] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-01T19:18:11.302357] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-01T19:18:11.371637] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T19:18:12.102394] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-01T19:18:12.883628] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T19:18:12.902331] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-01T19:18:13.209297] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T19:18:13.210837] [INFO ] [REMOTE ] GTN: Full fetch complete (66381 records). [2025-10-01T19:18:13.210985] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-01T19:18:13.633343] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-01T19:18:13.633441] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-01T19:18:13.634376] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-01T19:18:13.634448] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-01T19:18:13.635944] [DEBUG] [LOCAL ] GTN: Trimmed 66381 records to 45476 (keeping 200 days of data) [2025-10-01T19:18:13.703709] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-01T19:18:13.870727] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T19:18:13.943152] [DEBUG] [LOCAL ] GTN: Primary data saved (45476 records). [2025-10-01T19:18:13.943296] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-01T19:18:13.943383] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTN took 36.9s. Estimated remaining: 3h 16m 28s. Rate: 7.1 symbols/min [2025-10-01T19:18:14.133912] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:14.153180] [DEBUG] [LOCAL ] GUT: Loaded 15320 existing records from primary storage. [2025-10-01T19:18:14.153429] [INFO ] [MAIN ] GUT: Loaded 15320 existing records. [2025-10-01T19:18:14.347232] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:14.347460] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-01T19:18:14.347514] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-01T19:18:14.347833] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-01T19:18:14.347892] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-01T19:18:14.510594] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-01T19:18:14.745160] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:15.202540] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-01T19:18:15.203947] [INFO ] [REMOTE ] GTY: Full fetch complete (43448 records). [2025-10-01T19:18:15.204028] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-01T19:18:15.307453] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-01T19:18:15.551698] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T19:18:15.653335] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-01T19:18:15.653428] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-01T19:18:15.654357] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-01T19:18:15.654431] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-01T19:18:15.655570] [DEBUG] [LOCAL ] GTY: Trimmed 43448 records to 30286 (keeping 200 days of data) [2025-10-01T19:18:15.860209] [DEBUG] [LOCAL ] GTY: Primary data saved (30286 records). [2025-10-01T19:18:15.860359] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-01T19:18:15.860478] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTY took 29.7s. Estimated remaining: 3h 16m 10s. Rate: 7.1 symbols/min [2025-10-01T19:18:16.093576] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:16.102348] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-01T19:18:16.132828] [DEBUG] [LOCAL ] GVA: Loaded 33174 existing records from primary storage. [2025-10-01T19:18:16.133125] [INFO ] [MAIN ] GVA: Loaded 33174 existing records. [2025-10-01T19:18:16.333026] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:16.333242] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-01T19:18:16.333290] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-01T19:18:16.333517] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-01T19:18:16.333575] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-01T19:18:16.752093] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:16.902386] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-01T19:18:17.008420] [DEBUG] [REMOTE ] GUG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-01T19:18:17.008790] [WARN ] [REMOTE ] GUG: No data returned for month 2025-06 [2025-10-01T19:18:17.008886] [FATAL] [REMOTE ] GUG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:18:17.008994] [FATAL] [MAIN ] GUG: Failed to fetch primary data. [2025-10-01T19:18:17.009083] [WARN ] [MAIN ] GUG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:18:17.009172] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-01T19:18:17.009257] [DEBUG] [LOCAL ] GUG: No primary data file found to delete. [2025-10-01T19:18:17.009336] [INFO ] [LOCAL ] GUG: Starting deletion of derivative data. [2025-10-01T19:18:17.009825] [DEBUG] [LOCAL ] GUG: Deleted derivative data file. [2025-10-01T19:18:17.009917] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GUG took 12.2s. Estimated remaining: 3h 15m 51s. Rate: 7.1 symbols/min [2025-10-01T19:18:17.241333] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T19:18:17.245323] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:17.270432] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T19:18:17.289543] [DEBUG] [LOCAL ] GWH: Loaded 15953 existing records from primary storage. [2025-10-01T19:18:17.289830] [INFO ] [MAIN ] GWH: Loaded 15953 existing records. [2025-10-01T19:18:17.493875] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:17.494139] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-01T19:18:17.494194] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-01T19:18:17.494421] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-01T19:18:17.494479] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-01T19:18:17.708223] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-01T19:18:17.913989] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:18.502389] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-01T19:18:19.087844] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T19:18:19.128618] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T19:18:19.302386] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-01T19:18:19.910781] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T19:18:20.102415] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-01T19:18:20.902429] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-01T19:18:21.408853] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T19:18:21.702415] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-01T19:18:21.717170] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T19:18:22.413055] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T19:18:22.502398] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-01T19:18:23.249913] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T19:18:23.302381] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-01T19:18:24.050712] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T19:18:24.102410] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-01T19:18:24.902427] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-01T19:18:25.702374] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-01T19:18:25.925761] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T19:18:26.296331] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-01T19:18:26.303614] [INFO ] [REMOTE ] GTLS: Full fetch complete (61369 records). [2025-10-01T19:18:26.303760] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-01T19:18:26.513752] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-01T19:18:26.648872] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T19:18:26.779249] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-01T19:18:26.779334] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-01T19:18:26.780186] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-01T19:18:26.780250] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-01T19:18:26.781538] [DEBUG] [LOCAL ] GTLS: Trimmed 61369 records to 42788 (keeping 200 days of data) [2025-10-01T19:18:27.059477] [DEBUG] [LOCAL ] GTLS: Primary data saved (42788 records). [2025-10-01T19:18:27.059624] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-01T19:18:27.059765] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTLS took 53.9s. Estimated remaining: 3h 15m 45s. Rate: 7.1 symbols/min [2025-10-01T19:18:27.260343] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:27.303127] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-01T19:18:27.303036] [DEBUG] [LOCAL ] GWRE: Loaded 40664 existing records from primary storage. [2025-10-01T19:18:27.304576] [INFO ] [MAIN ] GWRE: Loaded 40664 existing records. [2025-10-01T19:18:27.508942] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:27.509351] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-01T19:18:27.509409] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-01T19:18:27.509891] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-01T19:18:27.509951] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-01T19:18:27.880348] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T19:18:27.945461] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:28.102417] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-01T19:18:28.796544] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T19:18:28.902432] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-01T19:18:29.707480] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-01T19:18:29.728168] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T19:18:29.875739] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T19:18:30.502383] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-01T19:18:31.259382] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T19:18:31.302359] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-01T19:18:31.529109] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T19:18:32.102425] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-01T19:18:32.872168] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T19:18:32.902370] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-01T19:18:33.251155] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T19:18:33.702425] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-01T19:18:34.502349] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-01T19:18:34.538231] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T19:18:34.694185] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T19:18:35.302392] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-01T19:18:36.054797] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T19:18:36.102360] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-01T19:18:36.174587] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T19:18:36.902386] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-01T19:18:37.338812] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T19:18:37.702409] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-01T19:18:38.502371] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-01T19:18:38.652083] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T19:18:38.969410] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T19:18:39.302385] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-01T19:18:39.557362] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T19:18:40.102383] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-01T19:18:40.515134] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T19:18:40.516463] [INFO ] [REMOTE ] GWH: Full fetch complete (21235 records). [2025-10-01T19:18:40.516590] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-01T19:18:40.910902] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-01T19:18:40.944720] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-01T19:18:40.944890] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-01T19:18:40.945428] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-01T19:18:40.945473] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-01T19:18:40.946497] [DEBUG] [LOCAL ] GWH: Trimmed 21235 records to 16083 (keeping 200 days of data) [2025-10-01T19:18:41.048314] [DEBUG] [LOCAL ] GWH: Primary data saved (16083 records). [2025-10-01T19:18:41.048502] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-01T19:18:41.048605] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GWH took 24.0s. Estimated remaining: 3h 15m 45s. Rate: 7.1 symbols/min [2025-10-01T19:18:41.184618] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T19:18:41.255092] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:41.279386] [DEBUG] [LOCAL ] GWW: Loaded 19483 existing records from primary storage. [2025-10-01T19:18:41.279684] [INFO ] [MAIN ] GWW: Loaded 19483 existing records. [2025-10-01T19:18:41.483222] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:41.483489] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-01T19:18:41.483547] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-01T19:18:41.483804] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-01T19:18:41.483888] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-01T19:18:41.707587] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-01T19:18:41.902245] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:42.485363] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T19:18:42.502341] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-01T19:18:42.720763] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T19:18:43.302378] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-01T19:18:44.102389] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-01T19:18:44.137756] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T19:18:44.156623] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T19:18:44.830120] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T19:18:44.902443] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-01T19:18:45.702390] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-01T19:18:46.249549] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T19:18:46.502352] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-01T19:18:46.887805] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T19:18:47.302389] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-01T19:18:48.030095] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T19:18:48.102391] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-01T19:18:48.434034] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T19:18:48.434975] [INFO ] [REMOTE ] GUT: Full fetch complete (22781 records). [2025-10-01T19:18:48.435053] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-01T19:18:48.840724] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-01T19:18:48.840823] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-01T19:18:48.841306] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-01T19:18:48.841349] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-01T19:18:48.842041] [DEBUG] [LOCAL ] GUT: Trimmed 22781 records to 15316 (keeping 200 days of data) [2025-10-01T19:18:48.908131] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-01T19:18:48.939189] [DEBUG] [LOCAL ] GUT: Primary data saved (15316 records). [2025-10-01T19:18:48.939331] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-01T19:18:48.939421] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 35.0s. Estimated remaining: 3h 15m 35s. Rate: 7.1 symbols/min [2025-10-01T19:18:49.131992] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:49.177183] [DEBUG] [LOCAL ] GXO: Loaded 47460 existing records from primary storage. [2025-10-01T19:18:49.177519] [INFO ] [MAIN ] GXO: Loaded 47460 existing records. [2025-10-01T19:18:49.384174] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:49.384572] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-01T19:18:49.384633] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-01T19:18:49.384906] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-01T19:18:49.384967] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-01T19:18:49.704808] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-01T19:18:49.810441] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:49.836350] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T19:18:50.111498] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T19:18:50.502382] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-01T19:18:51.075811] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T19:18:51.302535] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-01T19:18:51.491061] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T19:18:52.102365] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-01T19:18:52.558304] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T19:18:52.902376] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-01T19:18:53.413243] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T19:18:53.702384] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-01T19:18:54.482868] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-01T19:18:54.484090] [INFO ] [REMOTE ] GVA: Full fetch complete (48625 records). [2025-10-01T19:18:54.484193] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-01T19:18:54.507470] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-01T19:18:54.901798] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-01T19:18:54.901905] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-01T19:18:54.902726] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-01T19:18:54.902788] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-01T19:18:54.903835] [DEBUG] [LOCAL ] GVA: Trimmed 48625 records to 33140 (keeping 200 days of data) [2025-10-01T19:18:55.123668] [DEBUG] [LOCAL ] GVA: Primary data saved (33140 records). [2025-10-01T19:18:55.123951] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-01T19:18:55.124171] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GVA took 39.3s. Estimated remaining: 3h 15m 24s. Rate: 7.1 symbols/min [2025-10-01T19:18:55.226159] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T19:18:55.307465] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-01T19:18:55.363129] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:18:55.367300] [DEBUG] [LOCAL ] GYLD: Loaded 1541 existing records from primary storage. [2025-10-01T19:18:55.367469] [INFO ] [MAIN ] GYLD: Loaded 1541 existing records. [2025-10-01T19:18:55.565474] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:18:55.565682] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-01T19:18:55.565741] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-01T19:18:55.565918] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-01T19:18:55.565976] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-01T19:18:55.966935] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:18:55.990540] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T19:18:56.102349] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-01T19:18:56.467743] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-01T19:18:56.499393] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T19:18:56.902394] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-01T19:18:57.702411] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-01T19:18:58.376024] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T19:18:58.502380] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-01T19:18:59.198001] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T19:18:59.302391] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-01T19:18:59.364521] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T19:19:00.102427] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-01T19:19:00.788324] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T19:19:00.902389] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-01T19:19:01.164231] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T19:19:01.702459] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-01T19:19:02.495712] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T19:19:02.513556] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-01T19:19:02.542046] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T19:19:03.302390] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-01T19:19:03.662445] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-01T19:19:04.102418] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-01T19:19:04.902428] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-01T19:19:05.202223] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T19:19:05.268716] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-01T19:19:05.587915] [DEBUG] [REMOTE ] GWRE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:19:05.588255] [WARN ] [REMOTE ] GWRE: No data returned for month 2025-10 [2025-10-01T19:19:05.588367] [FATAL] [REMOTE ] GWRE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:19:05.588502] [FATAL] [MAIN ] GWRE: Failed to fetch primary data. [2025-10-01T19:19:05.588593] [WARN ] [MAIN ] GWRE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:19:05.588715] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-01T19:19:05.588813] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-01T19:19:05.588869] [INFO ] [LOCAL ] GWRE: Starting deletion of derivative data. [2025-10-01T19:19:05.589214] [DEBUG] [LOCAL ] GWRE: Deleted derivative data file. [2025-10-01T19:19:05.589303] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWRE took 38.5s. Estimated remaining: 3h 15m 18s. Rate: 7.1 symbols/min [2025-10-01T19:19:05.707561] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-01T19:19:05.790810] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:19:05.839493] [DEBUG] [LOCAL ] H: Loaded 44651 existing records from primary storage. [2025-10-01T19:19:05.839867] [INFO ] [MAIN ] H: Loaded 44651 existing records. [2025-10-01T19:19:06.039428] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:19:06.039676] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-01T19:19:06.039739] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-01T19:19:06.039992] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-01T19:19:06.040052] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-01T19:19:06.492136] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:19:06.502419] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-01T19:19:06.810952] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T19:19:07.302437] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-01T19:19:08.102400] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-01T19:19:08.210167] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T19:19:08.657282] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-01T19:19:08.658348] [INFO ] [REMOTE ] GWW: Full fetch complete (29276 records). [2025-10-01T19:19:08.658423] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-01T19:19:08.912862] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-01T19:19:09.110175] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-01T19:19:09.110280] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-01T19:19:09.111002] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-01T19:19:09.111067] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-01T19:19:09.111977] [DEBUG] [LOCAL ] GWW: Trimmed 29276 records to 19477 (keeping 200 days of data) [2025-10-01T19:19:09.241008] [DEBUG] [LOCAL ] GWW: Primary data saved (19477 records). [2025-10-01T19:19:09.241154] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-01T19:19:09.241263] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWW took 28.2s. Estimated remaining: 3h 15m 3s. Rate: 7.1 symbols/min [2025-10-01T19:19:09.430349] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:19:09.472209] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T19:19:09.493738] [DEBUG] [LOCAL ] HAE: Loaded 39442 existing records from primary storage. [2025-10-01T19:19:09.494064] [INFO ] [MAIN ] HAE: Loaded 39442 existing records. [2025-10-01T19:19:09.690229] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:19:09.690516] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-01T19:19:09.690569] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-01T19:19:09.691018] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-01T19:19:09.691084] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-01T19:19:09.712735] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-01T19:19:10.085488] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:19:10.502399] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-01T19:19:10.620540] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T19:19:11.155629] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T19:19:11.176944] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T19:19:11.302400] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-01T19:19:12.102362] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-01T19:19:12.354196] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T19:19:12.421308] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-01T19:19:12.902375] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-01T19:19:13.702383] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-01T19:19:14.358705] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T19:19:14.502390] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-01T19:19:15.282002] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T19:19:15.302336] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-01T19:19:15.730950] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T19:19:16.102386] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-01T19:19:16.902375] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-01T19:19:16.942358] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T19:19:17.302967] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-01T19:19:17.702386] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-01T19:19:17.768524] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:19:17.985709] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-01T19:19:18.502357] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-01T19:19:19.302434] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-01T19:19:20.036003] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T19:19:20.102453] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-01T19:19:20.902350] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-01T19:19:20.934861] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T19:19:21.351112] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T19:19:21.702370] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-01T19:19:21.771780] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T19:19:22.139721] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-01T19:19:22.502387] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-01T19:19:23.302415] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-01T19:19:23.846948] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T19:19:24.102372] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-01T19:19:24.902378] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-01T19:19:25.033283] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:19:25.328029] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-01T19:19:25.459090] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T19:19:25.702399] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-01T19:19:26.502382] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-01T19:19:27.248230] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T19:19:27.302354] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-01T19:19:27.463807] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T19:19:28.102395] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-01T19:19:28.580424] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T19:19:28.902395] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-01T19:19:29.627069] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T19:19:29.702363] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-01T19:19:30.449740] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T19:19:30.502350] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-01T19:19:30.893585] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T19:19:31.302401] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-01T19:19:31.744096] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T19:19:32.102415] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-01T19:19:32.902387] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-01T19:19:33.702424] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-01T19:19:33.771462] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T19:19:34.238630] [DEBUG] [REMOTE ] HAE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:19:34.239000] [WARN ] [REMOTE ] HAE: No data returned for month 2025-10 [2025-10-01T19:19:34.239113] [FATAL] [REMOTE ] HAE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:19:34.239198] [FATAL] [MAIN ] HAE: Failed to fetch primary data. [2025-10-01T19:19:34.239261] [WARN ] [MAIN ] HAE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:19:34.239334] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-01T19:19:34.239398] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-01T19:19:34.239435] [INFO ] [LOCAL ] HAE: Starting deletion of derivative data. [2025-10-01T19:19:34.239833] [DEBUG] [LOCAL ] HAE: Deleted derivative data file. [2025-10-01T19:19:34.239949] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. HAE took 25.0s. Estimated remaining: 3h 15m 17s. Rate: 7.1 symbols/min [2025-10-01T19:19:34.438826] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:19:34.488749] [DEBUG] [LOCAL ] HAFN: Loaded 43295 existing records from primary storage. [2025-10-01T19:19:34.489075] [INFO ] [MAIN ] HAFN: Loaded 43295 existing records. [2025-10-01T19:19:34.523237] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-01T19:19:34.682775] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:19:34.682989] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-01T19:19:34.683037] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-01T19:19:34.683274] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-01T19:19:34.683333] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-01T19:19:35.063941] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:19:35.302390] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-01T19:19:35.813360] [DEBUG] [REMOTE ] GXO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:19:35.813699] [WARN ] [REMOTE ] GXO: No data returned for month 2025-10 [2025-10-01T19:19:35.813788] [FATAL] [REMOTE ] GXO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:19:35.813911] [FATAL] [MAIN ] GXO: Failed to fetch primary data. [2025-10-01T19:19:35.813982] [WARN ] [MAIN ] GXO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:19:35.814052] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-01T19:19:35.814116] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-01T19:19:35.814153] [INFO ] [LOCAL ] GXO: Starting deletion of derivative data. [2025-10-01T19:19:35.814413] [DEBUG] [LOCAL ] GXO: Deleted derivative data file. [2025-10-01T19:19:35.814514] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 46.9s. Estimated remaining: 3h 14m 59s. Rate: 7.1 symbols/min [2025-10-01T19:19:36.001998] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:19:36.041823] [DEBUG] [REMOTE ] GYLD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:19:36.056938] [WARN ] [REMOTE ] GYLD: No data returned for month 2025-10 [2025-10-01T19:19:36.057130] [FATAL] [REMOTE ] GYLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:19:36.057408] [FATAL] [MAIN ] GYLD: Failed to fetch primary data. [2025-10-01T19:19:36.058529] [WARN ] [MAIN ] GYLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:19:36.058429] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-01T19:19:36.058794] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-01T19:19:36.058922] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-01T19:19:36.059012] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-01T19:19:36.059111] [INFO ] [LOCAL ] GYLD: Starting deletion of derivative data. [2025-10-01T19:19:36.106875] [DEBUG] [LOCAL ] GYLD: Deleted derivative data file. [2025-10-01T19:19:36.129166] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GYLD took 41.0s. Estimated remaining: 3h 14m 40s. Rate: 7.1 symbols/min [2025-10-01T19:19:36.385781] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:19:36.386283] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-01T19:19:36.386371] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-01T19:19:36.392352] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-01T19:19:36.408023] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-01T19:19:36.470912] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:19:36.609864] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T19:19:36.651636] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-01T19:19:36.911022] [DEBUG] [LOCAL ] HASI: Loaded 47161 existing records from primary storage. [2025-10-01T19:19:36.926905] [INFO ] [MAIN ] HASI: Loaded 47161 existing records. [2025-10-01T19:19:37.074337] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:19:37.117926] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-01T19:19:37.207740] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:19:37.208222] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-01T19:19:37.208444] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-01T19:19:37.208755] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-01T19:19:37.208826] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-01T19:19:37.558409] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-01T19:19:37.649059] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:19:37.702400] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-01T19:19:37.930254] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T19:19:38.502447] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-01T19:19:39.223216] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T19:19:39.302395] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-01T19:19:39.466119] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T19:19:40.095996] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T19:19:40.102708] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-01T19:19:40.820961] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T19:19:40.902400] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-01T19:19:41.433009] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T19:19:41.702403] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-01T19:19:42.502397] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-01T19:19:43.313854] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-01T19:19:43.319358] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T19:19:43.835297] [DEBUG] [REMOTE ] H: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:19:43.835714] [WARN ] [REMOTE ] H: No data returned for month 2025-10 [2025-10-01T19:19:43.835851] [FATAL] [REMOTE ] H: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:19:43.835986] [FATAL] [MAIN ] H: Failed to fetch primary data. [2025-10-01T19:19:43.836075] [WARN ] [MAIN ] H: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:19:43.836169] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-01T19:19:43.836270] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-01T19:19:43.836344] [INFO ] [LOCAL ] H: Starting deletion of derivative data. [2025-10-01T19:19:43.836891] [DEBUG] [LOCAL ] H: Deleted derivative data file. [2025-10-01T19:19:43.837036] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 38.2s. Estimated remaining: 3h 14m 30s. Rate: 7.1 symbols/min [2025-10-01T19:19:44.019257] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:19:44.067440] [DEBUG] [LOCAL ] HAYW: Loaded 48728 existing records from primary storage. [2025-10-01T19:19:44.067830] [INFO ] [MAIN ] HAYW: Loaded 48728 existing records. [2025-10-01T19:19:44.111329] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-01T19:19:44.267713] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:19:44.267990] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-01T19:19:44.268096] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-01T19:19:44.268440] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-01T19:19:44.268561] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-01T19:19:44.603712] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-01T19:19:44.700983] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:19:44.902363] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-01T19:19:45.150362] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T19:19:45.527262] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T19:19:45.702363] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-01T19:19:46.251766] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T19:19:46.502388] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-01T19:19:47.123383] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T19:19:47.302393] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-01T19:19:48.102365] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-01T19:19:48.904980] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-01T19:19:48.910324] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-01T19:19:49.280250] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-01T19:19:49.573325] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T19:19:49.702380] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-01T19:19:50.136317] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T19:19:50.502377] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-01T19:19:50.988592] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T19:19:51.302374] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-01T19:19:51.920001] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:19:52.102387] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-01T19:19:52.415324] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T19:19:52.902375] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-01T19:19:53.702388] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-01T19:19:53.770222] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T19:19:54.460538] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T19:19:54.502439] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-01T19:19:55.302397] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-01T19:19:55.668839] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T19:19:56.058210] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T19:19:56.102339] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-01T19:19:56.902374] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-01T19:19:56.933751] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T19:19:57.691441] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T19:19:57.702593] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-01T19:19:58.509358] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-01T19:19:58.535869] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T19:19:59.217398] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T19:19:59.302413] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-01T19:20:00.107497] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-01T19:20:00.123060] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T19:20:00.902402] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-01T19:20:01.149388] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T19:20:01.702488] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-01T19:20:01.842204] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T19:20:02.502435] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-01T19:20:03.302446] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-01T19:20:03.456908] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:20:03.922972] [DEBUG] [REMOTE ] HAFN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:03.923276] [WARN ] [REMOTE ] HAFN: No data returned for month 2025-10 [2025-10-01T19:20:03.923369] [FATAL] [REMOTE ] HAFN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:03.923456] [FATAL] [MAIN ] HAFN: Failed to fetch primary data. [2025-10-01T19:20:03.923521] [WARN ] [MAIN ] HAFN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:03.923601] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-01T19:20:03.923741] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-01T19:20:03.923826] [INFO ] [LOCAL ] HAFN: Starting deletion of derivative data. [2025-10-01T19:20:03.924189] [DEBUG] [LOCAL ] HAFN: Deleted derivative data file. [2025-10-01T19:20:03.924292] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAFN took 29.7s. Estimated remaining: 3h 14m 38s. Rate: 7.1 symbols/min [2025-10-01T19:20:04.106319] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:04.106390] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-01T19:20:04.116967] [DEBUG] [LOCAL ] HBB: Loaded 6651 existing records from primary storage. [2025-10-01T19:20:04.117170] [INFO ] [MAIN ] HBB: Loaded 6651 existing records. [2025-10-01T19:20:04.329356] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:20:04.329691] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-01T19:20:04.329786] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-01T19:20:04.330007] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-01T19:20:04.330067] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-01T19:20:04.754902] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:20:04.786560] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-01T19:20:04.902402] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-01T19:20:05.702377] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-01T19:20:06.071513] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-01T19:20:06.473320] [DEBUG] [REMOTE ] HASI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:06.473628] [WARN ] [REMOTE ] HASI: No data returned for month 2025-10 [2025-10-01T19:20:06.473768] [FATAL] [REMOTE ] HASI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:06.473881] [FATAL] [MAIN ] HASI: Failed to fetch primary data. [2025-10-01T19:20:06.473951] [WARN ] [MAIN ] HASI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:06.474041] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-01T19:20:06.474128] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-01T19:20:06.474186] [INFO ] [LOCAL ] HASI: Starting deletion of derivative data. [2025-10-01T19:20:06.474461] [DEBUG] [LOCAL ] HASI: Deleted derivative data file. [2025-10-01T19:20:06.474548] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HASI took 30.3s. Estimated remaining: 3h 14m 21s. Rate: 7.1 symbols/min [2025-10-01T19:20:06.507009] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-01T19:20:06.551898] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T19:20:06.694375] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:06.743727] [DEBUG] [LOCAL ] HBI: Loaded 52992 existing records from primary storage. [2025-10-01T19:20:06.744177] [INFO ] [MAIN ] HBI: Loaded 52992 existing records. [2025-10-01T19:20:06.965990] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:20:06.976744] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-01T19:20:06.976922] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-01T19:20:06.977302] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-01T19:20:06.977670] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-01T19:20:06.979397] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-01T19:20:07.307529] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-01T19:20:07.381139] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:20:07.866980] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T19:20:07.985560] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T19:20:08.102384] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-01T19:20:08.902388] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-01T19:20:09.702420] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-01T19:20:09.794009] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T19:20:10.373412] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-01T19:20:10.449987] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T19:20:10.502355] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-01T19:20:11.302386] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-01T19:20:12.102363] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-01T19:20:12.200259] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T19:20:12.592160] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-01T19:20:12.902401] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-01T19:20:13.702394] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-01T19:20:13.830992] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T19:20:14.263459] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T19:20:14.502392] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-01T19:20:15.302448] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-01T19:20:15.318088] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T19:20:16.102430] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-01T19:20:16.907636] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-01T19:20:16.913313] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T19:20:16.935440] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T19:20:17.065283] [DEBUG] [REMOTE ] HAL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:17.065610] [WARN ] [REMOTE ] HAL: No data returned for month 2025-10 [2025-10-01T19:20:17.065724] [FATAL] [REMOTE ] HAL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:17.065812] [FATAL] [MAIN ] HAL: Failed to fetch primary data. [2025-10-01T19:20:17.065875] [WARN ] [MAIN ] HAL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:17.065948] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-01T19:20:17.066011] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-01T19:20:17.066048] [INFO ] [LOCAL ] HAL: Starting deletion of derivative data. [2025-10-01T19:20:17.066335] [DEBUG] [LOCAL ] HAL: Deleted derivative data file. [2025-10-01T19:20:17.066422] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 41.3s. Estimated remaining: 3h 14m 16s. Rate: 7.1 symbols/min [2025-10-01T19:20:17.254243] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:17.304054] [DEBUG] [LOCAL ] HBM: Loaded 52903 existing records from primary storage. [2025-10-01T19:20:17.304389] [INFO ] [MAIN ] HBM: Loaded 52903 existing records. [2025-10-01T19:20:17.507513] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:20:17.507812] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-01T19:20:17.507876] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-01T19:20:17.508135] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-01T19:20:17.508199] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-01T19:20:17.705292] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-01T19:20:17.911082] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:20:18.502737] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-01T19:20:18.510356] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T19:20:19.139240] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T19:20:19.302357] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-01T19:20:19.489282] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T19:20:20.102419] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-01T19:20:20.902435] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-01T19:20:21.063495] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T19:20:21.585562] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T19:20:21.702412] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-01T19:20:21.822811] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T19:20:22.376527] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T19:20:22.502451] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-01T19:20:23.302396] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-01T19:20:23.987231] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T19:20:24.102412] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-01T19:20:24.684019] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-01T19:20:24.902406] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-01T19:20:25.702437] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-01T19:20:26.368203] [DEBUG] [REMOTE ] HAYW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:26.368570] [WARN ] [REMOTE ] HAYW: No data returned for month 2025-10 [2025-10-01T19:20:26.368762] [FATAL] [REMOTE ] HAYW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:26.368883] [FATAL] [MAIN ] HAYW: Failed to fetch primary data. [2025-10-01T19:20:26.368971] [WARN ] [MAIN ] HAYW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:26.369084] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-01T19:20:26.369164] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-01T19:20:26.369203] [INFO ] [LOCAL ] HAYW: Starting deletion of derivative data. [2025-10-01T19:20:26.369700] [DEBUG] [LOCAL ] HAYW: Deleted derivative data file. [2025-10-01T19:20:26.369808] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HAYW took 42.5s. Estimated remaining: 3h 14m 8s. Rate: 7.1 symbols/min [2025-10-01T19:20:26.507530] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-01T19:20:26.560406] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:26.604008] [DEBUG] [LOCAL ] HCA: Loaded 46952 existing records from primary storage. [2025-10-01T19:20:26.604323] [INFO ] [MAIN ] HCA: Loaded 46952 existing records. [2025-10-01T19:20:26.797099] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:20:26.797378] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-01T19:20:26.797436] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-01T19:20:26.797726] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-01T19:20:26.797814] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-01T19:20:27.222815] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:20:27.300421] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:20:27.311515] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-01T19:20:27.411789] [DEBUG] [REMOTE ] HBB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:27.412141] [WARN ] [REMOTE ] HBB: No data returned for month 2025-10 [2025-10-01T19:20:27.412241] [FATAL] [REMOTE ] HBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:27.412340] [FATAL] [MAIN ] HBB: Failed to fetch primary data. [2025-10-01T19:20:27.412426] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:27.412511] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-01T19:20:27.412630] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-01T19:20:27.412744] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-10-01T19:20:27.413165] [DEBUG] [LOCAL ] HBB: Deleted derivative data file. [2025-10-01T19:20:27.413283] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HBB took 23.5s. Estimated remaining: 3h 13m 50s. Rate: 7.1 symbols/min [2025-10-01T19:20:27.621356] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:27.663797] [DEBUG] [LOCAL ] HCC: Loaded 45344 existing records from primary storage. [2025-10-01T19:20:27.664150] [INFO ] [MAIN ] HCC: Loaded 45344 existing records. [2025-10-01T19:20:27.860369] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:20:27.860950] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-01T19:20:27.861039] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-01T19:20:27.861451] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-01T19:20:27.861535] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-01T19:20:28.103815] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-01T19:20:28.304003] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T19:20:28.312925] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:20:28.902416] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-01T19:20:28.995156] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T19:20:29.709178] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-01T19:20:29.715577] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T19:20:30.502409] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-01T19:20:30.752780] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T19:20:31.302355] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-01T19:20:31.441313] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T19:20:32.026593] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T19:20:32.102429] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-01T19:20:32.690838] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T19:20:32.902419] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-01T19:20:33.702378] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-01T19:20:33.856937] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:20:34.502424] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-01T19:20:34.746068] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T19:20:35.244866] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T19:20:35.302380] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-01T19:20:36.102394] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-01T19:20:36.334145] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T19:20:36.902372] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-01T19:20:37.052119] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T19:20:37.652368] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T19:20:37.702400] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-01T19:20:38.502378] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-01T19:20:38.563921] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T19:20:39.230834] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T19:20:39.302409] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-01T19:20:39.949710] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T19:20:40.102388] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-01T19:20:40.902384] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-01T19:20:41.380981] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-01T19:20:41.702376] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-01T19:20:41.842803] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T19:20:42.218838] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T19:20:42.502395] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-01T19:20:43.302378] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-01T19:20:43.619857] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T19:20:44.102392] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-01T19:20:44.171451] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T19:20:44.483411] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T19:20:44.902418] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-01T19:20:45.702376] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-01T19:20:46.410099] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T19:20:46.502379] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-01T19:20:47.202449] [DEBUG] [REMOTE ] HBI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:47.202811] [WARN ] [REMOTE ] HBI: No data returned for month 2025-10 [2025-10-01T19:20:47.202914] [FATAL] [REMOTE ] HBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:47.203002] [FATAL] [MAIN ] HBI: Failed to fetch primary data. [2025-10-01T19:20:47.203070] [WARN ] [MAIN ] HBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:47.203176] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-01T19:20:47.203273] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-01T19:20:47.203339] [INFO ] [LOCAL ] HBI: Starting deletion of derivative data. [2025-10-01T19:20:47.203787] [DEBUG] [LOCAL ] HBI: Deleted derivative data file. [2025-10-01T19:20:47.203884] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HBI took 40.7s. Estimated remaining: 3h 13m 57s. Rate: 7.1 symbols/min [2025-10-01T19:20:47.303322] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-01T19:20:47.306160] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T19:20:48.102387] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-01T19:20:48.287429] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T19:20:48.784701] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T19:20:48.902378] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-01T19:20:49.660894] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T19:20:49.702341] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-01T19:20:50.502396] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-01T19:20:51.384871] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:20:51.395562] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-01T19:20:51.859099] [DEBUG] [REMOTE ] HBM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:51.859424] [WARN ] [REMOTE ] HBM: No data returned for month 2025-10 [2025-10-01T19:20:51.859582] [FATAL] [REMOTE ] HBM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:51.859729] [FATAL] [MAIN ] HBM: Failed to fetch primary data. [2025-10-01T19:20:51.859813] [WARN ] [MAIN ] HBM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:51.859889] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-01T19:20:51.859956] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-01T19:20:51.859993] [INFO ] [LOCAL ] HBM: Starting deletion of derivative data. [2025-10-01T19:20:51.860564] [DEBUG] [LOCAL ] HBM: Deleted derivative data file. [2025-10-01T19:20:51.860689] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBM took 34.8s. Estimated remaining: 3h 13m 43s. Rate: 7.1 symbols/min [2025-10-01T19:20:52.258245] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T19:20:52.270610] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-01T19:20:52.482128] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T19:20:52.902422] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-01T19:20:53.810853] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T19:20:53.820903] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-01T19:20:53.884937] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T19:20:54.502432] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-01T19:20:55.543321] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T19:20:55.553929] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-01T19:20:57.510395] [DEBUG] [REMOTE ] HCC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:57.510772] [WARN ] [REMOTE ] HCC: No data returned for month 2025-10 [2025-10-01T19:20:57.510885] [FATAL] [REMOTE ] HCC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:57.511011] [FATAL] [MAIN ] HCC: Failed to fetch primary data. [2025-10-01T19:20:57.511084] [WARN ] [MAIN ] HCC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:57.511156] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-01T19:20:57.511239] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-01T19:20:57.511297] [INFO ] [LOCAL ] HCC: Starting deletion of derivative data. [2025-10-01T19:20:57.511846] [DEBUG] [LOCAL ] HCC: Deleted derivative data file. [2025-10-01T19:20:57.511950] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HCC took 30.1s. Estimated remaining: 3h 13m 31s. Rate: 7.1 symbols/min [2025-10-01T19:20:58.564605] [DEBUG] [REMOTE ] HCA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:20:58.564994] [WARN ] [REMOTE ] HCA: No data returned for month 2025-10 [2025-10-01T19:20:58.565088] [FATAL] [REMOTE ] HCA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:20:58.565173] [FATAL] [MAIN ] HCA: Failed to fetch primary data. [2025-10-01T19:20:58.565239] [WARN ] [MAIN ] HCA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:20:58.565309] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-01T19:20:58.565374] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-01T19:20:58.565412] [INFO ] [LOCAL ] HCA: Starting deletion of derivative data. [2025-10-01T19:20:58.565722] [DEBUG] [LOCAL ] HCA: Deleted derivative data file. [2025-10-01T19:20:58.565869] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 32.2s. Estimated remaining: 3h 13m 12s. Rate: 7.1 symbols/min [2025-10-01T19:20:59.338886] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:59.392988] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:59.419800] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:59.391274] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:20:59.420445] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-01T19:20:59.420530] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-01T19:20:59.420717] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-01T19:20:59.420896] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-01T19:20:59.421002] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-01T19:20:59.421083] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-01T19:20:59.595581] [DEBUG] [LOCAL ] HCI: Loaded 13987 existing records from primary storage. [2025-10-01T19:20:59.613323] [INFO ] [MAIN ] HCI: Loaded 13987 existing records. [2025-10-01T19:20:59.941968] [DEBUG] [LOCAL ] HDB: Loaded 51926 existing records from primary storage. [2025-10-01T19:21:00.018241] [INFO ] [MAIN ] HDB: Loaded 51926 existing records. [2025-10-01T19:21:00.077059] [DEBUG] [LOCAL ] HD: Loaded 53497 existing records from primary storage. [2025-10-01T19:21:00.161201] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:00.197963] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-01T19:21:00.161495] [INFO ] [MAIN ] HD: Loaded 53497 existing records. [2025-10-01T19:21:00.221800] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:21:00.262931] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-01T19:21:00.298254] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-01T19:21:00.365504] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-01T19:21:00.433146] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-01T19:21:00.503783] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:21:00.545420] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-01T19:21:00.569119] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-01T19:21:00.657447] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-01T19:21:00.690841] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-01T19:21:00.694229] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-01T19:21:00.717588] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:21:00.734705] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-01T19:21:00.796874] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-01T19:21:00.809095] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-01T19:21:00.876713] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-01T19:21:00.932730] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-01T19:21:01.210747] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T19:21:01.223084] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-01T19:21:01.479401] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:01.510272] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-01T19:21:01.760985] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T19:21:01.782979] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-01T19:21:01.874981] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:01.875780] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-01T19:21:01.978410] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:01.978931] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-01T19:21:02.152084] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T19:21:02.153697] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-01T19:21:02.401961] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-01T19:21:02.502456] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-01T19:21:02.671576] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T19:21:02.755851] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-01T19:21:03.302417] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-01T19:21:03.622563] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T19:21:03.636777] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-01T19:21:03.745628] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T19:21:04.102413] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-01T19:21:04.355367] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-01T19:21:04.902444] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-01T19:21:05.706410] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-01T19:21:05.709475] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:21:06.502412] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-01T19:21:07.248565] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T19:21:07.302412] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-01T19:21:07.397064] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T19:21:07.608823] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-01T19:21:08.102425] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-01T19:21:08.902393] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-01T19:21:09.002009] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T19:21:09.702410] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-01T19:21:10.502391] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-01T19:21:10.564804] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T19:21:11.079191] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T19:21:11.302431] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-01T19:21:11.669541] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-01T19:21:12.102424] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-01T19:21:12.902366] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-01T19:21:13.036178] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T19:21:13.064421] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T19:21:13.151013] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-01T19:21:13.702370] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-01T19:21:14.502415] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-01T19:21:14.691951] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T19:21:15.302431] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-01T19:21:16.102382] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-01T19:21:16.319684] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T19:21:16.773821] [DEBUG] [REMOTE ] HCXY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:21:16.774200] [WARN ] [REMOTE ] HCXY: No data returned for month 2025-10 [2025-10-01T19:21:16.774331] [FATAL] [REMOTE ] HCXY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:21:16.774450] [FATAL] [MAIN ] HCXY: Failed to fetch primary data. [2025-10-01T19:21:16.774535] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:21:16.774623] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-01T19:21:16.774741] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-01T19:21:16.774830] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-01T19:21:16.774929] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-01T19:21:16.775026] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 18.2s. Estimated remaining: 3h 13m 17s. Rate: 7.1 symbols/min [2025-10-01T19:21:16.907496] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-01T19:21:16.999834] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:21:17.053801] [DEBUG] [LOCAL ] HE: Loaded 49067 existing records from primary storage. [2025-10-01T19:21:17.054133] [INFO ] [MAIN ] HE: Loaded 49067 existing records. [2025-10-01T19:21:17.250927] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:21:17.251169] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-01T19:21:17.251225] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-01T19:21:17.251458] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-01T19:21:17.251518] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-01T19:21:17.643116] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:17.702366] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-01T19:21:18.502395] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-01T19:21:18.543975] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-01T19:21:18.885418] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T19:21:19.302420] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-01T19:21:19.521781] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T19:21:19.677865] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T19:21:20.102439] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-01T19:21:20.780810] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T19:21:20.902456] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-01T19:21:20.915360] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T19:21:21.702419] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-01T19:21:22.502385] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-01T19:21:22.547122] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T19:21:23.302435] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-01T19:21:23.699134] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T19:21:24.102395] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-01T19:21:24.360451] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T19:21:24.695609] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T19:21:24.902405] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-01T19:21:25.702447] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-01T19:21:26.213552] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-01T19:21:26.502429] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-01T19:21:27.302400] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-01T19:21:27.382751] [DEBUG] [REMOTE ] HCI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:21:27.398613] [WARN ] [REMOTE ] HCI: No data returned for month 2025-10 [2025-10-01T19:21:27.399144] [FATAL] [REMOTE ] HCI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:21:27.401771] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T19:21:27.401901] [FATAL] [MAIN ] HCI: Failed to fetch primary data. [2025-10-01T19:21:27.402074] [WARN ] [MAIN ] HCI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:21:27.413939] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-01T19:21:27.414109] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-01T19:21:27.414165] [INFO ] [LOCAL ] HCI: Starting deletion of derivative data. [2025-10-01T19:21:27.414920] [DEBUG] [LOCAL ] HCI: Deleted derivative data file. [2025-10-01T19:21:27.415045] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 28.8s. Estimated remaining: 3h 13m 11s. Rate: 7.1 symbols/min [2025-10-01T19:21:27.614199] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:21:27.652749] [DEBUG] [LOCAL ] HEI: Loaded 32152 existing records from primary storage. [2025-10-01T19:21:27.653053] [INFO ] [MAIN ] HEI: Loaded 32152 existing records. [2025-10-01T19:21:27.851458] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:21:27.851695] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-01T19:21:27.851770] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-01T19:21:27.852152] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-01T19:21:27.852215] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-01T19:21:28.115936] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-01T19:21:28.258008] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:28.659095] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-01T19:21:28.835549] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T19:21:28.902372] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-01T19:21:29.477468] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T19:21:29.702395] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-01T19:21:30.139267] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T19:21:30.502444] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-01T19:21:31.302417] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-01T19:21:31.624989] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T19:21:32.102427] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-01T19:21:32.649503] [DEBUG] [REMOTE ] HDB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:21:32.650009] [WARN ] [REMOTE ] HDB: No data returned for month 2025-10 [2025-10-01T19:21:32.650114] [FATAL] [REMOTE ] HDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:21:32.650411] [FATAL] [MAIN ] HDB: Failed to fetch primary data. [2025-10-01T19:21:32.650476] [WARN ] [MAIN ] HDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:21:32.650550] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-01T19:21:32.650622] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-01T19:21:32.650696] [INFO ] [LOCAL ] HDB: Starting deletion of derivative data. [2025-10-01T19:21:32.651283] [DEBUG] [LOCAL ] HDB: Deleted derivative data file. [2025-10-01T19:21:32.651594] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HDB took 34.1s. Estimated remaining: 3h 12m 59s. Rate: 7.1 symbols/min [2025-10-01T19:21:32.846228] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:21:32.854739] [DEBUG] [LOCAL ] HEQ: Loaded 6231 existing records from primary storage. [2025-10-01T19:21:32.854927] [INFO ] [MAIN ] HEQ: Loaded 6231 existing records. [2025-10-01T19:21:32.914560] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-01T19:21:33.054547] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:21:33.055110] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-01T19:21:33.055197] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-01T19:21:33.055401] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-01T19:21:33.055465] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-01T19:21:33.486495] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:33.523563] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T19:21:33.559285] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-01T19:21:33.702432] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-01T19:21:34.502358] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-01T19:21:34.873362] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T19:21:35.097933] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T19:21:35.302407] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-01T19:21:35.976358] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-01T19:21:35.995758] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T19:21:36.102414] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-01T19:21:36.902400] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-01T19:21:37.702391] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-01T19:21:38.246770] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-01T19:21:38.304176] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T19:21:38.502408] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-01T19:21:39.245812] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:21:39.302402] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-01T19:21:39.499886] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T19:21:39.885750] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T19:21:40.102383] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-01T19:21:40.902428] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-01T19:21:41.618812] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T19:21:41.702374] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-01T19:21:42.415704] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T19:21:42.447054] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T19:21:42.502393] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-01T19:21:43.302394] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-01T19:21:44.087271] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T19:21:44.102332] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-01T19:21:44.902377] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-01T19:21:45.418115] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-01T19:21:45.450994] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T19:21:45.466819] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-01T19:21:45.702366] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-01T19:21:46.502385] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-01T19:21:47.068422] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T19:21:47.094626] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T19:21:47.302385] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-01T19:21:48.102378] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-01T19:21:48.691535] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T19:21:48.729005] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T19:21:48.902386] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-01T19:21:49.702362] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-01T19:21:50.129823] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T19:21:50.502381] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-01T19:21:51.302402] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-01T19:21:51.381462] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:21:52.102393] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-01T19:21:52.902416] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-01T19:21:53.225699] [DEBUG] [REMOTE ] HEI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:21:53.226095] [WARN ] [REMOTE ] HEI: No data returned for month 2025-10 [2025-10-01T19:21:53.226186] [FATAL] [REMOTE ] HEI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:21:53.226267] [FATAL] [MAIN ] HEI: Failed to fetch primary data. [2025-10-01T19:21:53.226330] [WARN ] [MAIN ] HEI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:21:53.226402] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-01T19:21:53.226467] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-01T19:21:53.226502] [INFO ] [LOCAL ] HEI: Starting deletion of derivative data. [2025-10-01T19:21:53.226934] [DEBUG] [LOCAL ] HEI: Deleted derivative data file. [2025-10-01T19:21:53.227021] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HEI took 25.8s. Estimated remaining: 3h 13m 7s. Rate: 7.1 symbols/min [2025-10-01T19:21:53.425533] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:21:53.476839] [DEBUG] [LOCAL ] HESM: Loaded 48247 existing records from primary storage. [2025-10-01T19:21:53.477188] [INFO ] [MAIN ] HESM: Loaded 48247 existing records. [2025-10-01T19:21:53.567979] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T19:21:53.699799] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:21:53.700093] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-01T19:21:53.700169] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-01T19:21:53.700725] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-01T19:21:53.700828] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-01T19:21:53.706074] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-01T19:21:53.879935] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T19:21:54.175985] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:54.348138] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-01T19:21:54.502397] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-01T19:21:54.676302] [DEBUG] [REMOTE ] HD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:21:54.676702] [WARN ] [REMOTE ] HD: No data returned for month 2025-10 [2025-10-01T19:21:54.676813] [FATAL] [REMOTE ] HD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:21:54.676903] [FATAL] [MAIN ] HD: Failed to fetch primary data. [2025-10-01T19:21:54.676982] [WARN ] [MAIN ] HD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:21:54.677068] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-01T19:21:54.677149] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-01T19:21:54.677191] [INFO ] [LOCAL ] HD: Starting deletion of derivative data. [2025-10-01T19:21:54.677586] [DEBUG] [LOCAL ] HD: Deleted derivative data file. [2025-10-01T19:21:54.677718] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HD took 56.1s. Estimated remaining: 3h 12m 49s. Rate: 7.1 symbols/min [2025-10-01T19:21:54.966352] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:21:54.966664] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-01T19:21:54.966733] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-01T19:21:54.966879] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-01T19:21:54.967447] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-01T19:21:54.967542] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-01T19:21:54.967614] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-01T19:21:55.307611] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-01T19:21:55.548713] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:21:56.028511] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T19:21:56.102412] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-01T19:21:56.174180] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T19:21:56.902413] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-01T19:21:57.702416] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-01T19:21:57.860186] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T19:21:58.498822] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T19:21:58.507545] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-01T19:21:59.302382] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-01T19:21:59.792242] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-01T19:22:00.102441] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-01T19:22:00.138965] [DEBUG] [REMOTE ] HEQ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:22:00.139324] [WARN ] [REMOTE ] HEQ: No data returned for month 2025-10 [2025-10-01T19:22:00.139423] [FATAL] [REMOTE ] HEQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:22:00.139504] [FATAL] [MAIN ] HEQ: Failed to fetch primary data. [2025-10-01T19:22:00.139569] [WARN ] [MAIN ] HEQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:22:00.139665] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-01T19:22:00.139749] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-01T19:22:00.139829] [INFO ] [LOCAL ] HEQ: Starting deletion of derivative data. [2025-10-01T19:22:00.140296] [DEBUG] [LOCAL ] HEQ: Deleted derivative data file. [2025-10-01T19:22:00.140386] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 27.5s. Estimated remaining: 3h 12m 36s. Rate: 7.1 symbols/min [2025-10-01T19:22:00.328166] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:22:00.328339] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-01T19:22:00.328378] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-01T19:22:00.328493] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-01T19:22:00.328535] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-01T19:22:00.328578] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-01T19:22:00.328613] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-01T19:22:00.717497] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:22:00.902389] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-01T19:22:01.156084] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-01T19:22:01.702407] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-01T19:22:01.775861] [DEBUG] [REMOTE ] HE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:22:01.776273] [WARN ] [REMOTE ] HE: No data returned for month 2025-10 [2025-10-01T19:22:01.776390] [FATAL] [REMOTE ] HE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:22:01.776502] [FATAL] [MAIN ] HE: Failed to fetch primary data. [2025-10-01T19:22:01.776556] [WARN ] [MAIN ] HE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:22:01.776622] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-01T19:22:01.776745] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-01T19:22:01.776790] [INFO ] [LOCAL ] HE: Starting deletion of derivative data. [2025-10-01T19:22:01.778273] [DEBUG] [LOCAL ] HE: Deleted derivative data file. [2025-10-01T19:22:01.778367] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 45.0s. Estimated remaining: 3h 12m 18s. Rate: 7.1 symbols/min [2025-10-01T19:22:02.012999] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:22:02.041373] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-01T19:22:02.066274] [DEBUG] [LOCAL ] HFRO: Loaded 17720 existing records from primary storage. [2025-10-01T19:22:02.066548] [INFO ] [MAIN ] HFRO: Loaded 17720 existing records. [2025-10-01T19:22:02.166313] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-01T19:22:02.291731] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:22:02.291968] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-01T19:22:02.292042] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-01T19:22:02.292311] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-01T19:22:02.292372] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-01T19:22:02.506337] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-01T19:22:02.727269] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:22:03.302437] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-01T19:22:03.712298] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T19:22:04.102370] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-01T19:22:04.286389] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T19:22:04.622601] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T19:22:04.902411] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-01T19:22:05.161511] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-01T19:22:05.702393] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-01T19:22:06.502423] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-01T19:22:06.788684] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-01T19:22:07.159197] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T19:22:07.302420] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-01T19:22:08.102433] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-01T19:22:08.335056] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-01T19:22:08.861462] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T19:22:08.902391] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-01T19:22:09.702467] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-01T19:22:10.188829] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T19:22:10.502407] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-01T19:22:10.740916] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-01T19:22:11.108893] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T19:22:11.302395] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-01T19:22:11.546875] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-01T19:22:12.102397] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-01T19:22:12.376835] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-01T19:22:12.902414] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-01T19:22:13.702398] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-01T19:22:13.995240] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T19:22:14.502385] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-01T19:22:14.916749] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T19:22:15.302363] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-01T19:22:15.420384] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T19:22:15.574797] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-01T19:22:16.102438] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-01T19:22:16.902366] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-01T19:22:17.129093] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-01T19:22:17.602681] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T19:22:17.702452] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-01T19:22:18.502365] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-01T19:22:18.799846] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T19:22:19.302387] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-01T19:22:19.716363] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-01T19:22:20.102393] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-01T19:22:20.759423] [DEBUG] [REMOTE ] HF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:22:20.759819] [WARN ] [REMOTE ] HF: No data returned for month 2025-10 [2025-10-01T19:22:20.759918] [FATAL] [REMOTE ] HF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:22:20.760002] [FATAL] [MAIN ] HF: Failed to fetch primary data. [2025-10-01T19:22:20.760068] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:22:20.760144] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-01T19:22:20.760263] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-01T19:22:20.760328] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-01T19:22:20.760406] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-01T19:22:20.760479] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HF took 26.1s. Estimated remaining: 3h 12m 24s. Rate: 7.1 symbols/min [2025-10-01T19:22:20.907484] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-01T19:22:20.959045] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:22:20.977502] [DEBUG] [LOCAL ] HGER: Loaded 13442 existing records from primary storage. [2025-10-01T19:22:20.977907] [INFO ] [MAIN ] HGER: Loaded 13442 existing records. [2025-10-01T19:22:21.179819] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:22:21.180057] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-01T19:22:21.180107] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-01T19:22:21.180409] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-01T19:22:21.180473] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-01T19:22:21.308691] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-01T19:22:21.607957] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:22:21.702379] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-01T19:22:21.861688] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T19:22:22.030619] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-01T19:22:22.502442] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-01T19:22:22.835458] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-01T19:22:23.302430] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-01T19:22:24.102366] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-01T19:22:24.528125] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T19:22:24.592506] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T19:22:24.902378] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-01T19:22:25.702425] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-01T19:22:25.810034] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T19:22:26.502418] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-01T19:22:27.221543] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T19:22:27.302405] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-01T19:22:27.736744] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-01T19:22:28.102393] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-01T19:22:28.796129] [DEBUG] [REMOTE ] HESM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:22:28.796469] [WARN ] [REMOTE ] HESM: No data returned for month 2025-10 [2025-10-01T19:22:28.796566] [FATAL] [REMOTE ] HESM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:22:28.796677] [FATAL] [MAIN ] HESM: Failed to fetch primary data. [2025-10-01T19:22:28.796763] [WARN ] [MAIN ] HESM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:22:28.796838] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-01T19:22:28.796927] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-01T19:22:28.796987] [INFO ] [LOCAL ] HESM: Starting deletion of derivative data. [2025-10-01T19:22:28.797292] [DEBUG] [LOCAL ] HESM: Deleted derivative data file. [2025-10-01T19:22:28.797388] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HESM took 35.6s. Estimated remaining: 3h 12m 15s. Rate: 7.1 symbols/min [2025-10-01T19:22:28.910174] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-01T19:22:29.004337] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:22:29.016029] [DEBUG] [LOCAL ] HGLB: Loaded 9473 existing records from primary storage. [2025-10-01T19:22:29.016289] [INFO ] [MAIN ] HGLB: Loaded 9473 existing records. [2025-10-01T19:22:29.209134] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:22:29.209384] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-01T19:22:29.209444] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-01T19:22:29.209669] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-01T19:22:29.209732] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-01T19:22:29.634707] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:22:29.702408] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-01T19:22:29.818953] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-01T19:22:30.432304] [DEBUG] [REMOTE ] HFND: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:22:30.432636] [WARN ] [REMOTE ] HFND: No data returned for month 2025-10 [2025-10-01T19:22:30.432776] [FATAL] [REMOTE ] HFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:22:30.432901] [FATAL] [MAIN ] HFND: Failed to fetch primary data. [2025-10-01T19:22:30.432990] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:22:30.433088] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-01T19:22:30.433175] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-01T19:22:30.433213] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-01T19:22:30.433256] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-01T19:22:30.433304] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HFND took 30.3s. Estimated remaining: 3h 11m 57s. Rate: 7.1 symbols/min [2025-10-01T19:22:30.503104] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-01T19:22:30.613874] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T19:22:30.652193] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:22:30.666921] [DEBUG] [LOCAL ] HGTY: Loaded 13203 existing records from primary storage. [2025-10-01T19:22:30.667163] [INFO ] [MAIN ] HGTY: Loaded 13203 existing records. [2025-10-01T19:22:30.868796] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:22:30.869039] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-01T19:22:30.869101] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-01T19:22:30.869315] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-01T19:22:30.869376] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-01T19:22:31.307519] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-01T19:22:31.355134] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:22:31.505625] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T19:22:32.046506] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T19:22:32.102390] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-01T19:22:32.902382] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-01T19:22:33.096078] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T19:22:33.690121] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T19:22:33.702344] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-01T19:22:34.152895] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T19:22:34.502420] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-01T19:22:35.302384] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-01T19:22:35.483085] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T19:22:36.098207] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T19:22:36.102325] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-01T19:22:36.684587] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-01T19:22:36.902394] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-01T19:22:37.580351] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T19:22:37.702391] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-01T19:22:38.479315] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T19:22:38.502423] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-01T19:22:39.206497] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T19:22:39.302391] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-01T19:22:39.780824] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T19:22:40.102373] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-01T19:22:40.663086] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-01T19:22:40.902382] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-01T19:22:41.633220] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T19:22:41.702387] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-01T19:22:42.502357] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-01T19:22:42.585754] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T19:22:43.302385] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-01T19:22:43.446564] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-01T19:22:44.052633] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-01T19:22:44.102383] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-01T19:22:44.902396] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-01T19:22:45.163413] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T19:22:45.473929] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T19:22:45.702417] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-01T19:22:46.506500] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-01T19:22:46.511394] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T19:22:47.302451] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-01T19:22:48.019446] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T19:22:48.102427] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-01T19:22:48.890398] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T19:22:48.902348] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-01T19:22:49.089324] [DEBUG] [REMOTE ] HFRO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:22:49.089714] [WARN ] [REMOTE ] HFRO: No data returned for month 2025-10 [2025-10-01T19:22:49.089811] [FATAL] [REMOTE ] HFRO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:22:49.089917] [FATAL] [MAIN ] HFRO: Failed to fetch primary data. [2025-10-01T19:22:49.089989] [WARN ] [MAIN ] HFRO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:22:49.090062] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-01T19:22:49.090128] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-01T19:22:49.090167] [INFO ] [LOCAL ] HFRO: Starting deletion of derivative data. [2025-10-01T19:22:49.090543] [DEBUG] [LOCAL ] HFRO: Deleted derivative data file. [2025-10-01T19:22:49.090683] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFRO took 47.3s. Estimated remaining: 3h 12m 3s. Rate: 7.1 symbols/min [2025-10-01T19:22:49.286089] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:22:49.335588] [DEBUG] [LOCAL ] HGV: Loaded 46608 existing records from primary storage. [2025-10-01T19:22:49.336055] [INFO ] [MAIN ] HGV: Loaded 46608 existing records. [2025-10-01T19:22:49.548128] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T19:22:49.554282] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:22:49.557480] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-01T19:22:49.557542] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-01T19:22:49.558054] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-01T19:22:49.558116] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-01T19:22:49.712464] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-01T19:22:49.988753] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:22:50.359491] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T19:22:50.502426] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-01T19:22:51.302414] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-01T19:22:52.102396] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-01T19:22:52.902426] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-01T19:22:52.917292] [DEBUG] [REMOTE ] HGLB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:22:52.917636] [WARN ] [REMOTE ] HGLB: No data returned for month 2025-10 [2025-10-01T19:22:52.917764] [FATAL] [REMOTE ] HGLB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:22:52.917891] [FATAL] [MAIN ] HGLB: Failed to fetch primary data. [2025-10-01T19:22:52.917964] [WARN ] [MAIN ] HGLB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:22:52.918055] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-01T19:22:52.918184] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-01T19:22:52.918246] [INFO ] [LOCAL ] HGLB: Starting deletion of derivative data. [2025-10-01T19:22:52.918687] [DEBUG] [LOCAL ] HGLB: Deleted derivative data file. [2025-10-01T19:22:52.918815] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGLB took 24.1s. Estimated remaining: 3h 11m 48s. Rate: 7.1 symbols/min [2025-10-01T19:22:53.132298] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:22:53.170880] [DEBUG] [LOCAL ] HHH: Loaded 32605 existing records from primary storage. [2025-10-01T19:22:53.171222] [INFO ] [MAIN ] HHH: Loaded 32605 existing records. [2025-10-01T19:22:53.371858] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:22:53.372101] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-01T19:22:53.372196] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-01T19:22:53.372448] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-01T19:22:53.372510] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-01T19:22:53.793790] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:22:53.794124] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-01T19:23:04.833094] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (11.93 seconds). [2025-10-01T19:23:04.837615] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-01T19:23:05.346595] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (14.04 seconds). [2025-10-01T19:23:05.349451] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-01T19:23:05.820724] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (13.72 seconds). [2025-10-01T19:23:05.830093] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-01T19:23:06.324225] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T19:23:06.327825] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-01T19:23:06.628810] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T19:23:06.632798] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-01T19:23:07.329119] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (13.53 seconds). [2025-10-01T19:23:07.334461] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-01T19:23:08.268950] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T19:23:08.274571] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-01T19:23:08.310013] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T19:23:08.315320] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-01T19:23:08.635035] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-01T19:23:08.644145] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-01T19:23:09.074228] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T19:23:09.081376] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-01T19:23:09.142064] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T19:23:09.147760] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-01T19:23:09.536528] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T19:23:09.546121] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-01T19:23:10.788912] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T19:23:10.801261] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-01T19:23:11.628235] [DEBUG] [REMOTE ] HGTY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:23:11.628682] [WARN ] [REMOTE ] HGTY: No data returned for month 2025-10 [2025-10-01T19:23:11.628807] [FATAL] [REMOTE ] HGTY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:23:11.628917] [FATAL] [MAIN ] HGTY: Failed to fetch primary data. [2025-10-01T19:23:11.629098] [WARN ] [MAIN ] HGTY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:23:11.629195] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-01T19:23:11.629339] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-01T19:23:11.629397] [INFO ] [LOCAL ] HGTY: Starting deletion of derivative data. [2025-10-01T19:23:11.629779] [DEBUG] [LOCAL ] HGTY: Deleted derivative data file. [2025-10-01T19:23:11.629901] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGTY took 41.2s. Estimated remaining: 3h 11m 53s. Rate: 7.1 symbols/min [2025-10-01T19:23:11.748311] [DEBUG] [REMOTE ] HGER: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:23:11.752184] [WARN ] [REMOTE ] HGER: No data returned for month 2025-10 [2025-10-01T19:23:11.773415] [FATAL] [REMOTE ] HGER: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:23:11.814548] [FATAL] [MAIN ] HGER: Failed to fetch primary data. [2025-10-01T19:23:11.833435] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:23:11.834151] [WARN ] [MAIN ] HGER: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:23:11.834238] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-01T19:23:11.834298] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-01T19:23:11.834334] [INFO ] [LOCAL ] HGER: Starting deletion of derivative data. [2025-10-01T19:23:11.834905] [DEBUG] [LOCAL ] HGER: Deleted derivative data file. [2025-10-01T19:23:11.834993] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGER took 51.1s. Estimated remaining: 3h 11m 34s. Rate: 7.1 symbols/min [2025-10-01T19:23:12.058242] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:23:12.072188] [DEBUG] [LOCAL ] HI: Loaded 35264 existing records from primary storage. [2025-10-01T19:23:12.072631] [INFO ] [MAIN ] HI: Loaded 35264 existing records. [2025-10-01T19:23:12.267196] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (4.93 seconds). [2025-10-01T19:23:12.337005] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:23:12.338854] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-01T19:23:12.339086] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-01T19:23:12.338560] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-01T19:23:12.340792] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-01T19:23:12.340951] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-01T19:23:12.473206] [DEBUG] [LOCAL ] HIG: Loaded 51228 existing records from primary storage. [2025-10-01T19:23:12.484460] [INFO ] [MAIN ] HIG: Loaded 51228 existing records. [2025-10-01T19:23:12.637564] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T19:23:12.783112] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-01T19:23:12.994974] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:23:13.022225] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-01T19:23:13.027472] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-01T19:23:13.060511] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-01T19:23:13.066835] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-01T19:23:13.066748] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:23:13.100261] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-01T19:23:13.456582] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:23:13.456958] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-01T19:23:13.768610] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T19:23:13.775281] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-01T19:23:14.478501] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T19:23:14.504378] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T19:23:14.512638] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-01T19:23:14.513090] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-01T19:23:14.860760] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T19:23:14.867539] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-01T19:23:15.181787] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T19:23:15.192212] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-01T19:23:15.521516] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T19:23:15.528512] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-01T19:23:15.630070] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T19:23:15.640279] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-01T19:23:15.682060] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T19:23:15.688613] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-01T19:23:16.581462] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T19:23:16.589153] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-01T19:23:16.883482] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T19:23:16.894060] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-01T19:23:17.310769] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T19:23:17.319906] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-01T19:23:17.457599] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T19:23:17.469559] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-01T19:23:17.698793] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T19:23:17.706339] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-01T19:23:18.415624] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T19:23:18.489151] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T19:23:18.502332] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-01T19:23:18.880852] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T19:23:19.065583] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T19:23:19.302416] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-01T19:23:20.102392] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-01T19:23:20.357176] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T19:23:20.818811] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T19:23:20.902387] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-01T19:23:21.070814] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T19:23:21.702416] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-01T19:23:22.254949] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T19:23:22.502437] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-01T19:23:23.302358] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-01T19:23:23.543629] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T19:23:24.032567] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T19:23:24.102387] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-01T19:23:24.632510] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T19:23:24.902397] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-01T19:23:25.702381] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-01T19:23:26.502363] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-01T19:23:26.634333] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:23:26.986850] [DEBUG] [REMOTE ] HGV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:23:26.987174] [WARN ] [REMOTE ] HGV: No data returned for month 2025-10 [2025-10-01T19:23:26.987266] [FATAL] [REMOTE ] HGV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:23:26.987364] [FATAL] [MAIN ] HGV: Failed to fetch primary data. [2025-10-01T19:23:26.987437] [WARN ] [MAIN ] HGV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:23:26.987570] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-01T19:23:26.987696] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-01T19:23:26.987758] [INFO ] [LOCAL ] HGV: Starting deletion of derivative data. [2025-10-01T19:23:26.988225] [DEBUG] [LOCAL ] HGV: Deleted derivative data file. [2025-10-01T19:23:26.988312] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGV took 37.9s. Estimated remaining: 3h 11m 34s. Rate: 7.1 symbols/min [2025-10-01T19:23:27.187079] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:23:27.210416] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T19:23:27.260669] [DEBUG] [LOCAL ] HII: Loaded 34713 existing records from primary storage. [2025-10-01T19:23:27.261059] [INFO ] [MAIN ] HII: Loaded 34713 existing records. [2025-10-01T19:23:27.310204] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-01T19:23:27.472054] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:23:27.472276] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-01T19:23:27.472326] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-01T19:23:27.473401] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-01T19:23:27.473465] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-01T19:23:27.891256] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:23:27.955593] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T19:23:28.102384] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-01T19:23:28.641589] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T19:23:28.902402] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-01T19:23:29.485242] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T19:23:29.702399] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-01T19:23:29.720998] [DEBUG] [REMOTE ] HHH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:23:29.721312] [WARN ] [REMOTE ] HHH: No data returned for month 2025-10 [2025-10-01T19:23:29.721446] [FATAL] [REMOTE ] HHH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:23:29.721531] [FATAL] [MAIN ] HHH: Failed to fetch primary data. [2025-10-01T19:23:29.721571] [WARN ] [MAIN ] HHH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:23:29.721611] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-01T19:23:29.721764] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-01T19:23:29.721840] [INFO ] [LOCAL ] HHH: Starting deletion of derivative data. [2025-10-01T19:23:29.722158] [DEBUG] [LOCAL ] HHH: Deleted derivative data file. [2025-10-01T19:23:29.722264] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HHH took 36.8s. Estimated remaining: 3h 11m 18s. Rate: 7.1 symbols/min [2025-10-01T19:23:29.914943] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:23:29.971022] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-01T19:23:29.971402] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-01T19:23:30.171279] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:23:30.171520] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-01T19:23:30.171581] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-01T19:23:30.174545] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-01T19:23:30.174613] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-01T19:23:30.502683] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-01T19:23:30.594594] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:23:31.226068] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T19:23:31.302392] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-01T19:23:32.088615] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T19:23:32.102342] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-01T19:23:32.902352] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-01T19:23:33.073172] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T19:23:33.106859] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T19:23:33.682982] [DEBUG] [REMOTE ] HI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:23:33.683305] [WARN ] [REMOTE ] HI: No data returned for month 2025-10 [2025-10-01T19:23:33.683430] [FATAL] [REMOTE ] HI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:23:33.683525] [FATAL] [MAIN ] HI: Failed to fetch primary data. [2025-10-01T19:23:33.683570] [WARN ] [MAIN ] HI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:23:33.683664] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-01T19:23:33.683750] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-01T19:23:33.683788] [INFO ] [LOCAL ] HI: Starting deletion of derivative data. [2025-10-01T19:23:33.684176] [DEBUG] [LOCAL ] HI: Deleted derivative data file. [2025-10-01T19:23:33.684286] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HI took 22.1s. Estimated remaining: 3h 11m 3s. Rate: 7.1 symbols/min [2025-10-01T19:23:33.707609] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-01T19:23:33.894124] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:23:33.923130] [DEBUG] [LOCAL ] HIO: Loaded 23693 existing records from primary storage. [2025-10-01T19:23:33.923438] [INFO ] [MAIN ] HIO: Loaded 23693 existing records. [2025-10-01T19:23:34.125738] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:23:34.125956] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-01T19:23:34.126021] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-01T19:23:34.127387] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-01T19:23:34.127463] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-01T19:23:34.514782] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-01T19:23:34.536325] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:23:35.302387] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-01T19:23:36.004310] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T19:23:36.051053] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-01T19:23:36.102364] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-01T19:23:36.902376] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-01T19:23:36.982014] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T19:23:37.702378] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-01T19:23:38.509809] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-01T19:23:38.517714] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-01T19:23:38.621198] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T19:23:38.840401] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T19:23:39.302405] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-01T19:23:40.111917] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-01T19:23:40.130499] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T19:23:40.268369] [DEBUG] [REMOTE ] HIG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:23:40.268722] [WARN ] [REMOTE ] HIG: No data returned for month 2025-10 [2025-10-01T19:23:40.268816] [FATAL] [REMOTE ] HIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:23:40.268898] [FATAL] [MAIN ] HIG: Failed to fetch primary data. [2025-10-01T19:23:40.268965] [WARN ] [MAIN ] HIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:23:40.269044] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-01T19:23:40.269111] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-01T19:23:40.269148] [INFO ] [LOCAL ] HIG: Starting deletion of derivative data. [2025-10-01T19:23:40.269555] [DEBUG] [LOCAL ] HIG: Deleted derivative data file. [2025-10-01T19:23:40.269666] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HIG took 28.4s. Estimated remaining: 3h 10m 52s. Rate: 7.1 symbols/min [2025-10-01T19:23:40.514283] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:23:40.537065] [DEBUG] [LOCAL ] HIPO: Loaded 22110 existing records from primary storage. [2025-10-01T19:23:40.537437] [INFO ] [MAIN ] HIPO: Loaded 22110 existing records. [2025-10-01T19:23:40.743727] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:23:40.743963] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-01T19:23:40.744025] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-01T19:23:40.745008] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-01T19:23:40.745101] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-01T19:23:40.907181] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-01T19:23:41.154139] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T19:23:41.184830] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:23:41.702426] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-01T19:23:42.502379] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-01T19:23:42.548496] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T19:23:43.302417] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-01T19:23:43.538962] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T19:23:43.885487] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-01T19:23:44.102395] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-01T19:23:44.452067] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T19:23:44.902391] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-01T19:23:45.210733] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T19:23:45.702389] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-01T19:23:45.959881] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T19:23:46.502394] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-01T19:23:46.695495] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T19:23:47.302420] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-01T19:23:47.953328] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T19:23:48.102415] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-01T19:23:48.286320] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T19:23:48.902423] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-01T19:23:49.584977] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T19:23:49.702426] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-01T19:23:50.502429] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-01T19:23:51.068370] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T19:23:51.284245] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T19:23:51.307497] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-01T19:23:51.328034] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-01T19:23:52.076877] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T19:23:52.102353] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-01T19:23:52.902421] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-01T19:23:53.702354] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-01T19:23:53.860398] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T19:23:54.502421] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-01T19:23:54.762036] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-01T19:23:54.788720] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T19:23:55.302383] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-01T19:23:55.756179] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T19:23:56.102399] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-01T19:23:56.353620] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T19:23:56.902443] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-01T19:23:57.549347] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T19:23:57.702365] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-01T19:23:58.012878] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T19:23:58.502390] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-01T19:23:58.852156] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T19:23:59.302409] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-01T19:24:00.102441] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-01T19:24:00.902435] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-01T19:24:01.350697] [DEBUG] [REMOTE ] HII: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:24:01.366858] [WARN ] [REMOTE ] HII: No data returned for month 2025-10 [2025-10-01T19:24:01.368399] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T19:24:01.367596] [FATAL] [REMOTE ] HII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:24:01.374500] [FATAL] [MAIN ] HII: Failed to fetch primary data. [2025-10-01T19:24:01.374964] [WARN ] [MAIN ] HII: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:24:01.375339] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-01T19:24:01.375444] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-01T19:24:01.375498] [INFO ] [LOCAL ] HII: Starting deletion of derivative data. [2025-10-01T19:24:01.375917] [DEBUG] [LOCAL ] HII: Deleted derivative data file. [2025-10-01T19:24:01.376016] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HII took 34.4s. Estimated remaining: 3h 11m 1s. Rate: 7.1 symbols/min [2025-10-01T19:24:01.572219] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:24:01.627066] [DEBUG] [LOCAL ] HIW: Loaded 44523 existing records from primary storage. [2025-10-01T19:24:01.627446] [INFO ] [MAIN ] HIW: Loaded 44523 existing records. [2025-10-01T19:24:01.703272] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-01T19:24:01.855432] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:24:01.856043] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-01T19:24:01.856201] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-01T19:24:01.870777] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-01T19:24:01.888857] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-01T19:24:01.950183] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-01T19:24:02.048666] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T19:24:02.362464] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:24:02.502354] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-01T19:24:02.886487] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T19:24:03.190571] [DEBUG] [REMOTE ] HIO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:24:03.190964] [WARN ] [REMOTE ] HIO: No data returned for month 2025-10 [2025-10-01T19:24:03.191060] [FATAL] [REMOTE ] HIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:24:03.191153] [FATAL] [MAIN ] HIO: Failed to fetch primary data. [2025-10-01T19:24:03.191221] [WARN ] [MAIN ] HIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:24:03.191297] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-01T19:24:03.191364] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-01T19:24:03.191402] [INFO ] [LOCAL ] HIO: Starting deletion of derivative data. [2025-10-01T19:24:03.191780] [DEBUG] [LOCAL ] HIO: Deleted derivative data file. [2025-10-01T19:24:03.191882] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIO took 29.5s. Estimated remaining: 3h 10m 43s. Rate: 7.1 symbols/min [2025-10-01T19:24:03.307521] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-01T19:24:03.376582] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:24:03.399623] [DEBUG] [LOCAL ] HIX: Loaded 20593 existing records from primary storage. [2025-10-01T19:24:03.399912] [INFO ] [MAIN ] HIX: Loaded 20593 existing records. [2025-10-01T19:24:03.589226] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:24:03.589500] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-01T19:24:03.589560] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-01T19:24:03.589837] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-01T19:24:03.589899] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-01T19:24:03.985954] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:24:04.102353] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-01T19:24:04.408963] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T19:24:04.902381] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-01T19:24:05.684481] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T19:24:05.702336] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-01T19:24:05.985435] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T19:24:06.502416] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-01T19:24:07.206713] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T19:24:07.302390] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-01T19:24:07.703486] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T19:24:08.102425] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-01T19:24:08.549668] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T19:24:08.902433] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-01T19:24:09.659978] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T19:24:09.702359] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-01T19:24:10.502403] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-01T19:24:11.302381] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-01T19:24:11.317836] [DEBUG] [REMOTE ] HIPO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:24:11.318323] [WARN ] [REMOTE ] HIPO: No data returned for month 2025-10 [2025-10-01T19:24:11.318420] [FATAL] [REMOTE ] HIPO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:24:11.318580] [FATAL] [MAIN ] HIPO: Failed to fetch primary data. [2025-10-01T19:24:11.318684] [WARN ] [MAIN ] HIPO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:24:11.318771] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-01T19:24:11.318870] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-01T19:24:11.318929] [INFO ] [LOCAL ] HIPO: Starting deletion of derivative data. [2025-10-01T19:24:11.319281] [DEBUG] [LOCAL ] HIPO: Deleted derivative data file. [2025-10-01T19:24:11.319372] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIPO took 31.0s. Estimated remaining: 3h 10m 35s. Rate: 7.1 symbols/min [2025-10-01T19:24:11.528249] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:24:11.559118] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T19:24:11.615557] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-01T19:24:11.634276] [DEBUG] [LOCAL ] HKD: Loaded 18365 existing records from primary storage. [2025-10-01T19:24:11.634574] [INFO ] [MAIN ] HKD: Loaded 18365 existing records. [2025-10-01T19:24:11.842632] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:24:11.842896] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-01T19:24:11.842946] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-01T19:24:11.843182] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-01T19:24:11.843241] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-01T19:24:12.107028] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-01T19:24:12.188980] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T19:24:12.273569] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:24:12.902416] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-01T19:24:13.702433] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-01T19:24:14.083391] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T19:24:14.502402] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-01T19:24:14.920226] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-01T19:24:15.102469] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T19:24:15.302403] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-01T19:24:15.493956] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T19:24:16.102370] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-01T19:24:16.128974] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T19:24:16.905195] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-01T19:24:16.910754] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T19:24:17.702358] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-01T19:24:18.054459] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T19:24:18.441182] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T19:24:18.502409] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-01T19:24:19.302380] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-01T19:24:20.050242] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T19:24:20.084025] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T19:24:20.102405] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-01T19:24:20.902373] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-01T19:24:21.702425] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-01T19:24:22.007438] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T19:24:22.502354] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-01T19:24:22.560866] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-01T19:24:22.602203] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T19:24:23.302416] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-01T19:24:23.370702] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T19:24:24.109210] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-01T19:24:24.112620] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T19:24:24.902397] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-01T19:24:25.423580] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T19:24:25.702373] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-01T19:24:26.502364] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-01T19:24:26.537368] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T19:24:27.302374] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-01T19:24:27.369296] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-01T19:24:28.038066] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T19:24:28.102398] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-01T19:24:28.260720] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T19:24:28.902391] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-01T19:24:29.106483] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T19:24:29.702412] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-01T19:24:30.005895] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T19:24:30.502396] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-01T19:24:31.302429] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-01T19:24:31.341233] [DEBUG] [REMOTE ] HIMS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:24:31.341562] [WARN ] [REMOTE ] HIMS: No data returned for month 2025-10 [2025-10-01T19:24:31.341684] [FATAL] [REMOTE ] HIMS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:24:31.341778] [FATAL] [MAIN ] HIMS: Failed to fetch primary data. [2025-10-01T19:24:31.341844] [WARN ] [MAIN ] HIMS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:24:31.341919] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-01T19:24:31.342047] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-01T19:24:31.342100] [INFO ] [LOCAL ] HIMS: Starting deletion of derivative data. [2025-10-01T19:24:31.342459] [DEBUG] [LOCAL ] HIMS: Deleted derivative data file. [2025-10-01T19:24:31.342567] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIMS took 1m 2s. Estimated remaining: 3h 10m 41s. Rate: 7.1 symbols/min [2025-10-01T19:24:31.542938] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:24:31.608487] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-10-01T19:24:31.608947] [INFO ] [MAIN ] HL: Loaded 53671 existing records. [2025-10-01T19:24:31.859208] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:24:31.859572] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-01T19:24:31.859631] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-01T19:24:31.860175] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-01T19:24:31.860235] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-01T19:24:32.111741] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-01T19:24:32.319578] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:24:32.322761] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T19:24:32.360289] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T19:24:32.716433] [DEBUG] [REMOTE ] HIX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:24:32.716810] [WARN ] [REMOTE ] HIX: No data returned for month 2025-10 [2025-10-01T19:24:32.716905] [FATAL] [REMOTE ] HIX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:24:32.717012] [FATAL] [MAIN ] HIX: Failed to fetch primary data. [2025-10-01T19:24:32.717082] [WARN ] [MAIN ] HIX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:24:32.717156] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-01T19:24:32.717260] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-01T19:24:32.717321] [INFO ] [LOCAL ] HIX: Starting deletion of derivative data. [2025-10-01T19:24:32.717636] [DEBUG] [LOCAL ] HIX: Deleted derivative data file. [2025-10-01T19:24:32.717749] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIX took 29.5s. Estimated remaining: 3h 10m 23s. Rate: 7.1 symbols/min [2025-10-01T19:24:32.908692] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-01T19:24:32.939741] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:24:32.991214] [DEBUG] [LOCAL ] HLF: Loaded 48536 existing records from primary storage. [2025-10-01T19:24:32.991554] [INFO ] [MAIN ] HLF: Loaded 48536 existing records. [2025-10-01T19:24:33.195786] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:24:33.196066] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-01T19:24:33.196118] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-01T19:24:33.196388] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-01T19:24:33.196448] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-01T19:24:33.604517] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:24:33.702380] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-01T19:24:34.502391] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-01T19:24:34.581104] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T19:24:34.969683] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T19:24:35.302380] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-01T19:24:36.024435] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T19:24:36.102372] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-01T19:24:36.151220] [DEBUG] [REMOTE ] HIW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:24:36.151543] [WARN ] [REMOTE ] HIW: No data returned for month 2025-10 [2025-10-01T19:24:36.151633] [FATAL] [REMOTE ] HIW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:24:36.151757] [FATAL] [MAIN ] HIW: Failed to fetch primary data. [2025-10-01T19:24:36.151823] [WARN ] [MAIN ] HIW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:24:36.151895] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-01T19:24:36.151961] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-01T19:24:36.151997] [INFO ] [LOCAL ] HIW: Starting deletion of derivative data. [2025-10-01T19:24:36.152310] [DEBUG] [LOCAL ] HIW: Deleted derivative data file. [2025-10-01T19:24:36.152397] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIW took 34.8s. Estimated remaining: 3h 10m 8s. Rate: 7.1 symbols/min [2025-10-01T19:24:36.334683] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:24:36.374616] [DEBUG] [LOCAL ] HLI: Loaded 30960 existing records from primary storage. [2025-10-01T19:24:36.374955] [INFO ] [MAIN ] HLI: Loaded 30960 existing records. [2025-10-01T19:24:36.571743] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:24:36.571947] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-01T19:24:36.571998] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-01T19:24:36.572231] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-01T19:24:36.572290] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-01T19:24:36.918449] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-01T19:24:36.962138] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:24:37.705433] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-01T19:24:37.709392] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T19:24:38.502370] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-01T19:24:38.565751] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T19:24:39.048179] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T19:24:39.302418] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-01T19:24:40.102427] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-01T19:24:40.902403] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-01T19:24:41.156723] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T19:24:41.258895] [DEBUG] [REMOTE ] HKD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:24:41.259291] [WARN ] [REMOTE ] HKD: No data returned for month 2025-10 [2025-10-01T19:24:41.259373] [FATAL] [REMOTE ] HKD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:24:41.259491] [FATAL] [MAIN ] HKD: Failed to fetch primary data. [2025-10-01T19:24:41.259563] [WARN ] [MAIN ] HKD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:24:41.259638] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-01T19:24:41.259752] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-01T19:24:41.259799] [INFO ] [LOCAL ] HKD: Starting deletion of derivative data. [2025-10-01T19:24:41.260185] [DEBUG] [LOCAL ] HKD: Deleted derivative data file. [2025-10-01T19:24:41.260289] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HKD took 29.9s. Estimated remaining: 3h 9m 55s. Rate: 7.1 symbols/min [2025-10-01T19:24:41.493289] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:24:41.521890] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T19:24:41.558735] [DEBUG] [LOCAL ] HLIO: Loaded 27935 existing records from primary storage. [2025-10-01T19:24:41.559097] [INFO ] [MAIN ] HLIO: Loaded 27935 existing records. [2025-10-01T19:24:41.707589] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-01T19:24:41.768147] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:24:41.769188] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-01T19:24:41.769303] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-01T19:24:41.769779] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-01T19:24:41.769840] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-01T19:24:42.203698] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:24:42.206041] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T19:24:42.502437] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-01T19:24:43.185937] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T19:24:43.302429] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-01T19:24:43.700433] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-01T19:24:44.102421] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-01T19:24:44.324036] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T19:24:44.902424] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-01T19:24:45.702353] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-01T19:24:45.804878] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T19:24:46.502433] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-01T19:24:46.600889] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T19:24:46.793010] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T19:24:47.302409] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-01T19:24:47.492106] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T19:24:48.102386] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-01T19:24:48.420700] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T19:24:48.902405] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-01T19:24:49.429404] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T19:24:49.702381] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-01T19:24:50.265700] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T19:24:50.502432] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-01T19:24:51.083148] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T19:24:51.302371] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-01T19:24:51.732439] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T19:24:52.102406] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-01T19:24:52.662427] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T19:24:52.902429] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-01T19:24:53.702358] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-01T19:24:54.123562] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-01T19:24:54.240510] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T19:24:54.502428] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-01T19:24:54.938155] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T19:24:55.302432] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-01T19:24:56.102382] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-01T19:24:56.546436] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-01T19:24:56.848532] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T19:24:56.902356] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-01T19:24:57.341868] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T19:24:57.702394] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-01T19:24:58.507634] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-01T19:24:58.520958] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T19:24:58.991186] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T19:24:59.302398] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-01T19:25:00.102355] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-01T19:25:00.339800] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-01T19:25:00.624065] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T19:25:00.902373] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-01T19:25:01.702381] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-01T19:25:01.793389] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T19:25:02.502401] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-01T19:25:03.302357] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-01T19:25:03.505949] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-01T19:25:03.614092] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T19:25:04.102393] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-01T19:25:04.902407] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-01T19:25:05.533913] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-10-01T19:25:05.702373] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-01T19:25:05.964226] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-01T19:25:06.446789] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-01T19:25:06.502390] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-01T19:25:06.883565] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T19:25:07.001349] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-01T19:25:07.302436] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-01T19:25:07.380626] [DEBUG] [REMOTE ] HLF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:07.381044] [WARN ] [REMOTE ] HLF: No data returned for month 2025-10 [2025-10-01T19:25:07.381156] [FATAL] [REMOTE ] HLF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:07.381256] [FATAL] [MAIN ] HLF: Failed to fetch primary data. [2025-10-01T19:25:07.381332] [WARN ] [MAIN ] HLF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:07.381417] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-01T19:25:07.381511] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-01T19:25:07.381577] [INFO ] [LOCAL ] HLF: Starting deletion of derivative data. [2025-10-01T19:25:07.382139] [DEBUG] [LOCAL ] HLF: Deleted derivative data file. [2025-10-01T19:25:07.382248] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HLF took 34.7s. Estimated remaining: 3h 10m 10s. Rate: 7.1 symbols/min [2025-10-01T19:25:07.584243] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:07.618273] [DEBUG] [LOCAL ] HLLY: Loaded 33120 existing records from primary storage. [2025-10-01T19:25:07.618557] [INFO ] [MAIN ] HLLY: Loaded 33120 existing records. [2025-10-01T19:25:07.820765] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:07.820999] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-01T19:25:07.821048] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-01T19:25:07.821304] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-01T19:25:07.821363] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-01T19:25:08.108712] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-01T19:25:08.207945] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:08.902428] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-01T19:25:09.062082] [DEBUG] [REMOTE ] HLI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:09.062468] [WARN ] [REMOTE ] HLI: No data returned for month 2025-10 [2025-10-01T19:25:09.062561] [FATAL] [REMOTE ] HLI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:09.062676] [FATAL] [MAIN ] HLI: Failed to fetch primary data. [2025-10-01T19:25:09.062758] [WARN ] [MAIN ] HLI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:09.062842] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-01T19:25:09.062959] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-01T19:25:09.063027] [INFO ] [LOCAL ] HLI: Starting deletion of derivative data. [2025-10-01T19:25:09.063470] [DEBUG] [LOCAL ] HLI: Deleted derivative data file. [2025-10-01T19:25:09.063583] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLI took 32.9s. Estimated remaining: 3h 9m 53s. Rate: 7.1 symbols/min [2025-10-01T19:25:09.268414] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:09.334888] [DEBUG] [LOCAL ] HLN: Loaded 53083 existing records from primary storage. [2025-10-01T19:25:09.335232] [INFO ] [MAIN ] HLN: Loaded 53083 existing records. [2025-10-01T19:25:09.540795] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:09.541003] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-01T19:25:09.541052] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-01T19:25:09.541360] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-01T19:25:09.541428] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-01T19:25:09.716043] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-01T19:25:09.914733] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T19:25:10.013219] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:10.336155] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-01T19:25:10.502397] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-01T19:25:11.151195] [DEBUG] [REMOTE ] HLIO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:11.152993] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T19:25:11.151727] [WARN ] [REMOTE ] HLIO: No data returned for month 2025-10 [2025-10-01T19:25:11.160846] [FATAL] [REMOTE ] HLIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:11.161021] [FATAL] [MAIN ] HLIO: Failed to fetch primary data. [2025-10-01T19:25:11.161157] [WARN ] [MAIN ] HLIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:11.161242] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-01T19:25:11.161321] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-01T19:25:11.161366] [INFO ] [LOCAL ] HLIO: Starting deletion of derivative data. [2025-10-01T19:25:11.161752] [DEBUG] [LOCAL ] HLIO: Deleted derivative data file. [2025-10-01T19:25:11.161865] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLIO took 29.9s. Estimated remaining: 3h 9m 36s. Rate: 7.1 symbols/min [2025-10-01T19:25:11.307531] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-01T19:25:11.356978] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:11.420053] [DEBUG] [LOCAL ] HLT: Loaded 50626 existing records from primary storage. [2025-10-01T19:25:11.420388] [INFO ] [MAIN ] HLT: Loaded 50626 existing records. [2025-10-01T19:25:11.627299] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:11.627509] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-01T19:25:11.627560] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-01T19:25:11.627875] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-01T19:25:11.627935] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-01T19:25:12.043252] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:12.102376] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-01T19:25:12.712459] [DEBUG] [REMOTE ] HL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:12.712827] [WARN ] [REMOTE ] HL: No data returned for month 2025-10 [2025-10-01T19:25:12.712978] [FATAL] [REMOTE ] HL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:12.713093] [FATAL] [MAIN ] HL: Failed to fetch primary data. [2025-10-01T19:25:12.713162] [WARN ] [MAIN ] HL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:12.713232] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-01T19:25:12.713312] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-01T19:25:12.713371] [INFO ] [LOCAL ] HL: Starting deletion of derivative data. [2025-10-01T19:25:12.713694] [DEBUG] [LOCAL ] HL: Deleted derivative data file. [2025-10-01T19:25:12.713784] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HL took 41.4s. Estimated remaining: 3h 9m 18s. Rate: 7.1 symbols/min [2025-10-01T19:25:12.921031] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:12.916695] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-01T19:25:12.967964] [DEBUG] [LOCAL ] HLX: Loaded 47823 existing records from primary storage. [2025-10-01T19:25:12.968322] [INFO ] [MAIN ] HLX: Loaded 47823 existing records. [2025-10-01T19:25:13.161533] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:13.161781] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-01T19:25:13.161841] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-01T19:25:13.162124] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-01T19:25:13.162185] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-01T19:25:13.556865] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:13.702429] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-01T19:25:14.502418] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-01T19:25:14.820525] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-01T19:25:15.302475] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-01T19:25:15.854790] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (2.94 seconds). [2025-10-01T19:25:16.007381] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-01T19:25:16.102445] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-01T19:25:16.377813] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T19:25:16.907698] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-01T19:25:16.927902] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T19:25:17.683959] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T19:25:17.707498] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-01T19:25:17.727360] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T19:25:18.502424] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-01T19:25:19.109404] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T19:25:19.302376] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-01T19:25:19.961315] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:25:20.102434] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-01T19:25:20.667389] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T19:25:20.902388] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-01T19:25:21.423960] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T19:25:21.702399] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-01T19:25:21.915755] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T19:25:22.502457] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-01T19:25:23.141028] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T19:25:23.302437] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-01T19:25:24.102501] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-01T19:25:24.375631] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T19:25:24.431631] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T19:25:24.902413] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-01T19:25:25.702401] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-01T19:25:26.107545] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T19:25:26.125131] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T19:25:26.502425] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-01T19:25:27.302392] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-01T19:25:27.449549] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:25:27.679382] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T19:25:28.102395] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-01T19:25:28.902393] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-01T19:25:28.953014] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T19:25:29.597898] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:25:29.702420] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-01T19:25:30.211760] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T19:25:30.502421] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-01T19:25:31.304548] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-01T19:25:31.311104] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T19:25:32.102372] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-01T19:25:32.247396] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T19:25:32.826998] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T19:25:32.902369] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-01T19:25:33.709807] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-01T19:25:33.731036] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T19:25:33.839336] [DEBUG] [REMOTE ] HLLY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:33.839679] [WARN ] [REMOTE ] HLLY: No data returned for month 2025-10 [2025-10-01T19:25:33.839822] [FATAL] [REMOTE ] HLLY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:33.839956] [FATAL] [MAIN ] HLLY: Failed to fetch primary data. [2025-10-01T19:25:33.840060] [WARN ] [MAIN ] HLLY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:33.840157] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-01T19:25:33.840240] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-01T19:25:33.840280] [INFO ] [LOCAL ] HLLY: Starting deletion of derivative data. [2025-10-01T19:25:33.840712] [DEBUG] [LOCAL ] HLLY: Deleted derivative data file. [2025-10-01T19:25:33.840818] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 26.5s. Estimated remaining: 3h 9m 27s. Rate: 7.1 symbols/min [2025-10-01T19:25:34.029496] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:34.077827] [DEBUG] [LOCAL ] HMC: Loaded 46717 existing records from primary storage. [2025-10-01T19:25:34.078165] [INFO ] [MAIN ] HMC: Loaded 46717 existing records. [2025-10-01T19:25:34.275257] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:34.275519] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-01T19:25:34.275587] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-01T19:25:34.275909] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-01T19:25:34.275972] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-01T19:25:34.507489] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-01T19:25:34.683761] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:35.228039] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T19:25:35.302395] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-01T19:25:36.102354] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-01T19:25:36.235908] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T19:25:36.787305] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T19:25:36.902378] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-01T19:25:37.630631] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T19:25:37.702385] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-01T19:25:38.461004] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T19:25:38.502360] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-01T19:25:39.302437] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-01T19:25:39.470911] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T19:25:40.108157] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-01T19:25:40.126742] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T19:25:40.902378] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-01T19:25:41.037300] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:25:41.702431] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-01T19:25:41.916084] [DEBUG] [REMOTE ] HLT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:41.916414] [WARN ] [REMOTE ] HLT: No data returned for month 2025-10 [2025-10-01T19:25:41.916515] [FATAL] [REMOTE ] HLT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:41.916600] [FATAL] [MAIN ] HLT: Failed to fetch primary data. [2025-10-01T19:25:41.916692] [WARN ] [MAIN ] HLT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:41.916772] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-01T19:25:41.916840] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-01T19:25:41.916877] [INFO ] [LOCAL ] HLT: Starting deletion of derivative data. [2025-10-01T19:25:41.917359] [DEBUG] [LOCAL ] HLT: Deleted derivative data file. [2025-10-01T19:25:41.917488] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLT took 30.8s. Estimated remaining: 3h 9m 18s. Rate: 7.1 symbols/min [2025-10-01T19:25:42.116761] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:42.151817] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-01T19:25:42.188543] [DEBUG] [LOCAL ] HMN: Loaded 23372 existing records from primary storage. [2025-10-01T19:25:42.188928] [INFO ] [MAIN ] HMN: Loaded 23372 existing records. [2025-10-01T19:25:42.408054] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:42.408263] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-01T19:25:42.408310] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-01T19:25:42.408558] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-01T19:25:42.408616] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-01T19:25:42.507492] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-01T19:25:42.806804] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:43.240586] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T19:25:43.302411] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-01T19:25:43.939203] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:25:44.102360] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-01T19:25:44.336432] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T19:25:44.902387] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-01T19:25:45.704902] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-01T19:25:45.708918] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T19:25:46.502418] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-01T19:25:46.685710] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T19:25:47.302454] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-01T19:25:47.543751] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T19:25:48.102384] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-01T19:25:48.208561] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T19:25:48.330759] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T19:25:48.902435] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-01T19:25:49.550928] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T19:25:49.702395] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-01T19:25:50.392291] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T19:25:50.502370] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-01T19:25:50.891592] [DEBUG] [REMOTE ] HLN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:50.892047] [WARN ] [REMOTE ] HLN: No data returned for month 2025-10 [2025-10-01T19:25:50.892143] [FATAL] [REMOTE ] HLN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:50.892436] [FATAL] [MAIN ] HLN: Failed to fetch primary data. [2025-10-01T19:25:50.892799] [WARN ] [MAIN ] HLN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:50.892888] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-01T19:25:50.893027] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-01T19:25:50.893083] [INFO ] [LOCAL ] HLN: Starting deletion of derivative data. [2025-10-01T19:25:50.893400] [DEBUG] [LOCAL ] HLN: Deleted derivative data file. [2025-10-01T19:25:50.893534] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLN took 41.8s. Estimated remaining: 3h 9m 10s. Rate: 7.1 symbols/min [2025-10-01T19:25:51.074503] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:51.132216] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-10-01T19:25:51.132613] [INFO ] [MAIN ] HMY: Loaded 53136 existing records. [2025-10-01T19:25:51.307621] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-01T19:25:51.359246] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:51.359478] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-01T19:25:51.359529] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-01T19:25:51.360056] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-01T19:25:51.360126] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-01T19:25:51.774566] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:52.102435] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-01T19:25:52.454960] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T19:25:52.902464] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-01T19:25:53.438584] [DEBUG] [REMOTE ] HLX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:53.439076] [WARN ] [REMOTE ] HLX: No data returned for month 2025-10 [2025-10-01T19:25:53.439225] [FATAL] [REMOTE ] HLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:53.439340] [FATAL] [MAIN ] HLX: Failed to fetch primary data. [2025-10-01T19:25:53.439378] [WARN ] [MAIN ] HLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:53.439441] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-01T19:25:53.439535] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-01T19:25:53.439593] [INFO ] [LOCAL ] HLX: Starting deletion of derivative data. [2025-10-01T19:25:53.440085] [DEBUG] [LOCAL ] HLX: Deleted derivative data file. [2025-10-01T19:25:53.440187] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLX took 40.7s. Estimated remaining: 3h 8m 54s. Rate: 7.1 symbols/min [2025-10-01T19:25:53.669348] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:53.669589] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-01T19:25:53.669630] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-01T19:25:53.669780] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-01T19:25:53.669853] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-01T19:25:53.669914] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-01T19:25:53.669951] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-01T19:25:53.703116] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-01T19:25:54.013545] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T19:25:54.112558] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:54.144980] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T19:25:54.502434] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-01T19:25:54.715111] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:25:54.715671] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-01T19:25:54.715810] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:25:54.715861] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-01T19:25:54.715895] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:25:54.715965] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-01T19:25:54.716039] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-01T19:25:54.716076] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-01T19:25:54.716117] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-01T19:25:54.716171] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HNGE took 1.3s. Estimated remaining: 3h 8m 36s. Rate: 7.1 symbols/min [2025-10-01T19:25:54.889947] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:25:54.927319] [DEBUG] [LOCAL ] HNI: Loaded 29190 existing records from primary storage. [2025-10-01T19:25:54.927739] [INFO ] [MAIN ] HNI: Loaded 29190 existing records. [2025-10-01T19:25:55.110913] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:25:55.111193] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-01T19:25:55.111246] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-01T19:25:55.111615] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-01T19:25:55.111718] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-01T19:25:55.313255] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-01T19:25:55.497735] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:25:55.536157] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T19:25:56.102376] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-01T19:25:56.253145] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T19:25:56.902406] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-01T19:25:57.373916] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T19:25:57.702378] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-01T19:25:58.502372] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-01T19:25:58.609167] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T19:25:59.307531] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-01T19:25:59.317989] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T19:25:59.589351] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T19:26:00.102400] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-01T19:26:00.902385] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-01T19:26:01.111970] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T19:26:01.285072] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T19:26:01.702387] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-01T19:26:02.502347] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-01T19:26:02.710477] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T19:26:03.311929] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-01T19:26:03.332174] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T19:26:03.543109] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T19:26:04.102380] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-01T19:26:04.902355] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-01T19:26:05.287430] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-01T19:26:05.326609] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T19:26:05.702392] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-01T19:26:05.761970] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T19:26:06.502391] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-01T19:26:06.803806] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T19:26:07.302443] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-01T19:26:08.102450] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-01T19:26:08.752753] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-01T19:26:08.902371] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-01T19:26:09.055474] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T19:26:09.503114] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T19:26:09.605519] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T19:26:09.702398] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-01T19:26:10.502377] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-01T19:26:10.533267] [DEBUG] [REMOTE ] HMN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:26:10.533589] [WARN ] [REMOTE ] HMN: No data returned for month 2025-10 [2025-10-01T19:26:10.533737] [FATAL] [REMOTE ] HMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:26:10.533826] [FATAL] [MAIN ] HMN: Failed to fetch primary data. [2025-10-01T19:26:10.533892] [WARN ] [MAIN ] HMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:26:10.533988] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-01T19:26:10.534081] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-01T19:26:10.534135] [INFO ] [LOCAL ] HMN: Starting deletion of derivative data. [2025-10-01T19:26:10.534668] [DEBUG] [LOCAL ] HMN: Deleted derivative data file. [2025-10-01T19:26:10.534781] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMN took 28.6s. Estimated remaining: 3h 8m 37s. Rate: 7.1 symbols/min [2025-10-01T19:26:10.724859] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:26:10.783209] [DEBUG] [LOCAL ] HOG: Loaded 51137 existing records from primary storage. [2025-10-01T19:26:10.783550] [INFO ] [MAIN ] HOG: Loaded 51137 existing records. [2025-10-01T19:26:10.983813] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:26:10.984090] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-01T19:26:10.984194] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-01T19:26:10.984560] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-01T19:26:10.984622] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-01T19:26:11.307453] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-01T19:26:11.391788] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:26:12.102419] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-01T19:26:12.327265] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T19:26:12.562017] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T19:26:12.902414] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-01T19:26:13.702388] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-01T19:26:13.882979] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T19:26:14.502416] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-01T19:26:14.801121] [DEBUG] [REMOTE ] HMC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:26:14.812549] [WARN ] [REMOTE ] HMC: No data returned for month 2025-10 [2025-10-01T19:26:14.814928] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T19:26:14.815050] [FATAL] [REMOTE ] HMC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:26:14.826833] [FATAL] [MAIN ] HMC: Failed to fetch primary data. [2025-10-01T19:26:14.827092] [WARN ] [MAIN ] HMC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:26:14.827207] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-01T19:26:14.827723] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-01T19:26:14.827831] [INFO ] [LOCAL ] HMC: Starting deletion of derivative data. [2025-10-01T19:26:14.828498] [DEBUG] [LOCAL ] HMC: Deleted derivative data file. [2025-10-01T19:26:14.828588] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 41.0s. Estimated remaining: 3h 8m 23s. Rate: 7.1 symbols/min [2025-10-01T19:26:15.032811] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:26:15.081179] [DEBUG] [LOCAL ] HOMB: Loaded 43513 existing records from primary storage. [2025-10-01T19:26:15.081530] [INFO ] [MAIN ] HOMB: Loaded 43513 existing records. [2025-10-01T19:26:15.283021] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:26:15.283237] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-01T19:26:15.283287] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-01T19:26:15.283883] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-01T19:26:15.283945] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-01T19:26:15.307526] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-01T19:26:15.700190] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:26:16.086687] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T19:26:16.102388] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-01T19:26:16.309742] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T19:26:16.902410] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-01T19:26:17.645149] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T19:26:17.702355] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-01T19:26:18.502419] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-01T19:26:18.814069] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T19:26:18.862863] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-01T19:26:19.302401] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-01T19:26:19.338297] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T19:26:20.102394] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-01T19:26:20.677316] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T19:26:20.902371] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-01T19:26:21.702357] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-01T19:26:21.998800] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T19:26:22.091327] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T19:26:22.502407] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-01T19:26:22.860055] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T19:26:23.302382] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-01T19:26:23.952603] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T19:26:24.102384] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-01T19:26:24.628693] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T19:26:24.902381] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-01T19:26:25.123246] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-01T19:26:25.702373] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-01T19:26:26.502350] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-01T19:26:26.588383] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T19:26:27.201449] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T19:26:27.302376] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-01T19:26:27.545045] [DEBUG] [REMOTE ] HNI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:26:27.545369] [WARN ] [REMOTE ] HNI: No data returned for month 2025-10 [2025-10-01T19:26:27.545463] [FATAL] [REMOTE ] HNI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:26:27.545546] [FATAL] [MAIN ] HNI: Failed to fetch primary data. [2025-10-01T19:26:27.545614] [WARN ] [MAIN ] HNI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:26:27.545753] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-01T19:26:27.545823] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-01T19:26:27.545868] [INFO ] [LOCAL ] HNI: Starting deletion of derivative data. [2025-10-01T19:26:27.546176] [DEBUG] [LOCAL ] HNI: Deleted derivative data file. [2025-10-01T19:26:27.546295] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNI took 32.8s. Estimated remaining: 3h 8m 20s. Rate: 7.1 symbols/min [2025-10-01T19:26:28.102381] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-01T19:26:28.838548] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:26:28.902356] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-01T19:26:29.702357] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-01T19:26:30.003313] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T19:26:30.042452] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T19:26:30.502399] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-01T19:26:31.302377] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-01T19:26:31.384937] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T19:26:31.768736] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T19:26:32.102452] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-01T19:26:32.844637] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T19:26:32.902368] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-01T19:26:33.227218] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T19:26:33.702392] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-01T19:26:34.346947] [DEBUG] [REMOTE ] HMY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:26:34.347291] [WARN ] [REMOTE ] HMY: No data returned for month 2025-10 [2025-10-01T19:26:34.347390] [FATAL] [REMOTE ] HMY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:26:34.347476] [FATAL] [MAIN ] HMY: Failed to fetch primary data. [2025-10-01T19:26:34.347548] [WARN ] [MAIN ] HMY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:26:34.347631] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-01T19:26:34.347808] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-01T19:26:34.347869] [INFO ] [LOCAL ] HMY: Starting deletion of derivative data. [2025-10-01T19:26:34.348259] [DEBUG] [LOCAL ] HMY: Deleted derivative data file. [2025-10-01T19:26:34.348349] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMY took 43.5s. Estimated remaining: 3h 8m 9s. Rate: 7.1 symbols/min [2025-10-01T19:26:34.502443] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-01T19:26:35.363460] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T19:26:35.373948] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-01T19:26:36.286295] [DEBUG] [REMOTE ] HOMB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:26:36.286606] [WARN ] [REMOTE ] HOMB: No data returned for month 2025-10 [2025-10-01T19:26:36.286758] [FATAL] [REMOTE ] HOMB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:26:36.286886] [FATAL] [MAIN ] HOMB: Failed to fetch primary data. [2025-10-01T19:26:36.286976] [WARN ] [MAIN ] HOMB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:26:36.287071] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-01T19:26:36.287157] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-01T19:26:36.287197] [INFO ] [LOCAL ] HOMB: Starting deletion of derivative data. [2025-10-01T19:26:36.287488] [DEBUG] [LOCAL ] HOMB: Deleted derivative data file. [2025-10-01T19:26:36.287576] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOMB took 21.5s. Estimated remaining: 3h 7m 52s. Rate: 7.1 symbols/min [2025-10-01T19:26:36.358686] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T19:26:36.369855] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-01T19:26:38.079712] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T19:26:38.089954] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-01T19:26:39.758461] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T19:26:39.770212] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-01T19:26:41.429458] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T19:26:41.441094] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-01T19:26:43.231604] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T19:26:43.248100] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-01T19:26:46.288225] [DEBUG] [REMOTE ] HOG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:26:46.288561] [WARN ] [REMOTE ] HOG: No data returned for month 2025-10 [2025-10-01T19:26:46.288687] [FATAL] [REMOTE ] HOG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:26:46.288815] [FATAL] [MAIN ] HOG: Failed to fetch primary data. [2025-10-01T19:26:46.288886] [WARN ] [MAIN ] HOG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:26:46.288955] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-01T19:26:46.289020] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-01T19:26:46.289058] [INFO ] [LOCAL ] HOG: Starting deletion of derivative data. [2025-10-01T19:26:46.289559] [DEBUG] [LOCAL ] HOG: Deleted derivative data file. [2025-10-01T19:26:46.289693] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOG took 35.8s. Estimated remaining: 3h 7m 46s. Rate: 7.1 symbols/min [2025-10-01T19:26:47.028626] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:26:47.083879] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:26:47.086209] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:26:47.105174] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:26:47.127864] [DEBUG] [LOCAL ] HOV: Loaded 13796 existing records from primary storage. [2025-10-01T19:26:47.128227] [INFO ] [MAIN ] HOV: Loaded 13796 existing records. [2025-10-01T19:26:47.441127] [DEBUG] [LOCAL ] HOUS: Loaded 44419 existing records from primary storage. [2025-10-01T19:26:47.439709] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:26:47.442407] [DEBUG] [LOCAL ] HP: Loaded 51593 existing records from primary storage. [2025-10-01T19:26:47.444096] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-01T19:26:47.443258] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-01T19:26:47.443120] [INFO ] [MAIN ] HP: Loaded 51593 existing records. [2025-10-01T19:26:47.444731] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-01T19:26:47.444466] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-01T19:26:47.444276] [INFO ] [MAIN ] HOUS: Loaded 44419 existing records. [2025-10-01T19:26:47.477959] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-01T19:26:47.512764] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-01T19:26:48.209222] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:26:48.303905] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-01T19:26:48.313108] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:26:48.336528] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:26:48.337489] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-01T19:26:48.337660] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-01T19:26:48.357587] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-01T19:26:48.357484] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-01T19:26:48.373909] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-01T19:26:48.368702] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-01T19:26:48.411490] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-01T19:26:48.385168] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-01T19:26:48.416828] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-01T19:26:48.411659] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-01T19:26:48.438505] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-01T19:26:49.052861] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:26:49.163943] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-01T19:26:49.731108] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:26:49.772598] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:26:49.804578] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-01T19:26:49.804345] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-01T19:26:49.845788] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:26:49.847845] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-01T19:26:50.122507] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T19:26:50.126847] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-01T19:26:50.892137] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T19:26:50.900494] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-01T19:26:51.087087] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T19:26:51.092036] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-01T19:26:51.334778] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T19:26:51.344953] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-01T19:26:51.733617] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T19:26:51.751770] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-01T19:26:51.753579] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T19:26:51.756892] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-01T19:26:51.911326] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T19:26:51.920595] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-01T19:26:52.413941] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T19:26:52.423711] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-01T19:26:52.607721] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T19:26:52.610799] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-01T19:26:53.249679] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T19:26:53.259446] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-01T19:26:53.406006] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T19:26:53.417501] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-01T19:26:53.572978] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T19:26:53.576633] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-01T19:26:53.908123] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T19:26:53.918295] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-01T19:26:54.339514] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T19:26:54.342359] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-01T19:26:54.580377] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T19:26:54.589889] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-01T19:26:54.998914] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T19:26:55.034225] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T19:26:55.302397] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-01T19:26:55.411244] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T19:26:55.740520] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T19:26:56.044585] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T19:26:56.102394] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-01T19:26:56.902392] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-01T19:26:57.702368] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-01T19:26:58.032097] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T19:26:58.502361] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-01T19:26:58.715387] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T19:26:59.225029] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T19:26:59.302372] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-01T19:27:00.102425] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-01T19:27:00.372012] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T19:27:00.715375] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T19:27:00.902394] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-01T19:27:01.702353] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-01T19:27:01.976020] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T19:27:02.502385] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-01T19:27:02.558098] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T19:27:02.616190] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T19:27:03.302392] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-01T19:27:03.927504] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:27:04.102359] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-01T19:27:04.902395] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-01T19:27:05.085351] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T19:27:05.398091] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T19:27:05.702367] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-01T19:27:06.334879] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T19:27:06.502409] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-01T19:27:07.300270] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T19:27:07.303357] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-01T19:27:07.503366] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T19:27:08.102395] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-01T19:27:08.619807] [DEBUG] [REMOTE ] HOV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:27:08.620146] [WARN ] [REMOTE ] HOV: No data returned for month 2025-10 [2025-10-01T19:27:08.620269] [FATAL] [REMOTE ] HOV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:27:08.620381] [FATAL] [MAIN ] HOV: Failed to fetch primary data. [2025-10-01T19:27:08.620452] [WARN ] [MAIN ] HOV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:27:08.620528] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-01T19:27:08.620628] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-01T19:27:08.620722] [INFO ] [LOCAL ] HOV: Starting deletion of derivative data. [2025-10-01T19:27:08.621082] [DEBUG] [LOCAL ] HOV: Deleted derivative data file. [2025-10-01T19:27:08.621191] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 22.3s. Estimated remaining: 3h 7m 55s. Rate: 7.1 symbols/min [2025-10-01T19:27:08.818316] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:27:08.828801] [DEBUG] [LOCAL ] HPF: Loaded 7392 existing records from primary storage. [2025-10-01T19:27:08.829066] [INFO ] [MAIN ] HPF: Loaded 7392 existing records. [2025-10-01T19:27:08.902626] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-01T19:27:09.033051] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:27:09.033380] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-01T19:27:09.033465] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-01T19:27:09.033754] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-01T19:27:09.033838] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-01T19:27:09.241371] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T19:27:09.492971] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:27:09.702365] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-01T19:27:10.458417] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-01T19:27:10.502345] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-01T19:27:10.917968] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T19:27:11.302359] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-01T19:27:11.323245] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T19:27:12.102379] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-01T19:27:12.720390] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T19:27:12.907497] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-01T19:27:12.928436] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T19:27:13.702370] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-01T19:27:14.502401] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-01T19:27:14.615191] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T19:27:15.093876] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T19:27:15.302360] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-01T19:27:15.651844] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T19:27:16.102360] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-01T19:27:16.213433] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T19:27:16.902373] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-01T19:27:17.106247] [DEBUG] [REMOTE ] HOUS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:27:17.106576] [WARN ] [REMOTE ] HOUS: No data returned for month 2025-10 [2025-10-01T19:27:17.106695] [FATAL] [REMOTE ] HOUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:27:17.106783] [FATAL] [MAIN ] HOUS: Failed to fetch primary data. [2025-10-01T19:27:17.106849] [WARN ] [MAIN ] HOUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:27:17.106921] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-01T19:27:17.106986] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-01T19:27:17.107022] [INFO ] [LOCAL ] HOUS: Starting deletion of derivative data. [2025-10-01T19:27:17.107468] [DEBUG] [LOCAL ] HOUS: Deleted derivative data file. [2025-10-01T19:27:17.109316] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOUS took 30.8s. Estimated remaining: 3h 7m 47s. Rate: 7.1 symbols/min [2025-10-01T19:27:17.289698] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:27:17.302082] [DEBUG] [LOCAL ] HPI: Loaded 10334 existing records from primary storage. [2025-10-01T19:27:17.302328] [INFO ] [MAIN ] HPI: Loaded 10334 existing records. [2025-10-01T19:27:17.497568] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:27:17.497841] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-01T19:27:17.497903] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-01T19:27:17.498078] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-01T19:27:17.498137] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-01T19:27:17.677089] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T19:27:17.707469] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-01T19:27:17.900073] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:27:18.502395] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-01T19:27:19.094294] [DEBUG] [REMOTE ] HPE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:27:19.094699] [WARN ] [REMOTE ] HPE: No data returned for month 2025-10 [2025-10-01T19:27:19.095485] [FATAL] [REMOTE ] HPE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:27:19.095726] [FATAL] [MAIN ] HPE: Failed to fetch primary data. [2025-10-01T19:27:19.095804] [WARN ] [MAIN ] HPE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:27:19.095883] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-01T19:27:19.095960] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-01T19:27:19.096024] [INFO ] [LOCAL ] HPE: Starting deletion of derivative data. [2025-10-01T19:27:19.096407] [DEBUG] [LOCAL ] HPE: Deleted derivative data file. [2025-10-01T19:27:19.096507] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HPE took 32.8s. Estimated remaining: 3h 7m 30s. Rate: 7.1 symbols/min [2025-10-01T19:27:19.303928] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-01T19:27:19.300700] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T19:27:19.303851] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:27:19.360952] [DEBUG] [LOCAL ] HPP: Loaded 50907 existing records from primary storage. [2025-10-01T19:27:19.361335] [INFO ] [MAIN ] HPP: Loaded 50907 existing records. [2025-10-01T19:27:19.573260] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:27:19.573534] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-01T19:27:19.573612] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-01T19:27:19.573948] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-01T19:27:19.574029] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-01T19:27:19.994597] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:27:20.102386] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-01T19:27:20.848391] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T19:27:20.902382] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-01T19:27:20.978683] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T19:27:21.702382] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-01T19:27:22.502355] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-01T19:27:22.603776] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T19:27:22.775266] [DEBUG] [REMOTE ] HP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:27:22.775616] [WARN ] [REMOTE ] HP: No data returned for month 2025-10 [2025-10-01T19:27:22.775739] [FATAL] [REMOTE ] HP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:27:22.775826] [FATAL] [MAIN ] HP: Failed to fetch primary data. [2025-10-01T19:27:22.775892] [WARN ] [MAIN ] HP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:27:22.775967] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-01T19:27:22.776034] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-01T19:27:22.776073] [INFO ] [LOCAL ] HP: Starting deletion of derivative data. [2025-10-01T19:27:22.776476] [DEBUG] [LOCAL ] HP: Deleted derivative data file. [2025-10-01T19:27:22.776576] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 36.5s. Estimated remaining: 3h 7m 15s. Rate: 7.1 symbols/min [2025-10-01T19:27:22.971851] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:27:23.025066] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-01T19:27:23.025406] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-01T19:27:23.253990] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:27:23.254301] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-01T19:27:23.254356] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-01T19:27:23.254593] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-01T19:27:23.254693] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-01T19:27:23.307472] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-01T19:27:23.389364] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-01T19:27:23.736661] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:27:24.104268] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-01T19:27:24.108095] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T19:27:24.902378] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-01T19:27:25.595242] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-01T19:27:25.702399] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-01T19:27:25.785305] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T19:27:26.414698] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T19:27:26.502372] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-01T19:27:26.962541] [DEBUG] [REMOTE ] HPF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:27:26.962852] [WARN ] [REMOTE ] HPF: No data returned for month 2025-10 [2025-10-01T19:27:26.962962] [FATAL] [REMOTE ] HPF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:27:26.963072] [FATAL] [MAIN ] HPF: Failed to fetch primary data. [2025-10-01T19:27:26.963146] [WARN ] [MAIN ] HPF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:27:26.963223] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-01T19:27:26.963294] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-01T19:27:26.963335] [INFO ] [LOCAL ] HPF: Starting deletion of derivative data. [2025-10-01T19:27:26.963633] [DEBUG] [LOCAL ] HPF: Deleted derivative data file. [2025-10-01T19:27:26.963746] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 18.3s. Estimated remaining: 3h 7m 2s. Rate: 7.1 symbols/min [2025-10-01T19:27:27.154864] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:27:27.167400] [DEBUG] [LOCAL ] HPS: Loaded 10167 existing records from primary storage. [2025-10-01T19:27:27.167670] [INFO ] [MAIN ] HPS: Loaded 10167 existing records. [2025-10-01T19:27:27.318798] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-01T19:27:27.362998] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:27:27.363200] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-01T19:27:27.363253] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-01T19:27:27.363458] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-01T19:27:27.363519] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-01T19:27:27.746525] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:27:27.954590] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T19:27:28.102391] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-01T19:27:28.787509] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T19:27:28.902379] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-01T19:27:29.702392] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-01T19:27:30.459194] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T19:27:30.499298] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T19:27:30.502325] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-01T19:27:31.302386] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-01T19:27:31.314431] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:27:32.102383] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-01T19:27:32.802479] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T19:27:32.902397] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-01T19:27:33.114632] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T19:27:33.671519] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T19:27:33.702393] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-01T19:27:34.200453] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T19:27:34.502425] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-01T19:27:35.172245] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T19:27:35.302375] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-01T19:27:36.006156] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T19:27:36.102377] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-01T19:27:36.907127] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-01T19:27:36.910389] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T19:27:37.702407] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-01T19:27:38.510533] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-01T19:27:38.537191] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T19:27:39.256242] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T19:27:39.272997] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T19:27:39.302380] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-01T19:27:40.094335] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T19:27:40.102325] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-01T19:27:40.848406] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-01T19:27:40.902382] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-01T19:27:41.702385] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-01T19:27:41.876523] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T19:27:42.337062] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T19:27:42.502424] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-01T19:27:43.268858] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T19:27:43.302353] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-01T19:27:44.102429] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-01T19:27:44.136775] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T19:27:44.902425] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-01T19:27:45.704685] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-01T19:27:45.707726] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T19:27:45.758281] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T19:27:46.502381] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-01T19:27:47.065929] [DEBUG] [REMOTE ] HPI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:27:47.066275] [WARN ] [REMOTE ] HPI: No data returned for month 2025-10 [2025-10-01T19:27:47.066407] [FATAL] [REMOTE ] HPI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:27:47.066538] [FATAL] [MAIN ] HPI: Failed to fetch primary data. [2025-10-01T19:27:47.066624] [WARN ] [MAIN ] HPI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:27:47.066734] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-01T19:27:47.066827] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-01T19:27:47.066890] [INFO ] [LOCAL ] HPI: Starting deletion of derivative data. [2025-10-01T19:27:47.067214] [DEBUG] [LOCAL ] HPI: Deleted derivative data file. [2025-10-01T19:27:47.067325] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 30.0s. Estimated remaining: 3h 7m 8s. Rate: 7.1 symbols/min [2025-10-01T19:27:47.259106] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:27:47.287708] [DEBUG] [LOCAL ] HQH: Loaded 25151 existing records from primary storage. [2025-10-01T19:27:47.288023] [INFO ] [MAIN ] HQH: Loaded 25151 existing records. [2025-10-01T19:27:47.307527] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-01T19:27:47.509024] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:27:47.509672] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-01T19:27:47.525749] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-01T19:27:47.541884] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-01T19:27:47.542010] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-01T19:27:47.585711] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T19:27:47.990552] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:27:48.102397] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-01T19:27:48.902391] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-01T19:27:49.702358] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-01T19:27:49.788804] [DEBUG] [REMOTE ] HPS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:27:49.789160] [WARN ] [REMOTE ] HPS: No data returned for month 2025-10 [2025-10-01T19:27:49.789252] [FATAL] [REMOTE ] HPS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:27:49.789333] [FATAL] [MAIN ] HPS: Failed to fetch primary data. [2025-10-01T19:27:49.789397] [WARN ] [MAIN ] HPS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:27:49.789492] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-01T19:27:49.789582] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-01T19:27:49.789624] [INFO ] [LOCAL ] HPS: Starting deletion of derivative data. [2025-10-01T19:27:49.790205] [DEBUG] [LOCAL ] HPS: Deleted derivative data file. [2025-10-01T19:27:49.790303] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPS took 22.8s. Estimated remaining: 3h 6m 52s. Rate: 7.1 symbols/min [2025-10-01T19:27:49.991468] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:27:50.010236] [DEBUG] [LOCAL ] HQL: Loaded 16097 existing records from primary storage. [2025-10-01T19:27:50.010677] [INFO ] [MAIN ] HQL: Loaded 16097 existing records. [2025-10-01T19:27:50.218310] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:27:50.218765] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-01T19:27:50.218852] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-01T19:27:50.219332] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-01T19:27:50.219439] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-01T19:27:50.430188] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-01T19:27:50.510169] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-01T19:27:50.694972] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:27:50.714192] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T19:27:50.743803] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T19:27:51.302384] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-01T19:27:52.102427] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-01T19:27:52.441467] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T19:27:52.745908] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:27:52.902376] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-01T19:27:53.036989] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T19:27:53.702381] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-01T19:27:54.502343] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-01T19:27:54.689473] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T19:27:55.302324] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-01T19:27:55.386090] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T19:27:55.551364] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T19:27:56.102373] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-01T19:27:56.893045] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T19:27:56.904050] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-01T19:27:57.162318] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T19:27:57.702388] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-01T19:27:57.840210] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T19:27:58.502374] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-01T19:27:59.236106] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T19:27:59.302406] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-01T19:27:59.471020] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T19:28:00.100785] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T19:28:00.105982] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-01T19:28:00.902382] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-01T19:28:01.702397] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-01T19:28:01.935405] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T19:28:02.041713] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T19:28:02.502382] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-01T19:28:03.302398] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-01T19:28:03.356907] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T19:28:03.468988] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T19:28:04.102378] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-01T19:28:04.902388] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-01T19:28:04.973893] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T19:28:05.069550] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T19:28:05.702375] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-01T19:28:05.820583] [DEBUG] [REMOTE ] HPP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:28:05.820939] [WARN ] [REMOTE ] HPP: No data returned for month 2025-10 [2025-10-01T19:28:05.821030] [FATAL] [REMOTE ] HPP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:28:05.821142] [FATAL] [MAIN ] HPP: Failed to fetch primary data. [2025-10-01T19:28:05.821211] [WARN ] [MAIN ] HPP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:28:05.821283] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-01T19:28:05.821348] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-01T19:28:05.821386] [INFO ] [LOCAL ] HPP: Starting deletion of derivative data. [2025-10-01T19:28:05.821861] [DEBUG] [LOCAL ] HPP: Deleted derivative data file. [2025-10-01T19:28:05.821950] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 46.7s. Estimated remaining: 3h 6m 53s. Rate: 7.1 symbols/min [2025-10-01T19:28:06.005788] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:28:06.056362] [DEBUG] [LOCAL ] HR: Loaded 51939 existing records from primary storage. [2025-10-01T19:28:06.056732] [INFO ] [MAIN ] HR: Loaded 51939 existing records. [2025-10-01T19:28:06.252016] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:28:06.252244] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-01T19:28:06.252291] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-01T19:28:06.252602] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-01T19:28:06.252697] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-01T19:28:06.508692] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-01T19:28:06.644190] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:28:07.020041] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T19:28:07.302354] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-01T19:28:07.540434] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T19:28:08.102417] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-01T19:28:08.669091] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T19:28:08.902387] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-01T19:28:09.111048] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T19:28:09.702383] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-01T19:28:10.112890] [DEBUG] [REMOTE ] HPQ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:28:10.113286] [WARN ] [REMOTE ] HPQ: No data returned for month 2025-10 [2025-10-01T19:28:10.113383] [FATAL] [REMOTE ] HPQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:28:10.113467] [FATAL] [MAIN ] HPQ: Failed to fetch primary data. [2025-10-01T19:28:10.113535] [WARN ] [MAIN ] HPQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:28:10.113612] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-01T19:28:10.113754] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-01T19:28:10.113808] [INFO ] [LOCAL ] HPQ: Starting deletion of derivative data. [2025-10-01T19:28:10.114154] [DEBUG] [LOCAL ] HPQ: Deleted derivative data file. [2025-10-01T19:28:10.114245] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPQ took 47.3s. Estimated remaining: 3h 6m 39s. Rate: 7.1 symbols/min [2025-10-01T19:28:10.305196] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:28:10.350914] [DEBUG] [LOCAL ] HRB: Loaded 48466 existing records from primary storage. [2025-10-01T19:28:10.351287] [INFO ] [MAIN ] HRB: Loaded 48466 existing records. [2025-10-01T19:28:10.507599] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-01T19:28:10.591051] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:28:10.591306] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-01T19:28:10.591389] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-01T19:28:10.591873] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-01T19:28:10.591933] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-01T19:28:10.984771] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:28:11.044850] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T19:28:11.302396] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-01T19:28:11.571333] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T19:28:12.102403] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-01T19:28:12.659063] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T19:28:12.902385] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-01T19:28:13.461063] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T19:28:13.702380] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-01T19:28:14.094045] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T19:28:14.502384] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-01T19:28:15.134752] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T19:28:15.302414] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-01T19:28:15.581241] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T19:28:16.102465] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-01T19:28:16.455378] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T19:28:16.902387] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-01T19:28:17.188169] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T19:28:17.702392] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-01T19:28:18.502385] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-01T19:28:18.506616] [DEBUG] [REMOTE ] HQH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:28:18.507086] [WARN ] [REMOTE ] HQH: No data returned for month 2025-10 [2025-10-01T19:28:18.507191] [FATAL] [REMOTE ] HQH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:28:18.507315] [FATAL] [MAIN ] HQH: Failed to fetch primary data. [2025-10-01T19:28:18.507399] [WARN ] [MAIN ] HQH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:28:18.507480] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-01T19:28:18.507589] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-01T19:28:18.507672] [INFO ] [LOCAL ] HQH: Starting deletion of derivative data. [2025-10-01T19:28:18.508238] [DEBUG] [LOCAL ] HQH: Deleted derivative data file. [2025-10-01T19:28:18.508425] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HQH took 31.4s. Estimated remaining: 3h 6m 31s. Rate: 7.1 symbols/min [2025-10-01T19:28:18.703933] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:28:18.736449] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T19:28:18.786013] [DEBUG] [LOCAL ] HRI: Loaded 32784 existing records from primary storage. [2025-10-01T19:28:18.786373] [INFO ] [MAIN ] HRI: Loaded 32784 existing records. [2025-10-01T19:28:18.978873] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:28:18.979136] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-01T19:28:18.979195] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-01T19:28:18.979457] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-01T19:28:18.979525] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-01T19:28:19.307534] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-01T19:28:19.389267] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:28:20.102363] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-01T19:28:20.316424] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T19:28:20.427736] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T19:28:20.902384] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-01T19:28:21.010496] [DEBUG] [REMOTE ] HQL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-01T19:28:21.010876] [WARN ] [REMOTE ] HQL: No data returned for month 2025-07 [2025-10-01T19:28:21.010970] [FATAL] [REMOTE ] HQL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:28:21.011056] [FATAL] [MAIN ] HQL: Failed to fetch primary data. [2025-10-01T19:28:21.011122] [WARN ] [MAIN ] HQL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:28:21.011202] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-01T19:28:21.011283] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-01T19:28:21.011341] [INFO ] [LOCAL ] HQL: Starting deletion of derivative data. [2025-10-01T19:28:21.011805] [DEBUG] [LOCAL ] HQL: Deleted derivative data file. [2025-10-01T19:28:21.011913] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQL took 31.2s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-01T19:28:21.199781] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:28:21.255281] [DEBUG] [LOCAL ] HRL: Loaded 53075 existing records from primary storage. [2025-10-01T19:28:21.255744] [INFO ] [MAIN ] HRL: Loaded 53075 existing records. [2025-10-01T19:28:21.466992] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:28:21.467381] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-01T19:28:21.467538] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-01T19:28:21.467986] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-01T19:28:21.468064] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-01T19:28:21.705536] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-01T19:28:21.831447] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T19:28:21.933479] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:28:22.502384] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-01T19:28:23.303446] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-01T19:28:23.309869] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:28:23.977851] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T19:28:24.102371] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-01T19:28:24.229611] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T19:28:24.902373] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-01T19:28:25.598556] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:28:25.702394] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-01T19:28:25.848831] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T19:28:26.502419] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-01T19:28:27.302363] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-01T19:28:27.384854] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T19:28:27.912851] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T19:28:28.102389] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-01T19:28:28.652024] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T19:28:28.902419] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-01T19:28:29.551787] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T19:28:29.702397] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-01T19:28:30.293707] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T19:28:30.502381] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-01T19:28:31.265802] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T19:28:31.302353] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-01T19:28:32.105850] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-01T19:28:32.116591] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T19:28:32.651175] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T19:28:32.902412] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-01T19:28:33.702364] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-01T19:28:33.779632] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T19:28:34.510292] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-01T19:28:34.529991] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T19:28:35.302400] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-01T19:28:35.459688] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T19:28:35.977509] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T19:28:36.102396] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-01T19:28:36.315115] [DEBUG] [REMOTE ] HRB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:28:36.315485] [WARN ] [REMOTE ] HRB: No data returned for month 2025-10 [2025-10-01T19:28:36.315598] [FATAL] [REMOTE ] HRB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:28:36.315759] [FATAL] [MAIN ] HRB: Failed to fetch primary data. [2025-10-01T19:28:36.315841] [WARN ] [MAIN ] HRB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:28:36.315943] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-01T19:28:36.316039] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-01T19:28:36.316115] [INFO ] [LOCAL ] HRB: Starting deletion of derivative data. [2025-10-01T19:28:36.316551] [DEBUG] [LOCAL ] HRB: Deleted derivative data file. [2025-10-01T19:28:36.316696] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HRB took 26.2s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-01T19:28:36.539922] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:28:36.572739] [DEBUG] [LOCAL ] HRTG: Loaded 33359 existing records from primary storage. [2025-10-01T19:28:36.573013] [INFO ] [MAIN ] HRTG: Loaded 33359 existing records. [2025-10-01T19:28:36.764501] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:28:36.764767] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-01T19:28:36.764818] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-01T19:28:36.765173] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-01T19:28:36.765234] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-01T19:28:36.917888] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-01T19:28:37.206533] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:28:37.702379] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-01T19:28:37.788065] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T19:28:38.326573] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T19:28:38.502387] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-01T19:28:38.747551] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T19:28:39.302388] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-01T19:28:40.102384] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-01T19:28:40.246338] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T19:28:40.387925] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T19:28:40.902381] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-01T19:28:41.659453] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T19:28:41.702377] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-01T19:28:41.825310] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T19:28:42.502387] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-01T19:28:43.093695] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T19:28:43.302398] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-01T19:28:43.996914] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T19:28:44.102351] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-01T19:28:44.538755] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T19:28:44.902390] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-01T19:28:45.702401] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-01T19:28:46.004340] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T19:28:46.322962] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T19:28:46.502460] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-01T19:28:46.817241] [DEBUG] [REMOTE ] HR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:28:46.817693] [WARN ] [REMOTE ] HR: No data returned for month 2025-10 [2025-10-01T19:28:46.817857] [FATAL] [REMOTE ] HR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:28:46.817982] [FATAL] [MAIN ] HR: Failed to fetch primary data. [2025-10-01T19:28:46.818042] [WARN ] [MAIN ] HR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:28:46.818085] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-01T19:28:46.818147] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-01T19:28:46.818184] [INFO ] [LOCAL ] HR: Starting deletion of derivative data. [2025-10-01T19:28:46.818616] [DEBUG] [LOCAL ] HR: Deleted derivative data file. [2025-10-01T19:28:46.818761] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 41.0s. Estimated remaining: 3h 6m 9s. Rate: 7.1 symbols/min [2025-10-01T19:28:46.998139] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:28:47.047990] [DEBUG] [LOCAL ] HSBC: Loaded 51058 existing records from primary storage. [2025-10-01T19:28:47.048385] [INFO ] [MAIN ] HSBC: Loaded 51058 existing records. [2025-10-01T19:28:47.255490] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:28:47.255720] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-01T19:28:47.255778] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-01T19:28:47.256102] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-01T19:28:47.256164] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-01T19:28:47.309751] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-01T19:28:47.571580] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T19:28:47.692038] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:28:48.102415] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-01T19:28:48.293143] [DEBUG] [REMOTE ] HRI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:28:48.293720] [WARN ] [REMOTE ] HRI: No data returned for month 2025-10 [2025-10-01T19:28:48.293921] [FATAL] [REMOTE ] HRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:28:48.294037] [FATAL] [MAIN ] HRI: Failed to fetch primary data. [2025-10-01T19:28:48.294078] [WARN ] [MAIN ] HRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:28:48.294196] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-01T19:28:48.294287] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-01T19:28:48.294330] [INFO ] [LOCAL ] HRI: Starting deletion of derivative data. [2025-10-01T19:28:48.294963] [DEBUG] [LOCAL ] HRI: Deleted derivative data file. [2025-10-01T19:28:48.295065] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRI took 29.8s. Estimated remaining: 3h 5m 52s. Rate: 7.1 symbols/min [2025-10-01T19:28:48.468757] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:28:48.490228] [DEBUG] [LOCAL ] HSHP: Loaded 15280 existing records from primary storage. [2025-10-01T19:28:48.490626] [INFO ] [MAIN ] HSHP: Loaded 15280 existing records. [2025-10-01T19:28:48.714523] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:28:48.714804] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-01T19:28:48.714857] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-01T19:28:48.715607] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-01T19:28:48.716046] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-01T19:28:48.912580] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-01T19:28:49.108290] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:28:49.523948] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T19:28:49.702443] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-01T19:28:50.483040] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T19:28:50.502349] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-01T19:28:51.231573] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T19:28:51.302396] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-01T19:28:52.102407] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-01T19:28:52.257345] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T19:28:52.298862] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T19:28:52.902367] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-01T19:28:53.532463] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:28:53.702378] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-01T19:28:54.502384] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-01T19:28:54.689468] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T19:28:55.002463] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T19:28:55.302381] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-01T19:28:55.542216] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T19:28:55.823573] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T19:28:56.102386] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-01T19:28:56.902386] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-01T19:28:57.702364] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-01T19:28:57.937048] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T19:28:58.502410] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-01T19:28:58.566806] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T19:28:59.120941] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T19:28:59.302401] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-01T19:28:59.508456] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T19:29:00.102421] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-01T19:29:00.902355] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-01T19:29:01.003615] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T19:29:01.702465] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-01T19:29:01.705395] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T19:29:02.344963] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T19:29:02.502367] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-01T19:29:02.825705] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T19:29:03.302378] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-01T19:29:04.102381] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-01T19:29:04.342475] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T19:29:04.561570] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-01T19:29:04.898776] [DEBUG] [REMOTE ] HRTG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:04.899103] [WARN ] [REMOTE ] HRTG: No data returned for month 2025-10 [2025-10-01T19:29:04.899209] [FATAL] [REMOTE ] HRTG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:04.899339] [FATAL] [MAIN ] HRTG: Failed to fetch primary data. [2025-10-01T19:29:04.899410] [WARN ] [MAIN ] HRTG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:04.899505] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-01T19:29:04.899598] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-01T19:29:04.899682] [INFO ] [LOCAL ] HRTG: Starting deletion of derivative data. [2025-10-01T19:29:04.899978] [DEBUG] [LOCAL ] HRTG: Deleted derivative data file. [2025-10-01T19:29:04.900087] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRTG took 28.6s. Estimated remaining: 3h 5m 54s. Rate: 7.1 symbols/min [2025-10-01T19:29:04.912001] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-01T19:29:05.090096] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:05.141779] [DEBUG] [LOCAL ] HSY: Loaded 50351 existing records from primary storage. [2025-10-01T19:29:05.142188] [INFO ] [MAIN ] HSY: Loaded 50351 existing records. [2025-10-01T19:29:05.341111] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:29:05.341354] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-01T19:29:05.341406] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-01T19:29:05.341690] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-01T19:29:05.341752] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-01T19:29:05.708089] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-01T19:29:05.756606] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:29:05.765581] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-01T19:29:06.502396] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-01T19:29:06.921444] [DEBUG] [REMOTE ] HRL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:06.921823] [WARN ] [REMOTE ] HRL: No data returned for month 2025-10 [2025-10-01T19:29:06.921929] [FATAL] [REMOTE ] HRL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:06.922085] [FATAL] [MAIN ] HRL: Failed to fetch primary data. [2025-10-01T19:29:06.922179] [WARN ] [MAIN ] HRL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:06.922268] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-01T19:29:06.922360] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-01T19:29:06.922411] [INFO ] [LOCAL ] HRL: Starting deletion of derivative data. [2025-10-01T19:29:06.922907] [DEBUG] [LOCAL ] HRL: Deleted derivative data file. [2025-10-01T19:29:06.922997] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRL took 45.9s. Estimated remaining: 3h 5m 37s. Rate: 7.1 symbols/min [2025-10-01T19:29:07.115516] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:07.116619] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-01T19:29:07.116698] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-01T19:29:07.116925] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-01T19:29:07.116998] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-01T19:29:07.117056] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-01T19:29:07.117092] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-01T19:29:07.312871] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-01T19:29:07.518140] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:29:08.109829] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-01T19:29:08.116718] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T19:29:08.474675] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T19:29:08.902405] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-01T19:29:09.702364] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-01T19:29:09.892315] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T19:29:09.903461] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:09.904932] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-01T19:29:09.905143] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:09.905286] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-01T19:29:09.905355] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:09.905625] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-01T19:29:09.910966] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-01T19:29:09.915941] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-01T19:29:09.916074] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-01T19:29:09.916702] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HTB took 3.0s. Estimated remaining: 3h 5m 22s. Rate: 7.1 symbols/min [2025-10-01T19:29:09.917053] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T19:29:10.118375] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:10.137578] [DEBUG] [LOCAL ] HTD: Loaded 13765 existing records from primary storage. [2025-10-01T19:29:10.137887] [INFO ] [MAIN ] HTD: Loaded 13765 existing records. [2025-10-01T19:29:10.337680] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:29:10.337937] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-01T19:29:10.337990] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-01T19:29:10.338537] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-01T19:29:10.338598] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-01T19:29:10.507570] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-01T19:29:10.775981] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:29:11.302387] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-01T19:29:12.014102] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-01T19:29:12.105948] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-01T19:29:12.119620] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T19:29:12.902384] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-01T19:29:13.702403] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-01T19:29:13.988112] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T19:29:14.511846] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-01T19:29:14.517980] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T19:29:14.715351] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T19:29:15.302380] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-01T19:29:16.102385] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-01T19:29:16.365258] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-01T19:29:16.902381] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-01T19:29:17.563853] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T19:29:17.702387] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-01T19:29:17.828135] [DEBUG] [REMOTE ] HSHP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:17.828454] [WARN ] [REMOTE ] HSHP: No data returned for month 2025-10 [2025-10-01T19:29:17.828550] [FATAL] [REMOTE ] HSHP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:17.828681] [FATAL] [MAIN ] HSHP: Failed to fetch primary data. [2025-10-01T19:29:17.828756] [WARN ] [MAIN ] HSHP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:17.828831] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-01T19:29:17.828897] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-01T19:29:17.828993] [INFO ] [LOCAL ] HSHP: Starting deletion of derivative data. [2025-10-01T19:29:17.829521] [DEBUG] [LOCAL ] HSHP: Deleted derivative data file. [2025-10-01T19:29:17.829620] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 29.5s. Estimated remaining: 3h 5m 13s. Rate: 7.1 symbols/min [2025-10-01T19:29:18.032408] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T19:29:18.034214] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:18.038179] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-01T19:29:18.038263] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-01T19:29:18.038422] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-01T19:29:18.038474] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-01T19:29:18.038522] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-01T19:29:18.038558] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-01T19:29:18.415720] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:29:18.502384] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-01T19:29:18.822153] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-01T19:29:19.302352] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-01T19:29:19.427745] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T19:29:20.102377] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-01T19:29:20.681314] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T19:29:20.902385] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-01T19:29:21.130529] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-01T19:29:21.551439] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T19:29:21.702382] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-01T19:29:22.179666] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T19:29:22.502395] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-01T19:29:23.302377] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-01T19:29:23.682615] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-01T19:29:24.102406] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-01T19:29:24.902447] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-01T19:29:25.331681] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-01T19:29:25.526111] [DEBUG] [REMOTE ] HSBC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:25.526529] [WARN ] [REMOTE ] HSBC: No data returned for month 2025-10 [2025-10-01T19:29:25.526605] [FATAL] [REMOTE ] HSBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:25.526747] [FATAL] [MAIN ] HSBC: Failed to fetch primary data. [2025-10-01T19:29:25.526816] [WARN ] [MAIN ] HSBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:25.526889] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-01T19:29:25.526955] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-01T19:29:25.527019] [INFO ] [LOCAL ] HSBC: Starting deletion of derivative data. [2025-10-01T19:29:25.527511] [DEBUG] [LOCAL ] HSBC: Deleted derivative data file. [2025-10-01T19:29:25.527612] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 38.7s. Estimated remaining: 3h 5m 3s. Rate: 7.1 symbols/min [2025-10-01T19:29:25.717969] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:25.707619] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-01T19:29:25.770160] [DEBUG] [LOCAL ] HTGC: Loaded 47389 existing records from primary storage. [2025-10-01T19:29:25.770563] [INFO ] [MAIN ] HTGC: Loaded 47389 existing records. [2025-10-01T19:29:25.968351] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:29:25.968634] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-01T19:29:25.968718] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-01T19:29:25.969022] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-01T19:29:25.969092] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-01T19:29:26.125053] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-01T19:29:26.434111] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:29:26.502429] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-01T19:29:26.519313] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:29:27.302377] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-01T19:29:28.059130] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T19:29:28.102355] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-01T19:29:28.745965] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T19:29:28.902367] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-01T19:29:29.702681] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-01T19:29:29.703025] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T19:29:29.848448] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T19:29:30.502425] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-01T19:29:30.843734] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-01T19:29:31.166471] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T19:29:31.302382] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-01T19:29:31.626512] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-01T19:29:32.102396] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-01T19:29:32.902387] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-01T19:29:33.612345] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T19:29:33.702385] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-01T19:29:34.091070] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T19:29:34.502395] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-01T19:29:34.797033] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-01T19:29:35.085349] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T19:29:35.302373] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-01T19:29:35.520366] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-01T19:29:36.102436] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-01T19:29:36.902391] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-01T19:29:37.159976] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-01T19:29:37.702416] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-01T19:29:38.463135] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T19:29:38.502356] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-01T19:29:39.302348] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-01T19:29:39.409954] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T19:29:39.595059] [DEBUG] [REMOTE ] HSY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:39.595367] [WARN ] [REMOTE ] HSY: No data returned for month 2025-10 [2025-10-01T19:29:39.595460] [FATAL] [REMOTE ] HSY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:39.595562] [FATAL] [MAIN ] HSY: Failed to fetch primary data. [2025-10-01T19:29:39.595634] [WARN ] [MAIN ] HSY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:39.595786] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-01T19:29:39.595851] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-01T19:29:39.595889] [INFO ] [LOCAL ] HSY: Starting deletion of derivative data. [2025-10-01T19:29:39.596310] [DEBUG] [LOCAL ] HSY: Deleted derivative data file. [2025-10-01T19:29:39.596397] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSY took 34.7s. Estimated remaining: 3h 5m 2s. Rate: 7.1 symbols/min [2025-10-01T19:29:39.795045] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:39.828879] [DEBUG] [LOCAL ] HTH: Loaded 32188 existing records from primary storage. [2025-10-01T19:29:39.829147] [INFO ] [MAIN ] HTH: Loaded 32188 existing records. [2025-10-01T19:29:40.025752] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:29:40.026055] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-01T19:29:40.026265] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-01T19:29:40.026902] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-01T19:29:40.026966] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-01T19:29:40.107584] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-01T19:29:40.176949] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T19:29:40.425049] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-01T19:29:40.452222] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:29:40.902382] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-01T19:29:41.702395] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-01T19:29:42.354056] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T19:29:42.482706] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T19:29:42.502375] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-01T19:29:43.302362] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-01T19:29:43.571711] [DEBUG] [REMOTE ] HTFC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:43.572085] [WARN ] [REMOTE ] HTFC: No data returned for month 2025-10 [2025-10-01T19:29:43.572170] [FATAL] [REMOTE ] HTFC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:43.572279] [FATAL] [MAIN ] HTFC: Failed to fetch primary data. [2025-10-01T19:29:43.572354] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:43.572428] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-01T19:29:43.572492] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-01T19:29:43.572528] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-01T19:29:43.572623] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-01T19:29:43.572722] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTFC took 25.7s. Estimated remaining: 3h 4m 48s. Rate: 7.1 symbols/min [2025-10-01T19:29:43.735919] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T19:29:43.798016] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:43.841370] [DEBUG] [LOCAL ] HUBB: Loaded 36727 existing records from primary storage. [2025-10-01T19:29:43.841733] [INFO ] [MAIN ] HUBB: Loaded 36727 existing records. [2025-10-01T19:29:44.038894] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:29:44.039130] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-01T19:29:44.039180] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-01T19:29:44.039738] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-01T19:29:44.039801] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-01T19:29:44.112060] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-01T19:29:44.471435] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:29:44.902385] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-01T19:29:45.702400] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-01T19:29:45.850219] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T19:29:46.251801] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T19:29:46.266190] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T19:29:46.502414] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-01T19:29:47.302401] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-01T19:29:48.102363] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-01T19:29:48.129278] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T19:29:48.465098] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T19:29:48.902383] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-01T19:29:49.517583] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T19:29:49.702403] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-01T19:29:50.345964] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T19:29:50.502361] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-01T19:29:50.699711] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T19:29:51.302381] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-01T19:29:51.834229] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T19:29:52.102386] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-01T19:29:52.902397] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-01T19:29:53.008500] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T19:29:53.548583] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T19:29:53.702398] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-01T19:29:54.263255] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T19:29:54.502458] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-01T19:29:55.307719] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-01T19:29:55.314383] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T19:29:55.783680] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T19:29:55.839008] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-01T19:29:56.102423] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-01T19:29:56.902401] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-01T19:29:57.703214] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-01T19:29:57.706809] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T19:29:58.259092] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T19:29:58.502360] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-01T19:29:58.533043] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T19:29:59.302395] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-01T19:29:59.406627] [DEBUG] [REMOTE ] HTGC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:29:59.406981] [WARN ] [REMOTE ] HTGC: No data returned for month 2025-10 [2025-10-01T19:29:59.407080] [FATAL] [REMOTE ] HTGC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:29:59.407164] [FATAL] [MAIN ] HTGC: Failed to fetch primary data. [2025-10-01T19:29:59.407230] [WARN ] [MAIN ] HTGC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:29:59.407305] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-01T19:29:59.407370] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-01T19:29:59.407410] [INFO ] [LOCAL ] HTGC: Starting deletion of derivative data. [2025-10-01T19:29:59.407988] [DEBUG] [LOCAL ] HTGC: Deleted derivative data file. [2025-10-01T19:29:59.408083] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTGC took 33.9s. Estimated remaining: 3h 4m 48s. Rate: 7.1 symbols/min [2025-10-01T19:29:59.594817] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:29:59.638786] [DEBUG] [LOCAL ] HUBS: Loaded 39238 existing records from primary storage. [2025-10-01T19:29:59.639127] [INFO ] [MAIN ] HUBS: Loaded 39238 existing records. [2025-10-01T19:29:59.842049] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:29:59.842319] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-01T19:29:59.842379] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-01T19:29:59.842580] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-01T19:29:59.842673] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-01T19:30:00.113241] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-01T19:30:00.260115] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:00.711535] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T19:30:00.902385] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-01T19:30:01.342851] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T19:30:01.613167] [DEBUG] [REMOTE ] HTD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:30:01.613581] [WARN ] [REMOTE ] HTD: No data returned for month 2025-10 [2025-10-01T19:30:01.613745] [FATAL] [REMOTE ] HTD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:30:01.613917] [FATAL] [MAIN ] HTD: Failed to fetch primary data. [2025-10-01T19:30:01.613999] [WARN ] [MAIN ] HTD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:30:01.614087] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-01T19:30:01.614199] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-01T19:30:01.614253] [INFO ] [LOCAL ] HTD: Starting deletion of derivative data. [2025-10-01T19:30:01.614796] [DEBUG] [LOCAL ] HTD: Deleted derivative data file. [2025-10-01T19:30:01.614887] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTD took 51.7s. Estimated remaining: 3h 4m 32s. Rate: 7.1 symbols/min [2025-10-01T19:30:01.707550] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-01T19:30:01.831926] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:30:01.890698] [DEBUG] [LOCAL ] HUM: Loaded 48794 existing records from primary storage. [2025-10-01T19:30:01.891109] [INFO ] [MAIN ] HUM: Loaded 48794 existing records. [2025-10-01T19:30:02.113896] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:30:02.114113] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-01T19:30:02.114163] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-01T19:30:02.115270] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-01T19:30:02.115333] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-01T19:30:02.507516] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-01T19:30:02.542597] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:03.302353] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-01T19:30:03.488542] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T19:30:04.102387] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-01T19:30:04.420509] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T19:30:04.902459] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-01T19:30:05.275776] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T19:30:05.455916] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T19:30:05.702403] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-01T19:30:06.424754] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T19:30:06.502463] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-01T19:30:07.125401] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T19:30:07.302388] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-01T19:30:08.049243] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T19:30:08.102431] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-01T19:30:08.649295] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T19:30:08.902396] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-01T19:30:09.702378] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-01T19:30:09.766292] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T19:30:10.384032] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T19:30:10.502390] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-01T19:30:11.302412] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-01T19:30:11.470334] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T19:30:12.102384] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-01T19:30:12.189072] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T19:30:12.246227] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T19:30:12.902376] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-01T19:30:13.679614] [DEBUG] [REMOTE ] HTH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:30:13.680001] [WARN ] [REMOTE ] HTH: No data returned for month 2025-10 [2025-10-01T19:30:13.680096] [FATAL] [REMOTE ] HTH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:30:13.680179] [FATAL] [MAIN ] HTH: Failed to fetch primary data. [2025-10-01T19:30:13.680245] [WARN ] [MAIN ] HTH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:30:13.680320] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-01T19:30:13.680385] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-01T19:30:13.680421] [INFO ] [LOCAL ] HTH: Starting deletion of derivative data. [2025-10-01T19:30:13.680963] [DEBUG] [LOCAL ] HTH: Deleted derivative data file. [2025-10-01T19:30:13.681055] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 34.1s. Estimated remaining: 3h 4m 28s. Rate: 7.1 symbols/min [2025-10-01T19:30:13.721313] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-01T19:30:13.884363] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:30:13.917794] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T19:30:13.979080] [DEBUG] [LOCAL ] HUN: Loaded 53197 existing records from primary storage. [2025-10-01T19:30:13.979502] [INFO ] [MAIN ] HUN: Loaded 53197 existing records. [2025-10-01T19:30:14.171904] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:30:14.172109] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-01T19:30:14.172156] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-01T19:30:14.172626] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-01T19:30:14.172722] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-01T19:30:14.507466] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-01T19:30:14.580090] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:15.263954] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T19:30:15.302365] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-01T19:30:16.077200] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T19:30:16.102449] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-01T19:30:16.404014] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T19:30:16.902401] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-01T19:30:17.702383] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-01T19:30:17.839535] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T19:30:18.429332] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T19:30:18.502370] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-01T19:30:19.302378] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-01T19:30:19.321684] [DEBUG] [REMOTE ] HUBB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:30:19.321979] [WARN ] [REMOTE ] HUBB: No data returned for month 2025-10 [2025-10-01T19:30:19.322073] [FATAL] [REMOTE ] HUBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:30:19.322159] [FATAL] [MAIN ] HUBB: Failed to fetch primary data. [2025-10-01T19:30:19.322227] [WARN ] [MAIN ] HUBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:30:19.322301] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-01T19:30:19.322366] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-01T19:30:19.322405] [INFO ] [LOCAL ] HUBB: Starting deletion of derivative data. [2025-10-01T19:30:19.322903] [DEBUG] [LOCAL ] HUBB: Deleted derivative data file. [2025-10-01T19:30:19.322991] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 35.8s. Estimated remaining: 3h 4m 16s. Rate: 7.1 symbols/min [2025-10-01T19:30:19.514629] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:30:19.563976] [DEBUG] [LOCAL ] HUYA: Loaded 44164 existing records from primary storage. [2025-10-01T19:30:19.564328] [INFO ] [MAIN ] HUYA: Loaded 44164 existing records. [2025-10-01T19:30:19.764313] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:30:19.764538] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-01T19:30:19.764592] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-01T19:30:19.764856] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-01T19:30:19.764924] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-01T19:30:20.105984] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-01T19:30:20.175081] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:20.254447] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T19:30:20.533756] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T19:30:20.902381] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-01T19:30:21.557601] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T19:30:21.702382] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-01T19:30:22.502352] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-01T19:30:22.776300] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T19:30:23.227241] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T19:30:23.302424] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-01T19:30:23.827336] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T19:30:24.102388] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-01T19:30:24.794485] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T19:30:24.902400] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-01T19:30:25.230717] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T19:30:25.702429] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-01T19:30:26.502430] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-01T19:30:26.762219] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T19:30:27.119538] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T19:30:27.302383] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-01T19:30:28.102414] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-01T19:30:28.246696] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T19:30:28.902353] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-01T19:30:28.948177] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T19:30:29.646720] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T19:30:29.702350] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-01T19:30:30.414614] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T19:30:30.502426] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-01T19:30:30.974494] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T19:30:31.302381] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-01T19:30:32.102432] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-01T19:30:32.902358] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-01T19:30:33.176986] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T19:30:33.478496] [DEBUG] [REMOTE ] HUBS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:30:33.478989] [WARN ] [REMOTE ] HUBS: No data returned for month 2025-10 [2025-10-01T19:30:33.479101] [FATAL] [REMOTE ] HUBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:30:33.479187] [FATAL] [MAIN ] HUBS: Failed to fetch primary data. [2025-10-01T19:30:33.479232] [WARN ] [MAIN ] HUBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:30:33.479276] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-01T19:30:33.479366] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-01T19:30:33.479425] [INFO ] [LOCAL ] HUBS: Starting deletion of derivative data. [2025-10-01T19:30:33.479922] [DEBUG] [LOCAL ] HUBS: Deleted derivative data file. [2025-10-01T19:30:33.480047] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 34.1s. Estimated remaining: 3h 4m 15s. Rate: 7.1 symbols/min [2025-10-01T19:30:33.703101] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-01T19:30:33.703020] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:30:33.699102] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T19:30:33.729104] [DEBUG] [LOCAL ] HVT: Loaded 15579 existing records from primary storage. [2025-10-01T19:30:33.729382] [INFO ] [MAIN ] HVT: Loaded 15579 existing records. [2025-10-01T19:30:33.927879] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:30:33.928091] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-01T19:30:33.928138] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-01T19:30:33.928311] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-01T19:30:33.928369] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-01T19:30:34.325963] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:34.502438] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-01T19:30:34.635421] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T19:30:35.302402] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-01T19:30:35.405823] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T19:30:35.922633] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:30:36.102358] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-01T19:30:36.307753] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T19:30:36.902412] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-01T19:30:37.702385] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-01T19:30:37.801313] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T19:30:37.824424] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T19:30:38.502430] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-01T19:30:39.258398] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T19:30:39.302344] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-01T19:30:40.102360] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-01T19:30:40.272246] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T19:30:40.874827] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T19:30:40.902348] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-01T19:30:41.084878] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T19:30:41.702416] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-01T19:30:42.439718] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T19:30:42.502366] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-01T19:30:43.216184] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T19:30:43.300377] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T19:30:43.305040] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-01T19:30:44.102440] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-01T19:30:44.902367] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-01T19:30:45.197933] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T19:30:45.702391] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-01T19:30:46.062739] [DEBUG] [REMOTE ] HUN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:30:46.063074] [WARN ] [REMOTE ] HUN: No data returned for month 2025-10 [2025-10-01T19:30:46.063185] [FATAL] [REMOTE ] HUN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:30:46.063316] [FATAL] [MAIN ] HUN: Failed to fetch primary data. [2025-10-01T19:30:46.063385] [WARN ] [MAIN ] HUN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:30:46.063482] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-01T19:30:46.063597] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-01T19:30:46.063686] [INFO ] [LOCAL ] HUN: Starting deletion of derivative data. [2025-10-01T19:30:46.064096] [DEBUG] [LOCAL ] HUN: Deleted derivative data file. [2025-10-01T19:30:46.064249] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUN took 32.4s. Estimated remaining: 3h 4m 11s. Rate: 7.1 symbols/min [2025-10-01T19:30:46.276090] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:30:46.331102] [DEBUG] [LOCAL ] HWM: Loaded 52974 existing records from primary storage. [2025-10-01T19:30:46.331497] [INFO ] [MAIN ] HWM: Loaded 52974 existing records. [2025-10-01T19:30:46.512782] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-01T19:30:46.537435] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:30:46.538611] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-01T19:30:46.538703] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-01T19:30:46.539012] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-01T19:30:46.539071] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-01T19:30:46.918235] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T19:30:47.003557] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:47.302414] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-01T19:30:47.305824] [DEBUG] [REMOTE ] HUYA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:30:47.306073] [WARN ] [REMOTE ] HUYA: No data returned for month 2025-10 [2025-10-01T19:30:47.306163] [FATAL] [REMOTE ] HUYA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:30:47.306250] [FATAL] [MAIN ] HUYA: Failed to fetch primary data. [2025-10-01T19:30:47.306605] [WARN ] [MAIN ] HUYA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:30:47.306823] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-01T19:30:47.306885] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-01T19:30:47.306924] [INFO ] [LOCAL ] HUYA: Starting deletion of derivative data. [2025-10-01T19:30:47.307445] [DEBUG] [LOCAL ] HUYA: Deleted derivative data file. [2025-10-01T19:30:47.307537] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUYA took 28.0s. Estimated remaining: 3h 3m 54s. Rate: 7.1 symbols/min [2025-10-01T19:30:47.506800] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:30:47.552916] [DEBUG] [LOCAL ] HXL: Loaded 46000 existing records from primary storage. [2025-10-01T19:30:47.553244] [INFO ] [MAIN ] HXL: Loaded 46000 existing records. [2025-10-01T19:30:47.778846] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:30:47.779102] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-01T19:30:47.779152] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-01T19:30:47.780555] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-01T19:30:47.780618] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-01T19:30:48.107489] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-01T19:30:48.222114] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:48.303719] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T19:30:48.718448] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T19:30:48.902353] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-01T19:30:49.308172] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T19:30:49.702421] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-01T19:30:50.366341] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T19:30:50.502428] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-01T19:30:51.302432] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-01T19:30:51.522342] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T19:30:51.811693] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-01T19:30:52.062006] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T19:30:52.102374] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-01T19:30:52.902445] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-01T19:30:53.619561] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T19:30:53.702401] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-01T19:30:54.502366] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-01T19:30:54.632027] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T19:30:55.302428] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-01T19:30:55.351564] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T19:30:55.759312] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T19:30:56.102386] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-01T19:30:56.902392] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-01T19:30:57.010095] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T19:30:57.702401] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-01T19:30:58.475152] [DEBUG] [REMOTE ] HUM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:30:58.475506] [WARN ] [REMOTE ] HUM: No data returned for month 2025-10 [2025-10-01T19:30:58.475580] [FATAL] [REMOTE ] HUM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:30:58.475690] [FATAL] [MAIN ] HUM: Failed to fetch primary data. [2025-10-01T19:30:58.475754] [WARN ] [MAIN ] HUM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:30:58.475825] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-01T19:30:58.475891] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-01T19:30:58.475928] [INFO ] [LOCAL ] HUM: Starting deletion of derivative data. [2025-10-01T19:30:58.476375] [DEBUG] [LOCAL ] HUM: Deleted derivative data file. [2025-10-01T19:30:58.476468] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUM took 56.9s. Estimated remaining: 3h 3m 49s. Rate: 7.1 symbols/min [2025-10-01T19:30:58.509983] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-01T19:30:58.664773] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:30:58.677459] [DEBUG] [LOCAL ] HY: Loaded 9962 existing records from primary storage. [2025-10-01T19:30:58.677706] [INFO ] [MAIN ] HY: Loaded 9962 existing records. [2025-10-01T19:30:58.882752] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:30:58.883020] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-01T19:30:58.883087] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-01T19:30:58.883268] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-01T19:30:58.883327] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-01T19:30:59.126192] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-01T19:30:59.306833] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-01T19:30:59.329077] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:30:59.392040] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T19:30:59.433344] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T19:31:00.102427] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-01T19:31:00.902386] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-01T19:31:01.355038] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T19:31:01.702549] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-01T19:31:01.702441] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T19:31:01.759500] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T19:31:02.502400] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-01T19:31:02.639233] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T19:31:03.302385] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-01T19:31:04.102400] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-01T19:31:04.439137] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T19:31:04.902410] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-01T19:31:05.702520] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-01T19:31:05.714375] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:31:05.802909] [DEBUG] [REMOTE ] HVT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:31:05.803281] [WARN ] [REMOTE ] HVT: No data returned for month 2025-10 [2025-10-01T19:31:05.803414] [FATAL] [REMOTE ] HVT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:31:05.803574] [FATAL] [MAIN ] HVT: Failed to fetch primary data. [2025-10-01T19:31:05.803735] [WARN ] [MAIN ] HVT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:31:05.803840] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-01T19:31:05.803955] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-01T19:31:05.804041] [INFO ] [LOCAL ] HVT: Starting deletion of derivative data. [2025-10-01T19:31:05.804594] [DEBUG] [LOCAL ] HVT: Deleted derivative data file. [2025-10-01T19:31:05.804742] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 32.3s. Estimated remaining: 3h 3m 39s. Rate: 7.1 symbols/min [2025-10-01T19:31:06.030749] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:31:06.031698] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-01T19:31:06.033991] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-01T19:31:06.034391] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-01T19:31:06.044924] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-01T19:31:06.045535] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-01T19:31:06.045615] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-01T19:31:06.045717] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-01T19:31:06.441987] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:31:06.502355] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-01T19:31:06.800531] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-01T19:31:07.308868] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-01T19:31:07.331821] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T19:31:07.668450] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-01T19:31:08.102408] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-01T19:31:08.583120] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T19:31:08.902456] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-01T19:31:09.136116] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-01T19:31:09.702399] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-01T19:31:10.502349] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-01T19:31:10.586189] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T19:31:11.302386] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-01T19:31:11.628093] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-01T19:31:12.102366] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-01T19:31:12.260490] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T19:31:12.902389] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-01T19:31:13.688907] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T19:31:13.702337] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-01T19:31:14.502381] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-01T19:31:14.582515] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T19:31:15.075605] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T19:31:15.151884] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T19:31:15.302398] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-01T19:31:15.608591] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-01T19:31:16.102383] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-01T19:31:16.521368] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-01T19:31:16.902383] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-01T19:31:17.702372] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-01T19:31:17.818436] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T19:31:18.030570] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-01T19:31:18.502385] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-01T19:31:18.740759] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-01T19:31:19.302395] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-01T19:31:19.530966] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-01T19:31:20.102386] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-01T19:31:20.888904] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T19:31:20.902331] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-01T19:31:21.666086] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T19:31:21.702408] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-01T19:31:22.415123] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-01T19:31:22.502397] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-01T19:31:23.259523] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T19:31:23.302442] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-01T19:31:24.102369] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-01T19:31:24.890091] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T19:31:24.902365] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-01T19:31:25.281314] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-01T19:31:25.464737] [DEBUG] [REMOTE ] HY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:31:25.465082] [WARN ] [REMOTE ] HY: No data returned for month 2025-10 [2025-10-01T19:31:25.465178] [FATAL] [REMOTE ] HY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:31:25.465262] [FATAL] [MAIN ] HY: Failed to fetch primary data. [2025-10-01T19:31:25.465303] [WARN ] [MAIN ] HY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:31:25.465390] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-01T19:31:25.465463] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-01T19:31:25.465553] [INFO ] [LOCAL ] HY: Starting deletion of derivative data. [2025-10-01T19:31:25.465989] [DEBUG] [LOCAL ] HY: Deleted derivative data file. [2025-10-01T19:31:25.466131] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 27.0s. Estimated remaining: 3h 3m 44s. Rate: 7.1 symbols/min [2025-10-01T19:31:25.657562] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:31:25.657833] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-01T19:31:25.657890] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-01T19:31:25.658014] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-01T19:31:25.658059] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-01T19:31:25.658103] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-01T19:31:25.658138] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-01T19:31:25.707514] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-01T19:31:26.140955] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:31:26.502378] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-01T19:31:26.856545] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-01T19:31:26.992527] [DEBUG] [REMOTE ] HWM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:31:26.992907] [WARN ] [REMOTE ] HWM: No data returned for month 2025-10 [2025-10-01T19:31:26.993039] [FATAL] [REMOTE ] HWM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:31:26.993182] [FATAL] [MAIN ] HWM: Failed to fetch primary data. [2025-10-01T19:31:26.993272] [WARN ] [MAIN ] HWM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:31:26.993361] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-01T19:31:26.993455] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-01T19:31:26.993501] [INFO ] [LOCAL ] HWM: Starting deletion of derivative data. [2025-10-01T19:31:26.993912] [DEBUG] [LOCAL ] HWM: Deleted derivative data file. [2025-10-01T19:31:26.994012] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HWM took 40.9s. Estimated remaining: 3h 3m 27s. Rate: 7.1 symbols/min [2025-10-01T19:31:27.189307] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:31:27.200195] [DEBUG] [LOCAL ] HYI: Loaded 9392 existing records from primary storage. [2025-10-01T19:31:27.200397] [INFO ] [MAIN ] HYI: Loaded 9392 existing records. [2025-10-01T19:31:27.306547] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-01T19:31:27.393794] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:31:27.394012] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-01T19:31:27.394064] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-01T19:31:27.394229] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-01T19:31:27.394288] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-01T19:31:27.692929] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-01T19:31:27.829550] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:31:28.102405] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-01T19:31:28.326497] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-01T19:31:28.902412] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-01T19:31:29.702403] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-01T19:31:29.954421] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-01T19:31:30.313413] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T19:31:30.502418] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-01T19:31:30.827333] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-01T19:31:31.302420] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-01T19:31:32.102411] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-01T19:31:32.417254] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-01T19:31:32.902413] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-01T19:31:33.549798] [DEBUG] [REMOTE ] HYAC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:31:33.550123] [WARN ] [REMOTE ] HYAC: No data returned for month 2025-10 [2025-10-01T19:31:33.550215] [FATAL] [REMOTE ] HYAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:31:33.550296] [FATAL] [MAIN ] HYAC: Failed to fetch primary data. [2025-10-01T19:31:33.550360] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:31:33.550433] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-01T19:31:33.550510] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-01T19:31:33.550566] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-01T19:31:33.550636] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-01T19:31:33.550733] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 27.7s. Estimated remaining: 3h 3m 16s. Rate: 7.1 symbols/min [2025-10-01T19:31:33.711153] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-01T19:31:33.749353] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:31:33.787446] [DEBUG] [LOCAL ] HYT: Loaded 33686 existing records from primary storage. [2025-10-01T19:31:33.787881] [INFO ] [MAIN ] HYT: Loaded 33686 existing records. [2025-10-01T19:31:33.913942] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T19:31:34.007374] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:31:34.007702] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-01T19:31:34.007764] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-01T19:31:34.008235] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-01T19:31:34.008295] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-01T19:31:34.419021] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:31:34.502395] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-01T19:31:34.895183] [DEBUG] [REMOTE ] HXL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:31:34.895694] [WARN ] [REMOTE ] HXL: No data returned for month 2025-10 [2025-10-01T19:31:34.895823] [FATAL] [REMOTE ] HXL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:31:34.895954] [FATAL] [MAIN ] HXL: Failed to fetch primary data. [2025-10-01T19:31:34.896045] [WARN ] [MAIN ] HXL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:31:34.896136] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-01T19:31:34.896235] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-01T19:31:34.896308] [INFO ] [LOCAL ] HXL: Starting deletion of derivative data. [2025-10-01T19:31:34.896829] [DEBUG] [LOCAL ] HXL: Deleted derivative data file. [2025-10-01T19:31:34.897034] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HXL took 47.6s. Estimated remaining: 3h 2m 59s. Rate: 7.1 symbols/min [2025-10-01T19:31:35.091834] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:31:35.098100] [DEBUG] [LOCAL ] HYTR: Loaded 3151 existing records from primary storage. [2025-10-01T19:31:35.098378] [INFO ] [MAIN ] HYTR: Loaded 3151 existing records. [2025-10-01T19:31:35.298017] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T19:31:35.306111] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-01T19:31:35.312917] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:31:35.317919] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-01T19:31:35.318140] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-01T19:31:35.318426] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-01T19:31:35.318518] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-01T19:31:35.730006] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:31:36.102436] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-01T19:31:36.733283] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T19:31:36.900953] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T19:31:36.903505] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-01T19:31:37.133438] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-01T19:31:37.702393] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-01T19:31:37.944853] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-01T19:31:38.502432] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-01T19:31:39.302396] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-01T19:31:39.620162] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T19:31:39.965862] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T19:31:40.102380] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-01T19:31:40.902437] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-01T19:31:41.133536] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-01T19:31:41.375533] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T19:31:41.702399] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-01T19:31:42.502398] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-01T19:31:42.727494] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T19:31:42.856425] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-01T19:31:43.302391] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-01T19:31:44.028191] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T19:31:44.102431] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-01T19:31:44.902406] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-01T19:31:45.434019] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-01T19:31:45.633761] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T19:31:45.702431] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-01T19:31:46.257685] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T19:31:46.502391] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-01T19:31:47.231009] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T19:31:47.302426] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-01T19:31:48.102392] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-01T19:31:48.580146] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T19:31:48.902448] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-01T19:31:49.239069] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-01T19:31:49.581559] [DEBUG] [REMOTE ] HYBX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:31:49.581942] [WARN ] [REMOTE ] HYBX: No data returned for month 2025-10 [2025-10-01T19:31:49.582045] [FATAL] [REMOTE ] HYBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:31:49.582130] [FATAL] [MAIN ] HYBX: Failed to fetch primary data. [2025-10-01T19:31:49.582198] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:31:49.582271] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-01T19:31:49.582356] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-01T19:31:49.582417] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-01T19:31:49.582463] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-01T19:31:49.582513] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYBX took 24.1s. Estimated remaining: 3h 2m 58s. Rate: 7.1 symbols/min [2025-10-01T19:31:49.703150] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-01T19:31:49.794950] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:31:49.832339] [DEBUG] [LOCAL ] HZO: Loaded 29205 existing records from primary storage. [2025-10-01T19:31:49.832717] [INFO ] [MAIN ] HZO: Loaded 29205 existing records. [2025-10-01T19:31:50.049470] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:31:50.049758] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-01T19:31:50.049827] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-01T19:31:50.050442] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-01T19:31:50.050508] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-01T19:31:50.356615] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T19:31:50.495250] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:31:50.502342] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-01T19:31:51.302409] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-01T19:31:51.593948] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T19:31:51.889628] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T19:31:52.102393] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-01T19:31:52.902412] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-01T19:31:53.361239] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T19:31:53.480222] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T19:31:53.702429] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-01T19:31:54.502397] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-01T19:31:55.074713] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T19:31:55.089533] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T19:31:55.302391] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-01T19:31:55.857290] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T19:31:56.102393] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-01T19:31:56.817518] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T19:31:56.902389] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-01T19:31:57.661961] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T19:31:57.702420] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-01T19:31:58.502393] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-01T19:31:58.787571] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T19:31:58.965374] [DEBUG] [REMOTE ] HYI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:31:58.965811] [WARN ] [REMOTE ] HYI: No data returned for month 2025-10 [2025-10-01T19:31:58.965957] [FATAL] [REMOTE ] HYI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:31:58.966048] [FATAL] [MAIN ] HYI: Failed to fetch primary data. [2025-10-01T19:31:58.966127] [WARN ] [MAIN ] HYI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:31:58.966203] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-01T19:31:58.966270] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-01T19:31:58.966309] [INFO ] [LOCAL ] HYI: Starting deletion of derivative data. [2025-10-01T19:31:58.966774] [DEBUG] [LOCAL ] HYI: Deleted derivative data file. [2025-10-01T19:31:58.966877] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYI took 32.0s. Estimated remaining: 3h 2m 51s. Rate: 7.1 symbols/min [2025-10-01T19:31:59.164600] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:31:59.173051] [DEBUG] [LOCAL ] IAE: Loaded 6043 existing records from primary storage. [2025-10-01T19:31:59.173309] [INFO ] [MAIN ] IAE: Loaded 6043 existing records. [2025-10-01T19:31:59.307616] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-01T19:31:59.373889] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:31:59.374165] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-01T19:31:59.374213] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-01T19:31:59.374551] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-01T19:31:59.374618] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-01T19:31:59.788196] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:00.078163] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T19:32:00.102353] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-01T19:32:00.605747] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T19:32:00.902385] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-01T19:32:01.702420] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-01T19:32:02.024843] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T19:32:02.109055] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T19:32:02.502401] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-01T19:32:03.139064] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T19:32:03.302366] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-01T19:32:04.102391] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-01T19:32:04.455134] [DEBUG] [REMOTE ] HYTR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:32:04.455574] [WARN ] [REMOTE ] HYTR: No data returned for month 2025-10 [2025-10-01T19:32:04.455719] [FATAL] [REMOTE ] HYTR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:32:04.455837] [FATAL] [MAIN ] HYTR: Failed to fetch primary data. [2025-10-01T19:32:04.455926] [WARN ] [MAIN ] HYTR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:32:04.456012] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-01T19:32:04.456090] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-01T19:32:04.456131] [INFO ] [LOCAL ] HYTR: Starting deletion of derivative data. [2025-10-01T19:32:04.456571] [DEBUG] [LOCAL ] HYTR: Deleted derivative data file. [2025-10-01T19:32:04.456688] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYTR took 29.6s. Estimated remaining: 3h 2m 39s. Rate: 7.1 symbols/min [2025-10-01T19:32:04.584372] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T19:32:04.902394] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-01T19:32:05.702352] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-01T19:32:05.968266] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T19:32:06.502386] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-01T19:32:06.891227] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T19:32:07.302379] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-01T19:32:07.935764] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T19:32:08.102395] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-01T19:32:08.415435] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T19:32:08.710855] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T19:32:08.902390] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-01T19:32:09.704097] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-01T19:32:09.706962] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T19:32:10.502381] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-01T19:32:11.302377] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-01T19:32:11.686789] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T19:32:12.026516] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T19:32:12.102388] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-01T19:32:12.508616] [DEBUG] [REMOTE ] HYT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:32:12.509073] [WARN ] [REMOTE ] HYT: No data returned for month 2025-10 [2025-10-01T19:32:12.509186] [FATAL] [REMOTE ] HYT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:32:12.509310] [FATAL] [MAIN ] HYT: Failed to fetch primary data. [2025-10-01T19:32:12.509390] [WARN ] [MAIN ] HYT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:32:12.509472] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-01T19:32:12.509549] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-01T19:32:12.509593] [INFO ] [LOCAL ] HYT: Starting deletion of derivative data. [2025-10-01T19:32:12.510079] [DEBUG] [LOCAL ] HYT: Deleted derivative data file. [2025-10-01T19:32:12.510222] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYT took 39.0s. Estimated remaining: 3h 2m 30s. Rate: 7.1 symbols/min [2025-10-01T19:32:12.902412] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-01T19:32:13.394395] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T19:32:13.495295] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T19:32:13.702379] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-01T19:32:14.303910] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T19:32:14.502389] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-01T19:32:15.101504] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T19:32:15.302368] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-01T19:32:15.945075] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T19:32:16.102432] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-01T19:32:16.731255] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T19:32:16.902447] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-01T19:32:17.702458] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-01T19:32:18.166813] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T19:32:18.325377] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-01T19:32:18.502353] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-01T19:32:19.226953] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T19:32:19.302399] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-01T19:32:20.102436] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-01T19:32:20.522045] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T19:32:20.795916] [DEBUG] [REMOTE ] IAE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:32:20.796241] [WARN ] [REMOTE ] IAE: No data returned for month 2025-10 [2025-10-01T19:32:20.796337] [FATAL] [REMOTE ] IAE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:32:20.796430] [FATAL] [MAIN ] IAE: Failed to fetch primary data. [2025-10-01T19:32:20.796496] [WARN ] [MAIN ] IAE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:32:20.796603] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-01T19:32:20.796723] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-01T19:32:20.796780] [INFO ] [LOCAL ] IAE: Starting deletion of derivative data. [2025-10-01T19:32:20.797255] [DEBUG] [LOCAL ] IAE: Deleted derivative data file. [2025-10-01T19:32:20.797372] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. IAE took 21.8s. Estimated remaining: 3h 2m 21s. Rate: 7.1 symbols/min [2025-10-01T19:32:20.902419] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-01T19:32:21.495925] [DEBUG] [REMOTE ] HZO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:32:21.496332] [WARN ] [REMOTE ] HZO: No data returned for month 2025-10 [2025-10-01T19:32:21.496428] [FATAL] [REMOTE ] HZO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:32:21.496549] [FATAL] [MAIN ] HZO: Failed to fetch primary data. [2025-10-01T19:32:21.496676] [WARN ] [MAIN ] HZO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:32:21.496752] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-01T19:32:21.496818] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-01T19:32:21.496856] [INFO ] [LOCAL ] HZO: Starting deletion of derivative data. [2025-10-01T19:32:21.497144] [DEBUG] [LOCAL ] HZO: Deleted derivative data file. [2025-10-01T19:32:21.497235] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 31.9s. Estimated remaining: 3h 2m 3s. Rate: 7.1 symbols/min [2025-10-01T19:32:22.261819] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:32:22.347705] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:32:22.350401] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:32:22.377118] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:32:22.411902] [DEBUG] [LOCAL ] IBP: Loaded 28967 existing records from primary storage. [2025-10-01T19:32:22.412279] [INFO ] [MAIN ] IBP: Loaded 28967 existing records. [2025-10-01T19:32:22.718501] [DEBUG] [LOCAL ] IBM: Loaded 53635 existing records from primary storage. [2025-10-01T19:32:22.716395] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:32:22.733549] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-01T19:32:22.733864] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-01T19:32:22.735090] [DEBUG] [LOCAL ] IBN: Loaded 52867 existing records from primary storage. [2025-10-01T19:32:22.735176] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-01T19:32:22.735694] [INFO ] [MAIN ] IBN: Loaded 52867 existing records. [2025-10-01T19:32:22.734118] [INFO ] [MAIN ] IBM: Loaded 53635 existing records. [2025-10-01T19:32:22.735570] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-01T19:32:22.834589] [DEBUG] [LOCAL ] IAG: Loaded 53449 existing records from primary storage. [2025-10-01T19:32:22.917720] [INFO ] [MAIN ] IAG: Loaded 53449 existing records. [2025-10-01T19:32:23.456214] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:32:23.620461] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:32:23.602717] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-01T19:32:23.674858] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-01T19:32:23.707495] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-01T19:32:23.700321] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-01T19:32:23.711623] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:32:23.732753] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-01T19:32:23.716990] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-01T19:32:23.743504] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-01T19:32:23.737954] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-01T19:32:23.765333] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-01T19:32:23.765484] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-01T19:32:23.803985] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-01T19:32:23.879802] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-01T19:32:24.181829] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:24.197704] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-01T19:32:25.133285] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:25.157899] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-01T19:32:25.161576] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:25.154738] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:25.162850] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-01T19:32:25.163705] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-01T19:32:25.689514] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T19:32:25.695248] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-01T19:32:26.768267] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T19:32:26.780805] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-01T19:32:26.832077] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T19:32:26.838691] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-01T19:32:26.985386] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T19:32:27.305249] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-01T19:32:27.311187] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-01T19:32:28.063923] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T19:32:28.102423] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-01T19:32:28.199378] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T19:32:28.902412] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-01T19:32:28.972084] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T19:32:29.702381] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-01T19:32:29.786990] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T19:32:30.507494] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-01T19:32:30.520408] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T19:32:31.093480] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T19:32:31.302394] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-01T19:32:32.107468] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-01T19:32:32.120412] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T19:32:32.902342] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-01T19:32:33.086960] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T19:32:33.697563] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T19:32:33.707491] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-01T19:32:33.964323] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T19:32:34.502411] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-01T19:32:35.302437] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-01T19:32:35.517534] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T19:32:36.102388] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-01T19:32:36.659590] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-01T19:32:36.902406] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-01T19:32:37.083608] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:32:37.478969] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T19:32:37.702448] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-01T19:32:38.502379] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-01T19:32:38.505553] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:32:38.585336] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T19:32:39.302396] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-01T19:32:40.102466] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-01T19:32:40.479836] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T19:32:40.902375] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-01T19:32:41.056821] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T19:32:41.702451] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-01T19:32:41.918796] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T19:32:42.222184] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T19:32:42.502439] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-01T19:32:43.302460] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-01T19:32:43.421724] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T19:32:44.102359] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-01T19:32:44.229829] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T19:32:44.902436] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-01T19:32:45.197800] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T19:32:45.663568] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T19:32:45.702353] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-01T19:32:46.167866] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T19:32:46.502424] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-01T19:32:47.302393] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-01T19:32:47.393054] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T19:32:48.102454] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-01T19:32:48.532894] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T19:32:48.738987] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-01T19:32:48.902382] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-01T19:32:49.568940] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T19:32:49.702407] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-01T19:32:50.502391] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-01T19:32:51.302357] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-01T19:32:51.406297] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-01T19:32:51.505042] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T19:32:52.102351] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-01T19:32:52.197813] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T19:32:52.472535] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T19:32:52.902394] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-01T19:32:53.546275] [DEBUG] [REMOTE ] IBP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:32:53.546581] [WARN ] [REMOTE ] IBP: No data returned for month 2025-10 [2025-10-01T19:32:53.546700] [FATAL] [REMOTE ] IBP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:32:53.546800] [FATAL] [MAIN ] IBP: Failed to fetch primary data. [2025-10-01T19:32:53.546865] [WARN ] [MAIN ] IBP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:32:53.546940] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-01T19:32:53.547009] [DEBUG] [LOCAL ] IBP: No primary data file found to delete. [2025-10-01T19:32:53.547049] [INFO ] [LOCAL ] IBP: Starting deletion of derivative data. [2025-10-01T19:32:53.547505] [DEBUG] [LOCAL ] IBP: Deleted derivative data file. [2025-10-01T19:32:53.547595] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IBP took 32.0s. Estimated remaining: 3h 2m 23s. Rate: 7.1 symbols/min [2025-10-01T19:32:53.716550] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-01T19:32:53.755019] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:32:53.814715] [DEBUG] [LOCAL ] IBTA: Loaded 37607 existing records from primary storage. [2025-10-01T19:32:53.815070] [INFO ] [MAIN ] IBTA: Loaded 37607 existing records. [2025-10-01T19:32:54.077471] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:32:54.077899] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-01T19:32:54.078045] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-01T19:32:54.078801] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-01T19:32:54.078867] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-01T19:32:54.509254] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:54.503344] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-01T19:32:54.543756] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-01T19:32:55.302384] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-01T19:32:55.781392] [DEBUG] [REMOTE ] IAG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:32:55.781757] [WARN ] [REMOTE ] IAG: No data returned for month 2025-10 [2025-10-01T19:32:55.781855] [FATAL] [REMOTE ] IAG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:32:55.781945] [FATAL] [MAIN ] IAG: Failed to fetch primary data. [2025-10-01T19:32:55.782011] [WARN ] [MAIN ] IAG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:32:55.782088] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-01T19:32:55.782156] [DEBUG] [LOCAL ] IAG: No primary data file found to delete. [2025-10-01T19:32:55.782196] [INFO ] [LOCAL ] IAG: Starting deletion of derivative data. [2025-10-01T19:32:55.782554] [DEBUG] [LOCAL ] IAG: Deleted derivative data file. [2025-10-01T19:32:55.782677] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IAG took 34.3s. Estimated remaining: 3h 2m 7s. Rate: 7.1 symbols/min [2025-10-01T19:32:55.971606] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:32:56.032183] [DEBUG] [LOCAL ] ICE: Loaded 53003 existing records from primary storage. [2025-10-01T19:32:56.032521] [INFO ] [MAIN ] ICE: Loaded 53003 existing records. [2025-10-01T19:32:56.108054] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-01T19:32:56.233146] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:32:56.233423] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-01T19:32:56.233539] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-01T19:32:56.234204] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-01T19:32:56.234265] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-01T19:32:56.636900] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:56.656505] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T19:32:56.731852] [DEBUG] [REMOTE ] IBN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:32:56.732174] [WARN ] [REMOTE ] IBN: No data returned for month 2025-10 [2025-10-01T19:32:56.732265] [FATAL] [REMOTE ] IBN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:32:56.732390] [FATAL] [MAIN ] IBN: Failed to fetch primary data. [2025-10-01T19:32:56.732461] [WARN ] [MAIN ] IBN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:32:56.732538] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-01T19:32:56.732609] [DEBUG] [LOCAL ] IBN: No primary data file found to delete. [2025-10-01T19:32:56.732679] [INFO ] [LOCAL ] IBN: Starting deletion of derivative data. [2025-10-01T19:32:56.733220] [DEBUG] [LOCAL ] IBN: Deleted derivative data file. [2025-10-01T19:32:56.733339] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBN took 35.2s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-01T19:32:56.923852] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-01T19:32:56.927909] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:32:56.977564] [DEBUG] [LOCAL ] ICL: Loaded 38406 existing records from primary storage. [2025-10-01T19:32:56.978030] [INFO ] [MAIN ] ICL: Loaded 38406 existing records. [2025-10-01T19:32:57.203764] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:32:57.204011] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-01T19:32:57.204068] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-01T19:32:57.204912] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-01T19:32:57.204985] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-01T19:32:57.626546] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:32:57.702377] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-01T19:32:58.028137] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T19:32:58.319845] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-01T19:32:58.502498] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-01T19:32:59.302364] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-01T19:32:59.409659] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T19:32:59.617325] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T19:33:00.102423] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-01T19:33:00.902375] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-01T19:33:01.702432] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-01T19:33:01.770184] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:33:02.107515] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T19:33:02.502410] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-01T19:33:03.302402] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-01T19:33:03.386926] [DEBUG] [REMOTE ] IBM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:33:03.387235] [WARN ] [REMOTE ] IBM: No data returned for month 2025-10 [2025-10-01T19:33:03.387329] [FATAL] [REMOTE ] IBM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:33:03.387410] [FATAL] [MAIN ] IBM: Failed to fetch primary data. [2025-10-01T19:33:03.387476] [WARN ] [MAIN ] IBM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:33:03.387550] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-01T19:33:03.387616] [DEBUG] [LOCAL ] IBM: No primary data file found to delete. [2025-10-01T19:33:03.387684] [INFO ] [LOCAL ] IBM: Starting deletion of derivative data. [2025-10-01T19:33:03.388059] [DEBUG] [LOCAL ] IBM: Deleted derivative data file. [2025-10-01T19:33:03.388152] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBM took 41.9s. Estimated remaining: 3h 1m 39s. Rate: 7.1 symbols/min [2025-10-01T19:33:03.590274] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:33:03.620016] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T19:33:03.674376] [DEBUG] [LOCAL ] IDA: Loaded 32082 existing records from primary storage. [2025-10-01T19:33:03.674737] [INFO ] [MAIN ] IDA: Loaded 32082 existing records. [2025-10-01T19:33:03.905046] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:33:03.905429] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-01T19:33:03.905483] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-01T19:33:03.906173] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-01T19:33:03.906237] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-01T19:33:04.180256] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-01T19:33:04.205410] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T19:33:04.363967] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:33:04.894579] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T19:33:04.904483] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-01T19:33:05.702381] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-01T19:33:05.944118] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T19:33:06.120123] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T19:33:06.502376] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-01T19:33:06.780499] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T19:33:07.302379] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-01T19:33:08.032520] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T19:33:08.102389] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-01T19:33:08.885625] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T19:33:08.902372] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-01T19:33:09.047547] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T19:33:09.702396] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-01T19:33:10.126057] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T19:33:10.502396] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-01T19:33:11.072751] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T19:33:11.302380] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-01T19:33:12.102385] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-01T19:33:12.468182] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T19:33:12.495122] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T19:33:12.902354] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-01T19:33:12.962433] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T19:33:13.702435] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-01T19:33:14.408617] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T19:33:14.502426] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-01T19:33:14.729427] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T19:33:15.302426] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-01T19:33:15.726751] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T19:33:16.102401] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-01T19:33:16.902413] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-01T19:33:16.961481] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T19:33:17.665712] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T19:33:17.702386] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-01T19:33:18.502387] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-01T19:33:18.574183] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T19:33:19.295789] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T19:33:19.307895] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-01T19:33:19.606811] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T19:33:20.102422] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-01T19:33:20.782220] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T19:33:20.902363] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-01T19:33:21.120523] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T19:33:21.702395] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-01T19:33:22.324818] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T19:33:22.502408] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-01T19:33:23.302436] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-01T19:33:23.645707] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T19:33:23.647141] [INFO ] [REMOTE ] IBTA: Full fetch complete (50807 records). [2025-10-01T19:33:23.647246] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-01T19:33:24.078793] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-01T19:33:24.078914] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-01T19:33:24.079909] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-01T19:33:24.080150] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-01T19:33:24.081785] [DEBUG] [LOCAL ] IBTA: Trimmed 50807 records to 37611 (keeping 200 days of data) [2025-10-01T19:33:24.134470] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-01T19:33:24.246512] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T19:33:24.370837] [DEBUG] [LOCAL ] IBTA: Primary data saved (37611 records). [2025-10-01T19:33:24.370991] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-01T19:33:24.371079] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBTA took 30.8s. Estimated remaining: 3h 1m 45s. Rate: 7.1 symbols/min [2025-10-01T19:33:24.566212] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:33:24.578070] [DEBUG] [LOCAL ] IDE: Loaded 8748 existing records from primary storage. [2025-10-01T19:33:24.578294] [INFO ] [MAIN ] IDE: Loaded 8748 existing records. [2025-10-01T19:33:24.772274] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:33:24.772578] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-01T19:33:24.772732] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-01T19:33:24.772980] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-01T19:33:24.773054] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-01T19:33:24.847249] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:33:24.908714] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-01T19:33:25.206931] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:33:25.707479] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-01T19:33:25.726457] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T19:33:26.502385] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-01T19:33:26.720792] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T19:33:27.106991] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T19:33:27.130986] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:33:27.302390] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-01T19:33:28.102430] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-01T19:33:28.729447] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T19:33:28.902413] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-01T19:33:29.702427] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-01T19:33:30.242446] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T19:33:30.444894] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T19:33:30.502387] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-01T19:33:30.673954] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-01T19:33:30.675836] [INFO ] [REMOTE ] ICE: Full fetch complete (76757 records). [2025-10-01T19:33:30.675944] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-01T19:33:31.114744] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-01T19:33:31.114853] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-01T19:33:31.116059] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-01T19:33:31.116128] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-01T19:33:31.117620] [DEBUG] [LOCAL ] ICE: Trimmed 76757 records to 53003 (keeping 200 days of data) [2025-10-01T19:33:31.221105] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T19:33:31.323276] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-01T19:33:31.492844] [DEBUG] [LOCAL ] ICE: Primary data saved (53003 records). [2025-10-01T19:33:31.492992] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-01T19:33:31.493076] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICE took 35.7s. Estimated remaining: 3h 1m 35s. Rate: 7.1 symbols/min [2025-10-01T19:33:31.673055] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:33:31.691146] [DEBUG] [LOCAL ] IDT: Loaded 17861 existing records from primary storage. [2025-10-01T19:33:31.691415] [INFO ] [MAIN ] IDT: Loaded 17861 existing records. [2025-10-01T19:33:31.884200] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:33:31.884479] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-01T19:33:31.884540] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-01T19:33:31.884813] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-01T19:33:31.884871] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-01T19:33:32.113473] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-01T19:33:32.270896] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:33:32.741062] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T19:33:32.902390] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-01T19:33:33.448732] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T19:33:33.465424] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-01T19:33:33.702382] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-01T19:33:34.460080] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T19:33:34.502383] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-01T19:33:35.241819] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T19:33:35.302405] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-01T19:33:35.928047] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T19:33:36.102364] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-01T19:33:36.823726] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T19:33:36.902375] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-01T19:33:37.673834] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T19:33:37.702393] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-01T19:33:38.502378] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-01T19:33:39.211626] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T19:33:39.302373] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-01T19:33:39.507007] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-01T19:33:39.508311] [INFO ] [REMOTE ] ICL: Full fetch complete (55937 records). [2025-10-01T19:33:39.508400] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-01T19:33:39.941531] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-01T19:33:39.966174] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-01T19:33:39.966273] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-01T19:33:39.967327] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-01T19:33:39.967396] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-01T19:33:39.968629] [DEBUG] [LOCAL ] ICL: Trimmed 55937 records to 38446 (keeping 200 days of data) [2025-10-01T19:33:40.134301] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-01T19:33:40.201103] [DEBUG] [LOCAL ] ICL: Primary data saved (38446 records). [2025-10-01T19:33:40.201249] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-01T19:33:40.201381] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICL took 43.5s. Estimated remaining: 3h 1m 27s. Rate: 7.1 symbols/min [2025-10-01T19:33:40.381714] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:33:40.427849] [DEBUG] [LOCAL ] IEX: Loaded 38324 existing records from primary storage. [2025-10-01T19:33:40.428207] [INFO ] [MAIN ] IEX: Loaded 38324 existing records. [2025-10-01T19:33:40.629555] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:33:40.629838] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-01T19:33:40.629900] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-01T19:33:40.630529] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-01T19:33:40.630592] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-01T19:33:40.907579] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-01T19:33:41.005252] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:33:41.702381] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-01T19:33:41.839637] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T19:33:41.841019] [INFO ] [REMOTE ] IDA: Full fetch complete (44798 records). [2025-10-01T19:33:41.841119] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-01T19:33:42.174637] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T19:33:42.288477] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-01T19:33:42.288577] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-01T19:33:42.289371] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-01T19:33:42.289468] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-01T19:33:42.290604] [DEBUG] [LOCAL ] IDA: Trimmed 44798 records to 32160 (keeping 200 days of data) [2025-10-01T19:33:42.510060] [DEBUG] [LOCAL ] IDA: Primary data saved (32160 records). [2025-10-01T19:33:42.502470] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-01T19:33:42.510392] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-01T19:33:42.511725] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. IDA took 39.1s. Estimated remaining: 3h 1m 11s. Rate: 7.1 symbols/min [2025-10-01T19:33:42.714562] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:33:42.769052] [DEBUG] [LOCAL ] IFF: Loaded 50986 existing records from primary storage. [2025-10-01T19:33:42.769485] [INFO ] [MAIN ] IFF: Loaded 50986 existing records. [2025-10-01T19:33:43.003036] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:33:43.017258] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-01T19:33:43.018263] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-01T19:33:43.019192] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T19:33:43.025913] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-01T19:33:43.026022] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-01T19:33:43.307499] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-01T19:33:43.464283] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:33:43.475591] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T19:33:44.102400] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-01T19:33:44.198753] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T19:33:44.902388] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-01T19:33:45.408196] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T19:33:45.702360] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-01T19:33:45.851221] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T19:33:46.502356] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-01T19:33:46.884869] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T19:33:47.302378] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-01T19:33:48.102362] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-01T19:33:48.346144] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T19:33:48.402617] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T19:33:48.902370] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-01T19:33:49.029703] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-01T19:33:49.030581] [INFO ] [REMOTE ] IDE: Full fetch complete (12624 records). [2025-10-01T19:33:49.030678] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-01T19:33:49.431436] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-01T19:33:49.431555] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-01T19:33:49.431896] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-01T19:33:49.431962] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-01T19:33:49.432555] [DEBUG] [LOCAL ] IDE: Trimmed 12624 records to 8754 (keeping 200 days of data) [2025-10-01T19:33:49.490868] [DEBUG] [LOCAL ] IDE: Primary data saved (8754 records). [2025-10-01T19:33:49.491025] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-01T19:33:49.491131] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 25.1s. Estimated remaining: 3h 1m 1s. Rate: 7.1 symbols/min [2025-10-01T19:33:49.696179] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:33:49.702404] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-01T19:33:49.717606] [DEBUG] [LOCAL ] IFN: Loaded 18249 existing records from primary storage. [2025-10-01T19:33:49.718368] [INFO ] [MAIN ] IFN: Loaded 18249 existing records. [2025-10-01T19:33:49.852739] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T19:33:49.947502] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:33:49.947848] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-01T19:33:49.947920] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-01T19:33:49.948330] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-01T19:33:49.948392] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-01T19:33:50.352172] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:33:50.502418] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-01T19:33:51.302874] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-01T19:33:51.306820] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T19:33:51.754158] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T19:33:52.102387] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-01T19:33:52.380710] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T19:33:52.902381] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-01T19:33:53.247148] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T19:33:53.702379] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-01T19:33:54.168344] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T19:33:54.502355] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-01T19:33:54.915904] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T19:33:55.302385] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-01T19:33:56.102423] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-01T19:33:56.191476] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T19:33:56.484076] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T19:33:56.485254] [INFO ] [REMOTE ] IDT: Full fetch complete (22895 records). [2025-10-01T19:33:56.485327] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-01T19:33:56.878978] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-01T19:33:56.879070] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-01T19:33:56.879814] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-01T19:33:56.879880] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-01T19:33:56.880676] [DEBUG] [LOCAL ] IDT: Trimmed 22895 records to 17953 (keeping 200 days of data) [2025-10-01T19:33:56.929849] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-01T19:33:57.001345] [DEBUG] [LOCAL ] IDT: Primary data saved (17953 records). [2025-10-01T19:33:57.001497] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-01T19:33:57.001611] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDT took 25.5s. Estimated remaining: 3h 0m 52s. Rate: 7.1 symbols/min [2025-10-01T19:33:57.194800] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:33:57.209772] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T19:33:57.233897] [DEBUG] [LOCAL ] IFS: Loaded 22986 existing records from primary storage. [2025-10-01T19:33:57.234156] [INFO ] [MAIN ] IFS: Loaded 22986 existing records. [2025-10-01T19:33:57.431747] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:33:57.431958] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-01T19:33:57.432009] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-01T19:33:57.432838] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-01T19:33:57.432903] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-01T19:33:57.707724] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-01T19:33:57.847421] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:33:58.502407] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-01T19:33:58.797715] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T19:33:58.872035] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T19:33:59.302387] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-01T19:33:59.543507] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T19:34:00.102383] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-01T19:34:00.902930] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-01T19:34:00.971312] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:34:01.022516] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T19:34:01.702410] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-01T19:34:02.502402] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-01T19:34:02.526843] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T19:34:02.834743] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T19:34:03.302404] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-01T19:34:04.102359] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-01T19:34:04.175488] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T19:34:04.194475] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T19:34:04.902364] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-01T19:34:05.144750] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T19:34:05.702378] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-01T19:34:06.304575] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T19:34:06.502392] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-01T19:34:06.624555] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T19:34:07.178066] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T19:34:07.302368] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-01T19:34:08.102386] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-01T19:34:08.461963] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T19:34:08.902378] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-01T19:34:09.563686] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T19:34:09.702385] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-01T19:34:10.016627] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T19:34:10.502390] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-01T19:34:11.220311] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T19:34:11.302375] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-01T19:34:11.481864] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T19:34:12.102423] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-01T19:34:12.849099] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T19:34:12.902440] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-01T19:34:13.366787] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T19:34:13.367854] [INFO ] [REMOTE ] IFN: Full fetch complete (29080 records). [2025-10-01T19:34:13.367931] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-01T19:34:13.707525] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-01T19:34:13.786452] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-01T19:34:13.786563] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-01T19:34:13.787374] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-01T19:34:13.787442] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-01T19:34:13.788345] [DEBUG] [LOCAL ] IFN: Trimmed 29080 records to 18268 (keeping 200 days of data) [2025-10-01T19:34:13.909624] [DEBUG] [LOCAL ] IFN: Primary data saved (18268 records). [2025-10-01T19:34:13.909827] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-01T19:34:13.909959] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IFN took 24.4s. Estimated remaining: 3h 0m 53s. Rate: 7.1 symbols/min [2025-10-01T19:34:14.099802] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:34:14.111720] [DEBUG] [LOCAL ] IGA: Loaded 9775 existing records from primary storage. [2025-10-01T19:34:14.111973] [INFO ] [MAIN ] IGA: Loaded 9775 existing records. [2025-10-01T19:34:14.317004] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:34:14.317440] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-01T19:34:14.317605] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-01T19:34:14.318309] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-01T19:34:14.318386] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-01T19:34:14.518577] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-01T19:34:14.763723] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:34:14.766553] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T19:34:14.803619] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T19:34:15.302383] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-01T19:34:15.858768] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T19:34:16.102418] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-01T19:34:16.887199] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T19:34:16.902338] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-01T19:34:16.966086] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T19:34:17.702414] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-01T19:34:18.502354] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-01T19:34:18.725588] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T19:34:18.777024] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T19:34:19.303628] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-01T19:34:19.307394] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T19:34:20.102432] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-01T19:34:20.510674] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T19:34:20.609393] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-01T19:34:20.902389] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-01T19:34:21.683798] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T19:34:21.702400] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-01T19:34:22.502387] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-01T19:34:23.302379] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-01T19:34:23.403471] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T19:34:24.102379] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-01T19:34:24.300706] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T19:34:24.406144] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-01T19:34:24.407932] [INFO ] [REMOTE ] IEX: Full fetch complete (53486 records). [2025-10-01T19:34:24.408024] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-01T19:34:24.880775] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-01T19:34:24.880858] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-01T19:34:24.881730] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-01T19:34:24.881793] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-01T19:34:24.885247] [DEBUG] [LOCAL ] IEX: Trimmed 53486 records to 38359 (keeping 200 days of data) [2025-10-01T19:34:24.943557] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-01T19:34:25.135895] [DEBUG] [LOCAL ] IEX: Primary data saved (38359 records). [2025-10-01T19:34:25.136037] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-01T19:34:25.136121] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 44.9s. Estimated remaining: 3h 0m 48s. Rate: 7.1 symbols/min [2025-10-01T19:34:25.339195] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:34:25.358146] [DEBUG] [LOCAL ] IGD: Loaded 19008 existing records from primary storage. [2025-10-01T19:34:25.358411] [INFO ] [MAIN ] IGD: Loaded 19008 existing records. [2025-10-01T19:34:25.565153] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:34:25.565367] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-01T19:34:25.565478] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-01T19:34:25.566180] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-01T19:34:25.566242] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-01T19:34:25.708165] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-01T19:34:25.980187] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:34:26.109139] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T19:34:26.467958] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T19:34:26.502375] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-01T19:34:27.037340] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T19:34:27.100282] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-01T19:34:27.101964] [INFO ] [REMOTE ] IFF: Full fetch complete (73036 records). [2025-10-01T19:34:27.102073] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-01T19:34:27.315282] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-01T19:34:27.535502] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-01T19:34:27.535586] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-01T19:34:27.536760] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-01T19:34:27.536832] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-01T19:34:27.538504] [DEBUG] [LOCAL ] IFF: Trimmed 73036 records to 50984 (keeping 200 days of data) [2025-10-01T19:34:27.873707] [DEBUG] [LOCAL ] IFF: Primary data saved (50984 records). [2025-10-01T19:34:27.873867] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-01T19:34:27.873977] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFF took 45.4s. Estimated remaining: 3h 0m 33s. Rate: 7.1 symbols/min [2025-10-01T19:34:28.068481] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:34:28.069439] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T19:34:28.078399] [DEBUG] [LOCAL ] IGI: Loaded 3617 existing records from primary storage. [2025-10-01T19:34:28.078629] [INFO ] [MAIN ] IGI: Loaded 3617 existing records. [2025-10-01T19:34:28.109069] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-01T19:34:28.270461] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:34:28.270715] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-01T19:34:28.270774] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-01T19:34:28.270936] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-01T19:34:28.270997] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-01T19:34:28.702147] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:34:28.902349] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-01T19:34:28.977997] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T19:34:29.702390] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-01T19:34:29.882596] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T19:34:30.502425] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-01T19:34:30.537925] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T19:34:31.302366] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-01T19:34:31.388985] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T19:34:32.102388] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-01T19:34:32.567138] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T19:34:32.902410] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-01T19:34:33.213564] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T19:34:33.214488] [INFO ] [REMOTE ] IGA: Full fetch complete (13742 records). [2025-10-01T19:34:33.214578] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-01T19:34:33.425710] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T19:34:33.620013] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-01T19:34:33.620089] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-01T19:34:33.620396] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-01T19:34:33.620435] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-01T19:34:33.620966] [DEBUG] [LOCAL ] IGA: Trimmed 13742 records to 9830 (keeping 200 days of data) [2025-10-01T19:34:33.683704] [DEBUG] [LOCAL ] IGA: Primary data saved (9830 records). [2025-10-01T19:34:33.683848] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-01T19:34:33.683940] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IGA took 19.8s. Estimated remaining: 3h 0m 21s. Rate: 7.1 symbols/min [2025-10-01T19:34:33.707519] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-01T19:34:33.876831] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:34:33.909828] [DEBUG] [LOCAL ] IGR: Loaded 30505 existing records from primary storage. [2025-10-01T19:34:33.910148] [INFO ] [MAIN ] IGR: Loaded 30505 existing records. [2025-10-01T19:34:34.116469] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:34:34.116726] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-01T19:34:34.116841] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-01T19:34:34.117113] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-01T19:34:34.117175] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-01T19:34:34.507593] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-01T19:34:34.546824] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:34:34.988188] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T19:34:35.302357] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-01T19:34:35.320050] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T19:34:36.102393] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-01T19:34:36.893420] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T19:34:36.902340] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-01T19:34:37.202220] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T19:34:37.233701] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-01T19:34:37.702410] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-01T19:34:38.502417] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-01T19:34:38.772124] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T19:34:39.103990] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T19:34:39.302376] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-01T19:34:40.102429] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-01T19:34:40.902402] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-01T19:34:40.926110] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-01T19:34:40.927710] [INFO ] [REMOTE ] IFS: Full fetch complete (31657 records). [2025-10-01T19:34:40.927869] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-01T19:34:41.305588] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T19:34:41.361531] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-01T19:34:41.361618] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-01T19:34:41.362362] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-01T19:34:41.362428] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-01T19:34:41.363423] [DEBUG] [LOCAL ] IFS: Trimmed 31657 records to 23078 (keeping 200 days of data) [2025-10-01T19:34:41.512658] [DEBUG] [LOCAL ] IFS: Primary data saved (23078 records). [2025-10-01T19:34:41.512942] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-01T19:34:41.513065] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFS took 44.5s. Estimated remaining: 3h 0m 12s. Rate: 7.1 symbols/min [2025-10-01T19:34:41.706324] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:34:41.706389] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-01T19:34:41.712076] [DEBUG] [LOCAL ] IH: Loaded 3225 existing records from primary storage. [2025-10-01T19:34:41.712287] [INFO ] [MAIN ] IH: Loaded 3225 existing records. [2025-10-01T19:34:41.906829] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:34:41.907118] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-01T19:34:41.907174] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-01T19:34:41.907520] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-01T19:34:41.907586] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-01T19:34:42.330690] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:34:42.398839] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T19:34:42.502373] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-01T19:34:42.837155] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T19:34:42.968920] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T19:34:43.302391] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-01T19:34:43.767663] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T19:34:44.102387] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-01T19:34:44.902386] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-01T19:34:45.347029] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T19:34:45.407193] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T19:34:45.702400] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-01T19:34:46.502433] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-01T19:34:46.996449] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T19:34:47.302382] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-01T19:34:47.475214] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T19:34:47.756510] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T19:34:48.102440] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-01T19:34:48.602317] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-01T19:34:48.902367] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-01T19:34:49.532497] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T19:34:49.702390] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-01T19:34:50.502395] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-01T19:34:50.712265] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T19:34:51.131352] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T19:34:51.302382] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-01T19:34:51.741004] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-01T19:34:52.102401] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-01T19:34:52.869527] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T19:34:52.902450] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-01T19:34:53.702413] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-01T19:34:54.176066] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T19:34:54.336961] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T19:34:54.502394] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-01T19:34:55.302373] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-01T19:34:55.461457] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T19:34:56.102389] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-01T19:34:56.366208] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T19:34:56.902403] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-01T19:34:57.174458] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T19:34:57.314538] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T19:34:57.702391] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-01T19:34:58.502388] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-01T19:34:59.104343] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T19:34:59.211283] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T19:34:59.212027] [INFO ] [REMOTE ] IGI: Full fetch complete (5267 records). [2025-10-01T19:34:59.212152] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-01T19:34:59.307571] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-01T19:34:59.607197] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-01T19:34:59.607310] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-01T19:34:59.607540] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-01T19:34:59.607667] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-01T19:34:59.608313] [DEBUG] [LOCAL ] IGI: Trimmed 5267 records to 3604 (keeping 200 days of data) [2025-10-01T19:34:59.632040] [DEBUG] [LOCAL ] IGI: Primary data saved (3604 records). [2025-10-01T19:34:59.632176] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-01T19:34:59.632268] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGI took 31.8s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-01T19:34:59.832716] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:34:59.842690] [DEBUG] [LOCAL ] IHD: Loaded 6983 existing records from primary storage. [2025-10-01T19:34:59.842886] [INFO ] [MAIN ] IHD: Loaded 6983 existing records. [2025-10-01T19:35:00.042057] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:00.042399] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-01T19:35:00.042453] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-01T19:35:00.042890] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-01T19:35:00.042969] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-01T19:35:00.106087] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-01T19:35:00.172296] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T19:35:00.481384] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:00.678276] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T19:35:00.902383] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-01T19:35:01.702364] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-01T19:35:02.193813] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-01T19:35:02.283205] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T19:35:02.502408] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-01T19:35:02.921359] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-01T19:35:03.302390] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-01T19:35:03.818491] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T19:35:04.102398] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-01T19:35:04.577748] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T19:35:04.902384] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-01T19:35:05.702458] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-01T19:35:05.880486] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T19:35:06.502388] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-01T19:35:06.738743] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T19:35:07.302387] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-01T19:35:07.655856] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T19:35:07.657981] [INFO ] [REMOTE ] IGD: Full fetch complete (29743 records). [2025-10-01T19:35:07.658127] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-01T19:35:08.085736] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-01T19:35:08.085827] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-01T19:35:08.086515] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-01T19:35:08.086578] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-01T19:35:08.087478] [DEBUG] [LOCAL ] IGD: Trimmed 29743 records to 19065 (keeping 200 days of data) [2025-10-01T19:35:08.143544] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-01T19:35:08.218368] [DEBUG] [LOCAL ] IGD: Primary data saved (19065 records). [2025-10-01T19:35:08.218522] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-01T19:35:08.218669] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGD took 43.1s. Estimated remaining: 3h 0m 6s. Rate: 7.1 symbols/min [2025-10-01T19:35:08.406111] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:35:08.435042] [DEBUG] [LOCAL ] IHG: Loaded 24441 existing records from primary storage. [2025-10-01T19:35:08.435324] [INFO ] [MAIN ] IHG: Loaded 24441 existing records. [2025-10-01T19:35:08.632763] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:08.632976] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-01T19:35:08.633028] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-01T19:35:08.633995] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-01T19:35:08.634059] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-01T19:35:08.831376] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T19:35:08.853150] [INFO ] [REMOTE ] IH: Full fetch complete (4971 records). [2025-10-01T19:35:08.864117] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-01T19:35:08.842953] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-01T19:35:08.921209] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-01T19:35:08.944162] [INFO ] [REMOTE ] IGR: Full fetch complete (45771 records). [2025-10-01T19:35:08.971941] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-01T19:35:09.328337] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:09.712865] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-01T19:35:09.933026] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-01T19:35:09.952094] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-01T19:35:09.952013] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-01T19:35:09.952329] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-01T19:35:09.952493] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-01T19:35:09.952821] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-01T19:35:09.953673] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-01T19:35:09.953903] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-01T19:35:09.954458] [DEBUG] [LOCAL ] IH: Trimmed 4971 records to 3116 (keeping 200 days of data) [2025-10-01T19:35:09.971614] [DEBUG] [LOCAL ] IGR: Trimmed 45771 records to 30496 (keeping 200 days of data) [2025-10-01T19:35:09.974342] [DEBUG] [LOCAL ] IH: Primary data saved (3116 records). [2025-10-01T19:35:09.974669] [INFO ] [MAIN ] IH: Full history saved. [2025-10-01T19:35:09.974833] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IH took 28.5s. Estimated remaining: 2h 59m 50s. Rate: 7.1 symbols/min [2025-10-01T19:35:10.181507] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T19:35:10.274368] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:35:10.380193] [DEBUG] [LOCAL ] IHS: Loaded 39106 existing records from primary storage. [2025-10-01T19:35:10.382529] [INFO ] [MAIN ] IHS: Loaded 39106 existing records. [2025-10-01T19:35:10.504516] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-01T19:35:10.611318] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:10.611894] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-01T19:35:10.612300] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-01T19:35:10.614169] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-01T19:35:10.616373] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-01T19:35:10.616305] [DEBUG] [LOCAL ] IGR: Primary data saved (30496 records). [2025-10-01T19:35:10.621697] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-01T19:35:10.663080] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGR took 37.0s. Estimated remaining: 2h 59m 32s. Rate: 7.1 symbols/min [2025-10-01T19:35:10.985585] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:35:11.110077] [DEBUG] [LOCAL ] IIF: Loaded 5721 existing records from primary storage. [2025-10-01T19:35:11.150706] [INFO ] [MAIN ] IIF: Loaded 5721 existing records. [2025-10-01T19:35:11.230158] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T19:35:11.317432] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-01T19:35:11.386618] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:11.412568] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T19:35:11.494340] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:11.494547] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-01T19:35:11.494596] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-01T19:35:11.494804] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-01T19:35:11.494863] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-01T19:35:11.877516] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:12.102355] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-01T19:35:12.255811] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T19:35:12.892631] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T19:35:12.902329] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-01T19:35:13.691149] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T19:35:13.702347] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-01T19:35:14.281231] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T19:35:14.502394] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-01T19:35:15.302372] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-01T19:35:15.697402] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T19:35:16.102386] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-01T19:35:16.693536] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T19:35:16.880458] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T19:35:16.902361] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-01T19:35:17.376154] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T19:35:17.702427] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-01T19:35:18.349751] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T19:35:18.502411] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-01T19:35:19.155543] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T19:35:19.302424] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-01T19:35:20.102390] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-01T19:35:20.521722] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T19:35:20.857483] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T19:35:20.902393] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-01T19:35:21.702436] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-01T19:35:21.867847] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T19:35:21.869723] [INFO ] [REMOTE ] IHD: Full fetch complete (11762 records). [2025-10-01T19:35:21.869852] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-01T19:35:22.303837] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-01T19:35:22.303927] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-01T19:35:22.304242] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-01T19:35:22.304318] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-01T19:35:22.305117] [DEBUG] [LOCAL ] IHD: Trimmed 11762 records to 6958 (keeping 200 days of data) [2025-10-01T19:35:22.353401] [DEBUG] [LOCAL ] IHD: Primary data saved (6958 records). [2025-10-01T19:35:22.353578] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-01T19:35:22.353717] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IHD took 22.7s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-01T19:35:22.507512] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-01T19:35:22.561374] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:35:22.581767] [DEBUG] [LOCAL ] IIIN: Loaded 16449 existing records from primary storage. [2025-10-01T19:35:22.582059] [INFO ] [MAIN ] IIIN: Loaded 16449 existing records. [2025-10-01T19:35:22.829520] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:22.830023] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-01T19:35:22.830124] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-01T19:35:22.873376] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-01T19:35:22.885379] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-01T19:35:22.956015] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T19:35:23.309827] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:23.309897] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-01T19:35:23.726502] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T19:35:24.102380] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-01T19:35:24.313889] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T19:35:24.902395] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-01T19:35:25.438992] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T19:35:25.702419] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-01T19:35:25.751334] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:35:26.502414] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-01T19:35:26.848451] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T19:35:27.221821] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T19:35:27.302439] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-01T19:35:28.102402] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-01T19:35:28.134920] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-01T19:35:28.902374] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-01T19:35:29.260074] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T19:35:29.690025] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T19:35:29.702349] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-01T19:35:30.502415] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-01T19:35:30.894063] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T19:35:30.898835] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-01T19:35:31.302388] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-01T19:35:32.078898] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T19:35:32.102338] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-01T19:35:32.748611] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T19:35:32.902406] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-01T19:35:33.479458] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-01T19:35:33.702440] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-01T19:35:34.502488] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-01T19:35:34.633841] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T19:35:34.952898] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T19:35:35.302418] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-01T19:35:36.102445] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-01T19:35:36.241814] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-01T19:35:36.600622] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T19:35:36.902458] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-01T19:35:37.702437] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-01T19:35:38.045275] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T19:35:38.502417] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-01T19:35:38.780302] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T19:35:39.302375] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-01T19:35:39.613119] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T19:35:40.102416] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-01T19:35:40.559411] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T19:35:40.807492] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T19:35:40.902407] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-01T19:35:41.582612] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T19:35:41.583509] [INFO ] [REMOTE ] IIF: Full fetch complete (9445 records). [2025-10-01T19:35:41.583580] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-01T19:35:41.707500] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-01T19:35:41.976121] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-01T19:35:41.976259] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-01T19:35:41.976638] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-01T19:35:41.976728] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-01T19:35:41.977291] [DEBUG] [LOCAL ] IIF: Trimmed 9445 records to 5723 (keeping 200 days of data) [2025-10-01T19:35:42.012673] [DEBUG] [LOCAL ] IIF: Primary data saved (5723 records). [2025-10-01T19:35:42.012836] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-01T19:35:42.012954] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IIF took 31.3s. Estimated remaining: 2h 59m 32s. Rate: 7.1 symbols/min [2025-10-01T19:35:42.195018] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:35:42.215086] [DEBUG] [LOCAL ] IIM: Loaded 15962 existing records from primary storage. [2025-10-01T19:35:42.215486] [INFO ] [MAIN ] IIM: Loaded 15962 existing records. [2025-10-01T19:35:42.400467] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:42.401793] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-01T19:35:42.401855] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-01T19:35:42.402550] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-01T19:35:42.402612] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-01T19:35:42.505246] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-01T19:35:42.784266] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:42.804046] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T19:35:43.302433] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-01T19:35:43.753539] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T19:35:44.102403] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-01T19:35:44.541354] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T19:35:44.543088] [INFO ] [REMOTE ] IHG: Full fetch complete (33769 records). [2025-10-01T19:35:44.543169] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-01T19:35:44.907547] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-01T19:35:44.963524] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-01T19:35:44.963639] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-01T19:35:44.964500] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-01T19:35:44.964557] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-01T19:35:44.965708] [DEBUG] [LOCAL ] IHG: Trimmed 33769 records to 24438 (keeping 200 days of data) [2025-10-01T19:35:45.134043] [DEBUG] [LOCAL ] IHG: Primary data saved (24438 records). [2025-10-01T19:35:45.134192] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-01T19:35:45.134298] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHG took 36.9s. Estimated remaining: 2h 59m 17s. Rate: 7.1 symbols/min [2025-10-01T19:35:45.329232] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:35:45.341145] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T19:35:45.375843] [DEBUG] [LOCAL ] IIPR: Loaded 29709 existing records from primary storage. [2025-10-01T19:35:45.376182] [INFO ] [MAIN ] IIPR: Loaded 29709 existing records. [2025-10-01T19:35:45.603969] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:45.604197] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-01T19:35:45.604250] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-01T19:35:45.604485] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-01T19:35:45.604546] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-01T19:35:45.710138] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-01T19:35:46.015964] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:46.502372] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-01T19:35:46.544755] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T19:35:46.949845] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T19:35:47.302358] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-01T19:35:47.694812] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T19:35:48.102494] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-01T19:35:48.608496] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T19:35:48.902502] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-01T19:35:49.663748] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T19:35:49.702410] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-01T19:35:49.920864] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T19:35:50.502402] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-01T19:35:51.180212] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T19:35:51.302386] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-01T19:35:51.370611] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T19:35:52.102416] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-01T19:35:52.412111] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T19:35:52.902379] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-01T19:35:53.077757] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T19:35:53.702359] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-01T19:35:53.930540] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T19:35:54.502396] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-01T19:35:54.667500] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T19:35:55.307112] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-01T19:35:55.309817] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T19:35:56.102353] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-01T19:35:56.148543] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T19:35:56.902418] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-01T19:35:57.107966] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T19:35:57.109073] [INFO ] [REMOTE ] IIIN: Full fetch complete (24928 records). [2025-10-01T19:35:57.109151] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-01T19:35:57.529348] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-01T19:35:57.529445] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-01T19:35:57.530067] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-01T19:35:57.530131] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-01T19:35:57.530969] [DEBUG] [LOCAL ] IIIN: Trimmed 24928 records to 16358 (keeping 200 days of data) [2025-10-01T19:35:57.643279] [DEBUG] [LOCAL ] IIIN: Primary data saved (16358 records). [2025-10-01T19:35:57.643478] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-01T19:35:57.643605] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIIN took 35.3s. Estimated remaining: 2h 59m 14s. Rate: 7.1 symbols/min [2025-10-01T19:35:57.702371] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-01T19:35:57.837172] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:35:57.848547] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T19:35:57.896137] [DEBUG] [LOCAL ] IMAX: Loaded 42737 existing records from primary storage. [2025-10-01T19:35:57.896506] [INFO ] [MAIN ] IMAX: Loaded 42737 existing records. [2025-10-01T19:35:58.091516] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:35:58.091796] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-01T19:35:58.091847] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-01T19:35:58.093360] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-01T19:35:58.093423] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-01T19:35:58.509152] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:35:58.505352] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-01T19:35:59.108294] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T19:35:59.302381] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-01T19:36:00.027868] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T19:36:00.102397] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-01T19:36:00.796960] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T19:36:00.902381] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-01T19:36:01.534101] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T19:36:01.702369] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-01T19:36:01.854990] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T19:36:02.502411] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-01T19:36:03.057862] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T19:36:03.302396] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-01T19:36:03.415798] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T19:36:04.102417] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-01T19:36:04.732479] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T19:36:04.902363] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-01T19:36:05.070562] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T19:36:05.702389] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-01T19:36:06.502383] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-01T19:36:06.545036] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T19:36:06.546369] [INFO ] [REMOTE ] IHS: Full fetch complete (51921 records). [2025-10-01T19:36:06.546469] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-01T19:36:06.993365] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-01T19:36:06.993470] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-01T19:36:06.994405] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-01T19:36:06.994473] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-01T19:36:06.995633] [DEBUG] [LOCAL ] IHS: Trimmed 51921 records to 39149 (keeping 200 days of data) [2025-10-01T19:36:07.118057] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T19:36:07.264837] [DEBUG] [LOCAL ] IHS: Primary data saved (39149 records). [2025-10-01T19:36:07.264988] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-01T19:36:07.265103] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 57.3s. Estimated remaining: 2h 59m 6s. Rate: 7.1 symbols/min [2025-10-01T19:36:07.307494] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-01T19:36:07.461463] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:36:07.511759] [DEBUG] [LOCAL ] INFA: Loaded 49666 existing records from primary storage. [2025-10-01T19:36:07.512197] [INFO ] [MAIN ] INFA: Loaded 49666 existing records. [2025-10-01T19:36:07.742570] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:36:07.742887] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-01T19:36:07.742949] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-01T19:36:07.743460] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-01T19:36:07.743524] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-01T19:36:07.960357] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T19:36:08.107506] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-01T19:36:08.173338] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:36:08.664218] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T19:36:08.902404] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-01T19:36:09.304172] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-01T19:36:09.305197] [INFO ] [REMOTE ] IIM: Full fetch complete (25438 records). [2025-10-01T19:36:09.305268] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-01T19:36:09.707940] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-01T19:36:09.742135] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-01T19:36:09.742220] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-01T19:36:09.742850] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-01T19:36:09.742914] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-01T19:36:09.743668] [DEBUG] [LOCAL ] IIM: Trimmed 25438 records to 16041 (keeping 200 days of data) [2025-10-01T19:36:09.852681] [DEBUG] [LOCAL ] IIM: Primary data saved (16041 records). [2025-10-01T19:36:09.852831] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-01T19:36:09.852941] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIM took 27.8s. Estimated remaining: 2h 58m 51s. Rate: 7.1 symbols/min [2025-10-01T19:36:10.044684] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:36:10.102808] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-10-01T19:36:10.103151] [INFO ] [MAIN ] INFY: Loaded 53598 existing records. [2025-10-01T19:36:10.302341] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:36:10.302718] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-01T19:36:10.302782] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-01T19:36:10.303434] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-01T19:36:10.303497] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-01T19:36:10.509715] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-01T19:36:10.754753] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:36:10.785975] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T19:36:10.944179] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T19:36:11.302366] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-01T19:36:11.606743] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T19:36:12.102400] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-01T19:36:12.907517] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-01T19:36:12.925713] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T19:36:13.702955] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-01T19:36:13.702843] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:36:14.492994] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T19:36:14.507335] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-01T19:36:15.302352] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-01T19:36:15.411401] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T19:36:16.005538] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:36:16.102420] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-01T19:36:16.706268] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T19:36:16.902426] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-01T19:36:17.702369] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-01T19:36:17.886031] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T19:36:18.264718] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T19:36:18.502381] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-01T19:36:19.114165] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T19:36:19.302395] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-01T19:36:20.107520] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-01T19:36:20.124248] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T19:36:20.718315] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T19:36:20.902398] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-01T19:36:21.252123] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T19:36:21.702432] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-01T19:36:22.502372] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-01T19:36:22.538621] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T19:36:23.184218] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T19:36:23.302454] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-01T19:36:24.102383] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-01T19:36:24.429787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T19:36:24.544433] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T19:36:24.902389] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-01T19:36:25.702393] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-01T19:36:25.760735] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T19:36:26.381370] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T19:36:26.502417] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-01T19:36:27.302402] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-01T19:36:27.335631] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-01T19:36:27.336970] [INFO ] [REMOTE ] IIPR: Full fetch complete (44578 records). [2025-10-01T19:36:27.337111] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-01T19:36:27.785198] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-01T19:36:27.785309] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-01T19:36:27.786193] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-01T19:36:27.786257] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-01T19:36:27.787397] [DEBUG] [LOCAL ] IIPR: Trimmed 44578 records to 29798 (keeping 200 days of data) [2025-10-01T19:36:28.008784] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T19:36:28.030494] [DEBUG] [LOCAL ] IIPR: Primary data saved (29798 records). [2025-10-01T19:36:28.030668] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-01T19:36:28.030788] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIPR took 42.9s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-10-01T19:36:28.107517] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-01T19:36:28.248702] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:36:28.299797] [DEBUG] [LOCAL ] ING: Loaded 50722 existing records from primary storage. [2025-10-01T19:36:28.300187] [INFO ] [MAIN ] ING: Loaded 50722 existing records. [2025-10-01T19:36:28.501628] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:36:28.501931] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-01T19:36:28.501982] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-01T19:36:28.502866] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-01T19:36:28.502931] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-01T19:36:28.887128] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:36:28.902342] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-01T19:36:29.168223] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-01T19:36:29.169615] [INFO ] [REMOTE ] IMAX: Full fetch complete (59834 records). [2025-10-01T19:36:29.169736] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-01T19:36:29.596634] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-01T19:36:29.596899] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-01T19:36:29.598011] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-01T19:36:29.598252] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-01T19:36:29.628621] [DEBUG] [LOCAL ] IMAX: Trimmed 59834 records to 42818 (keeping 200 days of data) [2025-10-01T19:36:29.630216] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T19:36:29.704162] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-01T19:36:29.905321] [DEBUG] [LOCAL ] IMAX: Primary data saved (42818 records). [2025-10-01T19:36:29.905453] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-01T19:36:29.905536] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IMAX took 32.3s. Estimated remaining: 2h 58m 38s. Rate: 7.1 symbols/min [2025-10-01T19:36:30.090124] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:36:30.118403] [DEBUG] [LOCAL ] INGM: Loaded 28628 existing records from primary storage. [2025-10-01T19:36:30.118694] [INFO ] [MAIN ] INGM: Loaded 28628 existing records. [2025-10-01T19:36:30.322130] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:36:30.322523] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-01T19:36:30.322600] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-01T19:36:30.323562] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-01T19:36:30.323624] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-01T19:36:30.509213] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-01T19:36:30.722392] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:36:30.776231] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T19:36:31.302354] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-01T19:36:31.404418] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T19:36:32.102365] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-01T19:36:32.192688] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:36:32.902372] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-01T19:36:33.031476] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T19:36:33.531956] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T19:36:33.702380] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-01T19:36:34.466633] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T19:36:34.502387] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-01T19:36:35.302382] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-01T19:36:35.532136] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-01T19:36:35.583316] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T19:36:36.102377] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-01T19:36:36.282200] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T19:36:36.902423] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-01T19:36:37.702355] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-01T19:36:37.844512] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T19:36:38.502381] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-01T19:36:38.816374] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T19:36:39.177704] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T19:36:39.302372] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-01T19:36:39.737131] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T19:36:40.102407] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-01T19:36:40.902406] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-01T19:36:41.278862] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-01T19:36:41.280408] [INFO ] [REMOTE ] INFA: Full fetch complete (71434 records). [2025-10-01T19:36:41.280523] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-01T19:36:41.718194] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-01T19:36:41.762329] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-01T19:36:41.765125] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T19:36:41.763500] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-01T19:36:41.775808] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-01T19:36:41.775991] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-01T19:36:41.777489] [DEBUG] [LOCAL ] INFA: Trimmed 71434 records to 49567 (keeping 200 days of data) [2025-10-01T19:36:42.096252] [DEBUG] [LOCAL ] INFA: Primary data saved (49567 records). [2025-10-01T19:36:42.096436] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-01T19:36:42.096634] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. INFA took 34.8s. Estimated remaining: 2h 58m 33s. Rate: 7.1 symbols/min [2025-10-01T19:36:42.300488] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:36:42.339800] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T19:36:42.373053] [DEBUG] [LOCAL ] INGR: Loaded 33275 existing records from primary storage. [2025-10-01T19:36:42.373432] [INFO ] [MAIN ] INGR: Loaded 33275 existing records. [2025-10-01T19:36:42.507508] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-01T19:36:42.577834] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:36:42.578115] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-01T19:36:42.578171] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-01T19:36:42.578484] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-01T19:36:42.578557] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-01T19:36:42.975287] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:36:43.302397] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-01T19:36:43.446538] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T19:36:44.102347] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-01T19:36:44.226189] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T19:36:44.265773] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T19:36:44.902401] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-01T19:36:45.459598] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T19:36:45.702380] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-01T19:36:46.502432] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-01T19:36:47.302387] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-01T19:36:47.367578] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T19:36:47.411059] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-01T19:36:47.412691] [INFO ] [REMOTE ] INFY: Full fetch complete (77544 records). [2025-10-01T19:36:47.412792] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-01T19:36:47.832368] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-01T19:36:47.832459] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-01T19:36:47.833601] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-01T19:36:47.833694] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-01T19:36:47.835222] [DEBUG] [LOCAL ] INFY: Trimmed 77544 records to 53598 (keeping 200 days of data) [2025-10-01T19:36:48.130806] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-01T19:36:48.179982] [DEBUG] [LOCAL ] INFY: Primary data saved (53598 records). [2025-10-01T19:36:48.180132] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-01T19:36:48.180243] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFY took 38.3s. Estimated remaining: 2h 58m 22s. Rate: 7.1 symbols/min [2025-10-01T19:36:48.368021] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:36:48.390467] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T19:36:48.432460] [DEBUG] [LOCAL ] INN: Loaded 41730 existing records from primary storage. [2025-10-01T19:36:48.432807] [INFO ] [MAIN ] INN: Loaded 41730 existing records. [2025-10-01T19:36:48.563940] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T19:36:48.659688] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:36:48.659922] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-01T19:36:48.659983] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-01T19:36:48.660248] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-01T19:36:48.660308] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-01T19:36:48.907476] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-01T19:36:49.052562] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:36:49.702370] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-01T19:36:49.990592] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T19:36:50.440806] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T19:36:50.502394] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-01T19:36:50.870529] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T19:36:51.302392] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-01T19:36:52.102382] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-01T19:36:52.144723] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T19:36:52.742768] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T19:36:52.902365] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-01T19:36:53.403300] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-01T19:36:53.702352] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-01T19:36:53.783339] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T19:36:54.502430] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-01T19:36:55.176925] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T19:36:55.302416] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-01T19:36:55.883961] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T19:36:56.102385] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-01T19:36:56.913331] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-01T19:36:56.919317] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T19:36:57.436843] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T19:36:57.702382] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-01T19:36:58.356434] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T19:36:58.502393] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-01T19:36:59.056804] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T19:36:59.302376] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-01T19:37:00.086798] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T19:37:00.102348] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-01T19:37:00.155783] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-01T19:37:00.902377] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-01T19:37:01.692089] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T19:37:01.702390] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-01T19:37:01.926601] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T19:37:02.451708] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T19:37:02.502424] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-01T19:37:03.302374] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-01T19:37:03.632575] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T19:37:04.102390] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-01T19:37:04.675244] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T19:37:04.902373] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-01T19:37:05.702437] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-01T19:37:06.281498] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T19:37:06.396347] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-01T19:37:06.398122] [INFO ] [REMOTE ] ING: Full fetch complete (73626 records). [2025-10-01T19:37:06.398234] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-01T19:37:06.507577] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-01T19:37:06.843975] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-01T19:37:06.844065] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-01T19:37:06.845109] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-01T19:37:06.845176] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-01T19:37:06.846635] [DEBUG] [LOCAL ] ING: Trimmed 73626 records to 50724 (keeping 200 days of data) [2025-10-01T19:37:06.974144] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-01T19:37:06.979157] [INFO ] [REMOTE ] INGM: Full fetch complete (42412 records). [2025-10-01T19:37:06.981230] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-01T19:37:07.307095] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-01T19:37:07.526548] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-01T19:37:07.526989] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-01T19:37:07.531493] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-01T19:37:07.532558] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-01T19:37:07.537702] [DEBUG] [LOCAL ] INGM: Trimmed 42412 records to 28652 (keeping 200 days of data) [2025-10-01T19:37:07.795065] [DEBUG] [LOCAL ] ING: Primary data saved (50724 records). [2025-10-01T19:37:07.796475] [INFO ] [MAIN ] ING: Full history saved. [2025-10-01T19:37:07.797136] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. ING took 39.8s. Estimated remaining: 2h 58m 26s. Rate: 7.1 symbols/min [2025-10-01T19:37:08.030739] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:37:08.035385] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-01T19:37:08.034021] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T19:37:08.035279] [DEBUG] [LOCAL ] INGM: Primary data saved (28652 records). [2025-10-01T19:37:08.044768] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-01T19:37:08.045055] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INGM took 38.1s. Estimated remaining: 2h 58m 9s. Rate: 7.1 symbols/min [2025-10-01T19:37:08.044859] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-01T19:37:08.058039] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-01T19:37:08.063390] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-01T19:37:08.069583] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-01T19:37:08.070043] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-01T19:37:08.109091] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-01T19:37:08.414085] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:37:08.674189] [DEBUG] [LOCAL ] INSP: Loaded 37045 existing records from primary storage. [2025-10-01T19:37:08.693296] [INFO ] [MAIN ] INSP: Loaded 37045 existing records. [2025-10-01T19:37:08.701945] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:37:08.902200] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:37:08.902745] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-01T19:37:08.903079] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-01T19:37:08.902398] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-01T19:37:08.904374] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-01T19:37:08.904480] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-01T19:37:09.052301] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T19:37:09.144242] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:37:09.199607] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-01T19:37:09.228829] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:37:09.241685] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-01T19:37:09.270274] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:37:09.273991] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-01T19:37:09.274396] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-01T19:37:09.285098] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-01T19:37:09.295530] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-01T19:37:09.300762] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INR took 1.5s. Estimated remaining: 2h 57m 52s. Rate: 7.1 symbols/min [2025-10-01T19:37:09.404774] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:37:09.566933] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:37:09.593564] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T19:37:09.636842] [DEBUG] [LOCAL ] INSW: Loaded 40060 existing records from primary storage. [2025-10-01T19:37:09.637137] [INFO ] [MAIN ] INSW: Loaded 40060 existing records. [2025-10-01T19:37:09.707484] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-01T19:37:09.843325] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:37:09.843559] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-01T19:37:09.843624] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-01T19:37:09.843930] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-01T19:37:09.844011] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-01T19:37:10.253676] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:37:10.502377] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-01T19:37:11.302435] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-01T19:37:11.710913] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-01T19:37:11.712762] [INFO ] [REMOTE ] INGR: Full fetch complete (50186 records). [2025-10-01T19:37:11.712908] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-01T19:37:12.066243] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T19:37:12.107434] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-01T19:37:12.174458] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-01T19:37:12.174541] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-01T19:37:12.175487] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-01T19:37:12.175557] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-01T19:37:12.176754] [DEBUG] [LOCAL ] INGR: Trimmed 50186 records to 33339 (keeping 200 days of data) [2025-10-01T19:37:12.394371] [DEBUG] [LOCAL ] INGR: Primary data saved (33339 records). [2025-10-01T19:37:12.394527] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-01T19:37:12.394615] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGR took 30.3s. Estimated remaining: 2h 57m 37s. Rate: 7.1 symbols/min [2025-10-01T19:37:12.600531] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:37:12.654510] [DEBUG] [LOCAL ] INVH: Loaded 53130 existing records from primary storage. [2025-10-01T19:37:12.654902] [INFO ] [MAIN ] INVH: Loaded 53130 existing records. [2025-10-01T19:37:12.855159] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:37:12.855502] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-01T19:37:12.862687] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-01T19:37:12.875694] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T19:37:12.875762] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-01T19:37:12.876015] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-01T19:37:12.907506] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-01T19:37:13.273853] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:37:13.702396] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-01T19:37:13.832143] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T19:37:14.341408] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T19:37:14.502378] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-01T19:37:15.163168] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T19:37:15.302452] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-01T19:37:16.102423] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-01T19:37:16.383147] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T19:37:16.716856] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T19:37:16.902430] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-01T19:37:17.259561] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T19:37:17.702392] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-01T19:37:18.502364] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-01T19:37:18.613141] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T19:37:19.302410] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-01T19:37:19.333418] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T19:37:20.102386] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-01T19:37:20.381167] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-01T19:37:20.382551] [INFO ] [REMOTE ] INN: Full fetch complete (57801 records). [2025-10-01T19:37:20.382670] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-01T19:37:20.870860] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-01T19:37:20.871035] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-01T19:37:20.872062] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-01T19:37:20.872188] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-01T19:37:20.880727] [DEBUG] [LOCAL ] INN: Trimmed 57801 records to 41756 (keeping 200 days of data) [2025-10-01T19:37:20.894174] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T19:37:20.949589] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-01T19:37:21.149479] [DEBUG] [LOCAL ] INN: Primary data saved (41756 records). [2025-10-01T19:37:21.149678] [INFO ] [MAIN ] INN: Full history saved. [2025-10-01T19:37:21.149792] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 33.0s. Estimated remaining: 2h 57m 29s. Rate: 7.1 symbols/min [2025-10-01T19:37:21.341755] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:37:21.371198] [DEBUG] [LOCAL ] INVX: Loaded 29027 existing records from primary storage. [2025-10-01T19:37:21.371491] [INFO ] [MAIN ] INVX: Loaded 29027 existing records. [2025-10-01T19:37:21.569137] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:37:21.569426] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-01T19:37:21.569483] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-01T19:37:21.570155] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-01T19:37:21.570219] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-01T19:37:21.706570] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-01T19:37:22.006594] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:37:22.034714] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-01T19:37:22.502403] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-01T19:37:22.731418] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T19:37:23.302349] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-01T19:37:23.468203] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T19:37:24.102396] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-01T19:37:24.353109] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T19:37:24.902376] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-01T19:37:24.969922] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T19:37:25.702455] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-01T19:37:25.863057] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T19:37:26.502411] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-01T19:37:26.679066] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:37:27.237178] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T19:37:27.302441] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-01T19:37:27.963253] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T19:37:28.102443] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-01T19:37:28.656332] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T19:37:28.902390] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-01T19:37:29.179157] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T19:37:29.702424] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-01T19:37:30.342990] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T19:37:30.502380] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-01T19:37:31.044408] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T19:37:31.302383] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-01T19:37:31.446722] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-01T19:37:32.102401] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-01T19:37:32.840716] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T19:37:32.902366] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-01T19:37:33.227766] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T19:37:33.702385] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-01T19:37:34.345270] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T19:37:34.502400] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-01T19:37:35.279417] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T19:37:35.302393] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-01T19:37:35.880484] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T19:37:36.102394] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-01T19:37:36.902371] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-01T19:37:37.148819] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T19:37:37.176317] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T19:37:37.702402] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-01T19:37:38.188202] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T19:37:38.502400] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-01T19:37:39.035124] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T19:37:39.302388] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-01T19:37:39.900747] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T19:37:40.102366] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-01T19:37:40.902413] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-01T19:37:41.188066] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T19:37:41.189354] [INFO ] [REMOTE ] INSW: Full fetch complete (60562 records). [2025-10-01T19:37:41.189446] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-01T19:37:41.633503] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-01T19:37:41.633665] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-01T19:37:41.634666] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-01T19:37:41.634756] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-01T19:37:41.638007] [DEBUG] [LOCAL ] INSW: Trimmed 60562 records to 39994 (keeping 200 days of data) [2025-10-01T19:37:41.709106] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-01T19:37:41.908399] [DEBUG] [LOCAL ] INSW: Primary data saved (39994 records). [2025-10-01T19:37:41.908558] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-01T19:37:41.908669] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSW took 32.6s. Estimated remaining: 2h 57m 35s. Rate: 7.1 symbols/min [2025-10-01T19:37:42.082231] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-01T19:37:42.113609] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:37:42.114774] [INFO ] [REMOTE ] INSP: Full fetch complete (52999 records). [2025-10-01T19:37:42.115029] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-01T19:37:42.230401] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T19:37:42.510119] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-01T19:37:42.516207] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-01T19:37:42.508691] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-01T19:37:42.717370] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-01T19:37:42.725971] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-01T19:37:42.729840] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-01T19:37:42.729965] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-01T19:37:42.786029] [DEBUG] [LOCAL ] INSP: Trimmed 52999 records to 37162 (keeping 200 days of data) [2025-10-01T19:37:42.821806] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:37:42.822084] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-01T19:37:42.822135] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-01T19:37:42.823900] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-01T19:37:42.823979] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-01T19:37:43.474449] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:37:43.476857] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-01T19:37:43.481409] [DEBUG] [LOCAL ] INSP: Primary data saved (37162 records). [2025-10-01T19:37:43.482720] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-01T19:37:43.482925] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSP took 35.4s. Estimated remaining: 2h 57m 18s. Rate: 7.1 symbols/min [2025-10-01T19:37:43.710845] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:37:43.713499] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-01T19:37:43.776859] [DEBUG] [LOCAL ] IOT: Loaded 53470 existing records from primary storage. [2025-10-01T19:37:43.777204] [INFO ] [MAIN ] IOT: Loaded 53470 existing records. [2025-10-01T19:37:43.979752] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:37:43.980047] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-01T19:37:43.980106] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-01T19:37:43.981879] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-01T19:37:43.981945] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-01T19:37:44.105765] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-01T19:37:44.206740] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T19:37:44.421464] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:37:44.902371] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-01T19:37:45.702424] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-01T19:37:45.849455] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-01T19:37:45.895411] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T19:37:46.474276] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T19:37:46.502345] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-01T19:37:46.973474] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T19:37:47.302450] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-01T19:37:48.102415] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-01T19:37:48.321057] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T19:37:48.902412] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-01T19:37:49.640585] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-01T19:37:49.642290] [INFO ] [REMOTE ] INVH: Full fetch complete (76725 records). [2025-10-01T19:37:49.642459] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-01T19:37:49.713270] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-01T19:37:50.096141] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-01T19:37:50.096312] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-01T19:37:50.097400] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-01T19:37:50.097539] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-01T19:37:50.099199] [DEBUG] [LOCAL ] INVH: Trimmed 76725 records to 53133 (keeping 200 days of data) [2025-10-01T19:37:50.464151] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T19:37:50.507984] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-01T19:37:50.539941] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-01T19:37:50.554933] [DEBUG] [LOCAL ] INVH: Primary data saved (53133 records). [2025-10-01T19:37:50.556132] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-01T19:37:50.556460] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INVH took 38.2s. Estimated remaining: 2h 57m 8s. Rate: 7.1 symbols/min [2025-10-01T19:37:50.606241] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T19:37:51.302408] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-01T19:37:52.102363] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-01T19:37:52.342941] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T19:37:52.472192] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-01T19:37:52.902588] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-01T19:37:53.702398] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-01T19:37:54.291492] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-01T19:37:54.351067] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T19:37:54.352248] [INFO ] [REMOTE ] INVX: Full fetch complete (44197 records). [2025-10-01T19:37:54.352349] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-01T19:37:54.510075] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-01T19:37:54.788873] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-01T19:37:54.788963] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-01T19:37:54.789769] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-01T19:37:54.789855] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-01T19:37:54.790897] [DEBUG] [LOCAL ] INVX: Trimmed 44197 records to 29044 (keeping 200 days of data) [2025-10-01T19:37:54.966784] [DEBUG] [LOCAL ] INVX: Primary data saved (29044 records). [2025-10-01T19:37:54.966921] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-01T19:37:54.967022] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 33.8s. Estimated remaining: 2h 56m 55s. Rate: 7.1 symbols/min [2025-10-01T19:37:55.643351] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T19:37:55.660300] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-01T19:37:57.346927] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-01T19:37:57.358578] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-01T19:37:57.517633] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T19:37:57.530405] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-01T19:37:59.347978] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T19:37:59.359362] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-01T19:38:00.036199] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-01T19:38:00.049987] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-01T19:38:01.310187] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T19:38:01.322706] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-01T19:38:02.800746] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-01T19:38:02.812898] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-01T19:38:03.338805] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-01T19:38:03.351533] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-01T19:38:05.327039] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-01T19:38:05.340259] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-01T19:38:05.375551] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-01T19:38:05.387719] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-01T19:38:07.806810] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-01T19:38:07.819207] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-01T19:38:08.079633] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-01T19:38:08.081313] [INFO ] [REMOTE ] IOT: Full fetch complete (77382 records). [2025-10-01T19:38:08.081457] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-01T19:38:08.525792] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-01T19:38:08.525889] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-01T19:38:08.527151] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-01T19:38:08.527225] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-01T19:38:08.529099] [DEBUG] [LOCAL ] IOT: Trimmed 77382 records to 53471 (keeping 200 days of data) [2025-10-01T19:38:08.902266] [DEBUG] [LOCAL ] IOT: Primary data saved (53471 records). [2025-10-01T19:38:08.902416] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-01T19:38:08.902501] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. IOT took 25.4s. Estimated remaining: 2h 56m 53s. Rate: 7.1 symbols/min [2025-10-01T19:38:10.529031] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-01T19:38:10.541591] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-01T19:38:13.345324] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-01T19:38:13.357440] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-01T19:38:17.798265] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (4.44 seconds). [2025-10-01T19:38:17.799860] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-01T19:38:17.799966] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-01T19:38:18.243870] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-01T19:38:18.243957] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-01T19:38:18.244957] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-01T19:38:18.245025] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-01T19:38:18.246598] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-01T19:38:18.593998] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-01T19:38:18.594151] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-01T19:38:18.594254] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 36.7s. Estimated remaining: 2h 56m 46s. Rate: 7.1 symbols/min [2025-10-01T19:38:19.279325] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:19.256833] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:19.325214] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:19.380941] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:19.402091] [DEBUG] [LOCAL ] IPI: Loaded 21401 existing records from primary storage. [2025-10-01T19:38:19.406203] [INFO ] [MAIN ] IPI: Loaded 21401 existing records. [2025-10-01T19:38:19.489786] [DEBUG] [LOCAL ] IQI: Loaded 18036 existing records from primary storage. [2025-10-01T19:38:19.521359] [INFO ] [MAIN ] IQI: Loaded 18036 existing records. [2025-10-01T19:38:19.715237] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-10-01T19:38:19.776778] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:19.782216] [INFO ] [MAIN ] IP: Loaded 53313 existing records. [2025-10-01T19:38:19.795553] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-01T19:38:19.832471] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-01T19:38:19.809584] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-01T19:38:19.857964] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-01T19:38:19.895589] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-01T19:38:19.953768] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-01T19:38:20.133690] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:20.159666] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-01T19:38:20.185814] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-01T19:38:20.216126] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-01T19:38:20.236883] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-01T19:38:20.452455] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:20.504551] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-01T19:38:20.514169] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:20.529539] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-01T19:38:20.561115] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-01T19:38:20.561351] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-01T19:38:20.573633] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-01T19:38:20.596047] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-01T19:38:20.601819] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-01T19:38:20.613664] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-01T19:38:21.756419] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:21.842483] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-01T19:38:21.873076] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:21.890379] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-01T19:38:22.029762] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:22.041894] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-01T19:38:22.077336] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:22.077611] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-01T19:38:23.005698] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T19:38:23.011701] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-01T19:38:23.359804] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T19:38:23.364808] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-01T19:38:23.479552] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T19:38:23.490957] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-01T19:38:23.552282] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T19:38:23.566151] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-01T19:38:23.693412] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T19:38:23.699470] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-01T19:38:24.353831] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T19:38:24.358468] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-01T19:38:24.670878] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T19:38:24.675541] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-01T19:38:24.801661] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T19:38:24.812815] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-01T19:38:24.861844] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T19:38:24.873128] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-01T19:38:25.226389] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T19:38:25.231530] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-01T19:38:25.810231] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T19:38:25.815602] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-01T19:38:26.198715] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T19:38:26.205214] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T19:38:26.206327] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-01T19:38:26.219364] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-01T19:38:26.251092] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T19:38:26.261948] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-01T19:38:26.888349] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T19:38:26.896463] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-01T19:38:27.275487] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T19:38:27.280709] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-01T19:38:27.843777] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T19:38:27.856984] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-01T19:38:27.892543] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:38:27.905517] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-01T19:38:28.103152] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T19:38:28.109159] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-01T19:38:28.208380] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T19:38:28.212261] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-01T19:38:28.852217] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T19:38:28.856299] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-01T19:38:29.292472] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T19:38:29.297299] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-01T19:38:29.433391] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T19:38:29.445779] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-01T19:38:29.656373] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T19:38:29.668001] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-01T19:38:30.032341] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T19:38:30.037092] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-01T19:38:30.381392] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T19:38:30.386144] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-01T19:38:30.921440] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T19:38:30.926860] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-01T19:38:31.307227] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T19:38:31.312997] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-01T19:38:31.368329] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T19:38:31.392362] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-01T19:38:31.393973] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:38:31.636838] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T19:38:32.102444] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-01T19:38:32.551552] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T19:38:32.902431] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-01T19:38:33.109164] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T19:38:33.191620] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T19:38:33.192684] [INFO ] [REMOTE ] IQI: Full fetch complete (27073 records). [2025-10-01T19:38:33.192816] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-01T19:38:33.605659] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-01T19:38:33.605755] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-01T19:38:33.606372] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-01T19:38:33.606415] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-01T19:38:33.607219] [DEBUG] [LOCAL ] IQI: Trimmed 27073 records to 18090 (keeping 200 days of data) [2025-10-01T19:38:33.705149] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-01T19:38:33.723766] [DEBUG] [LOCAL ] IQI: Primary data saved (18090 records). [2025-10-01T19:38:33.723891] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-01T19:38:33.723974] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IQI took 15.1s. Estimated remaining: 2h 56m 45s. Rate: 7.1 symbols/min [2025-10-01T19:38:33.938467] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:33.991956] [DEBUG] [LOCAL ] IQV: Loaded 50073 existing records from primary storage. [2025-10-01T19:38:33.992280] [INFO ] [MAIN ] IQV: Loaded 50073 existing records. [2025-10-01T19:38:34.184065] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:34.184267] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-01T19:38:34.184316] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-01T19:38:34.185015] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-01T19:38:34.185078] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-01T19:38:34.296227] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-01T19:38:34.313616] [INFO ] [REMOTE ] IPI: Full fetch complete (29292 records). [2025-10-01T19:38:34.324128] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-01T19:38:34.536631] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-01T19:38:34.929604] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:35.021617] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-01T19:38:35.021722] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-01T19:38:35.022388] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-01T19:38:35.022452] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-01T19:38:35.023263] [DEBUG] [LOCAL ] IPI: Trimmed 29292 records to 21433 (keeping 200 days of data) [2025-10-01T19:38:35.156532] [DEBUG] [LOCAL ] IPI: Primary data saved (21433 records). [2025-10-01T19:38:35.156687] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-01T19:38:35.156804] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IPI took 16.6s. Estimated remaining: 2h 56m 28s. Rate: 7.1 symbols/min [2025-10-01T19:38:35.316841] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-01T19:38:35.354457] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:35.410791] [DEBUG] [LOCAL ] IR: Loaded 52685 existing records from primary storage. [2025-10-01T19:38:35.411106] [INFO ] [MAIN ] IR: Loaded 52685 existing records. [2025-10-01T19:38:35.616273] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:35.616621] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-01T19:38:35.616762] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-01T19:38:35.617360] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-01T19:38:35.617425] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-01T19:38:35.950358] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-01T19:38:36.104418] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-01T19:38:36.110970] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:36.292948] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T19:38:36.902398] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-01T19:38:37.138499] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T19:38:37.702379] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-01T19:38:37.940036] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T19:38:38.448742] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T19:38:38.502381] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-01T19:38:39.302429] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-01T19:38:39.376259] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T19:38:39.666310] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T19:38:40.102419] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-01T19:38:40.902411] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-01T19:38:41.144555] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T19:38:41.702372] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-01T19:38:41.815214] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T19:38:42.427446] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T19:38:42.502353] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-01T19:38:43.289947] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T19:38:43.302345] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-01T19:38:44.102432] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-01T19:38:44.310838] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T19:38:44.902534] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-01T19:38:45.134559] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T19:38:45.702401] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-01T19:38:45.979500] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-01T19:38:45.981207] [INFO ] [REMOTE ] IP: Full fetch complete (77087 records). [2025-10-01T19:38:45.981316] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-01T19:38:46.411136] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-01T19:38:46.411317] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-01T19:38:46.412487] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-01T19:38:46.412564] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-01T19:38:46.414256] [DEBUG] [LOCAL ] IP: Trimmed 77087 records to 53313 (keeping 200 days of data) [2025-10-01T19:38:46.506533] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-01T19:38:46.699809] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T19:38:46.811831] [DEBUG] [LOCAL ] IP: Primary data saved (53313 records). [2025-10-01T19:38:46.811998] [INFO ] [MAIN ] IP: Full history saved. [2025-10-01T19:38:46.812099] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IP took 28.2s. Estimated remaining: 2h 56m 23s. Rate: 7.1 symbols/min [2025-10-01T19:38:47.059195] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:47.111346] [DEBUG] [LOCAL ] IRM: Loaded 49336 existing records from primary storage. [2025-10-01T19:38:47.111723] [INFO ] [MAIN ] IRM: Loaded 49336 existing records. [2025-10-01T19:38:47.304751] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-01T19:38:47.329841] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:47.330253] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-01T19:38:47.330331] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-01T19:38:47.330731] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-01T19:38:47.330800] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-01T19:38:47.733020] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-01T19:38:47.747547] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:47.748452] [INFO ] [REMOTE ] IPG: Full fetch complete (77254 records). [2025-10-01T19:38:47.748679] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-01T19:38:48.105839] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-01T19:38:48.201629] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-01T19:38:48.201832] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-01T19:38:48.203186] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-01T19:38:48.203512] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-01T19:38:48.206095] [DEBUG] [LOCAL ] IPG: Trimmed 77254 records to 53330 (keeping 200 days of data) [2025-10-01T19:38:48.329952] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T19:38:48.600155] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-01T19:38:48.600304] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-01T19:38:48.600394] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IPG took 30.0s. Estimated remaining: 2h 56m 8s. Rate: 7.1 symbols/min [2025-10-01T19:38:48.795018] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:38:48.818310] [DEBUG] [LOCAL ] IRS: Loaded 21827 existing records from primary storage. [2025-10-01T19:38:48.818560] [INFO ] [MAIN ] IRS: Loaded 21827 existing records. [2025-10-01T19:38:48.907439] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-01T19:38:49.026627] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:38:49.027149] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-01T19:38:49.027237] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-01T19:38:49.028099] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-01T19:38:49.028185] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-01T19:38:49.373622] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T19:38:49.474597] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:38:49.702436] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-01T19:38:49.950062] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T19:38:50.502366] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-01T19:38:50.582560] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T19:38:50.858938] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T19:38:51.302388] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-01T19:38:52.102450] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-01T19:38:52.314733] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T19:38:52.902352] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-01T19:38:53.121001] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T19:38:53.228195] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T19:38:53.702388] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-01T19:38:54.143400] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T19:38:54.502361] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-01T19:38:55.302382] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-01T19:38:55.428350] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T19:38:55.681259] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T19:38:56.102380] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-01T19:38:56.902357] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-01T19:38:56.967220] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T19:38:57.057417] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T19:38:57.702383] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-01T19:38:58.502391] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-01T19:38:58.597141] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T19:38:59.302381] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-01T19:38:59.400608] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T19:39:00.102384] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-01T19:39:00.239084] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T19:39:00.280918] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T19:39:00.902325] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-01T19:39:01.705114] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-01T19:39:01.709404] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T19:39:01.931615] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T19:39:02.502436] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-01T19:39:03.302411] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-01T19:39:03.605773] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-01T19:39:03.608420] [INFO ] [REMOTE ] IQV: Full fetch complete (72205 records). [2025-10-01T19:39:03.608611] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-01T19:39:04.099026] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-01T19:39:04.099150] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-01T19:39:04.100233] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-01T19:39:04.100317] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-01T19:39:04.102005] [DEBUG] [LOCAL ] IQV: Trimmed 72205 records to 50102 (keeping 200 days of data) [2025-10-01T19:39:04.102514] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-01T19:39:04.259298] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T19:39:04.479470] [DEBUG] [LOCAL ] IQV: Primary data saved (50102 records). [2025-10-01T19:39:04.479636] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-01T19:39:04.479763] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQV took 30.8s. Estimated remaining: 2h 56m 7s. Rate: 7.1 symbols/min [2025-10-01T19:39:04.669151] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:39:04.702822] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T19:39:04.757095] [DEBUG] [LOCAL ] IRT: Loaded 50402 existing records from primary storage. [2025-10-01T19:39:04.757425] [INFO ] [MAIN ] IRT: Loaded 50402 existing records. [2025-10-01T19:39:04.913686] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-01T19:39:04.951892] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:39:04.952089] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-01T19:39:04.952138] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-01T19:39:04.953249] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-01T19:39:04.953310] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-01T19:39:05.274957] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T19:39:05.366770] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:39:05.702430] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-01T19:39:06.493137] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T19:39:06.503490] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-01T19:39:06.820756] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T19:39:07.302378] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-01T19:39:07.842096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T19:39:08.102400] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-01T19:39:08.902362] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-01T19:39:09.063191] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T19:39:09.151699] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T19:39:09.702386] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-01T19:39:10.502359] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-01T19:39:10.689917] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T19:39:10.982275] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T19:39:11.302416] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-01T19:39:12.114749] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-01T19:39:12.116946] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T19:39:12.902445] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-01T19:39:13.113397] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T19:39:13.702377] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-01T19:39:13.826103] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T19:39:13.907706] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T19:39:14.502481] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-01T19:39:15.244493] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T19:39:15.302405] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-01T19:39:15.908863] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T19:39:16.102390] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-01T19:39:16.902403] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-01T19:39:17.458163] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T19:39:17.459304] [INFO ] [REMOTE ] IRS: Full fetch complete (32187 records). [2025-10-01T19:39:17.459383] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-01T19:39:17.716216] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-01T19:39:17.724857] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-01T19:39:17.783790] [INFO ] [REMOTE ] IRM: Full fetch complete (72243 records). [2025-10-01T19:39:17.797927] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-01T19:39:18.035921] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-01T19:39:18.046324] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-01T19:39:18.052458] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-01T19:39:18.052550] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-01T19:39:18.126529] [DEBUG] [LOCAL ] IRS: Trimmed 32187 records to 21936 (keeping 200 days of data) [2025-10-01T19:39:18.472158] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-01T19:39:18.486379] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-01T19:39:18.487909] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-01T19:39:18.492371] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-01T19:39:18.498031] [DEBUG] [LOCAL ] IRS: Primary data saved (21936 records). [2025-10-01T19:39:18.498695] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-01T19:39:18.499212] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IRS took 29.9s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-01T19:39:18.519281] [DEBUG] [LOCAL ] IRM: Trimmed 72243 records to 49302 (keeping 200 days of data) [2025-10-01T19:39:18.806821] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T19:39:18.866041] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:39:18.886892] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-01T19:39:18.984812] [DEBUG] [LOCAL ] ISD: Loaded 15486 existing records from primary storage. [2025-10-01T19:39:18.995782] [INFO ] [MAIN ] ISD: Loaded 15486 existing records. [2025-10-01T19:39:19.275921] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:39:19.277701] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-01T19:39:19.278383] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-01T19:39:19.280475] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-01T19:39:19.280828] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-01T19:39:19.759598] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:39:19.760479] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-01T19:39:19.778604] [DEBUG] [LOCAL ] IRM: Primary data saved (49302 records). [2025-10-01T19:39:19.778740] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-01T19:39:19.778863] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRM took 33.0s. Estimated remaining: 2h 55m 48s. Rate: 7.1 symbols/min [2025-10-01T19:39:19.975811] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:39:20.020040] [DEBUG] [LOCAL ] IT: Loaded 41916 existing records from primary storage. [2025-10-01T19:39:20.020344] [INFO ] [MAIN ] IT: Loaded 41916 existing records. [2025-10-01T19:39:20.221412] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:39:20.221731] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-01T19:39:20.221811] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-01T19:39:20.223837] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-01T19:39:20.223901] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-01T19:39:20.664393] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T19:39:20.686810] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:39:20.694542] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-01T19:39:20.701955] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T19:39:20.724010] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-01T19:39:20.725637] [INFO ] [REMOTE ] IR: Full fetch complete (76157 records). [2025-10-01T19:39:20.725795] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-01T19:39:20.907466] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-01T19:39:21.176796] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-01T19:39:21.176898] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-01T19:39:21.178002] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-01T19:39:21.178073] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-01T19:39:21.179551] [DEBUG] [LOCAL ] IR: Trimmed 76157 records to 52690 (keeping 200 days of data) [2025-10-01T19:39:21.521455] [DEBUG] [LOCAL ] IR: Primary data saved (52690 records). [2025-10-01T19:39:21.521668] [INFO ] [MAIN ] IR: Full history saved. [2025-10-01T19:39:21.521869] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IR took 46.4s. Estimated remaining: 2h 55m 33s. Rate: 7.1 symbols/min [2025-10-01T19:39:21.608362] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T19:39:21.708988] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-01T19:39:21.730281] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:39:21.765636] [DEBUG] [LOCAL ] ITGR: Loaded 31521 existing records from primary storage. [2025-10-01T19:39:21.766031] [INFO ] [MAIN ] ITGR: Loaded 31521 existing records. [2025-10-01T19:39:21.956537] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:39:21.956795] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-01T19:39:21.956847] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-01T19:39:21.957327] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-01T19:39:21.957395] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-01T19:39:22.342478] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:39:22.503936] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-01T19:39:22.504928] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T19:39:22.686376] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:39:23.302420] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-01T19:39:23.417745] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T19:39:24.102376] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-01T19:39:24.293492] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T19:39:24.902386] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-01T19:39:25.491803] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T19:39:25.702385] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-01T19:39:25.932609] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T19:39:26.400892] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T19:39:26.502380] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-01T19:39:27.302372] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-01T19:39:27.954495] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T19:39:28.102378] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-01T19:39:28.369905] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T19:39:28.902417] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-01T19:39:29.252291] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T19:39:29.702379] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-01T19:39:29.750507] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:39:30.502416] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-01T19:39:30.913344] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T19:39:31.302438] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-01T19:39:31.502567] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T19:39:32.102386] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-01T19:39:32.902363] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-01T19:39:33.085500] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T19:39:33.197967] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T19:39:33.702398] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-01T19:39:34.044850] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T19:39:34.449767] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T19:39:34.502413] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-01T19:39:35.302388] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-01T19:39:35.880777] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T19:39:36.102383] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-01T19:39:36.784322] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T19:39:36.902359] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-01T19:39:36.996616] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T19:39:37.702432] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-01T19:39:38.254984] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T19:39:38.502348] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-01T19:39:38.565227] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T19:39:39.302375] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-01T19:39:40.102385] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-01T19:39:40.231627] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T19:39:40.793408] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T19:39:40.902379] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-01T19:39:41.129425] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T19:39:41.130504] [INFO ] [REMOTE ] ISD: Full fetch complete (24002 records). [2025-10-01T19:39:41.130596] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-01T19:39:41.568813] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-01T19:39:41.568950] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-01T19:39:41.569697] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-01T19:39:41.569774] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-01T19:39:41.573162] [DEBUG] [LOCAL ] ISD: Trimmed 24002 records to 15574 (keeping 200 days of data) [2025-10-01T19:39:41.673731] [DEBUG] [LOCAL ] ISD: Primary data saved (15574 records). [2025-10-01T19:39:41.673871] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-01T19:39:41.674045] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. ISD took 23.2s. Estimated remaining: 2h 55m 37s. Rate: 7.1 symbols/min [2025-10-01T19:39:41.707562] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-01T19:39:41.867497] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:39:41.907199] [DEBUG] [LOCAL ] ITT: Loaded 32807 existing records from primary storage. [2025-10-01T19:39:41.907481] [INFO ] [MAIN ] ITT: Loaded 32807 existing records. [2025-10-01T19:39:42.115463] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:39:42.115875] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-01T19:39:42.115963] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-01T19:39:42.117443] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-01T19:39:42.130890] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-01T19:39:42.247663] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T19:39:42.507509] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-01T19:39:42.570930] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:39:43.302411] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-01T19:39:43.416856] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T19:39:43.691972] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T19:39:44.102388] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-01T19:39:44.757625] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T19:39:44.902389] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-01T19:39:45.702383] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-01T19:39:45.848903] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T19:39:45.877537] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T19:39:46.502440] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-01T19:39:47.302450] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-01T19:39:47.713771] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T19:39:47.950413] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-01T19:39:47.953308] [INFO ] [REMOTE ] IRT: Full fetch complete (72586 records). [2025-10-01T19:39:47.953409] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-01T19:39:48.116525] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-01T19:39:48.390715] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-01T19:39:48.390847] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-01T19:39:48.391893] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-01T19:39:48.392102] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-01T19:39:48.393623] [DEBUG] [LOCAL ] IRT: Trimmed 72586 records to 50401 (keeping 200 days of data) [2025-10-01T19:39:48.506329] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T19:39:48.742585] [DEBUG] [LOCAL ] IRT: Primary data saved (50401 records). [2025-10-01T19:39:48.742754] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-01T19:39:48.742869] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRT took 44.3s. Estimated remaining: 2h 55m 27s. Rate: 7.1 symbols/min [2025-10-01T19:39:48.940759] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:39:48.909419] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-01T19:39:48.992967] [DEBUG] [LOCAL ] ITUB: Loaded 53327 existing records from primary storage. [2025-10-01T19:39:48.993488] [INFO ] [MAIN ] ITUB: Loaded 53327 existing records. [2025-10-01T19:39:49.194229] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:39:49.194531] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-01T19:39:49.194583] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-01T19:39:49.196608] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-01T19:39:49.196699] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-01T19:39:49.642623] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T19:39:49.706680] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-01T19:39:49.706581] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:39:50.267736] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T19:39:50.502390] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-01T19:39:51.102263] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T19:39:51.302386] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-01T19:39:52.102382] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-01T19:39:52.473533] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T19:39:52.630588] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-01T19:39:52.632068] [INFO ] [REMOTE ] IT: Full fetch complete (56075 records). [2025-10-01T19:39:52.632181] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-01T19:39:52.907587] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-01T19:39:53.065505] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-01T19:39:53.065588] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-01T19:39:53.066498] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-01T19:39:53.066562] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-01T19:39:53.067867] [DEBUG] [LOCAL ] IT: Trimmed 56075 records to 42034 (keeping 200 days of data) [2025-10-01T19:39:53.326225] [DEBUG] [LOCAL ] IT: Primary data saved (42034 records). [2025-10-01T19:39:53.326359] [INFO ] [MAIN ] IT: Full history saved. [2025-10-01T19:39:53.326467] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. IT took 33.5s. Estimated remaining: 2h 55m 14s. Rate: 7.1 symbols/min [2025-10-01T19:39:53.509419] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:39:53.542145] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T19:39:53.594170] [DEBUG] [LOCAL ] ITW: Loaded 45869 existing records from primary storage. [2025-10-01T19:39:53.594557] [INFO ] [MAIN ] ITW: Loaded 45869 existing records. [2025-10-01T19:39:53.707454] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-01T19:39:53.785494] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:39:53.785743] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-01T19:39:53.785798] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-01T19:39:53.788078] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-01T19:39:53.788156] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-01T19:39:54.177735] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:39:54.193084] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T19:39:54.502383] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-01T19:39:55.225850] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T19:39:55.302372] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-01T19:39:55.833863] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T19:39:56.102372] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-01T19:39:56.829631] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T19:39:56.902372] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-01T19:39:57.702370] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-01T19:39:57.793982] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T19:39:58.502407] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-01T19:39:58.671256] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T19:39:58.771940] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T19:39:59.302379] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-01T19:40:00.102359] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-01T19:40:00.147335] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T19:40:00.902371] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-01T19:40:01.057889] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-01T19:40:01.059346] [INFO ] [REMOTE ] ITGR: Full fetch complete (41714 records). [2025-10-01T19:40:01.059507] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-01T19:40:01.477109] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T19:40:01.546745] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-01T19:40:01.546849] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-01T19:40:01.547720] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-01T19:40:01.547821] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-01T19:40:01.549028] [DEBUG] [LOCAL ] ITGR: Trimmed 41714 records to 31386 (keeping 200 days of data) [2025-10-01T19:40:01.719394] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-01T19:40:01.769594] [DEBUG] [LOCAL ] ITGR: Primary data saved (31386 records). [2025-10-01T19:40:01.769782] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-01T19:40:01.769879] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ITGR took 40.2s. Estimated remaining: 2h 55m 6s. Rate: 7.1 symbols/min [2025-10-01T19:40:01.959975] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:40:02.007206] [DEBUG] [LOCAL ] IVR: Loaded 47877 existing records from primary storage. [2025-10-01T19:40:02.007670] [INFO ] [MAIN ] IVR: Loaded 47877 existing records. [2025-10-01T19:40:02.207700] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:40:02.207998] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-01T19:40:02.208061] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-01T19:40:02.209622] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-01T19:40:02.209708] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-01T19:40:02.504238] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-01T19:40:02.629977] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:40:02.767308] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T19:40:03.249926] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T19:40:03.302342] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-01T19:40:04.102436] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-01T19:40:04.182973] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T19:40:04.338166] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T19:40:04.902431] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-01T19:40:05.585280] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T19:40:05.702390] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-01T19:40:06.502427] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-01T19:40:06.744852] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T19:40:07.104347] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T19:40:07.302430] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-01T19:40:07.810061] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T19:40:08.102447] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-01T19:40:08.834570] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T19:40:08.903931] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-01T19:40:08.910836] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T19:40:09.702388] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-01T19:40:10.512253] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-01T19:40:10.532567] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T19:40:11.070590] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-01T19:40:11.071833] [INFO ] [REMOTE ] ITT: Full fetch complete (46989 records). [2025-10-01T19:40:11.071926] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-01T19:40:11.310110] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-01T19:40:11.493440] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-01T19:40:11.493535] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-01T19:40:11.494402] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-01T19:40:11.494472] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-01T19:40:11.495620] [DEBUG] [LOCAL ] ITT: Trimmed 46989 records to 32783 (keeping 200 days of data) [2025-10-01T19:40:11.728276] [DEBUG] [LOCAL ] ITT: Primary data saved (32783 records). [2025-10-01T19:40:11.728427] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-01T19:40:11.728531] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITT took 30.1s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-01T19:40:11.914431] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:40:11.948307] [DEBUG] [LOCAL ] IVT: Loaded 30715 existing records from primary storage. [2025-10-01T19:40:11.948625] [INFO ] [MAIN ] IVT: Loaded 30715 existing records. [2025-10-01T19:40:12.106361] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-01T19:40:12.152059] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:40:12.152673] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-01T19:40:12.152771] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-01T19:40:12.153847] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-01T19:40:12.154025] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-01T19:40:12.480339] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-01T19:40:12.596766] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:40:12.902404] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-01T19:40:13.237524] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T19:40:13.702414] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-01T19:40:13.873764] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T19:40:14.283082] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T19:40:14.502401] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-01T19:40:15.302373] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-01T19:40:15.415216] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T19:40:15.914469] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T19:40:16.102408] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-01T19:40:16.902393] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-01T19:40:17.066213] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T19:40:17.134306] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T19:40:17.702385] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-01T19:40:18.504952] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-01T19:40:18.507909] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T19:40:19.071490] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T19:40:19.302433] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-01T19:40:19.613789] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T19:40:20.102407] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-01T19:40:20.258839] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T19:40:20.902391] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-01T19:40:21.702406] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-01T19:40:21.867805] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T19:40:22.502429] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-01T19:40:22.650101] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T19:40:23.210482] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T19:40:23.302369] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-01T19:40:24.102418] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-01T19:40:24.473356] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T19:40:24.900857] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T19:40:24.910407] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-01T19:40:25.532807] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T19:40:25.702415] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-01T19:40:26.502389] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-01T19:40:26.888261] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T19:40:27.302413] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-01T19:40:27.756557] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T19:40:27.758008] [INFO ] [REMOTE ] ITW: Full fetch complete (66386 records). [2025-10-01T19:40:27.758100] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-01T19:40:28.107405] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-01T19:40:28.208946] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-01T19:40:28.209268] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-01T19:40:28.210276] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-01T19:40:28.210342] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-01T19:40:28.241821] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T19:40:28.240372] [DEBUG] [LOCAL ] ITW: Trimmed 66386 records to 45819 (keeping 200 days of data) [2025-10-01T19:40:28.569635] [DEBUG] [LOCAL ] ITW: Primary data saved (45819 records). [2025-10-01T19:40:28.569807] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-01T19:40:28.569940] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITW took 35.2s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-01T19:40:28.763897] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:40:28.820080] [DEBUG] [LOCAL ] IVZ: Loaded 53127 existing records from primary storage. [2025-10-01T19:40:28.820421] [INFO ] [MAIN ] IVZ: Loaded 53127 existing records. [2025-10-01T19:40:28.904841] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-01T19:40:29.023424] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:40:29.023816] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-01T19:40:29.023918] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-01T19:40:29.024251] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-01T19:40:29.024311] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-01T19:40:29.279263] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-01T19:40:29.478512] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:40:29.499483] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T19:40:29.702384] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-01T19:40:30.502394] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-01T19:40:30.924561] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-01T19:40:31.122778] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-01T19:40:31.124305] [INFO ] [REMOTE ] IVR: Full fetch complete (69124 records). [2025-10-01T19:40:31.124429] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-01T19:40:31.307683] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-01T19:40:31.567207] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-01T19:40:31.567290] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-01T19:40:31.568373] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-01T19:40:31.568446] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-01T19:40:31.570008] [DEBUG] [LOCAL ] IVR: Trimmed 69124 records to 47888 (keeping 200 days of data) [2025-10-01T19:40:31.880459] [DEBUG] [LOCAL ] IVR: Primary data saved (47888 records). [2025-10-01T19:40:31.880702] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-01T19:40:31.880873] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. IVR took 30.1s. Estimated remaining: 2h 54m 45s. Rate: 7.1 symbols/min [2025-10-01T19:40:32.072183] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:40:32.098679] [DEBUG] [LOCAL ] IX: Loaded 22541 existing records from primary storage. [2025-10-01T19:40:32.098960] [INFO ] [MAIN ] IX: Loaded 22541 existing records. [2025-10-01T19:40:32.137533] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-01T19:40:32.307042] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:40:32.307458] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-01T19:40:32.307537] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-01T19:40:32.313826] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-01T19:40:32.323719] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-01T19:40:32.348232] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T19:40:32.720168] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:40:32.772003] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T19:40:32.774756] [INFO ] [REMOTE ] ITUB: Full fetch complete (77173 records). [2025-10-01T19:40:32.774929] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-01T19:40:32.907516] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-01T19:40:33.222589] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-01T19:40:33.222722] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-01T19:40:33.223878] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-01T19:40:33.223948] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-01T19:40:33.226918] [DEBUG] [LOCAL ] ITUB: Trimmed 77173 records to 53325 (keeping 200 days of data) [2025-10-01T19:40:33.575849] [DEBUG] [LOCAL ] ITUB: Primary data saved (53325 records). [2025-10-01T19:40:33.575987] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-01T19:40:33.576098] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITUB took 44.8s. Estimated remaining: 2h 54m 29s. Rate: 7.1 symbols/min [2025-10-01T19:40:33.704880] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-01T19:40:33.711116] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T19:40:33.780580] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:40:33.852348] [DEBUG] [LOCAL ] J: Loaded 40135 existing records from primary storage. [2025-10-01T19:40:33.854534] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T19:40:33.854719] [INFO ] [MAIN ] J: Loaded 40135 existing records. [2025-10-01T19:40:34.069471] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:40:34.069767] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-01T19:40:34.069823] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-01T19:40:34.070229] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-01T19:40:34.070288] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-01T19:40:34.467102] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:40:34.502394] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-01T19:40:35.041289] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T19:40:35.302394] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-01T19:40:35.637216] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T19:40:36.102399] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-01T19:40:36.788477] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T19:40:36.902362] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-01T19:40:37.518811] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T19:40:37.702364] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-01T19:40:38.282737] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T19:40:38.445822] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T19:40:38.502344] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-01T19:40:39.302465] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-01T19:40:39.319580] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T19:40:40.102437] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-01T19:40:40.557674] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T19:40:40.902363] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-01T19:40:41.161946] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-01T19:40:41.702448] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-01T19:40:42.502846] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-01T19:40:42.507878] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T19:40:43.283874] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-01T19:40:43.285174] [INFO ] [REMOTE ] IVT: Full fetch complete (45495 records). [2025-10-01T19:40:43.285255] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-01T19:40:43.307536] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-01T19:40:43.722938] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-01T19:40:43.723054] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-01T19:40:43.724020] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-01T19:40:43.724102] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-01T19:40:43.745581] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T19:40:43.752468] [DEBUG] [LOCAL ] IVT: Trimmed 45495 records to 30693 (keeping 200 days of data) [2025-10-01T19:40:43.957462] [DEBUG] [LOCAL ] IVT: Primary data saved (30693 records). [2025-10-01T19:40:43.957619] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-01T19:40:43.957758] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVT took 32.2s. Estimated remaining: 2h 54m 23s. Rate: 7.1 symbols/min [2025-10-01T19:40:44.108687] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-01T19:40:44.145716] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:40:44.193615] [DEBUG] [LOCAL ] JBGS: Loaded 42396 existing records from primary storage. [2025-10-01T19:40:44.193989] [INFO ] [MAIN ] JBGS: Loaded 42396 existing records. [2025-10-01T19:40:44.397105] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:40:44.397327] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-01T19:40:44.397379] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-01T19:40:44.397848] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-01T19:40:44.397911] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-01T19:40:44.860930] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:40:44.889232] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T19:40:44.902343] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-01T19:40:45.232719] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T19:40:45.702379] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-01T19:40:46.502399] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-01T19:40:46.792897] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T19:40:47.079635] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T19:40:47.302398] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-01T19:40:48.073367] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T19:40:48.102361] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-01T19:40:48.515025] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T19:40:48.902379] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-01T19:40:49.702390] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-01T19:40:50.046227] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T19:40:50.473090] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T19:40:50.502350] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-01T19:40:51.133753] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T19:40:51.302377] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-01T19:40:51.963222] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T19:40:52.102386] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-01T19:40:52.656701] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T19:40:52.902382] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-01T19:40:53.702393] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-01T19:40:54.161062] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-01T19:40:54.245515] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T19:40:54.502382] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-01T19:40:54.687221] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T19:40:55.302374] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-01T19:40:56.007065] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T19:40:56.102340] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-01T19:40:56.293466] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T19:40:56.902441] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-01T19:40:57.331975] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T19:40:57.702373] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-01T19:40:58.088733] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T19:40:58.090055] [INFO ] [REMOTE ] IX: Full fetch complete (27239 records). [2025-10-01T19:40:58.090131] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-01T19:40:58.508611] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-01T19:40:58.510902] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-01T19:40:58.511809] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-01T19:40:58.512411] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-01T19:40:58.512457] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-01T19:40:58.513363] [DEBUG] [LOCAL ] IX: Trimmed 27239 records to 22501 (keeping 200 days of data) [2025-10-01T19:40:58.659288] [DEBUG] [LOCAL ] IX: Primary data saved (22501 records). [2025-10-01T19:40:58.659420] [INFO ] [MAIN ] IX: Full history saved. [2025-10-01T19:40:58.659507] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IX took 26.8s. Estimated remaining: 2h 54m 21s. Rate: 7.1 symbols/min [2025-10-01T19:40:58.871413] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:40:58.918741] [DEBUG] [LOCAL ] JBI: Loaded 43584 existing records from primary storage. [2025-10-01T19:40:58.919108] [INFO ] [MAIN ] JBI: Loaded 43584 existing records. [2025-10-01T19:40:59.141570] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:40:59.141865] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-01T19:40:59.141916] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-01T19:40:59.142151] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-01T19:40:59.142211] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-01T19:40:59.304839] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-01T19:40:59.584479] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T19:40:59.590206] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:00.065863] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T19:41:00.102356] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-01T19:41:00.902385] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-01T19:41:00.978833] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T19:41:01.702389] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-01T19:41:01.859082] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T19:41:02.451437] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T19:41:02.502368] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-01T19:41:03.270395] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T19:41:03.302352] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-01T19:41:03.952089] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T19:41:04.102384] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-01T19:41:04.902389] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-01T19:41:05.114983] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-01T19:41:05.116385] [INFO ] [REMOTE ] J: Full fetch complete (59066 records). [2025-10-01T19:41:05.116482] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-01T19:41:05.586007] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-01T19:41:05.586199] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-01T19:41:05.587197] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-01T19:41:05.587285] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-01T19:41:05.588982] [DEBUG] [LOCAL ] J: Trimmed 59066 records to 40138 (keeping 200 days of data) [2025-10-01T19:41:05.715936] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-01T19:41:05.722166] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T19:41:05.910997] [DEBUG] [LOCAL ] J: Primary data saved (40138 records). [2025-10-01T19:41:05.911155] [INFO ] [MAIN ] J: Full history saved. [2025-10-01T19:41:05.911288] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. J took 32.3s. Estimated remaining: 2h 54m 11s. Rate: 7.1 symbols/min [2025-10-01T19:41:06.101211] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:06.149168] [DEBUG] [LOCAL ] JBL: Loaded 48383 existing records from primary storage. [2025-10-01T19:41:06.149483] [INFO ] [MAIN ] JBL: Loaded 48383 existing records. [2025-10-01T19:41:06.343668] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:41:06.343891] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-01T19:41:06.343952] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-01T19:41:06.345254] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-01T19:41:06.345315] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-01T19:41:06.510234] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-01T19:41:06.735777] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:07.044681] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-01T19:41:07.115264] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T19:41:07.302422] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-01T19:41:08.102405] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-01T19:41:08.398174] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T19:41:08.632186] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T19:41:08.902368] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-01T19:41:09.430260] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T19:41:09.702389] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-01T19:41:10.391897] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T19:41:10.502414] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-01T19:41:11.198511] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T19:41:11.302388] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-01T19:41:11.942485] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T19:41:12.102380] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-01T19:41:12.775000] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T19:41:12.902380] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-01T19:41:13.702386] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-01T19:41:14.370768] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-01T19:41:14.372439] [INFO ] [REMOTE ] JBGS: Full fetch complete (59233 records). [2025-10-01T19:41:14.372560] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-01T19:41:14.507819] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-01T19:41:14.575130] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T19:41:14.841190] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-01T19:41:14.841271] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-01T19:41:14.842111] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-01T19:41:14.842176] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-01T19:41:14.843384] [DEBUG] [LOCAL ] JBGS: Trimmed 59233 records to 42383 (keeping 200 days of data) [2025-10-01T19:41:15.114096] [DEBUG] [LOCAL ] JBGS: Primary data saved (42383 records). [2025-10-01T19:41:15.114225] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-01T19:41:15.114314] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. JBGS took 31.2s. Estimated remaining: 2h 54m 4s. Rate: 7.1 symbols/min [2025-10-01T19:41:15.304423] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:15.302794] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-01T19:41:15.332330] [DEBUG] [LOCAL ] JBND: Loaded 25895 existing records from primary storage. [2025-10-01T19:41:15.332598] [INFO ] [MAIN ] JBND: Loaded 25895 existing records. [2025-10-01T19:41:15.528051] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:41:15.528357] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-01T19:41:15.528474] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-01T19:41:15.529373] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-01T19:41:15.540424] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-01T19:41:15.652135] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T19:41:15.966813] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:16.102391] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-01T19:41:16.251492] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T19:41:16.706531] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T19:41:16.788035] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T19:41:16.902394] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-01T19:41:17.702370] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-01T19:41:17.844344] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T19:41:18.502406] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-01T19:41:19.302383] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-01T19:41:19.562062] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T19:41:19.585850] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T19:41:20.102402] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-01T19:41:20.902351] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-01T19:41:21.154041] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T19:41:21.441473] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-01T19:41:21.443726] [INFO ] [REMOTE ] IVZ: Full fetch complete (76770 records). [2025-10-01T19:41:21.443867] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-01T19:41:21.708521] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-01T19:41:21.898417] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-01T19:41:21.898504] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-01T19:41:21.899557] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-01T19:41:21.899624] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-01T19:41:21.901246] [DEBUG] [LOCAL ] IVZ: Trimmed 76770 records to 53128 (keeping 200 days of data) [2025-10-01T19:41:22.253471] [DEBUG] [LOCAL ] IVZ: Primary data saved (53128 records). [2025-10-01T19:41:22.253634] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-01T19:41:22.253775] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. IVZ took 53.7s. Estimated remaining: 2h 53m 54s. Rate: 7.1 symbols/min [2025-10-01T19:41:22.454507] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:22.454879] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-01T19:41:22.454990] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-01T19:41:22.455172] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-01T19:41:22.455219] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-01T19:41:22.455264] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-01T19:41:22.455298] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-01T19:41:22.517125] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-01T19:41:22.866042] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:22.896378] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T19:41:22.958413] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T19:41:23.302386] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-01T19:41:24.102382] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-01T19:41:24.210695] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T19:41:24.863752] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T19:41:24.902369] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-01T19:41:24.932929] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T19:41:25.102224] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:41:25.102592] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-01T19:41:25.102739] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:41:25.102821] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-01T19:41:25.102890] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:41:25.102966] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-01T19:41:25.103035] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-01T19:41:25.103075] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-01T19:41:25.103148] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-01T19:41:25.103230] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBS took 2.8s. Estimated remaining: 2h 53m 39s. Rate: 7.1 symbols/min [2025-10-01T19:41:25.289873] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:25.290034] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-01T19:41:25.290072] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-01T19:41:25.290201] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-01T19:41:25.290242] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-01T19:41:25.290284] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-01T19:41:25.290316] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-01T19:41:25.678860] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:25.702346] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-01T19:41:26.097754] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:41:26.098103] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-01T19:41:26.098196] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:41:26.098249] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-01T19:41:26.098287] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:41:26.098356] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-01T19:41:26.098423] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-01T19:41:26.098461] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-01T19:41:26.098503] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-01T19:41:26.098552] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBTM took 1.0s. Estimated remaining: 2h 53m 23s. Rate: 7.1 symbols/min [2025-10-01T19:41:26.287761] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:26.296855] [DEBUG] [LOCAL ] JCE: Loaded 6688 existing records from primary storage. [2025-10-01T19:41:26.297042] [INFO ] [MAIN ] JCE: Loaded 6688 existing records. [2025-10-01T19:41:26.493896] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:41:26.494118] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-01T19:41:26.494168] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-01T19:41:26.494403] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-01T19:41:26.494464] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-01T19:41:26.507578] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-01T19:41:26.905022] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:27.302410] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-01T19:41:28.102393] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-01T19:41:28.329404] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T19:41:28.418760] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T19:41:28.902438] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-01T19:41:29.289271] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T19:41:29.504519] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T19:41:29.702428] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-01T19:41:30.502407] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-01T19:41:30.952879] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T19:41:31.302449] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-01T19:41:31.604093] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-01T19:41:32.088944] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T19:41:32.102362] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-01T19:41:32.519982] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T19:41:32.902397] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-01T19:41:33.379227] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T19:41:33.702387] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-01T19:41:34.502442] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-01T19:41:35.096623] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T19:41:35.302439] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-01T19:41:35.965720] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T19:41:36.102366] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-01T19:41:36.829575] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T19:41:36.902414] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-01T19:41:37.128235] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T19:41:37.476034] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T19:41:37.702370] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-01T19:41:38.502419] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-01T19:41:38.835910] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T19:41:39.153817] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-01T19:41:39.302398] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-01T19:41:40.102382] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-01T19:41:40.879983] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T19:41:40.902349] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-01T19:41:41.702382] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-01T19:41:41.770726] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-01T19:41:41.772201] [INFO ] [REMOTE ] JBI: Full fetch complete (64422 records). [2025-10-01T19:41:41.772297] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-01T19:41:42.205976] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-01T19:41:42.206093] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-01T19:41:42.207099] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-01T19:41:42.207167] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-01T19:41:42.208781] [DEBUG] [LOCAL ] JBI: Trimmed 64422 records to 43502 (keeping 200 days of data) [2025-10-01T19:41:42.423943] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T19:41:42.505008] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-01T19:41:42.516343] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T19:41:42.531071] [DEBUG] [LOCAL ] JBI: Primary data saved (43502 records). [2025-10-01T19:41:42.531367] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-01T19:41:42.531474] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBI took 43.9s. Estimated remaining: 2h 53m 23s. Rate: 7.1 symbols/min [2025-10-01T19:41:42.728331] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:42.783212] [DEBUG] [LOCAL ] JCI: Loaded 53543 existing records from primary storage. [2025-10-01T19:41:42.783670] [INFO ] [MAIN ] JCI: Loaded 53543 existing records. [2025-10-01T19:41:42.979840] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:41:42.980104] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-01T19:41:42.980164] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-01T19:41:42.981229] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-01T19:41:42.981438] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-01T19:41:43.275495] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T19:41:43.305010] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-01T19:41:43.412256] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:44.102395] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-01T19:41:44.652637] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T19:41:44.902398] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-01T19:41:45.702400] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-01T19:41:46.317752] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-01T19:41:46.319353] [INFO ] [REMOTE ] JBL: Full fetch complete (70328 records). [2025-10-01T19:41:46.319455] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-01T19:41:46.528935] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-01T19:41:46.568931] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-01T19:41:46.590323] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T19:41:46.589593] [INFO ] [REMOTE ] JBND: Full fetch complete (34147 records). [2025-10-01T19:41:46.610315] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-01T19:41:46.975682] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-01T19:41:46.983511] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-01T19:41:46.990821] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-01T19:41:46.999577] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-01T19:41:47.107301] [DEBUG] [LOCAL ] JBL: Trimmed 70328 records to 48376 (keeping 200 days of data) [2025-10-01T19:41:47.305970] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-01T19:41:47.327069] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-01T19:41:47.328067] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-01T19:41:47.330286] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-01T19:41:47.331342] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-01T19:41:47.336201] [DEBUG] [LOCAL ] JBND: Trimmed 34147 records to 26039 (keeping 200 days of data) [2025-10-01T19:41:47.669295] [DEBUG] [LOCAL ] JBND: Primary data saved (26039 records). [2025-10-01T19:41:47.670575] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-01T19:41:47.670753] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBND took 32.6s. Estimated remaining: 2h 53m 11s. Rate: 7.1 symbols/min [2025-10-01T19:41:47.879565] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:47.995157] [DEBUG] [LOCAL ] JBL: Primary data saved (48376 records). [2025-10-01T19:41:47.995368] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-01T19:41:47.995580] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBL took 42.1s. Estimated remaining: 2h 52m 54s. Rate: 7.1 symbols/min [2025-10-01T19:41:47.993535] [DEBUG] [LOCAL ] JEF: Loaded 50008 existing records from primary storage. [2025-10-01T19:41:47.996144] [INFO ] [MAIN ] JEF: Loaded 50008 existing records. [2025-10-01T19:41:48.266104] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T19:41:48.304948] [INFO ] [REMOTE ] JCE: Full fetch complete (9399 records). [2025-10-01T19:41:48.398015] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:48.393124] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-01T19:41:48.444572] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:41:48.450745] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-01T19:41:48.451093] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-01T19:41:48.471698] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-01T19:41:48.471932] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-01T19:41:48.872728] [DEBUG] [LOCAL ] JELD: Loaded 46062 existing records from primary storage. [2025-10-01T19:41:48.899490] [INFO ] [MAIN ] JELD: Loaded 46062 existing records. [2025-10-01T19:41:48.941295] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-01T19:41:49.034051] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-01T19:41:49.588362] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:49.592911] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-01T19:41:49.593556] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-01T19:41:49.594545] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-01T19:41:49.592700] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:41:49.595001] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-01T19:41:49.595199] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-01T19:41:49.595471] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-01T19:41:49.595898] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-01T19:41:49.596244] [DEBUG] [LOCAL ] JCE: Trimmed 9399 records to 6781 (keeping 200 days of data) [2025-10-01T19:41:49.614165] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-01T19:41:49.614381] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-01T19:41:49.836615] [DEBUG] [LOCAL ] JCE: Primary data saved (6781 records). [2025-10-01T19:41:49.852009] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-01T19:41:49.868291] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JCE took 23.8s. Estimated remaining: 2h 52m 38s. Rate: 7.1 symbols/min [2025-10-01T19:41:50.237987] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:41:50.263114] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:50.263612] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-01T19:41:50.272678] [DEBUG] [LOCAL ] JEQ: Loaded 8895 existing records from primary storage. [2025-10-01T19:41:50.273020] [INFO ] [MAIN ] JEQ: Loaded 8895 existing records. [2025-10-01T19:41:50.482223] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:41:50.482442] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-01T19:41:50.482495] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-01T19:41:50.482706] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-01T19:41:50.482765] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-01T19:41:50.916507] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:41:50.916973] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-01T19:41:50.949357] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T19:41:51.220571] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T19:41:51.302378] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-01T19:41:51.703083] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T19:41:51.703353] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T19:41:52.102384] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-01T19:41:52.716037] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T19:41:52.902371] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-01T19:41:53.686420] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T19:41:53.702346] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-01T19:41:54.502377] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-01T19:41:54.665946] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T19:41:54.940023] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-01T19:41:54.984679] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T19:41:55.302407] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-01T19:41:56.102387] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-01T19:41:56.524758] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T19:41:56.902418] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-01T19:41:57.702392] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-01T19:41:58.502407] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-01T19:41:58.799356] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T19:41:58.985326] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T19:41:59.302400] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-01T19:42:00.102425] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-01T19:42:00.335103] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T19:42:00.855459] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (4.75 seconds). [2025-10-01T19:42:00.902389] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-01T19:42:01.582926] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-01T19:42:01.702393] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-01T19:42:02.121397] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T19:42:02.142618] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T19:42:02.502388] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-01T19:42:03.302378] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-01T19:42:03.777077] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T19:42:03.986997] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T19:42:04.102344] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-01T19:42:04.133948] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T19:42:04.902375] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-01T19:42:05.561754] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T19:42:05.702403] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-01T19:42:06.467762] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T19:42:06.502447] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-01T19:42:06.505761] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T19:42:07.302398] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-01T19:42:08.049987] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T19:42:08.102428] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-01T19:42:08.660601] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T19:42:08.806192] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:42:08.902428] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-01T19:42:09.702431] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-01T19:42:10.502402] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-01T19:42:10.592827] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T19:42:11.302377] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-01T19:42:11.610461] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T19:42:12.102398] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-01T19:42:12.172449] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T19:42:12.732459] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T19:42:12.902355] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-01T19:42:13.075678] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T19:42:13.702385] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-01T19:42:13.723553] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T19:42:14.502443] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-01T19:42:14.910276] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T19:42:15.055204] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T19:42:15.302432] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-01T19:42:16.102407] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-01T19:42:16.120083] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T19:42:16.120880] [INFO ] [REMOTE ] JEQ: Full fetch complete (11759 records). [2025-10-01T19:42:16.120953] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-01T19:42:16.521775] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-01T19:42:16.521854] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-01T19:42:16.522160] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-01T19:42:16.522206] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-01T19:42:16.522708] [DEBUG] [LOCAL ] JEQ: Trimmed 11759 records to 8807 (keeping 200 days of data) [2025-10-01T19:42:16.575796] [DEBUG] [LOCAL ] JEQ: Primary data saved (8807 records). [2025-10-01T19:42:16.575929] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-01T19:42:16.576010] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JEQ took 26.7s. Estimated remaining: 2h 52m 49s. Rate: 7.1 symbols/min [2025-10-01T19:42:16.763089] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:42:16.793915] [DEBUG] [LOCAL ] JFR: Loaded 30656 existing records from primary storage. [2025-10-01T19:42:16.794264] [INFO ] [MAIN ] JFR: Loaded 30656 existing records. [2025-10-01T19:42:16.907259] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-01T19:42:16.998593] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:42:16.998861] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-01T19:42:16.998940] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-01T19:42:16.999337] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-01T19:42:16.999420] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-01T19:42:17.378600] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:42:17.702399] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-01T19:42:17.995964] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-01T19:42:17.997545] [INFO ] [REMOTE ] JELD: Full fetch complete (63970 records). [2025-10-01T19:42:17.997726] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-01T19:42:18.425444] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-01T19:42:18.425699] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-01T19:42:18.426794] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-01T19:42:18.426939] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-01T19:42:18.428392] [DEBUG] [LOCAL ] JELD: Trimmed 63970 records to 46073 (keeping 200 days of data) [2025-10-01T19:42:18.510749] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-01T19:42:18.670906] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T19:42:18.747501] [DEBUG] [LOCAL ] JELD: Primary data saved (46073 records). [2025-10-01T19:42:18.747639] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-01T19:42:18.747765] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JELD took 30.8s. Estimated remaining: 2h 52m 34s. Rate: 7.1 symbols/min [2025-10-01T19:42:18.903316] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T19:42:18.966201] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:42:18.979793] [DEBUG] [LOCAL ] JGH: Loaded 11028 existing records from primary storage. [2025-10-01T19:42:18.980040] [INFO ] [MAIN ] JGH: Loaded 11028 existing records. [2025-10-01T19:42:19.182898] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:42:19.183139] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-01T19:42:19.183192] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-01T19:42:19.183501] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-01T19:42:19.183564] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-01T19:42:19.307546] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-01T19:42:19.602340] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:42:20.102383] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-01T19:42:20.296603] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T19:42:20.895724] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T19:42:20.902323] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-01T19:42:21.055496] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T19:42:21.702377] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-01T19:42:21.753467] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:42:22.502390] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-01T19:42:23.090193] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T19:42:23.141111] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T19:42:23.302447] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-01T19:42:24.102435] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-01T19:42:24.902404] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-01T19:42:24.965961] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T19:42:25.631969] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T19:42:25.698837] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T19:42:25.709198] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-01T19:42:26.502389] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-01T19:42:27.302382] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-01T19:42:28.102413] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-01T19:42:28.122440] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T19:42:28.187285] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-01T19:42:28.188984] [INFO ] [REMOTE ] JCI: Full fetch complete (77415 records). [2025-10-01T19:42:28.189087] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-01T19:42:28.593596] [DEBUG] [REMOTE ] JEF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:42:28.619085] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-01T19:42:28.618910] [WARN ] [REMOTE ] JEF: No data returned for month 2025-10 [2025-10-01T19:42:28.619263] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-01T19:42:28.620310] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-01T19:42:28.619214] [FATAL] [REMOTE ] JEF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:42:28.620492] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-01T19:42:28.620622] [FATAL] [MAIN ] JEF: Failed to fetch primary data. [2025-10-01T19:42:28.620880] [WARN ] [MAIN ] JEF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:42:28.620958] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-01T19:42:28.621040] [DEBUG] [LOCAL ] JEF: No primary data file found to delete. [2025-10-01T19:42:28.621098] [INFO ] [LOCAL ] JEF: Starting deletion of derivative data. [2025-10-01T19:42:28.621695] [DEBUG] [LOCAL ] JEF: Deleted derivative data file. [2025-10-01T19:42:28.621838] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JEF took 41.0s. Estimated remaining: 2h 52m 27s. Rate: 7.1 symbols/min [2025-10-01T19:42:28.694824] [DEBUG] [LOCAL ] JCI: Trimmed 77415 records to 53545 (keeping 200 days of data) [2025-10-01T19:42:28.909230] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:42:28.904986] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-01T19:42:29.085082] [DEBUG] [LOCAL ] JHG: Loaded 47675 existing records from primary storage. [2025-10-01T19:42:29.086447] [INFO ] [MAIN ] JHG: Loaded 47675 existing records. [2025-10-01T19:42:29.290587] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:42:29.291859] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-01T19:42:29.294373] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-01T19:42:29.295738] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-01T19:42:29.296373] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-01T19:42:29.511995] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T19:42:29.726951] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-01T19:42:29.755451] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:42:29.757460] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T19:42:29.865134] [DEBUG] [LOCAL ] JCI: Primary data saved (53545 records). [2025-10-01T19:42:29.865284] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-01T19:42:29.865367] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JCI took 47.3s. Estimated remaining: 2h 52m 11s. Rate: 7.1 symbols/min [2025-10-01T19:42:30.049950] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:42:30.056296] [DEBUG] [LOCAL ] JHI: Loaded 3583 existing records from primary storage. [2025-10-01T19:42:30.056523] [INFO ] [MAIN ] JHI: Loaded 3583 existing records. [2025-10-01T19:42:30.252446] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:42:30.252736] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-01T19:42:30.252792] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-01T19:42:30.252980] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-01T19:42:30.253040] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-01T19:42:30.502365] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-01T19:42:30.572986] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T19:42:30.660893] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:42:31.302399] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-01T19:42:31.892682] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T19:42:32.102352] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-01T19:42:32.143718] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T19:42:32.902385] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-01T19:42:33.173973] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T19:42:33.702427] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-01T19:42:33.756036] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T19:42:34.502398] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-01T19:42:34.911093] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T19:42:35.171247] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T19:42:35.302387] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-01T19:42:36.102380] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-01T19:42:36.465968] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T19:42:36.902347] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-01T19:42:36.947384] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T19:42:37.702385] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-01T19:42:38.384562] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T19:42:38.502413] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-01T19:42:38.772302] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T19:42:38.773354] [INFO ] [REMOTE ] JGH: Full fetch complete (15022 records). [2025-10-01T19:42:38.773447] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-01T19:42:39.242814] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-01T19:42:39.242898] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-01T19:42:39.243287] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-01T19:42:39.243404] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-01T19:42:39.244067] [DEBUG] [LOCAL ] JGH: Trimmed 15022 records to 11062 (keeping 200 days of data) [2025-10-01T19:42:39.304360] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-01T19:42:39.319056] [DEBUG] [LOCAL ] JGH: Primary data saved (11062 records). [2025-10-01T19:42:39.319202] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-01T19:42:39.319291] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JGH took 20.6s. Estimated remaining: 2h 52m 3s. Rate: 7.1 symbols/min [2025-10-01T19:42:39.519872] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:42:39.526423] [DEBUG] [LOCAL ] JHS: Loaded 2831 existing records from primary storage. [2025-10-01T19:42:39.526605] [INFO ] [MAIN ] JHS: Loaded 2831 existing records. [2025-10-01T19:42:39.686000] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T19:42:39.750946] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:42:39.751146] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-01T19:42:39.751194] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-01T19:42:39.751395] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-01T19:42:39.751452] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-01T19:42:39.891929] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T19:42:40.102512] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-01T19:42:40.190841] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:42:40.902389] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-01T19:42:41.702390] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-01T19:42:41.881375] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T19:42:42.206948] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-01T19:42:42.502359] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-01T19:42:42.696302] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T19:42:43.134030] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T19:42:43.302389] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-01T19:42:43.794517] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-01T19:42:44.102384] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-01T19:42:44.547384] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T19:42:44.902375] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-01T19:42:45.702381] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-01T19:42:46.122668] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-01T19:42:46.502359] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-01T19:42:46.557754] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T19:42:46.912881] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-01T19:42:47.302374] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-01T19:42:48.102380] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-01T19:42:48.575106] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T19:42:48.678881] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T19:42:48.902396] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-01T19:42:49.251322] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-01T19:42:49.702378] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-01T19:42:50.502374] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-01T19:42:51.018284] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T19:42:51.272743] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T19:42:51.302379] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-01T19:42:52.102384] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-01T19:42:52.656805] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T19:42:52.668206] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T19:42:52.902371] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-01T19:42:53.702420] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-01T19:42:54.291227] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T19:42:54.490948] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-01T19:42:54.492349] [INFO ] [REMOTE ] JFR: Full fetch complete (48290 records). [2025-10-01T19:42:54.492460] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-01T19:42:54.507540] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-01T19:42:54.939578] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-01T19:42:54.939841] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-01T19:42:54.940771] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-01T19:42:54.940838] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-01T19:42:54.942007] [DEBUG] [LOCAL ] JFR: Trimmed 48290 records to 30718 (keeping 200 days of data) [2025-10-01T19:42:55.136280] [DEBUG] [LOCAL ] JFR: Primary data saved (30718 records). [2025-10-01T19:42:55.136460] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-01T19:42:55.136591] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JFR took 38.6s. Estimated remaining: 2h 52m 3s. Rate: 7.1 symbols/min [2025-10-01T19:42:55.324632] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-01T19:42:55.329910] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:42:55.334288] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-01T19:42:55.335497] [INFO ] [REMOTE ] JHI: Full fetch complete (5288 records). [2025-10-01T19:42:55.335573] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-01T19:42:55.725148] [DEBUG] [LOCAL ] JHX: Loaded 51603 existing records from primary storage. [2025-10-01T19:42:55.747180] [INFO ] [MAIN ] JHX: Loaded 51603 existing records. [2025-10-01T19:42:55.824175] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-01T19:42:55.797519] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T19:42:55.829496] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-01T19:42:55.851425] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-01T19:42:55.865076] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-01T19:42:55.884149] [DEBUG] [LOCAL ] JHI: Trimmed 5288 records to 3586 (keeping 200 days of data) [2025-10-01T19:42:56.010362] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:42:56.012724] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-01T19:42:56.013584] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-01T19:42:56.016332] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-01T19:42:56.017745] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-01T19:42:56.017864] [DEBUG] [LOCAL ] JHI: Primary data saved (3586 records). [2025-10-01T19:42:56.054449] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-01T19:42:56.092591] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JHI took 26.2s. Estimated remaining: 2h 51m 46s. Rate: 7.1 symbols/min [2025-10-01T19:42:56.135088] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-01T19:42:56.551272] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:42:56.640975] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:42:56.649825] [DEBUG] [LOCAL ] JILL: Loaded 16637 existing records from primary storage. [2025-10-01T19:42:56.650014] [INFO ] [MAIN ] JILL: Loaded 16637 existing records. [2025-10-01T19:42:56.839695] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:42:56.839967] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-01T19:42:56.840055] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-01T19:42:56.840330] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-01T19:42:56.840390] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-01T19:42:56.914384] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-01T19:42:57.249045] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:42:57.702344] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-01T19:42:57.890468] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T19:42:57.938865] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T19:42:58.175304] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T19:42:58.502403] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-01T19:42:58.966696] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T19:42:59.302424] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-01T19:42:59.957155] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T19:43:00.102381] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-01T19:43:00.740798] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T19:43:00.902385] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-01T19:43:01.364044] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T19:43:01.702383] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-01T19:43:02.071730] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-01T19:43:02.502388] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-01T19:43:03.293149] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T19:43:03.302337] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-01T19:43:03.891402] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T19:43:04.102386] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-01T19:43:04.702011] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T19:43:04.902386] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-01T19:43:05.702365] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-01T19:43:05.750875] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T19:43:06.473800] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T19:43:06.502361] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-01T19:43:07.067590] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T19:43:07.302391] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-01T19:43:08.102388] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-01T19:43:08.509582] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T19:43:08.510261] [INFO ] [REMOTE ] JHS: Full fetch complete (4444 records). [2025-10-01T19:43:08.510331] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-01T19:43:08.894481] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-01T19:43:08.894560] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-01T19:43:08.894724] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-01T19:43:08.894786] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-01T19:43:08.895156] [DEBUG] [LOCAL ] JHS: Trimmed 4444 records to 2826 (keeping 200 days of data) [2025-10-01T19:43:08.904579] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-01T19:43:08.915183] [DEBUG] [LOCAL ] JHS: Primary data saved (2826 records). [2025-10-01T19:43:08.915282] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-01T19:43:08.915364] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHS took 29.6s. Estimated remaining: 2h 51m 42s. Rate: 7.1 symbols/min [2025-10-01T19:43:09.115134] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:43:09.115325] [DEBUG] [LOCAL ] JKS: No existing data file found in primary storage. [2025-10-01T19:43:09.115366] [WARN ] [MAIN ] JKS: No existing data found, performing full refresh instead. [2025-10-01T19:43:09.115481] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-01T19:43:09.115531] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-01T19:43:09.115595] [DEBUG] [LOCAL ] JKS: No primary data file found to delete. [2025-10-01T19:43:09.115629] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-01T19:43:09.524113] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:43:09.702355] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-01T19:43:09.750525] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T19:43:10.092332] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T19:43:10.502408] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-01T19:43:10.834710] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T19:43:11.302387] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-01T19:43:11.814333] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T19:43:12.102390] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-01T19:43:12.272245] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T19:43:12.902370] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-01T19:43:13.626499] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T19:43:13.702453] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-01T19:43:14.502369] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-01T19:43:14.686691] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:43:15.034586] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T19:43:15.302411] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-01T19:43:15.575798] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T19:43:16.102403] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-01T19:43:16.902368] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-01T19:43:16.995452] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T19:43:17.033068] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T19:43:17.702379] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-01T19:43:18.484431] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T19:43:18.502336] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-01T19:43:19.302391] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-01T19:43:19.353592] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T19:43:20.102368] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-01T19:43:20.185751] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T19:43:20.286740] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T19:43:20.902376] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-01T19:43:21.702381] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-01T19:43:22.064592] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-01T19:43:22.066135] [INFO ] [REMOTE ] JHG: Full fetch complete (68286 records). [2025-10-01T19:43:22.066247] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-01T19:43:22.518260] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-01T19:43:22.519317] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-01T19:43:22.520315] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T19:43:22.521541] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-01T19:43:22.530805] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-01T19:43:22.531344] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-01T19:43:22.533480] [DEBUG] [LOCAL ] JHG: Trimmed 68286 records to 47664 (keeping 200 days of data) [2025-10-01T19:43:22.830611] [DEBUG] [LOCAL ] JHG: Primary data saved (47664 records). [2025-10-01T19:43:22.830767] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-01T19:43:22.830874] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 54.2s. Estimated remaining: 2h 51m 40s. Rate: 7.1 symbols/min [2025-10-01T19:43:23.025938] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:43:23.059512] [DEBUG] [LOCAL ] JLL: Loaded 31661 existing records from primary storage. [2025-10-01T19:43:23.059811] [INFO ] [MAIN ] JLL: Loaded 31661 existing records. [2025-10-01T19:43:23.270410] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:43:23.271467] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-01T19:43:23.271580] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-01T19:43:23.272560] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-01T19:43:23.272657] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-01T19:43:23.306982] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-01T19:43:23.428385] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T19:43:23.494324] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T19:43:23.739731] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:43:24.102380] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-01T19:43:24.902359] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-01T19:43:25.072514] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T19:43:25.139317] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T19:43:25.702415] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-01T19:43:26.038146] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-01T19:43:26.039202] [INFO ] [REMOTE ] JILL: Full fetch complete (22916 records). [2025-10-01T19:43:26.039275] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-01T19:43:26.480850] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-01T19:43:26.480931] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-01T19:43:26.481468] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-01T19:43:26.481511] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-01T19:43:26.482443] [DEBUG] [LOCAL ] JILL: Trimmed 22916 records to 16664 (keeping 200 days of data) [2025-10-01T19:43:26.527808] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-01T19:43:26.588737] [DEBUG] [LOCAL ] JILL: Primary data saved (16664 records). [2025-10-01T19:43:26.588885] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-01T19:43:26.588991] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JILL took 30.5s. Estimated remaining: 2h 51m 26s. Rate: 7.1 symbols/min [2025-10-01T19:43:27.302371] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-01T19:43:27.445064] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T19:43:28.089223] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T19:43:28.102340] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-01T19:43:28.521111] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T19:43:28.902391] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-01T19:43:29.556456] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T19:43:29.702391] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-01T19:43:30.328037] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T19:43:30.502417] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-01T19:43:31.017971] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T19:43:31.302404] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-01T19:43:31.807992] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T19:43:32.102456] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-01T19:43:32.902377] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-01T19:43:33.488351] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-01T19:43:33.489926] [INFO ] [REMOTE ] JHX: Full fetch complete (58533 records). [2025-10-01T19:43:33.490081] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-01T19:43:33.837016] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T19:43:33.871738] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-01T19:43:33.970859] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-01T19:43:33.970941] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-01T19:43:33.971866] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-01T19:43:33.971932] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-01T19:43:33.973315] [DEBUG] [LOCAL ] JHX: Trimmed 58533 records to 51882 (keeping 200 days of data) [2025-10-01T19:43:34.295211] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T19:43:34.326904] [DEBUG] [LOCAL ] JHX: Primary data saved (51882 records). [2025-10-01T19:43:34.327051] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-01T19:43:34.327155] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JHX took 39.2s. Estimated remaining: 2h 51m 17s. Rate: 7.1 symbols/min [2025-10-01T19:43:34.502440] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-01T19:43:35.286262] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T19:43:35.302346] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-01T19:43:35.693136] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T19:43:36.102384] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-01T19:43:36.489488] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T19:43:36.902390] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-01T19:43:37.465540] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T19:43:37.702386] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-01T19:43:38.822404] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-01T19:43:38.823789] [INFO ] [REMOTE ] JKS: Full fetch complete (59046 records). [2025-10-01T19:43:38.823874] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-01T19:43:39.233447] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T19:43:39.277119] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-01T19:43:39.277499] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-01T19:43:39.277572] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-01T19:43:39.279302] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-01T19:43:39.279477] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-01T19:43:39.280909] [DEBUG] [LOCAL ] JKS: Trimmed 59046 records to 40094 (keeping 200 days of data) [2025-10-01T19:43:39.542488] [DEBUG] [LOCAL ] JKS: Primary data saved (40094 records). [2025-10-01T19:43:39.542846] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-01T19:43:39.543069] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JKS took 30.6s. Estimated remaining: 2h 51m 5s. Rate: 7.1 symbols/min [2025-10-01T19:43:40.927370] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T19:43:40.935510] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-01T19:43:42.382542] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T19:43:42.390820] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-01T19:43:43.672725] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T19:43:43.679680] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-01T19:43:45.267439] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-01T19:43:45.268627] [INFO ] [REMOTE ] JLL: Full fetch complete (44711 records). [2025-10-01T19:43:45.268797] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-01T19:43:45.680581] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-01T19:43:45.680685] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-01T19:43:45.681457] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-01T19:43:45.681519] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-01T19:43:45.682511] [DEBUG] [LOCAL ] JLL: Trimmed 44711 records to 31546 (keeping 200 days of data) [2025-10-01T19:43:45.877420] [DEBUG] [LOCAL ] JLL: Primary data saved (31546 records). [2025-10-01T19:43:45.877556] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-01T19:43:45.877670] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JLL took 23.0s. Estimated remaining: 2h 50m 54s. Rate: 7.1 symbols/min [2025-10-01T19:43:46.568869] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:43:46.589425] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:43:46.635553] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-01T19:43:46.675784] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:43:46.674496] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:43:46.674616] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-01T19:43:46.676933] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-01T19:43:46.676997] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-01T19:43:46.677046] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-01T19:43:46.677180] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-01T19:43:46.747303] [DEBUG] [LOCAL ] JLS: Loaded 4126 existing records from primary storage. [2025-10-01T19:43:46.780030] [INFO ] [MAIN ] JLS: Loaded 4126 existing records. [2025-10-01T19:43:47.169785] [DEBUG] [LOCAL ] JMIA: Loaded 50631 existing records from primary storage. [2025-10-01T19:43:47.279843] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-01T19:43:47.263513] [INFO ] [MAIN ] JMIA: Loaded 50631 existing records. [2025-10-01T19:43:47.247511] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:43:47.317155] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-01T19:43:47.322600] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-01T19:43:47.374201] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-01T19:43:47.523417] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-01T19:43:47.580281] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-01T19:43:47.631890] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:43:47.686976] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-01T19:43:47.918469] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:43:47.896448] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:43:47.935375] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-01T19:43:47.935810] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-01T19:43:47.941217] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-01T19:43:47.941324] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-01T19:43:47.956822] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-01T19:43:47.982833] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-01T19:43:47.982889] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-01T19:43:48.050307] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-01T19:43:48.361073] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T19:43:48.388847] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-01T19:43:48.643675] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:43:48.691376] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-01T19:43:48.950450] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T19:43:49.012852] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-01T19:43:49.017526] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:43:49.030722] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-01T19:43:49.111796] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:43:49.112114] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-01T19:43:49.194126] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-01T19:43:49.195682] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-01T19:43:49.472748] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T19:43:49.473797] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-01T19:43:49.712388] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-01T19:43:49.713361] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-01T19:43:49.751848] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T19:43:49.753507] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-01T19:43:50.100794] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-01T19:43:50.102088] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-01T19:43:50.339744] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T19:43:50.502374] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-01T19:43:50.602287] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-01T19:43:50.964002] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T19:43:50.971506] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T19:43:51.302350] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-01T19:43:51.488124] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-01T19:43:51.760509] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-01T19:43:52.102377] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-01T19:43:52.657895] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-01T19:43:52.902365] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-01T19:43:53.512278] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T19:43:53.702416] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-01T19:43:54.155072] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T19:43:54.502395] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-01T19:43:55.085429] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-01T19:43:55.302402] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-01T19:43:56.102402] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-01T19:43:56.553421] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-01T19:43:56.902407] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-01T19:43:57.206013] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T19:43:57.396874] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T19:43:57.702394] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-01T19:43:58.502407] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-01T19:43:59.245553] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-01T19:43:59.246249] [INFO ] [REMOTE ] JMM: Full fetch complete (2305 records). [2025-10-01T19:43:59.246317] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-01T19:43:59.307550] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-01T19:43:59.450058] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-01T19:43:59.450273] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-01T19:43:59.450344] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-01T19:43:59.450418] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-01T19:43:59.450516] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-01T19:43:59.450572] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-01T19:43:59.450686] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-01T19:43:59.450784] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 13.6s. Estimated remaining: 2h 50m 51s. Rate: 7.1 symbols/min [2025-10-01T19:43:59.644120] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:43:59.701808] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-10-01T19:43:59.702143] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-10-01T19:43:59.905382] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:43:59.905793] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-01T19:43:59.905873] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-01T19:43:59.916588] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-01T19:43:59.931980] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-01T19:44:00.047464] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-01T19:44:00.107457] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-01T19:44:00.335532] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:44:00.721083] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T19:44:00.750091] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T19:44:00.902372] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-01T19:44:01.451119] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T19:44:01.702409] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-01T19:44:02.258298] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T19:44:02.502395] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-01T19:44:03.302389] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-01T19:44:04.102383] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-01T19:44:04.540843] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T19:44:04.765975] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T19:44:04.766766] [INFO ] [REMOTE ] JLS: Full fetch complete (5842 records). [2025-10-01T19:44:04.766838] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-01T19:44:04.907483] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-01T19:44:05.173002] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-01T19:44:05.173085] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-01T19:44:05.173280] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-01T19:44:05.173321] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-01T19:44:05.173773] [DEBUG] [LOCAL ] JLS: Trimmed 5842 records to 4138 (keeping 200 days of data) [2025-10-01T19:44:05.201287] [DEBUG] [LOCAL ] JLS: Primary data saved (4138 records). [2025-10-01T19:44:05.201437] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-01T19:44:05.201540] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLS took 19.3s. Estimated remaining: 2h 50m 40s. Rate: 7.1 symbols/min [2025-10-01T19:44:05.385784] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:44:05.411919] [DEBUG] [LOCAL ] JOE: Loaded 24183 existing records from primary storage. [2025-10-01T19:44:05.412181] [INFO ] [MAIN ] JOE: Loaded 24183 existing records. [2025-10-01T19:44:05.612799] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:44:05.613370] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-01T19:44:05.613524] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-01T19:44:05.614084] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-01T19:44:05.614185] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-01T19:44:05.704121] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-01T19:44:05.930975] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-01T19:44:06.064198] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:44:06.502370] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-01T19:44:06.690389] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T19:44:07.302429] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-01T19:44:07.754954] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T19:44:07.999838] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-01T19:44:08.102441] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-01T19:44:08.812374] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T19:44:08.902387] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-01T19:44:09.702397] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-01T19:44:10.363316] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-01T19:44:10.502348] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-01T19:44:10.563294] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T19:44:10.614999] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T19:44:11.302391] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-01T19:44:12.102381] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-01T19:44:12.806860] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-01T19:44:12.902375] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-01T19:44:13.127236] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T19:44:13.152400] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T19:44:13.702433] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-01T19:44:14.401526] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T19:44:14.502414] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-01T19:44:15.302436] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-01T19:44:15.846709] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T19:44:16.035914] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-01T19:44:16.102421] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-01T19:44:16.902395] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-01T19:44:17.445340] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-01T19:44:17.535318] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:44:17.702426] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-01T19:44:18.076740] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T19:44:18.502384] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-01T19:44:19.302359] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-01T19:44:19.690955] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T19:44:19.952290] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-01T19:44:20.102401] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-01T19:44:20.902373] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-01T19:44:20.956692] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T19:44:21.502843] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-01T19:44:21.702391] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-01T19:44:22.502431] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-01T19:44:23.302457] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-01T19:44:23.383514] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-01T19:44:23.653800] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T19:44:23.956184] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T19:44:24.114277] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-01T19:44:24.118421] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T19:44:24.902426] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-01T19:44:25.702386] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-01T19:44:26.076053] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T19:44:26.502434] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-01T19:44:26.610951] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-01T19:44:27.302391] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-01T19:44:27.567183] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T19:44:28.102415] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-01T19:44:28.750308] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (3.05 seconds). [2025-10-01T19:44:28.751934] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-01T19:44:28.752066] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-01T19:44:28.907523] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-01T19:44:29.203777] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-01T19:44:29.203872] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-01T19:44:29.205201] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-01T19:44:29.205297] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-01T19:44:29.206867] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-10-01T19:44:29.309928] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T19:44:29.313781] [INFO ] [REMOTE ] JOE: Full fetch complete (36065 records). [2025-10-01T19:44:29.315162] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-01T19:44:29.994466] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-01T19:44:29.995629] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-01T19:44:29.997295] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-01T19:44:29.998133] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-01T19:44:30.032305] [DEBUG] [LOCAL ] JOE: Trimmed 36065 records to 24154 (keeping 200 days of data) [2025-10-01T19:44:30.035324] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-10-01T19:44:30.104761] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-01T19:44:30.308774] [DEBUG] [LOCAL ] JOE: Primary data saved (24154 records). [2025-10-01T19:44:30.310035] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-01T19:44:30.310791] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JOE took 25.1s. Estimated remaining: 2h 50m 49s. Rate: 7.1 symbols/min [2025-10-01T19:44:30.430868] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-01T19:44:30.431440] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-01T19:44:30.434045] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 44.6s. Estimated remaining: 2h 50m 32s. Rate: 7.1 symbols/min [2025-10-01T19:44:30.588044] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:44:30.720636] [DEBUG] [LOCAL ] JOF: Loaded 7020 existing records from primary storage. [2025-10-01T19:44:30.722428] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:44:30.723004] [INFO ] [MAIN ] JOF: Loaded 7020 existing records. [2025-10-01T19:44:30.953499] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:44:30.954548] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-01T19:44:30.954731] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-01T19:44:30.966230] [DEBUG] [LOCAL ] JPC: Loaded 37115 existing records from primary storage. [2025-10-01T19:44:30.965416] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-01T19:44:30.981941] [INFO ] [MAIN ] JPC: Loaded 37115 existing records. [2025-10-01T19:44:30.981774] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-01T19:44:31.058980] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-01T19:44:31.202977] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-01T19:44:31.387305] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:44:31.445670] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-01T19:44:31.487487] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-01T19:44:31.524075] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-01T19:44:31.524256] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-01T19:44:31.752507] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:44:31.783972] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-01T19:44:32.019779] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:44:32.102358] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-01T19:44:32.681387] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-01T19:44:32.902376] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-01T19:44:33.027107] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T19:44:33.045460] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T19:44:33.167300] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T19:44:33.702393] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-01T19:44:34.258986] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T19:44:34.502380] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-01T19:44:35.136505] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T19:44:35.197626] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-01T19:44:35.302383] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-01T19:44:36.033166] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T19:44:36.102365] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-01T19:44:36.902389] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-01T19:44:36.920380] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T19:44:37.702389] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-01T19:44:38.192720] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T19:44:38.502379] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-01T19:44:39.302385] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-01T19:44:39.850104] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T19:44:39.908842] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T19:44:40.102389] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-01T19:44:40.143151] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-01T19:44:40.144909] [INFO ] [REMOTE ] JMIA: Full fetch complete (73263 records). [2025-10-01T19:44:40.145044] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-01T19:44:40.575116] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-01T19:44:40.575209] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-01T19:44:40.576221] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-01T19:44:40.576313] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-01T19:44:40.577987] [DEBUG] [LOCAL ] JMIA: Trimmed 73263 records to 50668 (keeping 200 days of data) [2025-10-01T19:44:40.804705] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T19:44:40.903437] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-01T19:44:40.908327] [DEBUG] [LOCAL ] JMIA: Primary data saved (50668 records). [2025-10-01T19:44:40.908615] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-01T19:44:40.908814] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JMIA took 55.0s. Estimated remaining: 2h 50m 25s. Rate: 7.1 symbols/min [2025-10-01T19:44:41.092154] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:44:41.158914] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-01T19:44:41.159271] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-01T19:44:41.359707] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:44:41.359984] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-01T19:44:41.360040] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-01T19:44:41.360807] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-01T19:44:41.360871] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-01T19:44:41.674837] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T19:44:41.707520] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-01T19:44:41.770460] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:44:42.502380] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-01T19:44:43.167693] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-01T19:44:43.302374] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-01T19:44:44.056403] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T19:44:44.102366] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-01T19:44:44.581741] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-01T19:44:44.902382] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-01T19:44:45.621697] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T19:44:45.702365] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-01T19:44:46.091887] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-01T19:44:46.502394] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-01T19:44:46.520438] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T19:44:46.521277] [INFO ] [REMOTE ] JOF: Full fetch complete (9507 records). [2025-10-01T19:44:46.521351] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-01T19:44:46.926019] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-01T19:44:46.926100] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-01T19:44:46.926351] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-01T19:44:46.926392] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-01T19:44:46.926886] [DEBUG] [LOCAL ] JOF: Trimmed 9507 records to 7000 (keeping 200 days of data) [2025-10-01T19:44:46.971600] [DEBUG] [LOCAL ] JOF: Primary data saved (7000 records). [2025-10-01T19:44:46.971774] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-01T19:44:46.971869] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOF took 16.7s. Estimated remaining: 2h 50m 14s. Rate: 7.1 symbols/min [2025-10-01T19:44:47.153626] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:44:47.190998] [DEBUG] [LOCAL ] JQC: Loaded 34076 existing records from primary storage. [2025-10-01T19:44:47.191393] [INFO ] [MAIN ] JQC: Loaded 34076 existing records. [2025-10-01T19:44:47.307505] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-01T19:44:47.389193] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:44:47.389414] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-01T19:44:47.389462] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-01T19:44:47.389935] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-01T19:44:47.389997] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-01T19:44:47.812713] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:44:47.838945] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T19:44:48.102380] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-01T19:44:48.903259] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-01T19:44:48.909995] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T19:44:49.486715] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T19:44:49.702389] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-01T19:44:49.871241] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T19:44:50.502378] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-01T19:44:51.302358] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-01T19:44:51.547395] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-01T19:44:52.102357] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-01T19:44:52.526823] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T19:44:52.902365] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-01T19:44:53.489677] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T19:44:53.702386] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-01T19:44:54.393308] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T19:44:54.502388] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-01T19:44:54.567940] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (4.07 seconds). [2025-10-01T19:44:54.569516] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-01T19:44:54.569616] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-01T19:44:55.003745] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-01T19:44:55.003859] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-01T19:44:55.004968] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-01T19:44:55.005060] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-01T19:44:55.006794] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53799 (keeping 200 days of data) [2025-10-01T19:44:55.236937] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T19:44:55.311571] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-01T19:44:55.365187] [DEBUG] [LOCAL ] JOBY: Primary data saved (53799 records). [2025-10-01T19:44:55.365333] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-01T19:44:55.365420] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOBY took 55.9s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-10-01T19:44:55.547352] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:44:55.564371] [DEBUG] [LOCAL ] JRI: Loaded 14806 existing records from primary storage. [2025-10-01T19:44:55.564598] [INFO ] [MAIN ] JRI: Loaded 14806 existing records. [2025-10-01T19:44:55.760607] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:44:55.760977] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-01T19:44:55.761034] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-01T19:44:55.761404] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-01T19:44:55.761467] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-01T19:44:56.090312] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T19:44:56.105186] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-01T19:44:56.194800] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:44:56.798251] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T19:44:56.902365] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-01T19:44:57.702404] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-01T19:44:58.337355] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-01T19:44:58.372631] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T19:44:58.502385] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-01T19:44:58.988617] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T19:44:59.302410] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-01T19:45:00.102354] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-01T19:45:00.288076] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T19:45:00.634961] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-01T19:45:00.902371] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-01T19:45:01.171719] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T19:45:01.702432] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-01T19:45:02.156545] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T19:45:02.502450] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-01T19:45:03.302381] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-01T19:45:03.938139] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-01T19:45:04.102378] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-01T19:45:04.269392] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-01T19:45:04.270883] [INFO ] [REMOTE ] JPC: Full fetch complete (55640 records). [2025-10-01T19:45:04.271001] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-01T19:45:04.416234] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T19:45:04.707949] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-01T19:45:04.708043] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-01T19:45:04.708943] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-01T19:45:04.709011] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-01T19:45:04.710285] [DEBUG] [LOCAL ] JPC: Trimmed 55640 records to 37095 (keeping 200 days of data) [2025-10-01T19:45:04.907598] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-01T19:45:04.942936] [DEBUG] [LOCAL ] JPC: Primary data saved (37095 records). [2025-10-01T19:45:04.943079] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-01T19:45:04.943168] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPC took 34.5s. Estimated remaining: 2h 49m 58s. Rate: 7.1 symbols/min [2025-10-01T19:45:05.129303] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:45:05.142916] [DEBUG] [LOCAL ] JRS: Loaded 11261 existing records from primary storage. [2025-10-01T19:45:05.143216] [INFO ] [MAIN ] JRS: Loaded 11261 existing records. [2025-10-01T19:45:05.350622] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:45:05.350981] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-01T19:45:05.351170] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-01T19:45:05.351464] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-01T19:45:05.351525] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-01T19:45:05.581809] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T19:45:05.706477] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-01T19:45:05.792026] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:45:06.502420] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-01T19:45:06.972736] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T19:45:07.212601] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-01T19:45:07.302409] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-01T19:45:07.516552] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T19:45:08.102394] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-01T19:45:08.902403] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-01T19:45:09.081287] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T19:45:09.534838] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-01T19:45:09.702395] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-01T19:45:09.991797] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T19:45:10.502432] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-01T19:45:11.302396] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-01T19:45:11.437489] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T19:45:11.907923] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T19:45:12.108450] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-01T19:45:12.123347] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-01T19:45:12.899327] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T19:45:12.902352] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-01T19:45:13.468044] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T19:45:13.702390] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-01T19:45:14.502358] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-01T19:45:14.566853] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T19:45:15.302431] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-01T19:45:16.009514] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T19:45:16.012101] [INFO ] [REMOTE ] JQC: Full fetch complete (49118 records). [2025-10-01T19:45:16.012271] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-01T19:45:16.103470] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-01T19:45:16.136114] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T19:45:16.665778] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-01T19:45:16.665886] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-01T19:45:16.667283] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-01T19:45:16.667382] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-01T19:45:16.669071] [DEBUG] [LOCAL ] JQC: Trimmed 49118 records to 34263 (keeping 200 days of data) [2025-10-01T19:45:16.902767] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-01T19:45:16.941211] [DEBUG] [LOCAL ] JQC: Primary data saved (34263 records). [2025-10-01T19:45:16.941428] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-01T19:45:16.941549] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JQC took 30.0s. Estimated remaining: 2h 49m 53s. Rate: 7.1 symbols/min [2025-10-01T19:45:17.154476] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:45:17.201002] [DEBUG] [LOCAL ] JXN: Loaded 45657 existing records from primary storage. [2025-10-01T19:45:17.201306] [INFO ] [MAIN ] JXN: Loaded 45657 existing records. [2025-10-01T19:45:17.397132] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:45:17.398136] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-01T19:45:17.398235] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-01T19:45:17.398703] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-01T19:45:17.398779] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-01T19:45:17.712144] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-01T19:45:17.755027] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T19:45:17.851931] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:45:18.502375] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-01T19:45:18.601058] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-01T19:45:18.694807] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T19:45:19.302392] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-01T19:45:19.978074] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T19:45:20.102411] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-01T19:45:20.902391] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-01T19:45:21.305829] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T19:45:21.702377] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-01T19:45:22.372113] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-01T19:45:22.376253] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-01T19:45:22.376425] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-01T19:45:22.509895] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-01T19:45:22.634208] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T19:45:22.659203] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T19:45:22.917111] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-01T19:45:22.917210] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-01T19:45:22.918312] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-01T19:45:22.918415] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-01T19:45:22.920939] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-10-01T19:45:23.273091] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-01T19:45:23.273240] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-01T19:45:23.273342] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JPM took 42.4s. Estimated remaining: 2h 49m 43s. Rate: 7.1 symbols/min [2025-10-01T19:45:23.307475] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-01T19:45:23.463277] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:45:23.513583] [DEBUG] [LOCAL ] K: Loaded 49962 existing records from primary storage. [2025-10-01T19:45:23.513923] [INFO ] [MAIN ] K: Loaded 49962 existing records. [2025-10-01T19:45:23.642106] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T19:45:23.726115] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:45:23.726364] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-01T19:45:23.726421] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-01T19:45:23.727236] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-01T19:45:23.727311] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-01T19:45:24.108818] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-01T19:45:24.115534] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:45:24.911672] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-01T19:45:24.916559] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T19:45:25.161597] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T19:45:25.598854] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T19:45:25.702425] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-01T19:45:26.502397] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-01T19:45:27.302370] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-01T19:45:27.353684] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T19:45:27.936362] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T19:45:28.102404] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-01T19:45:28.257170] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T19:45:28.902403] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-01T19:45:29.673616] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T19:45:29.702361] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-01T19:45:29.823076] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T19:45:30.502442] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-01T19:45:31.308599] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-01T19:45:31.333399] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T19:45:31.379603] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T19:45:32.102393] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-01T19:45:32.405332] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-01T19:45:32.406406] [INFO ] [REMOTE ] JRI: Full fetch complete (23267 records). [2025-10-01T19:45:32.406482] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-01T19:45:32.795728] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-01T19:45:32.795813] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-01T19:45:32.796353] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-01T19:45:32.796399] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-01T19:45:32.797056] [DEBUG] [LOCAL ] JRI: Trimmed 23267 records to 14885 (keeping 200 days of data) [2025-10-01T19:45:32.896503] [DEBUG] [LOCAL ] JRI: Primary data saved (14885 records). [2025-10-01T19:45:32.896677] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-01T19:45:32.896787] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 37.5s. Estimated remaining: 2h 49m 35s. Rate: 7.1 symbols/min [2025-10-01T19:45:32.908608] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-01T19:45:33.098970] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:45:33.094532] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-01T19:45:33.100726] [INFO ] [REMOTE ] JRS: Full fetch complete (16188 records). [2025-10-01T19:45:33.100827] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-01T19:45:33.243696] [DEBUG] [LOCAL ] KAI: Loaded 13286 existing records from primary storage. [2025-10-01T19:45:33.277517] [INFO ] [MAIN ] KAI: Loaded 13286 existing records. [2025-10-01T19:45:33.717269] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-01T19:45:33.725496] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:45:33.733033] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-01T19:45:33.733228] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-01T19:45:33.734096] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-01T19:45:33.734187] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-01T19:45:33.734710] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-01T19:45:33.734930] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-01T19:45:33.735065] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-01T19:45:33.735138] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-01T19:45:33.770150] [DEBUG] [LOCAL ] JRS: Trimmed 16188 records to 11305 (keeping 200 days of data) [2025-10-01T19:45:34.135463] [DEBUG] [LOCAL ] JRS: Primary data saved (11305 records). [2025-10-01T19:45:34.152030] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-01T19:45:34.162449] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 29.2s. Estimated remaining: 2h 49m 20s. Rate: 7.1 symbols/min [2025-10-01T19:45:34.330004] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:45:34.429941] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:45:34.479480] [DEBUG] [LOCAL ] KAR: Loaded 39860 existing records from primary storage. [2025-10-01T19:45:34.479829] [INFO ] [MAIN ] KAR: Loaded 39860 existing records. [2025-10-01T19:45:34.513439] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-01T19:45:34.684919] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:45:34.685289] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-01T19:45:34.685378] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-01T19:45:34.694576] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-01T19:45:34.710806] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-01T19:45:34.760740] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-01T19:45:35.111172] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:45:35.222160] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-01T19:45:35.302362] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-01T19:45:35.406833] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T19:45:36.102412] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-01T19:45:36.907914] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-01T19:45:36.929802] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T19:45:37.304158] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T19:45:37.702388] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-01T19:45:38.001674] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T19:45:38.218308] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T19:45:38.502395] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-01T19:45:39.302413] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-01T19:45:39.943379] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T19:45:40.102377] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-01T19:45:40.365469] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T19:45:40.902381] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-01T19:45:41.579907] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T19:45:41.668008] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T19:45:41.702362] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-01T19:45:42.502386] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-01T19:45:42.774401] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T19:45:43.302397] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-01T19:45:43.941532] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T19:45:44.102385] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-01T19:45:44.902383] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-01T19:45:44.950618] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T19:45:45.229198] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T19:45:45.702376] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-01T19:45:46.502388] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-01T19:45:46.778633] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T19:45:47.168738] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T19:45:47.302378] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-01T19:45:48.102447] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-01T19:45:48.108117] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T19:45:48.863531] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T19:45:48.902335] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-01T19:45:49.052541] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T19:45:49.702370] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-01T19:45:50.250430] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T19:45:50.502400] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-01T19:45:51.223536] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T19:45:51.302438] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-01T19:45:51.436308] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T19:45:52.102438] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-01T19:45:52.804514] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T19:45:52.902396] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-01T19:45:53.702422] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-01T19:45:53.966128] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T19:45:53.987553] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T19:45:54.502419] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-01T19:45:55.302393] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-01T19:45:55.598479] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-01T19:45:55.602212] [INFO ] [REMOTE ] JXN: Full fetch complete (65268 records). [2025-10-01T19:45:55.602353] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-01T19:45:56.095166] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-01T19:45:56.095286] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-01T19:45:56.096427] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-01T19:45:56.096605] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-01T19:45:56.109564] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T19:45:56.108234] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-01T19:45:56.117174] [DEBUG] [LOCAL ] JXN: Trimmed 65268 records to 45580 (keeping 200 days of data) [2025-10-01T19:45:56.350882] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T19:45:56.470580] [DEBUG] [LOCAL ] JXN: Primary data saved (45580 records). [2025-10-01T19:45:56.470744] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-01T19:45:56.470850] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 39.5s. Estimated remaining: 2h 49m 25s. Rate: 7.1 symbols/min [2025-10-01T19:45:56.656432] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:45:56.682256] [DEBUG] [LOCAL ] KB: Loaded 24012 existing records from primary storage. [2025-10-01T19:45:56.682508] [INFO ] [MAIN ] KB: Loaded 24012 existing records. [2025-10-01T19:45:56.878029] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:45:56.878262] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-01T19:45:56.878310] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-01T19:45:56.878788] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-01T19:45:56.878848] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-01T19:45:56.911215] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-01T19:45:57.297350] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:45:57.592013] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T19:45:57.702343] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-01T19:45:57.795900] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T19:45:58.502427] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-01T19:45:59.302404] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-01T19:45:59.409004] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T19:45:59.539723] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T19:45:59.540602] [INFO ] [REMOTE ] KAI: Full fetch complete (18850 records). [2025-10-01T19:45:59.540698] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-01T19:45:59.946048] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-01T19:45:59.946133] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-01T19:45:59.946687] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-01T19:45:59.946752] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-01T19:45:59.947512] [DEBUG] [LOCAL ] KAI: Trimmed 18850 records to 13309 (keeping 200 days of data) [2025-10-01T19:46:00.036522] [DEBUG] [LOCAL ] KAI: Primary data saved (13309 records). [2025-10-01T19:46:00.036744] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-01T19:46:00.036840] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 27.1s. Estimated remaining: 2h 49m 12s. Rate: 7.1 symbols/min [2025-10-01T19:46:00.107479] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-01T19:46:00.254086] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:00.278144] [DEBUG] [LOCAL ] KBDC: Loaded 21049 existing records from primary storage. [2025-10-01T19:46:00.294010] [INFO ] [MAIN ] KBDC: Loaded 21049 existing records. [2025-10-01T19:46:00.300751] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T19:46:00.500545] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:46:00.500829] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-01T19:46:00.500886] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-01T19:46:00.501194] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-01T19:46:00.501255] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-01T19:46:00.891172] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:00.902356] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-01T19:46:01.702430] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-01T19:46:01.756582] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T19:46:01.857835] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T19:46:02.502369] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-01T19:46:03.302377] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-01T19:46:03.447119] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T19:46:03.610806] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T19:46:03.612486] [INFO ] [REMOTE ] KAR: Full fetch complete (56837 records). [2025-10-01T19:46:03.612586] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-01T19:46:04.043273] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-01T19:46:04.043377] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-01T19:46:04.044344] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-01T19:46:04.044417] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-01T19:46:04.045896] [DEBUG] [LOCAL ] KAR: Trimmed 56837 records to 39968 (keeping 200 days of data) [2025-10-01T19:46:04.107172] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-01T19:46:04.300279] [DEBUG] [LOCAL ] KAR: Primary data saved (39968 records). [2025-10-01T19:46:04.300450] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-01T19:46:04.300541] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. KAR took 30.1s. Estimated remaining: 2h 48m 59s. Rate: 7.1 symbols/min [2025-10-01T19:46:04.539364] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:04.553006] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T19:46:04.604459] [DEBUG] [LOCAL ] KBH: Loaded 48913 existing records from primary storage. [2025-10-01T19:46:04.604822] [INFO ] [MAIN ] KBH: Loaded 48913 existing records. [2025-10-01T19:46:04.813927] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:46:04.814236] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-01T19:46:04.814290] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-01T19:46:04.814585] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-01T19:46:04.814679] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-01T19:46:04.912791] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-01T19:46:04.958929] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T19:46:05.243228] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:05.702406] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-01T19:46:06.502423] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-01T19:46:06.808699] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T19:46:06.834365] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T19:46:07.302390] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-01T19:46:07.827728] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T19:46:07.983979] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T19:46:08.102489] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-01T19:46:08.902454] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-01T19:46:09.313293] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T19:46:09.702405] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-01T19:46:10.502415] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-01T19:46:10.567915] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T19:46:11.124213] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-01T19:46:11.126495] [INFO ] [REMOTE ] K: Full fetch complete (72048 records). [2025-10-01T19:46:11.126700] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-01T19:46:11.305327] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-01T19:46:11.586691] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-01T19:46:11.586797] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-01T19:46:11.587900] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-01T19:46:11.587989] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-01T19:46:11.589571] [DEBUG] [LOCAL ] K: Trimmed 72048 records to 49977 (keeping 200 days of data) [2025-10-01T19:46:11.933375] [DEBUG] [LOCAL ] K: Primary data saved (49977 records). [2025-10-01T19:46:11.933520] [INFO ] [MAIN ] K: Full history saved. [2025-10-01T19:46:11.933611] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. K took 48.7s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-10-01T19:46:12.109971] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-01T19:46:12.129304] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:12.177239] [DEBUG] [LOCAL ] KBR: Loaded 48052 existing records from primary storage. [2025-10-01T19:46:12.177586] [INFO ] [MAIN ] KBR: Loaded 48052 existing records. [2025-10-01T19:46:12.389510] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:46:12.390199] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-01T19:46:12.390503] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-01T19:46:12.423338] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-01T19:46:12.432349] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T19:46:12.430437] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-01T19:46:12.448873] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T19:46:12.859348] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:12.902425] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-01T19:46:13.012259] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T19:46:13.638692] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T19:46:13.702393] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-01T19:46:14.502422] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-01T19:46:14.726340] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T19:46:15.302397] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-01T19:46:15.755154] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T19:46:16.102408] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-01T19:46:16.607124] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T19:46:16.902404] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-01T19:46:17.433016] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T19:46:17.702403] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-01T19:46:18.502374] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-01T19:46:18.603077] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T19:46:18.680464] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T19:46:19.302347] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-01T19:46:19.711423] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T19:46:20.102387] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-01T19:46:20.797375] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T19:46:20.902375] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-01T19:46:21.022557] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T19:46:21.702381] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-01T19:46:22.502376] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-01T19:46:22.613794] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T19:46:23.302367] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-01T19:46:23.495757] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T19:46:23.555856] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T19:46:24.038313] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T19:46:24.102380] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-01T19:46:24.902391] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-01T19:46:25.691335] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T19:46:25.702333] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-01T19:46:26.039310] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T19:46:26.502380] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-01T19:46:27.239245] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T19:46:27.302414] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-01T19:46:28.102427] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-01T19:46:28.259233] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-01T19:46:28.260528] [INFO ] [REMOTE ] KBDC: Full fetch complete (28852 records). [2025-10-01T19:46:28.260633] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-01T19:46:28.543131] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T19:46:28.589182] [INFO ] [REMOTE ] KB: Full fetch complete (34108 records). [2025-10-01T19:46:28.618819] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-01T19:46:28.919900] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-01T19:46:28.943756] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-01T19:46:28.981911] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-01T19:46:28.993820] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-01T19:46:29.008937] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-01T19:46:29.104744] [DEBUG] [LOCAL ] KBDC: Trimmed 28852 records to 21161 (keeping 200 days of data) [2025-10-01T19:46:29.307402] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-01T19:46:29.309947] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-01T19:46:29.310731] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-01T19:46:29.312164] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-01T19:46:29.317293] [DEBUG] [LOCAL ] KB: Trimmed 34108 records to 23969 (keeping 200 days of data) [2025-10-01T19:46:29.455382] [DEBUG] [LOCAL ] KBDC: Primary data saved (21161 records). [2025-10-01T19:46:29.456107] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-01T19:46:29.456465] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KBDC took 29.4s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-10-01T19:46:29.731262] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:29.737205] [DEBUG] [LOCAL ] KB: Primary data saved (23969 records). [2025-10-01T19:46:29.737454] [INFO ] [MAIN ] KB: Full history saved. [2025-10-01T19:46:29.737797] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KB took 33.3s. Estimated remaining: 2h 48m 33s. Rate: 7.1 symbols/min [2025-10-01T19:46:29.940747] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:29.991163] [DEBUG] [LOCAL ] KEN: Loaded 4740 existing records from primary storage. [2025-10-01T19:46:29.993267] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T19:46:30.004432] [INFO ] [MAIN ] KEN: Loaded 4740 existing records. [2025-10-01T19:46:30.054199] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-01T19:46:30.074177] [DEBUG] [LOCAL ] KD: Loaded 52305 existing records from primary storage. [2025-10-01T19:46:30.095523] [INFO ] [MAIN ] KD: Loaded 52305 existing records. [2025-10-01T19:46:30.362695] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:46:30.395920] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-01T19:46:30.414178] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-01T19:46:30.440170] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:46:30.440484] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-01T19:46:30.440567] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-01T19:46:30.440782] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-01T19:46:30.440915] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-01T19:46:30.518575] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-01T19:46:30.533725] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-01T19:46:31.208418] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:31.226271] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-01T19:46:31.317006] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:31.341785] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-01T19:46:31.347275] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-01T19:46:31.755846] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-01T19:46:31.855742] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T19:46:32.102382] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-01T19:46:32.902346] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-01T19:46:33.070281] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T19:46:33.655478] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T19:46:33.693850] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T19:46:33.703799] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-01T19:46:34.185393] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T19:46:34.502409] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-01T19:46:35.302407] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-01T19:46:36.102420] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-01T19:46:36.223948] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T19:46:36.840756] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T19:46:36.902402] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-01T19:46:37.702378] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-01T19:46:37.840135] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T19:46:38.133802] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T19:46:38.429866] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T19:46:38.502380] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-01T19:46:39.302391] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-01T19:46:40.102405] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-01T19:46:40.704281] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-01T19:46:40.706595] [INFO ] [REMOTE ] KBH: Full fetch complete (70758 records). [2025-10-01T19:46:40.706844] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-01T19:46:40.906122] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-01T19:46:40.990802] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T19:46:41.209477] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-01T19:46:41.209797] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-01T19:46:41.210916] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-01T19:46:41.211205] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-01T19:46:41.213164] [DEBUG] [LOCAL ] KBH: Trimmed 70758 records to 48894 (keeping 200 days of data) [2025-10-01T19:46:41.343029] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T19:46:41.579249] [DEBUG] [LOCAL ] KBH: Primary data saved (48894 records). [2025-10-01T19:46:41.579442] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-01T19:46:41.579546] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBH took 37.3s. Estimated remaining: 2h 48m 28s. Rate: 7.1 symbols/min [2025-10-01T19:46:41.707524] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-01T19:46:41.777069] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:41.813056] [DEBUG] [LOCAL ] KEP: Loaded 30960 existing records from primary storage. [2025-10-01T19:46:41.813382] [INFO ] [MAIN ] KEP: Loaded 30960 existing records. [2025-10-01T19:46:42.005981] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:46:42.006235] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-01T19:46:42.006294] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-01T19:46:42.006736] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-01T19:46:42.006797] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-01T19:46:42.368813] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T19:46:42.440987] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:42.502361] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-01T19:46:42.769635] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T19:46:43.302376] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-01T19:46:44.102363] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-01T19:46:44.263437] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T19:46:44.496618] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-01T19:46:44.692024] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T19:46:44.902380] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-01T19:46:45.702385] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-01T19:46:46.502389] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-01T19:46:46.956725] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T19:46:47.309415] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-01T19:46:47.315260] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-01T19:46:47.954739] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T19:46:48.102387] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-01T19:46:48.275911] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T19:46:48.674871] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T19:46:48.902440] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-01T19:46:49.530916] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T19:46:49.702383] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-01T19:46:50.502440] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-01T19:46:51.078211] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T19:46:51.302431] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-01T19:46:51.852575] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T19:46:51.933469] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T19:46:51.934217] [INFO ] [REMOTE ] KEN: Full fetch complete (5946 records). [2025-10-01T19:46:51.934290] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-01T19:46:52.109726] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-01T19:46:52.365206] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-01T19:46:52.365287] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-01T19:46:52.365473] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-01T19:46:52.365515] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-01T19:46:52.365948] [DEBUG] [LOCAL ] KEN: Trimmed 5946 records to 4732 (keeping 200 days of data) [2025-10-01T19:46:52.396135] [DEBUG] [LOCAL ] KEN: Primary data saved (4732 records). [2025-10-01T19:46:52.396282] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-01T19:46:52.396372] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KEN took 22.7s. Estimated remaining: 2h 48m 22s. Rate: 7.1 symbols/min [2025-10-01T19:46:52.580721] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:52.624962] [DEBUG] [LOCAL ] KEX: Loaded 38053 existing records from primary storage. [2025-10-01T19:46:52.625283] [INFO ] [MAIN ] KEX: Loaded 38053 existing records. [2025-10-01T19:46:52.839070] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:46:52.839406] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-01T19:46:52.839472] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-01T19:46:52.839869] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-01T19:46:52.839938] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-01T19:46:52.907831] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-01T19:46:53.232223] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:53.702466] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-01T19:46:54.093867] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-01T19:46:54.502395] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-01T19:46:54.777192] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T19:46:54.961385] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T19:46:54.963356] [INFO ] [REMOTE ] KBR: Full fetch complete (69878 records). [2025-10-01T19:46:54.963479] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-01T19:46:55.307462] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-01T19:46:55.389608] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-01T19:46:55.389724] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-01T19:46:55.390687] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-01T19:46:55.390751] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-01T19:46:55.392307] [DEBUG] [LOCAL ] KBR: Trimmed 69878 records to 48025 (keeping 200 days of data) [2025-10-01T19:46:55.699112] [DEBUG] [LOCAL ] KBR: Primary data saved (48025 records). [2025-10-01T19:46:55.699333] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-01T19:46:55.699431] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBR took 43.8s. Estimated remaining: 2h 48m 9s. Rate: 7.1 symbols/min [2025-10-01T19:46:55.880287] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:46:55.880531] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-01T19:46:55.880588] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-01T19:46:55.880738] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-01T19:46:55.880783] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-01T19:46:55.880826] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-01T19:46:55.880859] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-01T19:46:56.110197] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-01T19:46:56.286745] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:46:56.318376] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T19:46:56.902416] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-01T19:46:57.067494] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T19:46:57.170317] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T19:46:57.702378] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-01T19:46:58.414223] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T19:46:58.502437] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-01T19:46:58.756689] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T19:46:59.302401] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-01T19:47:00.102361] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-01T19:47:00.290222] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T19:47:00.501487] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T19:47:00.902443] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-01T19:47:01.702390] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-01T19:47:02.344306] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T19:47:02.346676] [INFO ] [REMOTE ] KD: Full fetch complete (75656 records). [2025-10-01T19:47:02.346805] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-01T19:47:02.510960] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-01T19:47:02.800736] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-01T19:47:02.809778] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-01T19:47:02.822614] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-01T19:47:02.822962] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-01T19:47:02.828539] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T19:47:02.839298] [DEBUG] [LOCAL ] KD: Trimmed 75656 records to 52309 (keeping 200 days of data) [2025-10-01T19:47:02.952627] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T19:47:03.195181] [DEBUG] [LOCAL ] KD: Primary data saved (52309 records). [2025-10-01T19:47:03.195363] [INFO ] [MAIN ] KD: Full history saved. [2025-10-01T19:47:03.195483] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KD took 33.7s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-10-01T19:47:03.307522] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-01T19:47:03.399798] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:47:03.445784] [DEBUG] [LOCAL ] KEYS: Loaded 43162 existing records from primary storage. [2025-10-01T19:47:03.446130] [INFO ] [MAIN ] KEYS: Loaded 43162 existing records. [2025-10-01T19:47:03.658341] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:47:03.658588] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-01T19:47:03.658687] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-01T19:47:03.659517] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-01T19:47:03.659580] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-01T19:47:04.081937] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:47:04.102401] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-01T19:47:04.401470] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T19:47:04.444091] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T19:47:04.902392] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-01T19:47:05.290272] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T19:47:05.702386] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-01T19:47:06.312379] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T19:47:06.502401] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-01T19:47:06.884516] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T19:47:07.302441] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-01T19:47:07.829214] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T19:47:08.102399] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-01T19:47:08.467674] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T19:47:08.902389] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-01T19:47:09.702367] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-01T19:47:09.793044] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T19:47:10.502394] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-01T19:47:10.535228] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T19:47:11.037489] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T19:47:11.302419] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-01T19:47:12.102358] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-01T19:47:12.220663] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T19:47:12.907490] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-01T19:47:12.923508] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T19:47:13.498070] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T19:47:13.702390] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-01T19:47:14.070297] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T19:47:14.502437] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-01T19:47:15.302421] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-01T19:47:15.347702] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T19:47:16.102455] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-01T19:47:16.374089] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-01T19:47:16.376017] [INFO ] [REMOTE ] KEP: Full fetch complete (41692 records). [2025-10-01T19:47:16.376193] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-01T19:47:16.854267] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T19:47:16.904435] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-01T19:47:17.094460] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-01T19:47:17.094603] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-01T19:47:17.095575] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-01T19:47:17.095669] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-01T19:47:17.096858] [DEBUG] [LOCAL ] KEP: Trimmed 41692 records to 31109 (keeping 200 days of data) [2025-10-01T19:47:17.314844] [DEBUG] [LOCAL ] KEP: Primary data saved (31109 records). [2025-10-01T19:47:17.314983] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-01T19:47:17.315080] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEP took 35.7s. Estimated remaining: 2h 47m 56s. Rate: 7.1 symbols/min [2025-10-01T19:47:17.505396] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:47:17.505659] [DEBUG] [LOCAL ] KF: No existing data file found in primary storage. [2025-10-01T19:47:17.505721] [WARN ] [MAIN ] KF: No existing data found, performing full refresh instead. [2025-10-01T19:47:17.505834] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-01T19:47:17.505883] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-01T19:47:17.505928] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-10-01T19:47:17.505962] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-01T19:47:17.721945] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-01T19:47:17.938181] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:47:18.008361] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T19:47:18.502397] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-01T19:47:18.718274] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T19:47:19.302407] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-01T19:47:19.399218] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T19:47:19.432629] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T19:47:20.102419] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-01T19:47:20.902361] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-01T19:47:21.141661] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T19:47:21.552387] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T19:47:21.702357] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-01T19:47:21.779695] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T19:47:22.010587] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-01T19:47:22.502443] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-01T19:47:23.302423] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-01T19:47:24.103180] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-01T19:47:24.106832] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T19:47:24.878029] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T19:47:24.902360] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-01T19:47:25.702411] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-01T19:47:25.949945] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T19:47:26.046198] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-01T19:47:26.502382] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-01T19:47:26.606256] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T19:47:27.302432] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-01T19:47:27.863199] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-01T19:47:28.102404] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-01T19:47:28.349734] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T19:47:28.656687] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T19:47:28.902396] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-01T19:47:29.702428] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-01T19:47:30.502383] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-01T19:47:30.970720] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T19:47:30.997163] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T19:47:30.998874] [INFO ] [REMOTE ] KEX: Full fetch complete (55804 records). [2025-10-01T19:47:30.999125] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-01T19:47:31.307525] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-01T19:47:31.457815] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-01T19:47:31.458080] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-01T19:47:31.459114] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-01T19:47:31.459206] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-01T19:47:31.485244] [DEBUG] [LOCAL ] KEX: Trimmed 55804 records to 38135 (keeping 200 days of data) [2025-10-01T19:47:31.486544] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T19:47:31.755192] [DEBUG] [LOCAL ] KEX: Primary data saved (38135 records). [2025-10-01T19:47:31.755345] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-01T19:47:31.755431] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEX took 39.4s. Estimated remaining: 2h 47m 54s. Rate: 7.1 symbols/min [2025-10-01T19:47:31.962022] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:47:31.986096] [DEBUG] [LOCAL ] KFRC: Loaded 19559 existing records from primary storage. [2025-10-01T19:47:31.986443] [INFO ] [MAIN ] KFRC: Loaded 19559 existing records. [2025-10-01T19:47:32.107611] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-01T19:47:32.185594] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:47:32.185849] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-01T19:47:32.185912] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-01T19:47:32.186280] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-01T19:47:32.186340] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-01T19:47:32.599435] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:47:32.617587] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-01T19:47:32.902346] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-01T19:47:33.253451] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T19:47:33.702358] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-01T19:47:33.752191] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T19:47:34.502383] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-01T19:47:35.302425] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-01T19:47:35.562767] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T19:47:35.678467] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T19:47:35.729553] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T19:47:36.102387] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-01T19:47:36.540667] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T19:47:36.902385] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-01T19:47:37.702423] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-01T19:47:38.234080] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T19:47:38.235071] [INFO ] [REMOTE ] KF: Full fetch complete (3582 records). [2025-10-01T19:47:38.235172] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-01T19:47:38.504094] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-01T19:47:38.662092] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-01T19:47:38.662273] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-01T19:47:38.662539] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-01T19:47:38.663431] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-01T19:47:38.665058] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T19:47:38.675295] [DEBUG] [LOCAL ] KF: Trimmed 3582 records to 2447 (keeping 200 days of data) [2025-10-01T19:47:38.695231] [DEBUG] [LOCAL ] KF: Primary data saved (2447 records). [2025-10-01T19:47:38.695330] [INFO ] [MAIN ] KF: Full history saved. [2025-10-01T19:47:38.695415] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KF took 21.4s. Estimated remaining: 2h 47m 44s. Rate: 7.1 symbols/min [2025-10-01T19:47:38.890525] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:47:38.903900] [DEBUG] [LOCAL ] KFS: Loaded 8472 existing records from primary storage. [2025-10-01T19:47:38.904139] [INFO ] [MAIN ] KFS: Loaded 8472 existing records. [2025-10-01T19:47:39.093695] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:47:39.093935] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-01T19:47:39.094023] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-01T19:47:39.094460] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-01T19:47:39.094522] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-01T19:47:39.246466] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T19:47:39.311758] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-01T19:47:39.502469] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:47:40.102381] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-01T19:47:40.310451] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T19:47:40.902376] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-01T19:47:41.702397] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-01T19:47:41.909898] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T19:47:42.287071] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-01T19:47:42.366486] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-01T19:47:42.368154] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-01T19:47:42.368317] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-01T19:47:42.507461] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-01T19:47:42.591159] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T19:47:42.592022] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-01T19:47:42.592100] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-01T19:47:42.592212] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-01T19:47:42.592290] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-01T19:47:42.592332] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-01T19:47:42.592395] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-01T19:47:42.592502] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KEY took 46.9s. Estimated remaining: 2h 47m 31s. Rate: 7.1 symbols/min [2025-10-01T19:47:42.798409] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:47:42.831191] [DEBUG] [LOCAL ] KFY: Loaded 30083 existing records from primary storage. [2025-10-01T19:47:42.831524] [INFO ] [MAIN ] KFY: Loaded 30083 existing records. [2025-10-01T19:47:43.029895] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:47:43.030197] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-01T19:47:43.030263] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-01T19:47:43.031167] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-01T19:47:43.031240] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-01T19:47:43.310406] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-01T19:47:43.437182] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:47:44.102401] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-01T19:47:44.126560] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T19:47:44.583264] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-01T19:47:44.584836] [INFO ] [REMOTE ] KEYS: Full fetch complete (62890 records). [2025-10-01T19:47:44.584974] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-01T19:47:44.907570] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-01T19:47:45.031035] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-01T19:47:45.031125] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-01T19:47:45.032046] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-01T19:47:45.032111] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-01T19:47:45.033418] [DEBUG] [LOCAL ] KEYS: Trimmed 62890 records to 43152 (keeping 200 days of data) [2025-10-01T19:47:45.315886] [DEBUG] [LOCAL ] KEYS: Primary data saved (43152 records). [2025-10-01T19:47:45.316031] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-01T19:47:45.316159] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEYS took 42.1s. Estimated remaining: 2h 47m 16s. Rate: 7.1 symbols/min [2025-10-01T19:47:45.510115] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:47:45.566847] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-01T19:47:45.567223] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-01T19:47:45.707155] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-01T19:47:45.782600] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:47:45.794879] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-01T19:47:45.795580] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-01T19:47:45.796724] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T19:47:45.803530] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-01T19:47:45.804158] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-01T19:47:46.010165] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T19:47:46.241218] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:47:46.414861] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T19:47:46.502404] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-01T19:47:47.085456] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T19:47:47.302396] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-01T19:47:47.910689] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T19:47:48.102426] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-01T19:47:48.902405] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-01T19:47:49.641359] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-01T19:47:49.679118] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T19:47:49.702339] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-01T19:47:50.502393] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-01T19:47:51.204090] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T19:47:51.302368] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-01T19:47:51.660400] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T19:47:52.102356] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-01T19:47:52.253954] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T19:47:52.902397] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-01T19:47:53.693490] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T19:47:53.702342] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-01T19:47:53.985543] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T19:47:54.466184] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T19:47:54.502486] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-01T19:47:55.302442] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-01T19:47:55.572866] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T19:47:56.102404] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-01T19:47:56.871471] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T19:47:56.902388] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-01T19:47:57.217263] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T19:47:57.702409] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-01T19:47:58.012883] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T19:47:58.502367] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-01T19:47:59.302357] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-01T19:47:59.662699] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T19:47:59.726297] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T19:48:00.102367] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-01T19:48:00.239298] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T19:48:00.902393] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-01T19:48:01.702439] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-01T19:48:02.391278] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-01T19:48:02.426000] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-01T19:48:02.427061] [INFO ] [REMOTE ] KFRC: Full fetch complete (25622 records). [2025-10-01T19:48:02.427162] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-01T19:48:02.509559] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-01T19:48:02.898829] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-01T19:48:02.898934] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-01T19:48:02.899536] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-01T19:48:02.899580] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-01T19:48:02.900396] [DEBUG] [LOCAL ] KFRC: Trimmed 25622 records to 19595 (keeping 200 days of data) [2025-10-01T19:48:03.031511] [DEBUG] [LOCAL ] KFRC: Primary data saved (19595 records). [2025-10-01T19:48:03.031699] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-01T19:48:03.031838] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KFRC took 31.3s. Estimated remaining: 2h 47m 17s. Rate: 7.1 symbols/min [2025-10-01T19:48:03.192334] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T19:48:03.259561] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:03.303081] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-01T19:48:03.304286] [DEBUG] [LOCAL ] KGS: Loaded 45721 existing records from primary storage. [2025-10-01T19:48:03.305447] [INFO ] [MAIN ] KGS: Loaded 45721 existing records. [2025-10-01T19:48:03.510291] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:48:03.510699] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-01T19:48:03.510834] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-01T19:48:03.511304] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-01T19:48:03.511395] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-01T19:48:04.004544] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:04.102374] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-01T19:48:04.158749] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T19:48:04.194981] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T19:48:04.902378] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-01T19:48:05.459351] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T19:48:05.702390] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-01T19:48:05.715765] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T19:48:06.502424] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-01T19:48:07.302425] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-01T19:48:07.441160] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-01T19:48:07.442049] [INFO ] [REMOTE ] KFS: Full fetch complete (10568 records). [2025-10-01T19:48:07.442122] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-01T19:48:07.863944] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-01T19:48:07.864168] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-01T19:48:07.864704] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-01T19:48:07.864943] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-01T19:48:07.897614] [DEBUG] [LOCAL ] KFS: Trimmed 10568 records to 8478 (keeping 200 days of data) [2025-10-01T19:48:07.900249] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-01T19:48:07.972786] [DEBUG] [LOCAL ] KFS: Primary data saved (8478 records). [2025-10-01T19:48:07.972941] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-01T19:48:07.973029] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 29.3s. Estimated remaining: 2h 47m 5s. Rate: 7.1 symbols/min [2025-10-01T19:48:08.104629] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-01T19:48:08.241755] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:08.264808] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T19:48:08.345291] [DEBUG] [LOCAL ] KIM: Loaded 53046 existing records from primary storage. [2025-10-01T19:48:08.345804] [INFO ] [MAIN ] KIM: Loaded 53046 existing records. [2025-10-01T19:48:08.654873] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:48:08.655167] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-01T19:48:08.655242] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-01T19:48:08.655942] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-01T19:48:08.656024] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-01T19:48:08.907539] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-01T19:48:09.187289] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:09.651256] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T19:48:09.702395] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-01T19:48:10.506392] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-01T19:48:10.510963] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T19:48:11.222815] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T19:48:11.302427] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-01T19:48:12.102442] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-01T19:48:12.581231] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-01T19:48:12.639309] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T19:48:12.902385] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-01T19:48:13.655090] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T19:48:13.702358] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-01T19:48:14.019123] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T19:48:14.502451] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-01T19:48:15.302368] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-01T19:48:15.424965] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T19:48:15.499556] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T19:48:16.102425] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-01T19:48:16.902399] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-01T19:48:17.129822] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T19:48:17.702457] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-01T19:48:17.789230] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T19:48:18.502406] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-01T19:48:18.929066] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-01T19:48:19.267674] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T19:48:19.268800] [INFO ] [REMOTE ] KFY: Full fetch complete (43417 records). [2025-10-01T19:48:19.268885] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-01T19:48:19.307516] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-01T19:48:19.691622] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-01T19:48:19.691780] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-01T19:48:19.692624] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-01T19:48:19.692708] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-01T19:48:19.693717] [DEBUG] [LOCAL ] KFY: Trimmed 43417 records to 29999 (keeping 200 days of data) [2025-10-01T19:48:19.885950] [DEBUG] [LOCAL ] KFY: Primary data saved (29999 records). [2025-10-01T19:48:19.886094] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-01T19:48:19.886178] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 37.3s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-01T19:48:20.076814] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:20.103605] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T19:48:20.102559] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-01T19:48:20.131729] [DEBUG] [LOCAL ] KIO: Loaded 21369 existing records from primary storage. [2025-10-01T19:48:20.132007] [INFO ] [MAIN ] KIO: Loaded 21369 existing records. [2025-10-01T19:48:20.327619] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:48:20.327918] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-01T19:48:20.327971] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-01T19:48:20.328186] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-01T19:48:20.328245] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-01T19:48:20.713975] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:20.902388] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-01T19:48:21.075178] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T19:48:21.702385] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-01T19:48:22.120471] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T19:48:22.502387] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-01T19:48:23.179087] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T19:48:23.302362] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-01T19:48:23.433697] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (3.33 seconds). [2025-10-01T19:48:23.435507] [INFO ] [REMOTE ] KGC: Full fetch complete (77696 records). [2025-10-01T19:48:23.435626] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-01T19:48:23.906503] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-01T19:48:23.906618] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-01T19:48:23.907769] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-01T19:48:23.907866] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-01T19:48:23.909440] [DEBUG] [LOCAL ] KGC: Trimmed 77696 records to 53699 (keeping 200 days of data) [2025-10-01T19:48:24.050404] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T19:48:24.134166] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-01T19:48:24.305976] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-01T19:48:24.306194] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-01T19:48:24.306331] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGC took 39.0s. Estimated remaining: 2h 46m 48s. Rate: 7.1 symbols/min [2025-10-01T19:48:24.490902] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:24.549277] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-01T19:48:24.549633] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-10-01T19:48:24.751464] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:48:24.751871] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-01T19:48:24.751950] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-01T19:48:24.752771] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-01T19:48:24.752836] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-01T19:48:24.913155] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-01T19:48:25.104491] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T19:48:25.241783] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:25.667204] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T19:48:25.702350] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-01T19:48:26.019851] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T19:48:26.502386] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-01T19:48:27.302366] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-01T19:48:27.335628] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T19:48:28.102399] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-01T19:48:28.242946] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T19:48:28.436041] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T19:48:28.902378] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-01T19:48:29.702342] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-01T19:48:29.736542] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T19:48:30.502377] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-01T19:48:30.653786] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T19:48:31.302370] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-01T19:48:31.378967] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T19:48:31.759064] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T19:48:32.102386] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-01T19:48:32.902351] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-01T19:48:32.970808] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T19:48:33.046357] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T19:48:33.702380] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-01T19:48:34.502356] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-01T19:48:34.595962] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T19:48:34.636458] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T19:48:35.302381] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-01T19:48:36.102391] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-01T19:48:36.674707] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-01T19:48:36.676165] [INFO ] [REMOTE ] KGS: Full fetch complete (66365 records). [2025-10-01T19:48:36.676262] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-01T19:48:36.915449] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-01T19:48:37.046184] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T19:48:37.154469] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-01T19:48:37.154677] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-01T19:48:37.155684] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-01T19:48:37.155770] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-01T19:48:37.185077] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T19:48:37.196202] [DEBUG] [LOCAL ] KGS: Trimmed 66365 records to 45668 (keeping 200 days of data) [2025-10-01T19:48:37.484762] [DEBUG] [LOCAL ] KGS: Primary data saved (45668 records). [2025-10-01T19:48:37.484905] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-01T19:48:37.484988] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGS took 34.5s. Estimated remaining: 2h 46m 44s. Rate: 7.1 symbols/min [2025-10-01T19:48:37.668983] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:37.676954] [DEBUG] [LOCAL ] KKRS: Loaded 5689 existing records from primary storage. [2025-10-01T19:48:37.677160] [INFO ] [MAIN ] KKRS: Loaded 5689 existing records. [2025-10-01T19:48:37.708982] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-01T19:48:37.875998] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:48:37.876334] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-01T19:48:37.876394] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-01T19:48:37.876848] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-01T19:48:37.876909] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-01T19:48:38.268025] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:38.502403] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-01T19:48:38.655084] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T19:48:38.789208] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T19:48:39.302392] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-01T19:48:40.102401] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-01T19:48:40.178512] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T19:48:40.567238] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-01T19:48:40.902378] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-01T19:48:41.702363] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-01T19:48:41.727246] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T19:48:41.817414] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T19:48:42.355749] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-01T19:48:42.502380] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-01T19:48:43.302371] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-01T19:48:43.711917] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-01T19:48:44.102373] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-01T19:48:44.533242] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T19:48:44.902414] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-01T19:48:45.702418] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-01T19:48:45.905840] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T19:48:46.502351] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-01T19:48:46.928604] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-01T19:48:46.930387] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-01T19:48:46.942632] [INFO ] [REMOTE ] KIO: Full fetch complete (31170 records). [2025-10-01T19:48:46.943245] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-01T19:48:47.161856] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T19:48:47.307566] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-01T19:48:47.377024] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-01T19:48:47.377414] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-01T19:48:47.378268] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-01T19:48:47.378334] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-01T19:48:47.379440] [DEBUG] [LOCAL ] KIO: Trimmed 31170 records to 21220 (keeping 200 days of data) [2025-10-01T19:48:47.519147] [DEBUG] [LOCAL ] KIO: Primary data saved (21220 records). [2025-10-01T19:48:47.519283] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-01T19:48:47.519384] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIO took 27.6s. Estimated remaining: 2h 46m 37s. Rate: 7.1 symbols/min [2025-10-01T19:48:47.706121] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:47.706301] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-01T19:48:47.706351] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-01T19:48:47.706468] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-01T19:48:47.706512] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-01T19:48:47.706556] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-01T19:48:47.706622] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-01T19:48:48.105322] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-01T19:48:48.119918] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:48.607063] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T19:48:48.902374] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-01T19:48:49.636845] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T19:48:49.678804] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-01T19:48:49.681809] [INFO ] [REMOTE ] KIM: Full fetch complete (76828 records). [2025-10-01T19:48:49.682005] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-01T19:48:49.707478] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-01T19:48:50.120752] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-01T19:48:50.120857] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-01T19:48:50.121923] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-01T19:48:50.121989] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-01T19:48:50.123505] [DEBUG] [LOCAL ] KIM: Trimmed 76828 records to 53045 (keeping 200 days of data) [2025-10-01T19:48:50.471356] [DEBUG] [LOCAL ] KIM: Primary data saved (53045 records). [2025-10-01T19:48:50.471512] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-01T19:48:50.471619] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIM took 42.5s. Estimated remaining: 2h 46m 23s. Rate: 7.1 symbols/min [2025-10-01T19:48:50.507536] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-01T19:48:50.661498] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:50.661737] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-01T19:48:50.661794] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-01T19:48:50.661908] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-01T19:48:50.661951] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-01T19:48:50.661999] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-01T19:48:50.662034] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-01T19:48:50.774248] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:48:50.790199] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-01T19:48:50.822189] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:48:50.838078] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-01T19:48:50.839841] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:48:50.851254] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-01T19:48:50.859327] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-01T19:48:50.895327] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-01T19:48:50.929770] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-01T19:48:50.941765] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRT took 3.4s. Estimated remaining: 2h 46m 7s. Rate: 7.1 symbols/min [2025-10-01T19:48:51.211999] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:51.272277] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:51.302357] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-01T19:48:51.315590] [DEBUG] [LOCAL ] KLC: Loaded 36676 existing records from primary storage. [2025-10-01T19:48:51.315926] [INFO ] [MAIN ] KLC: Loaded 36676 existing records. [2025-10-01T19:48:51.518491] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:48:51.518720] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-01T19:48:51.518775] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-01T19:48:51.519279] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-01T19:48:51.519354] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-01T19:48:51.932401] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:51.961488] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-01T19:48:52.102378] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-01T19:48:52.236578] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T19:48:52.902401] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-01T19:48:53.573521] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T19:48:53.702375] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-01T19:48:54.025272] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T19:48:54.273305] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-01T19:48:54.502378] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-01T19:48:55.167083] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-01T19:48:55.302361] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-01T19:48:56.102377] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-01T19:48:56.333583] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:48:56.333929] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-01T19:48:56.334019] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:48:56.334097] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-01T19:48:56.334178] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:48:56.334259] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-01T19:48:56.334341] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-01T19:48:56.334394] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-01T19:48:56.334488] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-01T19:48:56.334586] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KLAR took 5.9s. Estimated remaining: 2h 45m 55s. Rate: 7.1 symbols/min [2025-10-01T19:48:56.523418] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:48:56.577330] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-01T19:48:56.577873] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-01T19:48:56.780791] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:48:56.781094] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-01T19:48:56.781259] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-01T19:48:56.781939] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-01T19:48:56.782008] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-01T19:48:56.906310] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-01T19:48:57.082385] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T19:48:57.213909] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:48:57.610149] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T19:48:57.702398] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-01T19:48:58.502366] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-01T19:48:59.302373] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-01T19:48:59.512291] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T19:48:59.775753] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T19:48:59.990882] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T19:48:59.991699] [INFO ] [REMOTE ] KKRS: Full fetch complete (7916 records). [2025-10-01T19:48:59.991775] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-01T19:49:00.107588] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-01T19:49:00.419313] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-01T19:49:00.419424] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-01T19:49:00.419763] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-01T19:49:00.419853] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-01T19:49:00.420449] [DEBUG] [LOCAL ] KKRS: Trimmed 7916 records to 5710 (keeping 200 days of data) [2025-10-01T19:49:00.464060] [DEBUG] [LOCAL ] KKRS: Primary data saved (5710 records). [2025-10-01T19:49:00.464221] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-01T19:49:00.464318] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KKRS took 23.0s. Estimated remaining: 2h 45m 42s. Rate: 7.1 symbols/min [2025-10-01T19:49:00.902447] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-01T19:49:01.694113] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T19:49:01.705067] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-01T19:49:02.502413] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-01T19:49:02.849130] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T19:49:03.013850] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T19:49:03.302425] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-01T19:49:04.102403] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-01T19:49:04.828481] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T19:49:04.902378] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-01T19:49:04.926312] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-01T19:49:04.928950] [INFO ] [REMOTE ] KKR: Full fetch complete (77443 records). [2025-10-01T19:49:04.929084] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-01T19:49:05.376612] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-01T19:49:05.376736] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-01T19:49:05.377828] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-01T19:49:05.377894] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-01T19:49:05.379531] [DEBUG] [LOCAL ] KKR: Trimmed 77443 records to 53500 (keeping 200 days of data) [2025-10-01T19:49:05.740911] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-10-01T19:49:05.741060] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-01T19:49:05.741145] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKR took 41.4s. Estimated remaining: 2h 45m 31s. Rate: 7.1 symbols/min [2025-10-01T19:49:06.376368] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-01T19:49:06.393359] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T19:49:06.394308] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-01T19:49:06.502393] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-01T19:49:07.959377] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T19:49:07.968252] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-01T19:49:08.058366] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T19:49:08.102347] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-01T19:49:09.256801] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T19:49:09.264073] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-01T19:49:09.467528] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T19:49:09.702422] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-01T19:49:10.187208] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T19:49:10.502429] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-01T19:49:11.854196] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-01T19:49:11.870457] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T19:49:11.870877] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-01T19:49:12.102425] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-01T19:49:13.563475] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T19:49:13.572967] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-01T19:49:13.676332] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T19:49:13.702373] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-01T19:49:15.345557] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-01T19:49:15.346961] [INFO ] [REMOTE ] KLC: Full fetch complete (50658 records). [2025-10-01T19:49:15.347105] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-01T19:49:15.568456] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T19:49:15.626008] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-01T19:49:15.857522] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-01T19:49:15.857617] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-01T19:49:15.858737] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-01T19:49:15.858807] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-01T19:49:15.860136] [DEBUG] [LOCAL ] KLC: Trimmed 50658 records to 36723 (keeping 200 days of data) [2025-10-01T19:49:16.088125] [DEBUG] [LOCAL ] KLC: Primary data saved (36723 records). [2025-10-01T19:49:16.088273] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-01T19:49:16.088358] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLC took 25.1s. Estimated remaining: 2h 45m 24s. Rate: 7.1 symbols/min [2025-10-01T19:49:17.873029] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-01T19:49:17.886942] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-01T19:49:19.924299] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T19:49:19.936530] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-01T19:49:21.610851] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T19:49:21.622831] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-01T19:49:24.117903] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-01T19:49:24.119456] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-01T19:49:24.119557] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-01T19:49:24.548976] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-01T19:49:24.549089] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-01T19:49:24.550633] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-01T19:49:24.550744] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-01T19:49:24.552358] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-10-01T19:49:24.895555] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-01T19:49:24.895727] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-01T19:49:24.895822] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KMI took 28.6s. Estimated remaining: 2h 45m 16s. Rate: 7.1 symbols/min [2025-10-01T19:49:25.535702] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:49:25.593335] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:49:25.691604] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:49:25.714858] [DEBUG] [LOCAL ] KMPB: Loaded 3749 existing records from primary storage. [2025-10-01T19:49:25.731490] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:49:25.732327] [INFO ] [MAIN ] KMPB: Loaded 3749 existing records. [2025-10-01T19:49:26.004694] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:49:26.019399] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-01T19:49:26.019561] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-01T19:49:26.022386] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-01T19:49:26.022305] [DEBUG] [LOCAL ] KMX: Loaded 53148 existing records from primary storage. [2025-10-01T19:49:26.023303] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-01T19:49:26.023496] [INFO ] [MAIN ] KMX: Loaded 53148 existing records. [2025-10-01T19:49:26.029504] [DEBUG] [LOCAL ] KMT: Loaded 42940 existing records from primary storage. [2025-10-01T19:49:26.069679] [INFO ] [MAIN ] KMT: Loaded 42940 existing records. [2025-10-01T19:49:26.179122] [DEBUG] [LOCAL ] KMPR: Loaded 38781 existing records from primary storage. [2025-10-01T19:49:26.215812] [INFO ] [MAIN ] KMPR: Loaded 38781 existing records. [2025-10-01T19:49:26.774051] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:49:26.867515] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:49:26.872869] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-01T19:49:26.884455] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-01T19:49:26.884590] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-01T19:49:26.936793] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-01T19:49:26.955876] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-01T19:49:26.979440] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-01T19:49:26.979522] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-01T19:49:26.991726] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-01T19:49:27.064197] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:49:27.109702] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-01T19:49:27.163443] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:49:27.192073] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-01T19:49:27.197474] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-01T19:49:27.291779] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-01T19:49:27.307560] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-01T19:49:27.970573] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-01T19:49:27.972505] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-01T19:49:28.245628] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:49:28.239200] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:49:28.251303] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-01T19:49:28.274560] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-01T19:49:28.366794] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:49:28.367558] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-01T19:49:28.524939] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T19:49:28.526190] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-01T19:49:28.979710] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-01T19:49:28.980959] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-01T19:49:29.456135] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T19:49:29.457985] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-01T19:49:29.486835] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T19:49:29.492777] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-01T19:49:29.815970] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T19:49:29.824629] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-01T19:49:29.928664] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T19:49:29.930865] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-01T19:49:29.934773] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T19:49:29.946947] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-01T19:49:30.258784] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-01T19:49:30.260097] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-01T19:49:30.450834] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T19:49:30.456691] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-01T19:49:30.828081] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-01T19:49:30.830162] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-01T19:49:31.233175] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T19:49:31.242065] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-01T19:49:31.302250] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T19:49:31.308775] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-01T19:49:31.358419] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T19:49:31.359830] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-01T19:49:31.493205] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T19:49:31.695115] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-01T19:49:32.102349] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-01T19:49:32.640068] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-01T19:49:32.705949] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:49:32.781795] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T19:49:32.902385] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-01T19:49:33.702384] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-01T19:49:34.243523] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T19:49:34.502383] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-01T19:49:35.101409] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T19:49:35.178468] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T19:49:35.179214] [INFO ] [REMOTE ] KMPB: Full fetch complete (5131 records). [2025-10-01T19:49:35.179285] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-01T19:49:35.307452] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-01T19:49:35.566072] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-01T19:49:35.566159] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-01T19:49:35.566322] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-01T19:49:35.566362] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-01T19:49:35.566821] [DEBUG] [LOCAL ] KMPB: Trimmed 5131 records to 3780 (keeping 200 days of data) [2025-10-01T19:49:35.603127] [DEBUG] [LOCAL ] KMPB: Primary data saved (3780 records). [2025-10-01T19:49:35.603304] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-01T19:49:35.603435] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 10.7s. Estimated remaining: 2h 45m 10s. Rate: 7.1 symbols/min [2025-10-01T19:49:35.794968] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:49:35.845359] [DEBUG] [LOCAL ] KN: Loaded 38575 existing records from primary storage. [2025-10-01T19:49:35.845674] [INFO ] [MAIN ] KN: Loaded 38575 existing records. [2025-10-01T19:49:36.030721] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:49:36.030944] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-01T19:49:36.030991] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-01T19:49:36.031510] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-01T19:49:36.031572] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-01T19:49:36.110204] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-01T19:49:36.434747] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:49:36.897499] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T19:49:36.906970] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-01T19:49:37.517673] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T19:49:37.702379] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-01T19:49:38.507463] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-01T19:49:38.522015] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T19:49:39.118751] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:49:39.302376] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-01T19:49:39.885743] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T19:49:40.102378] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-01T19:49:40.688972] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T19:49:40.902384] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-01T19:49:41.450224] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T19:49:41.702371] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-01T19:49:42.502375] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-01T19:49:42.753349] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T19:49:42.801182] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T19:49:43.302345] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-01T19:49:43.525126] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T19:49:44.102376] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-01T19:49:44.456406] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T19:49:44.902384] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-01T19:49:45.544308] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T19:49:45.702449] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-01T19:49:46.105925] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T19:49:46.502385] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-01T19:49:47.302361] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-01T19:49:47.445085] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T19:49:47.864859] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T19:49:48.102402] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-01T19:49:48.579182] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-01T19:49:48.902385] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-01T19:49:49.702408] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-01T19:49:50.133606] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-01T19:49:50.135041] [INFO ] [REMOTE ] KMPR: Full fetch complete (51422 records). [2025-10-01T19:49:50.135124] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-01T19:49:50.507184] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-01T19:49:50.571243] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-01T19:49:50.571699] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-01T19:49:50.572726] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-01T19:49:50.572839] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-01T19:49:50.574512] [DEBUG] [LOCAL ] KMPR: Trimmed 51422 records to 38886 (keeping 200 days of data) [2025-10-01T19:49:50.708590] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T19:49:50.866843] [DEBUG] [LOCAL ] KMPR: Primary data saved (38886 records). [2025-10-01T19:49:50.867000] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-01T19:49:50.867091] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 26.0s. Estimated remaining: 2h 45m 8s. Rate: 7.1 symbols/min [2025-10-01T19:49:51.055118] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:49:51.093229] [DEBUG] [LOCAL ] KNF: Loaded 35821 existing records from primary storage. [2025-10-01T19:49:51.093628] [INFO ] [MAIN ] KNF: Loaded 35821 existing records. [2025-10-01T19:49:51.309680] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:49:51.310487] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-01T19:49:51.312165] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T19:49:51.304248] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-01T19:49:51.313136] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-01T19:49:51.322272] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-01T19:49:51.322937] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-01T19:49:51.712277] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:49:52.087155] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T19:49:52.102352] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-01T19:49:52.902442] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-01T19:49:53.061524] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T19:49:53.576988] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T19:49:53.702433] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-01T19:49:54.205456] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T19:49:54.502387] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-01T19:49:54.629694] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T19:49:55.302423] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-01T19:49:56.102404] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-01T19:49:56.507935] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T19:49:56.591198] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-01T19:49:56.592946] [INFO ] [REMOTE ] KMT: Full fetch complete (62060 records). [2025-10-01T19:49:56.593047] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-01T19:49:56.907610] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-01T19:49:57.023309] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-01T19:49:57.023389] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-01T19:49:57.024439] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-01T19:49:57.024508] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-01T19:49:57.025855] [DEBUG] [LOCAL ] KMT: Trimmed 62060 records to 42939 (keeping 200 days of data) [2025-10-01T19:49:57.302731] [DEBUG] [LOCAL ] KMT: Primary data saved (42939 records). [2025-10-01T19:49:57.302843] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-01T19:49:57.302927] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 32.4s. Estimated remaining: 2h 44m 57s. Rate: 7.1 symbols/min [2025-10-01T19:49:57.511869] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:49:57.524794] [DEBUG] [LOCAL ] KNOP: Loaded 10406 existing records from primary storage. [2025-10-01T19:49:57.525018] [INFO ] [MAIN ] KNOP: Loaded 10406 existing records. [2025-10-01T19:49:57.706496] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-01T19:49:57.718114] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T19:49:57.758520] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:49:57.759758] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-01T19:49:57.759816] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-01T19:49:57.760001] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-01T19:49:57.760061] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-01T19:49:58.162207] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:49:58.253266] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T19:49:58.502405] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-01T19:49:59.302362] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-01T19:49:59.394310] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T19:49:59.606356] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-01T19:50:00.102448] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-01T19:50:00.779371] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T19:50:00.902359] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-01T19:50:00.954786] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:50:01.702437] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-01T19:50:02.069382] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T19:50:02.502398] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-01T19:50:03.302422] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-01T19:50:03.543175] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T19:50:03.600973] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T19:50:04.102389] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-01T19:50:04.731401] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T19:50:04.902384] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-01T19:50:05.621753] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T19:50:05.702363] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-01T19:50:05.839512] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T19:50:06.502453] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-01T19:50:07.105366] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T19:50:07.182123] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T19:50:07.302373] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-01T19:50:08.102400] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-01T19:50:08.902393] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-01T19:50:09.174825] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-01T19:50:09.176415] [INFO ] [REMOTE ] KN: Full fetch complete (56419 records). [2025-10-01T19:50:09.176558] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-01T19:50:09.609177] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-01T19:50:09.609266] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-01T19:50:09.610166] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-01T19:50:09.610233] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-01T19:50:09.611475] [DEBUG] [LOCAL ] KN: Trimmed 56419 records to 38555 (keeping 200 days of data) [2025-10-01T19:50:09.704183] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-01T19:50:09.829090] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-01T19:50:09.865839] [DEBUG] [LOCAL ] KN: Primary data saved (38555 records). [2025-10-01T19:50:09.865980] [INFO ] [MAIN ] KN: Full history saved. [2025-10-01T19:50:09.866063] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KN took 34.3s. Estimated remaining: 2h 44m 53s. Rate: 7.1 symbols/min [2025-10-01T19:50:10.051987] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:50:10.073019] [DEBUG] [LOCAL ] KNSL: Loaded 18106 existing records from primary storage. [2025-10-01T19:50:10.073268] [INFO ] [MAIN ] KNSL: Loaded 18106 existing records. [2025-10-01T19:50:10.269206] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:50:10.269490] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-01T19:50:10.269583] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-01T19:50:10.270045] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-01T19:50:10.270106] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-01T19:50:10.507835] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-01T19:50:10.670451] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:50:11.013073] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T19:50:11.061420] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (2.96 seconds). [2025-10-01T19:50:11.063389] [INFO ] [REMOTE ] KMX: Full fetch complete (76013 records). [2025-10-01T19:50:11.063497] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-01T19:50:11.308463] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-01T19:50:11.502783] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-01T19:50:11.510958] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T19:50:11.510609] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-01T19:50:11.515050] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-01T19:50:11.515596] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-01T19:50:11.517260] [DEBUG] [LOCAL ] KMX: Trimmed 76013 records to 53161 (keeping 200 days of data) [2025-10-01T19:50:11.853154] [DEBUG] [LOCAL ] KMX: Primary data saved (53161 records). [2025-10-01T19:50:11.853302] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-01T19:50:11.853391] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 46.9s. Estimated remaining: 2h 44m 38s. Rate: 7.1 symbols/min [2025-10-01T19:50:12.035696] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:50:12.084981] [DEBUG] [LOCAL ] KNTK: Loaded 46115 existing records from primary storage. [2025-10-01T19:50:12.085356] [INFO ] [MAIN ] KNTK: Loaded 46115 existing records. [2025-10-01T19:50:12.107636] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-01T19:50:12.290498] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:50:12.290771] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-01T19:50:12.290824] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-01T19:50:12.291378] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-01T19:50:12.291444] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-01T19:50:12.686272] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:50:12.817827] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T19:50:12.902413] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-01T19:50:12.947271] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T19:50:13.702393] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-01T19:50:14.316291] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T19:50:14.502427] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-01T19:50:15.236377] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T19:50:15.302370] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-01T19:50:16.091218] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T19:50:16.102326] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-01T19:50:16.340838] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T19:50:16.902386] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-01T19:50:17.640722] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T19:50:17.702404] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-01T19:50:18.062821] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T19:50:18.491682] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T19:50:18.502339] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-01T19:50:19.303943] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-01T19:50:19.306733] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T19:50:20.102368] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-01T19:50:20.489858] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T19:50:20.902413] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-01T19:50:21.204347] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T19:50:21.702369] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-01T19:50:22.011173] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T19:50:22.378623] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T19:50:22.502379] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-01T19:50:23.302392] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-01T19:50:23.974576] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T19:50:24.102412] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-01T19:50:24.471938] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T19:50:24.902390] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-01T19:50:25.318525] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T19:50:25.702378] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-01T19:50:26.502392] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-01T19:50:26.805300] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-01T19:50:26.806661] [INFO ] [REMOTE ] KNF: Full fetch complete (50787 records). [2025-10-01T19:50:26.806750] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-01T19:50:27.246170] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-01T19:50:27.246385] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-01T19:50:27.247490] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-01T19:50:27.247887] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-01T19:50:27.249539] [DEBUG] [LOCAL ] KNF: Trimmed 50787 records to 35852 (keeping 200 days of data) [2025-10-01T19:50:27.324054] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-01T19:50:27.365475] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T19:50:27.512240] [DEBUG] [LOCAL ] KNF: Primary data saved (35852 records). [2025-10-01T19:50:27.512415] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-01T19:50:27.512518] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KNF took 36.6s. Estimated remaining: 2h 44m 37s. Rate: 7.1 symbols/min [2025-10-01T19:50:27.684931] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T19:50:27.748611] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:50:27.804388] [DEBUG] [LOCAL ] KNX: Loaded 52592 existing records from primary storage. [2025-10-01T19:50:27.804775] [INFO ] [MAIN ] KNX: Loaded 52592 existing records. [2025-10-01T19:50:28.007080] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:50:28.007321] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-01T19:50:28.007372] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-01T19:50:28.008271] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-01T19:50:28.008364] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-01T19:50:28.107503] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-01T19:50:28.408011] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:50:28.411756] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T19:50:28.412930] [INFO ] [REMOTE ] KNOP: Full fetch complete (14788 records). [2025-10-01T19:50:28.413016] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-01T19:50:28.849029] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-01T19:50:28.849235] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-01T19:50:28.849691] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-01T19:50:28.849758] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-01T19:50:28.850324] [DEBUG] [LOCAL ] KNOP: Trimmed 14788 records to 10442 (keeping 200 days of data) [2025-10-01T19:50:28.902606] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-01T19:50:28.919967] [DEBUG] [LOCAL ] KNOP: Primary data saved (10442 records). [2025-10-01T19:50:28.920122] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-01T19:50:28.920260] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNOP took 31.6s. Estimated remaining: 2h 44m 21s. Rate: 7.1 symbols/min [2025-10-01T19:50:29.117227] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:50:29.117542] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-01T19:50:29.117737] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-01T19:50:29.118023] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-01T19:50:29.123340] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-01T19:50:29.131203] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-01T19:50:29.131859] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-01T19:50:29.132719] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T19:50:29.549709] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:50:29.702394] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-01T19:50:30.460580] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T19:50:30.502345] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-01T19:50:31.302390] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-01T19:50:31.816957] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T19:50:32.102360] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-01T19:50:32.205194] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T19:50:32.824001] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T19:50:32.875092] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T19:50:32.902388] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-01T19:50:33.702381] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-01T19:50:34.502365] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-01T19:50:34.604974] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T19:50:35.302385] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-01T19:50:36.099815] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-01T19:50:36.110203] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-01T19:50:36.144859] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T19:50:36.211077] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T19:50:36.902410] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-01T19:50:37.699220] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T19:50:37.710272] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-01T19:50:38.502384] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-01T19:50:38.638368] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T19:50:38.721452] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T19:50:39.302379] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-01T19:50:40.102354] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-01T19:50:40.177748] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T19:50:40.819296] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T19:50:40.902370] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-01T19:50:41.492951] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-01T19:50:41.494038] [INFO ] [REMOTE ] KNSL: Full fetch complete (26640 records). [2025-10-01T19:50:41.494118] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-01T19:50:41.708061] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-01T19:50:41.914966] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-01T19:50:41.915056] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-01T19:50:41.915719] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-01T19:50:41.915784] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-01T19:50:41.916670] [DEBUG] [LOCAL ] KNSL: Trimmed 26640 records to 18181 (keeping 200 days of data) [2025-10-01T19:50:42.037365] [DEBUG] [LOCAL ] KNSL: Primary data saved (18181 records). [2025-10-01T19:50:42.037514] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-01T19:50:42.037602] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNSL took 32.2s. Estimated remaining: 2h 44m 17s. Rate: 7.1 symbols/min [2025-10-01T19:50:42.224769] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:50:42.269457] [DEBUG] [LOCAL ] KODK: Loaded 43436 existing records from primary storage. [2025-10-01T19:50:42.269813] [INFO ] [MAIN ] KODK: Loaded 43436 existing records. [2025-10-01T19:50:42.474694] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:50:42.475105] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-01T19:50:42.475165] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-01T19:50:42.475628] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-01T19:50:42.475723] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-01T19:50:42.508675] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-01T19:50:42.919074] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:50:42.921753] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-01T19:50:43.302423] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-01T19:50:44.007176] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-01T19:50:44.102382] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-01T19:50:44.136812] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T19:50:44.702593] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T19:50:44.902394] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-01T19:50:45.702392] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-01T19:50:46.502357] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-01T19:50:46.554049] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T19:50:46.914697] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-10-01T19:50:47.302416] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-01T19:50:47.754245] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-01T19:50:47.755748] [INFO ] [REMOTE ] KNTK: Full fetch complete (64593 records). [2025-10-01T19:50:47.755838] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-01T19:50:48.108624] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-01T19:50:48.194983] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-01T19:50:48.195570] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-01T19:50:48.196768] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-01T19:50:48.196863] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-01T19:50:48.223783] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T19:50:48.222302] [DEBUG] [LOCAL ] KNTK: Trimmed 64593 records to 46161 (keeping 200 days of data) [2025-10-01T19:50:48.528071] [DEBUG] [LOCAL ] KNTK: Primary data saved (46161 records). [2025-10-01T19:50:48.528215] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-01T19:50:48.528310] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNTK took 36.7s. Estimated remaining: 2h 44m 7s. Rate: 7.1 symbols/min [2025-10-01T19:50:48.711559] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:50:48.738471] [DEBUG] [LOCAL ] KOF: Loaded 26038 existing records from primary storage. [2025-10-01T19:50:48.738759] [INFO ] [MAIN ] KOF: Loaded 26038 existing records. [2025-10-01T19:50:48.908334] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-01T19:50:48.946076] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:50:48.946450] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-01T19:50:48.946519] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-01T19:50:48.946845] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-01T19:50:48.946907] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-01T19:50:49.346152] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:50:49.702368] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-01T19:50:50.049734] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T19:50:50.122594] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-01T19:50:50.387700] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T19:50:50.512348] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-01T19:50:50.518591] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T19:50:51.302399] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-01T19:50:52.107539] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-01T19:50:52.134801] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T19:50:52.902446] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-01T19:50:53.287700] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-01T19:50:53.607467] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T19:50:53.702419] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-01T19:50:54.249449] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T19:50:54.502401] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-01T19:50:55.302422] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-01T19:50:56.048166] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T19:50:56.102356] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-01T19:50:56.257562] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-01T19:50:56.842328] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T19:50:56.902418] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-01T19:50:56.929880] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T19:50:57.702428] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-01T19:50:58.502364] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-01T19:50:58.570396] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T19:50:58.805228] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T19:50:59.302391] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-01T19:51:00.102356] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-01T19:51:00.194401] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T19:51:00.902447] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-01T19:51:01.105863] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-01T19:51:01.702449] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-01T19:51:01.887308] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T19:51:02.502411] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-01T19:51:03.095910] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-01T19:51:03.097524] [INFO ] [REMOTE ] KNX: Full fetch complete (75768 records). [2025-10-01T19:51:03.097635] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-01T19:51:03.315487] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-01T19:51:03.537367] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-01T19:51:03.537557] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-01T19:51:03.538931] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-01T19:51:03.539005] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-01T19:51:03.543465] [DEBUG] [LOCAL ] KNX: Trimmed 75768 records to 52589 (keeping 200 days of data) [2025-10-01T19:51:03.664070] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T19:51:03.917431] [DEBUG] [LOCAL ] KNX: Primary data saved (52589 records). [2025-10-01T19:51:03.917603] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-01T19:51:03.917836] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNX took 36.4s. Estimated remaining: 2h 44m 5s. Rate: 7.1 symbols/min [2025-10-01T19:51:04.107022] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:51:04.103149] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-01T19:51:04.146443] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-01T19:51:04.169706] [DEBUG] [LOCAL ] KOP: Loaded 17616 existing records from primary storage. [2025-10-01T19:51:04.169949] [INFO ] [MAIN ] KOP: Loaded 17616 existing records. [2025-10-01T19:51:04.361085] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:51:04.361305] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-01T19:51:04.361360] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-01T19:51:04.361740] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-01T19:51:04.361804] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-01T19:51:04.823950] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:51:04.873554] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T19:51:04.902370] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-01T19:51:05.692904] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T19:51:05.702326] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-01T19:51:06.103567] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T19:51:06.502356] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-01T19:51:06.760888] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T19:51:07.302386] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-01T19:51:08.102390] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-01T19:51:08.902377] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-01T19:51:08.934391] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T19:51:09.035520] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-01T19:51:09.352300] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T19:51:09.702360] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-01T19:51:09.916970] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T19:51:10.502400] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-01T19:51:11.182270] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T19:51:11.302395] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-01T19:51:11.986202] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T19:51:12.087811] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-01T19:51:12.088985] [INFO ] [REMOTE ] KOF: Full fetch complete (37206 records). [2025-10-01T19:51:12.089110] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-01T19:51:12.111323] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-01T19:51:12.486713] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-01T19:51:12.486809] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-01T19:51:12.487484] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-01T19:51:12.487525] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-01T19:51:12.488558] [DEBUG] [LOCAL ] KOF: Trimmed 37206 records to 26133 (keeping 200 days of data) [2025-10-01T19:51:12.659844] [DEBUG] [LOCAL ] KOF: Primary data saved (26133 records). [2025-10-01T19:51:12.659986] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-01T19:51:12.660088] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KOF took 24.1s. Estimated remaining: 2h 43m 57s. Rate: 7.1 symbols/min [2025-10-01T19:51:12.848941] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:51:12.854296] [DEBUG] [LOCAL ] KORE: Loaded 1997 existing records from primary storage. [2025-10-01T19:51:12.854549] [INFO ] [MAIN ] KORE: Loaded 1997 existing records. [2025-10-01T19:51:12.907537] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-01T19:51:13.064180] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:51:13.064417] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-01T19:51:13.064468] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-01T19:51:13.064744] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-01T19:51:13.064805] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-01T19:51:13.452932] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:51:13.478008] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T19:51:13.702416] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-01T19:51:14.049154] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T19:51:14.502408] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-01T19:51:15.302407] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-01T19:51:15.576237] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-01T19:51:15.577741] [INFO ] [REMOTE ] KODK: Full fetch complete (63475 records). [2025-10-01T19:51:15.577962] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-01T19:51:15.801250] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T19:51:16.067508] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-01T19:51:16.067598] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-01T19:51:16.068612] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-01T19:51:16.068713] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-01T19:51:16.070148] [DEBUG] [LOCAL ] KODK: Trimmed 63475 records to 43459 (keeping 200 days of data) [2025-10-01T19:51:16.118778] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-01T19:51:16.335158] [DEBUG] [LOCAL ] KODK: Primary data saved (43459 records). [2025-10-01T19:51:16.335314] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-01T19:51:16.335423] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 34.3s. Estimated remaining: 2h 43m 44s. Rate: 7.1 symbols/min [2025-10-01T19:51:16.529636] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:51:16.580502] [DEBUG] [LOCAL ] KOS: Loaded 53049 existing records from primary storage. [2025-10-01T19:51:16.580991] [INFO ] [MAIN ] KOS: Loaded 53049 existing records. [2025-10-01T19:51:16.769340] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:51:16.769565] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-01T19:51:16.769614] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-01T19:51:16.770824] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-01T19:51:16.770894] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-01T19:51:16.924034] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-01T19:51:17.165087] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:51:17.178828] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T19:51:17.702419] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-01T19:51:17.956693] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T19:51:18.502420] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-01T19:51:18.603143] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (3.30 seconds). [2025-10-01T19:51:18.605285] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-01T19:51:18.605428] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-01T19:51:18.833162] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T19:51:18.834171] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-01T19:51:18.834248] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-01T19:51:18.834325] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-01T19:51:18.834398] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-01T19:51:18.834437] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-01T19:51:18.834515] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-01T19:51:18.834625] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KO took 49.9s. Estimated remaining: 2h 43m 30s. Rate: 7.1 symbols/min [2025-10-01T19:51:19.033032] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:51:19.074516] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T19:51:19.134037] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-01T19:51:19.134376] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-01T19:51:19.308535] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-01T19:51:19.345010] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:51:19.351704] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-01T19:51:19.354544] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T19:51:19.354244] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-01T19:51:19.359040] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-01T19:51:19.359113] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-01T19:51:19.757367] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:51:20.102428] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-01T19:51:20.902361] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-01T19:51:21.030792] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T19:51:21.702348] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-01T19:51:21.762131] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T19:51:21.782779] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T19:51:22.502388] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-01T19:51:23.302393] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-01T19:51:23.384422] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T19:51:23.815767] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-01T19:51:24.102409] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-01T19:51:24.362864] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-01T19:51:24.499928] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-01T19:51:24.902383] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-01T19:51:25.277540] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-01T19:51:25.702398] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-01T19:51:26.502380] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-01T19:51:26.649787] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T19:51:27.302396] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-01T19:51:27.629959] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-01T19:51:28.102391] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-01T19:51:28.300107] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T19:51:28.843954] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T19:51:28.902355] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-01T19:51:29.702440] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-01T19:51:30.502368] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-01T19:51:30.621263] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T19:51:30.755085] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T19:51:31.302427] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-01T19:51:31.412994] [DEBUG] [REMOTE ] KORE: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-01T19:51:31.413421] [WARN ] [REMOTE ] KORE: No data returned for month 2025-06 [2025-10-01T19:51:31.413538] [FATAL] [REMOTE ] KORE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:51:31.413683] [FATAL] [MAIN ] KORE: Failed to fetch primary data. [2025-10-01T19:51:31.413770] [WARN ] [MAIN ] KORE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:51:31.413859] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-01T19:51:31.413961] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-01T19:51:31.414034] [INFO ] [LOCAL ] KORE: Starting deletion of derivative data. [2025-10-01T19:51:31.414543] [DEBUG] [LOCAL ] KORE: Deleted derivative data file. [2025-10-01T19:51:31.414691] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KORE took 18.8s. Estimated remaining: 2h 43m 25s. Rate: 7.1 symbols/min [2025-10-01T19:51:31.605113] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:51:31.658482] [DEBUG] [LOCAL ] KRC: Loaded 48305 existing records from primary storage. [2025-10-01T19:51:31.658988] [INFO ] [MAIN ] KRC: Loaded 48305 existing records. [2025-10-01T19:51:31.861125] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:51:31.861431] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-01T19:51:31.861488] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-01T19:51:31.862298] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-01T19:51:31.862362] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-01T19:51:32.102870] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-01T19:51:32.277730] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:51:32.305867] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T19:51:32.902408] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-01T19:51:33.702390] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-01T19:51:33.929468] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T19:51:34.349119] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T19:51:34.502381] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-01T19:51:35.302381] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-01T19:51:35.520209] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T19:51:35.521201] [INFO ] [REMOTE ] KOP: Full fetch complete (25465 records). [2025-10-01T19:51:35.521271] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-01T19:51:35.989745] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-01T19:51:35.989958] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-01T19:51:35.991001] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-01T19:51:35.991279] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-01T19:51:35.993536] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-01T19:51:36.006245] [DEBUG] [LOCAL ] KOP: Trimmed 25465 records to 17610 (keeping 200 days of data) [2025-10-01T19:51:36.102440] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-01T19:51:36.127431] [DEBUG] [LOCAL ] KOP: Primary data saved (17610 records). [2025-10-01T19:51:36.127566] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-01T19:51:36.127682] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOP took 32.2s. Estimated remaining: 2h 43m 13s. Rate: 7.1 symbols/min [2025-10-01T19:51:36.315629] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:51:36.352119] [DEBUG] [LOCAL ] KREF: Loaded 37396 existing records from primary storage. [2025-10-01T19:51:36.352850] [INFO ] [MAIN ] KREF: Loaded 37396 existing records. [2025-10-01T19:51:36.548003] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:51:36.548364] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-01T19:51:36.548436] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-01T19:51:36.548821] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-01T19:51:36.548881] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-01T19:51:36.915847] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-01T19:51:36.961256] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:51:36.992586] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T19:51:37.702355] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-01T19:51:37.878628] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T19:51:38.502375] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-01T19:51:38.919913] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-01T19:51:39.248802] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T19:51:39.302351] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-01T19:51:40.102362] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-01T19:51:40.303691] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T19:51:40.753775] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T19:51:40.902410] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-01T19:51:41.702389] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-01T19:51:41.860532] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T19:51:42.035078] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T19:51:42.502443] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-01T19:51:43.307477] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-01T19:51:43.324355] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T19:51:44.102390] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-01T19:51:44.493418] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-01T19:51:44.902378] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-01T19:51:45.066022] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T19:51:45.702420] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-01T19:51:45.855331] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T19:51:46.385731] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T19:51:46.502378] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-01T19:51:47.302374] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-01T19:51:47.343734] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T19:51:47.716293] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T19:51:48.102402] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-01T19:51:48.902388] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-01T19:51:49.273622] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T19:51:49.398303] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T19:51:49.702386] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-01T19:51:50.100054] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T19:51:50.502404] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-01T19:51:51.089303] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T19:51:51.302414] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-01T19:51:51.568044] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T19:51:52.102408] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-01T19:51:52.902444] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-01T19:51:53.534184] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T19:51:53.702495] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-01T19:51:53.783529] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-01T19:51:53.785796] [INFO ] [REMOTE ] KOS: Full fetch complete (76847 records). [2025-10-01T19:51:53.786015] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-01T19:51:54.278223] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-01T19:51:54.278312] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-01T19:51:54.279404] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-01T19:51:54.279473] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-01T19:51:54.281290] [DEBUG] [LOCAL ] KOS: Trimmed 76847 records to 53059 (keeping 200 days of data) [2025-10-01T19:51:54.502555] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-01T19:51:54.608615] [DEBUG] [LOCAL ] KOS: Primary data saved (53059 records). [2025-10-01T19:51:54.608791] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-01T19:51:54.608883] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KOS took 38.3s. Estimated remaining: 2h 43m 14s. Rate: 7.1 symbols/min [2025-10-01T19:51:54.816409] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:51:54.883423] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T19:51:54.913475] [DEBUG] [LOCAL ] KRG: Loaded 49160 existing records from primary storage. [2025-10-01T19:51:54.913842] [INFO ] [MAIN ] KRG: Loaded 49160 existing records. [2025-10-01T19:51:55.136199] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T19:51:55.139917] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:51:55.148522] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-01T19:51:55.148587] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-01T19:51:55.149260] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-01T19:51:55.149353] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-01T19:51:55.312599] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-01T19:51:55.556230] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:51:56.102386] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-01T19:51:56.202588] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T19:51:56.588880] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T19:51:56.902424] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-01T19:51:57.497447] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T19:51:57.702396] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-01T19:51:58.505381] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-01T19:51:58.514358] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T19:51:58.574955] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T19:51:59.302422] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-01T19:51:59.742244] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T19:52:00.102416] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-01T19:52:00.902451] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-01T19:52:01.589881] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-01T19:52:01.702363] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-01T19:52:01.880073] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T19:52:02.226070] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T19:52:02.502382] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-01T19:52:03.302361] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-01T19:52:04.102401] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-01T19:52:04.454571] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-01T19:52:04.456217] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-10-01T19:52:04.456350] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-01T19:52:04.546923] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-01T19:52:04.586679] [INFO ] [REMOTE ] KREF: Full fetch complete (52470 records). [2025-10-01T19:52:04.612888] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-01T19:52:05.141221] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-01T19:52:05.187501] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-01T19:52:05.194428] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-01T19:52:05.202291] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-01T19:52:05.317394] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T19:52:05.322771] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 53681 (keeping 200 days of data) [2025-10-01T19:52:05.450735] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-01T19:52:05.530455] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-01T19:52:05.531407] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-01T19:52:05.532584] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-01T19:52:05.534405] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-01T19:52:05.544815] [DEBUG] [LOCAL ] KREF: Trimmed 52470 records to 37580 (keeping 200 days of data) [2025-10-01T19:52:05.925599] [DEBUG] [LOCAL ] KREF: Primary data saved (37580 records). [2025-10-01T19:52:05.926815] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-01T19:52:05.926928] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KREF took 29.8s. Estimated remaining: 2h 43m 8s. Rate: 7.1 symbols/min [2025-10-01T19:52:06.201693] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:06.213404] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-01T19:52:06.218728] [INFO ] [REMOTE ] KRC: Full fetch complete (69832 records). [2025-10-01T19:52:06.219542] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-01T19:52:06.218877] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-01T19:52:06.220850] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-01T19:52:06.227607] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-01T19:52:06.229620] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-01T19:52:06.248758] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-01T19:52:06.260722] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-01T19:52:06.303996] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-01T19:52:06.319731] [INFO ] [MAIN ] KR: Full history saved. [2025-10-01T19:52:06.319884] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KR took 47.5s. Estimated remaining: 2h 42m 52s. Rate: 7.1 symbols/min [2025-10-01T19:52:06.783626] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:07.118201] [DEBUG] [LOCAL ] KRO: Loaded 26036 existing records from primary storage. [2025-10-01T19:52:07.168042] [INFO ] [MAIN ] KRO: Loaded 26036 existing records. [2025-10-01T19:52:07.300807] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-01T19:52:07.359894] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-01T19:52:07.378191] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-01T19:52:07.393018] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-01T19:52:07.463276] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:07.482255] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-01T19:52:07.495531] [DEBUG] [LOCAL ] KRC: Trimmed 69832 records to 48262 (keeping 200 days of data) [2025-10-01T19:52:07.662347] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-01T19:52:07.740063] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:52:07.745790] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:52:07.748907] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-01T19:52:07.749694] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-01T19:52:07.750128] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-01T19:52:07.750952] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-01T19:52:07.750443] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:52:07.751107] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-01T19:52:07.752594] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-01T19:52:07.756119] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-01T19:52:07.757192] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:52:07.763809] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-01T19:52:07.781909] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-01T19:52:07.787891] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-01T19:52:07.802147] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-01T19:52:07.803439] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRMN took 1.9s. Estimated remaining: 2h 42m 37s. Rate: 7.1 symbols/min [2025-10-01T19:52:08.253722] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:08.548348] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:08.549561] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-01T19:52:08.586185] [DEBUG] [LOCAL ] KRP: Loaded 37125 existing records from primary storage. [2025-10-01T19:52:08.587236] [INFO ] [MAIN ] KRP: Loaded 37125 existing records. [2025-10-01T19:52:08.794262] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:52:08.795224] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-01T19:52:08.795870] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-01T19:52:08.797270] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-01T19:52:08.797334] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-01T19:52:09.257901] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:09.259696] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-01T19:52:09.277145] [DEBUG] [LOCAL ] KRC: Primary data saved (48262 records). [2025-10-01T19:52:09.277321] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-01T19:52:09.277464] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRC took 37.9s. Estimated remaining: 2h 42m 22s. Rate: 7.1 symbols/min [2025-10-01T19:52:09.482704] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:09.514986] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T19:52:09.526622] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-01T19:52:09.572450] [DEBUG] [LOCAL ] KSS: Loaded 53603 existing records from primary storage. [2025-10-01T19:52:09.572862] [INFO ] [MAIN ] KSS: Loaded 53603 existing records. [2025-10-01T19:52:09.769777] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T19:52:09.795913] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-01T19:52:09.799509] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:52:09.800558] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-01T19:52:09.800612] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-01T19:52:09.801251] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-01T19:52:09.801412] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-01T19:52:10.230950] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:10.502472] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-01T19:52:10.619043] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T19:52:10.640230] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T19:52:11.170195] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T19:52:11.302415] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-01T19:52:12.102363] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-01T19:52:12.306216] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T19:52:12.560865] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T19:52:12.902413] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-01T19:52:13.702388] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-01T19:52:13.858355] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T19:52:14.047067] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T19:52:14.502411] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-01T19:52:15.302400] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-01T19:52:15.630257] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T19:52:15.961817] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:52:16.102368] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-01T19:52:16.429214] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T19:52:16.902392] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-01T19:52:17.702382] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-01T19:52:18.044929] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-01T19:52:18.502390] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-01T19:52:18.861483] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-01T19:52:19.092003] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T19:52:19.302426] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-01T19:52:20.102354] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-01T19:52:20.304947] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T19:52:20.902368] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-01T19:52:20.933112] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T19:52:21.702388] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-01T19:52:22.074317] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T19:52:22.234202] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T19:52:22.502418] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-01T19:52:23.302393] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-01T19:52:23.495390] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T19:52:23.673768] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-01T19:52:23.678009] [INFO ] [REMOTE ] KRG: Full fetch complete (71105 records). [2025-10-01T19:52:23.678152] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-01T19:52:24.117497] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-01T19:52:24.113764] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-01T19:52:24.118625] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-01T19:52:24.119945] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-01T19:52:24.120105] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-01T19:52:24.121749] [DEBUG] [LOCAL ] KRG: Trimmed 71105 records to 49159 (keeping 200 days of data) [2025-10-01T19:52:24.457759] [DEBUG] [LOCAL ] KRG: Primary data saved (49159 records). [2025-10-01T19:52:24.457950] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-01T19:52:24.458064] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRG took 29.8s. Estimated remaining: 2h 42m 20s. Rate: 7.1 symbols/min [2025-10-01T19:52:24.649712] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:24.697205] [DEBUG] [LOCAL ] KT: Loaded 45663 existing records from primary storage. [2025-10-01T19:52:24.697535] [INFO ] [MAIN ] KT: Loaded 45663 existing records. [2025-10-01T19:52:24.919012] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-01T19:52:24.926290] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:52:24.927688] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-01T19:52:24.927867] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-01T19:52:24.928709] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-01T19:52:24.928778] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-01T19:52:25.308668] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T19:52:25.415623] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:25.432420] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T19:52:25.702384] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-01T19:52:26.461075] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T19:52:26.502393] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-01T19:52:27.004985] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-01T19:52:27.302410] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-01T19:52:28.108584] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-01T19:52:28.114824] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T19:52:28.770107] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T19:52:28.902379] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-01T19:52:29.194731] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T19:52:29.702380] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-01T19:52:30.121960] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T19:52:30.502350] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-01T19:52:31.302366] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-01T19:52:31.758216] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-01T19:52:31.838336] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T19:52:32.102374] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-01T19:52:32.672435] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-01T19:52:32.673772] [INFO ] [REMOTE ] KRO: Full fetch complete (34937 records). [2025-10-01T19:52:32.673851] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-01T19:52:32.910963] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-01T19:52:33.081963] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-01T19:52:33.082046] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-01T19:52:33.082733] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-01T19:52:33.082796] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-01T19:52:33.083712] [DEBUG] [LOCAL ] KRO: Trimmed 34937 records to 26074 (keeping 200 days of data) [2025-10-01T19:52:33.245733] [DEBUG] [LOCAL ] KRO: Primary data saved (26074 records). [2025-10-01T19:52:33.245875] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-01T19:52:33.245967] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRO took 26.9s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-01T19:52:33.429250] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:33.466612] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T19:52:33.517156] [DEBUG] [LOCAL ] KTB: Loaded 41051 existing records from primary storage. [2025-10-01T19:52:33.517503] [INFO ] [MAIN ] KTB: Loaded 41051 existing records. [2025-10-01T19:52:33.709272] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-01T19:52:33.746927] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:52:33.747147] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-01T19:52:33.747204] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-01T19:52:33.747825] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-01T19:52:33.747886] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-01T19:52:34.175077] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:34.390612] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T19:52:34.502379] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-01T19:52:35.302380] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-01T19:52:35.573016] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T19:52:35.963385] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T19:52:36.102395] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-01T19:52:36.658429] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T19:52:36.902397] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-01T19:52:37.702381] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-01T19:52:37.985852] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T19:52:38.086808] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-01T19:52:38.502374] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-01T19:52:39.063602] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T19:52:39.302380] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-01T19:52:40.102375] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-01T19:52:40.129237] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-01T19:52:40.130670] [INFO ] [REMOTE ] KRP: Full fetch complete (54901 records). [2025-10-01T19:52:40.130762] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-01T19:52:40.534983] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-01T19:52:40.535064] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-01T19:52:40.535906] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-01T19:52:40.535970] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-01T19:52:40.537106] [DEBUG] [LOCAL ] KRP: Trimmed 54901 records to 37049 (keeping 200 days of data) [2025-10-01T19:52:40.782393] [DEBUG] [LOCAL ] KRP: Primary data saved (37049 records). [2025-10-01T19:52:40.782547] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-01T19:52:40.782634] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 33.0s. Estimated remaining: 2h 42m 2s. Rate: 7.1 symbols/min [2025-10-01T19:52:40.908740] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-01T19:52:40.970958] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:41.003023] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T19:52:41.024593] [DEBUG] [LOCAL ] KTF: Loaded 12688 existing records from primary storage. [2025-10-01T19:52:41.024873] [INFO ] [MAIN ] KTF: Loaded 12688 existing records. [2025-10-01T19:52:41.229495] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:52:41.229785] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-01T19:52:41.229850] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-01T19:52:41.230099] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-01T19:52:41.230160] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-01T19:52:41.658286] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:41.702359] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-01T19:52:41.985246] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T19:52:42.198692] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-01T19:52:42.502383] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-01T19:52:43.246997] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:52:43.302393] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-01T19:52:44.102359] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-01T19:52:44.219489] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T19:52:44.828458] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-01T19:52:44.902384] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-01T19:52:45.558755] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:52:45.702448] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-01T19:52:46.502369] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-01T19:52:46.534442] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T19:52:46.782327] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T19:52:47.050097] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T19:52:47.302456] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-01T19:52:48.102427] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-01T19:52:48.756602] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T19:52:48.902412] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-01T19:52:49.614849] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-01T19:52:49.702350] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-01T19:52:50.113701] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T19:52:50.502372] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-01T19:52:50.866473] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T19:52:51.302390] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-01T19:52:52.102361] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-01T19:52:52.376183] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T19:52:52.902410] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-01T19:52:53.042953] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-01T19:52:53.044765] [INFO ] [REMOTE ] KSS: Full fetch complete (77635 records). [2025-10-01T19:52:53.044927] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-01T19:52:53.493468] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-01T19:52:53.493640] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-01T19:52:53.494945] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-01T19:52:53.495039] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-01T19:52:53.522171] [DEBUG] [LOCAL ] KSS: Trimmed 77635 records to 53603 (keeping 200 days of data) [2025-10-01T19:52:53.524009] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T19:52:53.667076] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T19:52:53.733600] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-01T19:52:53.895828] [DEBUG] [LOCAL ] KSS: Primary data saved (53603 records). [2025-10-01T19:52:53.895987] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-01T19:52:53.896077] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KSS took 44.6s. Estimated remaining: 2h 41m 58s. Rate: 7.1 symbols/min [2025-10-01T19:52:54.090681] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:52:54.090879] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-01T19:52:54.090919] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-01T19:52:54.091034] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-01T19:52:54.091079] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-01T19:52:54.091122] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-01T19:52:54.091160] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-01T19:52:54.509074] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-01T19:52:54.515525] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:52:54.526822] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T19:52:55.302424] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-01T19:52:56.003074] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-01T19:52:56.091208] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T19:52:56.102334] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-01T19:52:56.902406] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-01T19:52:57.327489] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T19:52:57.702362] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-01T19:52:57.887553] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T19:52:58.268238] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-01T19:52:58.502373] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-01T19:52:59.302355] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-01T19:52:59.374440] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T19:53:00.102449] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-01T19:53:00.122692] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T19:53:00.902356] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-01T19:53:01.069790] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T19:53:01.702397] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-01T19:53:02.502399] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-01T19:53:02.661277] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T19:53:02.662107] [INFO ] [REMOTE ] KTF: Full fetch complete (17879 records). [2025-10-01T19:53:02.662178] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-01T19:53:03.067331] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-01T19:53:03.067410] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-01T19:53:03.067827] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-01T19:53:03.067890] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-01T19:53:03.068411] [DEBUG] [LOCAL ] KTF: Trimmed 17879 records to 12567 (keeping 200 days of data) [2025-10-01T19:53:03.127132] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-01T19:53:03.131363] [INFO ] [REMOTE ] KT: Full fetch complete (66687 records). [2025-10-01T19:53:03.132051] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-01T19:53:03.315228] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-01T19:53:03.492197] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T19:53:03.575032] [DEBUG] [LOCAL ] KTF: Primary data saved (12567 records). [2025-10-01T19:53:03.599978] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-01T19:53:03.621964] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-01T19:53:03.605575] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KTF took 22.8s. Estimated remaining: 2h 41m 51s. Rate: 7.1 symbols/min [2025-10-01T19:53:03.622184] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-01T19:53:03.682234] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-01T19:53:03.705421] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-01T19:53:03.766845] [DEBUG] [LOCAL ] KT: Trimmed 66687 records to 45686 (keeping 200 days of data) [2025-10-01T19:53:03.834737] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:53:03.992584] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-01T19:53:03.994027] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-01T19:53:04.168975] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-01T19:53:04.303033] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:53:04.304604] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-01T19:53:04.304712] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-01T19:53:04.305513] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-01T19:53:04.305580] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-01T19:53:04.749859] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:53:04.806242] [DEBUG] [LOCAL ] KT: Primary data saved (45686 records). [2025-10-01T19:53:04.806462] [INFO ] [MAIN ] KT: Full history saved. [2025-10-01T19:53:04.806566] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KT took 40.3s. Estimated remaining: 2h 41m 36s. Rate: 7.1 symbols/min [2025-10-01T19:53:04.912169] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-01T19:53:04.955008] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T19:53:04.956938] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T19:53:05.045995] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:53:05.090827] [DEBUG] [LOCAL ] KVYO: Loaded 50023 existing records from primary storage. [2025-10-01T19:53:05.091141] [INFO ] [MAIN ] KVYO: Loaded 50023 existing records. [2025-10-01T19:53:05.287910] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:53:05.288133] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-01T19:53:05.288181] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-01T19:53:05.288755] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-01T19:53:05.288816] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-01T19:53:05.696395] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:53:05.702371] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-01T19:53:06.502384] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-01T19:53:06.787454] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T19:53:07.278278] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T19:53:07.302372] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-01T19:53:08.107536] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-01T19:53:08.112857] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T19:53:08.609951] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T19:53:08.902416] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-01T19:53:09.330791] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T19:53:09.673070] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T19:53:09.702332] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-01T19:53:10.502408] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-01T19:53:11.012755] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T19:53:11.302389] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-01T19:53:12.102398] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-01T19:53:12.397601] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T19:53:12.534961] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T19:53:12.889413] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T19:53:12.902339] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-01T19:53:13.702378] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-01T19:53:14.003232] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-01T19:53:14.502446] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-01T19:53:14.719859] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T19:53:15.302388] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-01T19:53:15.728459] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T19:53:16.102380] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-01T19:53:16.706442] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T19:53:16.902353] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-01T19:53:17.031591] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T19:53:17.702392] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-01T19:53:18.502358] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-01T19:53:18.558500] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T19:53:18.689794] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T19:53:19.302384] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-01T19:53:19.905947] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T19:53:20.102416] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-01T19:53:20.521420] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T19:53:20.522326] [INFO ] [REMOTE ] KUKE: Full fetch complete (8433 records). [2025-10-01T19:53:20.522411] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-01T19:53:20.718453] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T19:53:20.718739] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-01T19:53:20.718817] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-01T19:53:20.718897] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-01T19:53:20.718965] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-01T19:53:20.719004] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-01T19:53:20.719046] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-01T19:53:20.719106] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KUKE took 26.8s. Estimated remaining: 2h 41m 34s. Rate: 7.1 symbols/min [2025-10-01T19:53:20.900912] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:53:20.902414] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-01T19:53:20.942895] [DEBUG] [LOCAL ] KW: Loaded 40564 existing records from primary storage. [2025-10-01T19:53:20.943250] [INFO ] [MAIN ] KW: Loaded 40564 existing records. [2025-10-01T19:53:21.147495] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:53:21.147820] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-01T19:53:21.147883] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-01T19:53:21.148455] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-01T19:53:21.148527] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-01T19:53:21.570715] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:53:21.702378] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-01T19:53:21.923360] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T19:53:22.502373] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-01T19:53:22.872431] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-01T19:53:22.873878] [INFO ] [REMOTE ] KTB: Full fetch complete (57859 records). [2025-10-01T19:53:22.873972] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-01T19:53:23.304516] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-01T19:53:23.305088] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-01T19:53:23.306288] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-01T19:53:23.307349] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-01T19:53:23.307560] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-01T19:53:23.308992] [DEBUG] [LOCAL ] KTB: Trimmed 57859 records to 41046 (keeping 200 days of data) [2025-10-01T19:53:23.457370] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T19:53:23.625556] [DEBUG] [LOCAL ] KTB: Primary data saved (41046 records). [2025-10-01T19:53:23.625713] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-01T19:53:23.625842] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KTB took 50.4s. Estimated remaining: 2h 41m 20s. Rate: 7.1 symbols/min [2025-10-01T19:53:23.813889] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:53:23.832840] [DEBUG] [LOCAL ] KWR: Loaded 16599 existing records from primary storage. [2025-10-01T19:53:23.833087] [INFO ] [MAIN ] KWR: Loaded 16599 existing records. [2025-10-01T19:53:24.038005] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:53:24.038504] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-01T19:53:24.038565] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-01T19:53:24.038783] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-01T19:53:24.038843] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-01T19:53:24.110857] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-01T19:53:24.464502] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-01T19:53:24.523832] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:53:24.547734] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T19:53:24.902374] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-01T19:53:25.702414] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-01T19:53:25.789055] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T19:53:25.979371] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T19:53:26.502398] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-01T19:53:26.703270] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T19:53:27.302384] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-01T19:53:28.100795] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T19:53:28.110332] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-01T19:53:28.449752] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T19:53:28.902377] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-01T19:53:29.702356] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-01T19:53:30.060963] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T19:53:30.349487] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T19:53:30.511985] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-01T19:53:30.540605] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T19:53:31.302382] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-01T19:53:31.825546] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T19:53:32.102382] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-01T19:53:32.743663] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T19:53:32.902382] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-01T19:53:33.702360] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-01T19:53:33.961722] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T19:53:33.999561] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T19:53:34.502358] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-01T19:53:34.710538] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T19:53:35.302375] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-01T19:53:36.102376] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-01T19:53:36.703534] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-01T19:53:36.902375] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-01T19:53:37.604566] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T19:53:37.607351] [INFO ] [REMOTE ] KVYO: Full fetch complete (71596 records). [2025-10-01T19:53:37.607839] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-01T19:53:37.694109] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T19:53:37.707161] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-01T19:53:38.253215] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-01T19:53:38.253328] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-01T19:53:38.254508] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-01T19:53:38.254578] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-01T19:53:38.256194] [DEBUG] [LOCAL ] KVYO: Trimmed 71596 records to 50071 (keeping 200 days of data) [2025-10-01T19:53:38.502395] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-01T19:53:38.559146] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T19:53:38.598285] [DEBUG] [LOCAL ] KVYO: Primary data saved (50071 records). [2025-10-01T19:53:38.598434] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-01T19:53:38.598521] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KVYO took 33.8s. Estimated remaining: 2h 41m 18s. Rate: 7.1 symbols/min [2025-10-01T19:53:38.794975] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:53:38.829017] [DEBUG] [LOCAL ] KYN: Loaded 30028 existing records from primary storage. [2025-10-01T19:53:38.829381] [INFO ] [MAIN ] KYN: Loaded 30028 existing records. [2025-10-01T19:53:39.036772] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:53:39.037063] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-01T19:53:39.037122] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-01T19:53:39.037685] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-01T19:53:39.037746] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-01T19:53:39.309045] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-01T19:53:39.425575] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:53:40.042019] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:53:40.093788] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (3.19 seconds). [2025-10-01T19:53:40.095383] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-10-01T19:53:40.095507] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-01T19:53:40.108051] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-01T19:53:40.493807] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T19:53:40.590197] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-01T19:53:40.590290] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-01T19:53:40.591477] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-01T19:53:40.591557] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-01T19:53:40.593475] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 53667 (keeping 200 days of data) [2025-10-01T19:53:40.918078] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-01T19:53:40.947554] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-01T19:53:40.947715] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-01T19:53:40.947838] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KVUE took 37.3s. Estimated remaining: 2h 41m 4s. Rate: 7.1 symbols/min [2025-10-01T19:53:41.144142] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:53:41.189639] [DEBUG] [LOCAL ] L: Loaded 40964 existing records from primary storage. [2025-10-01T19:53:41.190064] [INFO ] [MAIN ] L: Loaded 40964 existing records. [2025-10-01T19:53:41.363561] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T19:53:41.439839] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:53:41.440081] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-01T19:53:41.440133] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-01T19:53:41.440729] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-01T19:53:41.440795] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-01T19:53:41.707638] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-01T19:53:41.856215] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:53:41.909400] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T19:53:42.502398] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-01T19:53:43.256776] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T19:53:43.302344] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-01T19:53:43.554371] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T19:53:44.102400] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-01T19:53:44.594708] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T19:53:44.807091] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T19:53:44.902381] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-01T19:53:45.702394] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-01T19:53:46.425407] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T19:53:46.502354] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-01T19:53:46.833292] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T19:53:47.302442] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-01T19:53:47.328480] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T19:53:48.102388] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-01T19:53:48.521630] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T19:53:48.902384] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-01T19:53:49.178867] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T19:53:49.179799] [INFO ] [REMOTE ] KWR: Full fetch complete (23934 records). [2025-10-01T19:53:49.179896] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-01T19:53:49.609123] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-01T19:53:49.609204] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-01T19:53:49.609796] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-01T19:53:49.609859] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-01T19:53:49.610599] [DEBUG] [LOCAL ] KWR: Trimmed 23934 records to 16535 (keeping 200 days of data) [2025-10-01T19:53:49.702503] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-01T19:53:49.718838] [DEBUG] [LOCAL ] KWR: Primary data saved (16535 records). [2025-10-01T19:53:49.719113] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-01T19:53:49.719212] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KWR took 26.1s. Estimated remaining: 2h 40m 56s. Rate: 7.1 symbols/min [2025-10-01T19:53:49.903084] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:53:49.954209] [DEBUG] [LOCAL ] LAC: Loaded 52329 existing records from primary storage. [2025-10-01T19:53:49.954566] [INFO ] [MAIN ] LAC: Loaded 52329 existing records. [2025-10-01T19:53:50.153297] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:53:50.153538] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-01T19:53:50.153671] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-01T19:53:50.154471] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-01T19:53:50.154538] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-01T19:53:50.502782] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-01T19:53:50.597888] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T19:53:50.608233] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:53:50.870200] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T19:53:51.302399] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-01T19:53:51.843170] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T19:53:52.102381] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-01T19:53:52.731174] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T19:53:52.902398] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-01T19:53:53.702397] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-01T19:53:54.256800] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-01T19:53:54.379356] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T19:53:54.502405] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-01T19:53:55.172743] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T19:53:55.302424] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-01T19:53:56.102369] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-01T19:53:56.268961] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T19:53:56.534970] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-01T19:53:56.902435] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-01T19:53:57.600121] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T19:53:57.702401] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-01T19:53:58.102082] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T19:53:58.502378] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-01T19:53:59.288591] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T19:53:59.302348] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-01T19:54:00.107445] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-01T19:54:00.121910] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T19:54:00.902368] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-01T19:54:01.305566] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T19:54:01.702406] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-01T19:54:02.072916] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T19:54:02.101617] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-01T19:54:02.103015] [INFO ] [REMOTE ] KW: Full fetch complete (57060 records). [2025-10-01T19:54:02.103103] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-01T19:54:02.513066] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-01T19:54:02.516187] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-01T19:54:02.516267] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-01T19:54:02.518121] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-01T19:54:02.518317] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-01T19:54:02.519571] [DEBUG] [LOCAL ] KW: Trimmed 57060 records to 40529 (keeping 200 days of data) [2025-10-01T19:54:02.767914] [DEBUG] [LOCAL ] KW: Primary data saved (40529 records). [2025-10-01T19:54:02.768055] [INFO ] [MAIN ] KW: Full history saved. [2025-10-01T19:54:02.768172] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KW took 42.0s. Estimated remaining: 2h 40m 51s. Rate: 7.1 symbols/min [2025-10-01T19:54:02.949463] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:02.974111] [DEBUG] [LOCAL ] LAD: Loaded 23493 existing records from primary storage. [2025-10-01T19:54:02.974368] [INFO ] [MAIN ] LAD: Loaded 23493 existing records. [2025-10-01T19:54:03.171252] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:03.171627] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-01T19:54:03.171773] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-01T19:54:03.172573] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-01T19:54:03.172681] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-01T19:54:03.306662] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-01T19:54:03.567734] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:03.598278] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T19:54:04.102383] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-01T19:54:04.169214] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T19:54:04.723565] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T19:54:04.902386] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-01T19:54:05.702346] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-01T19:54:05.989003] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T19:54:06.140408] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T19:54:06.502391] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-01T19:54:07.059249] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T19:54:07.302400] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-01T19:54:07.471014] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T19:54:08.102378] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-01T19:54:08.306026] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T19:54:08.902394] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-01T19:54:09.615603] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T19:54:09.616965] [INFO ] [REMOTE ] KYN: Full fetch complete (44599 records). [2025-10-01T19:54:09.617066] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-01T19:54:09.707528] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-01T19:54:10.071054] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-01T19:54:10.071242] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-01T19:54:10.072128] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-01T19:54:10.072211] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-01T19:54:10.073320] [DEBUG] [LOCAL ] KYN: Trimmed 44599 records to 30010 (keeping 200 days of data) [2025-10-01T19:54:10.212271] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T19:54:10.293482] [DEBUG] [LOCAL ] KYN: Primary data saved (30010 records). [2025-10-01T19:54:10.293619] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-01T19:54:10.293734] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KYN took 31.7s. Estimated remaining: 2h 40m 42s. Rate: 7.1 symbols/min [2025-10-01T19:54:10.478516] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:10.502685] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-01T19:54:10.520860] [DEBUG] [LOCAL ] LADR: Loaded 38698 existing records from primary storage. [2025-10-01T19:54:10.521182] [INFO ] [MAIN ] LADR: Loaded 38698 existing records. [2025-10-01T19:54:10.729923] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:10.730253] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-01T19:54:10.730329] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-01T19:54:10.731057] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-01T19:54:10.731119] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-01T19:54:11.123614] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:11.302460] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-01T19:54:11.428861] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T19:54:11.620816] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T19:54:12.102387] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-01T19:54:12.801452] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T19:54:12.902371] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-01T19:54:13.334217] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T19:54:13.702408] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-01T19:54:14.502420] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-01T19:54:15.120487] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-01T19:54:15.159308] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T19:54:15.302380] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-01T19:54:15.971371] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T19:54:16.102371] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-01T19:54:16.430184] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T19:54:16.902354] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-01T19:54:17.238476] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T19:54:17.702390] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-01T19:54:18.502383] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-01T19:54:18.762967] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T19:54:19.203691] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-01T19:54:19.205542] [INFO ] [REMOTE ] L: Full fetch complete (59549 records). [2025-10-01T19:54:19.205661] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-01T19:54:19.307511] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-01T19:54:19.646347] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-01T19:54:19.646463] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-01T19:54:19.647557] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-01T19:54:19.647664] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-01T19:54:19.671806] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T19:54:19.679284] [DEBUG] [LOCAL ] L: Trimmed 59549 records to 40991 (keeping 200 days of data) [2025-10-01T19:54:19.955876] [DEBUG] [LOCAL ] L: Primary data saved (40991 records). [2025-10-01T19:54:19.956012] [INFO ] [MAIN ] L: Full history saved. [2025-10-01T19:54:19.956130] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. L took 39.0s. Estimated remaining: 2h 40m 35s. Rate: 7.1 symbols/min [2025-10-01T19:54:20.113978] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-01T19:54:20.153018] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:20.160339] [DEBUG] [LOCAL ] LANV: Loaded 2826 existing records from primary storage. [2025-10-01T19:54:20.161108] [INFO ] [MAIN ] LANV: Loaded 2826 existing records. [2025-10-01T19:54:20.387225] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:20.387458] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-01T19:54:20.387511] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-01T19:54:20.387791] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-01T19:54:20.387879] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-01T19:54:20.768527] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T19:54:20.856211] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:20.902360] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-01T19:54:21.484351] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-01T19:54:21.702372] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-01T19:54:22.101860] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-01T19:54:22.502400] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-01T19:54:22.692536] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T19:54:23.302381] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-01T19:54:23.524795] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T19:54:23.868315] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T19:54:24.102400] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-01T19:54:24.902384] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-01T19:54:25.359038] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T19:54:25.702380] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-01T19:54:26.242869] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T19:54:26.502416] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-01T19:54:27.010991] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-01T19:54:27.302414] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-01T19:54:27.931094] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-01T19:54:28.102377] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-01T19:54:28.832456] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T19:54:28.902355] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-01T19:54:29.702381] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-01T19:54:30.162620] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T19:54:30.345044] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:54:30.502377] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-01T19:54:30.928008] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-01T19:54:31.128616] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-01T19:54:31.130243] [INFO ] [REMOTE ] LAC: Full fetch complete (75979 records). [2025-10-01T19:54:31.130364] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-01T19:54:31.307523] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-01T19:54:31.591957] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-01T19:54:31.592061] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-01T19:54:31.593175] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-01T19:54:31.593276] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-01T19:54:31.594838] [DEBUG] [LOCAL ] LAC: Trimmed 75979 records to 52362 (keeping 200 days of data) [2025-10-01T19:54:31.914265] [DEBUG] [LOCAL ] LAC: Primary data saved (52362 records). [2025-10-01T19:54:31.914425] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-01T19:54:31.914546] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAC took 42.2s. Estimated remaining: 2h 40m 29s. Rate: 7.1 symbols/min [2025-10-01T19:54:32.104531] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-01T19:54:32.104433] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:32.105961] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-01T19:54:32.106031] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-01T19:54:32.106147] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-01T19:54:32.106190] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-01T19:54:32.106234] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-01T19:54:32.106281] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-01T19:54:32.508275] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:32.727235] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:54:32.902395] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-01T19:54:33.255013] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-01T19:54:33.462662] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T19:54:33.463906] [INFO ] [REMOTE ] LAD: Full fetch complete (35456 records). [2025-10-01T19:54:33.463986] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-01T19:54:33.712260] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-01T19:54:33.892389] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-01T19:54:33.892487] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-01T19:54:33.893169] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-01T19:54:33.893232] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-01T19:54:33.894234] [DEBUG] [LOCAL ] LAD: Trimmed 35456 records to 23471 (keeping 200 days of data) [2025-10-01T19:54:33.985881] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T19:54:33.994367] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-01T19:54:33.997477] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T19:54:33.998672] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-01T19:54:34.000882] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T19:54:34.005180] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-01T19:54:34.011725] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-01T19:54:34.020926] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-01T19:54:34.029666] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-01T19:54:34.040577] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAR took 2.1s. Estimated remaining: 2h 40m 15s. Rate: 7.1 symbols/min [2025-10-01T19:54:34.221999] [DEBUG] [LOCAL ] LAD: Primary data saved (23471 records). [2025-10-01T19:54:34.224047] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-01T19:54:34.242574] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAD took 31.5s. Estimated remaining: 2h 39m 59s. Rate: 7.1 symbols/min [2025-10-01T19:54:34.244222] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:34.260699] [DEBUG] [LOCAL ] LAW: Loaded 13998 existing records from primary storage. [2025-10-01T19:54:34.261050] [INFO ] [MAIN ] LAW: Loaded 13998 existing records. [2025-10-01T19:54:34.474341] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:34.474610] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-01T19:54:34.474706] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-01T19:54:34.474966] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-01T19:54:34.475040] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-01T19:54:34.507526] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-01T19:54:34.895831] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:35.009198] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-01T19:54:35.302382] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-01T19:54:35.675156] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-01T19:54:36.102382] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-01T19:54:36.638334] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T19:54:36.902375] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-01T19:54:37.542290] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T19:54:37.702388] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-01T19:54:38.502359] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-01T19:54:38.718615] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T19:54:39.302372] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-01T19:54:40.105329] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-01T19:54:40.105261] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-01T19:54:40.108770] [INFO ] [REMOTE ] LANV: Full fetch complete (4443 records). [2025-10-01T19:54:40.109686] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-01T19:54:40.183788] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:54:40.532220] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-01T19:54:40.532357] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-01T19:54:40.532563] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-01T19:54:40.532663] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-01T19:54:40.533145] [DEBUG] [LOCAL ] LANV: Trimmed 4443 records to 2826 (keeping 200 days of data) [2025-10-01T19:54:40.552681] [DEBUG] [LOCAL ] LANV: Primary data saved (2826 records). [2025-10-01T19:54:40.552810] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-01T19:54:40.552930] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LANV took 20.6s. Estimated remaining: 2h 39m 49s. Rate: 7.1 symbols/min [2025-10-01T19:54:40.902413] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-01T19:54:40.938723] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T19:54:41.702387] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-01T19:54:41.988318] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T19:54:42.502387] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-01T19:54:42.604864] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T19:54:43.302440] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-01T19:54:44.009703] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T19:54:44.014584] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T19:54:44.102366] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-01T19:54:44.902389] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-01T19:54:45.715790] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T19:54:45.719190] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-01T19:54:46.181489] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-01T19:54:46.183002] [INFO ] [REMOTE ] LADR: Full fetch complete (55436 records). [2025-10-01T19:54:46.183099] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-01T19:54:46.602212] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-01T19:54:46.602332] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-01T19:54:46.613212] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-01T19:54:46.613609] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T19:54:46.613851] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-01T19:54:46.618282] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-01T19:54:46.619974] [DEBUG] [LOCAL ] LADR: Trimmed 55436 records to 38885 (keeping 200 days of data) [2025-10-01T19:54:46.893374] [DEBUG] [LOCAL ] LADR: Primary data saved (38885 records). [2025-10-01T19:54:46.893530] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-01T19:54:46.893623] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LADR took 36.6s. Estimated remaining: 2h 39m 38s. Rate: 7.1 symbols/min [2025-10-01T19:54:47.598224] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T19:54:47.604242] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-01T19:54:48.569355] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T19:54:48.573303] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-01T19:54:49.495162] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T19:54:49.501282] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-01T19:54:50.483507] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T19:54:50.487599] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-01T19:54:51.617775] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T19:54:51.618788] [INFO ] [REMOTE ] LAW: Full fetch complete (20492 records). [2025-10-01T19:54:51.618862] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-01T19:54:52.022667] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-01T19:54:52.022761] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-01T19:54:52.023194] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-01T19:54:52.023237] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-01T19:54:52.023873] [DEBUG] [LOCAL ] LAW: Trimmed 20492 records to 14021 (keeping 200 days of data) [2025-10-01T19:54:52.109391] [DEBUG] [LOCAL ] LAW: Primary data saved (14021 records). [2025-10-01T19:54:52.109557] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-01T19:54:52.109667] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAW took 18.1s. Estimated remaining: 2h 39m 27s. Rate: 7.1 symbols/min [2025-10-01T19:54:52.798425] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:52.824294] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:52.850224] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:52.934486] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:54:53.013405] [DEBUG] [LOCAL ] LBRT: Loaded 52915 existing records from primary storage. [2025-10-01T19:54:53.024558] [INFO ] [MAIN ] LBRT: Loaded 52915 existing records. [2025-10-01T19:54:53.014558] [DEBUG] [LOCAL ] LAZ: Loaded 44962 existing records from primary storage. [2025-10-01T19:54:53.043460] [INFO ] [MAIN ] LAZ: Loaded 44962 existing records. [2025-10-01T19:54:53.080430] [DEBUG] [LOCAL ] LB: Loaded 37689 existing records from primary storage. [2025-10-01T19:54:53.149878] [INFO ] [MAIN ] LB: Loaded 37689 existing records. [2025-10-01T19:54:53.338583] [DEBUG] [LOCAL ] LC: Loaded 47854 existing records from primary storage. [2025-10-01T19:54:53.426148] [INFO ] [MAIN ] LC: Loaded 47854 existing records. [2025-10-01T19:54:53.599748] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:53.664697] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:53.707783] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-01T19:54:53.738939] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-01T19:54:53.733692] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-01T19:54:53.744258] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-01T19:54:53.766594] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-01T19:54:53.777125] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-01T19:54:53.794326] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:53.835776] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-01T19:54:53.835562] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-01T19:54:53.841126] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-01T19:54:53.846291] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-01T19:54:53.890918] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-01T19:54:53.953806] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-01T19:54:54.122432] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:54:54.167104] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-01T19:54:54.226904] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-01T19:54:54.383950] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-01T19:54:54.479049] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-01T19:54:55.125199] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:55.210547] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-01T19:54:55.411134] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:55.379579] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:55.430638] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-01T19:54:55.438994] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-01T19:54:55.579714] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:54:55.580102] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-01T19:54:56.636366] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T19:54:56.645588] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-01T19:54:57.036403] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T19:54:57.047585] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-01T19:54:57.073755] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T19:54:57.084054] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-01T19:54:57.269217] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T19:54:57.280144] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-01T19:54:58.216115] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T19:54:58.230435] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-01T19:54:58.596551] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T19:54:58.605854] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-01T19:54:58.844048] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T19:54:58.855220] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-01T19:54:59.113525] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-01T19:54:59.302345] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-01T19:54:59.643952] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T19:54:59.735166] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T19:55:00.102390] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-01T19:55:00.508478] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T19:55:00.902440] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-01T19:55:01.069300] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T19:55:01.702378] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-01T19:55:01.748700] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T19:55:02.502428] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-01T19:55:02.809233] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T19:55:03.020097] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T19:55:03.302433] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-01T19:55:03.948729] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T19:55:04.102397] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-01T19:55:04.902350] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-01T19:55:05.050919] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:55:05.617838] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T19:55:05.702372] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-01T19:55:06.502408] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-01T19:55:06.650797] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:55:07.242332] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T19:55:07.302423] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-01T19:55:08.102382] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-01T19:55:08.290984] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T19:55:08.739428] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:55:08.902394] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-01T19:55:09.699935] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T19:55:09.709323] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-01T19:55:10.364366] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T19:55:10.502386] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-01T19:55:10.854252] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T19:55:11.302378] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-01T19:55:11.926987] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T19:55:12.102422] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-01T19:55:12.852673] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T19:55:12.902338] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-01T19:55:13.510806] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T19:55:13.702402] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-01T19:55:14.072908] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T19:55:14.502419] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-01T19:55:15.302421] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-01T19:55:15.565905] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T19:55:15.984909] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T19:55:16.102390] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-01T19:55:16.891590] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T19:55:16.902340] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-01T19:55:17.702401] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-01T19:55:17.856714] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T19:55:18.450035] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T19:55:18.502399] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-01T19:55:19.302394] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-01T19:55:19.516320] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T19:55:20.110842] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-01T19:55:20.116554] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T19:55:20.606748] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T19:55:20.902391] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-01T19:55:21.702398] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-01T19:55:21.965128] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-01T19:55:21.966850] [INFO ] [REMOTE ] LB: Full fetch complete (55913 records). [2025-10-01T19:55:21.967018] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-01T19:55:22.395917] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-01T19:55:22.396025] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-01T19:55:22.397011] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-01T19:55:22.397093] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-01T19:55:22.398619] [DEBUG] [LOCAL ] LB: Trimmed 55913 records to 37751 (keeping 200 days of data) [2025-10-01T19:55:22.502986] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-01T19:55:22.655282] [DEBUG] [LOCAL ] LB: Primary data saved (37751 records). [2025-10-01T19:55:22.655458] [INFO ] [MAIN ] LB: Full history saved. [2025-10-01T19:55:22.655572] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LB took 30.5s. Estimated remaining: 2h 39m 38s. Rate: 7.1 symbols/min [2025-10-01T19:55:22.890935] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:55:22.926769] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T19:55:22.963515] [DEBUG] [LOCAL ] LCII: Loaded 28110 existing records from primary storage. [2025-10-01T19:55:22.963844] [INFO ] [MAIN ] LCII: Loaded 28110 existing records. [2025-10-01T19:55:23.157235] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:55:23.157491] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-01T19:55:23.157543] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-01T19:55:23.157949] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-01T19:55:23.158010] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-01T19:55:23.307491] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-01T19:55:23.558413] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:55:23.783473] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-01T19:55:23.785128] [INFO ] [REMOTE ] LAZ: Full fetch complete (65844 records). [2025-10-01T19:55:23.785230] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-01T19:55:24.107542] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-01T19:55:24.221611] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-01T19:55:24.221755] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-01T19:55:24.222788] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-01T19:55:24.222857] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-01T19:55:24.224973] [DEBUG] [LOCAL ] LAZ: Trimmed 65844 records to 44922 (keeping 200 days of data) [2025-10-01T19:55:24.522425] [DEBUG] [LOCAL ] LAZ: Primary data saved (44922 records). [2025-10-01T19:55:24.522584] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-01T19:55:24.522699] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 32.4s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-01T19:55:24.625282] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-01T19:55:24.656322] [INFO ] [REMOTE ] LC: Full fetch complete (70563 records). [2025-10-01T19:55:24.657008] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-01T19:55:24.833312] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:55:25.141829] [DEBUG] [LOCAL ] LDI: Loaded 44128 existing records from primary storage. [2025-10-01T19:55:25.188392] [INFO ] [MAIN ] LDI: Loaded 44128 existing records. [2025-10-01T19:55:25.245266] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-01T19:55:25.245552] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-01T19:55:25.252861] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-01T19:55:25.258751] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-01T19:55:25.359432] [DEBUG] [LOCAL ] LC: Trimmed 70563 records to 47835 (keeping 200 days of data) [2025-10-01T19:55:25.477891] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T19:55:25.507047] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-01T19:55:25.562343] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-01T19:55:25.605747] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:55:25.608937] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-01T19:55:25.609912] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-01T19:55:25.611330] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-01T19:55:25.612056] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-01T19:55:25.704995] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-01T19:55:26.045079] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:55:26.224779] [DEBUG] [LOCAL ] LC: Primary data saved (47835 records). [2025-10-01T19:55:26.224922] [INFO ] [MAIN ] LC: Full history saved. [2025-10-01T19:55:26.225004] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LC took 34.1s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-01T19:55:26.415273] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:55:26.465376] [DEBUG] [LOCAL ] LDOS: Loaded 45593 existing records from primary storage. [2025-10-01T19:55:26.465795] [INFO ] [MAIN ] LDOS: Loaded 45593 existing records. [2025-10-01T19:55:26.512323] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-01T19:55:26.680263] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:55:26.680516] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-01T19:55:26.680675] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-01T19:55:26.681603] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-01T19:55:26.681705] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-01T19:55:26.874065] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T19:55:27.113357] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:55:27.302356] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-01T19:55:27.624094] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-01T19:55:28.102395] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-01T19:55:28.148440] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T19:55:28.348837] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T19:55:28.902397] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-01T19:55:29.702399] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-01T19:55:30.134318] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T19:55:30.486737] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T19:55:30.489919] [INFO ] [REMOTE ] LBRT: Full fetch complete (76540 records). [2025-10-01T19:55:30.490091] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-01T19:55:30.509693] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-01T19:55:30.932222] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-01T19:55:30.932313] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-01T19:55:30.933394] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-01T19:55:30.933470] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-01T19:55:30.935328] [DEBUG] [LOCAL ] LBRT: Trimmed 76540 records to 52912 (keeping 200 days of data) [2025-10-01T19:55:31.302427] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-01T19:55:31.322590] [DEBUG] [LOCAL ] LBRT: Primary data saved (52912 records). [2025-10-01T19:55:31.322792] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-01T19:55:31.322914] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 39.2s. Estimated remaining: 2h 38m 58s. Rate: 7.1 symbols/min [2025-10-01T19:55:31.514596] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:55:31.543999] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T19:55:31.572617] [DEBUG] [LOCAL ] LDP: Loaded 12967 existing records from primary storage. [2025-10-01T19:55:31.572973] [INFO ] [MAIN ] LDP: Loaded 12967 existing records. [2025-10-01T19:55:31.773713] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:55:31.773961] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-01T19:55:31.774013] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-01T19:55:31.774275] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-01T19:55:31.774350] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-01T19:55:32.080564] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T19:55:32.106499] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-01T19:55:32.225485] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:55:32.621434] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T19:55:32.902450] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-01T19:55:33.500892] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T19:55:33.702384] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-01T19:55:34.436484] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T19:55:34.502380] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-01T19:55:35.302405] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-01T19:55:35.380627] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T19:55:35.679101] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T19:55:36.102353] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-01T19:55:36.413470] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T19:55:36.902392] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-01T19:55:37.631338] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T19:55:37.702356] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-01T19:55:37.786478] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T19:55:38.502364] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-01T19:55:39.123360] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T19:55:39.302414] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-01T19:55:39.380920] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T19:55:40.102464] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-01T19:55:40.615283] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T19:55:40.902397] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-01T19:55:41.533558] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T19:55:41.702397] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-01T19:55:42.266617] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T19:55:42.502403] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-01T19:55:42.623439] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T19:55:43.302399] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-01T19:55:44.102351] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-01T19:55:44.201314] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T19:55:44.302573] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T19:55:44.902432] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-01T19:55:45.562392] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T19:55:45.636724] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T19:55:45.702409] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-01T19:55:46.502451] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-01T19:55:47.303913] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T19:55:47.302518] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-01T19:55:48.102381] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-01T19:55:48.144599] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T19:55:48.209632] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T19:55:48.902401] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-01T19:55:48.974414] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T19:55:49.525685] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T19:55:49.702382] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-01T19:55:50.502397] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-01T19:55:51.302364] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-01T19:55:51.333265] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T19:55:52.108782] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-01T19:55:52.125294] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T19:55:52.554187] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T19:55:52.703351] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T19:55:52.902378] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-01T19:55:53.702416] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-01T19:55:54.134611] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T19:55:54.502384] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-01T19:55:55.302358] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-01T19:55:55.328213] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T19:55:55.493934] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T19:55:56.102409] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-01T19:55:56.175136] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T19:55:56.902434] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-01T19:55:57.447195] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-01T19:55:57.448456] [INFO ] [REMOTE ] LCII: Full fetch complete (39228 records). [2025-10-01T19:55:57.448557] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-01T19:55:57.708203] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-01T19:55:57.878061] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-01T19:55:57.878170] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-01T19:55:57.879002] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-01T19:55:57.879066] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-01T19:55:57.880042] [DEBUG] [LOCAL ] LCII: Trimmed 39228 records to 28050 (keeping 200 days of data) [2025-10-01T19:55:58.063723] [DEBUG] [LOCAL ] LCII: Primary data saved (28050 records). [2025-10-01T19:55:58.063864] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-01T19:55:58.063963] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LCII took 35.4s. Estimated remaining: 2h 39m 6s. Rate: 7.1 symbols/min [2025-10-01T19:55:58.252409] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:55:58.309944] [DEBUG] [LOCAL ] LEA: Loaded 41744 existing records from primary storage. [2025-10-01T19:55:58.310398] [INFO ] [MAIN ] LEA: Loaded 41744 existing records. [2025-10-01T19:55:58.508905] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-01T19:55:58.514534] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:55:58.515732] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-01T19:55:58.515797] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-01T19:55:58.516798] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-01T19:55:58.516861] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-01T19:55:58.905413] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:55:59.076292] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-01T19:55:59.302368] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-01T19:55:59.570272] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T19:55:59.634953] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T19:55:59.635886] [INFO ] [REMOTE ] LDP: Full fetch complete (19436 records). [2025-10-01T19:55:59.635960] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-01T19:56:00.046831] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-01T19:56:00.046953] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-01T19:56:00.047476] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-01T19:56:00.047541] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-01T19:56:00.048347] [DEBUG] [LOCAL ] LDP: Trimmed 19436 records to 12928 (keeping 200 days of data) [2025-10-01T19:56:00.114787] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-01T19:56:00.144830] [DEBUG] [LOCAL ] LDP: Primary data saved (12928 records). [2025-10-01T19:56:00.145011] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-01T19:56:00.145135] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LDP took 28.8s. Estimated remaining: 2h 38m 52s. Rate: 7.1 symbols/min [2025-10-01T19:56:00.351469] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:00.401355] [DEBUG] [LOCAL ] LEG: Loaded 50291 existing records from primary storage. [2025-10-01T19:56:00.401756] [INFO ] [MAIN ] LEG: Loaded 50291 existing records. [2025-10-01T19:56:00.598266] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:00.598522] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-01T19:56:00.598615] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-01T19:56:00.599316] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-01T19:56:00.599378] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-01T19:56:00.905864] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-01T19:56:00.992332] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:56:01.702394] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-01T19:56:02.357668] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-01T19:56:02.359201] [INFO ] [REMOTE ] LDOS: Full fetch complete (67654 records). [2025-10-01T19:56:02.359296] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-01T19:56:02.747353] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (3.44 seconds). [2025-10-01T19:56:02.750753] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T19:56:02.764905] [INFO ] [REMOTE ] LDI: Full fetch complete (60541 records). [2025-10-01T19:56:02.770747] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-01T19:56:02.776392] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-01T19:56:02.975693] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-01T19:56:02.994847] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-01T19:56:02.996170] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-01T19:56:02.996258] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-01T19:56:03.089574] [DEBUG] [LOCAL ] LDOS: Trimmed 67654 records to 45597 (keeping 200 days of data) [2025-10-01T19:56:03.423099] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-01T19:56:03.423902] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-01T19:56:03.425238] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-01T19:56:03.425741] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-01T19:56:03.431108] [DEBUG] [LOCAL ] LDI: Trimmed 60541 records to 44137 (keeping 200 days of data) [2025-10-01T19:56:03.565022] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T19:56:03.580245] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-01T19:56:03.881834] [DEBUG] [LOCAL ] LDI: Primary data saved (44137 records). [2025-10-01T19:56:03.884775] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-01T19:56:03.885777] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 39.4s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-01T19:56:04.105467] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:04.180008] [DEBUG] [LOCAL ] LDOS: Primary data saved (45597 records). [2025-10-01T19:56:04.180149] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-01T19:56:04.180253] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 38.0s. Estimated remaining: 2h 38m 23s. Rate: 7.1 symbols/min [2025-10-01T19:56:04.318009] [DEBUG] [LOCAL ] LEN: Loaded 53188 existing records from primary storage. [2025-10-01T19:56:04.334565] [INFO ] [MAIN ] LEN: Loaded 53188 existing records. [2025-10-01T19:56:04.459961] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:04.622149] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:04.627504] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-01T19:56:04.627735] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-01T19:56:04.637150] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-01T19:56:04.645444] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-01T19:56:04.666541] [DEBUG] [LOCAL ] LEO: Loaded 17325 existing records from primary storage. [2025-10-01T19:56:04.707977] [INFO ] [MAIN ] LEO: Loaded 17325 existing records. [2025-10-01T19:56:04.717380] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T19:56:04.889396] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-01T19:56:05.164727] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:05.197958] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-01T19:56:05.216202] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-01T19:56:05.241727] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-01T19:56:05.289792] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-01T19:56:05.331001] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:56:05.343708] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-01T19:56:05.604935] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T19:56:05.707514] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-01T19:56:05.786221] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:56:06.502419] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-01T19:56:06.545969] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T19:56:07.309353] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-01T19:56:07.348780] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T19:56:07.367324] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-01T19:56:07.397840] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T19:56:08.102409] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-01T19:56:08.866074] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T19:56:08.902381] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-01T19:56:09.702420] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-01T19:56:09.862109] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T19:56:10.507227] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-01T19:56:10.510750] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T19:56:10.726300] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T19:56:11.302383] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-01T19:56:12.102371] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-01T19:56:12.166474] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T19:56:12.324109] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T19:56:12.902390] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-01T19:56:13.412328] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T19:56:13.702404] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-01T19:56:14.502355] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-01T19:56:14.758975] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T19:56:15.302362] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-01T19:56:15.487903] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T19:56:15.955889] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T19:56:16.102393] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-01T19:56:16.903892] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-01T19:56:16.906531] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T19:56:17.702353] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-01T19:56:17.898046] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T19:56:18.306452] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T19:56:18.482636] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T19:56:18.502341] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-01T19:56:19.302380] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-01T19:56:19.959121] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T19:56:20.102395] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-01T19:56:20.902397] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-01T19:56:20.953235] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T19:56:21.132870] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T19:56:21.702401] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-01T19:56:22.427313] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T19:56:22.502398] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-01T19:56:22.587892] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T19:56:23.302378] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-01T19:56:23.765584] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T19:56:24.102409] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-01T19:56:24.293878] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T19:56:24.902391] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-01T19:56:25.702380] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-01T19:56:25.836828] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T19:56:26.451992] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T19:56:26.502484] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-01T19:56:27.066995] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-01T19:56:27.302378] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-01T19:56:28.102388] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-01T19:56:28.447333] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T19:56:28.450068] [INFO ] [REMOTE ] LEG: Full fetch complete (73121 records). [2025-10-01T19:56:28.450285] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-01T19:56:28.902888] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-01T19:56:28.921463] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-01T19:56:28.922540] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-01T19:56:28.923614] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-01T19:56:28.923998] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-01T19:56:28.926057] [DEBUG] [LOCAL ] LEG: Trimmed 73121 records to 50265 (keeping 200 days of data) [2025-10-01T19:56:29.049088] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T19:56:29.090381] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T19:56:29.303488] [DEBUG] [LOCAL ] LEG: Primary data saved (50265 records). [2025-10-01T19:56:29.303630] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-01T19:56:29.303748] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LEG took 29.2s. Estimated remaining: 2h 38m 30s. Rate: 7.1 symbols/min [2025-10-01T19:56:29.492055] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:29.548900] [DEBUG] [LOCAL ] LEVI: Loaded 51554 existing records from primary storage. [2025-10-01T19:56:29.549269] [INFO ] [MAIN ] LEVI: Loaded 51554 existing records. [2025-10-01T19:56:29.712039] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-01T19:56:29.758413] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:29.758709] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-01T19:56:29.758770] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-01T19:56:29.759227] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-01T19:56:29.759287] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-01T19:56:30.175554] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:56:30.502366] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-01T19:56:30.619334] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T19:56:30.835222] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T19:56:30.836851] [INFO ] [REMOTE ] LEA: Full fetch complete (60928 records). [2025-10-01T19:56:30.836987] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-01T19:56:31.273702] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-01T19:56:31.273849] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-01T19:56:31.275003] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-01T19:56:31.275079] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-01T19:56:31.276537] [DEBUG] [LOCAL ] LEA: Trimmed 60928 records to 41746 (keeping 200 days of data) [2025-10-01T19:56:31.339365] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-01T19:56:31.580613] [DEBUG] [LOCAL ] LEA: Primary data saved (41746 records). [2025-10-01T19:56:31.580789] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-01T19:56:31.580909] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 33.5s. Estimated remaining: 2h 38m 15s. Rate: 7.1 symbols/min [2025-10-01T19:56:31.828668] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:31.859441] [DEBUG] [LOCAL ] LFT: Loaded 18306 existing records from primary storage. [2025-10-01T19:56:31.859854] [INFO ] [MAIN ] LFT: Loaded 18306 existing records. [2025-10-01T19:56:32.107720] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-01T19:56:32.139986] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:32.141809] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-01T19:56:32.141921] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-01T19:56:32.142390] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-01T19:56:32.142474] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-01T19:56:32.447251] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T19:56:32.687775] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:56:32.766027] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T19:56:32.902381] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-01T19:56:33.237198] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T19:56:33.238204] [INFO ] [REMOTE ] LEO: Full fetch complete (26951 records). [2025-10-01T19:56:33.238285] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-01T19:56:33.644121] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-01T19:56:33.644204] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-01T19:56:33.644863] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-01T19:56:33.644927] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-01T19:56:33.645633] [DEBUG] [LOCAL ] LEO: Trimmed 26951 records to 17282 (keeping 200 days of data) [2025-10-01T19:56:33.719097] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-01T19:56:33.753974] [DEBUG] [LOCAL ] LEO: Primary data saved (17282 records). [2025-10-01T19:56:33.754215] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-01T19:56:33.754434] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEO took 29.6s. Estimated remaining: 2h 38m 1s. Rate: 7.1 symbols/min [2025-10-01T19:56:33.880869] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T19:56:33.959875] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:33.973066] [DEBUG] [LOCAL ] LGI: Loaded 9828 existing records from primary storage. [2025-10-01T19:56:33.973310] [INFO ] [MAIN ] LGI: Loaded 9828 existing records. [2025-10-01T19:56:34.184974] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:34.185251] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-01T19:56:34.185305] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-01T19:56:34.185518] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-01T19:56:34.185577] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-01T19:56:34.507485] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-01T19:56:34.601213] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:56:35.302357] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-01T19:56:35.370172] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T19:56:36.102373] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-01T19:56:36.266522] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T19:56:36.337596] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T19:56:36.903450] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-01T19:56:36.905208] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T19:56:37.702401] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-01T19:56:38.502379] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-01T19:56:38.915453] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-01T19:56:39.142839] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T19:56:39.302374] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-01T19:56:39.346608] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T19:56:40.102383] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-01T19:56:40.843279] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T19:56:40.902380] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-01T19:56:41.401907] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-01T19:56:41.617775] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T19:56:41.702352] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-01T19:56:42.464825] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-01T19:56:42.502425] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-01T19:56:43.302434] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-01T19:56:43.357006] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T19:56:44.102407] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-01T19:56:44.902390] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-01T19:56:45.359198] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-01T19:56:45.702450] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-01T19:56:45.738892] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-01T19:56:45.883219] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T19:56:46.502427] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-01T19:56:47.302371] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-01T19:56:47.471900] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T19:56:48.107433] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-01T19:56:48.113162] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T19:56:48.902434] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-01T19:56:49.046725] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (3.34 seconds). [2025-10-01T19:56:49.048777] [INFO ] [REMOTE ] LEN: Full fetch complete (77030 records). [2025-10-01T19:56:49.048914] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-01T19:56:49.462410] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-01T19:56:49.462527] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-01T19:56:49.464013] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-01T19:56:49.464088] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-01T19:56:49.466069] [DEBUG] [LOCAL ] LEN: Trimmed 77030 records to 53177 (keeping 200 days of data) [2025-10-01T19:56:49.706298] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-01T19:56:49.760098] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T19:56:49.878727] [DEBUG] [LOCAL ] LEN: Primary data saved (53177 records). [2025-10-01T19:56:49.878946] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-01T19:56:49.881159] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEN took 46.0s. Estimated remaining: 2h 37m 60s. Rate: 7.1 symbols/min [2025-10-01T19:56:50.069559] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:50.085718] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T19:56:50.141957] [DEBUG] [LOCAL ] LH: Loaded 37822 existing records from primary storage. [2025-10-01T19:56:50.142342] [INFO ] [MAIN ] LH: Loaded 37822 existing records. [2025-10-01T19:56:50.324442] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:50.324813] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-01T19:56:50.324892] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-01T19:56:50.326048] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-01T19:56:50.326169] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-01T19:56:50.504069] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-01T19:56:50.635470] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T19:56:50.708596] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:56:51.302401] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-01T19:56:51.781973] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T19:56:52.102439] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-01T19:56:52.797146] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T19:56:52.902419] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-01T19:56:53.539277] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T19:56:53.702365] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-01T19:56:53.882043] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T19:56:54.502468] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-01T19:56:55.307506] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-01T19:56:55.325343] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T19:56:55.367779] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T19:56:56.085583] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T19:56:56.102341] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-01T19:56:56.813978] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-01T19:56:56.902338] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-01T19:56:57.534898] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T19:56:57.702418] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-01T19:56:58.502464] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-01T19:56:58.864320] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T19:56:58.865413] [INFO ] [REMOTE ] LFT: Full fetch complete (24123 records). [2025-10-01T19:56:58.865490] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-01T19:56:59.254160] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-01T19:56:59.254266] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-01T19:56:59.254980] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-01T19:56:59.255047] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-01T19:56:59.256209] [DEBUG] [LOCAL ] LFT: Trimmed 24123 records to 18303 (keeping 200 days of data) [2025-10-01T19:56:59.308771] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-01T19:56:59.368878] [DEBUG] [LOCAL ] LFT: Primary data saved (18303 records). [2025-10-01T19:56:59.369073] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-01T19:56:59.369176] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LFT took 27.8s. Estimated remaining: 2h 37m 52s. Rate: 7.1 symbols/min [2025-10-01T19:56:59.555466] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:56:59.605872] [DEBUG] [LOCAL ] LHX: Loaded 48643 existing records from primary storage. [2025-10-01T19:56:59.606230] [INFO ] [MAIN ] LHX: Loaded 48643 existing records. [2025-10-01T19:56:59.796235] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:56:59.796495] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-01T19:56:59.796571] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-01T19:56:59.798413] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-01T19:56:59.798484] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-01T19:57:00.105836] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-01T19:57:00.187993] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:00.212027] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T19:57:00.904836] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-01T19:57:00.909634] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T19:57:00.968212] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T19:57:01.702430] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-01T19:57:02.473704] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T19:57:02.502336] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-01T19:57:02.574145] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T19:57:02.575221] [INFO ] [REMOTE ] LGI: Full fetch complete (14294 records). [2025-10-01T19:57:02.575297] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-01T19:57:02.977912] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-01T19:57:02.978027] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-01T19:57:02.978659] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-01T19:57:02.978727] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-01T19:57:02.979396] [DEBUG] [LOCAL ] LGI: Trimmed 14294 records to 9839 (keeping 200 days of data) [2025-10-01T19:57:03.049278] [DEBUG] [LOCAL ] LGI: Primary data saved (9839 records). [2025-10-01T19:57:03.049514] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-01T19:57:03.049671] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LGI took 29.3s. Estimated remaining: 2h 37m 39s. Rate: 7.1 symbols/min [2025-10-01T19:57:03.253150] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:57:03.285094] [DEBUG] [LOCAL ] LII: Loaded 27966 existing records from primary storage. [2025-10-01T19:57:03.285524] [INFO ] [MAIN ] LII: Loaded 27966 existing records. [2025-10-01T19:57:03.308571] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-01T19:57:03.489562] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:57:03.489931] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-01T19:57:03.489985] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-01T19:57:03.490880] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-01T19:57:03.490946] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-01T19:57:03.892018] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:04.102367] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-01T19:57:04.185238] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T19:57:04.902388] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-01T19:57:05.078489] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T19:57:05.702377] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-01T19:57:05.744317] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T19:57:06.358434] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T19:57:06.502389] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-01T19:57:06.914419] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T19:57:07.302430] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-01T19:57:07.978050] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T19:57:08.102440] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-01T19:57:08.732995] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T19:57:08.902425] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-01T19:57:09.395180] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T19:57:09.702420] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-01T19:57:10.314397] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T19:57:10.502414] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-01T19:57:11.258626] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T19:57:11.302378] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-01T19:57:11.407448] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T19:57:12.102430] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-01T19:57:12.902380] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-01T19:57:13.055012] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T19:57:13.632741] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T19:57:13.702389] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-01T19:57:14.502438] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-01T19:57:15.041092] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-01T19:57:15.043230] [INFO ] [REMOTE ] LEVI: Full fetch complete (74447 records). [2025-10-01T19:57:15.043360] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-01T19:57:15.309867] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-01T19:57:15.434389] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T19:57:15.533639] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-01T19:57:15.533764] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-01T19:57:15.534795] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-01T19:57:15.534865] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-01T19:57:15.539567] [DEBUG] [LOCAL ] LEVI: Trimmed 74447 records to 51565 (keeping 200 days of data) [2025-10-01T19:57:15.911065] [DEBUG] [LOCAL ] LEVI: Primary data saved (51565 records). [2025-10-01T19:57:15.911236] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-01T19:57:15.911371] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 46.6s. Estimated remaining: 2h 37m 35s. Rate: 7.1 symbols/min [2025-10-01T19:57:16.097575] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:57:16.102361] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-01T19:57:16.145127] [DEBUG] [LOCAL ] LION: Loaded 44032 existing records from primary storage. [2025-10-01T19:57:16.145458] [INFO ] [MAIN ] LION: Loaded 44032 existing records. [2025-10-01T19:57:16.349345] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:57:16.349978] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-01T19:57:16.350054] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-01T19:57:16.351623] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-01T19:57:16.351735] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-01T19:57:16.646149] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-01T19:57:16.790270] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:16.810971] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T19:57:16.902364] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-01T19:57:17.585438] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T19:57:17.702432] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-01T19:57:18.191224] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T19:57:18.502357] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-01T19:57:18.721971] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T19:57:19.302376] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-01T19:57:20.100207] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T19:57:20.109972] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-01T19:57:20.331450] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-01T19:57:20.902351] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-01T19:57:21.231849] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T19:57:21.702411] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-01T19:57:22.473931] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T19:57:22.478956] [INFO ] [REMOTE ] LH: Full fetch complete (54930 records). [2025-10-01T19:57:22.479202] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-01T19:57:22.507618] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-01T19:57:22.918629] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-01T19:57:22.918751] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-01T19:57:22.919721] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-01T19:57:22.919791] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-01T19:57:22.921332] [DEBUG] [LOCAL ] LH: Trimmed 54930 records to 37827 (keeping 200 days of data) [2025-10-01T19:57:23.239259] [DEBUG] [LOCAL ] LH: Primary data saved (37827 records). [2025-10-01T19:57:23.239459] [INFO ] [MAIN ] LH: Full history saved. [2025-10-01T19:57:23.239603] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LH took 33.4s. Estimated remaining: 2h 37m 25s. Rate: 7.1 symbols/min [2025-10-01T19:57:23.305942] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-01T19:57:23.542808] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:57:23.552132] [DEBUG] [LOCAL ] LITB: Loaded 4352 existing records from primary storage. [2025-10-01T19:57:23.552473] [INFO ] [MAIN ] LITB: Loaded 4352 existing records. [2025-10-01T19:57:23.738677] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-01T19:57:23.845257] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T19:57:23.979966] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:57:23.980273] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-01T19:57:23.980338] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-01T19:57:23.980787] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-01T19:57:23.980880] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-01T19:57:24.107801] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-01T19:57:24.454823] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:24.672296] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T19:57:24.902399] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-01T19:57:25.236783] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T19:57:25.702379] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-01T19:57:26.047103] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-01T19:57:26.276309] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T19:57:26.502380] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-01T19:57:26.976427] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-01T19:57:27.302382] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-01T19:57:27.771405] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T19:57:28.102377] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-01T19:57:28.902379] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-01T19:57:29.702350] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-01T19:57:30.087497] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T19:57:30.205751] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-01T19:57:30.502361] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-01T19:57:30.602612] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T19:57:31.302410] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-01T19:57:32.102376] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-01T19:57:32.442473] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T19:57:32.518592] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-01T19:57:32.571156] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T19:57:32.902370] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-01T19:57:33.702375] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-01T19:57:34.502382] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-01T19:57:34.813376] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-01T19:57:34.814594] [INFO ] [REMOTE ] LII: Full fetch complete (41391 records). [2025-10-01T19:57:34.814717] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-01T19:57:35.234584] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-01T19:57:35.234870] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-01T19:57:35.235628] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-01T19:57:35.235743] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-01T19:57:35.237078] [DEBUG] [LOCAL ] LII: Trimmed 41391 records to 27988 (keeping 200 days of data) [2025-10-01T19:57:35.310393] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-01T19:57:35.361692] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T19:57:35.397299] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T19:57:35.491580] [DEBUG] [LOCAL ] LII: Primary data saved (27988 records). [2025-10-01T19:57:35.491748] [INFO ] [MAIN ] LII: Full history saved. [2025-10-01T19:57:35.491869] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LII took 32.4s. Estimated remaining: 2h 37m 20s. Rate: 7.1 symbols/min [2025-10-01T19:57:35.671385] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:57:35.725023] [DEBUG] [LOCAL ] LLY: Loaded 53281 existing records from primary storage. [2025-10-01T19:57:35.725344] [INFO ] [MAIN ] LLY: Loaded 53281 existing records. [2025-10-01T19:57:35.921071] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:57:35.921287] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-01T19:57:35.921334] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-01T19:57:35.922433] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-01T19:57:35.922494] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-01T19:57:36.111388] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-01T19:57:36.348004] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:36.902392] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-01T19:57:37.204919] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T19:57:37.425857] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T19:57:37.702403] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-01T19:57:38.502442] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-01T19:57:38.976680] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T19:57:39.302353] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-01T19:57:39.492918] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T19:57:39.586734] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-01T19:57:40.102419] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-01T19:57:40.902402] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-01T19:57:41.101171] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T19:57:41.711901] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-01T19:57:41.733735] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T19:57:42.502434] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-01T19:57:43.307458] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-01T19:57:43.325133] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-01T19:57:43.328813] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T19:57:44.093133] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-01T19:57:44.095399] [INFO ] [REMOTE ] LHX: Full fetch complete (70834 records). [2025-10-01T19:57:44.095525] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-01T19:57:44.110729] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-01T19:57:44.553187] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-01T19:57:44.553281] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-01T19:57:44.554257] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-01T19:57:44.554333] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-01T19:57:44.555964] [DEBUG] [LOCAL ] LHX: Trimmed 70834 records to 48686 (keeping 200 days of data) [2025-10-01T19:57:44.636919] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T19:57:44.894865] [DEBUG] [LOCAL ] LHX: Primary data saved (48686 records). [2025-10-01T19:57:44.895003] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-01T19:57:44.895146] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LHX took 45.5s. Estimated remaining: 2h 37m 13s. Rate: 7.1 symbols/min [2025-10-01T19:57:44.907467] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-01T19:57:45.126270] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:57:45.123075] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T19:57:45.192694] [DEBUG] [LOCAL ] LMND: Loaded 51876 existing records from primary storage. [2025-10-01T19:57:45.193038] [INFO ] [MAIN ] LMND: Loaded 51876 existing records. [2025-10-01T19:57:45.387097] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:57:45.387339] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-01T19:57:45.387390] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-01T19:57:45.388306] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-01T19:57:45.388368] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-01T19:57:45.502114] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T19:57:45.707514] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-01T19:57:45.806898] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:46.502384] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-01T19:57:47.302405] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-01T19:57:47.691842] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-01T19:57:47.693406] [INFO ] [REMOTE ] LION: Full fetch complete (54998 records). [2025-10-01T19:57:47.693503] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-01T19:57:48.063963] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T19:57:48.102384] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-01T19:57:48.145685] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-01T19:57:48.145780] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-01T19:57:48.146748] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-01T19:57:48.146817] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-01T19:57:48.148286] [DEBUG] [LOCAL ] LION: Trimmed 54998 records to 44271 (keeping 200 days of data) [2025-10-01T19:57:48.413793] [DEBUG] [LOCAL ] LION: Primary data saved (44271 records). [2025-10-01T19:57:48.413933] [INFO ] [MAIN ] LION: Full history saved. [2025-10-01T19:57:48.414024] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LION took 32.5s. Estimated remaining: 2h 36m 60s. Rate: 7.1 symbols/min [2025-10-01T19:57:48.623574] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:57:48.657397] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-01T19:57:48.717260] [DEBUG] [LOCAL ] LMT: Loaded 49835 existing records from primary storage. [2025-10-01T19:57:48.717620] [INFO ] [MAIN ] LMT: Loaded 49835 existing records. [2025-10-01T19:57:48.923988] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-01T19:57:48.930661] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:57:48.931688] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-01T19:57:48.931751] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-01T19:57:48.932781] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-01T19:57:48.932844] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-01T19:57:49.312281] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:49.672503] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-01T19:57:49.673371] [INFO ] [REMOTE ] LITB: Full fetch complete (5626 records). [2025-10-01T19:57:49.673463] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-01T19:57:49.707478] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-01T19:57:50.068081] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-01T19:57:50.068170] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-01T19:57:50.068353] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-01T19:57:50.068393] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-01T19:57:50.068826] [DEBUG] [LOCAL ] LITB: Trimmed 5626 records to 4340 (keeping 200 days of data) [2025-10-01T19:57:50.095491] [DEBUG] [LOCAL ] LITB: Primary data saved (4340 records). [2025-10-01T19:57:50.095930] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-01T19:57:50.096081] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LITB took 26.9s. Estimated remaining: 2h 36m 45s. Rate: 7.1 symbols/min [2025-10-01T19:57:50.286580] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:57:50.349082] [DEBUG] [LOCAL ] LNC: Loaded 51615 existing records from primary storage. [2025-10-01T19:57:50.349419] [INFO ] [MAIN ] LNC: Loaded 51615 existing records. [2025-10-01T19:57:50.511346] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-01T19:57:50.557836] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:57:50.558504] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-01T19:57:50.558595] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-01T19:57:50.568395] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-01T19:57:50.582248] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-01T19:57:50.700464] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-01T19:57:50.990234] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:57:51.302393] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-01T19:57:51.809055] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-01T19:57:52.102397] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-01T19:57:52.530802] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T19:57:52.833987] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T19:57:52.902351] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-01T19:57:53.702361] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-01T19:57:54.188322] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-01T19:57:54.502425] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-01T19:57:54.987334] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T19:57:55.307455] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-01T19:57:55.323454] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T19:57:56.102389] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-01T19:57:56.902439] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-01T19:57:57.142410] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-01T19:57:57.539493] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-01T19:57:57.652407] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T19:57:57.702367] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-01T19:57:58.211445] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T19:57:58.502424] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-01T19:57:59.302425] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-01T19:57:59.833931] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-01T19:58:00.102362] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-01T19:58:00.167717] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T19:58:00.902399] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-01T19:58:01.702345] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-01T19:58:01.792634] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-01T19:58:02.220316] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-01T19:58:02.502373] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-01T19:58:02.766166] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T19:58:03.302344] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-01T19:58:03.578684] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T19:58:04.102383] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-01T19:58:04.902347] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-01T19:58:04.948576] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-01T19:58:05.018982] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T19:58:05.702354] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-01T19:58:06.113371] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-01T19:58:06.502373] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-01T19:58:06.685186] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T19:58:07.302405] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-01T19:58:08.102351] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-01T19:58:08.302723] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-01T19:58:08.520183] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-01T19:58:08.902377] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-01T19:58:09.025039] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T19:58:09.702381] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-01T19:58:09.974075] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T19:58:10.502390] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-01T19:58:11.253334] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-01T19:58:11.302338] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-01T19:58:11.397233] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T19:58:12.102382] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-01T19:58:12.734607] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-01T19:58:12.902381] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-01T19:58:13.183722] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T19:58:13.702377] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-01T19:58:14.420203] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-01T19:58:14.502411] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-01T19:58:15.302375] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-01T19:58:15.673819] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-01T19:58:15.873772] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-01T19:58:16.102377] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-01T19:58:16.713385] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-01T19:58:16.902407] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-01T19:58:16.978306] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T19:58:17.702386] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-01T19:58:18.502414] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-01T19:58:19.121164] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (3.02 seconds). [2025-10-01T19:58:19.122811] [INFO ] [REMOTE ] LMT: Full fetch complete (72498 records). [2025-10-01T19:58:19.122915] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-01T19:58:19.556577] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-01T19:58:19.556704] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-01T19:58:19.557713] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-01T19:58:19.557778] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-01T19:58:19.559566] [DEBUG] [LOCAL ] LMT: Trimmed 72498 records to 49847 (keeping 200 days of data) [2025-10-01T19:58:19.693722] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-01T19:58:19.706980] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-01T19:58:19.942534] [DEBUG] [LOCAL ] LMT: Primary data saved (49847 records). [2025-10-01T19:58:19.942694] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-01T19:58:19.942792] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LMT took 31.5s. Estimated remaining: 2h 36m 56s. Rate: 7.1 symbols/min [2025-10-01T19:58:20.144228] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:58:20.152420] [DEBUG] [LOCAL ] LND: Loaded 4911 existing records from primary storage. [2025-10-01T19:58:20.152662] [INFO ] [MAIN ] LND: Loaded 4911 existing records. [2025-10-01T19:58:20.362755] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:58:20.363096] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-01T19:58:20.363176] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-01T19:58:20.363601] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-01T19:58:20.363751] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-01T19:58:20.515129] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-01T19:58:20.548963] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-01T19:58:20.823163] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:58:20.871726] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-01T19:58:20.873520] [INFO ] [REMOTE ] LMND: Full fetch complete (75307 records). [2025-10-01T19:58:20.873718] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-01T19:58:20.908420] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-01T19:58:21.317293] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-01T19:58:21.317391] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-01T19:58:21.318497] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-01T19:58:21.318565] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-01T19:58:21.320100] [DEBUG] [LOCAL ] LMND: Trimmed 75307 records to 51874 (keeping 200 days of data) [2025-10-01T19:58:21.639542] [DEBUG] [LOCAL ] LMND: Primary data saved (51874 records). [2025-10-01T19:58:21.639727] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-01T19:58:21.639831] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 36.7s. Estimated remaining: 2h 36m 41s. Rate: 7.1 symbols/min [2025-10-01T19:58:21.812870] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T19:58:21.835235] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-01T19:58:21.858613] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:58:21.912712] [DEBUG] [LOCAL ] LNG: Loaded 51406 existing records from primary storage. [2025-10-01T19:58:21.913095] [INFO ] [MAIN ] LNG: Loaded 51406 existing records. [2025-10-01T19:58:22.117954] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:58:22.118269] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-01T19:58:22.118330] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-01T19:58:22.119209] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-01T19:58:22.119272] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-01T19:58:22.372250] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T19:58:22.506441] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-01T19:58:22.540534] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:58:22.573258] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-01T19:58:23.302421] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-01T19:58:23.325870] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T19:58:23.482859] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (3.78 seconds). [2025-10-01T19:58:23.485037] [INFO ] [REMOTE ] LLY: Full fetch complete (77273 records). [2025-10-01T19:58:23.485239] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-01T19:58:23.965766] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-01T19:58:23.965950] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-01T19:58:23.967014] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-01T19:58:23.967080] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-01T19:58:23.968588] [DEBUG] [LOCAL ] LLY: Trimmed 77273 records to 53285 (keeping 200 days of data) [2025-10-01T19:58:24.103337] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-01T19:58:24.330465] [DEBUG] [LOCAL ] LLY: Primary data saved (53285 records). [2025-10-01T19:58:24.330617] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-01T19:58:24.330773] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LLY took 48.8s. Estimated remaining: 2h 36m 28s. Rate: 7.1 symbols/min [2025-10-01T19:58:24.512765] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:58:24.526128] [DEBUG] [LOCAL ] LNN: Loaded 11224 existing records from primary storage. [2025-10-01T19:58:24.526357] [INFO ] [MAIN ] LNN: Loaded 11224 existing records. [2025-10-01T19:58:24.728904] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:58:24.729174] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-01T19:58:24.729223] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-01T19:58:24.729479] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-01T19:58:24.729538] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-01T19:58:24.902629] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-01T19:58:25.126194] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:58:25.397505] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-01T19:58:25.399200] [INFO ] [REMOTE ] LNC: Full fetch complete (74184 records). [2025-10-01T19:58:25.399296] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-01T19:58:25.702971] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-01T19:58:25.759577] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T19:58:25.877754] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-01T19:58:25.877993] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-01T19:58:25.879171] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-01T19:58:25.879261] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-01T19:58:25.881074] [DEBUG] [LOCAL ] LNC: Trimmed 74184 records to 51610 (keeping 200 days of data) [2025-10-01T19:58:26.031692] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-01T19:58:26.261348] [DEBUG] [LOCAL ] LNC: Primary data saved (51610 records). [2025-10-01T19:58:26.261607] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-01T19:58:26.261901] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LNC took 36.2s. Estimated remaining: 2h 36m 13s. Rate: 7.1 symbols/min [2025-10-01T19:58:26.459111] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:58:26.506943] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-01T19:58:26.509054] [DEBUG] [LOCAL ] LOAR: Loaded 41572 existing records from primary storage. [2025-10-01T19:58:26.509362] [INFO ] [MAIN ] LOAR: Loaded 41572 existing records. [2025-10-01T19:58:26.628627] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T19:58:26.714065] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:58:26.714332] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-01T19:58:26.714395] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-01T19:58:26.715418] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-01T19:58:26.715519] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-01T19:58:27.111337] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:58:27.302384] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-01T19:58:28.102405] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-01T19:58:28.546108] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-01T19:58:28.797311] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T19:58:28.813229] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T19:58:28.902381] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-01T19:58:29.702383] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-01T19:58:30.222695] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T19:58:30.470884] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T19:58:30.502347] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-01T19:58:31.302396] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-01T19:58:31.900117] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T19:58:32.102459] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-01T19:58:32.417209] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T19:58:32.466510] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-01T19:58:32.902444] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-01T19:58:33.559413] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T19:58:33.702403] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-01T19:58:34.502357] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-01T19:58:34.918854] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T19:58:35.302404] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-01T19:58:35.993062] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T19:58:36.102377] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-01T19:58:36.488231] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-01T19:58:36.862985] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-01T19:58:36.902404] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-01T19:58:37.702418] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-01T19:58:38.209435] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T19:58:38.502363] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-01T19:58:38.810452] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T19:58:39.302452] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-01T19:58:40.074064] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T19:58:40.102367] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-01T19:58:40.348861] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T19:58:40.902381] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-01T19:58:41.601595] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T19:58:41.702399] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-01T19:58:42.321745] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T19:58:42.502419] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-01T19:58:43.082345] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T19:58:43.302431] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-01T19:58:44.102378] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-01T19:58:44.247746] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T19:58:44.778095] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T19:58:44.858390] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T19:58:44.902369] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-01T19:58:45.542359] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T19:58:45.702416] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-01T19:58:46.376528] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-01T19:58:46.377927] [INFO ] [REMOTE ] LND: Full fetch complete (8397 records). [2025-10-01T19:58:46.378001] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-01T19:58:46.507535] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-01T19:58:46.802287] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-01T19:58:46.802374] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-01T19:58:46.802662] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-01T19:58:46.802803] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-01T19:58:46.803276] [DEBUG] [LOCAL ] LND: Trimmed 8397 records to 4914 (keeping 200 days of data) [2025-10-01T19:58:46.832847] [DEBUG] [LOCAL ] LND: Primary data saved (4914 records). [2025-10-01T19:58:46.832980] [INFO ] [MAIN ] LND: Full history saved. [2025-10-01T19:58:46.833089] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LND took 26.9s. Estimated remaining: 2h 36m 16s. Rate: 7.1 symbols/min [2025-10-01T19:58:47.019700] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:58:47.051182] [DEBUG] [LOCAL ] LOB: Loaded 27471 existing records from primary storage. [2025-10-01T19:58:47.051459] [INFO ] [MAIN ] LOB: Loaded 27471 existing records. [2025-10-01T19:58:47.257922] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:58:47.258164] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-01T19:58:47.258215] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-01T19:58:47.258593] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-01T19:58:47.258695] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-01T19:58:47.307562] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-01T19:58:47.703719] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:58:48.082687] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T19:58:48.102374] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-01T19:58:48.287413] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T19:58:48.902392] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-01T19:58:49.668192] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T19:58:49.702379] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-01T19:58:49.959071] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T19:58:50.502417] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-01T19:58:51.302358] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-01T19:58:51.593753] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T19:58:51.619408] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T19:58:52.102376] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-01T19:58:52.725356] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T19:58:52.902427] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-01T19:58:53.702373] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-01T19:58:54.017937] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T19:58:54.112711] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T19:58:54.502406] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-01T19:58:55.302414] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-01T19:58:55.692190] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-01T19:58:55.693717] [INFO ] [REMOTE ] LOAR: Full fetch complete (56299 records). [2025-10-01T19:58:55.693809] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-01T19:58:55.935081] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T19:58:56.107470] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-01T19:58:56.153794] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-01T19:58:56.153887] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-01T19:58:56.154795] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-01T19:58:56.154865] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-01T19:58:56.156274] [DEBUG] [LOCAL ] LOAR: Trimmed 56299 records to 41649 (keeping 200 days of data) [2025-10-01T19:58:56.408630] [DEBUG] [LOCAL ] LOAR: Primary data saved (41649 records). [2025-10-01T19:58:56.408801] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-01T19:58:56.408908] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LOAR took 30.1s. Estimated remaining: 2h 36m 8s. Rate: 7.1 symbols/min [2025-10-01T19:58:56.594251] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:58:56.594427] [DEBUG] [LOCAL ] LOCL: No existing data file found in primary storage. [2025-10-01T19:58:56.594471] [WARN ] [MAIN ] LOCL: No existing data found, performing full refresh instead. [2025-10-01T19:58:56.594588] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-01T19:58:56.594669] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-01T19:58:56.594753] [DEBUG] [LOCAL ] LOCL: No primary data file found to delete. [2025-10-01T19:58:56.594819] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-01T19:58:56.906536] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-01T19:58:57.000339] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:58:57.037401] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T19:58:57.063248] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T19:58:57.702436] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-01T19:58:58.239152] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T19:58:58.502429] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-01T19:58:59.302365] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-01T19:58:59.370940] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T19:59:00.101423] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-01T19:59:00.103096] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-01T19:59:00.107430] [INFO ] [REMOTE ] LNG: Full fetch complete (74684 records). [2025-10-01T19:59:00.107607] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-01T19:59:00.568186] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-01T19:59:00.568322] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-01T19:59:00.569407] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-01T19:59:00.569479] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-01T19:59:00.570992] [DEBUG] [LOCAL ] LNG: Trimmed 74684 records to 51384 (keeping 200 days of data) [2025-10-01T19:59:00.685878] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T19:59:00.827035] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T19:59:00.908133] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-01T19:59:00.950057] [DEBUG] [LOCAL ] LNG: Primary data saved (51384 records). [2025-10-01T19:59:00.950246] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-01T19:59:00.950370] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNG took 39.3s. Estimated remaining: 2h 35m 56s. Rate: 7.1 symbols/min [2025-10-01T19:59:01.137086] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:59:01.175817] [DEBUG] [LOCAL ] LOMA: Loaded 32080 existing records from primary storage. [2025-10-01T19:59:01.176137] [INFO ] [MAIN ] LOMA: Loaded 32080 existing records. [2025-10-01T19:59:01.378051] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:59:01.382085] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-01T19:59:01.381936] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-01T19:59:01.382318] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-01T19:59:01.384349] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-01T19:59:01.384415] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-01T19:59:01.707528] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-01T19:59:01.789089] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:59:02.502384] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-01T19:59:02.883806] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T19:59:03.302396] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-01T19:59:03.989027] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T19:59:04.017864] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T19:59:04.102432] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-01T19:59:04.873459] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T19:59:04.902358] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-01T19:59:05.157516] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-01T19:59:05.702391] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-01T19:59:06.501244] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T19:59:06.503509] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-01T19:59:07.302404] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-01T19:59:07.429699] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-01T19:59:07.430527] [INFO ] [REMOTE ] LNN: Full fetch complete (15657 records). [2025-10-01T19:59:07.430603] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-01T19:59:07.835466] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-01T19:59:07.835544] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-01T19:59:07.835953] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-01T19:59:07.836019] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-01T19:59:07.836602] [DEBUG] [LOCAL ] LNN: Trimmed 15657 records to 11157 (keeping 200 days of data) [2025-10-01T19:59:07.913766] [DEBUG] [LOCAL ] LNN: Primary data saved (11157 records). [2025-10-01T19:59:07.913910] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-01T19:59:07.913994] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LNN took 43.6s. Estimated remaining: 2h 35m 46s. Rate: 7.1 symbols/min [2025-10-01T19:59:08.096484] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:59:08.102349] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-01T19:59:08.153399] [DEBUG] [LOCAL ] LOW: Loaded 52947 existing records from primary storage. [2025-10-01T19:59:08.153759] [INFO ] [MAIN ] LOW: Loaded 52947 existing records. [2025-10-01T19:59:08.361705] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:59:08.362238] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-01T19:59:08.362297] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-01T19:59:08.363295] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-01T19:59:08.363376] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-01T19:59:08.564912] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-01T19:59:08.791598] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:59:08.902396] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-01T19:59:09.132292] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T19:59:09.702380] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-01T19:59:10.217117] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T19:59:10.502356] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-01T19:59:10.969495] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T19:59:11.014327] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T19:59:11.302387] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-01T19:59:12.102385] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-01T19:59:12.902385] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-01T19:59:13.270501] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T19:59:13.279234] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T19:59:13.327757] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T19:59:13.702417] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-01T19:59:14.068376] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-01T19:59:14.502420] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-01T19:59:15.302380] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-01T19:59:15.960494] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T19:59:15.961674] [INFO ] [REMOTE ] LOB: Full fetch complete (37852 records). [2025-10-01T19:59:15.961766] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-01T19:59:16.127193] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-01T19:59:16.386597] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-01T19:59:16.386747] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-01T19:59:16.387496] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-01T19:59:16.387576] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-01T19:59:16.390562] [DEBUG] [LOCAL ] LOB: Trimmed 37852 records to 27380 (keeping 200 days of data) [2025-10-01T19:59:16.589393] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T19:59:16.602836] [DEBUG] [LOCAL ] LOB: Primary data saved (27380 records). [2025-10-01T19:59:16.603038] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-01T19:59:16.603149] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOB took 29.8s. Estimated remaining: 2h 35m 38s. Rate: 7.1 symbols/min [2025-10-01T19:59:16.789084] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:59:16.830331] [DEBUG] [LOCAL ] LPG: Loaded 39874 existing records from primary storage. [2025-10-01T19:59:16.830683] [INFO ] [MAIN ] LPG: Loaded 39874 existing records. [2025-10-01T19:59:16.907542] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-01T19:59:17.031784] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:59:17.032011] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-01T19:59:17.032064] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-01T19:59:17.032600] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-01T19:59:17.032721] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-01T19:59:17.346060] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-01T19:59:17.430416] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:59:17.702397] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-01T19:59:18.009926] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T19:59:18.502386] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-01T19:59:19.284253] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T19:59:19.302345] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-01T19:59:20.102394] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-01T19:59:20.309672] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T19:59:20.902349] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-01T19:59:20.995358] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T19:59:21.216832] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T19:59:21.702380] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-01T19:59:22.502389] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-01T19:59:22.587093] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T19:59:23.213174] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T19:59:23.212059] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T19:59:23.302358] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-01T19:59:24.102400] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-01T19:59:24.902410] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-01T19:59:25.261363] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T19:59:25.366079] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T19:59:25.702385] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-01T19:59:26.122107] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T19:59:26.502383] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-01T19:59:26.635311] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T19:59:27.198712] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-01T19:59:27.199476] [INFO ] [REMOTE ] LOCL: Full fetch complete (4743 records). [2025-10-01T19:59:27.199567] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-01T19:59:27.307471] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-01T19:59:27.605544] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-01T19:59:27.605620] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-01T19:59:27.605793] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-01T19:59:27.605846] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-01T19:59:27.606208] [DEBUG] [LOCAL ] LOCL: Trimmed 4743 records to 3632 (keeping 200 days of data) [2025-10-01T19:59:27.626816] [DEBUG] [LOCAL ] LOCL: Primary data saved (3632 records). [2025-10-01T19:59:27.626905] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-01T19:59:27.626988] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOCL took 31.2s. Estimated remaining: 2h 35m 32s. Rate: 7.1 symbols/min [2025-10-01T19:59:27.809616] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:59:27.835784] [DEBUG] [LOCAL ] LPL: Loaded 26306 existing records from primary storage. [2025-10-01T19:59:27.836053] [INFO ] [MAIN ] LPL: Loaded 26306 existing records. [2025-10-01T19:59:28.031025] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:59:28.031270] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-01T19:59:28.031324] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-01T19:59:28.031891] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-01T19:59:28.031956] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-01T19:59:28.102406] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-01T19:59:28.442318] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:59:28.577597] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T19:59:28.902407] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-01T19:59:29.702420] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-01T19:59:30.216470] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-01T19:59:30.388590] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T19:59:30.502396] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-01T19:59:30.559716] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T19:59:31.302404] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-01T19:59:31.806741] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T19:59:32.102420] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-01T19:59:32.902358] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-01T19:59:33.241981] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T19:59:33.623543] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T19:59:33.702408] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-01T19:59:34.051486] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T19:59:34.502436] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-01T19:59:35.302444] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-01T19:59:35.626058] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-01T19:59:35.628332] [INFO ] [REMOTE ] LOMA: Full fetch complete (47981 records). [2025-10-01T19:59:35.628422] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-01T19:59:36.084797] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-01T19:59:36.084906] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-01T19:59:36.085850] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-01T19:59:36.085940] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-01T19:59:36.108760] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-01T19:59:36.110867] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T19:59:36.121182] [DEBUG] [LOCAL ] LOMA: Trimmed 47981 records to 32067 (keeping 200 days of data) [2025-10-01T19:59:36.323195] [DEBUG] [LOCAL ] LOMA: Primary data saved (32067 records). [2025-10-01T19:59:36.323345] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-01T19:59:36.323431] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOMA took 35.4s. Estimated remaining: 2h 35m 24s. Rate: 7.1 symbols/min [2025-10-01T19:59:36.530331] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:59:36.526839] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T19:59:36.578669] [DEBUG] [LOCAL ] LPX: Loaded 39672 existing records from primary storage. [2025-10-01T19:59:36.578982] [INFO ] [MAIN ] LPX: Loaded 39672 existing records. [2025-10-01T19:59:36.768680] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:59:36.768915] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-01T19:59:36.768964] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-01T19:59:36.769559] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-01T19:59:36.769621] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-01T19:59:36.907542] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-01T19:59:37.173678] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:59:37.702432] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-01T19:59:38.093219] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T19:59:38.191067] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-01T19:59:38.502390] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-01T19:59:39.209125] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T19:59:39.302376] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-01T19:59:39.552483] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T19:59:40.102379] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-01T19:59:40.606776] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T19:59:40.902385] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-01T19:59:41.102570] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T19:59:41.702394] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-01T19:59:42.470515] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T19:59:42.502351] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-01T19:59:42.659273] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T19:59:43.302381] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-01T19:59:43.913959] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T19:59:44.102416] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-01T19:59:44.902431] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-01T19:59:45.030271] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-01T19:59:45.031820] [INFO ] [REMOTE ] LPG: Full fetch complete (59589 records). [2025-10-01T19:59:45.031909] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-01T19:59:45.455132] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-01T19:59:45.455294] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-01T19:59:45.456597] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-01T19:59:45.456794] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-01T19:59:45.458305] [DEBUG] [LOCAL ] LPG: Trimmed 59589 records to 39882 (keeping 200 days of data) [2025-10-01T19:59:45.706531] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-01T19:59:45.713949] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T19:59:45.755972] [DEBUG] [LOCAL ] LPG: Primary data saved (39882 records). [2025-10-01T19:59:45.756128] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-01T19:59:45.756214] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPG took 29.2s. Estimated remaining: 2h 35m 16s. Rate: 7.1 symbols/min [2025-10-01T19:59:45.937967] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T19:59:45.985395] [DEBUG] [LOCAL ] LRN: Loaded 39818 existing records from primary storage. [2025-10-01T19:59:45.985707] [INFO ] [MAIN ] LRN: Loaded 39818 existing records. [2025-10-01T19:59:46.147450] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T19:59:46.217063] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T19:59:46.217296] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-01T19:59:46.217350] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-01T19:59:46.218081] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-01T19:59:46.218144] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-01T19:59:46.508617] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-01T19:59:46.629895] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T19:59:47.302670] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-01T19:59:47.392725] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T19:59:48.016897] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T19:59:48.102363] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-01T19:59:48.554458] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T19:59:48.902447] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-01T19:59:49.646786] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T19:59:49.702358] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-01T19:59:50.180763] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T19:59:50.502405] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-01T19:59:51.084404] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T19:59:51.302399] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-01T19:59:51.528131] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-01T19:59:52.102408] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-01T19:59:52.746007] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T19:59:52.902385] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-01T19:59:53.105488] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T19:59:53.702423] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-01T19:59:54.360429] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T19:59:54.502380] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-01T19:59:54.905211] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T19:59:55.302381] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-01T19:59:55.695994] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T19:59:56.102398] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-01T19:59:56.778793] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T19:59:56.902379] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-01T19:59:57.654801] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T19:59:57.702347] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-01T19:59:58.502371] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-01T19:59:58.788164] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T19:59:59.302379] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-01T19:59:59.555683] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-01T19:59:59.557883] [INFO ] [REMOTE ] LPX: Full fetch complete (58801 records). [2025-10-01T19:59:59.557987] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-01T19:59:59.974961] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-01T19:59:59.975073] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-01T19:59:59.975977] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-01T19:59:59.976174] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-01T19:59:59.977500] [DEBUG] [LOCAL ] LPX: Trimmed 58801 records to 39688 (keeping 200 days of data) [2025-10-01T20:00:00.097472] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T20:00:00.107310] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-01T20:00:00.274369] [DEBUG] [LOCAL ] LPX: Primary data saved (39688 records). [2025-10-01T20:00:00.274557] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-01T20:00:00.274699] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPX took 24.0s. Estimated remaining: 2h 35m 13s. Rate: 7.1 symbols/min [2025-10-01T20:00:00.501441] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:00.548252] [DEBUG] [LOCAL ] LSPD: Loaded 42882 existing records from primary storage. [2025-10-01T20:00:00.548587] [INFO ] [MAIN ] LSPD: Loaded 42882 existing records. [2025-10-01T20:00:00.748293] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:00:00.748519] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-01T20:00:00.748571] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-01T20:00:00.748988] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-01T20:00:00.749052] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-01T20:00:00.907563] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-01T20:00:01.154923] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:01.656224] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T20:00:01.702426] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-01T20:00:01.842903] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-01T20:00:01.845186] [INFO ] [REMOTE ] LOW: Full fetch complete (76505 records). [2025-10-01T20:00:01.845333] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-01T20:00:02.326019] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-01T20:00:02.326117] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-01T20:00:02.327334] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-01T20:00:02.327425] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-01T20:00:02.329168] [DEBUG] [LOCAL ] LOW: Trimmed 76505 records to 52943 (keeping 200 days of data) [2025-10-01T20:00:02.451957] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-01T20:00:02.455331] [INFO ] [REMOTE ] LPL: Full fetch complete (35381 records). [2025-10-01T20:00:02.456695] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-01T20:00:02.512128] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-01T20:00:03.067190] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-01T20:00:03.071522] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-01T20:00:03.076692] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-01T20:00:03.077335] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-01T20:00:03.081011] [DEBUG] [LOCAL ] LPL: Trimmed 35381 records to 26529 (keeping 200 days of data) [2025-10-01T20:00:03.365904] [DEBUG] [LOCAL ] LOW: Primary data saved (52943 records). [2025-10-01T20:00:03.366472] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-01T20:00:03.366957] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 55.5s. Estimated remaining: 2h 34m 59s. Rate: 7.1 symbols/min [2025-10-01T20:00:03.541457] [DEBUG] [LOCAL ] LPL: Primary data saved (26529 records). [2025-10-01T20:00:03.576427] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:03.574776] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-01T20:00:03.577025] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPL took 35.9s. Estimated remaining: 2h 34m 44s. Rate: 7.1 symbols/min [2025-10-01T20:00:03.769365] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-01T20:00:03.841562] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-01T20:00:03.852031] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:03.856046] [DEBUG] [LOCAL ] LTC: Loaded 30125 existing records from primary storage. [2025-10-01T20:00:03.856502] [INFO ] [MAIN ] LTC: Loaded 30125 existing records. [2025-10-01T20:00:04.063750] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:00:04.080183] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-01T20:00:04.080360] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-01T20:00:04.080811] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-01T20:00:04.080885] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-01T20:00:04.242510] [DEBUG] [LOCAL ] LTH: Loaded 51759 existing records from primary storage. [2025-10-01T20:00:04.311247] [INFO ] [MAIN ] LTH: Loaded 51759 existing records. [2025-10-01T20:00:04.710787] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:00:04.757071] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:04.757434] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-01T20:00:04.757959] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-01T20:00:04.757571] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-01T20:00:04.759719] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-01T20:00:04.759803] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-01T20:00:04.942562] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-01T20:00:05.037005] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-01T20:00:05.283071] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:05.293997] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T20:00:05.702415] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-01T20:00:05.995572] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T20:00:06.433624] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T20:00:06.502414] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-01T20:00:07.312056] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-01T20:00:07.319402] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T20:00:08.102405] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-01T20:00:08.170468] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T20:00:08.902396] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-01T20:00:08.999493] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:00:09.457135] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T20:00:09.702434] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-01T20:00:10.502441] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-01T20:00:10.644243] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T20:00:11.132511] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T20:00:11.302404] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-01T20:00:12.086028] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T20:00:12.102361] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-01T20:00:12.902380] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-01T20:00:12.979048] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T20:00:13.702366] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-01T20:00:13.813340] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T20:00:14.375155] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T20:00:14.502441] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-01T20:00:15.302404] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-01T20:00:15.304434] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T20:00:15.452581] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T20:00:16.102493] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-01T20:00:16.844744] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T20:00:16.902429] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-01T20:00:17.435165] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T20:00:17.702386] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-01T20:00:18.498019] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T20:00:18.506135] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-01T20:00:19.010385] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T20:00:19.302394] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-01T20:00:20.102357] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-01T20:00:20.228628] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T20:00:20.902358] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-01T20:00:20.972725] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T20:00:21.310706] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T20:00:21.702388] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-01T20:00:22.396693] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T20:00:22.502389] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-01T20:00:23.308943] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-01T20:00:23.315541] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T20:00:23.411308] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T20:00:24.102379] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-01T20:00:24.567074] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T20:00:24.568476] [INFO ] [REMOTE ] LRN: Full fetch complete (58446 records). [2025-10-01T20:00:24.568582] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-01T20:00:24.908103] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-01T20:00:25.007393] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-01T20:00:25.007520] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-01T20:00:25.008869] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-01T20:00:25.008960] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-01T20:00:25.010861] [DEBUG] [LOCAL ] LRN: Trimmed 58446 records to 39775 (keeping 200 days of data) [2025-10-01T20:00:25.288445] [DEBUG] [LOCAL ] LRN: Primary data saved (39775 records). [2025-10-01T20:00:25.288613] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-01T20:00:25.288742] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LRN took 39.5s. Estimated remaining: 2h 34m 47s. Rate: 7.1 symbols/min [2025-10-01T20:00:25.485201] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:25.523268] [DEBUG] [LOCAL ] LTM: Loaded 36826 existing records from primary storage. [2025-10-01T20:00:25.523577] [INFO ] [MAIN ] LTM: Loaded 36826 existing records. [2025-10-01T20:00:25.713031] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-01T20:00:25.729328] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:00:25.730955] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-01T20:00:25.731094] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-01T20:00:25.731738] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-01T20:00:25.746467] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-01T20:00:25.859764] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T20:00:26.167666] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:26.374980] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T20:00:26.502395] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-01T20:00:27.266492] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T20:00:27.302350] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-01T20:00:28.007921] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T20:00:28.102366] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-01T20:00:28.170030] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T20:00:28.171386] [INFO ] [REMOTE ] LTC: Full fetch complete (43454 records). [2025-10-01T20:00:28.171503] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-01T20:00:28.582760] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-01T20:00:28.582857] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-01T20:00:28.583700] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-01T20:00:28.583767] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-01T20:00:28.584899] [DEBUG] [LOCAL ] LTC: Trimmed 43454 records to 30230 (keeping 200 days of data) [2025-10-01T20:00:28.784683] [DEBUG] [LOCAL ] LTC: Primary data saved (30230 records). [2025-10-01T20:00:28.784906] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-01T20:00:28.785039] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LTC took 25.4s. Estimated remaining: 2h 34m 34s. Rate: 7.1 symbols/min [2025-10-01T20:00:28.902408] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-01T20:00:29.590128] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T20:00:29.702432] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-01T20:00:30.502405] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-01T20:00:30.732003] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T20:00:31.076698] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T20:00:31.302428] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-01T20:00:31.419118] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T20:00:32.102394] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-01T20:00:32.645968] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T20:00:32.902425] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-01T20:00:33.574551] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-01T20:00:33.576049] [INFO ] [REMOTE ] LSPD: Full fetch complete (61638 records). [2025-10-01T20:00:33.576272] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-01T20:00:33.707628] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-01T20:00:34.045747] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-01T20:00:34.045847] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-01T20:00:34.046874] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-01T20:00:34.046942] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-01T20:00:34.048517] [DEBUG] [LOCAL ] LSPD: Trimmed 61638 records to 42896 (keeping 200 days of data) [2025-10-01T20:00:34.312957] [DEBUG] [LOCAL ] LSPD: Primary data saved (42896 records). [2025-10-01T20:00:34.313100] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-01T20:00:34.313192] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LSPD took 34.0s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-01T20:00:34.644252] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T20:00:34.645818] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T20:00:34.661952] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-01T20:00:35.302384] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-01T20:00:35.805153] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T20:00:36.102437] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-01T20:00:36.737887] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-01T20:00:36.740231] [INFO ] [REMOTE ] LTH: Full fetch complete (74180 records). [2025-10-01T20:00:36.740526] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-01T20:00:37.168453] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-01T20:00:37.168575] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-01T20:00:37.169808] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-01T20:00:37.169926] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-01T20:00:37.189583] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T20:00:37.195940] [DEBUG] [LOCAL ] LTH: Trimmed 74180 records to 51747 (keeping 200 days of data) [2025-10-01T20:00:37.196863] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-01T20:00:37.529339] [DEBUG] [LOCAL ] LTH: Primary data saved (51747 records). [2025-10-01T20:00:37.529521] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-01T20:00:37.529672] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTH took 34.0s. Estimated remaining: 2h 34m 10s. Rate: 7.1 symbols/min [2025-10-01T20:00:38.518120] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T20:00:38.524842] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-01T20:00:39.865033] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T20:00:39.872504] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-01T20:00:40.938931] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T20:00:40.946997] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-01T20:00:42.396969] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T20:00:42.405283] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-01T20:00:44.008692] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T20:00:44.018531] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-01T20:00:45.525307] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T20:00:45.536380] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-01T20:00:46.875209] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-01T20:00:46.876638] [INFO ] [REMOTE ] LTM: Full fetch complete (47842 records). [2025-10-01T20:00:46.876747] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-01T20:00:47.300918] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-01T20:00:47.301002] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-01T20:00:47.301871] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-01T20:00:47.301936] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-01T20:00:47.303060] [DEBUG] [LOCAL ] LTM: Trimmed 47842 records to 36988 (keeping 200 days of data) [2025-10-01T20:00:47.552185] [DEBUG] [LOCAL ] LTM: Primary data saved (36988 records). [2025-10-01T20:00:47.552333] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-01T20:00:47.552424] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTM took 22.3s. Estimated remaining: 2h 34m 3s. Rate: 7.1 symbols/min [2025-10-01T20:00:48.326301] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:48.330445] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:48.334212] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:48.364922] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-10-01T20:00:48.369184] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:00:48.369311] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-10-01T20:00:48.370209] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-01T20:00:48.370467] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-01T20:00:48.370538] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-10-01T20:00:48.370610] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-01T20:00:48.824805] [DEBUG] [LOCAL ] LU: Loaded 48947 existing records from primary storage. [2025-10-01T20:00:48.826697] [INFO ] [MAIN ] LU: Loaded 48947 existing records. [2025-10-01T20:00:48.844488] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-10-01T20:00:48.843596] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-01T20:00:48.864084] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-10-01T20:00:48.874727] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-01T20:00:49.080359] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:49.177130] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-01T20:00:49.495712] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:00:49.562028] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:00:49.564324] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-01T20:00:49.564620] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-01T20:00:49.567704] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-01T20:00:49.569302] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-01T20:00:49.569197] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:00:49.569634] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-01T20:00:49.569751] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-01T20:00:49.570109] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-01T20:00:49.570183] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-01T20:00:49.575525] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-01T20:00:49.582039] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-01T20:00:49.592730] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-01T20:00:49.624337] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-01T20:00:50.770296] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T20:00:50.756095] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:50.840016] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-01T20:00:50.829393] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-01T20:00:50.852601] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:50.903615] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:00:50.899580] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-01T20:00:50.904478] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-01T20:00:52.036018] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T20:00:52.044554] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-01T20:00:52.665167] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T20:00:52.676845] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-01T20:00:52.880426] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T20:00:52.892239] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-01T20:00:52.962770] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T20:00:52.974844] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-01T20:00:53.586853] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T20:00:53.594407] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-01T20:00:54.505683] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-01T20:00:54.520345] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-01T20:00:54.610538] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T20:00:54.622562] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-01T20:00:54.801236] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-01T20:00:54.812514] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-01T20:00:55.125965] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T20:00:55.132955] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-01T20:00:56.168826] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T20:00:56.183743] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-01T20:00:56.422510] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T20:00:56.433555] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-01T20:00:56.462038] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T20:00:56.469185] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-01T20:00:56.574091] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T20:00:56.585125] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-01T20:00:57.542921] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T20:00:57.554244] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-01T20:00:57.761054] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T20:00:57.767764] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-01T20:00:58.379770] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T20:00:58.421630] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T20:00:58.502521] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-01T20:00:58.873494] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T20:00:58.928831] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T20:00:59.302409] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-01T20:01:00.102380] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-01T20:01:00.406626] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T20:01:00.902351] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-01T20:01:01.371555] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T20:01:01.666555] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T20:01:01.702358] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-01T20:01:02.044953] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T20:01:02.502396] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-01T20:01:03.302367] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-01T20:01:03.828810] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-01T20:01:04.102425] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-01T20:01:04.731411] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-01T20:01:04.902418] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-01T20:01:05.004510] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T20:01:05.620283] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T20:01:05.702409] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-01T20:01:06.458430] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T20:01:06.502382] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-01T20:01:06.861229] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T20:01:07.302393] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-01T20:01:08.102448] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-01T20:01:08.463062] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T20:01:08.902419] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-01T20:01:09.206150] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T20:01:09.702393] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-01T20:01:09.838580] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T20:01:10.502355] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-01T20:01:10.551708] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T20:01:11.302387] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-01T20:01:11.440687] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T20:01:11.472769] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T20:01:12.102445] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-01T20:01:12.902391] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-01T20:01:13.158368] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T20:01:13.159956] [INFO ] [REMOTE ] LUCK: Full fetch complete (41234 records). [2025-10-01T20:01:13.160255] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-01T20:01:13.421690] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-01T20:01:13.673086] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-01T20:01:13.673199] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-01T20:01:13.674003] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-01T20:01:13.674067] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-01T20:01:13.675047] [DEBUG] [LOCAL ] LUCK: Trimmed 41234 records to 24646 (keeping 200 days of data) [2025-10-01T20:01:13.727532] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-01T20:01:13.837398] [DEBUG] [LOCAL ] LUCK: Primary data saved (24646 records). [2025-10-01T20:01:13.837549] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-01T20:01:13.837660] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 26.3s. Estimated remaining: 2h 34m 10s. Rate: 7.1 symbols/min [2025-10-01T20:01:14.025519] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:01:14.025726] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-01T20:01:14.025786] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-01T20:01:14.025913] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-01T20:01:14.025956] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-01T20:01:14.025999] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-01T20:01:14.026033] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-01T20:01:14.428301] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:01:14.502403] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-01T20:01:15.162989] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-01T20:01:15.165219] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-01T20:01:15.178078] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-10-01T20:01:15.178914] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-01T20:01:15.307514] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-01T20:01:15.625531] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-01T20:01:15.625626] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-01T20:01:15.626803] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-01T20:01:15.626873] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-01T20:01:15.628701] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 53689 (keeping 200 days of data) [2025-10-01T20:01:15.689094] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:01:15.725391] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-01T20:01:15.726611] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:01:15.727780] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-01T20:01:15.728228] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:01:15.728610] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-01T20:01:15.729834] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-01T20:01:15.731287] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-01T20:01:15.732837] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-01T20:01:15.734428] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LUXE took 1.9s. Estimated remaining: 2h 33m 56s. Rate: 7.1 symbols/min [2025-10-01T20:01:15.953771] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:01:16.102435] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-01T20:01:16.124763] [DEBUG] [LOCAL ] LVS: Loaded 53564 existing records from primary storage. [2025-10-01T20:01:16.126804] [INFO ] [MAIN ] LVS: Loaded 53564 existing records. [2025-10-01T20:01:16.355818] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:01:16.356790] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-01T20:01:16.357433] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-01T20:01:16.358348] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-01T20:01:16.358433] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-01T20:01:16.460889] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-01T20:01:16.878398] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-01T20:01:16.896465] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-01T20:01:16.902344] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-01T20:01:16.919074] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LUV took 29.4s. Estimated remaining: 2h 33m 41s. Rate: 7.1 symbols/min [2025-10-01T20:01:16.943820] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:01:17.140999] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:01:17.161277] [DEBUG] [LOCAL ] LVWR: Loaded 17657 existing records from primary storage. [2025-10-01T20:01:17.161521] [INFO ] [MAIN ] LVWR: Loaded 17657 existing records. [2025-10-01T20:01:17.364070] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:01:17.364267] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-01T20:01:17.364316] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-01T20:01:17.364782] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-01T20:01:17.364844] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-01T20:01:17.708602] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-01T20:01:17.799968] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:01:17.871985] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-01T20:01:17.873695] [INFO ] [REMOTE ] LUMN: Full fetch complete (77635 records). [2025-10-01T20:01:17.873798] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-01T20:01:18.336967] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-01T20:01:18.337143] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-01T20:01:18.338345] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-01T20:01:18.338430] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-01T20:01:18.341804] [DEBUG] [LOCAL ] LUMN: Trimmed 77635 records to 53634 (keeping 200 days of data) [2025-10-01T20:01:18.517716] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-01T20:01:18.704525] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T20:01:18.737180] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-10-01T20:01:18.737321] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-01T20:01:18.737457] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUMN took 31.2s. Estimated remaining: 2h 33m 27s. Rate: 7.1 symbols/min [2025-10-01T20:01:18.939246] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:01:18.952065] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-01T20:01:19.009396] [DEBUG] [LOCAL ] LW: Loaded 51157 existing records from primary storage. [2025-10-01T20:01:19.009953] [INFO ] [MAIN ] LW: Loaded 51157 existing records. [2025-10-01T20:01:19.209281] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:01:19.209513] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-01T20:01:19.209575] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-01T20:01:19.211016] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-01T20:01:19.211079] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-01T20:01:19.311349] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-01T20:01:19.659234] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:01:19.692001] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T20:01:20.102376] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-01T20:01:20.733199] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-01T20:01:20.735540] [INFO ] [REMOTE ] LU: Full fetch complete (70411 records). [2025-10-01T20:01:20.735707] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-01T20:01:20.907944] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-01T20:01:21.176626] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-01T20:01:21.176746] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-01T20:01:21.177714] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-01T20:01:21.177779] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-01T20:01:21.179902] [DEBUG] [LOCAL ] LU: Trimmed 70411 records to 48987 (keeping 200 days of data) [2025-10-01T20:01:21.489188] [DEBUG] [LOCAL ] LU: Primary data saved (48987 records). [2025-10-01T20:01:21.489339] [INFO ] [MAIN ] LU: Full history saved. [2025-10-01T20:01:21.489443] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LU took 33.9s. Estimated remaining: 2h 33m 13s. Rate: 7.1 symbols/min [2025-10-01T20:01:21.703624] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:01:21.702531] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-01T20:01:21.714104] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T20:01:21.733467] [DEBUG] [LOCAL ] LXFR: Loaded 16855 existing records from primary storage. [2025-10-01T20:01:21.733814] [INFO ] [MAIN ] LXFR: Loaded 16855 existing records. [2025-10-01T20:01:21.966700] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:01:21.967128] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-01T20:01:21.967254] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-01T20:01:21.967591] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-01T20:01:21.967771] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-01T20:01:22.175907] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-01T20:01:22.402989] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:01:22.502377] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-01T20:01:23.302362] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-01T20:01:23.468610] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T20:01:23.594584] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T20:01:23.897961] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T20:01:24.102397] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-01T20:01:24.524295] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-01T20:01:24.902373] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-01T20:01:25.702419] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-01T20:01:26.502375] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-01T20:01:26.701514] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T20:01:26.729123] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T20:01:27.302401] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-01T20:01:28.102384] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-01T20:01:28.319471] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T20:01:28.698579] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T20:01:28.902392] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-01T20:01:28.972611] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T20:01:29.702413] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-01T20:01:29.995936] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T20:01:30.502394] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-01T20:01:31.302363] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-01T20:01:31.481756] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T20:01:32.102381] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-01T20:01:32.143668] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T20:01:32.902376] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-01T20:01:33.116226] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T20:01:33.244237] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:01:33.702374] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-01T20:01:33.925961] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T20:01:34.502410] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-01T20:01:34.880843] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T20:01:35.302428] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-01T20:01:35.328759] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T20:01:36.102379] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-01T20:01:36.355040] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T20:01:36.902438] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-01T20:01:37.702351] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-01T20:01:37.895398] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T20:01:38.119100] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T20:01:38.384740] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T20:01:38.502428] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-01T20:01:39.302403] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-01T20:01:39.444563] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T20:01:40.102374] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-01T20:01:40.840313] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T20:01:40.902414] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-01T20:01:41.274691] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T20:01:41.702379] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-01T20:01:41.893987] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T20:01:42.502423] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-01T20:01:43.259020] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-01T20:01:43.260322] [INFO ] [REMOTE ] LVWR: Full fetch complete (19943 records). [2025-10-01T20:01:43.260458] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-01T20:01:43.307520] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-01T20:01:43.730773] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-01T20:01:43.730884] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-01T20:01:43.731398] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-01T20:01:43.731622] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-01T20:01:43.767765] [DEBUG] [LOCAL ] LVWR: Trimmed 19943 records to 17692 (keeping 200 days of data) [2025-10-01T20:01:43.772380] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T20:01:43.893443] [DEBUG] [LOCAL ] LVWR: Primary data saved (17692 records). [2025-10-01T20:01:43.893599] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-01T20:01:43.893746] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 26.9s. Estimated remaining: 2h 33m 17s. Rate: 7.1 symbols/min [2025-10-01T20:01:44.104759] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-01T20:01:44.110780] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:01:44.130136] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:01:44.192205] [DEBUG] [LOCAL ] LXP: Loaded 50687 existing records from primary storage. [2025-10-01T20:01:44.192610] [INFO ] [MAIN ] LXP: Loaded 50687 existing records. [2025-10-01T20:01:44.423730] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:01:44.423999] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-01T20:01:44.424098] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-01T20:01:44.424816] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-01T20:01:44.424883] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-01T20:01:44.823932] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:01:44.902429] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-01T20:01:45.702402] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-01T20:01:45.910854] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T20:01:46.502361] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-01T20:01:46.599150] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T20:01:47.288548] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T20:01:47.302330] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-01T20:01:48.102362] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-01T20:01:48.373595] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T20:01:48.669138] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T20:01:48.786803] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T20:01:48.787747] [INFO ] [REMOTE ] LXFR: Full fetch complete (25039 records). [2025-10-01T20:01:48.787853] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-01T20:01:48.907537] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-01T20:01:49.214900] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-01T20:01:49.215003] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-01T20:01:49.215697] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-01T20:01:49.215767] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-01T20:01:49.216715] [DEBUG] [LOCAL ] LXFR: Trimmed 25039 records to 16834 (keeping 200 days of data) [2025-10-01T20:01:49.323741] [DEBUG] [LOCAL ] LXFR: Primary data saved (16834 records). [2025-10-01T20:01:49.323946] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-01T20:01:49.324076] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LXFR took 27.8s. Estimated remaining: 2h 33m 6s. Rate: 7.1 symbols/min [2025-10-01T20:01:49.517293] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:01:49.548917] [DEBUG] [LOCAL ] LXU: Loaded 31733 existing records from primary storage. [2025-10-01T20:01:49.549234] [INFO ] [MAIN ] LXU: Loaded 31733 existing records. [2025-10-01T20:01:49.707512] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-01T20:01:49.769416] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:01:49.769621] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-01T20:01:49.769729] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-01T20:01:49.770263] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-01T20:01:49.770325] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-01T20:01:50.166881] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:01:50.495401] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T20:01:50.505126] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-01T20:01:51.302412] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-01T20:01:51.894299] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-01T20:01:52.102354] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-01T20:01:52.146216] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T20:01:52.436439] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T20:01:52.902371] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-01T20:01:53.702400] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-01T20:01:53.833933] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T20:01:54.131551] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T20:01:54.502441] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-01T20:01:54.644100] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T20:01:55.302423] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-01T20:01:56.102402] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-01T20:01:56.497004] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-01T20:01:56.902358] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-01T20:01:57.125788] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T20:01:57.702376] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-01T20:01:57.858548] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T20:01:58.502428] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-01T20:01:58.755910] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T20:01:59.010948] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-01T20:01:59.302396] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-01T20:02:00.102348] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-01T20:02:00.144312] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T20:02:00.299241] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T20:02:00.902392] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-01T20:02:01.645823] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-01T20:02:01.647559] [INFO ] [REMOTE ] LW: Full fetch complete (74687 records). [2025-10-01T20:02:01.647722] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-01T20:02:01.709471] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-01T20:02:02.135118] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-01T20:02:02.135252] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-01T20:02:02.136486] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-01T20:02:02.136586] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-01T20:02:02.147676] [DEBUG] [LOCAL ] LW: Trimmed 74687 records to 51158 (keeping 200 days of data) [2025-10-01T20:02:02.167429] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T20:02:02.508296] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-01T20:02:02.534246] [DEBUG] [LOCAL ] LW: Primary data saved (51158 records). [2025-10-01T20:02:02.534398] [INFO ] [MAIN ] LW: Full history saved. [2025-10-01T20:02:02.534500] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LW took 43.8s. Estimated remaining: 2h 33m 1s. Rate: 7.1 symbols/min [2025-10-01T20:02:02.729106] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:02.786194] [DEBUG] [LOCAL ] LYB: Loaded 53600 existing records from primary storage. [2025-10-01T20:02:02.786750] [INFO ] [MAIN ] LYB: Loaded 53600 existing records. [2025-10-01T20:02:02.994462] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:02.994708] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-01T20:02:02.994770] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-01T20:02:02.995349] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-01T20:02:02.995413] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-01T20:02:03.299109] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-01T20:02:03.306236] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-01T20:02:03.337085] [INFO ] [REMOTE ] LVS: Full fetch complete (77515 records). [2025-10-01T20:02:03.342048] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-01T20:02:03.549221] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:03.931528] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-01T20:02:03.931628] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-01T20:02:03.933152] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-01T20:02:03.933225] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-01T20:02:03.934791] [DEBUG] [LOCAL ] LVS: Trimmed 77515 records to 53563 (keeping 200 days of data) [2025-10-01T20:02:04.127330] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-01T20:02:04.328808] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T20:02:04.359837] [DEBUG] [LOCAL ] LVS: Primary data saved (53563 records). [2025-10-01T20:02:04.359990] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-01T20:02:04.360087] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LVS took 48.6s. Estimated remaining: 2h 32m 47s. Rate: 7.1 symbols/min [2025-10-01T20:02:04.574007] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:04.625945] [DEBUG] [LOCAL ] LYG: Loaded 52804 existing records from primary storage. [2025-10-01T20:02:04.626281] [INFO ] [MAIN ] LYG: Loaded 52804 existing records. [2025-10-01T20:02:04.878056] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:04.880143] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-01T20:02:04.880052] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T20:02:04.880319] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-01T20:02:04.887519] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-01T20:02:04.888271] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-01T20:02:04.911913] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-01T20:02:05.327129] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:05.702359] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-01T20:02:06.028769] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T20:02:06.502355] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-01T20:02:06.654858] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T20:02:06.750858] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-01T20:02:07.302385] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-01T20:02:08.102379] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-01T20:02:08.212573] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T20:02:08.641486] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T20:02:08.902437] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-01T20:02:09.433276] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T20:02:09.702422] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-01T20:02:10.320742] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T20:02:10.502398] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-01T20:02:11.302367] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-01T20:02:11.467753] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T20:02:12.112100] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-01T20:02:12.132398] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T20:02:12.537213] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T20:02:12.902382] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-01T20:02:13.702386] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-01T20:02:13.942753] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T20:02:14.280023] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T20:02:14.282068] [INFO ] [REMOTE ] LXP: Full fetch complete (72596 records). [2025-10-01T20:02:14.282202] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-01T20:02:14.516258] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-01T20:02:14.736772] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-01T20:02:14.736925] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-01T20:02:14.738235] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-01T20:02:14.738311] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-01T20:02:14.739852] [DEBUG] [LOCAL ] LXP: Trimmed 72596 records to 50700 (keeping 200 days of data) [2025-10-01T20:02:15.075084] [DEBUG] [LOCAL ] LXP: Primary data saved (50700 records). [2025-10-01T20:02:15.075353] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-01T20:02:15.075525] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXP took 31.2s. Estimated remaining: 2h 32m 41s. Rate: 7.1 symbols/min [2025-10-01T20:02:15.269290] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:15.305728] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-01T20:02:15.332698] [DEBUG] [LOCAL ] LYV: Loaded 51121 existing records from primary storage. [2025-10-01T20:02:15.333038] [INFO ] [MAIN ] LYV: Loaded 51121 existing records. [2025-10-01T20:02:15.512871] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T20:02:15.549960] [INFO ] [REMOTE ] LXU: Full fetch complete (44926 records). [2025-10-01T20:02:15.580697] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-01T20:02:15.584742] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:15.585675] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-01T20:02:15.585795] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-01T20:02:15.655899] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-01T20:02:15.670988] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-01T20:02:16.155011] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-01T20:02:16.303578] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-01T20:02:16.468551] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-01T20:02:16.468768] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-01T20:02:16.476423] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-01T20:02:16.487987] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-01T20:02:16.580231] [DEBUG] [LOCAL ] LXU: Trimmed 44926 records to 31708 (keeping 200 days of data) [2025-10-01T20:02:16.593117] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:16.888921] [DEBUG] [LOCAL ] LXU: Primary data saved (31708 records). [2025-10-01T20:02:16.889124] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-01T20:02:16.889267] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 27.6s. Estimated remaining: 2h 32m 27s. Rate: 7.1 symbols/min [2025-10-01T20:02:16.907794] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-01T20:02:17.164824] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:17.203828] [DEBUG] [LOCAL ] LZB: Loaded 35551 existing records from primary storage. [2025-10-01T20:02:17.204183] [INFO ] [MAIN ] LZB: Loaded 35551 existing records. [2025-10-01T20:02:17.424272] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:17.424787] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-01T20:02:17.424963] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-01T20:02:17.436489] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-01T20:02:17.456345] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-01T20:02:17.474317] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-01T20:02:17.707468] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-01T20:02:17.900339] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:17.941279] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T20:02:18.502371] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-01T20:02:18.881570] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T20:02:19.302402] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-01T20:02:19.823568] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T20:02:20.102361] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-01T20:02:20.264466] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T20:02:20.329638] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T20:02:20.902375] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-01T20:02:21.702374] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-01T20:02:21.767526] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T20:02:22.203063] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T20:02:22.502407] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-01T20:02:23.302381] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-01T20:02:23.560239] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T20:02:23.882294] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T20:02:24.102367] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-01T20:02:24.902407] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-01T20:02:25.166464] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T20:02:25.702399] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-01T20:02:25.829244] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T20:02:26.502386] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-01T20:02:26.939766] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T20:02:27.151867] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T20:02:27.302408] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-01T20:02:28.102344] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-01T20:02:28.535793] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-01T20:02:28.625523] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T20:02:28.902388] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-01T20:02:29.702450] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-01T20:02:30.067977] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T20:02:30.502409] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-01T20:02:30.907779] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-01T20:02:30.986313] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T20:02:31.302397] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-01T20:02:32.040524] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T20:02:32.102430] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-01T20:02:32.902376] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-01T20:02:33.253791] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T20:02:33.702371] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-01T20:02:33.756479] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T20:02:34.187583] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T20:02:34.502391] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-01T20:02:35.302416] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-01T20:02:35.475187] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T20:02:35.885413] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T20:02:36.102442] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-01T20:02:36.902356] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-01T20:02:37.162376] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T20:02:37.648284] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T20:02:37.702410] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-01T20:02:38.305008] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T20:02:38.502428] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-01T20:02:39.165097] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T20:02:39.166834] [INFO ] [REMOTE ] LYB: Full fetch complete (77457 records). [2025-10-01T20:02:39.166963] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-01T20:02:39.307600] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-01T20:02:39.690151] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-01T20:02:39.690241] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-01T20:02:39.691290] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-01T20:02:39.691359] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-01T20:02:39.693001] [DEBUG] [LOCAL ] LYB: Trimmed 77457 records to 53602 (keeping 200 days of data) [2025-10-01T20:02:39.935591] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-01T20:02:39.939373] [INFO ] [REMOTE ] LYG: Full fetch complete (76042 records). [2025-10-01T20:02:39.942044] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-01T20:02:40.118704] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-01T20:02:40.418530] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-01T20:02:40.419233] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-01T20:02:40.420721] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-01T20:02:40.421058] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-01T20:02:40.427698] [DEBUG] [LOCAL ] LYG: Trimmed 76042 records to 52795 (keeping 200 days of data) [2025-10-01T20:02:40.633104] [DEBUG] [LOCAL ] LYB: Primary data saved (53602 records). [2025-10-01T20:02:40.634576] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-01T20:02:40.634782] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LYB took 38.1s. Estimated remaining: 2h 32m 31s. Rate: 7.1 symbols/min [2025-10-01T20:02:40.850186] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:40.962350] [DEBUG] [LOCAL ] LZM: Loaded 13960 existing records from primary storage. [2025-10-01T20:02:40.964504] [INFO ] [MAIN ] LZM: Loaded 13960 existing records. [2025-10-01T20:02:41.195001] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:41.195373] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-01T20:02:41.196631] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-01T20:02:41.198712] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-01T20:02:41.199178] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-01T20:02:41.343162] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-01T20:02:41.445200] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-01T20:02:41.585109] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T20:02:41.705262] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-01T20:02:41.793415] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:41.809434] [DEBUG] [LOCAL ] LYG: Primary data saved (52795 records). [2025-10-01T20:02:41.809576] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-01T20:02:41.809686] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 37.4s. Estimated remaining: 2h 32m 16s. Rate: 7.1 symbols/min [2025-10-01T20:02:42.013308] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:42.074896] [DEBUG] [LOCAL ] M: Loaded 53535 existing records from primary storage. [2025-10-01T20:02:42.075211] [INFO ] [MAIN ] M: Loaded 53535 existing records. [2025-10-01T20:02:42.275239] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:42.275735] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-01T20:02:42.275804] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-01T20:02:42.276544] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-01T20:02:42.276608] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-01T20:02:42.502677] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-01T20:02:42.742434] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:43.207876] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T20:02:43.254305] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T20:02:43.306036] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-01T20:02:43.307686] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T20:02:44.102385] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-01T20:02:44.902362] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-01T20:02:44.950189] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T20:02:45.084796] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T20:02:45.702389] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-01T20:02:46.502404] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-01T20:02:46.877905] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T20:02:46.893104] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T20:02:46.894805] [INFO ] [REMOTE ] LZB: Full fetch complete (50549 records). [2025-10-01T20:02:46.894946] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-01T20:02:47.063702] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T20:02:47.305496] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-01T20:02:47.343689] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-01T20:02:47.343777] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-01T20:02:47.344672] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-01T20:02:47.344739] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-01T20:02:47.346089] [DEBUG] [LOCAL ] LZB: Trimmed 50549 records to 35517 (keeping 200 days of data) [2025-10-01T20:02:47.578554] [DEBUG] [LOCAL ] LZB: Primary data saved (35517 records). [2025-10-01T20:02:47.578773] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-01T20:02:47.578896] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LZB took 30.7s. Estimated remaining: 2h 32m 6s. Rate: 7.1 symbols/min [2025-10-01T20:02:47.776691] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:47.845008] [DEBUG] [LOCAL ] MA: Loaded 52531 existing records from primary storage. [2025-10-01T20:02:47.845382] [INFO ] [MAIN ] MA: Loaded 52531 existing records. [2025-10-01T20:02:48.062415] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:48.062678] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-01T20:02:48.062738] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-01T20:02:48.063215] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-01T20:02:48.063276] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-01T20:02:48.110256] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-01T20:02:48.473169] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:48.902370] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-01T20:02:49.107243] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T20:02:49.144059] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T20:02:49.702416] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-01T20:02:50.502399] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-01T20:02:50.696911] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T20:02:51.302426] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-01T20:02:51.478864] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T20:02:51.670971] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-01T20:02:52.102387] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-01T20:02:52.745938] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T20:02:52.902417] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-01T20:02:53.702416] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-01T20:02:54.131228] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-01T20:02:54.191208] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T20:02:54.501554] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T20:02:54.504502] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-01T20:02:55.302431] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-01T20:02:55.711299] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T20:02:55.713529] [INFO ] [REMOTE ] LYV: Full fetch complete (73711 records). [2025-10-01T20:02:55.713702] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-01T20:02:56.108764] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-01T20:02:56.173882] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-01T20:02:56.173971] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-01T20:02:56.174980] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-01T20:02:56.175050] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-01T20:02:56.176959] [DEBUG] [LOCAL ] LYV: Trimmed 73711 records to 51121 (keeping 200 days of data) [2025-10-01T20:02:56.520087] [DEBUG] [LOCAL ] LYV: Primary data saved (51121 records). [2025-10-01T20:02:56.520282] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-01T20:02:56.520412] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LYV took 41.4s. Estimated remaining: 2h 31m 57s. Rate: 7.1 symbols/min [2025-10-01T20:02:56.717993] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:02:56.770959] [DEBUG] [LOCAL ] MAA: Loaded 42672 existing records from primary storage. [2025-10-01T20:02:56.771288] [INFO ] [MAIN ] MAA: Loaded 42672 existing records. [2025-10-01T20:02:56.907336] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-01T20:02:56.991893] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T20:02:56.996417] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:02:57.000844] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-01T20:02:57.001077] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-01T20:02:57.002001] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-01T20:02:57.002135] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-01T20:02:57.348021] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-01T20:02:57.478317] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:02:57.702415] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-01T20:02:58.502386] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-01T20:02:58.847446] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:02:58.884347] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T20:02:59.302433] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-01T20:02:59.371039] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T20:03:00.102409] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-01T20:03:00.873803] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T20:03:00.902352] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-01T20:03:01.337217] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T20:03:01.702436] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-01T20:03:02.502391] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-01T20:03:02.544871] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T20:03:03.302365] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-01T20:03:03.542226] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T20:03:03.771942] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T20:03:04.102429] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-01T20:03:04.551498] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T20:03:04.902383] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-01T20:03:05.702397] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-01T20:03:06.210806] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-01T20:03:06.375241] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T20:03:06.502388] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-01T20:03:06.535435] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-01T20:03:06.536477] [INFO ] [REMOTE ] LZM: Full fetch complete (18327 records). [2025-10-01T20:03:06.536572] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-01T20:03:06.980633] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-01T20:03:06.980766] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-01T20:03:06.981241] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-01T20:03:06.981303] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-01T20:03:06.981970] [DEBUG] [LOCAL ] LZM: Trimmed 18327 records to 13976 (keeping 200 days of data) [2025-10-01T20:03:07.062957] [DEBUG] [LOCAL ] LZM: Primary data saved (13976 records). [2025-10-01T20:03:07.063098] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-01T20:03:07.063196] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 26.4s. Estimated remaining: 2h 31m 51s. Rate: 7.1 symbols/min [2025-10-01T20:03:07.249627] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:03:07.302375] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-01T20:03:07.303680] [DEBUG] [LOCAL ] MAC: Loaded 49676 existing records from primary storage. [2025-10-01T20:03:07.304909] [INFO ] [MAIN ] MAC: Loaded 49676 existing records. [2025-10-01T20:03:07.516356] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:03:07.516591] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-01T20:03:07.516692] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-01T20:03:07.517277] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-01T20:03:07.517338] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-01T20:03:07.922439] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:03:08.102388] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-01T20:03:08.429509] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T20:03:08.724878] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T20:03:08.902471] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-01T20:03:09.702420] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-01T20:03:09.795632] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:03:10.502378] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-01T20:03:10.891535] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T20:03:10.982373] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-01T20:03:11.302388] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-01T20:03:12.102373] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-01T20:03:12.158158] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T20:03:12.570320] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T20:03:12.902403] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-01T20:03:13.702387] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-01T20:03:14.113497] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-01T20:03:14.432960] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T20:03:14.502357] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-01T20:03:15.286913] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T20:03:15.302341] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-01T20:03:16.102349] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-01T20:03:16.316442] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T20:03:16.902391] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-01T20:03:17.466157] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-01T20:03:17.702390] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-01T20:03:17.761447] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T20:03:18.502347] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-01T20:03:18.861520] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-01T20:03:18.909755] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T20:03:19.302427] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-01T20:03:20.102463] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-01T20:03:20.207053] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T20:03:20.546544] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T20:03:20.902438] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-01T20:03:21.702443] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-01T20:03:21.710001] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-01T20:03:21.712051] [INFO ] [REMOTE ] M: Full fetch complete (77520 records). [2025-10-01T20:03:21.712253] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-01T20:03:22.176923] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-01T20:03:22.177111] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-01T20:03:22.178415] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-01T20:03:22.178610] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-01T20:03:22.181042] [DEBUG] [LOCAL ] M: Trimmed 77520 records to 53535 (keeping 200 days of data) [2025-10-01T20:03:22.311438] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T20:03:22.541296] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-01T20:03:22.594274] [DEBUG] [LOCAL ] M: Primary data saved (53535 records). [2025-10-01T20:03:22.594412] [INFO ] [MAIN ] M: Full history saved. [2025-10-01T20:03:22.594498] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. M took 40.8s. Estimated remaining: 2h 31m 48s. Rate: 7.1 symbols/min [2025-10-01T20:03:22.793212] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:03:22.831383] [DEBUG] [LOCAL ] MAGN: Loaded 34849 existing records from primary storage. [2025-10-01T20:03:22.831771] [INFO ] [MAIN ] MAGN: Loaded 34849 existing records. [2025-10-01T20:03:23.028756] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:03:23.028954] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-01T20:03:23.029011] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-01T20:03:23.029337] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-01T20:03:23.029437] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-01T20:03:23.311257] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-01T20:03:23.445481] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:03:23.977611] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-01T20:03:24.107587] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-01T20:03:24.121124] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T20:03:24.730842] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T20:03:24.902430] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-01T20:03:25.702391] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-01T20:03:26.010739] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T20:03:26.394456] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T20:03:26.502413] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-01T20:03:27.302404] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-01T20:03:27.368270] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T20:03:27.685612] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T20:03:28.102404] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-01T20:03:28.357908] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T20:03:28.359433] [INFO ] [REMOTE ] MAA: Full fetch complete (61095 records). [2025-10-01T20:03:28.359549] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-01T20:03:28.807745] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-01T20:03:28.807882] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-01T20:03:28.808916] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-01T20:03:28.808986] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-01T20:03:28.810620] [DEBUG] [LOCAL ] MAA: Trimmed 61095 records to 42625 (keeping 200 days of data) [2025-10-01T20:03:28.913975] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-01T20:03:29.106740] [DEBUG] [LOCAL ] MAA: Primary data saved (42625 records). [2025-10-01T20:03:29.106878] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-01T20:03:29.106964] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MAA took 32.6s. Estimated remaining: 2h 31m 38s. Rate: 7.1 symbols/min [2025-10-01T20:03:29.248708] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T20:03:29.334800] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:03:29.375627] [DEBUG] [LOCAL ] MAIN: Loaded 41190 existing records from primary storage. [2025-10-01T20:03:29.375964] [INFO ] [MAIN ] MAIN: Loaded 41190 existing records. [2025-10-01T20:03:29.573193] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:03:29.573442] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-01T20:03:29.573546] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-01T20:03:29.573886] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-01T20:03:29.573963] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-01T20:03:29.707559] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-01T20:03:29.990921] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:03:30.502401] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-01T20:03:30.539743] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T20:03:31.051529] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T20:03:31.302434] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-01T20:03:31.947113] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T20:03:32.102418] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-01T20:03:32.902389] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-01T20:03:32.939081] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T20:03:32.941426] [INFO ] [REMOTE ] MA: Full fetch complete (76255 records). [2025-10-01T20:03:32.941587] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-01T20:03:33.463874] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T20:03:33.462199] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-01T20:03:33.471044] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-01T20:03:33.472471] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-01T20:03:33.472998] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-01T20:03:33.474587] [DEBUG] [LOCAL ] MA: Trimmed 76255 records to 52525 (keeping 200 days of data) [2025-10-01T20:03:33.713004] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-01T20:03:33.869509] [DEBUG] [LOCAL ] MA: Primary data saved (52525 records). [2025-10-01T20:03:33.869685] [INFO ] [MAIN ] MA: Full history saved. [2025-10-01T20:03:33.869838] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MA took 46.3s. Estimated remaining: 2h 31m 26s. Rate: 7.1 symbols/min [2025-10-01T20:03:34.067741] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:03:34.116421] [DEBUG] [LOCAL ] MAN: Loaded 43544 existing records from primary storage. [2025-10-01T20:03:34.116997] [INFO ] [MAIN ] MAN: Loaded 43544 existing records. [2025-10-01T20:03:34.320283] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:03:34.320732] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-01T20:03:34.320789] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-01T20:03:34.321158] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-01T20:03:34.321218] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-01T20:03:34.532991] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-01T20:03:34.744396] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:03:34.783589] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T20:03:35.126550] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T20:03:35.302388] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-01T20:03:35.930171] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T20:03:36.102385] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-01T20:03:36.496185] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T20:03:36.497928] [INFO ] [REMOTE ] MAC: Full fetch complete (71470 records). [2025-10-01T20:03:36.498094] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-01T20:03:36.915924] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-01T20:03:36.941367] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-01T20:03:36.941455] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-01T20:03:36.942593] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-01T20:03:36.942808] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-01T20:03:36.944416] [DEBUG] [LOCAL ] MAC: Trimmed 71470 records to 49670 (keeping 200 days of data) [2025-10-01T20:03:37.289526] [DEBUG] [LOCAL ] MAC: Primary data saved (49670 records). [2025-10-01T20:03:37.289702] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-01T20:03:37.289965] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAC took 30.2s. Estimated remaining: 2h 31m 14s. Rate: 7.1 symbols/min [2025-10-01T20:03:37.510488] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:03:37.559433] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T20:03:37.578077] [DEBUG] [LOCAL ] MANU: Loaded 27013 existing records from primary storage. [2025-10-01T20:03:37.578455] [INFO ] [MAIN ] MANU: Loaded 27013 existing records. [2025-10-01T20:03:37.703095] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-01T20:03:37.792750] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:03:37.793024] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-01T20:03:37.793084] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-01T20:03:37.793399] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-01T20:03:37.793461] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-01T20:03:38.201499] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:03:38.480121] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T20:03:38.502345] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-01T20:03:39.263983] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T20:03:39.302389] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-01T20:03:39.455971] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T20:03:40.102430] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-01T20:03:40.804764] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T20:03:40.902380] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-01T20:03:41.553248] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T20:03:41.702371] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-01T20:03:42.009410] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T20:03:42.502447] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-01T20:03:43.302467] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-01T20:03:43.506161] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T20:03:43.563305] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T20:03:44.102418] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-01T20:03:44.411888] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T20:03:44.902353] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-01T20:03:44.996291] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T20:03:45.702429] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-01T20:03:46.319244] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T20:03:46.502385] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-01T20:03:47.187610] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T20:03:47.302421] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-01T20:03:47.511093] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T20:03:47.512422] [INFO ] [REMOTE ] MAGN: Full fetch complete (50887 records). [2025-10-01T20:03:47.512533] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-01T20:03:47.940298] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-01T20:03:47.940390] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-01T20:03:47.941205] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-01T20:03:47.941291] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-01T20:03:47.942435] [DEBUG] [LOCAL ] MAGN: Trimmed 50887 records to 34828 (keeping 200 days of data) [2025-10-01T20:03:48.108265] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-01T20:03:48.170023] [DEBUG] [LOCAL ] MAGN: Primary data saved (34828 records). [2025-10-01T20:03:48.170215] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-01T20:03:48.170434] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAGN took 25.6s. Estimated remaining: 2h 31m 7s. Rate: 7.1 symbols/min [2025-10-01T20:03:48.374956] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:03:48.435822] [DEBUG] [LOCAL ] MAS: Loaded 52338 existing records from primary storage. [2025-10-01T20:03:48.436190] [INFO ] [MAIN ] MAS: Loaded 52338 existing records. [2025-10-01T20:03:48.664965] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:03:48.665313] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-01T20:03:48.672268] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-01T20:03:48.684131] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-01T20:03:48.684229] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-01T20:03:48.736802] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T20:03:48.907555] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-01T20:03:49.103337] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:03:49.702358] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-01T20:03:49.963002] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T20:03:50.470959] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T20:03:50.502419] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-01T20:03:51.302351] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-01T20:03:51.406742] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T20:03:51.871633] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T20:03:52.102393] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-01T20:03:52.902347] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-01T20:03:53.026983] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T20:03:53.293176] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T20:03:53.702399] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-01T20:03:54.493682] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T20:03:54.503245] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-01T20:03:55.134265] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T20:03:55.302421] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-01T20:03:56.102407] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-01T20:03:56.259185] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T20:03:56.787344] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T20:03:56.902357] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-01T20:03:57.348686] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T20:03:57.702423] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-01T20:03:58.502380] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-01T20:03:58.761788] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T20:03:59.303545] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T20:03:59.302476] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-01T20:04:00.076036] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T20:04:00.102365] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-01T20:04:00.751858] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T20:04:00.753290] [INFO ] [REMOTE ] MAIN: Full fetch complete (59775 records). [2025-10-01T20:04:00.753412] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-01T20:04:00.907743] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-01T20:04:01.302166] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-01T20:04:01.302273] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-01T20:04:01.304149] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-01T20:04:01.304330] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-01T20:04:01.306280] [DEBUG] [LOCAL ] MAIN: Trimmed 59775 records to 41168 (keeping 200 days of data) [2025-10-01T20:04:01.697228] [DEBUG] [LOCAL ] MAIN: Primary data saved (41168 records). [2025-10-01T20:04:01.697419] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-01T20:04:01.697550] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAIN took 32.6s. Estimated remaining: 2h 31m 3s. Rate: 7.1 symbols/min [2025-10-01T20:04:01.703228] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-01T20:04:02.020313] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:04:02.023963] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T20:04:02.054263] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T20:04:02.099614] [DEBUG] [LOCAL ] MATV: Loaded 36847 existing records from primary storage. [2025-10-01T20:04:02.099986] [INFO ] [MAIN ] MATV: Loaded 36847 existing records. [2025-10-01T20:04:02.302614] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:04:02.302848] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-01T20:04:02.302897] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-01T20:04:02.303168] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-01T20:04:02.303229] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-01T20:04:02.507502] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-01T20:04:02.704841] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:04:03.302383] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-01T20:04:03.570466] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T20:04:03.608689] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T20:04:04.102382] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-01T20:04:04.925825] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-01T20:04:04.946266] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T20:04:05.304201] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-01T20:04:05.305371] [INFO ] [REMOTE ] MANU: Full fetch complete (38242 records). [2025-10-01T20:04:05.305456] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-01T20:04:05.707574] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-01T20:04:05.758769] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-01T20:04:05.758921] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-01T20:04:05.759987] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-01T20:04:05.760067] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-01T20:04:05.761377] [DEBUG] [LOCAL ] MANU: Trimmed 38242 records to 26805 (keeping 200 days of data) [2025-10-01T20:04:05.929423] [DEBUG] [LOCAL ] MANU: Primary data saved (26805 records). [2025-10-01T20:04:05.929562] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-01T20:04:05.929680] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MANU took 28.6s. Estimated remaining: 2h 30m 51s. Rate: 7.1 symbols/min [2025-10-01T20:04:06.130980] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:04:06.180878] [DEBUG] [LOCAL ] MATX: Loaded 31534 existing records from primary storage. [2025-10-01T20:04:06.181223] [INFO ] [MAIN ] MATX: Loaded 31534 existing records. [2025-10-01T20:04:06.389535] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:04:06.389858] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-01T20:04:06.389986] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-01T20:04:06.390728] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-01T20:04:06.390794] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-01T20:04:06.502485] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-01T20:04:06.772271] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T20:04:06.854311] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:04:06.874876] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T20:04:07.302381] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-01T20:04:08.107546] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-01T20:04:08.120596] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T20:04:08.902366] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-01T20:04:08.991060] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T20:04:09.027034] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T20:04:09.702375] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-01T20:04:10.502388] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-01T20:04:10.555427] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T20:04:11.302379] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-01T20:04:11.480862] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T20:04:11.756320] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T20:04:12.102387] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-01T20:04:12.587472] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T20:04:12.902382] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-01T20:04:13.220269] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T20:04:13.702381] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-01T20:04:14.235316] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T20:04:14.502376] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-01T20:04:15.005152] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T20:04:15.302414] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-01T20:04:16.102401] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-01T20:04:16.164988] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T20:04:16.902401] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-01T20:04:16.986967] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T20:04:17.702379] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-01T20:04:17.899743] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T20:04:18.502419] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-01T20:04:18.555355] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T20:04:19.264680] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T20:04:19.302418] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-01T20:04:20.102395] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-01T20:04:20.218781] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T20:04:20.831450] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T20:04:20.902420] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-01T20:04:21.327865] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T20:04:21.702380] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-01T20:04:22.502395] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-01T20:04:22.700432] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T20:04:23.163979] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T20:04:23.302389] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-01T20:04:24.023723] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-01T20:04:24.025369] [INFO ] [REMOTE ] MAN: Full fetch complete (62053 records). [2025-10-01T20:04:24.025475] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-01T20:04:24.114625] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-01T20:04:24.503464] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-01T20:04:24.503561] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-01T20:04:24.504613] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-01T20:04:24.504706] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-01T20:04:24.506162] [DEBUG] [LOCAL ] MAN: Trimmed 62053 records to 43461 (keeping 200 days of data) [2025-10-01T20:04:24.758573] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T20:04:24.814719] [DEBUG] [LOCAL ] MAN: Primary data saved (43461 records). [2025-10-01T20:04:24.814863] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-01T20:04:24.814954] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAN took 50.9s. Estimated remaining: 2h 30m 51s. Rate: 7.1 symbols/min [2025-10-01T20:04:24.907546] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-01T20:04:25.014042] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:04:25.046257] [DEBUG] [LOCAL ] MAX: Loaded 30628 existing records from primary storage. [2025-10-01T20:04:25.046573] [INFO ] [MAIN ] MAX: Loaded 30628 existing records. [2025-10-01T20:04:25.276001] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:04:25.276378] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-01T20:04:25.276439] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-01T20:04:25.277004] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-01T20:04:25.277066] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-01T20:04:25.649674] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T20:04:25.709862] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-01T20:04:25.725526] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:04:26.395961] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T20:04:26.502404] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-01T20:04:26.895254] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T20:04:26.896847] [INFO ] [REMOTE ] MAS: Full fetch complete (74821 records). [2025-10-01T20:04:26.896972] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-01T20:04:27.302408] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-01T20:04:27.354148] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-01T20:04:27.354274] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-01T20:04:27.355502] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-01T20:04:27.355686] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-01T20:04:27.357458] [DEBUG] [LOCAL ] MAS: Trimmed 74821 records to 52326 (keeping 200 days of data) [2025-10-01T20:04:27.636355] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T20:04:27.754455] [DEBUG] [LOCAL ] MAS: Primary data saved (52326 records). [2025-10-01T20:04:27.754608] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-01T20:04:27.754745] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAS took 39.6s. Estimated remaining: 2h 30m 38s. Rate: 7.1 symbols/min [2025-10-01T20:04:27.948275] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:04:27.991515] [DEBUG] [LOCAL ] MBC: Loaded 43179 existing records from primary storage. [2025-10-01T20:04:27.991865] [INFO ] [MAIN ] MBC: Loaded 43179 existing records. [2025-10-01T20:04:28.102461] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-01T20:04:28.191585] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:04:28.191941] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-01T20:04:28.192001] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-01T20:04:28.192469] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-01T20:04:28.192529] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-01T20:04:28.588293] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:04:28.773437] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T20:04:28.902402] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-01T20:04:29.638264] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T20:04:29.702384] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-01T20:04:30.110475] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T20:04:30.502384] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-01T20:04:30.580392] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T20:04:31.302346] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-01T20:04:31.392989] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T20:04:32.102410] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-01T20:04:32.770804] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T20:04:32.902364] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-01T20:04:33.444314] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-01T20:04:33.445487] [INFO ] [REMOTE ] MATX: Full fetch complete (42615 records). [2025-10-01T20:04:33.445617] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-01T20:04:33.714965] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-01T20:04:33.851493] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-01T20:04:33.851585] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-01T20:04:33.852422] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-01T20:04:33.852498] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-01T20:04:33.853539] [DEBUG] [LOCAL ] MATX: Trimmed 42615 records to 31529 (keeping 200 days of data) [2025-10-01T20:04:34.082659] [DEBUG] [LOCAL ] MATX: Primary data saved (31529 records). [2025-10-01T20:04:34.082822] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-01T20:04:34.082923] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATX took 28.2s. Estimated remaining: 2h 30m 28s. Rate: 7.1 symbols/min [2025-10-01T20:04:34.268201] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:04:34.291318] [DEBUG] [LOCAL ] MBI: Loaded 24289 existing records from primary storage. [2025-10-01T20:04:34.291568] [INFO ] [MAIN ] MBI: Loaded 24289 existing records. [2025-10-01T20:04:34.492393] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:04:34.492833] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-01T20:04:34.492945] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-01T20:04:34.493613] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-01T20:04:34.493882] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-01T20:04:34.507467] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-01T20:04:34.612285] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T20:04:34.937444] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:04:35.079739] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T20:04:35.302436] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-01T20:04:35.992639] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T20:04:36.102347] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-01T20:04:36.271872] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T20:04:36.902421] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-01T20:04:37.247022] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T20:04:37.702413] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-01T20:04:38.175908] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T20:04:38.502474] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-01T20:04:38.813958] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T20:04:39.302419] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-01T20:04:39.620596] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T20:04:39.621844] [INFO ] [REMOTE ] MATV: Full fetch complete (52364 records). [2025-10-01T20:04:39.621946] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-01T20:04:40.043965] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-01T20:04:40.044046] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-01T20:04:40.044877] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-01T20:04:40.044941] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-01T20:04:40.047304] [DEBUG] [LOCAL ] MATV: Trimmed 52364 records to 36693 (keeping 200 days of data) [2025-10-01T20:04:40.104346] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-01T20:04:40.282816] [DEBUG] [LOCAL ] MATV: Primary data saved (36693 records). [2025-10-01T20:04:40.282966] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-01T20:04:40.283056] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 38.6s. Estimated remaining: 2h 30m 17s. Rate: 7.1 symbols/min [2025-10-01T20:04:40.475702] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:04:40.490946] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T20:04:40.539255] [DEBUG] [LOCAL ] MC: Loaded 44091 existing records from primary storage. [2025-10-01T20:04:40.539556] [INFO ] [MAIN ] MC: Loaded 44091 existing records. [2025-10-01T20:04:40.733353] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:04:40.733584] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-01T20:04:40.733665] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-01T20:04:40.734230] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-01T20:04:40.734294] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-01T20:04:40.907995] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-01T20:04:41.129851] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:04:41.194986] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T20:04:41.702423] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-01T20:04:42.387442] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T20:04:42.502405] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-01T20:04:43.117255] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T20:04:43.302347] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-01T20:04:43.692551] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T20:04:44.102385] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-01T20:04:44.846047] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T20:04:44.902360] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-01T20:04:45.485305] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T20:04:45.702387] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-01T20:04:46.457719] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T20:04:46.502387] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-01T20:04:46.841123] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T20:04:47.302422] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-01T20:04:47.925589] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T20:04:48.102450] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-01T20:04:48.713866] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T20:04:48.902386] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-01T20:04:49.614008] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T20:04:49.702395] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-01T20:04:49.982566] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T20:04:50.502385] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-01T20:04:51.284393] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T20:04:51.302345] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-01T20:04:51.337973] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T20:04:52.102453] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-01T20:04:52.902415] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-01T20:04:53.004396] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T20:04:53.156847] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T20:04:53.702474] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-01T20:04:54.277914] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T20:04:54.502382] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-01T20:04:55.169047] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T20:04:55.302384] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-01T20:04:56.102431] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-01T20:04:56.186761] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T20:04:56.532288] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T20:04:56.902376] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-01T20:04:57.193449] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T20:04:57.702389] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-01T20:04:58.270886] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T20:04:58.471984] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-01T20:04:58.473432] [INFO ] [REMOTE ] MBI: Full fetch complete (36463 records). [2025-10-01T20:04:58.473526] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-01T20:04:58.509268] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-01T20:04:58.922536] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-01T20:04:58.922619] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-01T20:04:58.923322] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-01T20:04:58.923378] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-01T20:04:58.924336] [DEBUG] [LOCAL ] MBI: Trimmed 36463 records to 24272 (keeping 200 days of data) [2025-10-01T20:04:59.070193] [DEBUG] [LOCAL ] MBI: Primary data saved (24272 records). [2025-10-01T20:04:59.070327] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-01T20:04:59.070414] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MBI took 25.0s. Estimated remaining: 2h 30m 17s. Rate: 7.1 symbols/min [2025-10-01T20:04:59.250570] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:04:59.264012] [DEBUG] [LOCAL ] MCB: Loaded 11531 existing records from primary storage. [2025-10-01T20:04:59.264250] [INFO ] [MAIN ] MCB: Loaded 11531 existing records. [2025-10-01T20:04:59.309193] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-01T20:04:59.456859] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:04:59.457071] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-01T20:04:59.457120] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-01T20:04:59.457327] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-01T20:04:59.457387] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-01T20:04:59.862102] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:04:59.908399] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T20:05:00.102383] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-01T20:05:00.902442] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-01T20:05:00.966220] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T20:05:01.640029] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T20:05:01.707798] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-01T20:05:01.711104] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T20:05:02.502409] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-01T20:05:03.302363] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-01T20:05:03.377787] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T20:05:03.509617] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T20:05:04.102391] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-01T20:05:04.463137] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T20:05:04.464592] [INFO ] [REMOTE ] MAX: Full fetch complete (45265 records). [2025-10-01T20:05:04.464816] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-01T20:05:04.869874] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T20:05:04.906977] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-01T20:05:04.907233] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-01T20:05:04.908304] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-01T20:05:04.909230] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-01T20:05:04.909388] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-01T20:05:04.910526] [DEBUG] [LOCAL ] MAX: Trimmed 45265 records to 30716 (keeping 200 days of data) [2025-10-01T20:05:05.102638] [DEBUG] [LOCAL ] MAX: Primary data saved (30716 records). [2025-10-01T20:05:05.102840] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-01T20:05:05.102969] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MAX took 40.3s. Estimated remaining: 2h 30m 7s. Rate: 7.1 symbols/min [2025-10-01T20:05:05.297556] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:05.297766] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-01T20:05:05.297814] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-01T20:05:05.297952] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-01T20:05:05.297997] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-01T20:05:05.298042] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-01T20:05:05.298076] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-01T20:05:05.709549] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-01T20:05:05.736497] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:05.856989] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T20:05:06.502405] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-01T20:05:07.025942] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T20:05:07.302381] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-01T20:05:08.102394] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-01T20:05:08.796962] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-01T20:05:08.888851] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T20:05:08.902330] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-01T20:05:09.348583] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T20:05:09.702378] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-01T20:05:10.145147] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T20:05:10.146715] [INFO ] [REMOTE ] MC: Full fetch complete (62516 records). [2025-10-01T20:05:10.146814] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-01T20:05:10.515803] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-01T20:05:10.580741] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-01T20:05:10.580843] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-01T20:05:10.581776] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-01T20:05:10.581842] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-01T20:05:10.583339] [DEBUG] [LOCAL ] MC: Trimmed 62516 records to 44087 (keeping 200 days of data) [2025-10-01T20:05:10.894948] [DEBUG] [LOCAL ] MC: Primary data saved (44087 records). [2025-10-01T20:05:10.895108] [INFO ] [MAIN ] MC: Full history saved. [2025-10-01T20:05:10.895207] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MC took 30.6s. Estimated remaining: 2h 29m 56s. Rate: 7.1 symbols/min [2025-10-01T20:05:11.089524] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:11.098603] [DEBUG] [LOCAL ] MCI: Loaded 6378 existing records from primary storage. [2025-10-01T20:05:11.098857] [INFO ] [MAIN ] MCI: Loaded 6378 existing records. [2025-10-01T20:05:11.292287] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:05:11.292626] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-01T20:05:11.292741] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-01T20:05:11.293178] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-01T20:05:11.293264] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-01T20:05:11.307162] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-01T20:05:11.530213] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T20:05:11.763047] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:12.102410] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-01T20:05:12.542765] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T20:05:12.609132] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-01T20:05:12.642924] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-01T20:05:12.902381] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-01T20:05:13.642847] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T20:05:13.702445] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-01T20:05:14.502444] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-01T20:05:15.031699] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-01T20:05:15.037239] [INFO ] [REMOTE ] MBC: Full fetch complete (62913 records). [2025-10-01T20:05:15.037389] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-01T20:05:15.303688] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-01T20:05:15.432094] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T20:05:15.532541] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-01T20:05:15.532675] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-01T20:05:15.534520] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-01T20:05:15.534588] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-01T20:05:15.536339] [DEBUG] [LOCAL ] MBC: Trimmed 62913 records to 43173 (keeping 200 days of data) [2025-10-01T20:05:15.811215] [DEBUG] [LOCAL ] MBC: Primary data saved (43173 records). [2025-10-01T20:05:15.811415] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-01T20:05:15.811523] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MBC took 48.1s. Estimated remaining: 2h 29m 45s. Rate: 7.1 symbols/min [2025-10-01T20:05:15.989216] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:15.989455] [DEBUG] [LOCAL ] MCK: No existing data file found in primary storage. [2025-10-01T20:05:15.989496] [WARN ] [MAIN ] MCK: No existing data found, performing full refresh instead. [2025-10-01T20:05:15.989626] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-01T20:05:15.989708] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-01T20:05:15.989764] [DEBUG] [LOCAL ] MCK: No primary data file found to delete. [2025-10-01T20:05:15.989798] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-01T20:05:16.107615] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-01T20:05:16.385000] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:16.902365] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-01T20:05:16.984582] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T20:05:17.506622] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-01T20:05:17.702430] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-01T20:05:18.122116] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T20:05:18.502351] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-01T20:05:18.739483] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T20:05:19.302425] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-01T20:05:20.038615] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T20:05:20.102355] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-01T20:05:20.240357] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-01T20:05:20.902401] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-01T20:05:21.618016] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T20:05:21.702358] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-01T20:05:21.852591] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T20:05:22.413271] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T20:05:22.502388] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-01T20:05:23.202215] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T20:05:23.302383] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-01T20:05:24.102379] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-01T20:05:24.221020] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-01T20:05:24.902460] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-01T20:05:24.902976] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T20:05:25.702399] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-01T20:05:25.746934] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T20:05:26.502441] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-01T20:05:27.302388] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-01T20:05:27.915216] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-01T20:05:27.916141] [INFO ] [REMOTE ] MCB: Full fetch complete (16351 records). [2025-10-01T20:05:27.916227] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-01T20:05:28.126475] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-01T20:05:28.227973] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T20:05:28.369929] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-01T20:05:28.370082] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-01T20:05:28.370517] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-01T20:05:28.370634] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-01T20:05:28.387562] [DEBUG] [LOCAL ] MCB: Trimmed 16351 records to 11400 (keeping 200 days of data) [2025-10-01T20:05:28.403210] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-01T20:05:28.492469] [DEBUG] [LOCAL ] MCB: Primary data saved (11400 records). [2025-10-01T20:05:28.492679] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-01T20:05:28.492795] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MCB took 29.4s. Estimated remaining: 2h 29m 40s. Rate: 7.1 symbols/min [2025-10-01T20:05:28.691349] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:28.695946] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-01T20:05:28.707417] [DEBUG] [LOCAL ] MCN: Loaded 8182 existing records from primary storage. [2025-10-01T20:05:28.707639] [INFO ] [MAIN ] MCN: Loaded 8182 existing records. [2025-10-01T20:05:28.903461] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-01T20:05:28.908502] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:05:28.909227] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-01T20:05:28.909312] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-01T20:05:28.909539] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-01T20:05:28.909598] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-01T20:05:29.312722] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:29.552990] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T20:05:29.702440] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-01T20:05:30.502379] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-01T20:05:31.066421] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-01T20:05:31.302407] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-01T20:05:31.793260] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-01T20:05:32.034017] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T20:05:32.102382] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-01T20:05:32.902401] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-01T20:05:33.697196] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T20:05:33.702335] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-01T20:05:33.743980] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T20:05:34.444333] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-01T20:05:34.502384] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-01T20:05:35.173801] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T20:05:35.302406] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-01T20:05:36.102421] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-01T20:05:36.725454] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T20:05:36.902393] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-01T20:05:37.702424] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-01T20:05:38.204011] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-01T20:05:38.205021] [INFO ] [REMOTE ] MCI: Full fetch complete (9931 records). [2025-10-01T20:05:38.205253] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-01T20:05:38.421087] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T20:05:38.508610] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-01T20:05:38.634013] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-01T20:05:38.717589] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-01T20:05:38.717709] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-01T20:05:38.718017] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-01T20:05:38.718080] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-01T20:05:38.718745] [DEBUG] [LOCAL ] MCI: Trimmed 9931 records to 6368 (keeping 200 days of data) [2025-10-01T20:05:38.762803] [DEBUG] [LOCAL ] MCI: Primary data saved (6368 records). [2025-10-01T20:05:38.762948] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-01T20:05:38.763040] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCI took 27.9s. Estimated remaining: 2h 29m 33s. Rate: 7.1 symbols/min [2025-10-01T20:05:38.959669] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:39.006671] [DEBUG] [LOCAL ] MCO: Loaded 39288 existing records from primary storage. [2025-10-01T20:05:39.007025] [INFO ] [MAIN ] MCO: Loaded 39288 existing records. [2025-10-01T20:05:39.202592] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:05:39.202822] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-01T20:05:39.202869] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-01T20:05:39.203449] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-01T20:05:39.203510] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-01T20:05:39.309866] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-01T20:05:39.591770] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:40.112717] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-01T20:05:40.122406] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T20:05:40.260952] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T20:05:40.902394] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-01T20:05:41.228363] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T20:05:41.702444] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-01T20:05:42.320394] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T20:05:42.502377] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-01T20:05:43.207276] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T20:05:43.248525] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T20:05:43.302375] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-01T20:05:44.102419] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-01T20:05:44.865482] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T20:05:44.902374] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-01T20:05:45.702389] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-01T20:05:45.802340] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T20:05:46.400144] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T20:05:46.502382] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-01T20:05:47.036568] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T20:05:47.302394] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-01T20:05:48.081111] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-01T20:05:48.102341] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-01T20:05:48.199701] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-01T20:05:48.902383] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-01T20:05:49.702413] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-01T20:05:50.436905] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-01T20:05:50.488407] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T20:05:50.502345] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-01T20:05:51.302398] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-01T20:05:51.366556] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T20:05:51.550351] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T20:05:51.551706] [INFO ] [REMOTE ] MCK: Full fetch complete (57302 records). [2025-10-01T20:05:51.551797] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-01T20:05:51.890286] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T20:05:51.983799] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-01T20:05:51.983879] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-01T20:05:51.984852] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-01T20:05:51.984947] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-01T20:05:51.986236] [DEBUG] [LOCAL ] MCK: Trimmed 57302 records to 39151 (keeping 200 days of data) [2025-10-01T20:05:52.102507] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-01T20:05:52.251373] [DEBUG] [LOCAL ] MCK: Primary data saved (39151 records). [2025-10-01T20:05:52.251519] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-01T20:05:52.251595] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCK took 36.4s. Estimated remaining: 2h 29m 28s. Rate: 7.1 symbols/min [2025-10-01T20:05:52.428095] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:52.438866] [DEBUG] [LOCAL ] MCR: Loaded 8737 existing records from primary storage. [2025-10-01T20:05:52.439130] [INFO ] [MAIN ] MCR: Loaded 8737 existing records. [2025-10-01T20:05:52.651355] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:05:52.651625] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-01T20:05:52.651720] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-01T20:05:52.651918] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-01T20:05:52.651979] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-01T20:05:52.907505] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-01T20:05:53.057346] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:53.702392] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-01T20:05:53.711514] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T20:05:54.183187] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-01T20:05:54.502411] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-01T20:05:54.863377] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T20:05:55.046351] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-01T20:05:55.047284] [INFO ] [REMOTE ] MCN: Full fetch complete (11675 records). [2025-10-01T20:05:55.047361] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-01T20:05:55.307573] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-01T20:05:55.462211] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-01T20:05:55.462291] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-01T20:05:55.462594] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-01T20:05:55.462634] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-01T20:05:55.463152] [DEBUG] [LOCAL ] MCN: Trimmed 11675 records to 8211 (keeping 200 days of data) [2025-10-01T20:05:55.513542] [DEBUG] [LOCAL ] MCN: Primary data saved (8211 records). [2025-10-01T20:05:55.513717] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-01T20:05:55.513816] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCN took 27.0s. Estimated remaining: 2h 29m 16s. Rate: 7.1 symbols/min [2025-10-01T20:05:55.697539] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:55.721494] [DEBUG] [LOCAL ] MCS: Loaded 20933 existing records from primary storage. [2025-10-01T20:05:55.721793] [INFO ] [MAIN ] MCS: Loaded 20933 existing records. [2025-10-01T20:05:55.917131] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:05:55.917365] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-01T20:05:55.917417] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-01T20:05:55.917771] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-01T20:05:55.917857] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-01T20:05:56.113801] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-01T20:05:56.316781] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:56.902398] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-01T20:05:57.184806] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T20:05:57.267893] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-01T20:05:57.270154] [INFO ] [REMOTE ] MCD: Full fetch complete (77032 records). [2025-10-01T20:05:57.270281] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-01T20:05:57.486395] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T20:05:57.487364] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-01T20:05:57.487454] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-01T20:05:57.487582] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-01T20:05:57.487751] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-01T20:05:57.487809] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-01T20:05:57.487960] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-01T20:05:57.488067] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCD took 52.4s. Estimated remaining: 2h 29m 2s. Rate: 7.1 symbols/min [2025-10-01T20:05:57.671374] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:05:57.694868] [DEBUG] [LOCAL ] MCY: Loaded 24490 existing records from primary storage. [2025-10-01T20:05:57.695139] [INFO ] [MAIN ] MCY: Loaded 24490 existing records. [2025-10-01T20:05:57.708263] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-01T20:05:57.892949] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:05:57.893352] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-01T20:05:57.893475] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-01T20:05:57.893997] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-01T20:05:57.894064] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-01T20:05:58.293821] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T20:05:58.317600] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:05:58.502374] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-01T20:05:58.869124] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T20:05:59.302348] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-01T20:05:59.404830] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T20:06:00.102432] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-01T20:06:00.902354] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-01T20:06:01.331071] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-01T20:06:01.549671] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T20:06:01.643226] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T20:06:01.702445] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-01T20:06:02.502422] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-01T20:06:03.302408] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-01T20:06:03.376635] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T20:06:04.102343] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-01T20:06:04.135436] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T20:06:04.368765] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T20:06:04.827230] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T20:06:04.902387] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-01T20:06:05.702387] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-01T20:06:06.375732] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T20:06:06.502376] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-01T20:06:06.726398] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T20:06:07.302389] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-01T20:06:07.971125] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T20:06:08.102397] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-01T20:06:08.135460] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T20:06:08.902436] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-01T20:06:09.251102] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T20:06:09.651097] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T20:06:09.702429] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-01T20:06:10.502432] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-01T20:06:10.742878] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:06:11.261185] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T20:06:11.302368] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-01T20:06:12.102400] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-01T20:06:12.508784] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T20:06:12.799233] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T20:06:12.902409] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-01T20:06:13.702397] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-01T20:06:14.502361] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-01T20:06:14.576587] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T20:06:14.746770] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:06:15.302421] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-01T20:06:15.784506] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T20:06:16.102418] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-01T20:06:16.377817] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T20:06:16.902359] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-01T20:06:17.219408] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T20:06:17.702412] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-01T20:06:17.835547] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T20:06:18.502443] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-01T20:06:19.002238] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T20:06:19.004103] [INFO ] [REMOTE ] MCO: Full fetch complete (56909 records). [2025-10-01T20:06:19.004218] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-01T20:06:19.306137] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-01T20:06:19.472978] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-01T20:06:19.472812] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T20:06:19.473239] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-01T20:06:19.481113] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-01T20:06:19.481561] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-01T20:06:19.483548] [DEBUG] [LOCAL ] MCO: Trimmed 56909 records to 39277 (keeping 200 days of data) [2025-10-01T20:06:19.746013] [DEBUG] [LOCAL ] MCO: Primary data saved (39277 records). [2025-10-01T20:06:19.746161] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-01T20:06:19.746243] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCO took 41.0s. Estimated remaining: 2h 29m 4s. Rate: 7.1 symbols/min [2025-10-01T20:06:20.102403] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-01T20:06:20.190912] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T20:06:20.902391] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-01T20:06:21.123604] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T20:06:21.124808] [INFO ] [REMOTE ] MCY: Full fetch complete (41512 records). [2025-10-01T20:06:21.124924] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-01T20:06:21.514260] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T20:06:21.562767] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-01T20:06:21.562861] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-01T20:06:21.564106] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-01T20:06:21.564195] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-01T20:06:21.565543] [DEBUG] [LOCAL ] MCY: Trimmed 41512 records to 24385 (keeping 200 days of data) [2025-10-01T20:06:21.711411] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-01T20:06:21.730556] [DEBUG] [LOCAL ] MCY: Primary data saved (24385 records). [2025-10-01T20:06:21.730721] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-01T20:06:21.730877] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCY took 24.2s. Estimated remaining: 2h 28m 51s. Rate: 7.1 symbols/min [2025-10-01T20:06:22.494335] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T20:06:22.502327] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-01T20:06:23.105980] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T20:06:23.302396] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-01T20:06:23.781179] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-01T20:06:23.782039] [INFO ] [REMOTE ] MCR: Full fetch complete (14101 records). [2025-10-01T20:06:23.782114] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-01T20:06:24.107487] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-01T20:06:24.256900] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-01T20:06:24.256981] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-01T20:06:24.257341] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-01T20:06:24.257382] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-01T20:06:24.257958] [DEBUG] [LOCAL ] MCR: Trimmed 14101 records to 8766 (keeping 200 days of data) [2025-10-01T20:06:24.315575] [DEBUG] [LOCAL ] MCR: Primary data saved (8766 records). [2025-10-01T20:06:24.315741] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-01T20:06:24.315831] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCR took 32.1s. Estimated remaining: 2h 28m 38s. Rate: 7.1 symbols/min [2025-10-01T20:06:25.379112] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T20:06:25.386150] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-01T20:06:26.400536] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T20:06:26.405982] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-01T20:06:27.266722] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T20:06:27.267806] [INFO ] [REMOTE ] MCS: Full fetch complete (30368 records). [2025-10-01T20:06:27.267923] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-01T20:06:27.683575] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-01T20:06:27.683753] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-01T20:06:27.684490] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-01T20:06:27.684556] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-01T20:06:27.685840] [DEBUG] [LOCAL ] MCS: Trimmed 30368 records to 20933 (keeping 200 days of data) [2025-10-01T20:06:27.821920] [DEBUG] [LOCAL ] MCS: Primary data saved (20933 records). [2025-10-01T20:06:27.822058] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-01T20:06:27.822178] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 32.3s. Estimated remaining: 2h 28m 25s. Rate: 7.1 symbols/min [2025-10-01T20:06:28.446606] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:06:28.535951] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:06:28.594165] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:06:28.625461] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:06:28.636748] [DEBUG] [LOCAL ] MDST: Loaded 5641 existing records from primary storage. [2025-10-01T20:06:28.637098] [INFO ] [MAIN ] MDST: Loaded 5641 existing records. [2025-10-01T20:06:28.902571] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:06:28.915883] [DEBUG] [LOCAL ] MDU: Loaded 47904 existing records from primary storage. [2025-10-01T20:06:28.916159] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-01T20:06:28.916698] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-01T20:06:28.931310] [DEBUG] [LOCAL ] MD: Loaded 38339 existing records from primary storage. [2025-10-01T20:06:28.931613] [INFO ] [MAIN ] MDU: Loaded 47904 existing records. [2025-10-01T20:06:28.938334] [INFO ] [MAIN ] MD: Loaded 38339 existing records. [2025-10-01T20:06:28.943847] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-01T20:06:28.961167] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-01T20:06:28.992454] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-01T20:06:28.967492] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-01T20:06:29.660732] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:06:29.707508] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-01T20:06:29.714779] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-01T20:06:29.773265] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:06:29.795133] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:06:29.795426] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-01T20:06:29.795580] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-01T20:06:29.795382] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-01T20:06:29.810110] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-01T20:06:29.816592] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-01T20:06:29.938136] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-01T20:06:29.948954] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-01T20:06:29.999940] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-01T20:06:30.031733] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-01T20:06:30.106580] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-01T20:06:30.602613] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:06:30.733892] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-01T20:06:31.053864] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:06:31.158329] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-01T20:06:31.367227] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:06:31.388767] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-01T20:06:31.388293] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:06:31.389891] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-01T20:06:31.454619] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T20:06:31.457951] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-01T20:06:32.055090] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T20:06:32.057238] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-01T20:06:32.639018] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T20:06:32.641014] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-01T20:06:32.771753] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T20:06:32.781224] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-01T20:06:32.901571] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T20:06:32.911965] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-01T20:06:33.102432] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T20:06:33.135491] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T20:06:33.702439] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-01T20:06:34.195924] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T20:06:34.500819] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T20:06:34.510243] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-01T20:06:35.302355] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-01T20:06:35.597241] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T20:06:35.935712] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T20:06:36.102395] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-01T20:06:36.822079] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T20:06:36.902356] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-01T20:06:37.196887] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T20:06:37.702395] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-01T20:06:38.502404] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-01T20:06:38.630535] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T20:06:39.130850] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T20:06:39.302384] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-01T20:06:40.102358] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-01T20:06:40.305388] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T20:06:40.756429] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T20:06:40.810417] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T20:06:40.902351] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-01T20:06:41.702420] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-01T20:06:41.889598] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T20:06:42.502413] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-01T20:06:43.302371] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-01T20:06:43.469583] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T20:06:43.864564] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-01T20:06:43.897031] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T20:06:44.102384] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-01T20:06:44.902399] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-01T20:06:45.702357] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-01T20:06:46.032374] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T20:06:46.502470] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-01T20:06:46.596624] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T20:06:46.882426] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-01T20:06:47.117091] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T20:06:47.302372] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-01T20:06:48.102386] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-01T20:06:48.902356] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-01T20:06:48.939396] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T20:06:49.702367] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-01T20:06:50.051982] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T20:06:50.196614] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T20:06:50.502396] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-01T20:06:50.630384] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T20:06:51.302394] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-01T20:06:52.102378] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-01T20:06:52.364410] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T20:06:52.902374] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-01T20:06:52.961487] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T20:06:53.517523] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-01T20:06:53.525300] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T20:06:53.702418] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-01T20:06:54.502487] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-01T20:06:55.302349] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-01T20:06:55.525559] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T20:06:55.584285] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T20:06:55.585751] [INFO ] [REMOTE ] MD: Full fetch complete (55165 records). [2025-10-01T20:06:55.585860] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-01T20:06:56.010628] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-01T20:06:56.010762] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-01T20:06:56.011936] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-01T20:06:56.012002] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-01T20:06:56.013327] [DEBUG] [LOCAL ] MD: Trimmed 55165 records to 38329 (keeping 200 days of data) [2025-10-01T20:06:56.104823] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-01T20:06:56.248143] [DEBUG] [LOCAL ] MD: Primary data saved (38329 records). [2025-10-01T20:06:56.248285] [INFO ] [MAIN ] MD: Full history saved. [2025-10-01T20:06:56.248404] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MD took 28.4s. Estimated remaining: 2h 28m 33s. Rate: 7.1 symbols/min [2025-10-01T20:06:56.429398] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:06:56.440335] [DEBUG] [LOCAL ] MDV: Loaded 8512 existing records from primary storage. [2025-10-01T20:06:56.440583] [INFO ] [MAIN ] MDV: Loaded 8512 existing records. [2025-10-01T20:06:56.645922] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:06:56.646175] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-01T20:06:56.646223] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-01T20:06:56.646475] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-01T20:06:56.646549] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-01T20:06:56.910231] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-01T20:06:56.980599] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T20:06:57.055943] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:06:57.255251] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T20:06:57.702396] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-01T20:06:58.330841] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T20:06:58.502408] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-01T20:06:58.626577] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T20:06:59.120473] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T20:06:59.302371] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-01T20:07:00.102555] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-01T20:07:00.902366] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-01T20:07:01.285435] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T20:07:01.408929] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T20:07:01.410541] [INFO ] [REMOTE ] MDU: Full fetch complete (70373 records). [2025-10-01T20:07:01.410693] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-01T20:07:01.529191] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T20:07:01.550435] [INFO ] [REMOTE ] MDST: Full fetch complete (8589 records). [2025-10-01T20:07:01.576903] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-01T20:07:01.707523] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-01T20:07:02.104011] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-01T20:07:02.172284] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-01T20:07:02.189973] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-01T20:07:02.190104] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-01T20:07:02.233775] [DEBUG] [LOCAL ] MDU: Trimmed 70373 records to 47936 (keeping 200 days of data) [2025-10-01T20:07:02.420563] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-01T20:07:02.427684] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-01T20:07:02.432926] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-01T20:07:02.433263] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-01T20:07:02.450005] [DEBUG] [LOCAL ] MDST: Trimmed 8589 records to 5682 (keeping 200 days of data) [2025-10-01T20:07:02.538568] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-01T20:07:02.547089] [DEBUG] [LOCAL ] MDST: Primary data saved (5682 records). [2025-10-01T20:07:02.556592] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-01T20:07:02.589573] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T20:07:02.589223] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MDST took 34.8s. Estimated remaining: 2h 28m 22s. Rate: 7.1 symbols/min [2025-10-01T20:07:02.790957] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:02.815575] [DEBUG] [LOCAL ] MEC: Loaded 16312 existing records from primary storage. [2025-10-01T20:07:02.816623] [INFO ] [MAIN ] MEC: Loaded 16312 existing records. [2025-10-01T20:07:03.060032] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:03.065924] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-01T20:07:03.066545] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-01T20:07:03.069228] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-01T20:07:03.069311] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-01T20:07:03.203691] [DEBUG] [LOCAL ] MDU: Primary data saved (47936 records). [2025-10-01T20:07:03.219158] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-01T20:07:03.219324] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MDU took 35.4s. Estimated remaining: 2h 28m 8s. Rate: 7.1 symbols/min [2025-10-01T20:07:03.302510] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-01T20:07:03.649669] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:03.672829] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:07:03.693392] [DEBUG] [LOCAL ] MED: Loaded 21517 existing records from primary storage. [2025-10-01T20:07:03.693734] [INFO ] [MAIN ] MED: Loaded 21517 existing records. [2025-10-01T20:07:03.883713] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:03.883919] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-01T20:07:03.883969] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-01T20:07:03.884273] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-01T20:07:03.884334] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-01T20:07:04.112211] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-01T20:07:04.275276] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:07:04.284261] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T20:07:04.534717] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-01T20:07:04.902432] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-01T20:07:05.166212] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T20:07:05.702414] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-01T20:07:06.412131] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T20:07:06.414874] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-01T20:07:06.415006] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-01T20:07:06.507573] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-01T20:07:06.894105] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-01T20:07:06.895629] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T20:07:06.894873] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-01T20:07:06.902935] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-01T20:07:06.903922] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-01T20:07:06.905545] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-10-01T20:07:07.294829] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-01T20:07:07.294996] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-01T20:07:07.295106] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 39.5s. Estimated remaining: 2h 27m 56s. Rate: 7.1 symbols/min [2025-10-01T20:07:07.307508] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-01T20:07:07.536637] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:07.545342] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T20:07:07.578419] [DEBUG] [LOCAL ] MEG: Loaded 31793 existing records from primary storage. [2025-10-01T20:07:07.578727] [INFO ] [MAIN ] MEG: Loaded 31793 existing records. [2025-10-01T20:07:07.789992] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:07.790238] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-01T20:07:07.790289] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-01T20:07:07.790759] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-01T20:07:07.790822] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-01T20:07:08.104888] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-01T20:07:08.194310] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:07:08.469084] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T20:07:08.627819] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-01T20:07:08.902407] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-01T20:07:09.702400] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-01T20:07:10.097809] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T20:07:10.454279] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-01T20:07:10.502352] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-01T20:07:11.291959] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T20:07:11.302332] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-01T20:07:12.057736] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T20:07:12.102350] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-01T20:07:12.902394] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-01T20:07:13.209937] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T20:07:13.450332] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T20:07:13.702394] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-01T20:07:14.502384] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-01T20:07:15.093054] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T20:07:15.302388] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-01T20:07:15.336231] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-01T20:07:16.102425] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-01T20:07:16.329488] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T20:07:16.902406] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-01T20:07:17.155532] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T20:07:17.479099] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T20:07:17.480770] [INFO ] [REMOTE ] MDV: Full fetch complete (11628 records). [2025-10-01T20:07:17.480860] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-01T20:07:17.707504] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-01T20:07:17.882896] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-01T20:07:17.882981] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-01T20:07:17.883294] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-01T20:07:17.883337] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-01T20:07:17.883916] [DEBUG] [LOCAL ] MDV: Trimmed 11628 records to 8486 (keeping 200 days of data) [2025-10-01T20:07:17.944872] [DEBUG] [LOCAL ] MDV: Primary data saved (8486 records). [2025-10-01T20:07:17.945040] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-01T20:07:17.945162] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDV took 21.7s. Estimated remaining: 2h 27m 49s. Rate: 7.1 symbols/min [2025-10-01T20:07:18.124705] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:18.148518] [DEBUG] [LOCAL ] MEGI: Loaded 20119 existing records from primary storage. [2025-10-01T20:07:18.148818] [INFO ] [MAIN ] MEGI: Loaded 20119 existing records. [2025-10-01T20:07:18.360325] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:18.360605] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-01T20:07:18.360707] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-01T20:07:18.361186] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-01T20:07:18.361268] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-01T20:07:18.507572] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-01T20:07:18.789447] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:07:18.818056] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T20:07:19.302372] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-01T20:07:19.558751] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T20:07:20.102353] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-01T20:07:20.506067] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T20:07:20.902353] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-01T20:07:21.128625] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T20:07:21.702368] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-01T20:07:21.943564] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:07:22.502388] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-01T20:07:22.835839] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T20:07:23.044990] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-01T20:07:23.302424] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-01T20:07:24.102363] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-01T20:07:24.327506] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T20:07:24.902403] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-01T20:07:25.253421] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T20:07:25.702412] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-01T20:07:26.321457] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T20:07:26.502399] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-01T20:07:26.652741] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T20:07:27.302391] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-01T20:07:27.372139] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T20:07:28.102435] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-01T20:07:28.295624] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T20:07:28.751220] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T20:07:28.902378] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-01T20:07:29.702368] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-01T20:07:29.958048] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T20:07:30.502396] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-01T20:07:30.760083] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T20:07:31.302431] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-01T20:07:32.028065] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T20:07:32.102415] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-01T20:07:32.296544] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T20:07:32.902431] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-01T20:07:33.129723] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-01T20:07:33.702395] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-01T20:07:33.946383] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T20:07:34.502344] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-01T20:07:34.756160] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T20:07:35.273181] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-01T20:07:35.274405] [INFO ] [REMOTE ] MED: Full fetch complete (32637 records). [2025-10-01T20:07:35.274505] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-01T20:07:35.307541] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-01T20:07:35.693791] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-01T20:07:35.693922] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-01T20:07:35.694748] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-01T20:07:35.694815] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-01T20:07:35.695852] [DEBUG] [LOCAL ] MED: Trimmed 32637 records to 21517 (keeping 200 days of data) [2025-10-01T20:07:35.858879] [DEBUG] [LOCAL ] MED: Primary data saved (21517 records). [2025-10-01T20:07:35.859034] [INFO ] [MAIN ] MED: Full history saved. [2025-10-01T20:07:35.859161] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MED took 32.6s. Estimated remaining: 2h 27m 48s. Rate: 7.1 symbols/min [2025-10-01T20:07:36.050431] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:36.086316] [DEBUG] [LOCAL ] MEI: Loaded 32087 existing records from primary storage. [2025-10-01T20:07:36.086590] [INFO ] [MAIN ] MEI: Loaded 32087 existing records. [2025-10-01T20:07:36.109024] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-01T20:07:36.292330] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:36.292548] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-01T20:07:36.292599] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-01T20:07:36.292955] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-01T20:07:36.293019] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-01T20:07:36.698324] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T20:07:36.728619] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:07:36.899492] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T20:07:36.904163] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-01T20:07:37.702396] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-01T20:07:37.990018] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T20:07:38.333938] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T20:07:38.334861] [INFO ] [REMOTE ] MEC: Full fetch complete (22839 records). [2025-10-01T20:07:38.334933] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-01T20:07:38.507680] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-01T20:07:38.756081] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-01T20:07:38.756162] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-01T20:07:38.756737] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-01T20:07:38.756841] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-01T20:07:38.757726] [DEBUG] [LOCAL ] MEC: Trimmed 22839 records to 16283 (keeping 200 days of data) [2025-10-01T20:07:38.859983] [DEBUG] [LOCAL ] MEC: Primary data saved (16283 records). [2025-10-01T20:07:38.860129] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-01T20:07:38.860215] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 36.3s. Estimated remaining: 2h 27m 35s. Rate: 7.1 symbols/min [2025-10-01T20:07:39.041292] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:39.103611] [DEBUG] [LOCAL ] MET: Loaded 53310 existing records from primary storage. [2025-10-01T20:07:39.104000] [INFO ] [MAIN ] MET: Loaded 53310 existing records. [2025-10-01T20:07:39.291631] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:39.291878] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-01T20:07:39.291981] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-01T20:07:39.292403] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-01T20:07:39.292469] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-01T20:07:39.307574] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-01T20:07:39.691616] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:07:39.996591] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T20:07:40.102386] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-01T20:07:40.338257] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T20:07:40.902383] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-01T20:07:41.702408] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-01T20:07:41.844906] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T20:07:41.881462] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T20:07:42.502419] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-01T20:07:42.810183] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T20:07:43.296521] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T20:07:43.302884] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-01T20:07:44.102359] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-01T20:07:44.310615] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T20:07:44.902378] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-01T20:07:45.702436] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-01T20:07:45.802452] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T20:07:46.217946] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-01T20:07:46.219931] [INFO ] [REMOTE ] MEG: Full fetch complete (47977 records). [2025-10-01T20:07:46.220093] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-01T20:07:46.506322] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-01T20:07:46.767692] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-01T20:07:46.767896] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-01T20:07:46.769108] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-01T20:07:46.776996] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-01T20:07:46.793860] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T20:07:46.804828] [DEBUG] [LOCAL ] MEG: Trimmed 47977 records to 31808 (keeping 200 days of data) [2025-10-01T20:07:47.010889] [DEBUG] [LOCAL ] MEG: Primary data saved (31808 records). [2025-10-01T20:07:47.011065] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-01T20:07:47.011171] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MEG took 39.7s. Estimated remaining: 2h 27m 26s. Rate: 7.1 symbols/min [2025-10-01T20:07:47.203113] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:47.247440] [DEBUG] [LOCAL ] MFA: Loaded 45453 existing records from primary storage. [2025-10-01T20:07:47.247810] [INFO ] [MAIN ] MFA: Loaded 45453 existing records. [2025-10-01T20:07:47.311765] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-01T20:07:47.455743] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:47.456137] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-01T20:07:47.456324] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-01T20:07:47.462113] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-01T20:07:47.471336] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-01T20:07:47.478214] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T20:07:47.889130] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:07:48.102390] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-01T20:07:48.885468] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T20:07:48.902334] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-01T20:07:49.702403] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-01T20:07:49.776859] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T20:07:50.502350] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-01T20:07:50.707256] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T20:07:50.894963] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T20:07:51.302395] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-01T20:07:51.916625] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T20:07:52.102394] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-01T20:07:52.902358] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-01T20:07:53.151014] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T20:07:53.438990] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T20:07:53.702386] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-01T20:07:54.170123] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T20:07:54.502373] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-01T20:07:55.302399] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-01T20:07:55.525474] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T20:07:55.926915] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T20:07:56.101820] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T20:07:56.110812] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-01T20:07:56.902402] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-01T20:07:57.702379] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-01T20:07:57.737004] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T20:07:58.046044] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T20:07:58.502364] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-01T20:07:58.520186] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T20:07:58.521152] [INFO ] [REMOTE ] MEGI: Full fetch complete (30444 records). [2025-10-01T20:07:58.521224] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-01T20:07:58.923501] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-01T20:07:58.923584] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-01T20:07:58.924295] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-01T20:07:58.924359] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-01T20:07:58.925144] [DEBUG] [LOCAL ] MEGI: Trimmed 30444 records to 20116 (keeping 200 days of data) [2025-10-01T20:07:59.059234] [DEBUG] [LOCAL ] MEGI: Primary data saved (20116 records). [2025-10-01T20:07:59.059423] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-01T20:07:59.059529] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEGI took 41.1s. Estimated remaining: 2h 27m 21s. Rate: 7.1 symbols/min [2025-10-01T20:07:59.242327] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:07:59.249725] [DEBUG] [LOCAL ] MFAN: Loaded 4223 existing records from primary storage. [2025-10-01T20:07:59.249917] [INFO ] [MAIN ] MFAN: Loaded 4223 existing records. [2025-10-01T20:07:59.310983] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-01T20:07:59.455040] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:07:59.455315] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-01T20:07:59.455388] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-01T20:07:59.455709] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-01T20:07:59.455806] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-01T20:07:59.849717] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:08:00.080020] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T20:08:00.102342] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-01T20:08:00.902375] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-01T20:08:01.168703] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T20:08:01.331637] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-01T20:08:01.683759] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T20:08:01.702366] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-01T20:08:02.502385] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-01T20:08:03.302364] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-01T20:08:03.394566] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T20:08:03.579488] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T20:08:03.688569] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-01T20:08:04.102443] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-01T20:08:04.902392] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-01T20:08:05.249159] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T20:08:05.702423] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-01T20:08:06.149587] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-01T20:08:06.502342] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-01T20:08:06.699459] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T20:08:07.302401] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-01T20:08:07.908684] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T20:08:08.102401] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-01T20:08:08.703989] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-01T20:08:08.705688] [INFO ] [REMOTE ] MET: Full fetch complete (77117 records). [2025-10-01T20:08:08.705909] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-01T20:08:08.907613] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-01T20:08:09.229783] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-01T20:08:09.229886] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-01T20:08:09.231089] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-01T20:08:09.231158] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-01T20:08:09.232827] [DEBUG] [LOCAL ] MET: Trimmed 77117 records to 53311 (keeping 200 days of data) [2025-10-01T20:08:09.375585] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T20:08:09.473986] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-01T20:08:09.628467] [DEBUG] [LOCAL ] MET: Primary data saved (53311 records). [2025-10-01T20:08:09.628608] [INFO ] [MAIN ] MET: Full history saved. [2025-10-01T20:08:09.628719] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MET took 30.8s. Estimated remaining: 2h 27m 14s. Rate: 7.1 symbols/min [2025-10-01T20:08:09.707587] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-01T20:08:09.829912] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:08:09.836168] [DEBUG] [LOCAL ] MFAO: Loaded 3793 existing records from primary storage. [2025-10-01T20:08:09.836354] [INFO ] [MAIN ] MFAO: Loaded 3793 existing records. [2025-10-01T20:08:10.061387] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:08:10.061687] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-01T20:08:10.061763] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-01T20:08:10.062054] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-01T20:08:10.062117] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-01T20:08:10.480601] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:08:10.502406] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-01T20:08:10.919687] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-01T20:08:11.302387] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-01T20:08:11.524858] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T20:08:12.066214] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T20:08:12.102379] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-01T20:08:12.705715] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T20:08:12.902407] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-01T20:08:13.458371] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T20:08:13.702369] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-01T20:08:14.232381] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T20:08:14.502417] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-01T20:08:15.302401] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-01T20:08:16.077401] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T20:08:16.102372] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-01T20:08:16.701252] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T20:08:16.902387] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-01T20:08:17.366500] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T20:08:17.482031] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T20:08:17.702441] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-01T20:08:18.320325] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T20:08:18.502384] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-01T20:08:19.302393] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-01T20:08:19.880172] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T20:08:19.979602] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T20:08:20.102416] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-01T20:08:20.902407] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-01T20:08:21.135548] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T20:08:21.136823] [INFO ] [REMOTE ] MEI: Full fetch complete (45456 records). [2025-10-01T20:08:21.136917] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-01T20:08:21.439287] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T20:08:21.575570] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-01T20:08:21.575698] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-01T20:08:21.576551] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-01T20:08:21.576617] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-01T20:08:21.577716] [DEBUG] [LOCAL ] MEI: Trimmed 45456 records to 32017 (keeping 200 days of data) [2025-10-01T20:08:21.728194] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-01T20:08:21.775186] [DEBUG] [LOCAL ] MEI: Primary data saved (32017 records). [2025-10-01T20:08:21.775345] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-01T20:08:21.775439] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEI took 45.9s. Estimated remaining: 2h 27m 8s. Rate: 7.1 symbols/min [2025-10-01T20:08:21.971475] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:08:22.023147] [DEBUG] [LOCAL ] MFC: Loaded 51177 existing records from primary storage. [2025-10-01T20:08:22.023497] [INFO ] [MAIN ] MFC: Loaded 51177 existing records. [2025-10-01T20:08:22.253384] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:08:22.253624] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-01T20:08:22.253710] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-01T20:08:22.253997] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-01T20:08:22.254077] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-01T20:08:22.371201] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T20:08:22.510745] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-01T20:08:22.651418] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:08:23.125859] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-01T20:08:23.302391] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-01T20:08:23.738019] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-01T20:08:23.738978] [INFO ] [REMOTE ] MFAN: Full fetch complete (5696 records). [2025-10-01T20:08:23.739064] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-01T20:08:24.107466] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-01T20:08:24.140749] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-01T20:08:24.141587] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-01T20:08:24.141851] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-01T20:08:24.141914] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-01T20:08:24.142331] [DEBUG] [LOCAL ] MFAN: Trimmed 5696 records to 4236 (keeping 200 days of data) [2025-10-01T20:08:24.170111] [DEBUG] [LOCAL ] MFAN: Primary data saved (4236 records). [2025-10-01T20:08:24.170219] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-01T20:08:24.170303] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFAN took 25.1s. Estimated remaining: 2h 26m 55s. Rate: 7.1 symbols/min [2025-10-01T20:08:24.359169] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:08:24.412759] [DEBUG] [LOCAL ] MFG: Loaded 49131 existing records from primary storage. [2025-10-01T20:08:24.413100] [INFO ] [MAIN ] MFG: Loaded 49131 existing records. [2025-10-01T20:08:24.608932] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:08:24.609218] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-01T20:08:24.609287] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-01T20:08:24.609782] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-01T20:08:24.609845] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-01T20:08:24.763008] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T20:08:24.907589] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-01T20:08:25.038971] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:08:25.702392] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-01T20:08:26.502369] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-01T20:08:26.663877] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T20:08:26.874686] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T20:08:26.876327] [INFO ] [REMOTE ] MFA: Full fetch complete (65169 records). [2025-10-01T20:08:26.876473] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-01T20:08:27.309267] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-01T20:08:27.335601] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-01T20:08:27.335736] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-01T20:08:27.336914] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-01T20:08:27.337078] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-01T20:08:27.338737] [DEBUG] [LOCAL ] MFA: Trimmed 65169 records to 45479 (keeping 200 days of data) [2025-10-01T20:08:27.625461] [DEBUG] [LOCAL ] MFA: Primary data saved (45479 records). [2025-10-01T20:08:27.625634] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-01T20:08:27.625787] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFA took 40.6s. Estimated remaining: 2h 26m 43s. Rate: 7.1 symbols/min [2025-10-01T20:08:27.841675] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T20:08:27.839952] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:08:27.867677] [DEBUG] [LOCAL ] MFM: Loaded 14379 existing records from primary storage. [2025-10-01T20:08:27.867942] [INFO ] [MAIN ] MFM: Loaded 14379 existing records. [2025-10-01T20:08:28.065692] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:08:28.065925] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-01T20:08:28.065973] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-01T20:08:28.066220] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-01T20:08:28.066305] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-01T20:08:28.107585] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-01T20:08:28.473076] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:08:28.902417] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-01T20:08:29.063012] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T20:08:29.227405] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T20:08:29.427778] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T20:08:29.702384] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-01T20:08:30.502408] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-01T20:08:31.179489] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T20:08:31.302369] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-01T20:08:31.476595] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T20:08:32.102422] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-01T20:08:32.818477] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T20:08:32.866036] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T20:08:32.902399] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-01T20:08:33.702403] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-01T20:08:34.278530] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T20:08:34.475756] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T20:08:34.502384] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-01T20:08:34.832930] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-01T20:08:35.302386] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-01T20:08:35.748914] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-01T20:08:36.102391] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-01T20:08:36.697488] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T20:08:36.902405] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-01T20:08:37.702404] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-01T20:08:38.041876] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-01T20:08:38.329199] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T20:08:38.502487] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-01T20:08:39.302398] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-01T20:08:39.657287] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T20:08:40.102385] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-01T20:08:40.902368] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-01T20:08:41.205510] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T20:08:41.328581] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-01T20:08:41.329326] [INFO ] [REMOTE ] MFAO: Full fetch complete (5302 records). [2025-10-01T20:08:41.329397] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-01T20:08:41.707588] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-01T20:08:41.772199] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-01T20:08:41.772326] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-01T20:08:41.772555] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-01T20:08:41.772693] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-01T20:08:41.773530] [DEBUG] [LOCAL ] MFAO: Trimmed 5302 records to 3828 (keeping 200 days of data) [2025-10-01T20:08:41.800195] [DEBUG] [LOCAL ] MFAO: Primary data saved (3828 records). [2025-10-01T20:08:41.800311] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-01T20:08:41.800408] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 32.2s. Estimated remaining: 2h 26m 38s. Rate: 7.1 symbols/min [2025-10-01T20:08:42.001163] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:08:42.034624] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-01T20:08:42.034964] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-01T20:08:42.037100] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T20:08:42.037294] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-01T20:08:42.037423] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-01T20:08:42.049613] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-01T20:08:42.049740] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-01T20:08:42.489049] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:08:42.502341] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-01T20:08:42.619004] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-01T20:08:43.302385] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-01T20:08:44.102357] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-01T20:08:44.172053] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T20:08:44.329840] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T20:08:44.902378] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-01T20:08:45.346396] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T20:08:45.578926] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T20:08:45.702388] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-01T20:08:46.502385] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-01T20:08:47.302354] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-01T20:08:47.406247] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T20:08:47.448172] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T20:08:48.102388] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-01T20:08:48.429635] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-01T20:08:48.597110] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T20:08:48.902383] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-01T20:08:49.703114] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T20:08:49.702352] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-01T20:08:50.502392] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-01T20:08:51.302361] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-01T20:08:51.450219] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T20:08:51.534279] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-01T20:08:51.695700] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T20:08:52.102382] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-01T20:08:52.413290] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-01T20:08:52.902382] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-01T20:08:53.702348] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-01T20:08:53.719885] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:08:54.502395] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-01T20:08:55.088685] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T20:08:55.250998] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-01T20:08:55.252200] [INFO ] [REMOTE ] MFM: Full fetch complete (19561 records). [2025-10-01T20:08:55.252288] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-01T20:08:55.308861] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-01T20:08:55.648031] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-01T20:08:55.648132] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-01T20:08:55.648616] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-01T20:08:55.648699] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-01T20:08:55.649470] [DEBUG] [LOCAL ] MFM: Trimmed 19561 records to 14610 (keeping 200 days of data) [2025-10-01T20:08:55.738861] [DEBUG] [LOCAL ] MFM: Primary data saved (14610 records). [2025-10-01T20:08:55.739005] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-01T20:08:55.739091] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFM took 28.1s. Estimated remaining: 2h 26m 34s. Rate: 7.1 symbols/min [2025-10-01T20:08:55.934596] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:08:55.943493] [DEBUG] [LOCAL ] MFSG: Loaded 5340 existing records from primary storage. [2025-10-01T20:08:55.943762] [INFO ] [MAIN ] MFSG: Loaded 5340 existing records. [2025-10-01T20:08:56.107561] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-01T20:08:56.151587] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:08:56.151883] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-01T20:08:56.151951] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-01T20:08:56.152173] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-01T20:08:56.152234] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-01T20:08:56.578985] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:08:56.902391] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-01T20:08:57.095737] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T20:08:57.219375] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-01T20:08:57.702356] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-01T20:08:57.922043] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T20:08:58.005686] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-01T20:08:58.502380] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-01T20:08:58.741926] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-01T20:08:59.302450] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-01T20:09:00.102383] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-01T20:09:00.888893] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T20:09:00.902336] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-01T20:09:01.667716] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T20:09:01.670430] [INFO ] [REMOTE ] MFC: Full fetch complete (74180 records). [2025-10-01T20:09:01.670631] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-01T20:09:01.707583] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-01T20:09:02.140809] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T20:09:02.143972] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-01T20:09:02.145563] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-01T20:09:02.146818] [INFO ] [REMOTE ] MFG: Full fetch complete (68813 records). [2025-10-01T20:09:02.146950] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-01T20:09:02.147079] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-01T20:09:02.148258] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-01T20:09:02.148500] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-01T20:09:02.262134] [DEBUG] [LOCAL ] MFC: Trimmed 74180 records to 51162 (keeping 200 days of data) [2025-10-01T20:09:02.505801] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-01T20:09:02.714164] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-01T20:09:02.714816] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-01T20:09:02.718345] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-01T20:09:02.721505] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-01T20:09:02.727129] [DEBUG] [LOCAL ] MFG: Trimmed 68813 records to 49225 (keeping 200 days of data) [2025-10-01T20:09:02.886710] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-01T20:09:03.179705] [DEBUG] [LOCAL ] MFC: Primary data saved (51162 records). [2025-10-01T20:09:03.179882] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-01T20:09:03.180051] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFC took 41.4s. Estimated remaining: 2h 26m 25s. Rate: 7.1 symbols/min [2025-10-01T20:09:03.305483] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-01T20:09:03.404889] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:09:03.459874] [DEBUG] [LOCAL ] MFSI: Loaded 11363 existing records from primary storage. [2025-10-01T20:09:03.460786] [INFO ] [MAIN ] MFSI: Loaded 11363 existing records. [2025-10-01T20:09:03.670539] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:09:03.672826] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-01T20:09:03.673562] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-01T20:09:03.675529] [DEBUG] [LOCAL ] MFG: Primary data saved (49225 records). [2025-10-01T20:09:03.675608] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-01T20:09:03.675731] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFG took 39.5s. Estimated remaining: 2h 26m 10s. Rate: 7.1 symbols/min [2025-10-01T20:09:03.675784] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-01T20:09:03.675987] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-01T20:09:03.782720] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T20:09:04.107571] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-01T20:09:04.166460] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:09:04.235783] [DEBUG] [LOCAL ] MFSV: Loaded 2521 existing records from primary storage. [2025-10-01T20:09:04.247101] [INFO ] [MAIN ] MFSV: Loaded 2521 existing records. [2025-10-01T20:09:04.441601] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:09:04.531006] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:09:04.531328] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-01T20:09:04.531392] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-01T20:09:04.531560] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-01T20:09:04.531628] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-01T20:09:04.689679] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T20:09:04.904702] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-01T20:09:04.932015] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:09:05.473798] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T20:09:05.702414] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-01T20:09:06.196027] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-01T20:09:06.502387] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-01T20:09:06.934636] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T20:09:07.302448] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-01T20:09:07.668755] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-01T20:09:08.102416] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-01T20:09:08.570784] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-01T20:09:08.571819] [INFO ] [REMOTE ] MFSB: Full fetch complete (1668 records). [2025-10-01T20:09:08.571942] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-01T20:09:08.794150] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-01T20:09:08.794361] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-01T20:09:08.794434] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-01T20:09:08.794508] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-01T20:09:08.794574] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-01T20:09:08.794612] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-01T20:09:08.794713] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-01T20:09:08.794839] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFSB took 27.0s. Estimated remaining: 2h 25m 59s. Rate: 7.1 symbols/min [2025-10-01T20:09:08.905360] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-01T20:09:08.981763] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:09:08.999348] [DEBUG] [LOCAL ] MG: Loaded 16406 existing records from primary storage. [2025-10-01T20:09:08.999596] [INFO ] [MAIN ] MG: Loaded 16406 existing records. [2025-10-01T20:09:09.204203] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:09:09.204807] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-01T20:09:09.204873] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-01T20:09:09.205188] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-01T20:09:09.205252] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-01T20:09:09.326102] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-01T20:09:09.607482] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:09:09.702393] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-01T20:09:10.272827] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T20:09:10.502437] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-01T20:09:10.914745] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-01T20:09:11.302382] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-01T20:09:11.925546] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T20:09:12.102431] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-01T20:09:12.486823] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-01T20:09:12.902380] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-01T20:09:13.323115] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T20:09:13.702407] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-01T20:09:14.157104] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T20:09:14.502388] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-01T20:09:15.106186] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T20:09:15.302399] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-01T20:09:15.939927] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T20:09:16.102390] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-01T20:09:16.902359] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-01T20:09:17.129819] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T20:09:17.669409] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T20:09:17.702402] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-01T20:09:18.388956] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T20:09:18.502418] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-01T20:09:19.302368] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-01T20:09:19.537738] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T20:09:19.620053] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-01T20:09:20.102391] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-01T20:09:20.548707] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T20:09:20.902388] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-01T20:09:21.534048] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T20:09:21.702411] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-01T20:09:22.504723] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-01T20:09:22.507908] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T20:09:23.102960] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T20:09:23.302416] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-01T20:09:23.878835] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T20:09:24.102384] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-01T20:09:24.882895] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T20:09:24.902348] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-01T20:09:25.702439] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-01T20:09:25.887962] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T20:09:26.072091] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-01T20:09:26.502411] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-01T20:09:27.302402] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-01T20:09:27.445279] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T20:09:28.015068] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T20:09:28.102347] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-01T20:09:28.903173] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-01T20:09:28.903372] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-01T20:09:28.905008] [INFO ] [REMOTE ] MFSG: Full fetch complete (6075 records). [2025-10-01T20:09:28.905181] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-01T20:09:29.353959] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-01T20:09:29.354041] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-01T20:09:29.354229] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-01T20:09:29.354270] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-01T20:09:29.354688] [DEBUG] [LOCAL ] MFSG: Trimmed 6075 records to 5380 (keeping 200 days of data) [2025-10-01T20:09:29.391385] [DEBUG] [LOCAL ] MFSG: Primary data saved (5380 records). [2025-10-01T20:09:29.391505] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-01T20:09:29.391592] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSG took 33.7s. Estimated remaining: 2h 26m 0s. Rate: 7.1 symbols/min [2025-10-01T20:09:29.608960] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:09:29.663411] [DEBUG] [LOCAL ] MGA: Loaded 50634 existing records from primary storage. [2025-10-01T20:09:29.663770] [INFO ] [MAIN ] MGA: Loaded 50634 existing records. [2025-10-01T20:09:29.707531] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-01T20:09:29.887312] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T20:09:29.898495] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:09:29.899100] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-01T20:09:29.899155] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-01T20:09:29.899626] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-01T20:09:29.899727] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-01T20:09:30.314086] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:09:30.341118] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T20:09:30.502384] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-01T20:09:31.302450] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-01T20:09:32.102432] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-01T20:09:32.383113] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T20:09:32.780419] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-01T20:09:32.781963] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T20:09:32.902373] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-01T20:09:33.702417] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-01T20:09:34.484837] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T20:09:34.502333] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-01T20:09:34.749689] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T20:09:35.302368] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-01T20:09:35.734045] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-01T20:09:35.734760] [INFO ] [REMOTE ] MFSV: Full fetch complete (3196 records). [2025-10-01T20:09:35.734831] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-01T20:09:36.119083] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-01T20:09:36.170092] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-01T20:09:36.171336] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-01T20:09:36.171532] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-01T20:09:36.171598] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-01T20:09:36.172264] [DEBUG] [LOCAL ] MFSV: Trimmed 3196 records to 2553 (keeping 200 days of data) [2025-10-01T20:09:36.188949] [DEBUG] [LOCAL ] MFSV: Primary data saved (2553 records). [2025-10-01T20:09:36.189088] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-01T20:09:36.189717] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSV took 32.5s. Estimated remaining: 2h 25m 50s. Rate: 7.1 symbols/min [2025-10-01T20:09:36.373336] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:09:36.405959] [DEBUG] [LOCAL ] MGF: Loaded 4201 existing records from primary storage. [2025-10-01T20:09:36.407098] [INFO ] [MAIN ] MGF: Loaded 4201 existing records. [2025-10-01T20:09:36.410046] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T20:09:36.623405] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:09:36.623605] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-01T20:09:36.623678] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-01T20:09:36.623941] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-01T20:09:36.624002] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-01T20:09:36.909768] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-01T20:09:37.006936] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T20:09:37.043774] [INFO ] [REMOTE ] MFSI: Full fetch complete (13667 records). [2025-10-01T20:09:37.043622] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:09:37.043998] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-01T20:09:37.435550] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-01T20:09:37.435631] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-01T20:09:37.436023] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-01T20:09:37.436079] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-01T20:09:37.436606] [DEBUG] [LOCAL ] MFSI: Trimmed 13667 records to 11442 (keeping 200 days of data) [2025-10-01T20:09:37.508467] [DEBUG] [LOCAL ] MFSI: Primary data saved (11442 records). [2025-10-01T20:09:37.508611] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-01T20:09:37.508725] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 34.3s. Estimated remaining: 2h 25m 36s. Rate: 7.1 symbols/min [2025-10-01T20:09:37.692251] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:09:37.702396] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-01T20:09:37.750662] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-10-01T20:09:37.751027] [INFO ] [MAIN ] MGM: Loaded 53608 existing records. [2025-10-01T20:09:37.954274] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:09:37.954876] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-01T20:09:37.955053] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-01T20:09:37.955767] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-01T20:09:37.955830] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-01T20:09:38.120016] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T20:09:38.366547] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T20:09:38.407783] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:09:38.502418] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-01T20:09:39.302426] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-01T20:09:40.022677] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T20:09:40.102378] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-01T20:09:40.340496] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:09:40.739173] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T20:09:40.902388] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-01T20:09:41.702387] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-01T20:09:42.201008] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-01T20:09:42.492075] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T20:09:42.502596] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-01T20:09:42.932834] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T20:09:43.302395] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-01T20:09:44.081959] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T20:09:44.102343] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-01T20:09:44.621584] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-01T20:09:44.902386] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-01T20:09:45.702393] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-01T20:09:46.273422] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T20:09:46.502440] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-01T20:09:46.873148] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T20:09:47.302443] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-01T20:09:48.102388] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-01T20:09:48.365844] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T20:09:48.585906] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T20:09:48.902387] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-01T20:09:49.014455] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T20:09:49.702380] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-01T20:09:50.293680] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T20:09:50.502358] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-01T20:09:50.620907] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T20:09:51.302614] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T20:09:51.302704] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-01T20:09:52.102376] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-01T20:09:52.902388] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-01T20:09:52.966286] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T20:09:53.475793] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T20:09:53.493832] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T20:09:53.702408] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-01T20:09:54.502378] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-01T20:09:55.252005] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-01T20:09:55.253174] [INFO ] [REMOTE ] MG: Full fetch complete (24031 records). [2025-10-01T20:09:55.253255] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-01T20:09:55.307494] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-01T20:09:55.692940] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-01T20:09:55.693106] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-01T20:09:55.693696] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-01T20:09:55.693863] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-01T20:09:55.695177] [DEBUG] [LOCAL ] MG: Trimmed 24031 records to 16389 (keeping 200 days of data) [2025-10-01T20:09:55.793697] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T20:09:55.830565] [DEBUG] [LOCAL ] MG: Primary data saved (16389 records). [2025-10-01T20:09:55.830738] [INFO ] [MAIN ] MG: Full history saved. [2025-10-01T20:09:55.830838] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 47.0s. Estimated remaining: 2h 25m 35s. Rate: 7.1 symbols/min [2025-10-01T20:09:56.013810] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:09:56.023092] [DEBUG] [LOCAL ] MGR: Loaded 5591 existing records from primary storage. [2025-10-01T20:09:56.023276] [INFO ] [MAIN ] MGR: Loaded 5591 existing records. [2025-10-01T20:09:56.107566] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-01T20:09:56.214016] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:09:56.214242] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-01T20:09:56.214290] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-01T20:09:56.214587] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-01T20:09:56.214724] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-01T20:09:56.604779] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:09:56.902380] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-01T20:09:56.958471] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T20:09:57.637878] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T20:09:57.702396] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-01T20:09:58.115598] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T20:09:58.502402] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-01T20:09:59.090835] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T20:09:59.302449] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-01T20:09:59.366663] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T20:09:59.911087] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T20:10:00.102375] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-01T20:10:00.656246] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T20:10:00.902405] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-01T20:10:01.702459] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-01T20:10:02.263170] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T20:10:02.264761] [INFO ] [REMOTE ] MGA: Full fetch complete (73703 records). [2025-10-01T20:10:02.264863] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-01T20:10:02.373368] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-01T20:10:02.387502] [INFO ] [REMOTE ] MGF: Full fetch complete (5895 records). [2025-10-01T20:10:02.387632] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-01T20:10:02.506306] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-01T20:10:03.053146] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-01T20:10:03.053302] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-01T20:10:03.054424] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-01T20:10:03.054934] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-01T20:10:03.144426] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-01T20:10:03.144767] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-01T20:10:03.144899] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-01T20:10:03.144942] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-01T20:10:03.145391] [DEBUG] [LOCAL ] MGF: Trimmed 5895 records to 4260 (keeping 200 days of data) [2025-10-01T20:10:03.145777] [DEBUG] [LOCAL ] MGA: Trimmed 73703 records to 50657 (keeping 200 days of data) [2025-10-01T20:10:03.276484] [DEBUG] [LOCAL ] MGF: Primary data saved (4260 records). [2025-10-01T20:10:03.277673] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T20:10:03.277787] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-01T20:10:03.281729] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 27.1s. Estimated remaining: 2h 25m 26s. Rate: 7.1 symbols/min [2025-10-01T20:10:03.302344] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-01T20:10:03.501224] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:03.516046] [DEBUG] [LOCAL ] MGRB: Loaded 4058 existing records from primary storage. [2025-10-01T20:10:03.569504] [INFO ] [MAIN ] MGRB: Loaded 4058 existing records. [2025-10-01T20:10:03.812608] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:10:03.814497] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-01T20:10:03.815180] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-01T20:10:03.816070] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-01T20:10:03.816462] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-01T20:10:03.953845] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T20:10:04.104089] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-01T20:10:04.250435] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:04.330293] [DEBUG] [LOCAL ] MGA: Primary data saved (50657 records). [2025-10-01T20:10:04.330510] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-01T20:10:04.330621] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGA took 34.9s. Estimated remaining: 2h 25m 12s. Rate: 7.1 symbols/min [2025-10-01T20:10:04.520660] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:04.525633] [DEBUG] [LOCAL ] MGRD: Loaded 2230 existing records from primary storage. [2025-10-01T20:10:04.525837] [INFO ] [MAIN ] MGRD: Loaded 2230 existing records. [2025-10-01T20:10:04.730848] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:10:04.737143] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-01T20:10:04.737520] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-01T20:10:04.737425] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T20:10:04.739402] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-01T20:10:04.740329] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-01T20:10:04.907494] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-01T20:10:05.173811] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:05.702419] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-01T20:10:06.248292] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-01T20:10:06.502413] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-01T20:10:06.863165] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-01T20:10:06.884304] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-01T20:10:07.302383] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-01T20:10:08.102406] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-01T20:10:08.161826] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T20:10:08.902441] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-01T20:10:09.559792] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-01T20:10:09.702378] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-01T20:10:10.110208] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-01T20:10:10.392098] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T20:10:10.502392] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-01T20:10:10.912362] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T20:10:11.302397] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-01T20:10:11.950863] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T20:10:12.102420] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-01T20:10:12.711260] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T20:10:12.902397] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-01T20:10:13.452695] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T20:10:13.702404] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-01T20:10:14.502454] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-01T20:10:15.302427] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-01T20:10:15.323173] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T20:10:15.601192] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T20:10:15.800097] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-01T20:10:16.102433] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-01T20:10:16.902428] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-01T20:10:17.508585] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T20:10:17.702363] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-01T20:10:17.764667] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T20:10:18.319833] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T20:10:18.502404] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-01T20:10:19.302425] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-01T20:10:19.928145] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T20:10:20.102379] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-01T20:10:20.327270] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T20:10:20.422478] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-01T20:10:20.902397] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-01T20:10:21.315326] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-01T20:10:21.316155] [INFO ] [REMOTE ] MGR: Full fetch complete (8271 records). [2025-10-01T20:10:21.316253] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-01T20:10:21.702418] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-01T20:10:21.736551] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-01T20:10:21.736686] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-01T20:10:21.736949] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-01T20:10:21.736992] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-01T20:10:21.737452] [DEBUG] [LOCAL ] MGR: Trimmed 8271 records to 5614 (keeping 200 days of data) [2025-10-01T20:10:21.777316] [DEBUG] [LOCAL ] MGR: Primary data saved (5614 records). [2025-10-01T20:10:21.777461] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-01T20:10:21.777578] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGR took 25.9s. Estimated remaining: 2h 25m 10s. Rate: 7.1 symbols/min [2025-10-01T20:10:21.990918] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:22.001157] [DEBUG] [LOCAL ] MGRE: Loaded 6679 existing records from primary storage. [2025-10-01T20:10:22.001371] [INFO ] [MAIN ] MGRE: Loaded 6679 existing records. [2025-10-01T20:10:22.194572] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:10:22.194800] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-01T20:10:22.194849] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-01T20:10:22.195053] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-01T20:10:22.195111] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-01T20:10:22.309799] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T20:10:22.505172] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-01T20:10:22.590937] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:22.977333] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T20:10:23.302430] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-01T20:10:23.746063] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-01T20:10:24.102385] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-01T20:10:24.559248] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-01T20:10:24.902396] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-01T20:10:25.326167] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T20:10:25.702385] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-01T20:10:26.289356] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T20:10:26.502413] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-01T20:10:27.107761] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T20:10:27.302397] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-01T20:10:27.976693] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T20:10:28.102412] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-01T20:10:28.902420] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-01T20:10:29.481445] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-01T20:10:29.702416] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-01T20:10:29.717078] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-01T20:10:29.719150] [INFO ] [REMOTE ] MGM: Full fetch complete (77602 records). [2025-10-01T20:10:29.719283] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-01T20:10:30.160548] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-01T20:10:30.160638] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-01T20:10:30.161847] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-01T20:10:30.161915] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-01T20:10:30.163408] [DEBUG] [LOCAL ] MGM: Trimmed 77602 records to 53608 (keeping 200 days of data) [2025-10-01T20:10:30.169931] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-01T20:10:30.170713] [INFO ] [REMOTE ] MGRD: Full fetch complete (3522 records). [2025-10-01T20:10:30.170794] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-01T20:10:30.508031] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-01T20:10:30.696291] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-01T20:10:30.696806] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-01T20:10:30.696981] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-01T20:10:30.697321] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-01T20:10:30.699495] [DEBUG] [LOCAL ] MGRD: Trimmed 3522 records to 2238 (keeping 200 days of data) [2025-10-01T20:10:30.721552] [DEBUG] [LOCAL ] MGRD: Primary data saved (2238 records). [2025-10-01T20:10:30.722350] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-01T20:10:30.722806] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGRD took 26.4s. Estimated remaining: 2h 25m 2s. Rate: 7.1 symbols/min [2025-10-01T20:10:30.932262] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:31.092370] [DEBUG] [LOCAL ] MGY: Loaded 52425 existing records from primary storage. [2025-10-01T20:10:31.093933] [INFO ] [MAIN ] MGY: Loaded 52425 existing records. [2025-10-01T20:10:31.298458] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T20:10:31.312894] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-01T20:10:31.395794] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:10:31.396073] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-01T20:10:31.396164] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-01T20:10:31.397120] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-01T20:10:31.397580] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-01T20:10:31.790314] [DEBUG] [LOCAL ] MGM: Primary data saved (53608 records). [2025-10-01T20:10:31.853138] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:31.848932] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-01T20:10:31.853750] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGM took 54.3s. Estimated remaining: 2h 24m 48s. Rate: 7.1 symbols/min [2025-10-01T20:10:31.937956] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T20:10:32.054762] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:32.054961] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-01T20:10:32.054999] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-01T20:10:32.055116] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-01T20:10:32.055157] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-01T20:10:32.055199] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-01T20:10:32.055234] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-01T20:10:32.107476] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-01T20:10:32.459147] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:32.902393] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-01T20:10:33.598723] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T20:10:33.644743] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T20:10:33.702356] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-01T20:10:34.502424] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-01T20:10:34.707461] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:10:34.707823] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-01T20:10:34.711574] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:10:34.711671] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-01T20:10:34.711740] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:10:34.711814] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-01T20:10:34.711894] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-01T20:10:34.711950] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-01T20:10:34.711995] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-01T20:10:34.712044] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MH took 2.9s. Estimated remaining: 2h 24m 35s. Rate: 7.1 symbols/min [2025-10-01T20:10:34.902916] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:34.919353] [DEBUG] [LOCAL ] MHD: Loaded 12259 existing records from primary storage. [2025-10-01T20:10:34.919629] [INFO ] [MAIN ] MHD: Loaded 12259 existing records. [2025-10-01T20:10:35.137964] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:10:35.138265] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-01T20:10:35.138364] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-01T20:10:35.138721] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-01T20:10:35.138784] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-01T20:10:35.312061] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-01T20:10:35.566260] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:35.597504] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T20:10:36.050265] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T20:10:36.102375] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-01T20:10:36.761473] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T20:10:36.902368] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-01T20:10:37.676636] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T20:10:37.702361] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-01T20:10:38.308801] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T20:10:38.502447] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-01T20:10:39.184344] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T20:10:39.302438] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-01T20:10:39.727231] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T20:10:40.102393] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-01T20:10:40.209332] [DEBUG] [REMOTE ] MGRB: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-01T20:10:40.209727] [WARN ] [REMOTE ] MGRB: No data returned for month 2025-10 [2025-10-01T20:10:40.209866] [FATAL] [REMOTE ] MGRB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:10:40.209973] [FATAL] [MAIN ] MGRB: Failed to fetch primary data. [2025-10-01T20:10:40.210043] [WARN ] [MAIN ] MGRB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:10:40.210142] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-01T20:10:40.210224] [DEBUG] [LOCAL ] MGRB: No primary data file found to delete. [2025-10-01T20:10:40.210267] [INFO ] [LOCAL ] MGRB: Starting deletion of derivative data. [2025-10-01T20:10:40.210811] [DEBUG] [LOCAL ] MGRB: Deleted derivative data file. [2025-10-01T20:10:40.210922] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRB took 36.9s. Estimated remaining: 2h 24m 24s. Rate: 7.1 symbols/min [2025-10-01T20:10:40.406437] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:40.418074] [DEBUG] [LOCAL ] MHF: Loaded 8721 existing records from primary storage. [2025-10-01T20:10:40.418273] [INFO ] [MAIN ] MHF: Loaded 8721 existing records. [2025-10-01T20:10:40.616065] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:10:40.616318] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-01T20:10:40.616375] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-01T20:10:40.616553] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-01T20:10:40.616611] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-01T20:10:40.907520] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-01T20:10:41.003477] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:41.702441] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-01T20:10:42.434192] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T20:10:42.502360] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-01T20:10:42.626807] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T20:10:43.130514] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T20:10:43.302389] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-01T20:10:44.052205] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T20:10:44.102371] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-01T20:10:44.834226] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T20:10:44.902382] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-01T20:10:45.380856] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T20:10:45.702387] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-01T20:10:46.502362] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-01T20:10:46.723948] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T20:10:46.988703] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-01T20:10:46.989453] [INFO ] [REMOTE ] MGRE: Full fetch complete (9489 records). [2025-10-01T20:10:46.989524] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-01T20:10:47.306356] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-01T20:10:47.397367] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-01T20:10:47.397471] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-01T20:10:47.397788] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-01T20:10:47.397910] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-01T20:10:47.398500] [DEBUG] [LOCAL ] MGRE: Trimmed 9489 records to 6698 (keeping 200 days of data) [2025-10-01T20:10:47.443141] [DEBUG] [LOCAL ] MGRE: Primary data saved (6698 records). [2025-10-01T20:10:47.443300] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-01T20:10:47.443393] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRE took 25.7s. Estimated remaining: 2h 24m 15s. Rate: 7.1 symbols/min [2025-10-01T20:10:47.639052] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:10:47.692991] [DEBUG] [LOCAL ] MHK: Loaded 42249 existing records from primary storage. [2025-10-01T20:10:47.693370] [INFO ] [MAIN ] MHK: Loaded 42249 existing records. [2025-10-01T20:10:47.906079] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:10:47.906295] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-01T20:10:47.906352] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-01T20:10:47.906902] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-01T20:10:47.906964] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-01T20:10:48.109459] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-01T20:10:48.294012] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:10:48.902403] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-01T20:10:48.930681] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T20:10:49.078777] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T20:10:49.443890] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T20:10:49.702386] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-01T20:10:50.502368] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-01T20:10:50.616265] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T20:10:51.302375] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-01T20:10:52.102367] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-01T20:10:52.309939] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T20:10:52.756625] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T20:10:52.866448] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T20:10:52.902358] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-01T20:10:53.702435] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-01T20:10:54.469006] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T20:10:54.502350] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-01T20:10:54.815621] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T20:10:55.302390] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-01T20:10:56.102436] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-01T20:10:56.152028] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T20:10:56.769212] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T20:10:56.829421] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T20:10:56.902422] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-01T20:10:57.702424] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-01T20:10:58.288978] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T20:10:58.307936] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T20:10:58.502425] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-01T20:10:59.302357] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-01T20:10:59.538488] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T20:11:00.102423] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-01T20:11:00.894861] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T20:11:00.902339] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-01T20:11:01.059668] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T20:11:01.500121] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T20:11:01.702429] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-01T20:11:02.502372] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-01T20:11:03.262561] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T20:11:03.284041] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T20:11:03.302407] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-01T20:11:04.102456] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-01T20:11:04.902376] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-01T20:11:05.013046] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T20:11:05.039798] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T20:11:05.702418] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-01T20:11:06.502415] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-01T20:11:06.583663] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T20:11:06.614863] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T20:11:07.302447] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-01T20:11:07.325967] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T20:11:08.102428] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-01T20:11:08.630448] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T20:11:08.902395] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-01T20:11:09.404692] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T20:11:09.406283] [INFO ] [REMOTE ] MGY: Full fetch complete (75652 records). [2025-10-01T20:11:09.406432] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-01T20:11:09.500025] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-01T20:11:09.522362] [INFO ] [REMOTE ] MHF: Full fetch complete (12604 records). [2025-10-01T20:11:09.549977] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-01T20:11:09.709571] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-01T20:11:10.288392] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-01T20:11:10.298826] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-01T20:11:10.334412] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-01T20:11:10.342047] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-01T20:11:10.375540] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-01T20:11:10.375909] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-01T20:11:10.376242] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-01T20:11:10.376417] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-01T20:11:10.377329] [DEBUG] [LOCAL ] MHF: Trimmed 12604 records to 8704 (keeping 200 days of data) [2025-10-01T20:11:10.377818] [DEBUG] [LOCAL ] MGY: Trimmed 75652 records to 52421 (keeping 200 days of data) [2025-10-01T20:11:10.520271] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-01T20:11:10.556706] [DEBUG] [LOCAL ] MHF: Primary data saved (8704 records). [2025-10-01T20:11:10.557434] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-01T20:11:10.557559] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MHF took 30.3s. Estimated remaining: 2h 24m 18s. Rate: 7.1 symbols/min [2025-10-01T20:11:10.706732] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T20:11:10.779684] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:11:10.780171] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-01T20:11:10.780495] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-01T20:11:10.781531] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-01T20:11:10.782406] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-01T20:11:10.783096] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-01T20:11:10.783666] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-01T20:11:11.296698] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:11:11.302435] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-01T20:11:11.413808] [DEBUG] [LOCAL ] MGY: Primary data saved (52421 records). [2025-10-01T20:11:11.413981] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-01T20:11:11.414071] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MGY took 40.7s. Estimated remaining: 2h 24m 3s. Rate: 7.1 symbols/min [2025-10-01T20:11:11.633843] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:11:11.644964] [DEBUG] [LOCAL ] MHN: Loaded 7611 existing records from primary storage. [2025-10-01T20:11:11.645202] [INFO ] [MAIN ] MHN: Loaded 7611 existing records. [2025-10-01T20:11:11.701157] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-01T20:11:11.854930] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:11:11.855626] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-01T20:11:11.855806] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-01T20:11:11.856394] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-01T20:11:11.856554] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-01T20:11:12.041982] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T20:11:12.109732] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-01T20:11:12.310948] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:11:12.902402] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-01T20:11:13.309774] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-01T20:11:13.702367] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-01T20:11:13.992151] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T20:11:14.196127] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-01T20:11:14.502401] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-01T20:11:15.242067] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T20:11:15.302388] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-01T20:11:16.041206] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T20:11:16.102392] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-01T20:11:16.902427] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-01T20:11:17.657716] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T20:11:17.674827] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T20:11:17.702407] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-01T20:11:18.502446] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-01T20:11:18.622307] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T20:11:18.775081] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-01T20:11:19.302431] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-01T20:11:19.947734] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T20:11:20.102439] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-01T20:11:20.902395] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-01T20:11:21.275250] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-01T20:11:21.395961] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T20:11:21.702379] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-01T20:11:22.430721] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-01T20:11:22.432174] [INFO ] [REMOTE ] MHD: Full fetch complete (18827 records). [2025-10-01T20:11:22.432286] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-01T20:11:22.507530] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-01T20:11:22.893517] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-01T20:11:22.893602] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-01T20:11:22.894075] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-01T20:11:22.894139] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-01T20:11:22.894768] [DEBUG] [LOCAL ] MHD: Trimmed 18827 records to 12377 (keeping 200 days of data) [2025-10-01T20:11:22.975189] [DEBUG] [LOCAL ] MHD: Primary data saved (12377 records). [2025-10-01T20:11:22.975352] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-01T20:11:22.975482] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHD took 48.3s. Estimated remaining: 2h 23m 57s. Rate: 7.1 symbols/min [2025-10-01T20:11:23.185697] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:11:23.193852] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T20:11:23.219795] [DEBUG] [LOCAL ] MHO: Loaded 24027 existing records from primary storage. [2025-10-01T20:11:23.220095] [INFO ] [MAIN ] MHO: Loaded 24027 existing records. [2025-10-01T20:11:23.307530] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-01T20:11:23.448549] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:11:23.448973] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-01T20:11:23.449027] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-01T20:11:23.449464] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-01T20:11:23.449526] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-01T20:11:23.891527] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T20:11:23.896018] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:11:24.102387] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-01T20:11:24.867614] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T20:11:24.902356] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-01T20:11:25.702415] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-01T20:11:26.134412] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-01T20:11:26.135778] [INFO ] [REMOTE ] MHK: Full fetch complete (60778 records). [2025-10-01T20:11:26.135866] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-01T20:11:26.411981] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T20:11:26.507524] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-01T20:11:26.610987] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-01T20:11:26.611081] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-01T20:11:26.612176] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-01T20:11:26.612250] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-01T20:11:26.613613] [DEBUG] [LOCAL ] MHK: Trimmed 60778 records to 42192 (keeping 200 days of data) [2025-10-01T20:11:26.900205] [DEBUG] [LOCAL ] MHK: Primary data saved (42192 records). [2025-10-01T20:11:26.900346] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-01T20:11:26.900434] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHK took 39.5s. Estimated remaining: 2h 23m 45s. Rate: 7.1 symbols/min [2025-10-01T20:11:27.115580] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:11:27.115779] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-01T20:11:27.115826] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-01T20:11:27.115991] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-01T20:11:27.116041] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-01T20:11:27.116085] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-01T20:11:27.116120] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-01T20:11:27.303853] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-01T20:11:27.376001] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T20:11:27.551221] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:11:27.733754] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T20:11:28.102434] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-01T20:11:28.893472] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T20:11:28.902332] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-01T20:11:29.702441] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-01T20:11:29.745614] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T20:11:29.939823] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-01T20:11:30.502415] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-01T20:11:31.302474] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-01T20:11:31.503171] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:11:31.503547] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-01T20:11:31.503676] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:11:31.503738] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-01T20:11:31.503777] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:11:31.503852] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-01T20:11:31.503918] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-01T20:11:31.503956] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-01T20:11:31.504013] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-01T20:11:31.504098] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MIAX took 4.6s. Estimated remaining: 2h 23m 34s. Rate: 7.1 symbols/min [2025-10-01T20:11:31.749849] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:11:31.766694] [DEBUG] [LOCAL ] MIN: Loaded 13086 existing records from primary storage. [2025-10-01T20:11:31.766972] [INFO ] [MAIN ] MIN: Loaded 13086 existing records. [2025-10-01T20:11:32.014139] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:11:32.016067] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T20:11:32.025668] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-01T20:11:32.026753] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-01T20:11:32.027281] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-01T20:11:32.027346] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-01T20:11:32.107517] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-01T20:11:32.462534] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:11:32.485128] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-01T20:11:32.902398] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-01T20:11:33.702402] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-01T20:11:33.757228] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T20:11:34.502389] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-01T20:11:34.829679] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-01T20:11:35.045828] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T20:11:35.302387] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-01T20:11:35.776748] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-01T20:11:36.102411] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-01T20:11:36.902380] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-01T20:11:37.099592] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T20:11:37.391378] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-01T20:11:37.392491] [INFO ] [REMOTE ] MHN: Full fetch complete (11788 records). [2025-10-01T20:11:37.392606] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-01T20:11:37.707464] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-01T20:11:37.818236] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-01T20:11:37.818327] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-01T20:11:37.818612] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-01T20:11:37.818681] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-01T20:11:37.819157] [DEBUG] [LOCAL ] MHN: Trimmed 11788 records to 7578 (keeping 200 days of data) [2025-10-01T20:11:37.866399] [DEBUG] [LOCAL ] MHN: Primary data saved (7578 records). [2025-10-01T20:11:37.866582] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-01T20:11:37.866713] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHN took 26.5s. Estimated remaining: 2h 23m 24s. Rate: 7.1 symbols/min [2025-10-01T20:11:38.066052] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:11:38.120260] [DEBUG] [LOCAL ] MIR: Loaded 50989 existing records from primary storage. [2025-10-01T20:11:38.120608] [INFO ] [MAIN ] MIR: Loaded 50989 existing records. [2025-10-01T20:11:38.330148] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:11:38.330399] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-01T20:11:38.330451] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-01T20:11:38.331297] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-01T20:11:38.331370] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-01T20:11:38.512733] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-01T20:11:38.735529] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:11:39.033239] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T20:11:39.302350] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-01T20:11:39.337715] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T20:11:39.629939] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-01T20:11:39.630676] [INFO ] [REMOTE ] MHLA: Full fetch complete (1535 records). [2025-10-01T20:11:39.630761] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-01T20:11:39.851313] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-01T20:11:39.851602] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-01T20:11:39.851717] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-01T20:11:39.851821] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-01T20:11:39.851909] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-01T20:11:39.851950] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-01T20:11:39.851992] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-01T20:11:39.852070] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHLA took 29.3s. Estimated remaining: 2h 23m 11s. Rate: 7.1 symbols/min [2025-10-01T20:11:40.102414] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-01T20:11:40.647369] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T20:11:40.902387] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-01T20:11:41.702406] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-01T20:11:42.015264] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T20:11:42.226807] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-01T20:11:42.502389] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-01T20:11:43.302362] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-01T20:11:43.438797] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T20:11:44.102387] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-01T20:11:44.642673] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T20:11:44.908381] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-01T20:11:44.910436] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T20:11:45.702576] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-01T20:11:46.502387] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-01T20:11:46.614222] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T20:11:46.779175] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T20:11:47.272895] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T20:11:47.302359] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-01T20:11:48.102376] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-01T20:11:48.215541] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T20:11:48.902364] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-01T20:11:49.231997] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T20:11:49.702374] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-01T20:11:50.502449] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-01T20:11:50.539321] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T20:11:50.577092] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:11:51.302417] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-01T20:11:51.794633] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T20:11:52.102412] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-01T20:11:52.885990] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T20:11:52.902335] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-01T20:11:52.926175] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:11:53.702426] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-01T20:11:54.509261] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-01T20:11:54.529922] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T20:11:55.060558] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T20:11:55.269512] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-01T20:11:55.270589] [INFO ] [REMOTE ] MIN: Full fetch complete (17702 records). [2025-10-01T20:11:55.270695] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-01T20:11:55.309727] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-01T20:11:55.690863] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-01T20:11:55.690952] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-01T20:11:55.691396] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-01T20:11:55.691460] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-01T20:11:55.692091] [DEBUG] [LOCAL ] MIN: Trimmed 17702 records to 13146 (keeping 200 days of data) [2025-10-01T20:11:55.774736] [DEBUG] [LOCAL ] MIN: Primary data saved (13146 records). [2025-10-01T20:11:55.774884] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-01T20:11:55.774995] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIN took 24.3s. Estimated remaining: 2h 23m 8s. Rate: 7.1 symbols/min [2025-10-01T20:11:56.102436] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-01T20:11:56.323136] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T20:11:56.902387] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-01T20:11:57.553834] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T20:11:57.666260] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-01T20:11:57.667309] [INFO ] [REMOTE ] MHO: Full fetch complete (37298 records). [2025-10-01T20:11:57.667406] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-01T20:11:57.713320] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-01T20:11:58.077352] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-01T20:11:58.077460] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-01T20:11:58.078459] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-01T20:11:58.078739] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-01T20:11:58.080009] [DEBUG] [LOCAL ] MHO: Trimmed 37298 records to 23962 (keeping 200 days of data) [2025-10-01T20:11:58.231691] [DEBUG] [LOCAL ] MHO: Primary data saved (23962 records). [2025-10-01T20:11:58.231835] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-01T20:11:58.231936] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MHO took 35.3s. Estimated remaining: 2h 22m 55s. Rate: 7.1 symbols/min [2025-10-01T20:11:59.479267] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T20:11:59.490212] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-01T20:12:01.313554] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T20:12:01.324829] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-01T20:12:02.854612] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T20:12:02.871706] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-01T20:12:04.518195] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T20:12:04.531274] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-01T20:12:06.315925] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T20:12:06.327749] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-01T20:12:07.702873] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T20:12:07.704993] [INFO ] [REMOTE ] MIR: Full fetch complete (73442 records). [2025-10-01T20:12:07.705120] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-01T20:12:08.151114] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-01T20:12:08.151262] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-01T20:12:08.152399] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-01T20:12:08.152471] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-01T20:12:08.154117] [DEBUG] [LOCAL ] MIR: Trimmed 73442 records to 51020 (keeping 200 days of data) [2025-10-01T20:12:08.468083] [DEBUG] [LOCAL ] MIR: Primary data saved (51020 records). [2025-10-01T20:12:08.468241] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-01T20:12:08.468413] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIR took 30.6s. Estimated remaining: 2h 22m 48s. Rate: 7.1 symbols/min [2025-10-01T20:12:09.059729] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:09.112886] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:09.213376] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:09.246577] [DEBUG] [LOCAL ] MIY: Loaded 5968 existing records from primary storage. [2025-10-01T20:12:09.243478] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:09.247795] [INFO ] [MAIN ] MIY: Loaded 5968 existing records. [2025-10-01T20:12:09.247986] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-01T20:12:09.289000] [DEBUG] [LOCAL ] MITP: Loaded 2386 existing records from primary storage. [2025-10-01T20:12:09.270841] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-01T20:12:09.300710] [INFO ] [MAIN ] MITP: Loaded 2386 existing records. [2025-10-01T20:12:09.367826] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-01T20:12:09.404094] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-01T20:12:09.437362] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-01T20:12:09.437495] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-01T20:12:09.628529] [DEBUG] [LOCAL ] MITT: Loaded 22919 existing records from primary storage. [2025-10-01T20:12:09.660041] [INFO ] [MAIN ] MITT: Loaded 22919 existing records. [2025-10-01T20:12:09.867952] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:09.911067] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:09.927987] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-01T20:12:09.969151] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-01T20:12:09.989493] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-01T20:12:10.098852] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-01T20:12:10.099029] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-01T20:12:10.121105] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-01T20:12:10.146484] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-01T20:12:10.197809] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:10.196873] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-01T20:12:10.257582] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-01T20:12:10.312272] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-01T20:12:10.328031] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-01T20:12:10.455257] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-01T20:12:10.851408] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:10.892127] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-01T20:12:11.546804] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:11.567398] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-01T20:12:11.552376] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T20:12:11.590055] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-01T20:12:11.598181] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:11.615800] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-01T20:12:11.691929] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:11.692251] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-01T20:12:12.008388] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-01T20:12:12.009461] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-01T20:12:12.123056] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-01T20:12:12.124328] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-01T20:12:12.346044] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-01T20:12:12.347387] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-01T20:12:12.386110] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-01T20:12:12.389042] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-01T20:12:12.476131] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-01T20:12:12.477370] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-01T20:12:12.679564] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-01T20:12:12.686757] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-01T20:12:12.893992] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T20:12:12.895742] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-01T20:12:12.898413] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T20:12:12.901221] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-01T20:12:13.020098] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T20:12:13.022105] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-01T20:12:13.267632] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T20:12:13.448431] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-01T20:12:13.604230] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T20:12:13.702361] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-01T20:12:13.941384] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T20:12:13.986309] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-01T20:12:14.502426] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-01T20:12:15.164000] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T20:12:15.302409] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-01T20:12:15.824663] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-01T20:12:16.102396] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-01T20:12:16.424478] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-01T20:12:16.902423] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-01T20:12:17.691532] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T20:12:17.702387] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-01T20:12:18.373457] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T20:12:18.502390] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-01T20:12:19.263698] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T20:12:19.302354] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-01T20:12:20.102484] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-01T20:12:20.222943] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T20:12:20.437150] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-01T20:12:20.902386] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-01T20:12:21.323985] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-01T20:12:21.702384] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-01T20:12:22.298374] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T20:12:22.502442] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-01T20:12:23.151549] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T20:12:23.302460] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-01T20:12:23.937700] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T20:12:24.102412] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-01T20:12:24.902399] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-01T20:12:25.171365] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T20:12:25.230745] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-01T20:12:25.702407] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-01T20:12:26.115317] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-01T20:12:26.116019] [INFO ] [REMOTE ] MITN: Full fetch complete (2312 records). [2025-10-01T20:12:26.116134] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-01T20:12:26.311757] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T20:12:26.311998] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-01T20:12:26.312104] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-01T20:12:26.312200] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-01T20:12:26.312284] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-01T20:12:26.312337] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-01T20:12:26.312406] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-01T20:12:26.312469] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITN took 17.8s. Estimated remaining: 2h 22m 46s. Rate: 7.1 symbols/min [2025-10-01T20:12:26.503639] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:26.502603] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-01T20:12:26.577987] [DEBUG] [LOCAL ] MKC: Loaded 52440 existing records from primary storage. [2025-10-01T20:12:26.578336] [INFO ] [MAIN ] MKC: Loaded 52440 existing records. [2025-10-01T20:12:26.798946] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:26.799160] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-01T20:12:26.799210] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-01T20:12:26.799676] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-01T20:12:26.799739] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-01T20:12:26.895729] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-01T20:12:27.231934] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:27.302397] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-01T20:12:27.791150] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-01T20:12:27.792297] [INFO ] [REMOTE ] MIY: Full fetch complete (9007 records). [2025-10-01T20:12:27.792395] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-01T20:12:28.107461] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-01T20:12:28.226026] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-01T20:12:28.226116] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-01T20:12:28.226371] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-01T20:12:28.226412] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-01T20:12:28.226892] [DEBUG] [LOCAL ] MIY: Trimmed 9007 records to 5968 (keeping 200 days of data) [2025-10-01T20:12:28.264542] [DEBUG] [LOCAL ] MIY: Primary data saved (5968 records). [2025-10-01T20:12:28.264716] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-01T20:12:28.264820] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MIY took 19.8s. Estimated remaining: 2h 22m 33s. Rate: 7.1 symbols/min [2025-10-01T20:12:28.455713] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:28.499907] [DEBUG] [LOCAL ] MKL: Loaded 34021 existing records from primary storage. [2025-10-01T20:12:28.500269] [INFO ] [MAIN ] MKL: Loaded 34021 existing records. [2025-10-01T20:12:28.616684] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-01T20:12:28.707213] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:28.707584] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-01T20:12:28.707667] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-01T20:12:28.709248] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-01T20:12:28.709313] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-01T20:12:28.903783] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-01T20:12:29.127434] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:29.702398] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-01T20:12:30.177460] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T20:12:30.502387] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-01T20:12:31.302358] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-01T20:12:31.485734] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T20:12:31.803709] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T20:12:31.836079] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T20:12:32.102418] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-01T20:12:32.902390] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-01T20:12:33.486344] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T20:12:33.702372] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-01T20:12:34.502380] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-01T20:12:34.610290] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T20:12:34.937669] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T20:12:35.160082] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T20:12:35.302399] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-01T20:12:35.714501] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-01T20:12:35.715363] [INFO ] [REMOTE ] MITP: Full fetch complete (3363 records). [2025-10-01T20:12:35.715447] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-01T20:12:36.103822] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-01T20:12:36.152235] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-01T20:12:36.152359] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-01T20:12:36.152548] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-01T20:12:36.152625] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-01T20:12:36.153482] [DEBUG] [LOCAL ] MITP: Trimmed 3363 records to 2402 (keeping 200 days of data) [2025-10-01T20:12:36.178133] [DEBUG] [LOCAL ] MITP: Primary data saved (2402 records). [2025-10-01T20:12:36.178305] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-01T20:12:36.178443] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITP took 27.7s. Estimated remaining: 2h 22m 24s. Rate: 7.1 symbols/min [2025-10-01T20:12:36.365541] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:36.416799] [DEBUG] [LOCAL ] MLI: Loaded 43572 existing records from primary storage. [2025-10-01T20:12:36.417130] [INFO ] [MAIN ] MLI: Loaded 43572 existing records. [2025-10-01T20:12:36.616304] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:36.616569] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-01T20:12:36.616625] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-01T20:12:36.617551] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-01T20:12:36.617614] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-01T20:12:36.907689] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-01T20:12:37.018103] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:37.689518] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T20:12:37.702327] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-01T20:12:38.210433] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T20:12:38.502440] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-01T20:12:39.188004] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T20:12:39.302352] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-01T20:12:39.490152] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T20:12:40.102386] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-01T20:12:40.606721] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T20:12:40.902376] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-01T20:12:41.702385] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-01T20:12:41.858063] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T20:12:42.024462] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T20:12:42.502379] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-01T20:12:43.286119] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T20:12:43.302335] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-01T20:12:43.780839] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T20:12:44.102381] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-01T20:12:44.853780] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T20:12:44.902372] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-01T20:12:45.704536] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-01T20:12:45.707948] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T20:12:46.373472] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T20:12:46.502411] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-01T20:12:46.758506] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T20:12:47.302396] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-01T20:12:48.102404] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-01T20:12:48.425304] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T20:12:48.670960] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T20:12:48.902383] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-01T20:12:49.702351] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-01T20:12:49.893819] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T20:12:50.108893] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T20:12:50.502363] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-01T20:12:50.884467] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T20:12:51.302391] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-01T20:12:51.550995] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T20:12:51.552291] [INFO ] [REMOTE ] MKL: Full fetch complete (49567 records). [2025-10-01T20:12:51.552376] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-01T20:12:51.991334] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-01T20:12:51.991415] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-01T20:12:51.992216] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-01T20:12:51.992279] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-01T20:12:51.993413] [DEBUG] [LOCAL ] MKL: Trimmed 49567 records to 34014 (keeping 200 days of data) [2025-10-01T20:12:52.102405] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-01T20:12:52.226408] [DEBUG] [LOCAL ] MKL: Primary data saved (34014 records). [2025-10-01T20:12:52.226547] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-01T20:12:52.226681] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MKL took 24.0s. Estimated remaining: 2h 22m 21s. Rate: 7.1 symbols/min [2025-10-01T20:12:52.414551] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:52.454109] [DEBUG] [LOCAL ] MLM: Loaded 30109 existing records from primary storage. [2025-10-01T20:12:52.454439] [INFO ] [MAIN ] MLM: Loaded 30109 existing records. [2025-10-01T20:12:52.661789] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:52.662032] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-01T20:12:52.662083] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-01T20:12:52.662535] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-01T20:12:52.662597] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-01T20:12:52.906329] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-01T20:12:53.058286] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:12:53.107009] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T20:12:53.702430] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-01T20:12:53.874874] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T20:12:53.906199] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T20:12:54.502402] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-01T20:12:55.302402] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-01T20:12:55.542151] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-01T20:12:55.568765] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T20:12:56.102411] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-01T20:12:56.547330] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T20:12:56.902370] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-01T20:12:57.180247] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T20:12:57.702396] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-01T20:12:58.458224] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-01T20:12:58.459347] [INFO ] [REMOTE ] MITT: Full fetch complete (34854 records). [2025-10-01T20:12:58.459430] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-01T20:12:58.507435] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-01T20:12:58.690925] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T20:12:58.929687] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-01T20:12:58.929775] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-01T20:12:58.930463] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-01T20:12:58.930503] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-01T20:12:58.931444] [DEBUG] [LOCAL ] MITT: Trimmed 34854 records to 22930 (keeping 200 days of data) [2025-10-01T20:12:59.078045] [DEBUG] [LOCAL ] MITT: Primary data saved (22930 records). [2025-10-01T20:12:59.078174] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-01T20:12:59.078285] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MITT took 50.6s. Estimated remaining: 2h 22m 11s. Rate: 7.1 symbols/min [2025-10-01T20:12:59.261799] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:12:59.289062] [DEBUG] [LOCAL ] MLNK: Loaded 25422 existing records from primary storage. [2025-10-01T20:12:59.289399] [INFO ] [MAIN ] MLNK: Loaded 25422 existing records. [2025-10-01T20:12:59.311735] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-01T20:12:59.487893] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:12:59.488139] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-01T20:12:59.488187] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-01T20:12:59.488444] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-01T20:12:59.488502] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-01T20:12:59.895740] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:00.003524] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T20:13:00.102418] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-01T20:13:00.902376] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-01T20:13:01.031450] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T20:13:01.124296] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T20:13:01.702405] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-01T20:13:02.345749] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T20:13:02.502419] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-01T20:13:03.290863] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T20:13:03.302340] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-01T20:13:03.905754] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-01T20:13:03.910255] [INFO ] [REMOTE ] MKC: Full fetch complete (75569 records). [2025-10-01T20:13:03.910365] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-01T20:13:04.103260] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-01T20:13:04.337189] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-01T20:13:04.337287] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-01T20:13:04.338432] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-01T20:13:04.338499] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-01T20:13:04.340070] [DEBUG] [LOCAL ] MKC: Trimmed 75569 records to 52440 (keeping 200 days of data) [2025-10-01T20:13:04.683081] [DEBUG] [LOCAL ] MKC: Primary data saved (52440 records). [2025-10-01T20:13:04.683242] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-01T20:13:04.683352] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKC took 38.4s. Estimated remaining: 2h 22m 1s. Rate: 7.1 symbols/min [2025-10-01T20:13:04.903063] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-01T20:13:04.905026] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:13:04.908443] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T20:13:04.924288] [DEBUG] [LOCAL ] MLP: Loaded 2980 existing records from primary storage. [2025-10-01T20:13:04.924542] [INFO ] [MAIN ] MLP: Loaded 2980 existing records. [2025-10-01T20:13:05.117129] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:13:05.117362] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-01T20:13:05.117413] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-01T20:13:05.117718] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-01T20:13:05.117781] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-01T20:13:05.525483] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:05.544626] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T20:13:05.702429] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-01T20:13:06.118770] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T20:13:06.313836] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T20:13:06.502445] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-01T20:13:07.302420] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-01T20:13:07.899518] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T20:13:08.102363] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-01T20:13:08.327674] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T20:13:08.791389] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T20:13:08.902416] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-01T20:13:09.702400] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-01T20:13:10.164071] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T20:13:10.165846] [INFO ] [REMOTE ] MLI: Full fetch complete (63368 records). [2025-10-01T20:13:10.165957] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-01T20:13:10.502484] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-01T20:13:10.608950] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-01T20:13:10.609056] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-01T20:13:10.610152] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-01T20:13:10.610236] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-01T20:13:10.611628] [DEBUG] [LOCAL ] MLI: Trimmed 63368 records to 43527 (keeping 200 days of data) [2025-10-01T20:13:10.899745] [DEBUG] [LOCAL ] MLI: Primary data saved (43527 records). [2025-10-01T20:13:10.899878] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-01T20:13:10.899988] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 34.7s. Estimated remaining: 2h 21m 50s. Rate: 7.1 symbols/min [2025-10-01T20:13:11.091864] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:13:11.095603] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T20:13:11.111890] [DEBUG] [LOCAL ] MLR: Loaded 12551 existing records from primary storage. [2025-10-01T20:13:11.112142] [INFO ] [MAIN ] MLR: Loaded 12551 existing records. [2025-10-01T20:13:11.303252] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-01T20:13:11.335143] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:13:11.335507] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-01T20:13:11.335592] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-01T20:13:11.339879] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-01T20:13:11.339977] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-01T20:13:11.346776] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T20:13:11.742005] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:12.102415] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-01T20:13:12.202230] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:13:12.592817] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-01T20:13:12.902381] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-01T20:13:13.702378] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-01T20:13:13.740916] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T20:13:14.502446] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-01T20:13:15.081366] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T20:13:15.302450] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-01T20:13:15.638250] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:13:16.023866] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T20:13:16.102363] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-01T20:13:16.902365] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-01T20:13:17.302546] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T20:13:17.654149] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T20:13:17.702394] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-01T20:13:18.502393] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-01T20:13:18.670855] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T20:13:19.110806] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T20:13:19.302393] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-01T20:13:20.102423] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-01T20:13:20.641875] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-01T20:13:20.769575] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T20:13:20.902379] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-01T20:13:21.702367] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-01T20:13:21.718071] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T20:13:22.180787] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-01T20:13:22.502405] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-01T20:13:23.302423] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-01T20:13:23.555665] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T20:13:23.626376] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T20:13:24.102378] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-01T20:13:24.738909] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T20:13:24.902394] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-01T20:13:25.702398] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-01T20:13:26.075271] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T20:13:26.184049] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-01T20:13:26.184812] [INFO ] [REMOTE ] MLP: Full fetch complete (4572 records). [2025-10-01T20:13:26.184927] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-01T20:13:26.507483] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-01T20:13:26.591398] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-01T20:13:26.591533] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-01T20:13:26.591720] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-01T20:13:26.591782] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-01T20:13:26.592282] [DEBUG] [LOCAL ] MLP: Trimmed 4572 records to 2986 (keeping 200 days of data) [2025-10-01T20:13:26.610340] [DEBUG] [LOCAL ] MLP: Primary data saved (2986 records). [2025-10-01T20:13:26.610427] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-01T20:13:26.610517] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLP took 21.9s. Estimated remaining: 2h 21m 47s. Rate: 7.1 symbols/min [2025-10-01T20:13:26.802731] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:13:26.859224] [DEBUG] [LOCAL ] MMC: Loaded 51784 existing records from primary storage. [2025-10-01T20:13:26.859589] [INFO ] [MAIN ] MMC: Loaded 51784 existing records. [2025-10-01T20:13:27.052917] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:13:27.053220] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-01T20:13:27.053275] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-01T20:13:27.053907] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-01T20:13:27.053970] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-01T20:13:27.308384] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-01T20:13:27.452274] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:27.484603] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T20:13:28.090880] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T20:13:28.102326] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-01T20:13:28.852717] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T20:13:28.902346] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-01T20:13:29.603842] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T20:13:29.702396] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-01T20:13:30.502383] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-01T20:13:30.861860] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T20:13:31.302350] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-01T20:13:31.462951] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T20:13:32.102372] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-01T20:13:32.369304] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T20:13:32.902387] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-01T20:13:33.520819] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T20:13:33.702396] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-01T20:13:34.502392] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-01T20:13:34.646307] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T20:13:34.952725] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T20:13:35.302382] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-01T20:13:35.847731] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T20:13:35.984898] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T20:13:35.985853] [INFO ] [REMOTE ] MLR: Full fetch complete (18700 records). [2025-10-01T20:13:35.985925] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-01T20:13:36.107480] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-01T20:13:36.387349] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-01T20:13:36.387430] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-01T20:13:36.391285] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-01T20:13:36.391360] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-01T20:13:36.392123] [DEBUG] [LOCAL ] MLR: Trimmed 18700 records to 12504 (keeping 200 days of data) [2025-10-01T20:13:36.473316] [DEBUG] [LOCAL ] MLR: Primary data saved (12504 records). [2025-10-01T20:13:36.473467] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-01T20:13:36.473557] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLR took 25.6s. Estimated remaining: 2h 21m 40s. Rate: 7.1 symbols/min [2025-10-01T20:13:36.658061] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:13:36.673172] [DEBUG] [LOCAL ] MMD: Loaded 11403 existing records from primary storage. [2025-10-01T20:13:36.673417] [INFO ] [MAIN ] MMD: Loaded 11403 existing records. [2025-10-01T20:13:36.863182] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:13:36.863460] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-01T20:13:36.863507] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-01T20:13:36.863827] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-01T20:13:36.863887] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-01T20:13:36.908095] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-01T20:13:37.261833] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:37.522869] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T20:13:37.702379] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-01T20:13:38.502439] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-01T20:13:38.673595] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T20:13:39.004854] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T20:13:39.302395] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-01T20:13:39.681909] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T20:13:40.102380] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-01T20:13:40.902402] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-01T20:13:41.090778] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-01T20:13:41.092154] [INFO ] [REMOTE ] MLNK: Full fetch complete (35961 records). [2025-10-01T20:13:41.092243] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-01T20:13:41.464840] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-01T20:13:41.575993] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-01T20:13:41.576099] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-01T20:13:41.576865] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-01T20:13:41.576933] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-01T20:13:41.577906] [DEBUG] [LOCAL ] MLNK: Trimmed 35961 records to 25390 (keeping 200 days of data) [2025-10-01T20:13:41.703216] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-01T20:13:41.741070] [DEBUG] [LOCAL ] MLNK: Primary data saved (25390 records). [2025-10-01T20:13:41.741219] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-01T20:13:41.741329] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLNK took 42.7s. Estimated remaining: 2h 21m 29s. Rate: 7.1 symbols/min [2025-10-01T20:13:41.858482] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T20:13:41.901416] [INFO ] [REMOTE ] MLM: Full fetch complete (45584 records). [2025-10-01T20:13:41.915691] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-01T20:13:41.937524] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:13:42.148385] [DEBUG] [LOCAL ] MMI: Loaded 15065 existing records from primary storage. [2025-10-01T20:13:42.166790] [INFO ] [MAIN ] MMI: Loaded 15065 existing records. [2025-10-01T20:13:42.516366] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-01T20:13:42.631750] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:13:42.648843] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-01T20:13:42.649032] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-01T20:13:42.652007] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-01T20:13:42.652176] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-01T20:13:42.653331] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-01T20:13:42.653519] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-01T20:13:42.653428] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-01T20:13:42.665347] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-01T20:13:42.672002] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T20:13:42.712031] [DEBUG] [LOCAL ] MLM: Trimmed 45584 records to 29977 (keeping 200 days of data) [2025-10-01T20:13:43.202773] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:43.276703] [DEBUG] [LOCAL ] MLM: Primary data saved (29977 records). [2025-10-01T20:13:43.276843] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-01T20:13:43.276925] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLM took 51.1s. Estimated remaining: 2h 21m 15s. Rate: 7.1 symbols/min [2025-10-01T20:13:43.310352] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-01T20:13:43.468272] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:13:43.468535] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-01T20:13:43.468593] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-01T20:13:43.468748] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-01T20:13:43.468800] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-01T20:13:43.468849] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-01T20:13:43.468893] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-01T20:13:43.867268] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:44.102357] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-01T20:13:44.210314] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T20:13:44.598439] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-01T20:13:44.718051] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T20:13:44.902376] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-01T20:13:45.472620] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T20:13:45.702434] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-01T20:13:46.502400] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-01T20:13:46.721095] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:13:46.721400] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-01T20:13:46.721491] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:13:46.721542] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-01T20:13:46.721577] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:13:46.721616] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-01T20:13:46.721703] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-01T20:13:46.721755] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-01T20:13:46.721796] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-01T20:13:46.721844] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMID took 3.4s. Estimated remaining: 2h 21m 3s. Rate: 7.1 symbols/min [2025-10-01T20:13:46.916171] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:13:46.916394] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-01T20:13:46.916439] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-01T20:13:46.916557] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-01T20:13:46.916600] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-01T20:13:46.916666] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-01T20:13:46.916723] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-01T20:13:47.305006] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-01T20:13:47.319855] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:13:47.694571] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T20:13:47.903001] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T20:13:48.102417] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-01T20:13:48.902393] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-01T20:13:49.535811] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T20:13:49.702407] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-01T20:13:49.760404] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T20:13:50.498782] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T20:13:50.502501] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-01T20:13:51.302369] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-01T20:13:51.343531] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T20:13:52.102420] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-01T20:13:52.906893] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-01T20:13:52.909906] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T20:13:53.126467] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T20:13:53.702417] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-01T20:13:54.126311] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T20:13:54.502365] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-01T20:13:54.548021] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-01T20:13:55.302403] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-01T20:13:55.752112] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-01T20:13:56.102352] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-01T20:13:56.340027] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-01T20:13:56.831306] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T20:13:56.902400] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-01T20:13:57.702389] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-01T20:13:57.738408] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T20:13:58.016818] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-01T20:13:58.502437] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-01T20:13:59.302345] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-01T20:13:59.464158] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T20:14:00.031512] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T20:14:00.102465] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-01T20:14:00.570407] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T20:14:00.902393] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-01T20:14:01.274052] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T20:14:01.702401] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-01T20:14:02.502369] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-01T20:14:02.611190] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T20:14:02.946752] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T20:14:03.302466] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-01T20:14:04.102397] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-01T20:14:04.570559] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T20:14:04.902388] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-01T20:14:05.177612] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T20:14:05.347859] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-01T20:14:05.702391] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-01T20:14:06.502392] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-01T20:14:06.512851] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T20:14:07.302383] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-01T20:14:07.356954] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T20:14:08.096007] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T20:14:08.102354] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-01T20:14:08.902413] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-01T20:14:09.014396] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T20:14:09.702414] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-01T20:14:09.959056] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-01T20:14:10.482700] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T20:14:10.502355] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-01T20:14:11.302419] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-01T20:14:11.735340] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T20:14:11.966407] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T20:14:11.968030] [INFO ] [REMOTE ] MMC: Full fetch complete (74735 records). [2025-10-01T20:14:11.968146] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-01T20:14:12.107487] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-01T20:14:12.424018] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-01T20:14:12.424121] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-01T20:14:12.425420] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-01T20:14:12.425521] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-01T20:14:12.427281] [DEBUG] [LOCAL ] MMC: Trimmed 74735 records to 51794 (keeping 200 days of data) [2025-10-01T20:14:12.759982] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T20:14:12.763305] [INFO ] [REMOTE ] MMI: Full fetch complete (21064 records). [2025-10-01T20:14:12.763438] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-01T20:14:12.905305] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-01T20:14:13.189362] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-01T20:14:13.190005] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-01T20:14:13.192765] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-01T20:14:13.192843] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-01T20:14:13.195596] [DEBUG] [LOCAL ] MMC: Primary data saved (51794 records). [2025-10-01T20:14:13.196042] [DEBUG] [LOCAL ] MMI: Trimmed 21064 records to 15098 (keeping 200 days of data) [2025-10-01T20:14:13.195957] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-01T20:14:13.196297] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMC took 46.6s. Estimated remaining: 2h 21m 8s. Rate: 7.1 symbols/min [2025-10-01T20:14:13.467482] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:13.507635] [DEBUG] [LOCAL ] MMI: Primary data saved (15098 records). [2025-10-01T20:14:13.507819] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-01T20:14:13.507979] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMI took 31.8s. Estimated remaining: 2h 20m 54s. Rate: 7.1 symbols/min [2025-10-01T20:14:13.592283] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T20:14:13.612490] [INFO ] [REMOTE ] MMD: Full fetch complete (17911 records). [2025-10-01T20:14:13.647551] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-01T20:14:13.691491] [DEBUG] [LOCAL ] MMM: Loaded 53187 existing records from primary storage. [2025-10-01T20:14:13.728282] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-01T20:14:13.762053] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:13.762197] [INFO ] [MAIN ] MMM: Loaded 53187 existing records. [2025-10-01T20:14:14.224921] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:14:14.251009] [DEBUG] [LOCAL ] MMS: Loaded 33782 existing records from primary storage. [2025-10-01T20:14:14.256480] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-01T20:14:14.272086] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-01T20:14:14.277945] [INFO ] [MAIN ] MMS: Loaded 33782 existing records. [2025-10-01T20:14:14.296516] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-01T20:14:14.296724] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T20:14:14.335753] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-01T20:14:14.516876] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-01T20:14:14.571932] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-01T20:14:14.594471] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-01T20:14:14.648084] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-01T20:14:14.677585] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-01T20:14:14.757591] [DEBUG] [LOCAL ] MMD: Trimmed 17911 records to 11388 (keeping 200 days of data) [2025-10-01T20:14:14.757426] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:14:14.770385] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-01T20:14:14.770506] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-01T20:14:14.842275] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-01T20:14:14.864351] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-01T20:14:15.026247] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-01T20:14:15.097422] [INFO ] [REMOTE ] MMKT: Full fetch complete (2084 records). [2025-10-01T20:14:15.135044] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-01T20:14:15.561942] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:15.579131] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-01T20:14:15.656256] [DEBUG] [LOCAL ] MMD: Primary data saved (11388 records). [2025-10-01T20:14:15.696031] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-01T20:14:15.741366] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T20:14:15.771537] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMD took 39.3s. Estimated remaining: 2h 20m 41s. Rate: 7.1 symbols/min [2025-10-01T20:14:15.800165] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-01T20:14:15.803736] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-01T20:14:15.814770] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-01T20:14:15.814613] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:15.845330] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-01T20:14:15.881066] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-01T20:14:15.926852] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-01T20:14:15.927091] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMKT took 29.2s. Estimated remaining: 2h 20m 26s. Rate: 7.1 symbols/min [2025-10-01T20:14:16.123833] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:16.123929] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-01T20:14:16.213480] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:16.223709] [DEBUG] [LOCAL ] MMT: Loaded 10795 existing records from primary storage. [2025-10-01T20:14:16.223964] [INFO ] [MAIN ] MMT: Loaded 10795 existing records. [2025-10-01T20:14:16.354782] [DEBUG] [LOCAL ] MMU: Loaded 16779 existing records from primary storage. [2025-10-01T20:14:16.360300] [INFO ] [MAIN ] MMU: Loaded 16779 existing records. [2025-10-01T20:14:16.551983] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:14:16.552556] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-01T20:14:16.558078] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-01T20:14:16.578898] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-01T20:14:16.612758] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-01T20:14:16.637695] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:14:16.686861] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-01T20:14:16.710735] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-01T20:14:16.737525] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-01T20:14:16.756123] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-01T20:14:17.385128] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:17.396559] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-01T20:14:17.471908] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:17.702424] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-01T20:14:17.768736] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T20:14:17.869917] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-01T20:14:18.345763] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T20:14:18.502352] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-01T20:14:18.528529] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T20:14:19.302428] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-01T20:14:19.331516] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T20:14:20.102404] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-01T20:14:20.832385] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T20:14:20.902401] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-01T20:14:21.702385] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-01T20:14:21.878360] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T20:14:22.149318] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-01T20:14:22.458469] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T20:14:22.502388] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-01T20:14:23.302424] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-01T20:14:23.520403] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T20:14:24.102473] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-01T20:14:24.902466] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-01T20:14:25.137871] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T20:14:25.256739] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-01T20:14:25.702394] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-01T20:14:25.875393] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T20:14:26.502395] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-01T20:14:27.302348] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-01T20:14:27.379987] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T20:14:27.576102] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T20:14:28.102410] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-01T20:14:28.400935] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T20:14:28.902385] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-01T20:14:29.349101] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T20:14:29.550600] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T20:14:29.702390] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-01T20:14:30.502389] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-01T20:14:31.198865] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T20:14:31.302359] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-01T20:14:31.797228] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T20:14:31.998920] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T20:14:32.102477] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-01T20:14:32.902386] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-01T20:14:33.055259] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T20:14:33.702403] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-01T20:14:34.502387] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-01T20:14:34.928763] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T20:14:34.972317] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-01T20:14:35.302378] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-01T20:14:36.102382] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-01T20:14:36.302316] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T20:14:36.621121] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T20:14:36.902379] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-01T20:14:37.120865] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T20:14:37.702393] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-01T20:14:38.502377] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-01T20:14:38.595003] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T20:14:38.681798] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T20:14:39.266997] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T20:14:39.302387] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-01T20:14:39.957437] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T20:14:39.959957] [INFO ] [REMOTE ] MMU: Full fetch complete (25688 records). [2025-10-01T20:14:39.960059] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-01T20:14:40.107507] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-01T20:14:40.384926] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-01T20:14:40.385010] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-01T20:14:40.385615] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-01T20:14:40.385693] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-01T20:14:40.386381] [DEBUG] [LOCAL ] MMU: Trimmed 25688 records to 16842 (keeping 200 days of data) [2025-10-01T20:14:40.493440] [DEBUG] [LOCAL ] MMU: Primary data saved (16842 records). [2025-10-01T20:14:40.493585] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-01T20:14:40.493695] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMU took 24.6s. Estimated remaining: 2h 20m 29s. Rate: 7.1 symbols/min [2025-10-01T20:14:40.677235] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:40.702852] [DEBUG] [LOCAL ] MNR: Loaded 24517 existing records from primary storage. [2025-10-01T20:14:40.703134] [INFO ] [MAIN ] MNR: Loaded 24517 existing records. [2025-10-01T20:14:40.894132] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:14:40.894367] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-01T20:14:40.894417] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-01T20:14:40.895269] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-01T20:14:40.895331] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-01T20:14:40.908499] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-01T20:14:41.280763] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:41.702379] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-01T20:14:41.761866] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T20:14:42.210005] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T20:14:42.502404] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-01T20:14:43.070274] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-01T20:14:43.071271] [INFO ] [REMOTE ] MMT: Full fetch complete (16142 records). [2025-10-01T20:14:43.071343] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-01T20:14:43.247859] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T20:14:43.304619] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-01T20:14:43.503736] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-01T20:14:43.503834] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-01T20:14:43.504236] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-01T20:14:43.504278] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-01T20:14:43.505013] [DEBUG] [LOCAL ] MMT: Trimmed 16142 records to 10794 (keeping 200 days of data) [2025-10-01T20:14:43.575998] [DEBUG] [LOCAL ] MMT: Primary data saved (10794 records). [2025-10-01T20:14:43.576145] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-01T20:14:43.576233] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMT took 27.8s. Estimated remaining: 2h 20m 17s. Rate: 7.1 symbols/min [2025-10-01T20:14:43.752035] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:43.795067] [DEBUG] [LOCAL ] MNSO: Loaded 44420 existing records from primary storage. [2025-10-01T20:14:43.795381] [INFO ] [MAIN ] MNSO: Loaded 44420 existing records. [2025-10-01T20:14:43.988065] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:14:43.988319] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-01T20:14:43.988374] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-01T20:14:43.988813] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-01T20:14:43.988887] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-01T20:14:44.107481] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-01T20:14:44.394201] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:44.902389] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-01T20:14:45.160537] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T20:14:45.543595] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T20:14:45.702382] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-01T20:14:46.197748] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T20:14:46.502386] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-01T20:14:47.302361] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-01T20:14:47.611248] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T20:14:47.648045] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T20:14:48.102413] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-01T20:14:48.641156] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T20:14:48.902398] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-01T20:14:49.549977] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T20:14:49.551575] [INFO ] [REMOTE ] MMM: Full fetch complete (77090 records). [2025-10-01T20:14:49.551752] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-01T20:14:49.706149] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-01T20:14:49.985391] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-01T20:14:49.985484] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-01T20:14:49.986638] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-01T20:14:49.986724] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-01T20:14:49.988257] [DEBUG] [LOCAL ] MMM: Trimmed 77090 records to 53167 (keeping 200 days of data) [2025-10-01T20:14:50.118793] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T20:14:50.355779] [DEBUG] [LOCAL ] MMM: Primary data saved (53167 records). [2025-10-01T20:14:50.355932] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-01T20:14:50.356030] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMM took 37.2s. Estimated remaining: 2h 20m 7s. Rate: 7.1 symbols/min [2025-10-01T20:14:50.509171] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-01T20:14:50.542025] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:50.542437] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-01T20:14:50.542493] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-01T20:14:50.542611] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-01T20:14:50.542684] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-01T20:14:50.542747] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-01T20:14:50.542782] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-01T20:14:50.966740] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:51.302393] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-01T20:14:51.392125] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T20:14:51.520631] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:14:51.521050] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-01T20:14:51.521180] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:14:51.521254] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-01T20:14:51.521322] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:14:51.521435] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-01T20:14:51.521515] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-01T20:14:51.521556] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-01T20:14:51.521618] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-01T20:14:51.521719] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MNTN took 1.2s. Estimated remaining: 2h 19m 53s. Rate: 7.1 symbols/min [2025-10-01T20:14:51.712238] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:14:51.712512] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-01T20:14:51.712565] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-01T20:14:51.712736] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-01T20:14:51.712791] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-01T20:14:51.712839] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-01T20:14:51.712875] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-01T20:14:52.103147] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-01T20:14:52.162492] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T20:14:52.159394] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:14:52.902388] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-01T20:14:53.322103] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T20:14:53.702373] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-01T20:14:53.996410] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T20:14:54.502382] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-01T20:14:55.302433] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-01T20:14:55.384688] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T20:14:55.848195] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T20:14:56.102385] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-01T20:14:56.879604] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T20:14:56.902338] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-01T20:14:57.410412] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T20:14:57.702396] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-01T20:14:57.865083] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T20:14:58.502396] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-01T20:14:59.133363] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T20:14:59.302399] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-01T20:15:00.115088] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-01T20:15:00.121445] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T20:15:00.902399] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-01T20:15:01.342243] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-01T20:15:01.482109] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T20:15:01.702386] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-01T20:15:02.502369] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-01T20:15:02.783639] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T20:15:03.302388] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-01T20:15:04.001239] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-01T20:15:04.102386] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-01T20:15:04.619350] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T20:15:04.852461] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-01T20:15:04.902387] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-01T20:15:05.458586] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-01T20:15:05.459959] [INFO ] [REMOTE ] MMS: Full fetch complete (52061 records). [2025-10-01T20:15:05.460046] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-01T20:15:05.709703] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-01T20:15:05.877324] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-01T20:15:05.877408] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-01T20:15:05.878309] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-01T20:15:05.878415] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-01T20:15:05.879723] [DEBUG] [LOCAL ] MMS: Trimmed 52061 records to 33864 (keeping 200 days of data) [2025-10-01T20:15:06.093664] [DEBUG] [LOCAL ] MMS: Primary data saved (33864 records). [2025-10-01T20:15:06.093812] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-01T20:15:06.093910] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MMS took 52.6s. Estimated remaining: 2h 19m 49s. Rate: 7.1 symbols/min [2025-10-01T20:15:06.283738] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:15:06.328030] [DEBUG] [LOCAL ] MOD: Loaded 45309 existing records from primary storage. [2025-10-01T20:15:06.328351] [INFO ] [MAIN ] MOD: Loaded 45309 existing records. [2025-10-01T20:15:06.510226] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-01T20:15:06.535778] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:15:06.536667] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-01T20:15:06.536738] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-01T20:15:06.537171] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-01T20:15:06.537234] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-01T20:15:06.961975] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:15:06.979638] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T20:15:07.299492] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-01T20:15:07.303711] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-01T20:15:07.586841] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T20:15:08.102416] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-01T20:15:08.902493] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-01T20:15:08.930005] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T20:15:09.692347] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T20:15:09.702339] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-01T20:15:09.759594] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T20:15:10.502450] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-01T20:15:11.310566] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-01T20:15:11.333279] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T20:15:11.837901] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T20:15:12.102420] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-01T20:15:12.427557] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T20:15:12.902408] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-01T20:15:13.564944] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T20:15:13.702430] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-01T20:15:14.196394] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-01T20:15:14.197857] [INFO ] [REMOTE ] MNSO: Full fetch complete (64178 records). [2025-10-01T20:15:14.197986] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-01T20:15:14.400305] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-01T20:15:14.472143] [INFO ] [REMOTE ] MNR: Full fetch complete (36812 records). [2025-10-01T20:15:14.502939] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-01T20:15:14.503141] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-01T20:15:14.820411] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-01T20:15:14.827075] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-01T20:15:14.838489] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-01T20:15:14.838986] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-01T20:15:14.948739] [DEBUG] [LOCAL ] MNSO: Trimmed 64178 records to 44366 (keeping 200 days of data) [2025-10-01T20:15:15.174485] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-01T20:15:15.175161] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-01T20:15:15.176307] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-01T20:15:15.176391] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-01T20:15:15.180024] [DEBUG] [LOCAL ] MNR: Trimmed 36812 records to 24370 (keeping 200 days of data) [2025-10-01T20:15:15.302945] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-01T20:15:15.486206] [DEBUG] [LOCAL ] MNR: Primary data saved (24370 records). [2025-10-01T20:15:15.486923] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-01T20:15:15.487411] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNR took 35.0s. Estimated remaining: 2h 19m 42s. Rate: 7.1 symbols/min [2025-10-01T20:15:15.704088] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:15:15.741207] [DEBUG] [LOCAL ] MNSO: Primary data saved (44366 records). [2025-10-01T20:15:15.741483] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-01T20:15:15.741586] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MNSO took 32.2s. Estimated remaining: 2h 19m 27s. Rate: 7.1 symbols/min [2025-10-01T20:15:15.964424] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:15:15.965785] [DEBUG] [LOCAL ] MODG: Loaded 51561 existing records from primary storage. [2025-10-01T20:15:15.966360] [INFO ] [MAIN ] MODG: Loaded 51561 existing records. [2025-10-01T20:15:16.183631] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:15:16.183963] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-01T20:15:16.184027] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-01T20:15:16.184412] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-01T20:15:16.184475] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-01T20:15:16.327559] [DEBUG] [LOCAL ] MOH: Loaded 41781 existing records from primary storage. [2025-10-01T20:15:16.339096] [INFO ] [MAIN ] MOH: Loaded 41781 existing records. [2025-10-01T20:15:16.998472] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:15:17.068499] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-01T20:15:17.137921] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-01T20:15:17.184963] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-01T20:15:17.192204] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:15:17.193698] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-01T20:15:17.198572] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-01T20:15:17.198263] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-01T20:15:17.293562] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-01T20:15:17.663813] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-01T20:15:17.727274] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-01T20:15:17.733754] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:15:18.502394] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-01T20:15:18.582475] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T20:15:19.191452] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T20:15:19.302384] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-01T20:15:19.728547] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-01T20:15:19.878771] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T20:15:20.102393] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-01T20:15:20.846863] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T20:15:20.902441] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-01T20:15:21.704564] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-01T20:15:21.708272] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T20:15:22.380182] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T20:15:22.502422] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-01T20:15:23.181082] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T20:15:23.302406] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-01T20:15:24.102441] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-01T20:15:24.828399] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-01T20:15:24.895516] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T20:15:24.905402] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-01T20:15:25.630837] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T20:15:25.702378] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-01T20:15:26.502433] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-01T20:15:27.099366] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-01T20:15:27.256785] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T20:15:27.302371] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-01T20:15:28.102367] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-01T20:15:28.304824] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T20:15:28.615980] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T20:15:28.902375] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-01T20:15:29.450432] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T20:15:29.702394] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-01T20:15:30.471906] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T20:15:30.502339] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-01T20:15:31.302412] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-01T20:15:31.684092] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-01T20:15:31.951933] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T20:15:32.102396] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-01T20:15:32.818783] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T20:15:32.902401] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-01T20:15:33.702400] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-01T20:15:33.816336] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-01T20:15:33.820998] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-01T20:15:33.821218] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-01T20:15:34.043938] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T20:15:34.045029] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-01T20:15:34.045283] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-01T20:15:34.045419] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-01T20:15:34.045552] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-01T20:15:34.045944] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-01T20:15:34.046035] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-01T20:15:34.046111] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MO took 42.5s. Estimated remaining: 2h 19m 26s. Rate: 7.1 symbols/min [2025-10-01T20:15:34.163112] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T20:15:34.278028] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:15:34.342333] [DEBUG] [LOCAL ] MOS: Loaded 53504 existing records from primary storage. [2025-10-01T20:15:34.342738] [INFO ] [MAIN ] MOS: Loaded 53504 existing records. [2025-10-01T20:15:34.507536] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-01T20:15:34.541264] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:15:34.541632] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-01T20:15:34.541727] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-01T20:15:34.542972] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-01T20:15:34.543041] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-01T20:15:34.852848] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T20:15:34.878374] [INFO ] [REMOTE ] MOD: Full fetch complete (66276 records). [2025-10-01T20:15:34.901581] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-01T20:15:34.948093] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:15:35.307571] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-01T20:15:35.404226] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-01T20:15:35.404333] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-01T20:15:35.405463] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-01T20:15:35.405530] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-01T20:15:35.407207] [DEBUG] [LOCAL ] MOD: Trimmed 66276 records to 45228 (keeping 200 days of data) [2025-10-01T20:15:35.700726] [DEBUG] [LOCAL ] MOD: Primary data saved (45228 records). [2025-10-01T20:15:35.700852] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-01T20:15:35.700942] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MOD took 29.6s. Estimated remaining: 2h 19m 12s. Rate: 7.1 symbols/min [2025-10-01T20:15:35.889367] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:15:35.914451] [DEBUG] [LOCAL ] MOV: Loaded 21979 existing records from primary storage. [2025-10-01T20:15:35.914774] [INFO ] [MAIN ] MOV: Loaded 21979 existing records. [2025-10-01T20:15:36.113448] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-01T20:15:36.121538] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:15:36.123107] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-01T20:15:36.123257] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-01T20:15:36.123995] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-01T20:15:36.124063] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-01T20:15:36.424981] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T20:15:36.630139] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:15:36.902457] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-01T20:15:37.470380] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-01T20:15:37.702383] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-01T20:15:37.770924] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T20:15:37.907327] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T20:15:38.502382] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-01T20:15:39.271673] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T20:15:39.302349] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-01T20:15:40.102381] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-01T20:15:40.435077] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T20:15:40.902392] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-01T20:15:41.048509] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T20:15:41.166484] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T20:15:41.702399] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-01T20:15:42.502432] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-01T20:15:42.556714] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T20:15:42.607200] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T20:15:42.612539] [DEBUG] [REMOTE ] MOH: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-01T20:15:42.612866] [WARN ] [REMOTE ] MOH: No data returned for month 2025-08 [2025-10-01T20:15:42.612960] [FATAL] [REMOTE ] MOH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:15:42.613076] [FATAL] [MAIN ] MOH: Failed to fetch primary data. [2025-10-01T20:15:42.613148] [WARN ] [MAIN ] MOH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:15:42.613223] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-01T20:15:42.613287] [DEBUG] [LOCAL ] MOH: No primary data file found to delete. [2025-10-01T20:15:42.613326] [INFO ] [LOCAL ] MOH: Starting deletion of derivative data. [2025-10-01T20:15:42.613813] [DEBUG] [LOCAL ] MOH: Deleted derivative data file. [2025-10-01T20:15:42.613933] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOH took 26.9s. Estimated remaining: 2h 19m 3s. Rate: 7.1 symbols/min [2025-10-01T20:15:42.804157] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:15:42.867914] [DEBUG] [LOCAL ] MP: Loaded 53675 existing records from primary storage. [2025-10-01T20:15:42.868406] [INFO ] [MAIN ] MP: Loaded 53675 existing records. [2025-10-01T20:15:43.080715] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:15:43.080951] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-01T20:15:43.081000] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-01T20:15:43.081518] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-01T20:15:43.081586] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-01T20:15:43.307505] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-01T20:15:43.480635] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:15:44.102407] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-01T20:15:44.902377] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-01T20:15:45.116045] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T20:15:45.161881] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T20:15:45.702439] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-01T20:15:46.467166] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T20:15:46.502364] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-01T20:15:47.302377] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-01T20:15:47.431399] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T20:15:47.680626] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T20:15:48.102405] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-01T20:15:48.902368] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-01T20:15:49.247172] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T20:15:49.702388] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-01T20:15:49.820235] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T20:15:50.085239] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T20:15:50.502416] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-01T20:15:51.302411] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-01T20:15:51.540765] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T20:15:52.079915] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T20:15:52.102361] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-01T20:15:52.902402] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-01T20:15:53.127134] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T20:15:53.698588] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T20:15:53.703976] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-01T20:15:53.886696] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T20:15:54.502399] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-01T20:15:55.302359] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-01T20:15:55.471568] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T20:15:55.507226] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T20:15:56.102411] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-01T20:15:56.844214] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T20:15:56.902412] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-01T20:15:57.210345] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T20:15:57.702392] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-01T20:15:58.502372] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-01T20:15:58.760915] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T20:15:59.036216] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-01T20:15:59.037871] [INFO ] [REMOTE ] MODG: Full fetch complete (74774 records). [2025-10-01T20:15:59.037970] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-01T20:15:59.307461] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-01T20:15:59.479152] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-01T20:15:59.479256] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-01T20:15:59.480494] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-01T20:15:59.480564] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-01T20:15:59.482297] [DEBUG] [LOCAL ] MODG: Trimmed 74774 records to 51528 (keeping 200 days of data) [2025-10-01T20:15:59.810266] [DEBUG] [LOCAL ] MODG: Primary data saved (51528 records). [2025-10-01T20:15:59.810417] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-01T20:15:59.810511] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MODG took 44.3s. Estimated remaining: 2h 19m 1s. Rate: 7.1 symbols/min [2025-10-01T20:16:00.005804] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:00.014077] [DEBUG] [LOCAL ] MPA: Loaded 5222 existing records from primary storage. [2025-10-01T20:16:00.014365] [INFO ] [MAIN ] MPA: Loaded 5222 existing records. [2025-10-01T20:16:00.102400] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-01T20:16:00.226405] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:00.226774] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-01T20:16:00.226833] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-01T20:16:00.227085] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-01T20:16:00.227146] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-01T20:16:00.570685] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T20:16:00.676833] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:00.715499] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-01T20:16:00.778356] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T20:16:00.902416] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-01T20:16:01.702410] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-01T20:16:01.929752] [DEBUG] [REMOTE ] MOV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:16:01.930190] [WARN ] [REMOTE ] MOV: No data returned for month 2025-10 [2025-10-01T20:16:01.930314] [FATAL] [REMOTE ] MOV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:16:01.930424] [FATAL] [MAIN ] MOV: Failed to fetch primary data. [2025-10-01T20:16:01.930507] [WARN ] [MAIN ] MOV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:16:01.930597] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-01T20:16:01.930728] [DEBUG] [LOCAL ] MOV: No primary data file found to delete. [2025-10-01T20:16:01.930809] [INFO ] [LOCAL ] MOV: Starting deletion of derivative data. [2025-10-01T20:16:01.931290] [DEBUG] [LOCAL ] MOV: Deleted derivative data file. [2025-10-01T20:16:01.931432] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOV took 26.2s. Estimated remaining: 2h 18m 48s. Rate: 7.1 symbols/min [2025-10-01T20:16:02.137454] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:02.202996] [DEBUG] [LOCAL ] MPC: Loaded 52086 existing records from primary storage. [2025-10-01T20:16:02.203353] [INFO ] [MAIN ] MPC: Loaded 52086 existing records. [2025-10-01T20:16:02.414390] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:02.414611] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-01T20:16:02.414697] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-01T20:16:02.415340] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-01T20:16:02.415402] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-01T20:16:02.507679] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-01T20:16:02.855922] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:03.025210] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-01T20:16:03.302376] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-01T20:16:03.317275] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T20:16:04.102399] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-01T20:16:04.629592] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-01T20:16:04.902407] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-01T20:16:05.604938] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-01T20:16:05.702379] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-01T20:16:05.873629] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T20:16:06.399005] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T20:16:06.502444] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-01T20:16:07.181962] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T20:16:07.302409] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-01T20:16:07.998708] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T20:16:08.102432] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-01T20:16:08.377692] [DEBUG] [REMOTE ] MOS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:16:08.378237] [WARN ] [REMOTE ] MOS: No data returned for month 2025-10 [2025-10-01T20:16:08.378370] [FATAL] [REMOTE ] MOS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:16:08.378505] [FATAL] [MAIN ] MOS: Failed to fetch primary data. [2025-10-01T20:16:08.378595] [WARN ] [MAIN ] MOS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:16:08.378716] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-01T20:16:08.378811] [DEBUG] [LOCAL ] MOS: No primary data file found to delete. [2025-10-01T20:16:08.378863] [INFO ] [LOCAL ] MOS: Starting deletion of derivative data. [2025-10-01T20:16:08.379496] [DEBUG] [LOCAL ] MOS: Deleted derivative data file. [2025-10-01T20:16:08.379687] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MOS took 34.3s. Estimated remaining: 2h 18m 38s. Rate: 7.1 symbols/min [2025-10-01T20:16:08.688013] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:08.776351] [DEBUG] [LOCAL ] MPLX: Loaded 50737 existing records from primary storage. [2025-10-01T20:16:08.776900] [INFO ] [MAIN ] MPLX: Loaded 50737 existing records. [2025-10-01T20:16:08.904405] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-01T20:16:09.099887] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:09.100188] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-01T20:16:09.100262] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-01T20:16:09.100875] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-01T20:16:09.100956] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-01T20:16:09.640751] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:09.702383] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-01T20:16:10.502421] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-01T20:16:11.211612] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-01T20:16:11.292667] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T20:16:11.302326] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-01T20:16:11.519725] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T20:16:12.029940] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T20:16:12.102373] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-01T20:16:12.902435] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-01T20:16:13.020308] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T20:16:13.702384] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-01T20:16:14.502410] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-01T20:16:15.273566] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T20:16:15.302360] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-01T20:16:15.500905] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T20:16:15.615591] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-01T20:16:16.102400] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-01T20:16:16.122261] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T20:16:16.902385] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-01T20:16:17.497618] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-01T20:16:17.702374] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-01T20:16:18.178428] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T20:16:18.362024] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-01T20:16:18.502413] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-01T20:16:19.209495] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T20:16:19.302391] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-01T20:16:20.102388] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-01T20:16:20.902412] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-01T20:16:21.028806] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T20:16:21.702394] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-01T20:16:22.152741] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-01T20:16:22.502383] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-01T20:16:22.787554] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T20:16:22.992755] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T20:16:23.302390] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-01T20:16:23.508563] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T20:16:23.652096] [DEBUG] [REMOTE ] MPA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:16:23.652482] [WARN ] [REMOTE ] MPA: No data returned for month 2025-10 [2025-10-01T20:16:23.652572] [FATAL] [REMOTE ] MPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:16:23.652679] [FATAL] [MAIN ] MPA: Failed to fetch primary data. [2025-10-01T20:16:23.652752] [WARN ] [MAIN ] MPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:16:23.652827] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-01T20:16:23.652894] [DEBUG] [LOCAL ] MPA: No primary data file found to delete. [2025-10-01T20:16:23.652932] [INFO ] [LOCAL ] MPA: Starting deletion of derivative data. [2025-10-01T20:16:23.653320] [DEBUG] [LOCAL ] MPA: Deleted derivative data file. [2025-10-01T20:16:23.653420] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MPA took 23.8s. Estimated remaining: 2h 18m 34s. Rate: 7.1 symbols/min [2025-10-01T20:16:23.849398] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:23.857724] [DEBUG] [LOCAL ] MPV: Loaded 4979 existing records from primary storage. [2025-10-01T20:16:23.857997] [INFO ] [MAIN ] MPV: Loaded 4979 existing records. [2025-10-01T20:16:24.068297] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:24.068549] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-01T20:16:24.068599] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-01T20:16:24.068823] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-01T20:16:24.068883] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-01T20:16:24.107554] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-01T20:16:24.465512] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:24.902400] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-01T20:16:25.082775] [DEBUG] [REMOTE ] MP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:16:25.083138] [WARN ] [REMOTE ] MP: No data returned for month 2025-10 [2025-10-01T20:16:25.083232] [FATAL] [REMOTE ] MP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:16:25.083342] [FATAL] [MAIN ] MP: Failed to fetch primary data. [2025-10-01T20:16:25.083413] [WARN ] [MAIN ] MP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:16:25.083491] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-01T20:16:25.083576] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-01T20:16:25.083624] [INFO ] [LOCAL ] MP: Starting deletion of derivative data. [2025-10-01T20:16:25.084038] [DEBUG] [LOCAL ] MP: Deleted derivative data file. [2025-10-01T20:16:25.084156] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MP took 42.5s. Estimated remaining: 2h 18m 21s. Rate: 7.1 symbols/min [2025-10-01T20:16:25.274281] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:25.325481] [DEBUG] [LOCAL ] MPW: Loaded 53495 existing records from primary storage. [2025-10-01T20:16:25.325861] [INFO ] [MAIN ] MPW: Loaded 53495 existing records. [2025-10-01T20:16:25.534110] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:25.534403] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-01T20:16:25.534462] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-01T20:16:25.534768] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-01T20:16:25.534827] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-01T20:16:25.708185] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-01T20:16:25.941947] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:26.092133] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T20:16:26.498192] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T20:16:26.502324] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-01T20:16:27.194697] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T20:16:27.302395] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-01T20:16:28.080141] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T20:16:28.102350] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-01T20:16:28.902345] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-01T20:16:29.085521] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T20:16:29.702397] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-01T20:16:30.502407] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-01T20:16:30.604726] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T20:16:30.717703] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T20:16:31.302382] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-01T20:16:31.473498] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T20:16:32.102385] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-01T20:16:32.902391] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-01T20:16:33.027916] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T20:16:33.105922] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T20:16:33.577082] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-01T20:16:33.702436] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-01T20:16:34.502415] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-01T20:16:34.646062] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T20:16:35.302380] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-01T20:16:36.102360] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-01T20:16:36.171182] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T20:16:36.318180] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T20:16:36.835828] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T20:16:36.902389] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-01T20:16:37.099542] [DEBUG] [REMOTE ] MPC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:16:37.099959] [WARN ] [REMOTE ] MPC: No data returned for month 2025-10 [2025-10-01T20:16:37.100063] [FATAL] [REMOTE ] MPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:16:37.100148] [FATAL] [MAIN ] MPC: Failed to fetch primary data. [2025-10-01T20:16:37.100214] [WARN ] [MAIN ] MPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:16:37.100301] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-01T20:16:37.100377] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-01T20:16:37.100416] [INFO ] [LOCAL ] MPC: Starting deletion of derivative data. [2025-10-01T20:16:37.100816] [DEBUG] [LOCAL ] MPC: Deleted derivative data file. [2025-10-01T20:16:37.100937] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPC took 35.2s. Estimated remaining: 2h 18m 15s. Rate: 7.1 symbols/min [2025-10-01T20:16:37.301567] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:37.312310] [DEBUG] [LOCAL ] MPX: Loaded 4071 existing records from primary storage. [2025-10-01T20:16:37.312527] [INFO ] [MAIN ] MPX: Loaded 4071 existing records. [2025-10-01T20:16:37.524251] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:37.524479] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-01T20:16:37.524527] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-01T20:16:37.524762] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-01T20:16:37.524824] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-01T20:16:37.703373] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-01T20:16:37.932439] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:38.502385] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-01T20:16:39.061396] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T20:16:39.302369] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-01T20:16:39.512295] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T20:16:39.941787] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-01T20:16:40.102440] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-01T20:16:40.902384] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-01T20:16:41.530054] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T20:16:41.702379] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-01T20:16:42.087242] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T20:16:42.423699] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T20:16:42.502416] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-01T20:16:43.277306] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T20:16:43.302385] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-01T20:16:44.055116] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T20:16:44.102348] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-01T20:16:44.902427] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-01T20:16:44.991406] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T20:16:45.702418] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-01T20:16:46.502440] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-01T20:16:46.731440] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T20:16:47.163710] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-01T20:16:47.302423] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-01T20:16:47.865113] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-01T20:16:48.061046] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T20:16:48.102364] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-01T20:16:48.738433] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T20:16:48.902413] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-01T20:16:49.702419] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-01T20:16:49.883382] [DEBUG] [REMOTE ] MPLX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:16:49.883736] [WARN ] [REMOTE ] MPLX: No data returned for month 2025-10 [2025-10-01T20:16:49.883836] [FATAL] [REMOTE ] MPLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:16:49.883964] [FATAL] [MAIN ] MPLX: Failed to fetch primary data. [2025-10-01T20:16:49.884049] [WARN ] [MAIN ] MPLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:16:49.884136] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-01T20:16:49.884234] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-01T20:16:49.884305] [INFO ] [LOCAL ] MPLX: Starting deletion of derivative data. [2025-10-01T20:16:49.884805] [DEBUG] [LOCAL ] MPLX: Deleted derivative data file. [2025-10-01T20:16:49.884900] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPLX took 41.5s. Estimated remaining: 2h 18m 9s. Rate: 7.1 symbols/min [2025-10-01T20:16:50.088504] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:50.100528] [DEBUG] [LOCAL ] MQT: Loaded 8614 existing records from primary storage. [2025-10-01T20:16:50.100815] [INFO ] [MAIN ] MQT: Loaded 8614 existing records. [2025-10-01T20:16:50.297066] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:50.297320] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-01T20:16:50.297386] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-01T20:16:50.297692] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-01T20:16:50.297764] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-01T20:16:50.512514] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-01T20:16:50.702967] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:50.978186] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T20:16:51.252617] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T20:16:51.302381] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-01T20:16:51.547233] [DEBUG] [REMOTE ] MPV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:16:51.547566] [WARN ] [REMOTE ] MPV: No data returned for month 2025-10 [2025-10-01T20:16:51.547684] [FATAL] [REMOTE ] MPV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:16:51.547779] [FATAL] [MAIN ] MPV: Failed to fetch primary data. [2025-10-01T20:16:51.547853] [WARN ] [MAIN ] MPV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:16:51.547928] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-01T20:16:51.548006] [DEBUG] [LOCAL ] MPV: No primary data file found to delete. [2025-10-01T20:16:51.548063] [INFO ] [LOCAL ] MPV: Starting deletion of derivative data. [2025-10-01T20:16:51.548386] [DEBUG] [LOCAL ] MPV: Deleted derivative data file. [2025-10-01T20:16:51.548487] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPV took 27.9s. Estimated remaining: 2h 17m 56s. Rate: 7.1 symbols/min [2025-10-01T20:16:51.734727] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:16:51.753149] [DEBUG] [LOCAL ] MQY: Loaded 16937 existing records from primary storage. [2025-10-01T20:16:51.753386] [INFO ] [MAIN ] MQY: Loaded 16937 existing records. [2025-10-01T20:16:51.946286] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:16:51.946547] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-01T20:16:51.946637] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-01T20:16:51.946946] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-01T20:16:51.947005] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-01T20:16:52.107521] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-01T20:16:52.343253] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:16:52.902408] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-01T20:16:53.565420] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T20:16:53.702411] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-01T20:16:54.249972] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-01T20:16:54.502395] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-01T20:16:54.606548] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T20:16:55.302369] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-01T20:16:56.102357] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-01T20:16:56.326226] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T20:16:56.566374] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-01T20:16:56.594193] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T20:16:56.902388] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-01T20:16:57.539120] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T20:16:57.702421] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-01T20:16:58.502433] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-01T20:16:59.302426] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-01T20:16:59.403865] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T20:16:59.755185] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-01T20:17:00.102443] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-01T20:17:00.171858] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T20:17:00.849199] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T20:17:00.902455] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-01T20:17:01.702399] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-01T20:17:02.007690] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T20:17:02.502425] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-01T20:17:02.765609] [DEBUG] [REMOTE ] MPX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:17:02.766043] [WARN ] [REMOTE ] MPX: No data returned for month 2025-10 [2025-10-01T20:17:02.766121] [FATAL] [REMOTE ] MPX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:17:02.766195] [FATAL] [MAIN ] MPX: Failed to fetch primary data. [2025-10-01T20:17:02.766233] [WARN ] [MAIN ] MPX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:17:02.766280] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-01T20:17:02.766338] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-01T20:17:02.766375] [INFO ] [LOCAL ] MPX: Starting deletion of derivative data. [2025-10-01T20:17:02.766832] [DEBUG] [LOCAL ] MPX: Deleted derivative data file. [2025-10-01T20:17:02.766924] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPX took 25.7s. Estimated remaining: 2h 17m 49s. Rate: 7.1 symbols/min [2025-10-01T20:17:02.954447] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:17:02.993943] [DEBUG] [LOCAL ] MRC: Loaded 37475 existing records from primary storage. [2025-10-01T20:17:02.994272] [INFO ] [MAIN ] MRC: Loaded 37475 existing records. [2025-10-01T20:17:03.185058] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:17:03.185298] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-01T20:17:03.185348] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-01T20:17:03.185999] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-01T20:17:03.186061] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-01T20:17:03.307481] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-01T20:17:03.580719] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:17:03.701860] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-01T20:17:04.102412] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-01T20:17:04.629978] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T20:17:04.902420] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-01T20:17:05.434594] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T20:17:05.702359] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-01T20:17:05.948681] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T20:17:06.364957] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T20:17:06.502404] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-01T20:17:07.102709] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T20:17:07.302775] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-01T20:17:08.102412] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-01T20:17:08.906533] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-01T20:17:08.907591] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T20:17:09.406245] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T20:17:09.702381] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-01T20:17:10.260004] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T20:17:10.374486] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T20:17:10.502378] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-01T20:17:11.302393] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-01T20:17:11.345880] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T20:17:12.102374] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-01T20:17:12.902399] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-01T20:17:13.205290] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T20:17:13.361687] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T20:17:13.702384] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-01T20:17:14.502402] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-01T20:17:14.547329] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T20:17:14.600544] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T20:17:14.753530] [DEBUG] [REMOTE ] MQT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:17:14.753932] [WARN ] [REMOTE ] MQT: No data returned for month 2025-10 [2025-10-01T20:17:14.754051] [FATAL] [REMOTE ] MQT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:17:14.754146] [FATAL] [MAIN ] MQT: Failed to fetch primary data. [2025-10-01T20:17:14.754189] [WARN ] [MAIN ] MQT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:17:14.754277] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-01T20:17:14.754361] [DEBUG] [LOCAL ] MQT: No primary data file found to delete. [2025-10-01T20:17:14.754404] [INFO ] [LOCAL ] MQT: Starting deletion of derivative data. [2025-10-01T20:17:14.755480] [DEBUG] [LOCAL ] MQT: Deleted derivative data file. [2025-10-01T20:17:14.755592] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MQT took 24.9s. Estimated remaining: 2h 17m 43s. Rate: 7.1 symbols/min [2025-10-01T20:17:14.941893] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:17:14.991584] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-10-01T20:17:14.991933] [INFO ] [MAIN ] MRK: Loaded 53789 existing records. [2025-10-01T20:17:15.199555] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:17:15.200097] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-01T20:17:15.200162] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-01T20:17:15.201344] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-10-01T20:17:15.201433] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-01T20:17:15.309113] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-01T20:17:15.598686] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:17:16.102431] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-01T20:17:16.902359] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-01T20:17:17.084915] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T20:17:17.702449] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-01T20:17:17.899773] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T20:17:18.168840] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-01T20:17:18.502446] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-01T20:17:18.772338] [DEBUG] [REMOTE ] MPW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:17:18.772681] [WARN ] [REMOTE ] MPW: No data returned for month 2025-10 [2025-10-01T20:17:18.772796] [FATAL] [REMOTE ] MPW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:17:18.772901] [FATAL] [MAIN ] MPW: Failed to fetch primary data. [2025-10-01T20:17:18.772969] [WARN ] [MAIN ] MPW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:17:18.773043] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-01T20:17:18.773107] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-01T20:17:18.773144] [INFO ] [LOCAL ] MPW: Starting deletion of derivative data. [2025-10-01T20:17:18.773465] [DEBUG] [LOCAL ] MPW: Deleted derivative data file. [2025-10-01T20:17:18.773580] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MPW took 53.7s. Estimated remaining: 2h 17m 32s. Rate: 7.1 symbols/min [2025-10-01T20:17:19.220698] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T20:17:19.302373] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-01T20:17:20.102405] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-01T20:17:20.808754] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T20:17:20.902395] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-01T20:17:21.163042] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T20:17:21.702390] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-01T20:17:22.502392] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-01T20:17:23.214631] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T20:17:23.265990] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-01T20:17:23.302409] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-01T20:17:23.541828] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T20:17:24.102409] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-01T20:17:24.786410] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T20:17:24.830301] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T20:17:24.902376] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-01T20:17:25.702413] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-01T20:17:26.000129] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T20:17:26.502384] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-01T20:17:26.774298] [DEBUG] [REMOTE ] MQY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:17:26.774622] [WARN ] [REMOTE ] MQY: No data returned for month 2025-10 [2025-10-01T20:17:26.774736] [FATAL] [REMOTE ] MQY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:17:26.774841] [FATAL] [MAIN ] MQY: Failed to fetch primary data. [2025-10-01T20:17:26.774915] [WARN ] [MAIN ] MQY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:17:26.774988] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-01T20:17:26.775055] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-01T20:17:26.775139] [INFO ] [LOCAL ] MQY: Starting deletion of derivative data. [2025-10-01T20:17:26.775522] [DEBUG] [LOCAL ] MQY: Deleted derivative data file. [2025-10-01T20:17:26.775620] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 35.2s. Estimated remaining: 2h 17m 23s. Rate: 7.1 symbols/min [2025-10-01T20:17:27.302391] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-01T20:17:27.327731] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T20:17:28.102389] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-01T20:17:29.555547] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T20:17:29.563946] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-01T20:17:29.630687] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-01T20:17:29.702386] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-01T20:17:29.816414] [DEBUG] [REMOTE ] MRC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:17:29.816754] [WARN ] [REMOTE ] MRC: No data returned for month 2025-10 [2025-10-01T20:17:29.816870] [FATAL] [REMOTE ] MRC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:17:29.816953] [FATAL] [MAIN ] MRC: Failed to fetch primary data. [2025-10-01T20:17:29.817018] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:17:29.817088] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-01T20:17:29.817173] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-01T20:17:29.817228] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-01T20:17:29.818525] [DEBUG] [LOCAL ] MRC: Deleted derivative data file. [2025-10-01T20:17:29.818675] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 27.1s. Estimated remaining: 2h 17m 11s. Rate: 7.1 symbols/min [2025-10-01T20:17:32.140861] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-01T20:17:32.151513] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-01T20:17:34.140772] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-01T20:17:34.153017] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-01T20:17:36.547288] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-01T20:17:36.559021] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-01T20:17:39.017706] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-01T20:17:39.029886] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-01T20:17:41.407894] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-01T20:17:41.419590] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-01T20:17:43.354505] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T20:17:43.366909] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-01T20:17:44.338941] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T20:17:44.350607] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-01T20:17:45.298922] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T20:17:45.310781] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-01T20:17:45.568610] [DEBUG] [REMOTE ] MRK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:17:45.569046] [WARN ] [REMOTE ] MRK: No data returned for month 2025-10 [2025-10-01T20:17:45.569141] [FATAL] [REMOTE ] MRK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:17:45.569239] [FATAL] [MAIN ] MRK: Failed to fetch primary data. [2025-10-01T20:17:45.569325] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:17:45.569411] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-01T20:17:45.569511] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-01T20:17:45.569585] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-01T20:17:45.569940] [DEBUG] [LOCAL ] MRK: Deleted derivative data file. [2025-10-01T20:17:45.570054] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRK took 30.8s. Estimated remaining: 2h 17m 7s. Rate: 7.1 symbols/min [2025-10-01T20:17:46.227340] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:17:46.312139] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-01T20:17:46.303064] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:17:46.306918] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:17:46.335706] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-01T20:17:46.339362] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-01T20:17:46.345357] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-01T20:17:46.409522] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:17:46.409866] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-01T20:17:46.410112] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-01T20:17:46.555727] [DEBUG] [LOCAL ] MSB: Loaded 7838 existing records from primary storage. [2025-10-01T20:17:46.567130] [INFO ] [MAIN ] MSB: Loaded 7838 existing records. [2025-10-01T20:17:46.647023] [DEBUG] [LOCAL ] MSA: Loaded 18880 existing records from primary storage. [2025-10-01T20:17:46.706396] [INFO ] [MAIN ] MSA: Loaded 18880 existing records. [2025-10-01T20:17:46.985157] [DEBUG] [LOCAL ] MS: Loaded 53691 existing records from primary storage. [2025-10-01T20:17:47.073581] [INFO ] [MAIN ] MS: Loaded 53691 existing records. [2025-10-01T20:17:47.369785] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:17:47.419241] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-01T20:17:47.481238] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:17:47.484012] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-01T20:17:47.498327] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-01T20:17:47.503625] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-01T20:17:47.498239] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:17:47.531044] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-01T20:17:47.514965] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-01T20:17:47.536548] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-01T20:17:47.531241] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-01T20:17:47.536707] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-01T20:17:47.762480] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:17:47.826693] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-01T20:17:47.844171] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-01T20:17:47.852929] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-10-01T20:17:47.853239] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-01T20:17:48.031233] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:17:48.077423] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-01T20:17:48.096719] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:17:48.174624] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-01T20:17:48.246286] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:17:48.294382] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-01T20:17:48.343741] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-01T20:17:48.376002] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-01T20:17:48.414788] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-01T20:17:48.425715] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 2.9s. Estimated remaining: 2h 16m 55s. Rate: 7.1 symbols/min [2025-10-01T20:17:48.790746] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:17:48.837046] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-01T20:17:48.836725] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:17:48.924567] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-01T20:17:49.019814] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:17:49.030308] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-01T20:17:49.030393] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-01T20:17:49.035737] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-01T20:17:49.049969] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-01T20:17:49.058106] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-01T20:17:49.058202] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-01T20:17:49.164013] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:17:49.180162] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-01T20:17:49.494234] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:17:49.494560] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-01T20:17:49.696628] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T20:17:49.698566] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-01T20:17:49.896138] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-01T20:17:49.897059] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-01T20:17:50.042329] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T20:17:50.048255] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-01T20:17:50.488687] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T20:17:50.490066] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-01T20:17:50.507966] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T20:17:50.511877] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-01T20:17:51.122099] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T20:17:51.125550] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-01T20:17:51.154804] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T20:17:51.156590] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-01T20:17:51.291363] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T20:17:51.303086] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-01T20:17:51.322673] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T20:17:51.326727] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-01T20:17:51.530702] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T20:17:51.531951] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-01T20:17:51.838052] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-01T20:17:51.839026] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-01T20:17:52.045496] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T20:17:52.049415] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-01T20:17:52.183101] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T20:17:52.185674] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-01T20:17:52.267834] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T20:17:52.268940] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-01T20:17:52.665919] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-01T20:17:52.667053] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-01T20:17:52.780079] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T20:17:52.798590] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T20:17:52.902425] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-01T20:17:53.061981] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T20:17:53.173765] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-01T20:17:53.702432] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-01T20:17:54.284894] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T20:17:54.502412] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-01T20:17:55.302380] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-01T20:17:55.678695] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T20:17:55.732799] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T20:17:55.752390] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-01T20:17:56.102383] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-01T20:17:56.902381] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-01T20:17:57.160687] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T20:17:57.665053] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T20:17:57.702357] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-01T20:17:58.502381] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-01T20:17:59.058576] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T20:17:59.302383] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-01T20:17:59.869051] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-01T20:18:00.102369] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-01T20:18:00.135767] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T20:18:00.902380] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-01T20:18:01.702432] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-01T20:18:01.843125] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T20:18:02.231804] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-01T20:18:02.502372] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-01T20:18:02.895228] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T20:18:03.091148] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T20:18:03.302449] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-01T20:18:04.102405] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-01T20:18:04.217691] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T20:18:04.902401] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-01T20:18:05.142969] [DEBUG] [REMOTE ] MSB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:05.143304] [WARN ] [REMOTE ] MSB: No data returned for month 2025-10 [2025-10-01T20:18:05.143470] [FATAL] [REMOTE ] MSB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:05.143559] [FATAL] [MAIN ] MSB: Failed to fetch primary data. [2025-10-01T20:18:05.143602] [WARN ] [MAIN ] MSB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:05.143679] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-01T20:18:05.143774] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-01T20:18:05.143829] [INFO ] [LOCAL ] MSB: Starting deletion of derivative data. [2025-10-01T20:18:05.144380] [DEBUG] [LOCAL ] MSB: Deleted derivative data file. [2025-10-01T20:18:05.144492] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSB took 19.6s. Estimated remaining: 2h 16m 52s. Rate: 7.1 symbols/min [2025-10-01T20:18:05.338432] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:05.385206] [DEBUG] [LOCAL ] MSCI: Loaded 34570 existing records from primary storage. [2025-10-01T20:18:05.385610] [INFO ] [MAIN ] MSCI: Loaded 34570 existing records. [2025-10-01T20:18:05.577345] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:18:05.577580] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-01T20:18:05.577713] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-01T20:18:05.578831] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-01T20:18:05.578893] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-01T20:18:05.707489] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-01T20:18:05.994340] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:18:06.023589] [DEBUG] [REMOTE ] MSC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:06.024119] [WARN ] [REMOTE ] MSC: No data returned for month 2025-10 [2025-10-01T20:18:06.024247] [FATAL] [REMOTE ] MSC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:06.024430] [FATAL] [MAIN ] MSC: Failed to fetch primary data. [2025-10-01T20:18:06.024505] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:06.024596] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-01T20:18:06.024716] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-01T20:18:06.024776] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-01T20:18:06.024822] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-01T20:18:06.024872] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSC took 17.6s. Estimated remaining: 2h 16m 38s. Rate: 7.1 symbols/min [2025-10-01T20:18:06.231067] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:06.281927] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-01T20:18:06.307238] [DEBUG] [LOCAL ] MSD: Loaded 15819 existing records from primary storage. [2025-10-01T20:18:06.307569] [INFO ] [MAIN ] MSD: Loaded 15819 existing records. [2025-10-01T20:18:06.499844] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:18:06.500094] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-01T20:18:06.500149] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-01T20:18:06.500815] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-01T20:18:06.500875] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-01T20:18:06.512154] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-01T20:18:06.887135] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:18:07.302361] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-01T20:18:07.374140] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T20:18:08.102392] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-01T20:18:08.902385] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-01T20:18:09.036711] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T20:18:09.206902] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T20:18:09.702360] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-01T20:18:09.768275] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:18:10.502450] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-01T20:18:11.302369] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-01T20:18:11.421855] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T20:18:11.459066] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T20:18:12.102359] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-01T20:18:12.448891] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T20:18:12.902415] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-01T20:18:13.047378] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T20:18:13.702418] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-01T20:18:14.502374] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-01T20:18:14.634812] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T20:18:14.672505] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T20:18:15.302367] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-01T20:18:15.368907] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T20:18:16.102370] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-01T20:18:16.276188] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T20:18:16.834928] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T20:18:16.902353] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-01T20:18:17.138355] [DEBUG] [REMOTE ] MSA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:17.138729] [WARN ] [REMOTE ] MSA: No data returned for month 2025-10 [2025-10-01T20:18:17.138848] [FATAL] [REMOTE ] MSA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:17.138968] [FATAL] [MAIN ] MSA: Failed to fetch primary data. [2025-10-01T20:18:17.139055] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:17.139124] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-01T20:18:17.139190] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-01T20:18:17.139227] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-01T20:18:17.139494] [DEBUG] [LOCAL ] MSA: Deleted derivative data file. [2025-10-01T20:18:17.139622] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSA took 31.6s. Estimated remaining: 2h 16m 32s. Rate: 7.1 symbols/min [2025-10-01T20:18:17.347256] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:17.393689] [DEBUG] [LOCAL ] MSDL: Loaded 38162 existing records from primary storage. [2025-10-01T20:18:17.394008] [INFO ] [MAIN ] MSDL: Loaded 38162 existing records. [2025-10-01T20:18:17.598975] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:18:17.599188] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-01T20:18:17.599237] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-01T20:18:17.599533] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-01T20:18:17.599604] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-01T20:18:17.709306] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-01T20:18:18.000175] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:18:18.502378] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-01T20:18:18.577137] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T20:18:19.302357] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-01T20:18:19.516307] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T20:18:20.103708] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-01T20:18:20.106077] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T20:18:20.902396] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-01T20:18:21.247455] [DEBUG] [REMOTE ] MS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:21.247870] [WARN ] [REMOTE ] MS: No data returned for month 2025-10 [2025-10-01T20:18:21.247992] [FATAL] [REMOTE ] MS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:21.248102] [FATAL] [MAIN ] MS: Failed to fetch primary data. [2025-10-01T20:18:21.248171] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:21.248241] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-01T20:18:21.248307] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-01T20:18:21.248347] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-01T20:18:21.248709] [DEBUG] [LOCAL ] MS: Deleted derivative data file. [2025-10-01T20:18:21.248810] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MS took 35.7s. Estimated remaining: 2h 16m 20s. Rate: 7.1 symbols/min [2025-10-01T20:18:21.439121] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:21.467619] [DEBUG] [LOCAL ] MSGE: Loaded 26818 existing records from primary storage. [2025-10-01T20:18:21.467935] [INFO ] [MAIN ] MSGE: Loaded 26818 existing records. [2025-10-01T20:18:21.640086] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T20:18:21.703842] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-01T20:18:21.708126] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:18:21.709335] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-01T20:18:21.709393] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-01T20:18:21.709943] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-01T20:18:21.710130] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-01T20:18:22.106622] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:18:22.502359] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-01T20:18:22.555458] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T20:18:23.302379] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-01T20:18:23.334491] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T20:18:23.845865] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-01T20:18:24.102402] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-01T20:18:24.902445] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-01T20:18:25.182790] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T20:18:25.702407] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-01T20:18:26.136080] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T20:18:26.394357] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T20:18:26.502389] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-01T20:18:27.302373] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-01T20:18:27.761105] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-01T20:18:28.102380] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-01T20:18:28.423123] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T20:18:28.902378] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-01T20:18:29.299095] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T20:18:29.702384] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-01T20:18:30.260362] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T20:18:30.502381] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-01T20:18:30.949542] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T20:18:31.302366] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-01T20:18:32.102396] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-01T20:18:32.143402] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T20:18:32.497265] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T20:18:32.902384] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-01T20:18:32.971853] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:18:33.702387] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-01T20:18:34.129130] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T20:18:34.510314] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-01T20:18:34.526865] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:18:35.302394] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-01T20:18:35.327238] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:18:36.102427] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-01T20:18:36.363156] [DEBUG] [REMOTE ] MSD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:36.363636] [WARN ] [REMOTE ] MSD: No data returned for month 2025-10 [2025-10-01T20:18:36.363753] [FATAL] [REMOTE ] MSD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:36.363840] [FATAL] [MAIN ] MSD: Failed to fetch primary data. [2025-10-01T20:18:36.363906] [WARN ] [MAIN ] MSD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:36.363982] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-01T20:18:36.364047] [DEBUG] [LOCAL ] MSD: No primary data file found to delete. [2025-10-01T20:18:36.364085] [INFO ] [LOCAL ] MSD: Starting deletion of derivative data. [2025-10-01T20:18:36.364408] [DEBUG] [LOCAL ] MSD: Deleted derivative data file. [2025-10-01T20:18:36.364615] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSD took 30.3s. Estimated remaining: 2h 16m 16s. Rate: 7.1 symbols/min [2025-10-01T20:18:36.571637] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:36.591113] [DEBUG] [LOCAL ] MSGS: Loaded 17162 existing records from primary storage. [2025-10-01T20:18:36.591347] [INFO ] [MAIN ] MSGS: Loaded 17162 existing records. [2025-10-01T20:18:36.832389] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:18:36.834083] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T20:18:36.833183] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-01T20:18:36.834257] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-01T20:18:36.841760] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-01T20:18:36.841831] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-01T20:18:36.908467] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-01T20:18:37.257877] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:18:37.702395] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-01T20:18:37.914898] [DEBUG] [REMOTE ] MSCI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:37.915257] [WARN ] [REMOTE ] MSCI: No data returned for month 2025-10 [2025-10-01T20:18:37.915354] [FATAL] [REMOTE ] MSCI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:37.915444] [FATAL] [MAIN ] MSCI: Failed to fetch primary data. [2025-10-01T20:18:37.915519] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:37.915608] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-01T20:18:37.915728] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-01T20:18:37.915776] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-01T20:18:37.916247] [DEBUG] [LOCAL ] MSCI: Deleted derivative data file. [2025-10-01T20:18:37.916362] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSCI took 32.8s. Estimated remaining: 2h 16m 3s. Rate: 7.1 symbols/min [2025-10-01T20:18:38.122422] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:38.165138] [DEBUG] [LOCAL ] MSI: Loaded 40284 existing records from primary storage. [2025-10-01T20:18:38.165516] [INFO ] [MAIN ] MSI: Loaded 40284 existing records. [2025-10-01T20:18:38.372485] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:18:38.372794] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-01T20:18:38.373039] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-01T20:18:38.373595] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-01T20:18:38.373701] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-01T20:18:38.502502] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-01T20:18:38.560990] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T20:18:38.815950] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:18:39.302363] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-01T20:18:39.913374] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T20:18:40.102394] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-01T20:18:40.188752] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T20:18:40.902390] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-01T20:18:40.964952] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T20:18:41.474096] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T20:18:41.702407] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-01T20:18:42.339249] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T20:18:42.502409] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-01T20:18:43.302382] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-01T20:18:43.468302] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T20:18:44.102402] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-01T20:18:44.165259] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T20:18:44.902406] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-01T20:18:45.488099] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T20:18:45.702352] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-01T20:18:45.807280] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:18:46.502412] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-01T20:18:47.061282] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T20:18:47.302363] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-01T20:18:47.407253] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T20:18:48.102357] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-01T20:18:48.398944] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T20:18:48.902416] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-01T20:18:49.250043] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T20:18:49.702388] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-01T20:18:50.502353] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-01T20:18:50.665966] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T20:18:50.701369] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T20:18:51.302371] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-01T20:18:51.782082] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T20:18:52.102420] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-01T20:18:52.162503] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T20:18:52.902436] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-01T20:18:53.703398] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-01T20:18:53.706509] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T20:18:54.117517] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T20:18:54.502384] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-01T20:18:54.972088] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T20:18:55.302387] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-01T20:18:55.585741] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T20:18:56.102413] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-01T20:18:56.501494] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T20:18:56.898854] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T20:18:56.907447] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-01T20:18:57.163810] [DEBUG] [REMOTE ] MSDL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:57.164265] [WARN ] [REMOTE ] MSDL: No data returned for month 2025-10 [2025-10-01T20:18:57.164363] [FATAL] [REMOTE ] MSDL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:57.164447] [FATAL] [MAIN ] MSDL: Failed to fetch primary data. [2025-10-01T20:18:57.164519] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:57.164598] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-01T20:18:57.164710] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-01T20:18:57.164780] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-01T20:18:57.165286] [DEBUG] [LOCAL ] MSDL: Deleted derivative data file. [2025-10-01T20:18:57.165392] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSDL took 40.0s. Estimated remaining: 2h 16m 2s. Rate: 7.1 symbols/min [2025-10-01T20:18:57.368905] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:57.369082] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-01T20:18:57.369121] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-01T20:18:57.369236] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-01T20:18:57.369279] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-01T20:18:57.369323] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-01T20:18:57.369358] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-01T20:18:57.707525] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-01T20:18:57.770033] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:18:58.502391] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-01T20:18:59.083681] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T20:18:59.302415] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-01T20:18:59.453908] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T20:18:59.469138] [DEBUG] [REMOTE ] MSGE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:18:59.469423] [WARN ] [REMOTE ] MSGE: No data returned for month 2025-10 [2025-10-01T20:18:59.469518] [FATAL] [REMOTE ] MSGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:18:59.469626] [FATAL] [MAIN ] MSGE: Failed to fetch primary data. [2025-10-01T20:18:59.469719] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:18:59.469792] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-01T20:18:59.469857] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-01T20:18:59.469896] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-01T20:18:59.470396] [DEBUG] [LOCAL ] MSGE: Deleted derivative data file. [2025-10-01T20:18:59.470498] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSGE took 38.2s. Estimated remaining: 2h 15m 49s. Rate: 7.1 symbols/min [2025-10-01T20:18:59.676508] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:18:59.722747] [DEBUG] [LOCAL ] MSM: Loaded 35459 existing records from primary storage. [2025-10-01T20:18:59.723057] [INFO ] [MAIN ] MSM: Loaded 35459 existing records. [2025-10-01T20:18:59.942199] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:18:59.942466] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-01T20:18:59.942522] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-01T20:18:59.943230] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-01T20:18:59.943293] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-01T20:19:00.107509] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-01T20:19:00.344104] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:00.575416] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:00.575776] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-01T20:19:00.575869] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:00.575917] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-01T20:19:00.575959] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:00.575999] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-01T20:19:00.576054] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-01T20:19:00.576091] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-01T20:19:00.576130] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-01T20:19:00.576215] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSIF took 3.4s. Estimated remaining: 2h 15m 36s. Rate: 7.1 symbols/min [2025-10-01T20:19:00.770115] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:00.826585] [DEBUG] [LOCAL ] MT: Loaded 50609 existing records from primary storage. [2025-10-01T20:19:00.826943] [INFO ] [MAIN ] MT: Loaded 50609 existing records. [2025-10-01T20:19:00.907499] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-01T20:19:01.028846] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:01.029116] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-01T20:19:01.029166] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-01T20:19:01.030215] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-01T20:19:01.030277] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-01T20:19:01.437385] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:01.702340] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-01T20:19:01.794744] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T20:19:02.502399] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-01T20:19:02.690238] [DEBUG] [REMOTE ] MSI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:02.690567] [WARN ] [REMOTE ] MSI: No data returned for month 2025-10 [2025-10-01T20:19:02.690682] [FATAL] [REMOTE ] MSI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:02.690782] [FATAL] [MAIN ] MSI: Failed to fetch primary data. [2025-10-01T20:19:02.690846] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:02.690898] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-01T20:19:02.690956] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-01T20:19:02.690991] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-01T20:19:02.691308] [DEBUG] [LOCAL ] MSI: Deleted derivative data file. [2025-10-01T20:19:02.691399] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSI took 24.8s. Estimated remaining: 2h 15m 23s. Rate: 7.1 symbols/min [2025-10-01T20:19:02.886535] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:02.932134] [DEBUG] [LOCAL ] MTAL: Loaded 36463 existing records from primary storage. [2025-10-01T20:19:02.932435] [INFO ] [MAIN ] MTAL: Loaded 36463 existing records. [2025-10-01T20:19:03.135441] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:03.135835] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-01T20:19:03.135967] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-01T20:19:03.136780] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-10-01T20:19:03.157892] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-01T20:19:03.221893] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T20:19:03.307460] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-01T20:19:03.582301] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:04.102403] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-01T20:19:04.902502] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-01T20:19:05.011369] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T20:19:05.702408] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-01T20:19:05.962992] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T20:19:05.988697] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T20:19:06.435164] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T20:19:06.502395] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-01T20:19:07.302380] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-01T20:19:07.667479] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T20:19:08.102391] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-01T20:19:08.310192] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T20:19:08.902408] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-01T20:19:09.192467] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T20:19:09.702405] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-01T20:19:10.502377] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-01T20:19:10.540342] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T20:19:11.302372] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-01T20:19:11.481167] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T20:19:11.991283] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T20:19:12.102405] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-01T20:19:12.330082] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T20:19:12.902373] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-01T20:19:13.483527] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-01T20:19:13.629002] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T20:19:13.702374] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-01T20:19:13.937720] [DEBUG] [REMOTE ] MSGS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:13.938082] [WARN ] [REMOTE ] MSGS: No data returned for month 2025-10 [2025-10-01T20:19:13.938172] [FATAL] [REMOTE ] MSGS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:13.938253] [FATAL] [MAIN ] MSGS: Failed to fetch primary data. [2025-10-01T20:19:13.938317] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:13.938389] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-01T20:19:13.938454] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-01T20:19:13.938490] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-01T20:19:13.938798] [DEBUG] [LOCAL ] MSGS: Deleted derivative data file. [2025-10-01T20:19:13.938907] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSGS took 37.6s. Estimated remaining: 2h 15m 17s. Rate: 7.1 symbols/min [2025-10-01T20:19:14.128977] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:14.182057] [DEBUG] [LOCAL ] MTB: Loaded 46728 existing records from primary storage. [2025-10-01T20:19:14.182400] [INFO ] [MAIN ] MTB: Loaded 46728 existing records. [2025-10-01T20:19:14.389253] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:14.389542] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-01T20:19:14.389623] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-01T20:19:14.390424] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-01T20:19:14.390501] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-01T20:19:14.507530] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-01T20:19:14.803551] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:15.302371] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-01T20:19:16.102373] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-01T20:19:16.252726] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T20:19:16.868432] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T20:19:16.902341] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-01T20:19:17.103138] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T20:19:17.702379] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-01T20:19:18.502355] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-01T20:19:18.770319] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T20:19:19.070961] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T20:19:19.302365] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-01T20:19:19.406895] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T20:19:20.102397] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-01T20:19:20.902382] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-01T20:19:20.977402] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T20:19:21.233618] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T20:19:21.702397] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-01T20:19:22.454823] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T20:19:22.502356] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-01T20:19:23.307523] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-01T20:19:23.326042] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T20:19:24.064556] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T20:19:24.102351] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-01T20:19:24.873361] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T20:19:24.902345] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-01T20:19:25.629255] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T20:19:25.702391] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-01T20:19:26.502348] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-01T20:19:26.631611] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T20:19:27.093548] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T20:19:27.302362] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-01T20:19:27.415005] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T20:19:28.102384] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-01T20:19:28.907474] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-01T20:19:28.925545] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T20:19:29.127120] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T20:19:29.702378] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-01T20:19:30.507500] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-01T20:19:30.520865] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T20:19:30.990844] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-01T20:19:31.302358] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-01T20:19:31.629171] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T20:19:32.102397] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-01T20:19:32.762358] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T20:19:32.902384] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-01T20:19:33.564774] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T20:19:33.702389] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-01T20:19:34.502400] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-01T20:19:34.721845] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T20:19:35.034603] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T20:19:35.302362] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-01T20:19:35.462429] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T20:19:35.473840] [DEBUG] [REMOTE ] MT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:35.474179] [WARN ] [REMOTE ] MT: No data returned for month 2025-10 [2025-10-01T20:19:35.474291] [FATAL] [REMOTE ] MT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:35.474369] [FATAL] [MAIN ] MT: Failed to fetch primary data. [2025-10-01T20:19:35.474438] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:35.474535] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-01T20:19:35.474622] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-01T20:19:35.474720] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-01T20:19:35.475134] [DEBUG] [LOCAL ] MT: Deleted derivative data file. [2025-10-01T20:19:35.475226] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MT took 34.9s. Estimated remaining: 2h 15m 17s. Rate: 7.1 symbols/min [2025-10-01T20:19:35.682051] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:35.699932] [DEBUG] [LOCAL ] MTD: Loaded 15091 existing records from primary storage. [2025-10-01T20:19:35.700189] [INFO ] [MAIN ] MTD: Loaded 15091 existing records. [2025-10-01T20:19:35.913019] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:35.913232] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-01T20:19:35.913285] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-01T20:19:35.914274] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-01T20:19:35.914343] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-01T20:19:36.106158] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-01T20:19:36.340120] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:36.424562] [DEBUG] [REMOTE ] MTAL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:36.424930] [WARN ] [REMOTE ] MTAL: No data returned for month 2025-10 [2025-10-01T20:19:36.425022] [FATAL] [REMOTE ] MTAL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:36.425110] [FATAL] [MAIN ] MTAL: Failed to fetch primary data. [2025-10-01T20:19:36.425173] [WARN ] [MAIN ] MTAL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:36.425243] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-01T20:19:36.425322] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-01T20:19:36.425378] [INFO ] [LOCAL ] MTAL: Starting deletion of derivative data. [2025-10-01T20:19:36.425740] [DEBUG] [LOCAL ] MTAL: Deleted derivative data file. [2025-10-01T20:19:36.425866] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MTAL took 33.7s. Estimated remaining: 2h 15m 3s. Rate: 7.1 symbols/min [2025-10-01T20:19:36.620095] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:36.672271] [DEBUG] [LOCAL ] MTDR: Loaded 51570 existing records from primary storage. [2025-10-01T20:19:36.672608] [INFO ] [MAIN ] MTDR: Loaded 51570 existing records. [2025-10-01T20:19:36.888355] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:36.888622] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-01T20:19:36.888720] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-01T20:19:36.889201] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-01T20:19:36.889261] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-01T20:19:36.907578] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-01T20:19:37.315798] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:37.525745] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T20:19:37.702380] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-01T20:19:38.334776] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T20:19:38.502399] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-01T20:19:39.269924] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T20:19:39.302340] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-01T20:19:40.102392] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-01T20:19:40.328533] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T20:19:40.902419] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-01T20:19:41.702356] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-01T20:19:41.964441] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T20:19:42.392876] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T20:19:42.502358] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-01T20:19:42.829432] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T20:19:43.110382] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T20:19:43.302364] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-01T20:19:43.995498] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T20:19:44.102425] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-01T20:19:44.460602] [DEBUG] [REMOTE ] MSM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:44.461018] [WARN ] [REMOTE ] MSM: No data returned for month 2025-10 [2025-10-01T20:19:44.461147] [FATAL] [REMOTE ] MSM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:44.461271] [FATAL] [MAIN ] MSM: Failed to fetch primary data. [2025-10-01T20:19:44.461341] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:44.461433] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-01T20:19:44.461528] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-01T20:19:44.461584] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-01T20:19:44.461978] [DEBUG] [LOCAL ] MSM: Deleted derivative data file. [2025-10-01T20:19:44.462090] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MSM took 45.0s. Estimated remaining: 2h 14m 55s. Rate: 7.1 symbols/min [2025-10-01T20:19:44.653714] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:44.705357] [DEBUG] [LOCAL ] MTG: Loaded 51280 existing records from primary storage. [2025-10-01T20:19:44.705735] [INFO ] [MAIN ] MTG: Loaded 51280 existing records. [2025-10-01T20:19:44.907742] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-01T20:19:44.912355] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:44.913540] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-01T20:19:44.913602] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-01T20:19:44.914217] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-01T20:19:44.914297] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-01T20:19:45.331049] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:45.660582] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T20:19:45.702360] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-01T20:19:46.391117] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T20:19:46.502445] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-01T20:19:47.231175] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-01T20:19:47.302363] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-01T20:19:48.102406] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-01T20:19:48.253623] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T20:19:48.902378] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-01T20:19:49.305201] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-01T20:19:49.702378] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-01T20:19:49.828228] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T20:19:49.981995] [DEBUG] [REMOTE ] MTB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:49.982315] [WARN ] [REMOTE ] MTB: No data returned for month 2025-10 [2025-10-01T20:19:49.982406] [FATAL] [REMOTE ] MTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:49.982518] [FATAL] [MAIN ] MTB: Failed to fetch primary data. [2025-10-01T20:19:49.982587] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:49.982682] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-01T20:19:49.982758] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-01T20:19:49.982797] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-01T20:19:49.983214] [DEBUG] [LOCAL ] MTB: Deleted derivative data file. [2025-10-01T20:19:49.983313] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTB took 36.0s. Estimated remaining: 2h 14m 44s. Rate: 7.1 symbols/min [2025-10-01T20:19:50.174758] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:50.221517] [DEBUG] [LOCAL ] MTH: Loaded 43700 existing records from primary storage. [2025-10-01T20:19:50.221866] [INFO ] [MAIN ] MTH: Loaded 43700 existing records. [2025-10-01T20:19:50.424506] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:50.424800] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-01T20:19:50.424859] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-01T20:19:50.425613] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-01T20:19:50.425723] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-01T20:19:50.507538] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-01T20:19:50.830637] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:51.302367] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-01T20:19:51.896154] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T20:19:52.102434] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-01T20:19:52.248121] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T20:19:52.282965] [DEBUG] [REMOTE ] MTD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:19:52.283281] [WARN ] [REMOTE ] MTD: No data returned for month 2025-10 [2025-10-01T20:19:52.283373] [FATAL] [REMOTE ] MTD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:19:52.283479] [FATAL] [MAIN ] MTD: Failed to fetch primary data. [2025-10-01T20:19:52.283543] [WARN ] [MAIN ] MTD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:19:52.283617] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-01T20:19:52.283719] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-01T20:19:52.283766] [INFO ] [LOCAL ] MTD: Starting deletion of derivative data. [2025-10-01T20:19:52.284084] [DEBUG] [LOCAL ] MTD: Deleted derivative data file. [2025-10-01T20:19:52.284174] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTD took 16.8s. Estimated remaining: 2h 14m 32s. Rate: 7.1 symbols/min [2025-10-01T20:19:52.486488] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:19:52.538477] [DEBUG] [LOCAL ] MTN: Loaded 39006 existing records from primary storage. [2025-10-01T20:19:52.538839] [INFO ] [MAIN ] MTN: Loaded 39006 existing records. [2025-10-01T20:19:52.751132] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:19:52.751346] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-01T20:19:52.751460] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-01T20:19:52.752109] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-01T20:19:52.752177] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-01T20:19:52.907489] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-01T20:19:53.163609] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:19:53.702441] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-01T20:19:54.502431] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-01T20:19:54.537512] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T20:19:55.302748] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-01T20:19:55.329529] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T20:19:56.109684] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-01T20:19:56.117070] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T20:19:56.902452] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-01T20:19:57.088194] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-01T20:19:57.466728] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T20:19:57.702396] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-01T20:19:58.502422] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-01T20:19:58.545669] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T20:19:58.821493] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T20:19:59.302426] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-01T20:20:00.102547] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-01T20:20:00.257973] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T20:20:00.494456] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T20:20:00.902410] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-01T20:20:01.702443] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-01T20:20:02.502440] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-01T20:20:03.821789] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (3.72 seconds). [2025-10-01T20:20:03.833322] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-01T20:20:04.078187] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (3.18 seconds). [2025-10-01T20:20:04.107471] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-01T20:20:04.127967] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-01T20:20:04.310492] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T20:20:04.902424] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-01T20:20:05.692807] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T20:20:05.704124] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-01T20:20:05.903489] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T20:20:06.502448] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-01T20:20:06.594441] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T20:20:07.261496] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T20:20:07.302403] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-01T20:20:07.873316] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T20:20:08.102396] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-01T20:20:08.702773] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T20:20:08.902390] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-01T20:20:09.694889] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T20:20:09.704321] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-01T20:20:10.502382] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-01T20:20:10.742295] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T20:20:11.302387] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-01T20:20:11.637569] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T20:20:12.102382] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-01T20:20:12.277242] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T20:20:12.902376] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-01T20:20:13.121244] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T20:20:13.702403] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-01T20:20:14.045583] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T20:20:14.500967] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T20:20:14.511207] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-01T20:20:15.302475] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-01T20:20:15.378788] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T20:20:15.831088] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T20:20:16.102404] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-01T20:20:16.848107] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T20:20:16.902387] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-01T20:20:17.660175] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T20:20:17.702398] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-01T20:20:18.502383] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-01T20:20:18.721737] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T20:20:19.058880] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T20:20:19.302381] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-01T20:20:20.102390] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-01T20:20:20.192824] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T20:20:20.902400] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-01T20:20:21.116774] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T20:20:21.129045] [DEBUG] [REMOTE ] MTH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:20:21.130223] [WARN ] [REMOTE ] MTH: No data returned for month 2025-10 [2025-10-01T20:20:21.130423] [FATAL] [REMOTE ] MTH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:20:21.131030] [FATAL] [MAIN ] MTH: Failed to fetch primary data. [2025-10-01T20:20:21.131119] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:20:21.131209] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-01T20:20:21.131329] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-01T20:20:21.131390] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-01T20:20:21.131782] [DEBUG] [LOCAL ] MTH: Deleted derivative data file. [2025-10-01T20:20:21.131924] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTH took 31.1s. Estimated remaining: 2h 14m 37s. Rate: 7.1 symbols/min [2025-10-01T20:20:21.333452] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:20:21.333633] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-01T20:20:21.333712] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-01T20:20:21.333823] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-01T20:20:21.333866] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-01T20:20:21.333907] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-01T20:20:21.333950] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-01T20:20:21.710174] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-01T20:20:21.773514] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:20:21.830091] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T20:20:22.502400] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-01T20:20:22.981971] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-01T20:20:23.302379] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-01T20:20:23.660878] [DEBUG] [REMOTE ] MTG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:20:23.661278] [WARN ] [REMOTE ] MTG: No data returned for month 2025-10 [2025-10-01T20:20:23.661372] [FATAL] [REMOTE ] MTG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:20:23.661472] [FATAL] [MAIN ] MTG: Failed to fetch primary data. [2025-10-01T20:20:23.661541] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:20:23.661617] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-01T20:20:23.661776] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-01T20:20:23.661851] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-01T20:20:23.662282] [DEBUG] [LOCAL ] MTG: Deleted derivative data file. [2025-10-01T20:20:23.662375] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTG took 39.2s. Estimated remaining: 2h 14m 24s. Rate: 7.1 symbols/min [2025-10-01T20:20:23.896620] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:20:23.920516] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-01T20:20:23.952976] [DEBUG] [LOCAL ] MTRN: Loaded 17990 existing records from primary storage. [2025-10-01T20:20:23.953326] [INFO ] [MAIN ] MTRN: Loaded 17990 existing records. [2025-10-01T20:20:24.119344] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-01T20:20:24.166782] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:20:24.166989] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-01T20:20:24.167039] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-01T20:20:24.167669] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-01T20:20:24.167730] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-01T20:20:24.521012] [DEBUG] [REMOTE ] MTDR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:20:24.540358] [WARN ] [REMOTE ] MTDR: No data returned for month 2025-10 [2025-10-01T20:20:24.565490] [FATAL] [REMOTE ] MTDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:20:24.569193] [FATAL] [MAIN ] MTDR: Failed to fetch primary data. [2025-10-01T20:20:24.569317] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:20:24.569724] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-01T20:20:24.585431] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-01T20:20:24.600873] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-01T20:20:24.623900] [DEBUG] [LOCAL ] MTDR: Deleted derivative data file. [2025-10-01T20:20:24.651510] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTDR took 48.2s. Estimated remaining: 2h 14m 11s. Rate: 7.1 symbols/min [2025-10-01T20:20:24.657965] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:20:24.851359] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:20:24.881082] [DEBUG] [LOCAL ] MTUS: Loaded 28314 existing records from primary storage. [2025-10-01T20:20:24.881368] [INFO ] [MAIN ] MTUS: Loaded 28314 existing records. [2025-10-01T20:20:24.912368] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-01T20:20:25.100098] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:20:25.100317] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-01T20:20:25.100378] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-01T20:20:25.100860] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-01T20:20:25.100934] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-01T20:20:25.522044] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:20:25.619310] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T20:20:25.702396] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-01T20:20:26.142455] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-01T20:20:26.502376] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-01T20:20:26.942882] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-01T20:20:27.302385] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-01T20:20:27.744627] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T20:20:28.102385] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-01T20:20:28.902395] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-01T20:20:29.705878] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-01T20:20:29.711209] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T20:20:30.145342] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T20:20:30.502404] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-01T20:20:30.584051] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T20:20:31.153143] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-01T20:20:31.302401] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-01T20:20:31.560130] [DEBUG] [REMOTE ] MTN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:20:31.560460] [WARN ] [REMOTE ] MTN: No data returned for month 2025-10 [2025-10-01T20:20:31.560559] [FATAL] [REMOTE ] MTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:20:31.560687] [FATAL] [MAIN ] MTN: Failed to fetch primary data. [2025-10-01T20:20:31.560779] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:20:31.560873] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-01T20:20:31.560955] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-01T20:20:31.561010] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-01T20:20:31.561389] [DEBUG] [LOCAL ] MTN: Deleted derivative data file. [2025-10-01T20:20:31.561504] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTN took 39.3s. Estimated remaining: 2h 14m 1s. Rate: 7.1 symbols/min [2025-10-01T20:20:31.764548] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:20:31.793264] [DEBUG] [LOCAL ] MTW: Loaded 26443 existing records from primary storage. [2025-10-01T20:20:31.793550] [INFO ] [MAIN ] MTW: Loaded 26443 existing records. [2025-10-01T20:20:31.992145] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:20:31.992369] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-01T20:20:31.992421] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-01T20:20:31.993858] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-01T20:20:31.993923] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-01T20:20:32.107364] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-01T20:20:32.379825] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:20:32.868465] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-01T20:20:32.902390] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-01T20:20:33.535379] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T20:20:33.702393] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-01T20:20:34.493505] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T20:20:34.502331] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-01T20:20:35.061972] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-01T20:20:35.302422] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-01T20:20:36.102357] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-01T20:20:36.181048] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T20:20:36.573071] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-01T20:20:36.902395] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-01T20:20:37.702366] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-01T20:20:38.080144] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T20:20:38.391733] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T20:20:38.502429] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-01T20:20:39.302398] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-01T20:20:39.896182] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T20:20:40.102401] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-01T20:20:40.466550] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T20:20:40.902388] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-01T20:20:41.436033] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T20:20:41.702427] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-01T20:20:42.069340] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T20:20:42.142038] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T20:20:42.502401] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-01T20:20:42.682880] [DEBUG] [REMOTE ] MTR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:20:42.683253] [WARN ] [REMOTE ] MTR: No data returned for month 2025-10 [2025-10-01T20:20:42.683422] [FATAL] [REMOTE ] MTR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:20:42.683503] [FATAL] [MAIN ] MTR: Failed to fetch primary data. [2025-10-01T20:20:42.683542] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:20:42.683580] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-01T20:20:42.683637] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-01T20:20:42.683721] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-01T20:20:42.683771] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-01T20:20:42.683819] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTR took 21.6s. Estimated remaining: 2h 13m 55s. Rate: 7.1 symbols/min [2025-10-01T20:20:42.870507] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:20:42.893098] [DEBUG] [LOCAL ] MTX: Loaded 22798 existing records from primary storage. [2025-10-01T20:20:42.893360] [INFO ] [MAIN ] MTX: Loaded 22798 existing records. [2025-10-01T20:20:43.081856] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:20:43.082086] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-01T20:20:43.082134] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-01T20:20:43.082601] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-01T20:20:43.082726] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-01T20:20:43.307562] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-01T20:20:43.468888] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:20:44.102432] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-01T20:20:44.423255] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T20:20:44.902372] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-01T20:20:45.026333] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-01T20:20:45.702396] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-01T20:20:46.128229] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T20:20:46.502401] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-01T20:20:46.762577] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T20:20:47.302392] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-01T20:20:47.608554] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T20:20:48.102457] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-01T20:20:48.727017] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T20:20:48.902397] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-01T20:20:49.051577] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T20:20:49.702443] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-01T20:20:49.966544] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T20:20:50.502381] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-01T20:20:50.739894] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T20:20:51.302512] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-01T20:20:51.392277] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T20:20:52.102426] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-01T20:20:52.694301] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T20:20:52.902371] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-01T20:20:53.149342] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T20:20:53.702380] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-01T20:20:53.878835] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T20:20:54.502435] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-01T20:20:54.682865] [DEBUG] [REMOTE ] MTRN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:20:54.683255] [WARN ] [REMOTE ] MTRN: No data returned for month 2025-10 [2025-10-01T20:20:54.683347] [FATAL] [REMOTE ] MTRN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:20:54.683446] [FATAL] [MAIN ] MTRN: Failed to fetch primary data. [2025-10-01T20:20:54.683513] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:20:54.683589] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-01T20:20:54.683681] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-01T20:20:54.683741] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-01T20:20:54.684064] [DEBUG] [LOCAL ] MTRN: Deleted derivative data file. [2025-10-01T20:20:54.684184] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTRN took 31.0s. Estimated remaining: 2h 13m 49s. Rate: 7.1 symbols/min [2025-10-01T20:20:54.880585] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:20:54.928813] [DEBUG] [LOCAL ] MTZ: Loaded 43080 existing records from primary storage. [2025-10-01T20:20:54.929119] [INFO ] [MAIN ] MTZ: Loaded 43080 existing records. [2025-10-01T20:20:55.129415] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:20:55.129630] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-01T20:20:55.129716] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-01T20:20:55.130576] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-01T20:20:55.130679] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-01T20:20:55.302829] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-01T20:20:55.525845] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:20:56.102415] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-01T20:20:56.721297] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T20:20:56.902358] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-01T20:20:57.258176] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T20:20:57.702389] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-01T20:20:57.763314] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (4.06 seconds). [2025-10-01T20:20:58.142462] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T20:20:58.502431] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-01T20:20:58.604180] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:20:59.302388] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-01T20:20:59.776679] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T20:21:00.102433] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-01T20:21:00.582179] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-01T20:21:00.902390] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-01T20:21:01.326833] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T20:21:01.702379] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-01T20:21:02.225491] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T20:21:02.502393] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-01T20:21:03.205350] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T20:21:03.302386] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-01T20:21:03.431814] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T20:21:04.102414] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-01T20:21:04.358556] [DEBUG] [REMOTE ] MTUS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:04.358880] [WARN ] [REMOTE ] MTUS: No data returned for month 2025-10 [2025-10-01T20:21:04.358972] [FATAL] [REMOTE ] MTUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:04.359074] [FATAL] [MAIN ] MTUS: Failed to fetch primary data. [2025-10-01T20:21:04.359156] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:04.359288] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-01T20:21:04.359366] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-01T20:21:04.359406] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-01T20:21:04.359934] [DEBUG] [LOCAL ] MTUS: Deleted derivative data file. [2025-10-01T20:21:04.360037] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTUS took 39.7s. Estimated remaining: 2h 13m 41s. Rate: 7.1 symbols/min [2025-10-01T20:21:04.593277] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:04.611873] [DEBUG] [LOCAL ] MUA: Loaded 12248 existing records from primary storage. [2025-10-01T20:21:04.612109] [INFO ] [MAIN ] MUA: Loaded 12248 existing records. [2025-10-01T20:21:04.826298] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:21:04.826523] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-01T20:21:04.826574] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-01T20:21:04.826957] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-01T20:21:04.827022] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-01T20:21:04.909921] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-01T20:21:05.251926] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:21:05.279334] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-01T20:21:05.702404] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-01T20:21:05.983745] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T20:21:06.502385] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-01T20:21:07.301518] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T20:21:07.310332] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-01T20:21:07.542585] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T20:21:08.102444] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-01T20:21:08.477143] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T20:21:08.887308] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T20:21:08.902378] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-01T20:21:09.702416] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-01T20:21:09.824223] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T20:21:10.502374] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-01T20:21:11.302386] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-01T20:21:11.346929] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T20:21:11.588506] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T20:21:12.102353] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-01T20:21:12.266470] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T20:21:12.902383] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-01T20:21:13.021490] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T20:21:13.702388] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-01T20:21:13.923794] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-01T20:21:14.211160] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T20:21:14.502403] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-01T20:21:15.302368] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-01T20:21:15.529539] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T20:21:16.102367] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-01T20:21:16.490939] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T20:21:16.902358] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-01T20:21:16.981189] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T20:21:17.702393] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-01T20:21:17.899068] [DEBUG] [REMOTE ] MTW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:17.899398] [WARN ] [REMOTE ] MTW: No data returned for month 2025-10 [2025-10-01T20:21:17.899491] [FATAL] [REMOTE ] MTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:17.899574] [FATAL] [MAIN ] MTW: Failed to fetch primary data. [2025-10-01T20:21:17.899639] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:17.899728] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-01T20:21:17.899789] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-01T20:21:17.899825] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-01T20:21:17.900250] [DEBUG] [LOCAL ] MTW: Deleted derivative data file. [2025-10-01T20:21:17.900341] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTW took 46.3s. Estimated remaining: 2h 13m 36s. Rate: 7.1 symbols/min [2025-10-01T20:21:18.105973] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:18.133322] [DEBUG] [LOCAL ] MUC: Loaded 20622 existing records from primary storage. [2025-10-01T20:21:18.133590] [INFO ] [MAIN ] MUC: Loaded 20622 existing records. [2025-10-01T20:21:18.342909] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:21:18.343188] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-01T20:21:18.343305] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-01T20:21:18.343994] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-01T20:21:18.344061] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-01T20:21:18.506027] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-01T20:21:18.672194] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T20:21:18.801785] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:21:19.302382] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-01T20:21:19.546234] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T20:21:20.102434] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-01T20:21:20.902384] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-01T20:21:20.955223] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T20:21:20.979445] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T20:21:21.702389] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-01T20:21:22.197318] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T20:21:22.502374] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-01T20:21:23.277267] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T20:21:23.302347] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-01T20:21:23.566611] [DEBUG] [REMOTE ] MTX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:23.566997] [WARN ] [REMOTE ] MTX: No data returned for month 2025-10 [2025-10-01T20:21:23.567096] [FATAL] [REMOTE ] MTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:23.567207] [FATAL] [MAIN ] MTX: Failed to fetch primary data. [2025-10-01T20:21:23.567278] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:23.567359] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-01T20:21:23.567431] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-01T20:21:23.567474] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-01T20:21:23.567883] [DEBUG] [LOCAL ] MTX: Deleted derivative data file. [2025-10-01T20:21:23.567988] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTX took 40.9s. Estimated remaining: 2h 13m 25s. Rate: 7.1 symbols/min [2025-10-01T20:21:23.717204] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T20:21:23.776462] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:23.792679] [DEBUG] [LOCAL ] MUE: Loaded 11929 existing records from primary storage. [2025-10-01T20:21:23.792969] [INFO ] [MAIN ] MUE: Loaded 11929 existing records. [2025-10-01T20:21:23.986040] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:21:23.986244] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-01T20:21:23.986296] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-01T20:21:23.986575] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-01T20:21:23.986638] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-01T20:21:24.107497] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-01T20:21:24.418904] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:21:24.902402] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-01T20:21:25.702386] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-01T20:21:25.750202] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T20:21:25.873988] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T20:21:26.502397] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-01T20:21:26.533596] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T20:21:27.302383] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-01T20:21:27.817024] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T20:21:28.102403] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-01T20:21:28.299587] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T20:21:28.305984] [DEBUG] [REMOTE ] MUA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:28.306228] [WARN ] [REMOTE ] MUA: No data returned for month 2025-10 [2025-10-01T20:21:28.306317] [FATAL] [REMOTE ] MUA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:28.306391] [FATAL] [MAIN ] MUA: Failed to fetch primary data. [2025-10-01T20:21:28.306471] [WARN ] [MAIN ] MUA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:28.306541] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-01T20:21:28.306638] [DEBUG] [LOCAL ] MUA: No primary data file found to delete. [2025-10-01T20:21:28.306719] [INFO ] [LOCAL ] MUA: Starting deletion of derivative data. [2025-10-01T20:21:28.307061] [DEBUG] [LOCAL ] MUA: Deleted derivative data file. [2025-10-01T20:21:28.307144] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MUA took 23.9s. Estimated remaining: 2h 13m 14s. Rate: 7.1 symbols/min [2025-10-01T20:21:28.492025] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:28.562196] [DEBUG] [LOCAL ] MUFG: Loaded 52571 existing records from primary storage. [2025-10-01T20:21:28.562558] [INFO ] [MAIN ] MUFG: Loaded 52571 existing records. [2025-10-01T20:21:28.780119] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:21:28.780350] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-01T20:21:28.780405] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-01T20:21:28.781507] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-01T20:21:28.781588] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-01T20:21:28.907497] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-01T20:21:29.196376] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:21:29.702419] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-01T20:21:30.292697] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T20:21:30.502385] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-01T20:21:30.723262] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T20:21:30.991578] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-01T20:21:31.302417] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-01T20:21:32.102432] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-01T20:21:32.762664] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T20:21:32.902353] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-01T20:21:33.079807] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T20:21:33.702382] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-01T20:21:34.142746] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T20:21:34.502436] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-01T20:21:35.302404] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-01T20:21:35.371344] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T20:21:35.424829] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T20:21:36.102428] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-01T20:21:36.125427] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T20:21:36.902396] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-01T20:21:37.251631] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T20:21:37.702443] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-01T20:21:37.723535] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T20:21:37.928567] [DEBUG] [REMOTE ] MTZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:37.928971] [WARN ] [REMOTE ] MTZ: No data returned for month 2025-10 [2025-10-01T20:21:37.929073] [FATAL] [REMOTE ] MTZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:37.929174] [FATAL] [MAIN ] MTZ: Failed to fetch primary data. [2025-10-01T20:21:37.929244] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:37.929320] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-01T20:21:37.929386] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-01T20:21:37.929425] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-01T20:21:37.929760] [DEBUG] [LOCAL ] MTZ: Deleted derivative data file. [2025-10-01T20:21:37.929861] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MTZ took 43.2s. Estimated remaining: 2h 13m 7s. Rate: 7.1 symbols/min [2025-10-01T20:21:38.125816] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:38.142203] [DEBUG] [LOCAL ] MUJ: Loaded 13216 existing records from primary storage. [2025-10-01T20:21:38.142446] [INFO ] [MAIN ] MUJ: Loaded 13216 existing records. [2025-10-01T20:21:38.340809] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:21:38.341016] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-01T20:21:38.341065] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-01T20:21:38.341403] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-01T20:21:38.341468] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-01T20:21:38.506598] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-01T20:21:38.748051] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:21:39.302397] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-01T20:21:39.659563] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T20:21:40.102423] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-01T20:21:40.299473] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T20:21:40.902380] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-01T20:21:41.110758] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T20:21:41.434191] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T20:21:41.702383] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-01T20:21:42.502413] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-01T20:21:43.278223] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T20:21:43.302351] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-01T20:21:43.480368] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T20:21:44.102357] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-01T20:21:44.111475] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T20:21:44.902400] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-01T20:21:45.702440] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-01T20:21:45.738430] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T20:21:46.088306] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T20:21:46.502407] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-01T20:21:46.692045] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T20:21:47.302395] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-01T20:21:47.404243] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T20:21:48.102386] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-01T20:21:48.232137] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T20:21:48.902414] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-01T20:21:49.702401] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-01T20:21:49.846922] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T20:21:50.016186] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T20:21:50.502412] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-01T20:21:50.863770] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T20:21:51.302382] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-01T20:21:51.460290] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T20:21:52.102394] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-01T20:21:52.855044] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T20:21:52.902360] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-01T20:21:53.009049] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T20:21:53.702380] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-01T20:21:54.502372] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-01T20:21:54.780419] [DEBUG] [REMOTE ] MUE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:54.780908] [WARN ] [REMOTE ] MUE: No data returned for month 2025-10 [2025-10-01T20:21:54.781040] [FATAL] [REMOTE ] MUE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:54.781180] [FATAL] [MAIN ] MUE: Failed to fetch primary data. [2025-10-01T20:21:54.781267] [WARN ] [MAIN ] MUE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:54.781366] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-01T20:21:54.781474] [DEBUG] [LOCAL ] MUE: No primary data file found to delete. [2025-10-01T20:21:54.781522] [INFO ] [LOCAL ] MUE: Starting deletion of derivative data. [2025-10-01T20:21:54.781960] [DEBUG] [LOCAL ] MUE: Deleted derivative data file. [2025-10-01T20:21:54.782063] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUE took 31.2s. Estimated remaining: 2h 13m 4s. Rate: 7.1 symbols/min [2025-10-01T20:21:54.912308] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T20:21:55.025952] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:55.032987] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-01T20:21:55.108369] [DEBUG] [LOCAL ] MUR: Loaded 52925 existing records from primary storage. [2025-10-01T20:21:55.108829] [INFO ] [MAIN ] MUR: Loaded 52925 existing records. [2025-10-01T20:21:55.306592] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:21:55.306744] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-01T20:21:55.307285] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-01T20:21:55.308293] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-01T20:21:55.309130] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-01T20:21:55.309194] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-01T20:21:55.710730] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:21:56.102348] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-01T20:21:56.498550] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T20:21:56.902361] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-01T20:21:57.135400] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T20:21:57.702386] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-01T20:21:58.166510] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T20:21:58.502396] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-01T20:21:58.690689] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T20:21:58.733852] [DEBUG] [REMOTE ] MUC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:58.734210] [WARN ] [REMOTE ] MUC: No data returned for month 2025-10 [2025-10-01T20:21:58.734306] [FATAL] [REMOTE ] MUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:58.734444] [FATAL] [MAIN ] MUC: Failed to fetch primary data. [2025-10-01T20:21:58.734519] [WARN ] [MAIN ] MUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:58.734592] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-01T20:21:58.734688] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-01T20:21:58.734748] [INFO ] [LOCAL ] MUC: Starting deletion of derivative data. [2025-10-01T20:21:58.735140] [DEBUG] [LOCAL ] MUC: Deleted derivative data file. [2025-10-01T20:21:58.735260] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUC took 40.8s. Estimated remaining: 2h 12m 52s. Rate: 7.1 symbols/min [2025-10-01T20:21:58.928991] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:58.955072] [DEBUG] [LOCAL ] MUSA: Loaded 24760 existing records from primary storage. [2025-10-01T20:21:58.955408] [INFO ] [MAIN ] MUSA: Loaded 24760 existing records. [2025-10-01T20:21:59.152840] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:21:59.153080] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-01T20:21:59.153128] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-01T20:21:59.153504] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-01T20:21:59.153563] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-01T20:21:59.313524] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-01T20:21:59.553025] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:21:59.677951] [DEBUG] [REMOTE ] MUJ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:21:59.678352] [WARN ] [REMOTE ] MUJ: No data returned for month 2025-10 [2025-10-01T20:21:59.678470] [FATAL] [REMOTE ] MUJ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:21:59.678600] [FATAL] [MAIN ] MUJ: Failed to fetch primary data. [2025-10-01T20:21:59.678700] [WARN ] [MAIN ] MUJ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:21:59.678799] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-01T20:21:59.678869] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-01T20:21:59.678914] [INFO ] [LOCAL ] MUJ: Starting deletion of derivative data. [2025-10-01T20:21:59.679250] [DEBUG] [LOCAL ] MUJ: Deleted derivative data file. [2025-10-01T20:21:59.679359] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUJ took 21.7s. Estimated remaining: 2h 12m 39s. Rate: 7.1 symbols/min [2025-10-01T20:21:59.884187] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:21:59.884428] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-01T20:21:59.884487] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-01T20:21:59.884601] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-01T20:21:59.884677] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-01T20:21:59.884743] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-01T20:21:59.884778] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-01T20:22:00.105690] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-01T20:22:00.407469] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:22:00.902436] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-01T20:22:01.702439] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-01T20:22:01.760402] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T20:22:01.982795] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-01T20:22:02.231891] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-01T20:22:02.502406] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-01T20:22:02.771504] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:22:02.771932] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-01T20:22:02.772099] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:22:02.772222] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-01T20:22:02.772313] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:22:02.772407] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-01T20:22:02.772488] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-01T20:22:02.772550] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-01T20:22:02.772629] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-01T20:22:02.772745] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUSE took 3.1s. Estimated remaining: 2h 12m 27s. Rate: 7.1 symbols/min [2025-10-01T20:22:02.963322] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:22:02.963521] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-01T20:22:02.963561] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-01T20:22:02.963704] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-01T20:22:02.963811] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-01T20:22:02.963865] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-01T20:22:02.963904] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-01T20:22:03.307573] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-01T20:22:03.381501] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:22:04.102395] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-01T20:22:04.594816] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T20:22:04.902386] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-01T20:22:05.611003] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T20:22:05.702426] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-01T20:22:06.317222] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T20:22:06.502430] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-01T20:22:07.302399] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-01T20:22:07.597914] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T20:22:07.643262] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T20:22:08.102396] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-01T20:22:08.712197] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T20:22:08.902417] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-01T20:22:09.356512] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T20:22:09.702396] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-01T20:22:10.507365] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-01T20:22:10.514238] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T20:22:10.931330] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T20:22:11.302379] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-01T20:22:12.102352] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-01T20:22:12.458751] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T20:22:12.653818] [DEBUG] [REMOTE ] MUFG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:22:12.654185] [WARN ] [REMOTE ] MUFG: No data returned for month 2025-10 [2025-10-01T20:22:12.654324] [FATAL] [REMOTE ] MUFG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:22:12.654416] [FATAL] [MAIN ] MUFG: Failed to fetch primary data. [2025-10-01T20:22:12.654494] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:22:12.654571] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-01T20:22:12.654638] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-01T20:22:12.654722] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-01T20:22:12.655157] [DEBUG] [LOCAL ] MUFG: Deleted derivative data file. [2025-10-01T20:22:12.655250] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUFG took 44.3s. Estimated remaining: 2h 12m 19s. Rate: 7.1 symbols/min [2025-10-01T20:22:12.797852] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T20:22:12.898913] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:22:12.902350] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-01T20:22:12.914220] [DEBUG] [LOCAL ] MVF: Loaded 12938 existing records from primary storage. [2025-10-01T20:22:12.914460] [INFO ] [MAIN ] MVF: Loaded 12938 existing records. [2025-10-01T20:22:13.109479] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:22:13.109741] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-01T20:22:13.109822] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-01T20:22:13.110366] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-01T20:22:13.110432] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-01T20:22:13.509567] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:22:13.702380] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-01T20:22:14.359614] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T20:22:14.502377] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-01T20:22:15.118061] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T20:22:15.302397] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-01T20:22:15.588325] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T20:22:16.102388] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-01T20:22:16.394235] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T20:22:16.902378] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-01T20:22:17.702430] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-01T20:22:17.818063] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T20:22:17.850049] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T20:22:18.502379] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-01T20:22:19.302380] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-01T20:22:19.418551] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T20:22:19.448015] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T20:22:20.102372] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-01T20:22:20.273005] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T20:22:20.902355] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-01T20:22:21.072871] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T20:22:21.702442] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-01T20:22:21.954453] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T20:22:22.502458] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-01T20:22:23.248134] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T20:22:23.302412] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-01T20:22:24.102405] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-01T20:22:24.260079] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T20:22:24.691435] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T20:22:24.902375] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-01T20:22:25.702361] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-01T20:22:25.861347] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T20:22:25.883167] [DEBUG] [REMOTE ] MUSA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:22:25.883542] [WARN ] [REMOTE ] MUSA: No data returned for month 2025-10 [2025-10-01T20:22:25.884614] [FATAL] [REMOTE ] MUSA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:22:25.884799] [FATAL] [MAIN ] MUSA: Failed to fetch primary data. [2025-10-01T20:22:25.884889] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:22:25.884986] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-01T20:22:25.885086] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-01T20:22:25.885144] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-01T20:22:25.885411] [DEBUG] [LOCAL ] MUSA: Deleted derivative data file. [2025-10-01T20:22:25.885530] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUSA took 27.2s. Estimated remaining: 2h 12m 14s. Rate: 7.1 symbols/min [2025-10-01T20:22:26.067571] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:22:26.078796] [DEBUG] [LOCAL ] MVO: Loaded 8990 existing records from primary storage. [2025-10-01T20:22:26.079016] [INFO ] [MAIN ] MVO: Loaded 8990 existing records. [2025-10-01T20:22:26.283552] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:22:26.283937] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-01T20:22:26.284020] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-01T20:22:26.284341] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-01T20:22:26.284407] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-01T20:22:26.509537] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-01T20:22:26.707950] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:22:26.742859] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T20:22:27.302420] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-01T20:22:28.044888] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T20:22:28.102386] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-01T20:22:28.169450] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T20:22:28.902362] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-01T20:22:28.988850] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T20:22:29.702388] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-01T20:22:29.743303] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T20:22:30.502441] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-01T20:22:31.302406] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-01T20:22:31.409496] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T20:22:31.437363] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T20:22:32.102393] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-01T20:22:32.858048] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T20:22:32.902415] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-01T20:22:33.000127] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:22:33.702440] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-01T20:22:34.502441] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-01T20:22:34.605730] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T20:22:34.836902] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T20:22:35.122572] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-01T20:22:35.302396] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-01T20:22:36.102418] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-01T20:22:36.894615] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T20:22:36.902448] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-01T20:22:37.076054] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T20:22:37.409047] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T20:22:37.702435] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-01T20:22:38.491255] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T20:22:38.502381] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-01T20:22:39.302404] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-01T20:22:39.371244] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T20:22:39.742609] [DEBUG] [REMOTE ] MUR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:22:39.743009] [WARN ] [REMOTE ] MUR: No data returned for month 2025-10 [2025-10-01T20:22:39.743104] [FATAL] [REMOTE ] MUR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:22:39.743201] [FATAL] [MAIN ] MUR: Failed to fetch primary data. [2025-10-01T20:22:39.743267] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:22:39.743342] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-01T20:22:39.743431] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-01T20:22:39.743491] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-01T20:22:39.743795] [DEBUG] [LOCAL ] MUR: Deleted derivative data file. [2025-10-01T20:22:39.743903] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUR took 45.0s. Estimated remaining: 2h 12m 9s. Rate: 7.1 symbols/min [2025-10-01T20:22:39.932377] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:22:39.945089] [DEBUG] [LOCAL ] MVT: Loaded 10215 existing records from primary storage. [2025-10-01T20:22:39.945336] [INFO ] [MAIN ] MVT: Loaded 10215 existing records. [2025-10-01T20:22:40.107009] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-01T20:22:40.136025] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:22:40.136350] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-01T20:22:40.136405] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-01T20:22:40.136775] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-01T20:22:40.136837] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-01T20:22:40.516338] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:22:40.909030] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-01T20:22:40.914067] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T20:22:41.702387] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-01T20:22:42.502354] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-01T20:22:42.575715] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T20:22:42.677417] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T20:22:43.302454] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-01T20:22:43.428515] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T20:22:43.593400] [DEBUG] [REMOTE ] MUX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:22:43.593801] [WARN ] [REMOTE ] MUX: No data returned for month 2025-10 [2025-10-01T20:22:43.593915] [FATAL] [REMOTE ] MUX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:22:43.594041] [FATAL] [MAIN ] MUX: Failed to fetch primary data. [2025-10-01T20:22:43.594130] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:22:43.594220] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-01T20:22:43.594326] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-01T20:22:43.594403] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-01T20:22:43.594494] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-01T20:22:43.594588] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUX took 40.8s. Estimated remaining: 2h 11m 58s. Rate: 7.1 symbols/min [2025-10-01T20:22:43.803028] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:22:43.859482] [DEBUG] [LOCAL ] MWA: Loaded 46658 existing records from primary storage. [2025-10-01T20:22:43.860153] [INFO ] [MAIN ] MWA: Loaded 46658 existing records. [2025-10-01T20:22:44.079223] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:22:44.079478] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-01T20:22:44.079549] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-01T20:22:44.080249] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-01T20:22:44.080310] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-01T20:22:44.111812] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-01T20:22:44.484118] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:22:44.479901] [DEBUG] [REMOTE ] MVO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:22:44.484950] [WARN ] [REMOTE ] MVO: No data returned for month 2025-10 [2025-10-01T20:22:44.485108] [FATAL] [REMOTE ] MVO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:22:44.485269] [FATAL] [MAIN ] MVO: Failed to fetch primary data. [2025-10-01T20:22:44.485356] [WARN ] [MAIN ] MVO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:22:44.485431] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-01T20:22:44.485503] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-01T20:22:44.485544] [INFO ] [LOCAL ] MVO: Starting deletion of derivative data. [2025-10-01T20:22:44.485922] [DEBUG] [LOCAL ] MVO: Deleted derivative data file. [2025-10-01T20:22:44.486049] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVO took 18.6s. Estimated remaining: 2h 11m 44s. Rate: 7.1 symbols/min [2025-10-01T20:22:44.902398] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-01T20:22:45.702380] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-01T20:22:45.783415] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T20:22:46.502431] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-01T20:22:46.518194] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T20:22:47.302423] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-01T20:22:48.020906] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T20:22:48.023176] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T20:22:48.102438] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-01T20:22:48.902400] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-01T20:22:49.051193] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T20:22:49.702381] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-01T20:22:50.501075] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T20:22:50.510461] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-01T20:22:50.586337] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T20:22:51.302460] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-01T20:22:52.102460] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-01T20:23:05.764204] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (13.66 seconds). [2025-10-01T20:23:05.768899] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-01T20:23:06.040547] [DEBUG] [REMOTE ] MVF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:23:06.040959] [WARN ] [REMOTE ] MVF: No data returned for month 2025-10 [2025-10-01T20:23:06.041109] [FATAL] [REMOTE ] MVF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:23:06.041231] [FATAL] [MAIN ] MVF: Failed to fetch primary data. [2025-10-01T20:23:06.041327] [WARN ] [MAIN ] MVF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:23:06.041405] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-01T20:23:06.041508] [DEBUG] [LOCAL ] MVF: No primary data file found to delete. [2025-10-01T20:23:06.041566] [INFO ] [LOCAL ] MVF: Starting deletion of derivative data. [2025-10-01T20:23:06.041929] [DEBUG] [LOCAL ] MVF: Deleted derivative data file. [2025-10-01T20:23:06.042100] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVF took 53.4s. Estimated remaining: 2h 11m 44s. Rate: 7.1 symbols/min [2025-10-01T20:23:06.370442] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (15.86 seconds). [2025-10-01T20:23:06.373928] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-01T20:23:06.696732] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (15.39 seconds). [2025-10-01T20:23:06.707533] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-01T20:23:07.782325] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T20:23:07.785801] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-01T20:23:08.632701] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-01T20:23:08.635399] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-01T20:23:08.851681] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-01T20:23:08.863531] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-01T20:23:09.575891] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T20:23:09.580548] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-01T20:23:10.516607] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T20:23:10.519145] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-01T20:23:11.389438] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:23:11.392801] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-01T20:23:11.772044] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-01T20:23:11.783451] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-01T20:23:12.103279] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T20:23:12.106271] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-01T20:23:12.389529] [DEBUG] [REMOTE ] MVT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:23:12.389945] [WARN ] [REMOTE ] MVT: No data returned for month 2025-10 [2025-10-01T20:23:12.390049] [FATAL] [REMOTE ] MVT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:23:12.390196] [FATAL] [MAIN ] MVT: Failed to fetch primary data. [2025-10-01T20:23:12.390282] [WARN ] [MAIN ] MVT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:23:12.390369] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-01T20:23:12.390451] [DEBUG] [LOCAL ] MVT: No primary data file found to delete. [2025-10-01T20:23:12.390504] [INFO ] [LOCAL ] MVT: Starting deletion of derivative data. [2025-10-01T20:23:12.391892] [DEBUG] [LOCAL ] MVT: Deleted derivative data file. [2025-10-01T20:23:12.392031] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 32.6s. Estimated remaining: 2h 11m 34s. Rate: 7.1 symbols/min [2025-10-01T20:23:13.577745] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T20:23:13.594259] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-01T20:23:15.214949] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T20:23:15.224926] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-01T20:23:16.841022] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T20:23:16.851436] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-01T20:23:18.619694] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T20:23:18.631750] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-01T20:23:20.364421] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T20:23:20.374786] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-01T20:23:20.573733] [DEBUG] [REMOTE ] MWA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:23:20.574128] [WARN ] [REMOTE ] MWA: No data returned for month 2025-10 [2025-10-01T20:23:20.574252] [FATAL] [REMOTE ] MWA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:23:20.574350] [FATAL] [MAIN ] MWA: Failed to fetch primary data. [2025-10-01T20:23:20.574415] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:23:20.574490] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-01T20:23:20.574575] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-01T20:23:20.574671] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-01T20:23:20.575026] [DEBUG] [LOCAL ] MWA: Deleted derivative data file. [2025-10-01T20:23:20.575201] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MWA took 37.0s. Estimated remaining: 2h 11m 26s. Rate: 7.1 symbols/min [2025-10-01T20:23:21.409108] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:23:21.385373] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:23:21.534114] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:23:21.526565] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:23:21.538991] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-01T20:23:21.539418] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-01T20:23:21.539821] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-01T20:23:21.539939] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-01T20:23:21.539999] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-01T20:23:21.540050] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-01T20:23:21.574701] [DEBUG] [LOCAL ] MYD: Loaded 13710 existing records from primary storage. [2025-10-01T20:23:21.631083] [INFO ] [MAIN ] MYD: Loaded 13710 existing records. [2025-10-01T20:23:21.646630] [DEBUG] [LOCAL ] MXF: Loaded 5795 existing records from primary storage. [2025-10-01T20:23:21.652602] [INFO ] [MAIN ] MXF: Loaded 5795 existing records. [2025-10-01T20:23:21.699831] [DEBUG] [LOCAL ] MX: Loaded 22873 existing records from primary storage. [2025-10-01T20:23:21.820215] [INFO ] [MAIN ] MX: Loaded 22873 existing records. [2025-10-01T20:23:22.459003] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:23:22.501244] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-01T20:23:22.505137] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:23:22.510562] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-01T20:23:22.536945] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-01T20:23:22.547381] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-01T20:23:22.558972] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-01T20:23:22.647581] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-01T20:23:22.641246] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:23:22.677011] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-01T20:23:22.676935] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-01T20:23:22.734755] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:23:22.748318] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-01T20:23:22.759122] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-01T20:23:22.739985] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-01T20:23:22.821831] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-01T20:23:22.849272] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-01T20:23:23.507474] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T20:23:23.590111] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-01T20:23:23.820725] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:23:23.846408] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-01T20:23:24.000214] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:23:24.008996] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-01T20:23:24.015758] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:23:24.016865] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-01T20:23:24.298733] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T20:23:24.300047] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-01T20:23:24.843223] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T20:23:24.844574] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-01T20:23:24.893576] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T20:23:24.896251] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-01T20:23:25.120921] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T20:23:25.125688] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-01T20:23:25.403322] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T20:23:25.409958] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-01T20:23:25.557185] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T20:23:25.558437] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-01T20:23:25.776587] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T20:23:25.779912] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-01T20:23:25.820862] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T20:23:25.824343] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-01T20:23:25.948593] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-01T20:23:25.949718] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-01T20:23:26.096763] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T20:23:26.102553] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-01T20:23:26.321194] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T20:23:26.324309] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-01T20:23:26.378418] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T20:23:26.380232] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-01T20:23:26.918132] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-01T20:23:26.919689] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-01T20:23:26.922543] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T20:23:26.932738] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T20:23:26.933696] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-01T20:23:26.937350] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-01T20:23:27.242806] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T20:23:27.248911] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-01T20:23:27.522255] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T20:23:27.523923] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-01T20:23:27.725953] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T20:23:27.730570] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-01T20:23:27.747553] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T20:23:27.751855] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-01T20:23:28.145116] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-01T20:23:28.146493] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-01T20:23:28.411246] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T20:23:28.414201] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-01T20:23:28.558202] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T20:23:28.563972] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-01T20:23:28.902890] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T20:23:28.903024] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T20:23:28.908730] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-01T20:23:28.909360] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-01T20:23:29.109846] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T20:23:29.111803] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-01T20:23:29.153424] [DEBUG] [REMOTE ] MXE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:23:29.153849] [WARN ] [REMOTE ] MXE: No data returned for month 2025-10 [2025-10-01T20:23:29.153989] [FATAL] [REMOTE ] MXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:23:29.154075] [FATAL] [MAIN ] MXE: Failed to fetch primary data. [2025-10-01T20:23:29.154167] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:23:29.154253] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-01T20:23:29.154323] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-01T20:23:29.154359] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-01T20:23:29.154399] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-01T20:23:29.154445] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 8.6s. Estimated remaining: 2h 11m 17s. Rate: 7.1 symbols/min [2025-10-01T20:23:29.337394] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:23:29.363995] [DEBUG] [LOCAL ] MYE: Loaded 24623 existing records from primary storage. [2025-10-01T20:23:29.364354] [INFO ] [MAIN ] MYE: Loaded 24623 existing records. [2025-10-01T20:23:29.590350] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:23:29.590998] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-01T20:23:29.591114] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-01T20:23:29.591578] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-01T20:23:29.591704] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-01T20:23:29.726441] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T20:23:29.734793] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-01T20:23:29.766902] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T20:23:30.033729] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T20:23:30.087438] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:23:30.502385] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-01T20:23:30.562439] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T20:23:31.302416] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-01T20:23:31.411163] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T20:23:32.102391] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-01T20:23:32.586510] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T20:23:32.902376] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-01T20:23:33.125263] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T20:23:33.314103] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T20:23:33.702391] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-01T20:23:34.502430] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-01T20:23:35.175398] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T20:23:35.188822] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-01T20:23:35.302439] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-01T20:23:35.571161] [DEBUG] [REMOTE ] MXF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:23:35.571487] [WARN ] [REMOTE ] MXF: No data returned for month 2025-10 [2025-10-01T20:23:35.571617] [FATAL] [REMOTE ] MXF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:23:35.571768] [FATAL] [MAIN ] MXF: Failed to fetch primary data. [2025-10-01T20:23:35.571838] [WARN ] [MAIN ] MXF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:23:35.571929] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-01T20:23:35.572044] [DEBUG] [LOCAL ] MXF: No primary data file found to delete. [2025-10-01T20:23:35.572114] [INFO ] [LOCAL ] MXF: Starting deletion of derivative data. [2025-10-01T20:23:35.572558] [DEBUG] [LOCAL ] MXF: Deleted derivative data file. [2025-10-01T20:23:35.572706] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 15.0s. Estimated remaining: 2h 11m 8s. Rate: 7.1 symbols/min [2025-10-01T20:23:35.775520] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:23:35.800802] [DEBUG] [LOCAL ] MYI: Loaded 19335 existing records from primary storage. [2025-10-01T20:23:35.801067] [INFO ] [MAIN ] MYI: Loaded 19335 existing records. [2025-10-01T20:23:36.003408] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:23:36.003678] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-01T20:23:36.003757] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-01T20:23:36.004256] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-01T20:23:36.004345] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-01T20:23:36.107476] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-01T20:23:36.414130] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:23:36.902405] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-01T20:23:37.338881] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T20:23:37.702398] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-01T20:23:38.176686] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T20:23:38.289741] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T20:23:38.502433] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-01T20:23:38.783935] [DEBUG] [REMOTE ] MYD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:23:38.784281] [WARN ] [REMOTE ] MYD: No data returned for month 2025-10 [2025-10-01T20:23:38.784396] [FATAL] [REMOTE ] MYD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:23:38.784757] [FATAL] [MAIN ] MYD: Failed to fetch primary data. [2025-10-01T20:23:38.784842] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:23:38.784937] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-01T20:23:38.785036] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-01T20:23:38.785096] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-10-01T20:23:38.785492] [DEBUG] [LOCAL ] MYD: Deleted derivative data file. [2025-10-01T20:23:38.785589] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MYD took 18.2s. Estimated remaining: 2h 10m 56s. Rate: 7.1 symbols/min [2025-10-01T20:23:38.995956] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:23:39.008116] [DEBUG] [LOCAL ] MYN: Loaded 10002 existing records from primary storage. [2025-10-01T20:23:39.008383] [INFO ] [MAIN ] MYN: Loaded 10002 existing records. [2025-10-01T20:23:39.196930] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:23:39.197134] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-01T20:23:39.197180] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-01T20:23:39.197452] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-01T20:23:39.197511] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-01T20:23:39.302817] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-01T20:23:39.618712] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:23:40.102416] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-01T20:23:40.578752] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T20:23:40.902386] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-01T20:23:40.953895] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T20:23:41.702450] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-01T20:23:42.385739] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T20:23:42.502433] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-01T20:23:42.626442] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T20:23:43.302382] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-01T20:23:43.905051] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T20:23:44.102392] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-01T20:23:44.173379] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T20:23:44.902419] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-01T20:23:45.378279] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T20:23:45.696595] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T20:23:45.702342] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-01T20:23:46.502375] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-01T20:23:46.854254] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T20:23:47.302425] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-01T20:23:47.412180] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T20:23:48.102381] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-01T20:23:48.482493] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T20:23:48.902364] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-01T20:23:49.210176] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T20:23:49.702358] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-01T20:23:49.849600] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T20:23:50.502594] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-01T20:23:50.893174] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T20:23:51.302429] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-01T20:23:51.419962] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T20:23:52.102400] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-01T20:23:52.152588] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T20:23:52.902415] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-01T20:23:53.247268] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T20:23:53.702387] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-01T20:23:53.741282] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T20:23:54.502409] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-01T20:23:54.833715] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T20:23:55.302403] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-01T20:23:55.743303] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T20:23:56.102359] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-01T20:23:56.347229] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:23:56.902358] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-01T20:23:56.944135] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T20:23:57.702373] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-01T20:23:57.952785] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T20:23:58.502377] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-01T20:23:58.618090] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T20:23:59.302385] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-01T20:23:59.626772] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T20:24:00.102375] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-01T20:24:00.193016] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T20:24:00.902389] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-01T20:24:00.971885] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:24:01.702388] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-01T20:24:01.776605] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:24:02.011563] [DEBUG] [REMOTE ] MYE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:02.011987] [WARN ] [REMOTE ] MYE: No data returned for month 2025-10 [2025-10-01T20:24:02.012281] [FATAL] [REMOTE ] MYE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:02.012386] [FATAL] [MAIN ] MYE: Failed to fetch primary data. [2025-10-01T20:24:02.012461] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:02.012594] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-01T20:24:02.012730] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-01T20:24:02.012788] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-01T20:24:02.013387] [DEBUG] [LOCAL ] MYE: Deleted derivative data file. [2025-10-01T20:24:02.013512] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MYE took 32.9s. Estimated remaining: 2h 10m 57s. Rate: 7.1 symbols/min [2025-10-01T20:24:02.214202] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:02.267414] [DEBUG] [LOCAL ] NABL: Loaded 39395 existing records from primary storage. [2025-10-01T20:24:02.267734] [INFO ] [MAIN ] NABL: Loaded 39395 existing records. [2025-10-01T20:24:02.469711] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:02.469917] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-01T20:24:02.469964] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-01T20:24:02.470429] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-01T20:24:02.470490] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-01T20:24:02.507492] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-01T20:24:02.863502] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:03.302387] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-01T20:24:03.717391] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T20:24:04.102380] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-01T20:24:04.902361] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-01T20:24:04.927633] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T20:24:05.095768] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T20:24:05.340894] [DEBUG] [REMOTE ] MYI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:05.341238] [WARN ] [REMOTE ] MYI: No data returned for month 2025-10 [2025-10-01T20:24:05.341331] [FATAL] [REMOTE ] MYI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:05.341416] [FATAL] [MAIN ] MYI: Failed to fetch primary data. [2025-10-01T20:24:05.341483] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:05.341557] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-01T20:24:05.341624] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-01T20:24:05.341716] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-10-01T20:24:05.342064] [DEBUG] [LOCAL ] MYI: Deleted derivative data file. [2025-10-01T20:24:05.342173] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYI took 29.8s. Estimated remaining: 2h 10m 45s. Rate: 7.1 symbols/min [2025-10-01T20:24:05.560595] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:05.588179] [DEBUG] [LOCAL ] NAC: Loaded 24873 existing records from primary storage. [2025-10-01T20:24:05.588462] [INFO ] [MAIN ] NAC: Loaded 24873 existing records. [2025-10-01T20:24:05.707478] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-01T20:24:05.834532] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:05.834827] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-01T20:24:05.834879] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-01T20:24:05.835343] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-01T20:24:05.835406] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-01T20:24:06.245122] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:06.502425] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-01T20:24:07.116517] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T20:24:07.302379] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-01T20:24:07.955264] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T20:24:08.102377] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-01T20:24:08.345581] [DEBUG] [REMOTE ] MX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:08.345974] [WARN ] [REMOTE ] MX: No data returned for month 2025-10 [2025-10-01T20:24:08.346075] [FATAL] [REMOTE ] MX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:08.346174] [FATAL] [MAIN ] MX: Failed to fetch primary data. [2025-10-01T20:24:08.346243] [WARN ] [MAIN ] MX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:08.346318] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-01T20:24:08.346391] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-01T20:24:08.346433] [INFO ] [LOCAL ] MX: Starting deletion of derivative data. [2025-10-01T20:24:08.346734] [DEBUG] [LOCAL ] MX: Deleted derivative data file. [2025-10-01T20:24:08.346857] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MX took 47.8s. Estimated remaining: 2h 10m 33s. Rate: 7.1 symbols/min [2025-10-01T20:24:08.549180] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:08.596695] [DEBUG] [LOCAL ] NAD: Loaded 33896 existing records from primary storage. [2025-10-01T20:24:08.596992] [INFO ] [MAIN ] NAD: Loaded 33896 existing records. [2025-10-01T20:24:08.745232] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T20:24:08.836277] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:08.836497] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-01T20:24:08.836545] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-01T20:24:08.837135] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-01T20:24:08.837196] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-01T20:24:08.907574] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-01T20:24:09.286831] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:09.702378] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-01T20:24:09.912722] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T20:24:10.502347] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-01T20:24:10.905516] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T20:24:11.302380] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-01T20:24:12.107051] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-01T20:24:12.109685] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T20:24:12.421249] [DEBUG] [REMOTE ] MYN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:12.421607] [WARN ] [REMOTE ] MYN: No data returned for month 2025-10 [2025-10-01T20:24:12.421737] [FATAL] [REMOTE ] MYN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:12.421849] [FATAL] [MAIN ] MYN: Failed to fetch primary data. [2025-10-01T20:24:12.421918] [WARN ] [MAIN ] MYN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:12.421981] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-01T20:24:12.422043] [DEBUG] [LOCAL ] MYN: No primary data file found to delete. [2025-10-01T20:24:12.422086] [INFO ] [LOCAL ] MYN: Starting deletion of derivative data. [2025-10-01T20:24:12.422368] [DEBUG] [LOCAL ] MYN: Deleted derivative data file. [2025-10-01T20:24:12.422470] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYN took 33.6s. Estimated remaining: 2h 10m 22s. Rate: 7.1 symbols/min [2025-10-01T20:24:12.580149] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T20:24:12.669338] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:12.682204] [DEBUG] [LOCAL ] NAN: Loaded 8948 existing records from primary storage. [2025-10-01T20:24:12.682436] [INFO ] [MAIN ] NAN: Loaded 8948 existing records. [2025-10-01T20:24:12.904388] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-01T20:24:12.909101] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:12.910489] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-01T20:24:12.910580] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-01T20:24:12.910784] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-01T20:24:12.910847] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-01T20:24:13.302382] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:13.702404] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-01T20:24:14.466244] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T20:24:14.502352] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-01T20:24:15.262485] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T20:24:15.302338] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-01T20:24:15.629044] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T20:24:16.102420] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-01T20:24:16.862278] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T20:24:16.902334] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-01T20:24:17.491361] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T20:24:17.702385] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-01T20:24:18.079133] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T20:24:18.502429] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-01T20:24:18.997216] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T20:24:19.302388] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-01T20:24:19.771535] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T20:24:20.102424] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-01T20:24:20.717974] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T20:24:20.902397] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-01T20:24:21.169719] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T20:24:21.702400] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-01T20:24:22.248720] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T20:24:22.502398] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-01T20:24:23.201452] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T20:24:23.302452] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-01T20:24:23.627486] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T20:24:24.102414] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-01T20:24:24.407260] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T20:24:24.902393] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-01T20:24:25.702402] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-01T20:24:25.820255] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T20:24:26.389179] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T20:24:26.502428] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-01T20:24:26.537450] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T20:24:27.302435] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-01T20:24:27.678868] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T20:24:28.102403] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-01T20:24:28.155840] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T20:24:28.337430] [DEBUG] [REMOTE ] NABL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:28.337873] [WARN ] [REMOTE ] NABL: No data returned for month 2025-10 [2025-10-01T20:24:28.337949] [FATAL] [REMOTE ] NABL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:28.338034] [FATAL] [MAIN ] NABL: Failed to fetch primary data. [2025-10-01T20:24:28.338100] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:28.338176] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-01T20:24:28.338243] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-01T20:24:28.338283] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-01T20:24:28.338544] [DEBUG] [LOCAL ] NABL: Deleted derivative data file. [2025-10-01T20:24:28.338678] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NABL took 26.3s. Estimated remaining: 2h 10m 18s. Rate: 7.1 symbols/min [2025-10-01T20:24:28.524925] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:28.576147] [DEBUG] [LOCAL ] NAT: Loaded 49129 existing records from primary storage. [2025-10-01T20:24:28.576488] [INFO ] [MAIN ] NAT: Loaded 49129 existing records. [2025-10-01T20:24:28.769566] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:28.769825] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-01T20:24:28.769876] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-01T20:24:28.770250] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-01T20:24:28.770382] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-01T20:24:28.907459] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-01T20:24:29.157216] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:29.702395] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-01T20:24:30.227378] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T20:24:30.502380] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-01T20:24:30.898688] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T20:24:31.302380] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-01T20:24:32.102367] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-01T20:24:32.323356] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T20:24:32.501876] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T20:24:32.902355] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-01T20:24:32.969755] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T20:24:33.702389] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-01T20:24:34.115599] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T20:24:34.502441] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-01T20:24:35.302384] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-01T20:24:35.668360] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-01T20:24:35.730532] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T20:24:36.102381] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-01T20:24:36.724367] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T20:24:36.902395] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-01T20:24:36.958009] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T20:24:37.702404] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-01T20:24:38.340829] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T20:24:38.502401] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-01T20:24:38.812063] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T20:24:39.076491] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-01T20:24:39.302420] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-01T20:24:39.569195] [DEBUG] [REMOTE ] NAC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:39.569500] [WARN ] [REMOTE ] NAC: No data returned for month 2025-10 [2025-10-01T20:24:39.569592] [FATAL] [REMOTE ] NAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:39.569722] [FATAL] [MAIN ] NAC: Failed to fetch primary data. [2025-10-01T20:24:39.569793] [WARN ] [MAIN ] NAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:39.569871] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-01T20:24:39.569938] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-01T20:24:39.569976] [INFO ] [LOCAL ] NAC: Starting deletion of derivative data. [2025-10-01T20:24:39.570232] [DEBUG] [LOCAL ] NAC: Deleted derivative data file. [2025-10-01T20:24:39.570333] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAC took 34.2s. Estimated remaining: 2h 10m 11s. Rate: 7.1 symbols/min [2025-10-01T20:24:39.762490] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:39.800222] [DEBUG] [LOCAL ] NATL: Loaded 32612 existing records from primary storage. [2025-10-01T20:24:39.800504] [INFO ] [MAIN ] NATL: Loaded 32612 existing records. [2025-10-01T20:24:39.998266] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:39.998549] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-01T20:24:39.998612] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-01T20:24:39.998938] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-01T20:24:39.998999] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-01T20:24:40.107559] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-01T20:24:40.426301] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:40.902378] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-01T20:24:41.262692] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T20:24:41.702393] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-01T20:24:41.721236] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T20:24:42.502376] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-01T20:24:43.302373] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-01T20:24:43.353796] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T20:24:43.737874] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T20:24:44.102379] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-01T20:24:44.885955] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T20:24:44.902348] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-01T20:24:45.702390] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-01T20:24:45.866549] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T20:24:46.047288] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T20:24:46.502394] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-01T20:24:46.519380] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:24:47.302387] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-01T20:24:47.861460] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T20:24:48.102359] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-01T20:24:48.352919] [DEBUG] [REMOTE ] NAN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:48.353250] [WARN ] [REMOTE ] NAN: No data returned for month 2025-10 [2025-10-01T20:24:48.353340] [FATAL] [REMOTE ] NAN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:48.353438] [FATAL] [MAIN ] NAN: Failed to fetch primary data. [2025-10-01T20:24:48.353511] [WARN ] [MAIN ] NAN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:48.353586] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-01T20:24:48.353677] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-01T20:24:48.353736] [INFO ] [LOCAL ] NAN: Starting deletion of derivative data. [2025-10-01T20:24:48.354147] [DEBUG] [LOCAL ] NAN: Deleted derivative data file. [2025-10-01T20:24:48.354258] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAN took 35.9s. Estimated remaining: 2h 10m 3s. Rate: 7.1 symbols/min [2025-10-01T20:24:48.549457] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:48.563999] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T20:24:48.573266] [DEBUG] [LOCAL ] NAZ: Loaded 2627 existing records from primary storage. [2025-10-01T20:24:48.573477] [INFO ] [MAIN ] NAZ: Loaded 2627 existing records. [2025-10-01T20:24:48.787299] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:48.787533] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-01T20:24:48.787582] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-01T20:24:48.787871] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-01T20:24:48.787936] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-01T20:24:48.907504] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-01T20:24:49.199110] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:49.290704] [DEBUG] [REMOTE ] NAD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:24:49.291068] [WARN ] [REMOTE ] NAD: No data returned for month 2025-10 [2025-10-01T20:24:49.291164] [FATAL] [REMOTE ] NAD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:24:49.291270] [FATAL] [MAIN ] NAD: Failed to fetch primary data. [2025-10-01T20:24:49.291341] [WARN ] [MAIN ] NAD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:24:49.291417] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-01T20:24:49.291484] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-01T20:24:49.291522] [INFO ] [LOCAL ] NAD: Starting deletion of derivative data. [2025-10-01T20:24:49.291782] [DEBUG] [LOCAL ] NAD: Deleted derivative data file. [2025-10-01T20:24:49.291901] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAD took 40.9s. Estimated remaining: 2h 9m 50s. Rate: 7.1 symbols/min [2025-10-01T20:24:49.482163] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:24:49.494755] [DEBUG] [LOCAL ] NBB: Loaded 9014 existing records from primary storage. [2025-10-01T20:24:49.494979] [INFO ] [MAIN ] NBB: Loaded 9014 existing records. [2025-10-01T20:24:49.688248] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:24:49.688454] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-01T20:24:49.688500] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-01T20:24:49.688837] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-01T20:24:49.688949] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-01T20:24:49.711436] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-01T20:24:50.085777] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:24:50.502461] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-01T20:24:51.127839] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T20:24:51.302363] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-01T20:24:51.660915] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T20:24:52.017180] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-01T20:24:52.102368] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-01T20:24:52.512244] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-01T20:24:52.902383] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-01T20:24:53.702435] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-01T20:24:54.376224] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T20:24:54.502416] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-01T20:24:54.535698] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T20:24:55.163573] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T20:24:55.302438] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-01T20:24:56.102358] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-01T20:24:56.252167] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T20:24:56.902387] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-01T20:24:57.482513] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T20:24:57.618928] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T20:24:57.702626] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-01T20:24:58.195796] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-01T20:24:58.502386] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-01T20:24:59.302380] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-01T20:25:00.093828] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T20:25:00.102333] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-01T20:25:00.248692] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T20:25:00.902374] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-01T20:25:01.071005] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T20:25:01.702398] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-01T20:25:02.167561] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T20:25:02.214572] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T20:25:02.502427] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-01T20:25:03.302390] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-01T20:25:04.102386] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-01T20:25:04.396305] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T20:25:04.787326] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T20:25:04.902368] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-01T20:25:05.378948] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T20:25:05.567314] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T20:25:05.702375] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-01T20:25:06.502390] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-01T20:25:07.082999] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T20:25:07.145590] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T20:25:07.302379] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-01T20:25:08.102394] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-01T20:25:08.902392] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-01T20:25:09.016987] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-01T20:25:09.274158] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T20:25:09.702403] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-01T20:25:10.450599] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T20:25:10.476738] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T20:25:10.502371] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-01T20:25:11.302402] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-01T20:25:11.571121] [DEBUG] [REMOTE ] NAZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:25:11.571467] [WARN ] [REMOTE ] NAZ: No data returned for month 2025-10 [2025-10-01T20:25:11.571571] [FATAL] [REMOTE ] NAZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:25:11.571686] [FATAL] [MAIN ] NAZ: Failed to fetch primary data. [2025-10-01T20:25:11.571770] [WARN ] [MAIN ] NAZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:25:11.571855] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-01T20:25:11.571935] [DEBUG] [LOCAL ] NAZ: No primary data file found to delete. [2025-10-01T20:25:11.571979] [INFO ] [LOCAL ] NAZ: Starting deletion of derivative data. [2025-10-01T20:25:11.572403] [DEBUG] [LOCAL ] NAZ: Deleted derivative data file. [2025-10-01T20:25:11.572496] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAZ took 23.2s. Estimated remaining: 2h 9m 50s. Rate: 7.1 symbols/min [2025-10-01T20:25:11.769506] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:25:11.795292] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T20:25:11.829004] [DEBUG] [LOCAL ] NBHC: Loaded 23162 existing records from primary storage. [2025-10-01T20:25:11.829381] [INFO ] [MAIN ] NBHC: Loaded 23162 existing records. [2025-10-01T20:25:12.039925] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:25:12.040150] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-01T20:25:12.040202] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-01T20:25:12.040686] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-01T20:25:12.040750] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-01T20:25:12.107578] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-01T20:25:12.487237] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:25:12.902413] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-01T20:25:12.995135] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T20:25:13.087207] [DEBUG] [REMOTE ] NAT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:25:13.087562] [WARN ] [REMOTE ] NAT: No data returned for month 2025-10 [2025-10-01T20:25:13.087693] [FATAL] [REMOTE ] NAT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:25:13.087831] [FATAL] [MAIN ] NAT: Failed to fetch primary data. [2025-10-01T20:25:13.087906] [WARN ] [MAIN ] NAT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:25:13.087980] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-01T20:25:13.088106] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-01T20:25:13.088176] [INFO ] [LOCAL ] NAT: Starting deletion of derivative data. [2025-10-01T20:25:13.088433] [DEBUG] [LOCAL ] NAT: Deleted derivative data file. [2025-10-01T20:25:13.088520] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAT took 44.7s. Estimated remaining: 2h 9m 37s. Rate: 7.1 symbols/min [2025-10-01T20:25:13.305748] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:25:13.358962] [DEBUG] [LOCAL ] NBR: Loaded 34709 existing records from primary storage. [2025-10-01T20:25:13.359289] [INFO ] [MAIN ] NBR: Loaded 34709 existing records. [2025-10-01T20:25:13.579766] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:25:13.579979] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-01T20:25:13.580029] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-01T20:25:13.580448] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-01T20:25:13.580509] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-01T20:25:13.707605] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-01T20:25:14.021676] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:25:14.502385] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-01T20:25:14.561231] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-01T20:25:15.302392] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-01T20:25:15.869514] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T20:25:16.102397] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-01T20:25:16.383130] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T20:25:16.387760] [DEBUG] [REMOTE ] NATL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:25:16.388710] [WARN ] [REMOTE ] NATL: No data returned for month 2025-10 [2025-10-01T20:25:16.388804] [FATAL] [REMOTE ] NATL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:25:16.388930] [FATAL] [MAIN ] NATL: Failed to fetch primary data. [2025-10-01T20:25:16.389004] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:25:16.389078] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-01T20:25:16.389150] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-01T20:25:16.389191] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-01T20:25:16.389450] [DEBUG] [LOCAL ] NATL: Deleted derivative data file. [2025-10-01T20:25:16.389541] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NATL took 36.8s. Estimated remaining: 2h 9m 25s. Rate: 7.1 symbols/min [2025-10-01T20:25:16.581331] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:25:16.606488] [DEBUG] [LOCAL ] NBXG: Loaded 22277 existing records from primary storage. [2025-10-01T20:25:16.606803] [INFO ] [MAIN ] NBXG: Loaded 22277 existing records. [2025-10-01T20:25:16.807803] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:25:16.808133] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-01T20:25:16.808199] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-01T20:25:16.808630] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-01T20:25:16.808726] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-01T20:25:16.907695] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-01T20:25:17.210063] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:25:17.702356] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-01T20:25:17.740685] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T20:25:18.502405] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-01T20:25:18.931142] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T20:25:19.302352] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-01T20:25:19.526088] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T20:25:19.907291] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T20:25:20.102417] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-01T20:25:20.902382] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-01T20:25:21.550593] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T20:25:21.688150] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T20:25:21.702333] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-01T20:25:21.968036] [DEBUG] [REMOTE ] NBB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:25:21.968385] [WARN ] [REMOTE ] NBB: No data returned for month 2025-10 [2025-10-01T20:25:21.968482] [FATAL] [REMOTE ] NBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:25:21.968571] [FATAL] [MAIN ] NBB: Failed to fetch primary data. [2025-10-01T20:25:21.968636] [WARN ] [MAIN ] NBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:25:21.968732] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-01T20:25:21.968814] [DEBUG] [LOCAL ] NBB: No primary data file found to delete. [2025-10-01T20:25:21.968871] [INFO ] [LOCAL ] NBB: Starting deletion of derivative data. [2025-10-01T20:25:21.969165] [DEBUG] [LOCAL ] NBB: Deleted derivative data file. [2025-10-01T20:25:21.969254] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBB took 32.7s. Estimated remaining: 2h 9m 15s. Rate: 7.1 symbols/min [2025-10-01T20:25:22.168520] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:25:22.173705] [DEBUG] [LOCAL ] NC: Loaded 1925 existing records from primary storage. [2025-10-01T20:25:22.173908] [INFO ] [MAIN ] NC: Loaded 1925 existing records. [2025-10-01T20:25:22.383471] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:25:22.384015] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-01T20:25:22.384075] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-01T20:25:22.384291] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-01T20:25:22.384349] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-01T20:25:22.507480] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-01T20:25:22.793555] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:25:23.302436] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-01T20:25:23.744029] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T20:25:23.849063] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-01T20:25:24.102428] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-01T20:25:24.902403] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-01T20:25:25.454750] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T20:25:25.702377] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-01T20:25:25.974824] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T20:25:26.502362] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-01T20:25:26.742691] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:25:27.302437] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-01T20:25:27.712218] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T20:25:28.102371] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-01T20:25:28.135181] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T20:25:28.651793] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T20:25:28.902385] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-01T20:25:29.410281] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-01T20:25:29.702431] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-01T20:25:30.502382] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-01T20:25:30.997737] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T20:25:31.302418] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-01T20:25:32.095061] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T20:25:32.102340] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-01T20:25:32.164156] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T20:25:32.902373] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-01T20:25:32.976539] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T20:25:33.702393] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-01T20:25:33.790420] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T20:25:34.502422] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-01T20:25:35.088726] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T20:25:35.274135] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T20:25:35.302356] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-01T20:25:36.102391] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-01T20:25:36.726599] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T20:25:36.902390] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-01T20:25:36.967729] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T20:25:37.193862] [DEBUG] [REMOTE ] NBHC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:25:37.194211] [WARN ] [REMOTE ] NBHC: No data returned for month 2025-10 [2025-10-01T20:25:37.194301] [FATAL] [REMOTE ] NBHC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:25:37.194384] [FATAL] [MAIN ] NBHC: Failed to fetch primary data. [2025-10-01T20:25:37.194451] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:25:37.194523] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-01T20:25:37.194672] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-01T20:25:37.194756] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-01T20:25:37.195150] [DEBUG] [LOCAL ] NBHC: Deleted derivative data file. [2025-10-01T20:25:37.195251] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBHC took 25.6s. Estimated remaining: 2h 9m 11s. Rate: 7.1 symbols/min [2025-10-01T20:25:37.391794] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:25:37.403224] [DEBUG] [LOCAL ] NCA: Loaded 10231 existing records from primary storage. [2025-10-01T20:25:37.403435] [INFO ] [MAIN ] NCA: Loaded 10231 existing records. [2025-10-01T20:25:37.608098] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:25:37.608305] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-01T20:25:37.608356] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-01T20:25:37.608577] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-01T20:25:37.608716] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-01T20:25:37.707615] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-01T20:25:38.020827] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:25:38.502400] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-01T20:25:38.912198] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T20:25:39.302384] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-01T20:25:39.382776] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T20:25:40.102421] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-01T20:25:40.714408] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T20:25:40.793208] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T20:25:40.902414] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-01T20:25:41.419587] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-01T20:25:41.702389] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-01T20:25:42.502423] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-01T20:25:43.255313] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T20:25:43.304937] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-01T20:25:43.309950] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T20:25:43.712140] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-01T20:25:44.102396] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-01T20:25:44.902390] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-01T20:25:45.280768] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-01T20:25:45.508973] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T20:25:45.702413] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-01T20:25:45.880573] [DEBUG] [REMOTE ] NBR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:25:45.881035] [WARN ] [REMOTE ] NBR: No data returned for month 2025-10 [2025-10-01T20:25:45.881133] [FATAL] [REMOTE ] NBR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:25:45.881222] [FATAL] [MAIN ] NBR: Failed to fetch primary data. [2025-10-01T20:25:45.881318] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:25:45.881393] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-01T20:25:45.881459] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-01T20:25:45.881496] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-01T20:25:45.881760] [DEBUG] [LOCAL ] NBR: Deleted derivative data file. [2025-10-01T20:25:45.881850] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 32.8s. Estimated remaining: 2h 9m 3s. Rate: 7.1 symbols/min [2025-10-01T20:25:46.064278] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:25:46.086072] [DEBUG] [LOCAL ] NCDL: Loaded 21500 existing records from primary storage. [2025-10-01T20:25:46.086334] [INFO ] [MAIN ] NCDL: Loaded 21500 existing records. [2025-10-01T20:25:46.277689] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:25:46.277904] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-01T20:25:46.277954] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-01T20:25:46.278155] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-01T20:25:46.278213] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-01T20:25:46.507609] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-01T20:25:46.738266] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:25:47.016260] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-01T20:25:47.302459] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-01T20:25:48.102424] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-01T20:25:48.742331] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T20:25:48.902394] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-01T20:25:49.176914] [DEBUG] [REMOTE ] NC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:25:49.177230] [WARN ] [REMOTE ] NC: No data returned for month 2025-10 [2025-10-01T20:25:49.177321] [FATAL] [REMOTE ] NC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:25:49.177436] [FATAL] [MAIN ] NC: Failed to fetch primary data. [2025-10-01T20:25:49.177518] [WARN ] [MAIN ] NC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:25:49.177603] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-01T20:25:49.177723] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-01T20:25:49.177825] [INFO ] [LOCAL ] NC: Starting deletion of derivative data. [2025-10-01T20:25:49.178273] [DEBUG] [LOCAL ] NC: Deleted derivative data file. [2025-10-01T20:25:49.178369] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 27.2s. Estimated remaining: 2h 8m 51s. Rate: 7.1 symbols/min [2025-10-01T20:25:49.409447] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:25:49.411495] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T20:25:49.481169] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-01T20:25:49.481512] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-10-01T20:25:49.680512] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:25:49.680864] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-01T20:25:49.680921] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-01T20:25:49.681719] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-10-01T20:25:49.681783] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-01T20:25:49.707513] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-01T20:25:50.113303] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:25:50.502410] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-01T20:25:50.981375] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T20:25:51.302382] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-01T20:25:51.411009] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T20:25:52.102401] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-01T20:25:52.420369] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T20:25:52.721810] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T20:25:52.902396] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-01T20:25:53.702414] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-01T20:25:54.077746] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T20:25:54.502388] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-01T20:25:54.694286] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T20:25:55.302410] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-01T20:25:55.663959] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T20:25:56.102416] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-01T20:25:56.216723] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T20:25:56.902400] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-01T20:25:57.257087] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T20:25:57.702385] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-01T20:25:57.891336] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T20:25:58.502394] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-01T20:25:59.208910] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T20:25:59.302387] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-01T20:25:59.389865] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T20:26:00.102356] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-01T20:26:00.338411] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T20:26:00.902377] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-01T20:26:01.339042] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T20:26:01.702394] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-01T20:26:01.874040] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T20:26:01.964277] [DEBUG] [REMOTE ] NBXG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:26:01.964698] [WARN ] [REMOTE ] NBXG: No data returned for month 2025-10 [2025-10-01T20:26:01.964866] [FATAL] [REMOTE ] NBXG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:26:01.965067] [FATAL] [MAIN ] NBXG: Failed to fetch primary data. [2025-10-01T20:26:01.965166] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:26:01.965269] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-01T20:26:01.965396] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-01T20:26:01.965467] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-01T20:26:01.965789] [DEBUG] [LOCAL ] NBXG: Deleted derivative data file. [2025-10-01T20:26:01.965937] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 45.6s. Estimated remaining: 2h 8m 45s. Rate: 7.1 symbols/min [2025-10-01T20:26:02.190684] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:26:02.207856] [DEBUG] [LOCAL ] NCV: Loaded 13535 existing records from primary storage. [2025-10-01T20:26:02.208168] [INFO ] [MAIN ] NCV: Loaded 13535 existing records. [2025-10-01T20:26:02.407456] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:26:02.407684] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-01T20:26:02.407742] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-01T20:26:02.407995] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-01T20:26:02.408063] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-01T20:26:02.507483] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-01T20:26:02.819427] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:26:03.302385] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-01T20:26:03.399176] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T20:26:04.102547] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-01T20:26:04.357818] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T20:26:04.902378] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-01T20:26:05.080168] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T20:26:05.495991] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T20:26:05.702413] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-01T20:26:06.502407] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-01T20:26:06.940872] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T20:26:07.302361] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-01T20:26:07.629497] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T20:26:08.102371] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-01T20:26:08.483266] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T20:26:08.902395] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-01T20:26:09.112954] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T20:26:09.702377] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-01T20:26:10.144005] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T20:26:10.502409] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-01T20:26:10.895188] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T20:26:11.302371] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-01T20:26:11.438345] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T20:26:12.102380] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-01T20:26:12.160575] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T20:26:12.902355] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-01T20:26:12.903505] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T20:26:13.702372] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-01T20:26:13.867816] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T20:26:14.502409] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-01T20:26:14.609926] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T20:26:15.302411] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-01T20:26:15.673855] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T20:26:16.102374] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-01T20:26:16.211686] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T20:26:16.902355] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-01T20:26:17.143514] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T20:26:17.673973] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T20:26:17.702355] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-01T20:26:18.355993] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T20:26:18.502398] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-01T20:26:19.302398] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-01T20:26:19.644917] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T20:26:20.102367] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-01T20:26:20.260347] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T20:26:20.286683] [DEBUG] [REMOTE ] NCDL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:26:20.286998] [WARN ] [REMOTE ] NCDL: No data returned for month 2025-10 [2025-10-01T20:26:20.287091] [FATAL] [REMOTE ] NCDL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:26:20.287161] [FATAL] [MAIN ] NCDL: Failed to fetch primary data. [2025-10-01T20:26:20.287224] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:26:20.287296] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-01T20:26:20.287390] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-01T20:26:20.287448] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-01T20:26:20.287720] [DEBUG] [LOCAL ] NCDL: Deleted derivative data file. [2025-10-01T20:26:20.288019] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCDL took 34.4s. Estimated remaining: 2h 8m 43s. Rate: 7.1 symbols/min [2025-10-01T20:26:20.492840] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:26:20.510180] [DEBUG] [LOCAL ] NCZ: Loaded 11854 existing records from primary storage. [2025-10-01T20:26:20.510499] [INFO ] [MAIN ] NCZ: Loaded 11854 existing records. [2025-10-01T20:26:20.726013] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:26:20.726253] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-01T20:26:20.726302] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-01T20:26:20.726703] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-01T20:26:20.726796] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-01T20:26:20.904791] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-01T20:26:21.140286] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:26:21.697967] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T20:26:21.702326] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-01T20:26:22.502370] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-01T20:26:22.582748] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T20:26:23.150769] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T20:26:23.302454] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-01T20:26:23.533244] [DEBUG] [REMOTE ] NCA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:26:23.533557] [WARN ] [REMOTE ] NCA: No data returned for month 2025-10 [2025-10-01T20:26:23.533666] [FATAL] [REMOTE ] NCA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:26:23.533792] [FATAL] [MAIN ] NCA: Failed to fetch primary data. [2025-10-01T20:26:23.533875] [WARN ] [MAIN ] NCA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:26:23.533964] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-01T20:26:23.534047] [DEBUG] [LOCAL ] NCA: No primary data file found to delete. [2025-10-01T20:26:23.534099] [INFO ] [LOCAL ] NCA: Starting deletion of derivative data. [2025-10-01T20:26:23.534410] [DEBUG] [LOCAL ] NCA: Deleted derivative data file. [2025-10-01T20:26:23.534522] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCA took 46.3s. Estimated remaining: 2h 8m 31s. Rate: 7.1 symbols/min [2025-10-01T20:26:23.718417] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:26:23.740373] [DEBUG] [LOCAL ] NDMO: Loaded 16909 existing records from primary storage. [2025-10-01T20:26:23.740739] [INFO ] [MAIN ] NDMO: Loaded 16909 existing records. [2025-10-01T20:26:23.942495] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:26:23.942744] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-01T20:26:23.942800] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-01T20:26:23.943171] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-01T20:26:23.943232] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-01T20:26:24.111586] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-01T20:26:24.355199] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:26:24.396422] [DEBUG] [REMOTE ] NCLH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:26:24.396801] [WARN ] [REMOTE ] NCLH: No data returned for month 2025-10 [2025-10-01T20:26:24.396894] [FATAL] [REMOTE ] NCLH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:26:24.396979] [FATAL] [MAIN ] NCLH: Failed to fetch primary data. [2025-10-01T20:26:24.397042] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:26:24.397121] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-01T20:26:24.397187] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-01T20:26:24.397277] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-01T20:26:24.397592] [DEBUG] [LOCAL ] NCLH: Deleted derivative data file. [2025-10-01T20:26:24.397720] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCLH took 35.2s. Estimated remaining: 2h 8m 18s. Rate: 7.1 symbols/min [2025-10-01T20:26:24.594932] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:26:24.651474] [DEBUG] [LOCAL ] NE: Loaded 52366 existing records from primary storage. [2025-10-01T20:26:24.651870] [INFO ] [MAIN ] NE: Loaded 52366 existing records. [2025-10-01T20:26:24.848257] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:26:24.848492] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-01T20:26:24.848540] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-01T20:26:24.849357] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-01T20:26:24.849419] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-01T20:26:24.907510] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-01T20:26:25.290136] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:26:25.702352] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-01T20:26:25.946568] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T20:26:26.502389] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-01T20:26:26.717683] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T20:26:27.302346] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-01T20:26:27.450137] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T20:26:28.102371] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-01T20:26:28.266029] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T20:26:28.902464] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-01T20:26:29.253691] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T20:26:29.702433] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-01T20:26:30.502387] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-01T20:26:30.590679] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:26:30.764248] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T20:26:31.246630] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T20:26:31.302403] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-01T20:26:32.102413] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-01T20:26:32.610475] [DEBUG] [REMOTE ] NCV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:26:32.610839] [WARN ] [REMOTE ] NCV: No data returned for month 2025-10 [2025-10-01T20:26:32.610941] [FATAL] [REMOTE ] NCV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:26:32.611047] [FATAL] [MAIN ] NCV: Failed to fetch primary data. [2025-10-01T20:26:32.611116] [WARN ] [MAIN ] NCV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:26:32.611188] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-01T20:26:32.611258] [DEBUG] [LOCAL ] NCV: No primary data file found to delete. [2025-10-01T20:26:32.611299] [INFO ] [LOCAL ] NCV: Starting deletion of derivative data. [2025-10-01T20:26:32.611586] [DEBUG] [LOCAL ] NCV: Deleted derivative data file. [2025-10-01T20:26:32.611705] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCV took 30.6s. Estimated remaining: 2h 8m 9s. Rate: 7.1 symbols/min [2025-10-01T20:26:32.759220] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T20:26:32.829582] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:26:32.869233] [DEBUG] [LOCAL ] NEA: Loaded 35427 existing records from primary storage. [2025-10-01T20:26:32.869545] [INFO ] [MAIN ] NEA: Loaded 35427 existing records. [2025-10-01T20:26:32.907561] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-01T20:26:33.072835] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:26:33.073049] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-01T20:26:33.073098] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-01T20:26:33.073505] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-01T20:26:33.073564] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-01T20:26:33.461280] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:26:33.702362] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-01T20:26:34.502399] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-01T20:26:34.802862] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T20:26:34.809473] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T20:26:35.302397] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-01T20:26:36.052340] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T20:26:36.102359] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-01T20:26:36.844569] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T20:26:36.902391] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-01T20:26:37.681057] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T20:26:37.702350] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-01T20:26:37.812872] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T20:26:38.502416] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-01T20:26:39.021948] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T20:26:39.302468] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-01T20:26:39.483290] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T20:26:40.102384] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-01T20:26:40.902359] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-01T20:26:40.995314] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T20:26:41.557442] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-01T20:26:41.577076] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-01T20:26:41.702384] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-01T20:26:42.502401] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-01T20:26:43.181412] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T20:26:43.302383] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-01T20:26:44.102388] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-01T20:26:44.258337] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T20:26:44.281221] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T20:26:44.902381] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-01T20:26:45.512010] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T20:26:45.702460] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-01T20:26:45.792543] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T20:26:46.502374] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-01T20:26:46.666153] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T20:26:47.302396] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-01T20:26:48.102381] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-01T20:26:48.188426] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T20:26:48.745747] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T20:26:48.902355] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-01T20:26:48.957938] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T20:26:49.702403] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-01T20:26:50.110364] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T20:26:50.502380] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-01T20:26:51.302385] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-01T20:26:51.572304] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T20:26:51.613152] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T20:26:52.102384] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-01T20:26:52.378463] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T20:26:52.902360] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-01T20:26:53.138783] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T20:26:53.702382] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-01T20:26:54.371117] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T20:26:54.502387] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-01T20:26:54.710542] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T20:26:55.302405] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-01T20:26:55.542195] [DEBUG] [REMOTE ] NDMO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:26:55.542546] [WARN ] [REMOTE ] NDMO: No data returned for month 2025-10 [2025-10-01T20:26:55.542727] [FATAL] [REMOTE ] NDMO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:26:55.542851] [FATAL] [MAIN ] NDMO: Failed to fetch primary data. [2025-10-01T20:26:55.542927] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:26:55.543025] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-01T20:26:55.543141] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-01T20:26:55.543203] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-01T20:26:55.543661] [DEBUG] [LOCAL ] NDMO: Deleted derivative data file. [2025-10-01T20:26:55.543814] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NDMO took 32.0s. Estimated remaining: 2h 8m 10s. Rate: 7.1 symbols/min [2025-10-01T20:26:55.756622] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:26:55.825136] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-01T20:26:55.825483] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-10-01T20:26:56.031245] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:26:56.031448] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-01T20:26:56.031495] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-01T20:26:56.031895] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-10-01T20:26:56.031955] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-01T20:26:56.104466] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-01T20:26:56.442581] [DEBUG] [REMOTE ] NEA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:26:56.450192] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:26:56.450632] [WARN ] [REMOTE ] NEA: No data returned for month 2025-10 [2025-10-01T20:26:56.451586] [FATAL] [REMOTE ] NEA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:26:56.451819] [FATAL] [MAIN ] NEA: Failed to fetch primary data. [2025-10-01T20:26:56.452123] [WARN ] [MAIN ] NEA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:26:56.452231] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-01T20:26:56.452428] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-01T20:26:56.452712] [INFO ] [LOCAL ] NEA: Starting deletion of derivative data. [2025-10-01T20:26:56.453183] [DEBUG] [LOCAL ] NEA: Deleted derivative data file. [2025-10-01T20:26:56.453293] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NEA took 23.8s. Estimated remaining: 2h 7m 57s. Rate: 7.1 symbols/min [2025-10-01T20:26:56.592105] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-01T20:26:56.716051] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:26:56.779244] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-01T20:26:56.779614] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-10-01T20:26:56.903694] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-01T20:26:56.998294] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:26:56.998525] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-01T20:26:56.998581] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-01T20:26:56.999353] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-10-01T20:26:56.999425] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-01T20:26:57.416401] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:26:57.702377] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-01T20:26:58.435378] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T20:26:58.502374] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-01T20:26:58.771565] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T20:26:59.302370] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-01T20:26:59.373521] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T20:26:59.890823] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T20:27:00.102380] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-01T20:27:00.902372] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-01T20:27:01.126318] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T20:27:01.513757] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T20:27:01.702376] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-01T20:27:02.502350] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-01T20:27:02.666006] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T20:27:03.302353] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-01T20:27:04.102399] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-01T20:27:04.710880] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-01T20:27:04.902354] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-01T20:27:04.955075] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T20:27:05.162447] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T20:27:05.702402] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-01T20:27:06.001733] [DEBUG] [REMOTE ] NCZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:27:06.002056] [WARN ] [REMOTE ] NCZ: No data returned for month 2025-10 [2025-10-01T20:27:06.002147] [FATAL] [REMOTE ] NCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:27:06.002234] [FATAL] [MAIN ] NCZ: Failed to fetch primary data. [2025-10-01T20:27:06.002298] [WARN ] [MAIN ] NCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:27:06.002368] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-01T20:27:06.002464] [DEBUG] [LOCAL ] NCZ: No primary data file found to delete. [2025-10-01T20:27:06.002519] [INFO ] [LOCAL ] NCZ: Starting deletion of derivative data. [2025-10-01T20:27:06.003121] [DEBUG] [LOCAL ] NCZ: Deleted derivative data file. [2025-10-01T20:27:06.003211] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NCZ took 45.7s. Estimated remaining: 2h 7m 49s. Rate: 7.1 symbols/min [2025-10-01T20:27:06.207295] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:27:06.278088] [DEBUG] [LOCAL ] NET: Loaded 52998 existing records from primary storage. [2025-10-01T20:27:06.278527] [INFO ] [MAIN ] NET: Loaded 52998 existing records. [2025-10-01T20:27:06.501750] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:27:06.501964] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-01T20:27:06.502012] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-01T20:27:06.502385] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-01T20:27:06.503475] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-01T20:27:06.503557] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-01T20:27:06.728697] [DEBUG] [REMOTE ] NE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:27:06.795628] [WARN ] [REMOTE ] NE: No data returned for month 2025-10 [2025-10-01T20:27:06.806300] [FATAL] [REMOTE ] NE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:27:06.806532] [FATAL] [MAIN ] NE: Failed to fetch primary data. [2025-10-01T20:27:06.827687] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:27:06.828075] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-01T20:27:06.828172] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-01T20:27:06.833600] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-01T20:27:06.869270] [DEBUG] [LOCAL ] NE: Deleted derivative data file. [2025-10-01T20:27:06.906929] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NE took 42.5s. Estimated remaining: 2h 7m 36s. Rate: 7.1 symbols/min [2025-10-01T20:27:06.914164] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:27:07.115802] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:27:07.154078] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-01T20:27:07.169771] [DEBUG] [LOCAL ] NEU: Loaded 8252 existing records from primary storage. [2025-10-01T20:27:07.170058] [INFO ] [MAIN ] NEU: Loaded 8252 existing records. [2025-10-01T20:27:07.307576] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-01T20:27:07.383701] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:27:07.383910] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-01T20:27:07.383957] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-01T20:27:07.384157] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-01T20:27:07.384217] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-01T20:27:07.780099] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:27:08.102353] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-01T20:27:08.284215] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T20:27:08.902390] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-01T20:27:09.702396] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-01T20:27:10.241446] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-01T20:27:10.502374] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-01T20:27:10.795230] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T20:27:10.906008] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-01T20:27:11.302376] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-01T20:27:12.102367] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-01T20:27:12.175503] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T20:27:12.386517] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T20:27:12.902418] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-01T20:27:13.491033] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T20:27:13.702345] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-01T20:27:14.284551] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-01T20:27:14.495467] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T20:27:14.502343] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-01T20:27:15.302410] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-01T20:27:16.104232] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-01T20:27:16.110044] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T20:27:16.902350] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-01T20:27:16.910595] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T20:27:16.964368] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-01T20:27:17.702432] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-01T20:27:18.505565] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-01T20:27:18.512412] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T20:27:19.067522] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-01T20:27:19.302398] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-01T20:27:20.102409] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-01T20:27:20.786025] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-01T20:27:20.902403] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-01T20:27:21.180692] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T20:27:21.410985] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-01T20:27:21.650376] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T20:27:21.702381] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-01T20:27:22.474548] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T20:27:22.502341] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-01T20:27:23.302443] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-01T20:27:23.968609] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T20:27:24.102359] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-01T20:27:24.571175] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-01T20:27:24.762395] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T20:27:24.902427] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-01T20:27:25.702406] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-01T20:27:25.862123] [DEBUG] [REMOTE ] NEM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:27:25.862469] [WARN ] [REMOTE ] NEM: No data returned for month 2025-10 [2025-10-01T20:27:25.862563] [FATAL] [REMOTE ] NEM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:27:25.862691] [FATAL] [MAIN ] NEM: Failed to fetch primary data. [2025-10-01T20:27:25.862765] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:27:25.862847] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-01T20:27:25.862915] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-01T20:27:25.862954] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-01T20:27:25.863277] [DEBUG] [LOCAL ] NEM: Deleted derivative data file. [2025-10-01T20:27:25.863367] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEM took 29.4s. Estimated remaining: 2h 7m 34s. Rate: 7.1 symbols/min [2025-10-01T20:27:26.057865] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:27:26.062692] [DEBUG] [LOCAL ] NEUE: Loaded 2181 existing records from primary storage. [2025-10-01T20:27:26.062907] [INFO ] [MAIN ] NEUE: Loaded 2181 existing records. [2025-10-01T20:27:26.261484] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:27:26.261803] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-10-01T20:27:26.261861] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-10-01T20:27:26.262002] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-10-01T20:27:26.262061] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-10-01T20:27:26.507633] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-01T20:27:26.677526] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:27:27.239588] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-01T20:27:27.302355] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-01T20:27:27.719812] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T20:27:28.102380] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-01T20:27:28.902417] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-01T20:27:28.974610] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T20:27:29.250872] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T20:27:29.702400] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-01T20:27:30.502355] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-01T20:27:30.684152] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T20:27:31.302434] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-01T20:27:31.496416] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T20:27:31.585989] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T20:27:32.102624] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-01T20:27:32.902356] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-01T20:27:32.937593] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T20:27:33.671024] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-01T20:27:33.702420] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-01T20:27:33.969605] [DEBUG] [REMOTE ] NEU: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:27:33.969961] [WARN ] [REMOTE ] NEU: No data returned for month 2025-10 [2025-10-01T20:27:33.970066] [FATAL] [REMOTE ] NEU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:27:33.970196] [FATAL] [MAIN ] NEU: Failed to fetch primary data. [2025-10-01T20:27:33.970268] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:27:33.970339] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-01T20:27:33.970406] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-01T20:27:33.970444] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-01T20:27:33.970876] [DEBUG] [LOCAL ] NEU: Deleted derivative data file. [2025-10-01T20:27:33.970971] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEU took 27.1s. Estimated remaining: 2h 7m 25s. Rate: 7.1 symbols/min [2025-10-01T20:27:34.171118] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:27:34.178526] [DEBUG] [LOCAL ] NEXA: Loaded 4322 existing records from primary storage. [2025-10-01T20:27:34.178779] [INFO ] [MAIN ] NEXA: Loaded 4322 existing records. [2025-10-01T20:27:34.369789] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:27:34.370012] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-01T20:27:34.370060] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-01T20:27:34.370254] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-01T20:27:34.370312] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-01T20:27:34.507567] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-10-01T20:27:34.790014] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:27:35.126964] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-01T20:27:35.149689] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T20:27:35.302419] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-10-01T20:27:35.782105] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T20:27:36.102398] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-01T20:27:36.902381] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-01T20:27:37.702413] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-01T20:27:37.972497] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T20:27:38.367119] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T20:27:38.502393] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-01T20:27:39.103296] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T20:27:39.157290] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-01T20:27:39.302384] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-01T20:27:39.558323] [DEBUG] [REMOTE ] NET: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:27:39.558681] [WARN ] [REMOTE ] NET: No data returned for month 2025-10 [2025-10-01T20:27:39.558773] [FATAL] [REMOTE ] NET: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:27:39.558863] [FATAL] [MAIN ] NET: Failed to fetch primary data. [2025-10-01T20:27:39.558928] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:27:39.559003] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-01T20:27:39.559069] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-01T20:27:39.559108] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-01T20:27:39.559420] [DEBUG] [LOCAL ] NET: Deleted derivative data file. [2025-10-01T20:27:39.559520] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NET took 33.6s. Estimated remaining: 2h 7m 15s. Rate: 7.1 symbols/min [2025-10-01T20:27:39.748791] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:27:39.792734] [DEBUG] [LOCAL ] NFG: Loaded 38473 existing records from primary storage. [2025-10-01T20:27:39.793104] [INFO ] [MAIN ] NFG: Loaded 38473 existing records. [2025-10-01T20:27:39.985694] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:27:39.985937] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-01T20:27:39.985986] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-01T20:27:39.986518] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-01T20:27:39.986578] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-01T20:27:40.107487] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-01T20:27:40.373594] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:27:40.874838] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T20:27:40.902345] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-01T20:27:41.702390] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-01T20:27:42.353618] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T20:27:42.434549] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T20:27:42.502387] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-10-01T20:27:43.031891] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T20:27:43.302379] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-01T20:27:44.102383] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-01T20:27:44.741948] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-01T20:27:44.902358] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-10-01T20:27:44.989735] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T20:27:45.370190] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T20:27:45.702386] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-10-01T20:27:46.257039] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-01T20:27:46.502393] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-01T20:27:47.121040] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T20:27:47.302379] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-01T20:27:47.550945] [DEBUG] [REMOTE ] NEE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:27:47.551263] [WARN ] [REMOTE ] NEE: No data returned for month 2025-10 [2025-10-01T20:27:47.551365] [FATAL] [REMOTE ] NEE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:27:47.551502] [FATAL] [MAIN ] NEE: Failed to fetch primary data. [2025-10-01T20:27:47.551574] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:27:47.551675] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-01T20:27:47.551781] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-01T20:27:47.551836] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-01T20:27:47.552202] [DEBUG] [LOCAL ] NEE: Deleted derivative data file. [2025-10-01T20:27:47.552295] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEE took 52.0s. Estimated remaining: 2h 7m 6s. Rate: 7.1 symbols/min [2025-10-01T20:27:47.747279] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:27:47.772127] [DEBUG] [LOCAL ] NFJ: Loaded 20367 existing records from primary storage. [2025-10-01T20:27:47.772441] [INFO ] [MAIN ] NFJ: Loaded 20367 existing records. [2025-10-01T20:27:47.976181] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:27:47.976428] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-01T20:27:47.976481] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-01T20:27:47.976896] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-01T20:27:47.976963] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-01T20:27:48.107532] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-10-01T20:27:48.383020] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:27:48.660507] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T20:27:48.902406] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-01T20:27:49.702418] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-10-01T20:27:50.194601] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-01T20:27:50.497276] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T20:27:50.505290] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-01T20:27:51.302360] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-10-01T20:27:51.653454] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-01T20:27:51.721111] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T20:27:52.102434] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-01T20:27:52.594009] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-01T20:27:52.902389] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-10-01T20:27:53.451569] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T20:27:53.702378] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-10-01T20:27:54.215419] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-01T20:27:54.502385] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-10. [2025-10-01T20:27:54.889690] [DEBUG] [REMOTE ] NEUE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:27:54.890002] [WARN ] [REMOTE ] NEUE: No data returned for month 2025-10 [2025-10-01T20:27:54.890090] [FATAL] [REMOTE ] NEUE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:27:54.890204] [FATAL] [MAIN ] NEUE: Failed to fetch primary data. [2025-10-01T20:27:54.890273] [WARN ] [MAIN ] NEUE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:27:54.890346] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-10-01T20:27:54.890410] [DEBUG] [LOCAL ] NEUE: No primary data file found to delete. [2025-10-01T20:27:54.890450] [INFO ] [LOCAL ] NEUE: Starting deletion of derivative data. [2025-10-01T20:27:54.890867] [DEBUG] [LOCAL ] NEUE: Deleted derivative data file. [2025-10-01T20:27:54.890965] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NEUE took 29.0s. Estimated remaining: 2h 6m 57s. Rate: 7.1 symbols/min [2025-10-01T20:27:55.073501] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:27:55.121505] [DEBUG] [LOCAL ] NGG: Loaded 46203 existing records from primary storage. [2025-10-01T20:27:55.121842] [INFO ] [MAIN ] NGG: Loaded 46203 existing records. [2025-10-01T20:27:55.311602] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-01T20:27:55.344919] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:27:55.345101] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-01T20:27:55.345150] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-01T20:27:55.345790] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-01T20:27:55.345852] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-01T20:27:55.742890] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:27:56.102407] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-01T20:27:56.301186] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T20:27:56.902379] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-01T20:27:57.580623] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T20:27:57.707472] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-01T20:27:57.725004] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T20:27:58.423684] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T20:27:58.502399] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-01T20:27:59.302384] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-01T20:27:59.822596] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T20:28:00.102353] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-01T20:28:00.277968] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T20:28:00.902383] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-01T20:28:00.919073] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:28:01.702402] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-01T20:28:02.502395] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-01T20:28:02.608433] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T20:28:02.792102] [DEBUG] [REMOTE ] NEXA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:02.792447] [WARN ] [REMOTE ] NEXA: No data returned for month 2025-10 [2025-10-01T20:28:02.792559] [FATAL] [REMOTE ] NEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:02.792711] [FATAL] [MAIN ] NEXA: Failed to fetch primary data. [2025-10-01T20:28:02.792797] [WARN ] [MAIN ] NEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:02.792882] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-01T20:28:02.792959] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-01T20:28:02.793008] [INFO ] [LOCAL ] NEXA: Starting deletion of derivative data. [2025-10-01T20:28:02.793378] [DEBUG] [LOCAL ] NEXA: Deleted derivative data file. [2025-10-01T20:28:02.793486] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NEXA took 28.8s. Estimated remaining: 2h 6m 48s. Rate: 7.1 symbols/min [2025-10-01T20:28:02.991739] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:03.028369] [DEBUG] [LOCAL ] NGL: Loaded 30329 existing records from primary storage. [2025-10-01T20:28:03.028661] [INFO ] [MAIN ] NGL: Loaded 30329 existing records. [2025-10-01T20:28:03.232344] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:28:03.232619] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-01T20:28:03.232705] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-01T20:28:03.233147] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-01T20:28:03.233208] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-01T20:28:03.306499] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-01T20:28:03.631533] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:28:03.658952] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-01T20:28:04.102401] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-01T20:28:04.857850] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T20:28:04.902416] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-01T20:28:05.168166] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T20:28:05.702403] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-01T20:28:06.163104] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T20:28:06.440175] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T20:28:06.502377] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-01T20:28:07.302361] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-01T20:28:07.619360] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T20:28:08.102393] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-01T20:28:08.902357] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-01T20:28:08.931156] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T20:28:08.993798] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T20:28:09.702448] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-01T20:28:10.429518] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T20:28:10.502403] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-01T20:28:10.965761] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T20:28:11.302415] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-01T20:28:12.000758] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T20:28:12.102638] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-01T20:28:12.143975] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T20:28:12.902416] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-01T20:28:13.193692] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T20:28:13.702432] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-01T20:28:14.271356] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T20:28:14.502387] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-01T20:28:14.926777] [DEBUG] [REMOTE ] NFG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:14.927095] [WARN ] [REMOTE ] NFG: No data returned for month 2025-10 [2025-10-01T20:28:14.927202] [FATAL] [REMOTE ] NFG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:14.927332] [FATAL] [MAIN ] NFG: Failed to fetch primary data. [2025-10-01T20:28:14.927434] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:14.927524] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-01T20:28:14.927605] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-01T20:28:14.927701] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-01T20:28:14.928150] [DEBUG] [LOCAL ] NFG: Deleted derivative data file. [2025-10-01T20:28:14.928279] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NFG took 35.4s. Estimated remaining: 2h 6m 42s. Rate: 7.1 symbols/min [2025-10-01T20:28:15.090683] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T20:28:15.148244] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:15.161960] [DEBUG] [LOCAL ] NGS: Loaded 11524 existing records from primary storage. [2025-10-01T20:28:15.162223] [INFO ] [MAIN ] NGS: Loaded 11524 existing records. [2025-10-01T20:28:15.307536] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-01T20:28:15.367821] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:28:15.368102] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-01T20:28:15.368151] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-01T20:28:15.368516] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-01T20:28:15.368576] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-01T20:28:15.765140] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:28:16.102420] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-01T20:28:16.792574] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T20:28:16.902394] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-01T20:28:17.028819] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T20:28:17.702450] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-01T20:28:18.323431] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T20:28:18.502388] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-01T20:28:18.852505] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T20:28:19.302439] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-01T20:28:19.919923] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T20:28:20.076003] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T20:28:20.102358] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-01T20:28:20.902431] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-01T20:28:21.497960] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T20:28:21.702523] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-01T20:28:22.502387] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-01T20:28:22.696058] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T20:28:22.863028] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T20:28:23.302360] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-01T20:28:23.546977] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T20:28:24.102405] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-01T20:28:24.588489] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T20:28:24.902412] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-01T20:28:25.702383] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-01T20:28:25.764166] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T20:28:25.991420] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T20:28:26.502403] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-01T20:28:26.740569] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T20:28:27.302393] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-01T20:28:27.613258] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T20:28:28.102405] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-01T20:28:28.364026] [DEBUG] [REMOTE ] NFJ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:28.364352] [WARN ] [REMOTE ] NFJ: No data returned for month 2025-10 [2025-10-01T20:28:28.364449] [FATAL] [REMOTE ] NFJ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:28.364574] [FATAL] [MAIN ] NFJ: Failed to fetch primary data. [2025-10-01T20:28:28.364672] [WARN ] [MAIN ] NFJ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:28.364748] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-01T20:28:28.364862] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-01T20:28:28.364922] [INFO ] [LOCAL ] NFJ: Starting deletion of derivative data. [2025-10-01T20:28:28.365331] [DEBUG] [LOCAL ] NFJ: Deleted derivative data file. [2025-10-01T20:28:28.365424] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFJ took 40.8s. Estimated remaining: 2h 6m 36s. Rate: 7.1 symbols/min [2025-10-01T20:28:28.564561] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:28.587340] [DEBUG] [LOCAL ] NGVC: Loaded 22357 existing records from primary storage. [2025-10-01T20:28:28.587624] [INFO ] [MAIN ] NGVC: Loaded 22357 existing records. [2025-10-01T20:28:28.792131] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:28:28.792473] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-01T20:28:28.792538] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-01T20:28:28.792950] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-01T20:28:28.793012] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-01T20:28:28.903758] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-01T20:28:29.222739] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:28:29.252002] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T20:28:29.702390] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-01T20:28:29.973598] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T20:28:30.502424] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-01T20:28:31.302377] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-01T20:28:31.358913] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T20:28:31.615334] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T20:28:32.102473] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-01T20:28:32.796309] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T20:28:32.899285] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T20:28:32.902473] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-01T20:28:33.702460] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-01T20:28:34.502433] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-01T20:28:34.698238] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T20:28:34.740154] [DEBUG] [REMOTE ] NGL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:34.740635] [WARN ] [REMOTE ] NGL: No data returned for month 2025-10 [2025-10-01T20:28:34.740775] [FATAL] [REMOTE ] NGL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:34.740927] [FATAL] [MAIN ] NGL: Failed to fetch primary data. [2025-10-01T20:28:34.741013] [WARN ] [MAIN ] NGL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:34.741109] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-01T20:28:34.741239] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-01T20:28:34.741312] [INFO ] [LOCAL ] NGL: Starting deletion of derivative data. [2025-10-01T20:28:34.741858] [DEBUG] [LOCAL ] NGL: Deleted derivative data file. [2025-10-01T20:28:34.741997] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGL took 31.9s. Estimated remaining: 2h 6m 26s. Rate: 7.1 symbols/min [2025-10-01T20:28:34.934498] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:34.978601] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-01T20:28:35.010371] [DEBUG] [LOCAL ] NGVT: Loaded 24100 existing records from primary storage. [2025-10-01T20:28:35.010732] [INFO ] [MAIN ] NGVT: Loaded 24100 existing records. [2025-10-01T20:28:35.236862] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:28:35.237118] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-01T20:28:35.237168] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-01T20:28:35.237569] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-01T20:28:35.237632] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-01T20:28:35.307532] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-01T20:28:35.644755] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:28:36.102372] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-01T20:28:36.341782] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T20:28:36.902412] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-01T20:28:37.193292] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T20:28:37.702415] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-01T20:28:38.227793] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T20:28:38.502459] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-01T20:28:38.912857] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T20:28:39.302429] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-01T20:28:39.687341] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T20:28:40.102449] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-01T20:28:40.547131] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T20:28:40.902400] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-01T20:28:41.029873] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T20:28:41.702416] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-01T20:28:41.853181] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T20:28:42.502409] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-01T20:28:42.600474] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T20:28:43.302397] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-01T20:28:43.339979] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T20:28:44.102363] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-01T20:28:44.436494] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T20:28:44.902399] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-01T20:28:45.702364] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-01T20:28:46.013339] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-01T20:28:46.040836] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T20:28:46.502398] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-01T20:28:46.776813] [DEBUG] [REMOTE ] NGS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:46.777149] [WARN ] [REMOTE ] NGS: No data returned for month 2025-10 [2025-10-01T20:28:46.777258] [FATAL] [REMOTE ] NGS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:46.777395] [FATAL] [MAIN ] NGS: Failed to fetch primary data. [2025-10-01T20:28:46.777467] [WARN ] [MAIN ] NGS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:46.777551] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-01T20:28:46.777673] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-01T20:28:46.777733] [INFO ] [LOCAL ] NGS: Starting deletion of derivative data. [2025-10-01T20:28:46.778206] [DEBUG] [LOCAL ] NGS: Deleted derivative data file. [2025-10-01T20:28:46.778323] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGS took 31.8s. Estimated remaining: 2h 6m 20s. Rate: 7.1 symbols/min [2025-10-01T20:28:46.936255] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T20:28:47.302403] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-01T20:28:48.102400] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-01T20:28:48.389952] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T20:28:48.902411] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-01T20:28:49.143383] [DEBUG] [REMOTE ] NGG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:49.143725] [WARN ] [REMOTE ] NGG: No data returned for month 2025-10 [2025-10-01T20:28:49.143818] [FATAL] [REMOTE ] NGG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:49.143903] [FATAL] [MAIN ] NGG: Failed to fetch primary data. [2025-10-01T20:28:49.143964] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:49.144039] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-01T20:28:49.144103] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-01T20:28:49.144140] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-01T20:28:49.144458] [DEBUG] [LOCAL ] NGG: Deleted derivative data file. [2025-10-01T20:28:49.144561] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGG took 54.3s. Estimated remaining: 2h 6m 8s. Rate: 7.1 symbols/min [2025-10-01T20:28:49.248399] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T20:28:49.702559] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-01T20:28:50.502347] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-01T20:28:50.820827] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T20:28:51.302383] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-01T20:28:51.824282] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T20:28:52.102410] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-01T20:28:52.497497] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T20:28:52.902393] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-01T20:28:53.136124] [DEBUG] [REMOTE ] NGVC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:53.136508] [WARN ] [REMOTE ] NGVC: No data returned for month 2025-10 [2025-10-01T20:28:53.136633] [FATAL] [REMOTE ] NGVC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:53.136848] [FATAL] [MAIN ] NGVC: Failed to fetch primary data. [2025-10-01T20:28:53.136928] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:53.137004] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-01T20:28:53.137094] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-01T20:28:53.137149] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-01T20:28:53.137606] [DEBUG] [LOCAL ] NGVC: Deleted derivative data file. [2025-10-01T20:28:53.137798] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGVC took 24.8s. Estimated remaining: 2h 5m 57s. Rate: 7.1 symbols/min [2025-10-01T20:28:53.382840] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T20:28:53.702388] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-01T20:28:54.776031] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T20:28:54.781142] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-01T20:28:55.904039] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T20:28:55.909828] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-01T20:28:57.249024] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T20:28:57.255423] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-01T20:28:58.362203] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T20:28:58.367592] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-01T20:28:58.596822] [DEBUG] [REMOTE ] NGVT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:28:58.597129] [WARN ] [REMOTE ] NGVT: No data returned for month 2025-10 [2025-10-01T20:28:58.597217] [FATAL] [REMOTE ] NGVT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:28:58.597298] [FATAL] [MAIN ] NGVT: Failed to fetch primary data. [2025-10-01T20:28:58.597370] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:28:58.597443] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-01T20:28:58.597508] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-01T20:28:58.597545] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-01T20:28:58.598044] [DEBUG] [LOCAL ] NGVT: Deleted derivative data file. [2025-10-01T20:28:58.598200] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGVT took 23.9s. Estimated remaining: 2h 5m 47s. Rate: 7.1 symbols/min [2025-10-01T20:28:59.338952] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:59.373004] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:59.393218] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:59.414465] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:28:59.444926] [DEBUG] [LOCAL ] NHI: Loaded 21859 existing records from primary storage. [2025-10-01T20:28:59.449740] [DEBUG] [LOCAL ] NIC: Loaded 8968 existing records from primary storage. [2025-10-01T20:28:59.445355] [DEBUG] [LOCAL ] NIE: Loaded 11782 existing records from primary storage. [2025-10-01T20:28:59.450271] [INFO ] [MAIN ] NIC: Loaded 8968 existing records. [2025-10-01T20:28:59.450607] [INFO ] [MAIN ] NIE: Loaded 11782 existing records. [2025-10-01T20:28:59.484352] [INFO ] [MAIN ] NHI: Loaded 21859 existing records. [2025-10-01T20:29:00.003355] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:00.070195] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-01T20:29:00.067840] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:00.107178] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-01T20:29:00.112685] [DEBUG] [LOCAL ] NI: Loaded 53419 existing records from primary storage. [2025-10-01T20:29:00.111153] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-01T20:29:00.110910] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:00.113075] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-01T20:29:00.113318] [INFO ] [MAIN ] NI: Loaded 53419 existing records. [2025-10-01T20:29:00.113457] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-01T20:29:00.118970] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-01T20:29:00.119130] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-01T20:29:00.119050] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-01T20:29:00.147120] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-01T20:29:00.197375] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-01T20:29:00.244762] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-01T20:29:00.265776] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-01T20:29:00.749434] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:00.827556] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-01T20:29:00.912525] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-01T20:29:00.988179] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-10-01T20:29:01.138415] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-01T20:29:01.484574] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:01.594344] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-01T20:29:01.665346] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:01.677733] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:01.689469] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-01T20:29:01.689005] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-01T20:29:01.975823] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:01.976195] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-01T20:29:02.573827] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T20:29:02.576118] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-01T20:29:02.643038] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T20:29:02.646248] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-01T20:29:02.677293] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-01T20:29:02.682557] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-01T20:29:03.125030] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T20:29:03.302374] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-01T20:29:03.328741] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T20:29:03.518571] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T20:29:03.934075] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T20:29:04.102360] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-01T20:29:04.283283] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T20:29:04.902365] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-01T20:29:04.949181] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T20:29:05.530803] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T20:29:05.702413] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-01T20:29:06.502350] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-01T20:29:06.811898] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T20:29:07.302448] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-01T20:29:07.729233] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T20:29:08.102396] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-01T20:29:08.307364] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-01T20:29:08.902384] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-01T20:29:09.003146] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T20:29:09.702409] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-01T20:29:09.946132] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T20:29:10.502391] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-01T20:29:10.536157] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T20:29:11.302359] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-01T20:29:11.634192] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T20:29:12.102375] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-01T20:29:12.157182] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T20:29:12.902372] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-01T20:29:12.968073] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T20:29:13.557287] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T20:29:13.702421] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-01T20:29:14.502423] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-01T20:29:15.050983] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T20:29:15.302423] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-01T20:29:15.351216] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T20:29:16.102394] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-01T20:29:16.175444] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T20:29:16.902367] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-01T20:29:17.116855] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T20:29:17.438744] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-01T20:29:17.702441] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-01T20:29:18.502400] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-01T20:29:18.967584] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T20:29:19.108299] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T20:29:19.302391] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-01T20:29:20.102388] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-01T20:29:20.286761] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T20:29:20.902387] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-01T20:29:20.926633] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T20:29:21.702393] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-01T20:29:21.897847] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T20:29:22.502374] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-01T20:29:22.623519] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-01T20:29:23.302380] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-01T20:29:23.422247] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T20:29:24.102390] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-01T20:29:24.191187] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T20:29:24.448137] [DEBUG] [REMOTE ] NIE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:29:24.448468] [WARN ] [REMOTE ] NIE: No data returned for month 2025-10 [2025-10-01T20:29:24.448564] [FATAL] [REMOTE ] NIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:29:24.448677] [FATAL] [MAIN ] NIE: Failed to fetch primary data. [2025-10-01T20:29:24.448752] [WARN ] [MAIN ] NIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:29:24.448828] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-01T20:29:24.448896] [DEBUG] [LOCAL ] NIE: No primary data file found to delete. [2025-10-01T20:29:24.448935] [INFO ] [LOCAL ] NIE: Starting deletion of derivative data. [2025-10-01T20:29:24.449212] [DEBUG] [LOCAL ] NIE: Deleted derivative data file. [2025-10-01T20:29:24.449328] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIE took 25.8s. Estimated remaining: 2h 5m 48s. Rate: 7.1 symbols/min [2025-10-01T20:29:24.641904] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:29:24.649488] [DEBUG] [LOCAL ] NIM: Loaded 4105 existing records from primary storage. [2025-10-01T20:29:24.649713] [INFO ] [MAIN ] NIM: Loaded 4105 existing records. [2025-10-01T20:29:24.847326] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:24.847539] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-01T20:29:24.847592] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-01T20:29:24.847880] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-01T20:29:24.847970] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-01T20:29:24.908887] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-01T20:29:25.265500] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:25.702394] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-01T20:29:26.104114] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T20:29:26.502451] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-01T20:29:26.552338] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T20:29:27.162074] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T20:29:27.302382] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-01T20:29:28.102417] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-01T20:29:28.137612] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-01T20:29:28.753228] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T20:29:28.902385] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-01T20:29:29.702390] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-01T20:29:29.744392] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T20:29:30.403259] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T20:29:30.502434] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-01T20:29:30.684402] [DEBUG] [REMOTE ] NIC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:29:30.684830] [WARN ] [REMOTE ] NIC: No data returned for month 2025-10 [2025-10-01T20:29:30.684997] [FATAL] [REMOTE ] NIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:29:30.685086] [FATAL] [MAIN ] NIC: Failed to fetch primary data. [2025-10-01T20:29:30.685147] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:29:30.685215] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-01T20:29:30.685275] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-01T20:29:30.685310] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-01T20:29:30.685677] [DEBUG] [LOCAL ] NIC: Deleted derivative data file. [2025-10-01T20:29:30.685783] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIC took 32.1s. Estimated remaining: 2h 5m 39s. Rate: 7.1 symbols/min [2025-10-01T20:29:30.868879] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:29:30.899043] [DEBUG] [LOCAL ] NINE: Loaded 28273 existing records from primary storage. [2025-10-01T20:29:30.899316] [INFO ] [MAIN ] NINE: Loaded 28273 existing records. [2025-10-01T20:29:31.109637] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:31.110123] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-01T20:29:31.110184] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-01T20:29:31.110692] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-01T20:29:31.110754] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-01T20:29:31.307747] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-01T20:29:31.684855] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:31.983696] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T20:29:32.102390] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-01T20:29:32.902396] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-01T20:29:33.391147] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-01T20:29:33.561769] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T20:29:33.702427] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-01T20:29:34.502392] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-01T20:29:35.302366] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-01T20:29:35.381885] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T20:29:35.403902] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T20:29:35.995762] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T20:29:36.102415] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-01T20:29:36.781059] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T20:29:36.902408] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-01T20:29:37.534540] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T20:29:37.702405] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-01T20:29:38.224900] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T20:29:38.502389] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-01T20:29:38.769610] [DEBUG] [REMOTE ] NHI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:29:38.770040] [WARN ] [REMOTE ] NHI: No data returned for month 2025-10 [2025-10-01T20:29:38.770165] [FATAL] [REMOTE ] NHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:29:38.770308] [FATAL] [MAIN ] NHI: Failed to fetch primary data. [2025-10-01T20:29:38.770405] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:29:38.770507] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-01T20:29:38.770623] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-01T20:29:38.770730] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-01T20:29:38.771074] [DEBUG] [LOCAL ] NHI: Deleted derivative data file. [2025-10-01T20:29:38.771167] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NHI took 40.2s. Estimated remaining: 2h 5m 30s. Rate: 7.1 symbols/min [2025-10-01T20:29:38.963706] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:29:39.028104] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-01T20:29:39.028456] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-01T20:29:39.217127] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:39.217356] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-01T20:29:39.217407] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-01T20:29:39.217921] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-01T20:29:39.217994] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-01T20:29:39.307575] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-01T20:29:39.606069] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:39.896805] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T20:29:40.102383] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-01T20:29:40.902391] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-01T20:29:41.517746] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T20:29:41.702355] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-01T20:29:41.807856] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T20:29:41.936598] [DEBUG] [REMOTE ] NIM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:29:41.936991] [WARN ] [REMOTE ] NIM: No data returned for month 2025-10 [2025-10-01T20:29:41.937087] [FATAL] [REMOTE ] NIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:29:41.937168] [FATAL] [MAIN ] NIM: Failed to fetch primary data. [2025-10-01T20:29:41.937233] [WARN ] [MAIN ] NIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:29:41.937319] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-01T20:29:41.937425] [DEBUG] [LOCAL ] NIM: No primary data file found to delete. [2025-10-01T20:29:41.937502] [INFO ] [LOCAL ] NIM: Starting deletion of derivative data. [2025-10-01T20:29:41.937955] [DEBUG] [LOCAL ] NIM: Deleted derivative data file. [2025-10-01T20:29:41.938046] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NIM took 17.5s. Estimated remaining: 2h 5m 18s. Rate: 7.1 symbols/min [2025-10-01T20:29:42.129337] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:29:42.129582] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-01T20:29:42.129623] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-01T20:29:42.129771] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-01T20:29:42.129815] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-01T20:29:42.129859] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-01T20:29:42.129893] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-01T20:29:42.521924] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:42.515693] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-01T20:29:43.302388] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-01T20:29:44.102427] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-01T20:29:44.360906] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:29:44.361249] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-01T20:29:44.361345] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:29:44.361393] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-01T20:29:44.361428] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:29:44.361494] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-01T20:29:44.361580] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-01T20:29:44.361639] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-01T20:29:44.361753] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-01T20:29:44.361824] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIQ took 2.4s. Estimated remaining: 2h 5m 6s. Rate: 7.1 symbols/min [2025-10-01T20:29:44.546220] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:29:44.592341] [DEBUG] [LOCAL ] NJR: Loaded 38069 existing records from primary storage. [2025-10-01T20:29:44.592752] [INFO ] [MAIN ] NJR: Loaded 38069 existing records. [2025-10-01T20:29:44.722218] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T20:29:44.819314] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:29:44.819536] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-01T20:29:44.819597] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-01T20:29:44.820248] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-01T20:29:44.820312] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-01T20:29:44.907566] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-01T20:29:45.285206] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:45.290941] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-01T20:29:45.588330] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T20:29:45.702387] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-01T20:29:46.502388] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-01T20:29:46.908575] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T20:29:47.302406] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-01T20:29:48.102427] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-01T20:29:48.383371] [DEBUG] [REMOTE ] NI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:29:48.383740] [WARN ] [REMOTE ] NI: No data returned for month 2025-10 [2025-10-01T20:29:48.383863] [FATAL] [REMOTE ] NI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:29:48.384022] [FATAL] [MAIN ] NI: Failed to fetch primary data. [2025-10-01T20:29:48.384106] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:29:48.384182] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-01T20:29:48.384249] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-01T20:29:48.384327] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-01T20:29:48.384760] [DEBUG] [LOCAL ] NI: Deleted derivative data file. [2025-10-01T20:29:48.384874] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NI took 49.8s. Estimated remaining: 2h 4m 55s. Rate: 7.1 symbols/min [2025-10-01T20:29:48.585776] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:29:48.586063] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-01T20:29:48.586139] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-01T20:29:48.586276] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-01T20:29:48.586359] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-01T20:29:48.586500] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-01T20:29:48.586553] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-01T20:29:48.903182] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-01T20:29:49.043562] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:29:49.065425] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-01T20:29:49.063360] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T20:29:49.702389] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-01T20:29:50.205774] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T20:29:50.502411] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-01T20:29:51.041443] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T20:29:51.302387] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-01T20:29:52.102381] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-01T20:29:52.875715] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-01T20:29:52.902339] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-01T20:29:53.702358] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-01T20:29:53.747414] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-01T20:29:53.902393] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T20:29:54.502376] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-01T20:29:55.188514] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T20:29:55.302373] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-01T20:29:55.379098] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-01T20:29:55.793339] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T20:29:56.102386] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-01T20:29:56.902379] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-01T20:29:57.650679] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-01T20:29:57.702368] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-01T20:29:58.009583] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T20:29:58.195797] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T20:29:58.502383] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-01T20:29:59.302436] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-01T20:30:00.032553] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-01T20:30:00.066713] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T20:30:00.102384] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-01T20:30:00.902377] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-01T20:30:01.702440] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-01T20:30:01.891506] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-01T20:30:01.928952] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T20:30:02.020212] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T20:30:02.502394] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-01T20:30:02.737578] [DEBUG] [REMOTE ] NINE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:02.737973] [WARN ] [REMOTE ] NINE: No data returned for month 2025-10 [2025-10-01T20:30:02.738065] [FATAL] [REMOTE ] NINE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:02.738155] [FATAL] [MAIN ] NINE: Failed to fetch primary data. [2025-10-01T20:30:02.738221] [WARN ] [MAIN ] NINE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:02.738316] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-01T20:30:02.738383] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-01T20:30:02.738421] [INFO ] [LOCAL ] NINE: Starting deletion of derivative data. [2025-10-01T20:30:02.738757] [DEBUG] [LOCAL ] NINE: Deleted derivative data file. [2025-10-01T20:30:02.738859] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NINE took 32.1s. Estimated remaining: 2h 4m 50s. Rate: 7.1 symbols/min [2025-10-01T20:30:02.935345] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:02.956893] [DEBUG] [LOCAL ] NKX: Loaded 13662 existing records from primary storage. [2025-10-01T20:30:02.957171] [INFO ] [MAIN ] NKX: Loaded 13662 existing records. [2025-10-01T20:30:03.153366] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:30:03.153589] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-01T20:30:03.153659] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-01T20:30:03.153949] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-01T20:30:03.154012] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-01T20:30:03.312293] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-01T20:30:03.579931] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:30:04.102428] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-01T20:30:04.586781] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-01T20:30:04.894506] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T20:30:04.902328] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-01T20:30:05.642156] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-01T20:30:05.702387] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-01T20:30:05.883814] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T20:30:06.502422] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-01T20:30:07.302356] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-01T20:30:07.378435] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T20:30:08.102390] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-01T20:30:08.359988] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T20:30:08.902372] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-01T20:30:09.277788] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-01T20:30:09.577138] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-01T20:30:09.619774] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T20:30:09.702382] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-01T20:30:10.502393] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-01T20:30:11.128449] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T20:30:11.302404] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-01T20:30:12.102417] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-01T20:30:12.902371] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-01T20:30:12.940186] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-01T20:30:13.192085] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-01T20:30:13.702388] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-01T20:30:13.816155] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-01T20:30:14.272154] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T20:30:14.502467] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-01T20:30:14.763748] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T20:30:15.302434] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-01T20:30:16.142020] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-01T20:30:16.161824] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T20:30:16.363694] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T20:30:16.902432] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-01T20:30:17.159806] [DEBUG] [REMOTE ] NJR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:17.160159] [WARN ] [REMOTE ] NJR: No data returned for month 2025-10 [2025-10-01T20:30:17.160256] [FATAL] [REMOTE ] NJR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:17.160343] [FATAL] [MAIN ] NJR: Failed to fetch primary data. [2025-10-01T20:30:17.160409] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:17.160501] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-01T20:30:17.160596] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-01T20:30:17.160668] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-01T20:30:17.160982] [DEBUG] [LOCAL ] NJR: Deleted derivative data file. [2025-10-01T20:30:17.161074] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NJR took 32.8s. Estimated remaining: 2h 4m 45s. Rate: 7.1 symbols/min [2025-10-01T20:30:17.347129] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:17.347324] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-01T20:30:17.347363] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-01T20:30:17.347488] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-01T20:30:17.347534] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-01T20:30:17.347577] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-01T20:30:17.347612] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-01T20:30:17.708220] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-01T20:30:17.759247] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:30:18.502381] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-01T20:30:18.857861] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-01T20:30:19.221802] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-01T20:30:19.302397] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-01T20:30:20.020569] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-01T20:30:20.102400] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-01T20:30:20.363726] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-01T20:30:20.902438] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-01T20:30:21.530898] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T20:30:21.702390] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-01T20:30:22.293752] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T20:30:22.502420] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-01T20:30:22.825409] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-01T20:30:23.282129] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T20:30:23.302437] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-01T20:30:24.102467] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-01T20:30:24.411987] [DEBUG] [REMOTE ] NIO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:24.412352] [WARN ] [REMOTE ] NIO: No data returned for month 2025-10 [2025-10-01T20:30:24.412454] [FATAL] [REMOTE ] NIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:24.412599] [FATAL] [MAIN ] NIO: Failed to fetch primary data. [2025-10-01T20:30:24.412700] [WARN ] [MAIN ] NIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:24.412775] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-01T20:30:24.412845] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-01T20:30:24.412883] [INFO ] [LOCAL ] NIO: Starting deletion of derivative data. [2025-10-01T20:30:24.414570] [DEBUG] [LOCAL ] NIO: Deleted derivative data file. [2025-10-01T20:30:24.414712] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NIO took 45.6s. Estimated remaining: 2h 4m 36s. Rate: 7.1 symbols/min [2025-10-01T20:30:24.625913] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:24.640202] [DEBUG] [LOCAL ] NLOP: Loaded 11771 existing records from primary storage. [2025-10-01T20:30:24.640428] [INFO ] [MAIN ] NLOP: Loaded 11771 existing records. [2025-10-01T20:30:24.836750] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:30:24.836981] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-01T20:30:24.837029] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-01T20:30:24.837336] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-01T20:30:24.837399] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-01T20:30:24.907882] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-01T20:30:25.237454] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:30:25.702372] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-01T20:30:25.790399] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-01T20:30:25.821523] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T20:30:26.426543] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T20:30:26.502404] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-01T20:30:27.302439] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-01T20:30:27.416088] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T20:30:28.102399] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-01T20:30:28.165783] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T20:30:28.902389] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-01T20:30:29.043486] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T20:30:29.702381] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-01T20:30:29.977287] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T20:30:30.502416] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-01T20:30:30.532097] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T20:30:31.302428] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-01T20:30:31.392896] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T20:30:32.102363] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-01T20:30:32.161969] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T20:30:32.588342] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T20:30:32.902380] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-01T20:30:33.214395] [DEBUG] [REMOTE ] NKE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:33.214765] [WARN ] [REMOTE ] NKE: No data returned for month 2025-10 [2025-10-01T20:30:33.214860] [FATAL] [REMOTE ] NKE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:33.214950] [FATAL] [MAIN ] NKE: Failed to fetch primary data. [2025-10-01T20:30:33.215015] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:33.215090] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-01T20:30:33.215156] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-01T20:30:33.215194] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-01T20:30:33.215237] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-01T20:30:33.215320] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NKE took 44.8s. Estimated remaining: 2h 4m 28s. Rate: 7.1 symbols/min [2025-10-01T20:30:33.401960] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:33.463416] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-10-01T20:30:33.463804] [INFO ] [MAIN ] NLY: Loaded 53581 existing records. [2025-10-01T20:30:33.671493] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:30:33.671769] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-01T20:30:33.671825] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-01T20:30:33.672296] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-01T20:30:33.672363] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-01T20:30:33.707591] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-01T20:30:33.966166] [DEBUG] [REMOTE ] NKX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:33.988101] [WARN ] [REMOTE ] NKX: No data returned for month 2025-10 [2025-10-01T20:30:34.000602] [FATAL] [REMOTE ] NKX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:34.000878] [FATAL] [MAIN ] NKX: Failed to fetch primary data. [2025-10-01T20:30:34.001283] [WARN ] [MAIN ] NKX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:34.012021] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-01T20:30:34.017284] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-10-01T20:30:34.017357] [INFO ] [LOCAL ] NKX: Starting deletion of derivative data. [2025-10-01T20:30:34.044378] [DEBUG] [LOCAL ] NKX: Deleted derivative data file. [2025-10-01T20:30:34.062975] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NKX took 31.3s. Estimated remaining: 2h 4m 15s. Rate: 7.1 symbols/min [2025-10-01T20:30:34.142105] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:30:34.298389] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:34.314499] [DEBUG] [LOCAL ] NMAI: Loaded 12913 existing records from primary storage. [2025-10-01T20:30:34.314769] [INFO ] [MAIN ] NMAI: Loaded 12913 existing records. [2025-10-01T20:30:34.506462] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:30:34.506619] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-01T20:30:34.507187] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-01T20:30:34.507397] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-01T20:30:34.508780] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-01T20:30:34.508869] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-01T20:30:34.903211] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:30:35.302384] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-01T20:30:36.102375] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-01T20:30:36.234936] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T20:30:36.498761] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T20:30:36.775405] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T20:30:36.902430] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-01T20:30:37.453392] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T20:30:37.702390] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-01T20:30:37.975859] [DEBUG] [REMOTE ] NL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:37.976135] [WARN ] [REMOTE ] NL: No data returned for month 2025-10 [2025-10-01T20:30:37.976228] [FATAL] [REMOTE ] NL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:37.976318] [FATAL] [MAIN ] NL: Failed to fetch primary data. [2025-10-01T20:30:37.976383] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:37.976457] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-01T20:30:37.976521] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-01T20:30:37.976558] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-01T20:30:37.976599] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-01T20:30:37.976678] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NL took 20.8s. Estimated remaining: 2h 4m 4s. Rate: 7.1 symbols/min [2025-10-01T20:30:38.165885] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:38.166082] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-01T20:30:38.166121] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-01T20:30:38.166244] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-01T20:30:38.166290] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-01T20:30:38.166336] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-01T20:30:38.166369] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-01T20:30:38.507470] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-01T20:30:38.584046] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:30:39.302380] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-01T20:30:39.580098] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T20:30:40.102390] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-01T20:30:40.837474] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-01T20:30:40.902379] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-01T20:30:41.118237] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T20:30:41.172359] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:41.172739] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-01T20:30:41.172833] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:41.172881] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-01T20:30:41.172952] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:41.173025] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-01T20:30:41.173091] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-01T20:30:41.173127] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-01T20:30:41.173167] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-01T20:30:41.173234] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NMAX took 3.2s. Estimated remaining: 2h 3m 52s. Rate: 7.1 symbols/min [2025-10-01T20:30:41.353921] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:41.378824] [DEBUG] [LOCAL ] NMCO: Loaded 16715 existing records from primary storage. [2025-10-01T20:30:41.379106] [INFO ] [MAIN ] NMCO: Loaded 16715 existing records. [2025-10-01T20:30:41.580964] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:30:41.581220] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-01T20:30:41.581274] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-01T20:30:41.581594] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-01T20:30:41.581696] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-01T20:30:41.707551] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-01T20:30:41.972457] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:30:42.502376] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-01T20:30:42.847724] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T20:30:43.302411] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-01T20:30:44.102386] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-01T20:30:44.173332] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T20:30:44.346617] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T20:30:44.902382] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-01T20:30:45.205947] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-01T20:30:45.684364] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T20:30:45.702345] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-01T20:30:46.362606] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-01T20:30:46.502382] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-01T20:30:47.302395] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-01T20:30:48.102354] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-01T20:30:48.356083] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T20:30:48.594076] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T20:30:48.902388] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-01T20:30:49.166798] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T20:30:49.702415] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-01T20:30:49.797753] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-01T20:30:50.502394] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-01T20:30:50.521332] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T20:30:51.302392] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-01T20:30:51.996863] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T20:30:52.102407] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-01T20:30:52.558053] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-01T20:30:52.902383] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-01T20:30:53.236773] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T20:30:53.702402] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-01T20:30:54.502392] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-01T20:30:54.558886] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T20:30:54.733890] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T20:30:55.302381] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-01T20:30:55.649717] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T20:30:55.935167] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T20:30:56.102446] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-01T20:30:56.831413] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-01T20:30:56.902374] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-01T20:30:57.702345] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-01T20:30:58.086188] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T20:30:58.502438] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-01T20:30:59.171801] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T20:30:59.302358] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-01T20:30:59.647572] [DEBUG] [REMOTE ] NLOP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:30:59.648013] [WARN ] [REMOTE ] NLOP: No data returned for month 2025-10 [2025-10-01T20:30:59.648108] [FATAL] [REMOTE ] NLOP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:30:59.648199] [FATAL] [MAIN ] NLOP: Failed to fetch primary data. [2025-10-01T20:30:59.648241] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:30:59.648314] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-01T20:30:59.648404] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-01T20:30:59.648463] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-01T20:30:59.648753] [DEBUG] [LOCAL ] NLOP: Deleted derivative data file. [2025-10-01T20:30:59.648858] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NLOP took 35.2s. Estimated remaining: 2h 3m 49s. Rate: 7.1 symbols/min [2025-10-01T20:30:59.855626] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:30:59.891522] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-01T20:30:59.916028] [DEBUG] [LOCAL ] NMG: Loaded 8131 existing records from primary storage. [2025-10-01T20:30:59.916258] [INFO ] [MAIN ] NMG: Loaded 8131 existing records. [2025-10-01T20:31:00.110463] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:00.106453] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-01T20:31:00.110854] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-01T20:31:00.110990] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-01T20:31:00.112057] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-01T20:31:00.112131] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-01T20:31:00.502875] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:00.902378] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-01T20:31:01.278621] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T20:31:01.702683] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-01T20:31:01.705114] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T20:31:02.502408] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-01T20:31:03.302391] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-01T20:31:03.544521] [DEBUG] [REMOTE ] NMAI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:31:03.550158] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T20:31:03.550271] [WARN ] [REMOTE ] NMAI: No data returned for month 2025-10 [2025-10-01T20:31:03.552856] [FATAL] [REMOTE ] NMAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:31:03.555321] [FATAL] [MAIN ] NMAI: Failed to fetch primary data. [2025-10-01T20:31:03.555424] [WARN ] [MAIN ] NMAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:31:03.555521] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-01T20:31:03.555608] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-01T20:31:03.555689] [INFO ] [LOCAL ] NMAI: Starting deletion of derivative data. [2025-10-01T20:31:03.555981] [DEBUG] [LOCAL ] NMAI: Deleted derivative data file. [2025-10-01T20:31:03.556070] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMAI took 29.5s. Estimated remaining: 2h 3m 38s. Rate: 7.1 symbols/min [2025-10-01T20:31:03.753340] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:31:03.759781] [DEBUG] [LOCAL ] NMI: Loaded 4052 existing records from primary storage. [2025-10-01T20:31:03.759954] [INFO ] [MAIN ] NMI: Loaded 4052 existing records. [2025-10-01T20:31:03.962413] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:03.962948] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-01T20:31:03.963211] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-01T20:31:03.977480] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-01T20:31:03.999426] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-01T20:31:04.053948] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-01T20:31:04.107486] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-01T20:31:04.425708] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:04.902392] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-01T20:31:05.054416] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T20:31:05.649868] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T20:31:05.702409] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-01T20:31:06.492227] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T20:31:06.502389] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-01T20:31:07.302434] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-01T20:31:08.102358] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-01T20:31:08.245230] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T20:31:08.453585] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T20:31:08.824054] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T20:31:08.902458] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-01T20:31:09.395060] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T20:31:09.702430] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-01T20:31:10.502358] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-01T20:31:10.810901] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T20:31:11.302432] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-01T20:31:12.102387] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-01T20:31:12.187010] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T20:31:12.250190] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T20:31:12.831881] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-01T20:31:12.902388] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-01T20:31:13.702396] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-01T20:31:13.825014] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T20:31:13.923965] [DEBUG] [REMOTE ] NLY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:31:13.924309] [WARN ] [REMOTE ] NLY: No data returned for month 2025-10 [2025-10-01T20:31:13.924431] [FATAL] [REMOTE ] NLY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:31:13.924520] [FATAL] [MAIN ] NLY: Failed to fetch primary data. [2025-10-01T20:31:13.924585] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:31:13.924684] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-01T20:31:13.924776] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-01T20:31:13.924833] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-01T20:31:13.925099] [DEBUG] [LOCAL ] NLY: Deleted derivative data file. [2025-10-01T20:31:13.925202] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NLY took 40.7s. Estimated remaining: 2h 3m 31s. Rate: 7.1 symbols/min [2025-10-01T20:31:14.136145] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:31:14.152935] [DEBUG] [LOCAL ] NMM: Loaded 14348 existing records from primary storage. [2025-10-01T20:31:14.153186] [INFO ] [MAIN ] NMM: Loaded 14348 existing records. [2025-10-01T20:31:14.349054] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:14.349293] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-01T20:31:14.349344] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-01T20:31:14.349578] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-01T20:31:14.349639] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-01T20:31:14.510098] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-01T20:31:14.771261] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:15.117473] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T20:31:15.302437] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-01T20:31:16.102422] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-01T20:31:16.420516] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T20:31:16.902401] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-01T20:31:17.188888] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T20:31:17.657394] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T20:31:17.702350] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-01T20:31:18.502392] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-01T20:31:18.830254] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T20:31:19.177221] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-01T20:31:19.302424] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-01T20:31:19.946712] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T20:31:20.102413] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-01T20:31:20.749046] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-01T20:31:20.902395] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-01T20:31:21.579986] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T20:31:21.702392] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-01T20:31:22.409145] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T20:31:22.502431] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-01T20:31:23.195846] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T20:31:23.302391] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-01T20:31:24.077982] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T20:31:24.102373] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-01T20:31:24.902426] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-01T20:31:25.265336] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T20:31:25.702390] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-01T20:31:25.888208] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T20:31:26.502423] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-01T20:31:26.646636] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T20:31:27.102699] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-01T20:31:27.302388] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-01T20:31:28.102380] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-01T20:31:28.333358] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T20:31:28.902392] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-01T20:31:29.127561] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T20:31:29.702407] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-01T20:31:30.085338] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T20:31:30.163302] [DEBUG] [REMOTE ] NMCO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:31:30.163613] [WARN ] [REMOTE ] NMCO: No data returned for month 2025-10 [2025-10-01T20:31:30.163736] [FATAL] [REMOTE ] NMCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:31:30.163819] [FATAL] [MAIN ] NMCO: Failed to fetch primary data. [2025-10-01T20:31:30.163857] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:31:30.163897] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-01T20:31:30.163991] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-01T20:31:30.164223] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-01T20:31:30.164561] [DEBUG] [LOCAL ] NMCO: Deleted derivative data file. [2025-10-01T20:31:30.164686] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMCO took 49.0s. Estimated remaining: 2h 3m 27s. Rate: 7.1 symbols/min [2025-10-01T20:31:30.351761] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:31:30.389216] [DEBUG] [LOCAL ] NMR: Loaded 34990 existing records from primary storage. [2025-10-01T20:31:30.389518] [INFO ] [MAIN ] NMR: Loaded 34990 existing records. [2025-10-01T20:31:30.507675] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-01T20:31:30.611101] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:30.611342] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-01T20:31:30.611453] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-01T20:31:30.611993] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-01T20:31:30.612056] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-01T20:31:31.027227] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:31.191715] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T20:31:31.302378] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-01T20:31:32.102421] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-01T20:31:32.902392] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-01T20:31:33.165226] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T20:31:33.702386] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-01T20:31:33.909242] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T20:31:34.502367] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-01T20:31:34.657512] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T20:31:35.302433] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-01T20:31:35.683938] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T20:31:35.972349] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T20:31:36.102392] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-01T20:31:36.902395] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-01T20:31:37.604592] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T20:31:37.702399] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-01T20:31:37.796703] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T20:31:37.875889] [DEBUG] [REMOTE ] NMM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:31:37.876241] [WARN ] [REMOTE ] NMM: No data returned for month 2025-10 [2025-10-01T20:31:37.876338] [FATAL] [REMOTE ] NMM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:31:37.876421] [FATAL] [MAIN ] NMM: Failed to fetch primary data. [2025-10-01T20:31:37.876463] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:31:37.876503] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-01T20:31:37.876575] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-01T20:31:37.876633] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-01T20:31:37.877113] [DEBUG] [LOCAL ] NMM: Deleted derivative data file. [2025-10-01T20:31:37.877223] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMM took 24.0s. Estimated remaining: 2h 3m 18s. Rate: 7.1 symbols/min [2025-10-01T20:31:38.071418] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:31:38.077478] [DEBUG] [LOCAL ] NMS: Loaded 2855 existing records from primary storage. [2025-10-01T20:31:38.077733] [INFO ] [MAIN ] NMS: Loaded 2855 existing records. [2025-10-01T20:31:38.288739] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:38.289007] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-01T20:31:38.289059] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-01T20:31:38.289293] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-01T20:31:38.289382] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-01T20:31:38.507597] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-01T20:31:38.715593] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:39.302389] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-01T20:31:40.102419] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-01T20:31:40.764753] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T20:31:40.902398] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-01T20:31:40.977689] [DEBUG] [REMOTE ] NMI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:31:40.978094] [WARN ] [REMOTE ] NMI: No data returned for month 2025-10 [2025-10-01T20:31:40.978190] [FATAL] [REMOTE ] NMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:31:40.978343] [FATAL] [MAIN ] NMI: Failed to fetch primary data. [2025-10-01T20:31:40.978421] [WARN ] [MAIN ] NMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:31:40.978500] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-01T20:31:40.978577] [DEBUG] [LOCAL ] NMI: No primary data file found to delete. [2025-10-01T20:31:40.978621] [INFO ] [LOCAL ] NMI: Starting deletion of derivative data. [2025-10-01T20:31:40.978983] [DEBUG] [LOCAL ] NMI: Deleted derivative data file. [2025-10-01T20:31:40.979078] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMI took 37.4s. Estimated remaining: 2h 3m 6s. Rate: 7.1 symbols/min [2025-10-01T20:31:41.207612] [DEBUG] [REMOTE ] NMG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:31:41.207399] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:31:41.208376] [WARN ] [REMOTE ] NMG: No data returned for month 2025-10 [2025-10-01T20:31:41.208507] [FATAL] [REMOTE ] NMG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:31:41.208683] [FATAL] [MAIN ] NMG: Failed to fetch primary data. [2025-10-01T20:31:41.208765] [WARN ] [MAIN ] NMG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:31:41.208897] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-01T20:31:41.208991] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-01T20:31:41.209070] [INFO ] [LOCAL ] NMG: Starting deletion of derivative data. [2025-10-01T20:31:41.209565] [DEBUG] [LOCAL ] NMG: Deleted derivative data file. [2025-10-01T20:31:41.209735] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMG took 41.6s. Estimated remaining: 2h 2m 53s. Rate: 7.1 symbols/min [2025-10-01T20:31:41.311716] [DEBUG] [LOCAL ] NMT: Loaded 2851 existing records from primary storage. [2025-10-01T20:31:41.339285] [INFO ] [MAIN ] NMT: Loaded 2851 existing records. [2025-10-01T20:31:41.568816] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T20:31:41.563280] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:31:41.698242] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:41.698583] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-01T20:31:41.698673] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-01T20:31:41.698927] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-01T20:31:41.698999] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-01T20:31:41.714166] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-01T20:31:41.767924] [DEBUG] [LOCAL ] NMZ: Loaded 21758 existing records from primary storage. [2025-10-01T20:31:41.817210] [INFO ] [MAIN ] NMZ: Loaded 21758 existing records. [2025-10-01T20:31:42.347089] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:42.347955] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-01T20:31:42.353830] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-01T20:31:42.370064] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-01T20:31:42.414567] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-01T20:31:42.500438] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T20:31:42.485667] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:42.536125] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-01T20:31:42.864267] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:43.265882] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T20:31:43.302378] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-01T20:31:43.865718] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T20:31:44.102386] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-01T20:31:44.562415] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T20:31:44.902399] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-01T20:31:45.227964] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (6.72 seconds). [2025-10-01T20:31:45.428895] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-01T20:31:45.702379] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-01T20:31:46.257738] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-01T20:31:46.502383] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-01T20:31:47.302343] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-01T20:31:47.724948] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T20:31:48.102374] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-01T20:31:48.527975] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T20:31:48.851362] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T20:31:48.902371] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-01T20:31:49.586940] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T20:31:49.702380] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-01T20:31:50.381463] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T20:31:50.502440] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-01T20:31:50.964989] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T20:31:51.302369] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-01T20:31:52.063746] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T20:31:52.102386] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-01T20:31:52.902478] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-01T20:31:53.271590] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T20:31:53.702434] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-01T20:31:54.502434] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-01T20:31:54.628513] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T20:31:54.862114] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T20:31:55.089721] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T20:31:55.302421] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-01T20:31:56.102417] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-01T20:31:56.656226] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T20:31:56.745605] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-01T20:31:56.902397] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-01T20:31:57.419451] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-01T20:31:57.702383] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-01T20:31:58.502390] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-01T20:31:58.744231] [DEBUG] [REMOTE ] NMS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:31:58.744548] [WARN ] [REMOTE ] NMS: No data returned for month 2025-10 [2025-10-01T20:31:58.744679] [FATAL] [REMOTE ] NMS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:31:58.744795] [FATAL] [MAIN ] NMS: Failed to fetch primary data. [2025-10-01T20:31:58.744875] [WARN ] [MAIN ] NMS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:31:58.744950] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-01T20:31:58.745054] [DEBUG] [LOCAL ] NMS: No primary data file found to delete. [2025-10-01T20:31:58.745111] [INFO ] [LOCAL ] NMS: Starting deletion of derivative data. [2025-10-01T20:31:58.745494] [DEBUG] [LOCAL ] NMS: Deleted derivative data file. [2025-10-01T20:31:58.745639] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMS took 20.9s. Estimated remaining: 2h 2m 50s. Rate: 7.1 symbols/min [2025-10-01T20:31:58.942610] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:31:58.956524] [DEBUG] [LOCAL ] NNI: Loaded 10155 existing records from primary storage. [2025-10-01T20:31:58.956846] [INFO ] [MAIN ] NNI: Loaded 10155 existing records. [2025-10-01T20:31:59.157882] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:31:59.158118] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-01T20:31:59.158167] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-01T20:31:59.158432] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-01T20:31:59.158504] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-01T20:31:59.314406] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-01T20:31:59.482136] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T20:31:59.614292] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:31:59.969920] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T20:32:00.102429] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-01T20:32:00.767100] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T20:32:00.902395] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-01T20:32:01.702358] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-01T20:32:01.753395] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T20:32:02.502423] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-01T20:32:03.191226] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T20:32:03.302371] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-01T20:32:03.445979] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T20:32:04.102388] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-01T20:32:04.345708] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T20:32:04.902399] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-01T20:32:05.183577] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T20:32:05.482365] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T20:32:05.702404] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-01T20:32:06.502421] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-01T20:32:07.221761] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T20:32:07.254520] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T20:32:07.302387] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-01T20:32:08.102367] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-01T20:32:08.469175] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T20:32:08.902410] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-01T20:32:09.491320] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T20:32:09.702399] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-01T20:32:10.229404] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-01T20:32:10.482775] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T20:32:10.502341] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-01T20:32:11.101907] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T20:32:11.302409] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-01T20:32:11.724810] [DEBUG] [REMOTE ] NMT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:32:11.725174] [WARN ] [REMOTE ] NMT: No data returned for month 2025-10 [2025-10-01T20:32:11.725275] [FATAL] [REMOTE ] NMT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:32:11.725360] [FATAL] [MAIN ] NMT: Failed to fetch primary data. [2025-10-01T20:32:11.725431] [WARN ] [MAIN ] NMT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:32:11.725506] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-01T20:32:11.725575] [DEBUG] [LOCAL ] NMT: No primary data file found to delete. [2025-10-01T20:32:11.725613] [INFO ] [LOCAL ] NMT: Starting deletion of derivative data. [2025-10-01T20:32:11.725959] [DEBUG] [LOCAL ] NMT: Deleted derivative data file. [2025-10-01T20:32:11.726093] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 30.7s. Estimated remaining: 2h 2m 44s. Rate: 7.1 symbols/min [2025-10-01T20:32:11.936023] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:32:11.994883] [DEBUG] [LOCAL ] NNN: Loaded 48365 existing records from primary storage. [2025-10-01T20:32:11.995236] [INFO ] [MAIN ] NNN: Loaded 48365 existing records. [2025-10-01T20:32:12.107572] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-01T20:32:12.231919] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:32:12.232150] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-01T20:32:12.232201] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-01T20:32:12.232799] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-01T20:32:12.232863] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-01T20:32:12.484118] [DEBUG] [REMOTE ] NMR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:32:12.525555] [WARN ] [REMOTE ] NMR: No data returned for month 2025-10 [2025-10-01T20:32:12.553511] [FATAL] [REMOTE ] NMR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:32:12.580637] [FATAL] [MAIN ] NMR: Failed to fetch primary data. [2025-10-01T20:32:12.627516] [WARN ] [MAIN ] NMR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:32:12.633445] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-01T20:32:12.633906] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-01T20:32:12.639411] [INFO ] [LOCAL ] NMR: Starting deletion of derivative data. [2025-10-01T20:32:12.660479] [DEBUG] [LOCAL ] NMR: Deleted derivative data file. [2025-10-01T20:32:12.690220] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMR took 42.5s. Estimated remaining: 2h 2m 31s. Rate: 7.1 symbols/min [2025-10-01T20:32:12.723814] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:32:12.915214] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-01T20:32:12.919420] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:32:12.929065] [DEBUG] [LOCAL ] NNY: Loaded 5692 existing records from primary storage. [2025-10-01T20:32:12.929280] [INFO ] [MAIN ] NNY: Loaded 5692 existing records. [2025-10-01T20:32:13.126417] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:32:13.126672] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-01T20:32:13.126736] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-01T20:32:13.126932] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-01T20:32:13.126992] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-01T20:32:13.518607] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:32:13.582209] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-01T20:32:13.702398] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-01T20:32:14.502410] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-01T20:32:14.571773] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T20:32:15.302413] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-01T20:32:15.750139] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T20:32:15.969692] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T20:32:16.102429] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-01T20:32:16.673364] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T20:32:16.902396] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-01T20:32:17.587705] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T20:32:17.702392] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-01T20:32:18.502390] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-01T20:32:18.709542] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T20:32:19.302427] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-01T20:32:19.757230] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T20:32:20.102398] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-01T20:32:20.902410] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-01T20:32:21.674270] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T20:32:21.702410] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-01T20:32:21.922013] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T20:32:22.160564] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T20:32:22.502435] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-01T20:32:23.247009] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T20:32:23.295044] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (3.99 seconds). [2025-10-01T20:32:23.302330] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-01T20:32:24.102420] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-01T20:32:24.247470] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T20:32:24.902455] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-01T20:32:25.702405] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-01T20:32:25.735864] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T20:32:25.962399] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T20:32:26.432803] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T20:32:26.502439] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-01T20:32:27.302388] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-01T20:32:27.674436] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T20:32:27.982903] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T20:32:28.102378] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-01T20:32:28.882934] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T20:32:28.902359] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-01T20:32:29.168931] [DEBUG] [REMOTE ] NNY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:32:29.169277] [WARN ] [REMOTE ] NNY: No data returned for month 2025-10 [2025-10-01T20:32:29.169390] [FATAL] [REMOTE ] NNY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:32:29.169490] [FATAL] [MAIN ] NNY: Failed to fetch primary data. [2025-10-01T20:32:29.169568] [WARN ] [MAIN ] NNY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:32:29.169683] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-01T20:32:29.169784] [DEBUG] [LOCAL ] NNY: No primary data file found to delete. [2025-10-01T20:32:29.169833] [INFO ] [LOCAL ] NNY: Starting deletion of derivative data. [2025-10-01T20:32:29.170245] [DEBUG] [LOCAL ] NNY: Deleted derivative data file. [2025-10-01T20:32:29.170350] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNY took 16.4s. Estimated remaining: 2h 2m 27s. Rate: 7.1 symbols/min [2025-10-01T20:32:29.395789] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:32:29.414275] [DEBUG] [LOCAL ] NOA: Loaded 16200 existing records from primary storage. [2025-10-01T20:32:29.414559] [INFO ] [MAIN ] NOA: Loaded 16200 existing records. [2025-10-01T20:32:29.617090] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:32:29.617326] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-01T20:32:29.617376] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-01T20:32:29.617702] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-01T20:32:29.617767] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-01T20:32:29.707572] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-01T20:32:30.067545] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:32:30.502457] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-01T20:32:30.761130] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T20:32:31.302400] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-01T20:32:31.526393] [DEBUG] [REMOTE ] NNI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:32:31.526728] [WARN ] [REMOTE ] NNI: No data returned for month 2025-10 [2025-10-01T20:32:31.526822] [FATAL] [REMOTE ] NNI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:32:31.526927] [FATAL] [MAIN ] NNI: Failed to fetch primary data. [2025-10-01T20:32:31.526998] [WARN ] [MAIN ] NNI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:32:31.527072] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-01T20:32:31.527139] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-01T20:32:31.527178] [INFO ] [LOCAL ] NNI: Starting deletion of derivative data. [2025-10-01T20:32:31.527516] [DEBUG] [LOCAL ] NNI: Deleted derivative data file. [2025-10-01T20:32:31.527606] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNI took 32.8s. Estimated remaining: 2h 2m 15s. Rate: 7.1 symbols/min [2025-10-01T20:32:31.729924] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:32:31.753228] [DEBUG] [LOCAL ] NOAH: Loaded 20279 existing records from primary storage. [2025-10-01T20:32:31.753632] [INFO ] [MAIN ] NOAH: Loaded 20279 existing records. [2025-10-01T20:32:31.955267] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:32:31.955503] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-01T20:32:31.955566] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-01T20:32:31.955928] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-01T20:32:31.955990] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-01T20:32:32.103133] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-01T20:32:32.377221] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:32:32.406933] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T20:32:32.417311] [DEBUG] [REMOTE ] NMZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:32:32.418327] [WARN ] [REMOTE ] NMZ: No data returned for month 2025-10 [2025-10-01T20:32:32.418846] [FATAL] [REMOTE ] NMZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:32:32.418978] [FATAL] [MAIN ] NMZ: Failed to fetch primary data. [2025-10-01T20:32:32.419048] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:32:32.419121] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-01T20:32:32.419206] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-01T20:32:32.419264] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-10-01T20:32:32.419506] [DEBUG] [LOCAL ] NMZ: Deleted derivative data file. [2025-10-01T20:32:32.419596] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NMZ took 51.2s. Estimated remaining: 2h 2m 3s. Rate: 7.1 symbols/min [2025-10-01T20:32:32.612512] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:32:32.659056] [DEBUG] [LOCAL ] NOC: Loaded 42237 existing records from primary storage. [2025-10-01T20:32:32.659386] [INFO ] [MAIN ] NOC: Loaded 42237 existing records. [2025-10-01T20:32:32.855229] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:32:32.855536] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-01T20:32:32.855598] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-01T20:32:32.856167] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-01T20:32:32.856229] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-01T20:32:32.907505] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-01T20:32:33.268747] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:32:33.702362] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-01T20:32:33.913317] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T20:32:34.502344] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-01T20:32:34.568449] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T20:32:35.302379] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-01T20:32:36.102389] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-01T20:32:36.170199] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T20:32:36.330930] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T20:32:36.902358] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-01T20:32:37.168031] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T20:32:37.702389] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-01T20:32:38.502360] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-01T20:32:38.804461] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T20:32:39.188856] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T20:32:39.302375] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-01T20:32:39.368419] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T20:32:40.098764] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T20:32:40.105007] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-01T20:32:40.902355] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-01T20:32:41.129324] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T20:32:41.702386] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-01T20:32:41.973758] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T20:32:42.502373] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-01T20:32:43.302385] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-01T20:32:43.406137] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T20:32:43.488488] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T20:32:44.102348] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-01T20:32:44.572402] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T20:32:44.902388] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-01T20:32:45.705177] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-01T20:32:45.708399] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T20:32:45.984865] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T20:32:46.502341] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-01T20:32:46.790294] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T20:32:47.302391] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-01T20:32:47.481045] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T20:32:48.102391] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-01T20:32:48.902395] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-01T20:32:49.044827] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-01T20:32:49.574513] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T20:32:49.702427] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-01T20:32:50.502371] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-01T20:32:50.734611] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T20:32:51.302390] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-01T20:32:51.909700] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T20:32:52.102357] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-01T20:32:52.255882] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T20:32:52.902392] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-01T20:32:53.273944] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T20:32:53.702415] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-01T20:32:53.782353] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T20:32:54.032975] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (6.73 seconds). [2025-10-01T20:32:54.502408] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-01T20:32:54.610531] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T20:32:55.246408] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T20:32:55.302412] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-01T20:32:55.492612] [DEBUG] [REMOTE ] NOA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:32:55.492982] [WARN ] [REMOTE ] NOA: No data returned for month 2025-10 [2025-10-01T20:32:55.493070] [FATAL] [REMOTE ] NOA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:32:55.493159] [FATAL] [MAIN ] NOA: Failed to fetch primary data. [2025-10-01T20:32:55.493222] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:32:55.493319] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-01T20:32:55.493411] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-01T20:32:55.493513] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-01T20:32:55.493888] [DEBUG] [LOCAL ] NOA: Deleted derivative data file. [2025-10-01T20:32:55.493977] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOA took 26.3s. Estimated remaining: 2h 2m 3s. Rate: 7.1 symbols/min [2025-10-01T20:32:55.678286] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:32:55.731671] [DEBUG] [LOCAL ] NOG: Loaded 51183 existing records from primary storage. [2025-10-01T20:32:55.732014] [INFO ] [MAIN ] NOG: Loaded 51183 existing records. [2025-10-01T20:32:55.938699] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:32:55.940006] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-01T20:32:55.940069] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-01T20:32:55.941142] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-01T20:32:55.941220] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-01T20:32:56.108465] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-01T20:32:56.340758] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:32:56.902356] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-01T20:32:57.293185] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T20:32:57.702380] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-01T20:32:58.323111] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T20:32:58.502441] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-01T20:32:58.762899] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T20:32:59.302403] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-01T20:33:00.033131] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T20:33:00.102380] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-01T20:33:00.441769] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T20:33:00.902408] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-01T20:33:01.499587] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T20:33:01.702363] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-01T20:33:02.038757] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T20:33:02.502380] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-01T20:33:02.569527] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:33:03.302384] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-01T20:33:03.591083] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T20:33:04.102449] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-01T20:33:04.902392] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-01T20:33:05.074471] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T20:33:05.158453] [DEBUG] [REMOTE ] NOAH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:05.158836] [WARN ] [REMOTE ] NOAH: No data returned for month 2025-10 [2025-10-01T20:33:05.158941] [FATAL] [REMOTE ] NOAH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:05.159032] [FATAL] [MAIN ] NOAH: Failed to fetch primary data. [2025-10-01T20:33:05.159076] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:05.159152] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-01T20:33:05.159225] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-01T20:33:05.159270] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-01T20:33:05.159729] [DEBUG] [LOCAL ] NOAH: Deleted derivative data file. [2025-10-01T20:33:05.159853] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOAH took 33.6s. Estimated remaining: 2h 1m 55s. Rate: 7.1 symbols/min [2025-10-01T20:33:05.345006] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:05.408328] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-10-01T20:33:05.408799] [INFO ] [MAIN ] NOK: Loaded 53621 existing records. [2025-10-01T20:33:05.609462] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:33:05.609734] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-01T20:33:05.609792] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-01T20:33:05.610542] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-01T20:33:05.610604] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-01T20:33:05.709460] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-01T20:33:06.013788] [DEBUG] [REMOTE ] NNN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:06.013246] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:06.014678] [WARN ] [REMOTE ] NNN: No data returned for month 2025-10 [2025-10-01T20:33:06.014842] [FATAL] [REMOTE ] NNN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:06.015041] [FATAL] [MAIN ] NNN: Failed to fetch primary data. [2025-10-01T20:33:06.015184] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:06.015291] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-01T20:33:06.015413] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-01T20:33:06.015514] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-01T20:33:06.015832] [DEBUG] [LOCAL ] NNN: Deleted derivative data file. [2025-10-01T20:33:06.016084] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NNN took 54.3s. Estimated remaining: 2h 1m 42s. Rate: 7.1 symbols/min [2025-10-01T20:33:06.181794] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T20:33:06.253799] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:06.253998] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-01T20:33:06.254039] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-01T20:33:06.254149] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-01T20:33:06.254192] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-01T20:33:06.254235] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-01T20:33:06.254269] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-01T20:33:06.507583] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-01T20:33:06.664328] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:07.198954] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-01T20:33:07.302412] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-01T20:33:07.546444] [DEBUG] [REMOTE ] NOC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:07.546822] [WARN ] [REMOTE ] NOC: No data returned for month 2025-10 [2025-10-01T20:33:07.546913] [FATAL] [REMOTE ] NOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:07.547003] [FATAL] [MAIN ] NOC: Failed to fetch primary data. [2025-10-01T20:33:07.547066] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:07.547158] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-01T20:33:07.547223] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-01T20:33:07.547259] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-01T20:33:07.547618] [DEBUG] [LOCAL ] NOC: Deleted derivative data file. [2025-10-01T20:33:07.547742] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOC took 35.1s. Estimated remaining: 2h 1m 29s. Rate: 7.1 symbols/min [2025-10-01T20:33:07.744325] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:07.800080] [DEBUG] [LOCAL ] NOMD: Loaded 41446 existing records from primary storage. [2025-10-01T20:33:07.800394] [INFO ] [MAIN ] NOMD: Loaded 41446 existing records. [2025-10-01T20:33:08.025316] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:33:08.025515] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-01T20:33:08.025571] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-01T20:33:08.026064] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-01T20:33:08.026132] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-01T20:33:08.107561] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-01T20:33:08.439763] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:08.902382] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-01T20:33:09.702373] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-01T20:33:10.139082] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-01T20:33:10.306590] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T20:33:10.502423] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-01T20:33:11.309698] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-01T20:33:11.333263] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T20:33:12.102351] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-01T20:33:12.211582] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T20:33:12.590241] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-01T20:33:12.902363] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-01T20:33:13.480861] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-01T20:33:13.702379] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-01T20:33:14.271146] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T20:33:14.502423] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-01T20:33:15.302396] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-01T20:33:15.730256] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T20:33:15.767681] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-01T20:33:16.102439] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-01T20:33:16.470981] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-01T20:33:16.902438] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-01T20:33:17.343791] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T20:33:17.702430] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-01T20:33:18.048639] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-01T20:33:18.502425] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-01T20:33:18.657131] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T20:33:19.302405] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-01T20:33:20.102383] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-01T20:33:20.535200] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-01T20:33:20.762329] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-01T20:33:20.813468] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T20:33:20.902384] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-01T20:33:21.702394] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-01T20:33:22.502389] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-01T20:33:22.705982] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T20:33:22.934870] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-01T20:33:23.302389] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-01T20:33:23.499697] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T20:33:23.663111] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-01T20:33:24.102445] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-01T20:33:24.817002] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T20:33:24.902403] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-01T20:33:25.702395] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-01T20:33:26.177310] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T20:33:26.265600] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-01T20:33:26.502395] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-01T20:33:27.302382] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-01T20:33:28.071089] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T20:33:28.102386] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-01T20:33:28.902397] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-01T20:33:29.657482] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-01T20:33:29.673488] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T20:33:29.704565] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-01T20:33:29.707535] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T20:33:30.502393] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-01T20:33:31.302400] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-01T20:33:31.623677] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T20:33:32.102386] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-01T20:33:32.682698] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-01T20:33:32.706456] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T20:33:32.902380] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-01T20:33:32.995426] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T20:33:33.702382] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-01T20:33:34.508318] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-01T20:33:34.530793] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T20:33:34.774881] [DEBUG] [REMOTE ] NOM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:34.775257] [WARN ] [REMOTE ] NOM: No data returned for month 2025-10 [2025-10-01T20:33:34.775349] [FATAL] [REMOTE ] NOM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:34.775436] [FATAL] [MAIN ] NOM: Failed to fetch primary data. [2025-10-01T20:33:34.775500] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:34.775578] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-01T20:33:34.775668] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-01T20:33:34.775728] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-01T20:33:34.775779] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-01T20:33:34.775830] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOM took 28.8s. Estimated remaining: 2h 1m 32s. Rate: 7.1 symbols/min [2025-10-01T20:33:34.966179] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:35.017478] [DEBUG] [LOCAL ] NOTE: Loaded 42067 existing records from primary storage. [2025-10-01T20:33:35.017880] [INFO ] [MAIN ] NOTE: Loaded 42067 existing records. [2025-10-01T20:33:35.216178] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:33:35.216591] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-01T20:33:35.216757] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-01T20:33:35.217281] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-01T20:33:35.217347] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-01T20:33:35.303716] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-01T20:33:35.627865] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:35.662165] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-01T20:33:36.102380] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-01T20:33:36.902388] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-01T20:33:37.200031] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T20:33:37.637178] [DEBUG] [REMOTE ] NOMD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:37.637534] [WARN ] [REMOTE ] NOMD: No data returned for month 2025-10 [2025-10-01T20:33:37.637626] [FATAL] [REMOTE ] NOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:37.637762] [FATAL] [MAIN ] NOMD: Failed to fetch primary data. [2025-10-01T20:33:37.637846] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:37.637918] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-01T20:33:37.638009] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-01T20:33:37.638105] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-01T20:33:37.638569] [DEBUG] [LOCAL ] NOMD: Deleted derivative data file. [2025-10-01T20:33:37.638686] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOMD took 30.1s. Estimated remaining: 2h 1m 20s. Rate: 7.1 symbols/min [2025-10-01T20:33:37.707717] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-01T20:33:37.829268] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:37.892205] [DEBUG] [LOCAL ] NOV: Loaded 53180 existing records from primary storage. [2025-10-01T20:33:37.892572] [INFO ] [MAIN ] NOV: Loaded 53180 existing records. [2025-10-01T20:33:38.104149] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:33:38.104532] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-01T20:33:38.104634] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-01T20:33:38.105265] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-01T20:33:38.105331] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-01T20:33:38.341141] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-01T20:33:38.517608] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-01T20:33:38.563060] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:39.302387] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-01T20:33:40.102409] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-01T20:33:40.144091] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-01T20:33:40.374898] [DEBUG] [REMOTE ] NOG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:40.375239] [WARN ] [REMOTE ] NOG: No data returned for month 2025-10 [2025-10-01T20:33:40.375363] [FATAL] [REMOTE ] NOG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:40.375458] [FATAL] [MAIN ] NOG: Failed to fetch primary data. [2025-10-01T20:33:40.375526] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:40.375600] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-01T20:33:40.375693] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-01T20:33:40.375749] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-01T20:33:40.376095] [DEBUG] [LOCAL ] NOG: Deleted derivative data file. [2025-10-01T20:33:40.376198] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOG took 44.9s. Estimated remaining: 2h 1m 8s. Rate: 7.1 symbols/min [2025-10-01T20:33:40.573525] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:40.606463] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-01T20:33:40.661224] [DEBUG] [LOCAL ] NOW: Loaded 48554 existing records from primary storage. [2025-10-01T20:33:40.661562] [INFO ] [MAIN ] NOW: Loaded 48554 existing records. [2025-10-01T20:33:40.860116] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:33:40.860339] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-01T20:33:40.860431] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-01T20:33:40.861138] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-10-01T20:33:40.861201] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-01T20:33:40.907480] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-01T20:33:41.261583] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:41.302562] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-01T20:33:41.702395] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-01T20:33:42.502390] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-01T20:33:42.752686] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T20:33:43.293784] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T20:33:43.304263] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-01T20:33:43.359531] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T20:33:44.102376] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-01T20:33:44.902360] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-01T20:33:45.134489] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T20:33:45.172928] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T20:33:45.702406] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-01T20:33:46.502354] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-01T20:33:46.696067] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T20:33:46.960743] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-01T20:33:47.302374] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-01T20:33:47.524921] [DEBUG] [REMOTE ] NOK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:47.525210] [WARN ] [REMOTE ] NOK: No data returned for month 2025-10 [2025-10-01T20:33:47.525300] [FATAL] [REMOTE ] NOK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:47.525411] [FATAL] [MAIN ] NOK: Failed to fetch primary data. [2025-10-01T20:33:47.525479] [WARN ] [MAIN ] NOK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:47.525558] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-01T20:33:47.525627] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-01T20:33:47.525708] [INFO ] [LOCAL ] NOK: Starting deletion of derivative data. [2025-10-01T20:33:47.525984] [DEBUG] [LOCAL ] NOK: Deleted derivative data file. [2025-10-01T20:33:47.526073] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOK took 42.4s. Estimated remaining: 2h 0m 59s. Rate: 7.1 symbols/min [2025-10-01T20:33:47.710193] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:47.710482] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-01T20:33:47.710541] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-01T20:33:47.710726] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-01T20:33:47.710798] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-01T20:33:47.710906] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-01T20:33:47.710955] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-01T20:33:48.103730] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-01T20:33:48.103664] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:48.195373] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T20:33:48.697523] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T20:33:48.902384] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-01T20:33:49.702378] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-01T20:33:49.767188] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T20:33:49.925763] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:49.926131] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-01T20:33:49.926224] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:49.926298] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-01T20:33:49.926367] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:49.926452] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-01T20:33:49.926530] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-01T20:33:49.926570] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-01T20:33:49.926677] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-01T20:33:49.926752] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NP took 2.4s. Estimated remaining: 2h 0m 47s. Rate: 7.1 symbols/min [2025-10-01T20:33:50.146200] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:50.146387] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-01T20:33:50.146427] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-01T20:33:50.146542] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-01T20:33:50.146584] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-01T20:33:50.146636] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-01T20:33:50.146715] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-01T20:33:50.525085] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-01T20:33:50.531713] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:51.302391] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-01T20:33:52.102434] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-01T20:33:52.378271] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T20:33:52.625770] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-01T20:33:52.902361] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-01T20:33:53.331148] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T20:33:53.702420] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-01T20:33:54.020376] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:33:54.020805] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-01T20:33:54.020896] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:33:54.020951] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-01T20:33:54.021016] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:33:54.021088] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-01T20:33:54.021154] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-01T20:33:54.021192] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-01T20:33:54.021233] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-01T20:33:54.021296] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NPB took 4.1s. Estimated remaining: 2h 0m 36s. Rate: 7.1 symbols/min [2025-10-01T20:33:54.210535] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:33:54.230139] [DEBUG] [LOCAL ] NPCT: Loaded 16978 existing records from primary storage. [2025-10-01T20:33:54.230412] [INFO ] [MAIN ] NPCT: Loaded 16978 existing records. [2025-10-01T20:33:54.440397] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:33:54.440634] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-01T20:33:54.440815] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-01T20:33:54.441341] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-01T20:33:54.441403] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-01T20:33:54.511977] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-01T20:33:54.850393] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:33:54.883124] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T20:33:55.307600] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-01T20:33:55.322515] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T20:33:56.102388] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-01T20:33:56.524743] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T20:33:56.902393] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-01T20:33:57.595211] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T20:33:57.702403] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-01T20:33:58.013256] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T20:33:58.502413] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-01T20:33:59.302392] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-01T20:33:59.401475] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-01T20:33:59.514261] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T20:33:59.941308] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T20:34:00.102435] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-01T20:34:00.902403] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-01T20:34:01.702444] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-01T20:34:01.985043] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T20:34:02.042300] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T20:34:02.502424] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-01T20:34:03.302396] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-01T20:34:03.508528] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T20:34:03.730864] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-01T20:34:04.102386] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-01T20:34:04.180358] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T20:34:04.902380] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-01T20:34:05.492743] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T20:34:05.702362] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-01T20:34:06.040293] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T20:34:06.502396] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-01T20:34:07.302357] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-01T20:34:07.424590] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T20:34:07.572481] [DEBUG] [REMOTE ] NOW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:07.572886] [WARN ] [REMOTE ] NOW: No data returned for month 2025-10 [2025-10-01T20:34:07.572978] [FATAL] [REMOTE ] NOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:07.573073] [FATAL] [MAIN ] NOW: Failed to fetch primary data. [2025-10-01T20:34:07.573159] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:07.573243] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-01T20:34:07.573323] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-01T20:34:07.573375] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-01T20:34:07.573916] [DEBUG] [LOCAL ] NOW: Deleted derivative data file. [2025-10-01T20:34:07.574024] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOW took 27.2s. Estimated remaining: 2h 0m 31s. Rate: 7.1 symbols/min [2025-10-01T20:34:08.102413] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-01T20:34:08.345077] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T20:34:08.902374] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-01T20:34:09.702370] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-01T20:34:10.085810] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-01T20:34:10.369025] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T20:34:10.502467] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-01T20:34:10.906495] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T20:34:11.302417] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-01T20:34:12.102356] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-01T20:34:12.268815] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T20:34:12.400795] [DEBUG] [REMOTE ] NOV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:12.401147] [WARN ] [REMOTE ] NOV: No data returned for month 2025-10 [2025-10-01T20:34:12.401237] [FATAL] [REMOTE ] NOV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:12.401326] [FATAL] [MAIN ] NOV: Failed to fetch primary data. [2025-10-01T20:34:12.401416] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:12.401518] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-01T20:34:12.401593] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-01T20:34:12.401629] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-01T20:34:12.402133] [DEBUG] [LOCAL ] NOV: Deleted derivative data file. [2025-10-01T20:34:12.402234] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NOV took 34.8s. Estimated remaining: 2h 0m 20s. Rate: 7.1 symbols/min [2025-10-01T20:34:12.902384] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-01T20:34:13.020007] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T20:34:13.702380] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-01T20:34:14.465405] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T20:34:14.502394] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-01T20:34:14.698715] [DEBUG] [REMOTE ] NOTE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:14.699068] [WARN ] [REMOTE ] NOTE: No data returned for month 2025-10 [2025-10-01T20:34:14.699165] [FATAL] [REMOTE ] NOTE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:14.699248] [FATAL] [MAIN ] NOTE: Failed to fetch primary data. [2025-10-01T20:34:14.699311] [WARN ] [MAIN ] NOTE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:14.699361] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-01T20:34:14.699454] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-01T20:34:14.699512] [INFO ] [LOCAL ] NOTE: Starting deletion of derivative data. [2025-10-01T20:34:14.699886] [DEBUG] [LOCAL ] NOTE: Deleted derivative data file. [2025-10-01T20:34:14.699974] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NOTE took 39.9s. Estimated remaining: 2h 0m 8s. Rate: 7.1 symbols/min [2025-10-01T20:34:15.029726] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T20:34:15.302395] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-01T20:34:16.307443] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T20:34:16.311231] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-01T20:34:17.054053] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T20:34:17.058367] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-01T20:34:17.265921] [DEBUG] [REMOTE ] NPCT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:17.266309] [WARN ] [REMOTE ] NPCT: No data returned for month 2025-10 [2025-10-01T20:34:17.266425] [FATAL] [REMOTE ] NPCT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:17.266515] [FATAL] [MAIN ] NPCT: Failed to fetch primary data. [2025-10-01T20:34:17.266580] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:17.266690] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-01T20:34:17.266765] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-01T20:34:17.266827] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-01T20:34:17.267176] [DEBUG] [LOCAL ] NPCT: Deleted derivative data file. [2025-10-01T20:34:17.267272] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NPCT took 23.2s. Estimated remaining: 1h 59m 56s. Rate: 7.1 symbols/min [2025-10-01T20:34:18.037027] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:18.035048] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:18.044567] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:18.044733] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-01T20:34:18.060793] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-01T20:34:18.086180] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-01T20:34:18.101947] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-01T20:34:18.106426] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-01T20:34:18.126221] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-01T20:34:18.135116] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:18.141067] [DEBUG] [LOCAL ] NPFD: Loaded 9812 existing records from primary storage. [2025-10-01T20:34:18.149058] [INFO ] [MAIN ] NPFD: Loaded 9812 existing records. [2025-10-01T20:34:18.238127] [DEBUG] [LOCAL ] NPK: Loaded 8008 existing records from primary storage. [2025-10-01T20:34:18.297567] [INFO ] [MAIN ] NPK: Loaded 8008 existing records. [2025-10-01T20:34:18.564343] [DEBUG] [LOCAL ] NPO: Loaded 12939 existing records from primary storage. [2025-10-01T20:34:18.654461] [INFO ] [MAIN ] NPO: Loaded 12939 existing records. [2025-10-01T20:34:18.690011] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:34:18.764822] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-01T20:34:18.819048] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-01T20:34:18.883294] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-01T20:34:18.907201] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-01T20:34:19.215973] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:34:19.270595] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:34:19.261141] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-01T20:34:19.335610] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-01T20:34:19.360930] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-01T20:34:19.373732] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-01T20:34:19.377593] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-01T20:34:19.400728] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-01T20:34:19.416239] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-01T20:34:19.448535] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-01T20:34:19.443225] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:19.545380] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-01T20:34:20.216106] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:20.302288] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-01T20:34:20.479117] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:20.494872] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-01T20:34:20.555226] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:20.555774] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-01T20:34:20.789142] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T20:34:20.902385] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-01T20:34:21.419157] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T20:34:21.485730] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T20:34:21.526508] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T20:34:21.702388] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-01T20:34:22.221017] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T20:34:22.502379] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-01T20:34:22.625122] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T20:34:23.302383] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-01T20:34:23.886527] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T20:34:24.102354] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-01T20:34:24.236501] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T20:34:24.902409] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-01T20:34:24.918670] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T20:34:25.702403] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-01T20:34:26.370733] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T20:34:26.502351] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-01T20:34:26.661928] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T20:34:27.302395] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-01T20:34:28.031909] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T20:34:28.102358] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-01T20:34:28.230179] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T20:34:28.902358] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-01T20:34:29.006025] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:34:29.702389] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-01T20:34:30.405257] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-01T20:34:30.502369] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-01T20:34:31.302430] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-01T20:34:32.102374] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-01T20:34:32.121541] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T20:34:32.227286] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T20:34:32.679752] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (3.78 seconds). [2025-10-01T20:34:32.902384] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-01T20:34:33.166920] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T20:34:33.702397] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-01T20:34:34.474350] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T20:34:34.502413] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-01T20:34:34.849854] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T20:34:35.119132] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-01T20:34:35.302389] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-01T20:34:36.028168] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-01T20:34:36.102377] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-01T20:34:36.902367] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-01T20:34:36.927269] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T20:34:37.702380] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-01T20:34:38.502394] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-01T20:34:38.673123] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T20:34:39.072546] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T20:34:39.302363] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-01T20:34:39.346542] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T20:34:40.102375] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-01T20:34:40.902398] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-01T20:34:40.947556] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T20:34:41.147090] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T20:34:41.617552] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T20:34:41.702382] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-01T20:34:42.502408] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-01T20:34:42.612495] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T20:34:43.247548] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T20:34:43.302391] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-01T20:34:44.102375] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-01T20:34:44.136464] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T20:34:44.902424] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-01T20:34:45.524483] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T20:34:45.702403] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-01T20:34:45.884840] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T20:34:46.502401] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-01T20:34:46.637446] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T20:34:47.302394] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-01T20:34:47.487055] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T20:34:47.579893] [DEBUG] [REMOTE ] NPFD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:47.580388] [WARN ] [REMOTE ] NPFD: No data returned for month 2025-10 [2025-10-01T20:34:47.580495] [FATAL] [REMOTE ] NPFD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:47.580677] [FATAL] [MAIN ] NPFD: Failed to fetch primary data. [2025-10-01T20:34:47.580771] [WARN ] [MAIN ] NPFD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:47.580874] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-01T20:34:47.581183] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-01T20:34:47.581419] [INFO ] [LOCAL ] NPFD: Starting deletion of derivative data. [2025-10-01T20:34:47.581861] [DEBUG] [LOCAL ] NPFD: Deleted derivative data file. [2025-10-01T20:34:47.581999] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPFD took 30.3s. Estimated remaining: 2h 0m 0s. Rate: 7.1 symbols/min [2025-10-01T20:34:47.772352] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:47.781045] [DEBUG] [LOCAL ] NPV: Loaded 5075 existing records from primary storage. [2025-10-01T20:34:47.781316] [INFO ] [MAIN ] NPV: Loaded 5075 existing records. [2025-10-01T20:34:47.985129] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:34:47.985373] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-01T20:34:47.985423] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-01T20:34:47.985615] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-01T20:34:47.985715] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-01T20:34:48.107567] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-01T20:34:48.377744] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:48.902447] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-01T20:34:48.996312] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T20:34:49.246590] [DEBUG] [REMOTE ] NPKI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:49.247113] [WARN ] [REMOTE ] NPKI: No data returned for month 2025-10 [2025-10-01T20:34:49.247213] [FATAL] [REMOTE ] NPKI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:49.247342] [FATAL] [MAIN ] NPKI: Failed to fetch primary data. [2025-10-01T20:34:49.247426] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:49.247521] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-01T20:34:49.247620] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-01T20:34:49.247706] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-01T20:34:49.247763] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-01T20:34:49.247850] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPKI took 32.0s. Estimated remaining: 1h 59m 48s. Rate: 7.1 symbols/min [2025-10-01T20:34:49.437820] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:49.484753] [DEBUG] [LOCAL ] NPWR: Loaded 42966 existing records from primary storage. [2025-10-01T20:34:49.485177] [INFO ] [MAIN ] NPWR: Loaded 42966 existing records. [2025-10-01T20:34:49.700807] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:34:49.701186] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-01T20:34:49.701255] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-01T20:34:49.702076] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-01T20:34:49.702142] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-01T20:34:49.707472] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-01T20:34:50.088239] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:50.502371] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-01T20:34:50.725434] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T20:34:51.247163] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T20:34:51.302438] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-01T20:34:52.102389] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-01T20:34:52.808102] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T20:34:52.862832] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T20:34:52.902397] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-01T20:34:53.702409] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-01T20:34:53.989249] [DEBUG] [REMOTE ] NPK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:53.989675] [WARN ] [REMOTE ] NPK: No data returned for month 2025-10 [2025-10-01T20:34:53.989785] [FATAL] [REMOTE ] NPK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:53.989990] [FATAL] [MAIN ] NPK: Failed to fetch primary data. [2025-10-01T20:34:53.990081] [WARN ] [MAIN ] NPK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:53.990172] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-01T20:34:53.990243] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-01T20:34:53.990284] [INFO ] [LOCAL ] NPK: Starting deletion of derivative data. [2025-10-01T20:34:53.990815] [DEBUG] [LOCAL ] NPK: Deleted derivative data file. [2025-10-01T20:34:53.990947] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPK took 36.7s. Estimated remaining: 1h 59m 37s. Rate: 7.1 symbols/min [2025-10-01T20:34:54.190458] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:54.202515] [DEBUG] [LOCAL ] NQP: Loaded 9297 existing records from primary storage. [2025-10-01T20:34:54.202972] [INFO ] [MAIN ] NQP: Loaded 9297 existing records. [2025-10-01T20:34:54.401518] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:34:54.402021] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-01T20:34:54.402089] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-01T20:34:54.402458] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-01T20:34:54.410122] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-01T20:34:54.493245] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T20:34:54.523081] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-01T20:34:54.835763] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:55.302370] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-01T20:34:55.608797] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T20:34:56.029259] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-01T20:34:56.102390] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-01T20:34:56.902386] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-01T20:34:57.088146] [DEBUG] [REMOTE ] NPO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:34:57.088504] [WARN ] [REMOTE ] NPO: No data returned for month 2025-10 [2025-10-01T20:34:57.088749] [FATAL] [REMOTE ] NPO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:34:57.088954] [FATAL] [MAIN ] NPO: Failed to fetch primary data. [2025-10-01T20:34:57.089106] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:34:57.089203] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-01T20:34:57.089302] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-01T20:34:57.089387] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-01T20:34:57.089991] [DEBUG] [LOCAL ] NPO: Deleted derivative data file. [2025-10-01T20:34:57.090156] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPO took 39.8s. Estimated remaining: 1h 59m 26s. Rate: 7.1 symbols/min [2025-10-01T20:34:57.218738] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T20:34:57.295714] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:34:57.330797] [DEBUG] [LOCAL ] NRDY: Loaded 32735 existing records from primary storage. [2025-10-01T20:34:57.331059] [INFO ] [MAIN ] NRDY: Loaded 32735 existing records. [2025-10-01T20:34:57.521892] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:34:57.522159] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-01T20:34:57.522241] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-01T20:34:57.522852] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-01T20:34:57.522916] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-01T20:34:57.710871] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-01T20:34:57.917237] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:34:58.502355] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-01T20:34:58.583842] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T20:34:59.147480] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T20:34:59.302394] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-01T20:34:59.985031] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T20:35:00.102426] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-01T20:35:00.902436] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-01T20:35:01.450515] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T20:35:01.702414] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-01T20:35:02.282842] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T20:35:02.502390] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-01T20:35:02.958587] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T20:35:03.302405] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-01T20:35:03.811939] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T20:35:03.832323] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-01T20:35:04.102430] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-01T20:35:04.809072] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T20:35:04.902396] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-01T20:35:05.702430] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-01T20:35:06.462299] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T20:35:06.502406] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-01T20:35:06.724387] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T20:35:07.169425] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T20:35:07.302383] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-01T20:35:08.102396] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-01T20:35:08.215632] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-01T20:35:08.902399] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-01T20:35:09.533912] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T20:35:09.702381] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-01T20:35:09.784583] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T20:35:10.502425] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-01T20:35:11.165302] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-01T20:35:11.245195] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T20:35:11.302392] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-01T20:35:12.102393] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-01T20:35:12.158336] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T20:35:12.902413] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-01T20:35:13.135009] [DEBUG] [REMOTE ] NPV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:35:13.135353] [WARN ] [REMOTE ] NPV: No data returned for month 2025-10 [2025-10-01T20:35:13.135449] [FATAL] [REMOTE ] NPV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:35:13.135575] [FATAL] [MAIN ] NPV: Failed to fetch primary data. [2025-10-01T20:35:13.135679] [WARN ] [MAIN ] NPV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:35:13.135756] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-01T20:35:13.135826] [DEBUG] [LOCAL ] NPV: No primary data file found to delete. [2025-10-01T20:35:13.135864] [INFO ] [LOCAL ] NPV: Starting deletion of derivative data. [2025-10-01T20:35:13.136281] [DEBUG] [LOCAL ] NPV: Deleted derivative data file. [2025-10-01T20:35:13.136371] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NPV took 25.6s. Estimated remaining: 1h 59m 22s. Rate: 7.1 symbols/min [2025-10-01T20:35:13.328547] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:35:13.340955] [DEBUG] [LOCAL ] NREF: Loaded 7881 existing records from primary storage. [2025-10-01T20:35:13.341195] [INFO ] [MAIN ] NREF: Loaded 7881 existing records. [2025-10-01T20:35:13.546872] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:35:13.547116] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-01T20:35:13.547166] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-01T20:35:13.547400] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-01T20:35:13.547465] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-01T20:35:13.707549] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-01T20:35:13.960606] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:35:13.990344] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T20:35:14.407212] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T20:35:14.502417] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-01T20:35:15.302400] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-01T20:35:15.506993] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T20:35:16.102412] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-01T20:35:16.902366] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-01T20:35:16.938057] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T20:35:16.993504] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T20:35:17.702389] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-01T20:35:17.755243] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T20:35:18.502406] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-01T20:35:18.909394] [DEBUG] [REMOTE ] NQP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:35:18.909817] [WARN ] [REMOTE ] NQP: No data returned for month 2025-10 [2025-10-01T20:35:18.909936] [FATAL] [REMOTE ] NQP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:35:18.910046] [FATAL] [MAIN ] NQP: Failed to fetch primary data. [2025-10-01T20:35:18.910134] [WARN ] [MAIN ] NQP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:35:18.910233] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-01T20:35:18.910331] [DEBUG] [LOCAL ] NQP: No primary data file found to delete. [2025-10-01T20:35:18.910386] [INFO ] [LOCAL ] NQP: Starting deletion of derivative data. [2025-10-01T20:35:18.910902] [DEBUG] [LOCAL ] NQP: Deleted derivative data file. [2025-10-01T20:35:18.911040] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NQP took 24.9s. Estimated remaining: 1h 59m 12s. Rate: 7.1 symbols/min [2025-10-01T20:35:19.128070] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:35:19.128359] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-01T20:35:19.128602] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-01T20:35:19.128795] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-01T20:35:19.148050] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-01T20:35:19.150608] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-01T20:35:19.152410] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T20:35:19.151271] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-01T20:35:19.307507] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-01T20:35:19.615152] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:35:20.102398] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-01T20:35:20.832768] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T20:35:20.872145] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T20:35:20.902385] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-01T20:35:21.600404] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T20:35:21.702401] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-01T20:35:22.502363] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-01T20:35:22.572824] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T20:35:23.302412] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-01T20:35:24.006802] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T20:35:24.102413] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-01T20:35:24.267713] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T20:35:24.902415] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-01T20:35:25.026132] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T20:35:25.702391] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-01T20:35:26.502387] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-01T20:35:26.611277] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T20:35:26.671856] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T20:35:27.297349] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T20:35:27.302326] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-01T20:35:28.102414] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-01T20:35:28.160590] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T20:35:28.902381] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-01T20:35:29.702366] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-01T20:35:29.900584] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T20:35:30.149953] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-01T20:35:30.502366] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-01T20:35:30.545786] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T20:35:31.093233] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-01T20:35:31.302426] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-01T20:35:32.102387] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-01T20:35:32.119083] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T20:35:32.902390] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-01T20:35:33.611027] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T20:35:33.702378] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-01T20:35:34.502381] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-01T20:35:34.606085] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T20:35:34.720585] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T20:35:35.302378] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-01T20:35:35.885042] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T20:35:36.102383] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-01T20:35:36.746726] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T20:35:36.902363] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-01T20:35:36.960107] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T20:35:37.496105] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T20:35:37.702378] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-01T20:35:38.457974] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T20:35:38.502366] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-01T20:35:39.302378] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-01T20:35:39.538460] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T20:35:40.102431] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-01T20:35:40.902375] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-01T20:35:41.059386] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T20:35:41.095269] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-01T20:35:41.702437] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-01T20:35:41.875770] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T20:35:41.959017] [DEBUG] [REMOTE ] NREF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:35:41.959395] [WARN ] [REMOTE ] NREF: No data returned for month 2025-10 [2025-10-01T20:35:41.959504] [FATAL] [REMOTE ] NREF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:35:41.959614] [FATAL] [MAIN ] NREF: Failed to fetch primary data. [2025-10-01T20:35:41.959753] [WARN ] [MAIN ] NREF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:35:41.959838] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-01T20:35:41.959959] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-01T20:35:41.960020] [INFO ] [LOCAL ] NREF: Starting deletion of derivative data. [2025-10-01T20:35:41.960424] [DEBUG] [LOCAL ] NREF: Deleted derivative data file. [2025-10-01T20:35:41.960537] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NREF took 28.8s. Estimated remaining: 1h 59m 11s. Rate: 7.1 symbols/min [2025-10-01T20:35:42.181026] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:35:42.181258] [DEBUG] [LOCAL ] NRGV: No existing data file found in primary storage. [2025-10-01T20:35:42.181332] [WARN ] [MAIN ] NRGV: No existing data found, performing full refresh instead. [2025-10-01T20:35:42.181482] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-01T20:35:42.181530] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-01T20:35:42.181575] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-01T20:35:42.181625] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-01T20:35:42.507469] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-01T20:35:42.600175] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:35:42.856500] [DEBUG] [REMOTE ] NRDY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:35:42.856931] [WARN ] [REMOTE ] NRDY: No data returned for month 2025-10 [2025-10-01T20:35:42.857024] [FATAL] [REMOTE ] NRDY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:35:42.857115] [FATAL] [MAIN ] NRDY: Failed to fetch primary data. [2025-10-01T20:35:42.857154] [WARN ] [MAIN ] NRDY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:35:42.857224] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-01T20:35:42.857290] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-01T20:35:42.857326] [INFO ] [LOCAL ] NRDY: Starting deletion of derivative data. [2025-10-01T20:35:42.857873] [DEBUG] [LOCAL ] NRDY: Deleted derivative data file. [2025-10-01T20:35:42.857969] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NRDY took 45.8s. Estimated remaining: 1h 58m 59s. Rate: 7.1 symbols/min [2025-10-01T20:35:43.058285] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:35:43.079939] [DEBUG] [LOCAL ] NRK: Loaded 19922 existing records from primary storage. [2025-10-01T20:35:43.080280] [INFO ] [MAIN ] NRK: Loaded 19922 existing records. [2025-10-01T20:35:43.289518] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:35:43.289852] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-01T20:35:43.289949] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-01T20:35:43.290454] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-01T20:35:43.290516] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-01T20:35:43.307751] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-01T20:35:43.700392] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:35:44.102428] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-01T20:35:44.410392] [DEBUG] [REMOTE ] NPWR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:35:44.410809] [WARN ] [REMOTE ] NPWR: No data returned for month 2025-10 [2025-10-01T20:35:44.410904] [FATAL] [REMOTE ] NPWR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:35:44.410993] [FATAL] [MAIN ] NPWR: Failed to fetch primary data. [2025-10-01T20:35:44.411059] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:35:44.411132] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-01T20:35:44.411199] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-01T20:35:44.411238] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-01T20:35:44.411540] [DEBUG] [LOCAL ] NPWR: Deleted derivative data file. [2025-10-01T20:35:44.411630] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NPWR took 55.2s. Estimated remaining: 1h 58m 46s. Rate: 7.1 symbols/min [2025-10-01T20:35:44.650100] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:35:44.657373] [DEBUG] [LOCAL ] NRP: Loaded 4059 existing records from primary storage. [2025-10-01T20:35:44.657611] [INFO ] [MAIN ] NRP: Loaded 4059 existing records. [2025-10-01T20:35:44.860969] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:35:44.861395] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-01T20:35:44.861470] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-01T20:35:44.861895] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-01T20:35:44.861959] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-01T20:35:44.913152] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-01T20:35:45.282919] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:35:45.304675] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-01T20:35:45.702382] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-01T20:35:45.887099] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T20:35:46.502413] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-01T20:35:46.945424] [DEBUG] [REMOTE ] NRG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:35:46.945788] [WARN ] [REMOTE ] NRG: No data returned for month 2025-10 [2025-10-01T20:35:46.945878] [FATAL] [REMOTE ] NRG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:35:46.945989] [FATAL] [MAIN ] NRG: Failed to fetch primary data. [2025-10-01T20:35:46.946057] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:35:46.946130] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-01T20:35:46.946215] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-01T20:35:46.946272] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-01T20:35:46.946343] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-01T20:35:46.946403] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRG took 28.0s. Estimated remaining: 1h 58m 35s. Rate: 7.1 symbols/min [2025-10-01T20:35:47.138732] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:35:47.174155] [DEBUG] [LOCAL ] NRT: Loaded 4961 existing records from primary storage. [2025-10-01T20:35:47.175937] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T20:35:47.176342] [INFO ] [MAIN ] NRT: Loaded 4961 existing records. [2025-10-01T20:35:47.302478] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-01T20:35:47.393825] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:35:47.394118] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-01T20:35:47.394170] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-01T20:35:47.394358] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-01T20:35:47.394419] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-01T20:35:47.782342] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:35:48.102443] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-01T20:35:48.852934] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T20:35:48.902410] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-01T20:35:49.483113] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T20:35:49.702392] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-01T20:35:49.743907] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T20:35:50.502371] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-01T20:35:50.855817] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T20:35:51.302368] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-01T20:35:51.360122] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T20:35:52.102345] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-01T20:35:52.144863] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T20:35:52.790284] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T20:35:52.902404] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-01T20:35:53.603136] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-01T20:35:53.702380] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-01T20:35:54.411490] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T20:35:54.502369] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-01T20:35:55.139409] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-01T20:35:55.302412] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-01T20:35:56.102386] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-01T20:35:56.854960] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T20:35:56.902391] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-01T20:35:57.051000] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T20:35:57.641428] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T20:35:57.702424] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-01T20:35:58.502404] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-01T20:35:58.723982] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T20:35:59.190093] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T20:35:59.302414] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-01T20:35:59.995145] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T20:36:00.102410] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-01T20:36:00.792169] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T20:36:00.902379] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-01T20:36:01.498521] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T20:36:01.702396] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-01T20:36:02.502382] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-01T20:36:03.302353] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-01T20:36:03.501000] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T20:36:03.588120] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T20:36:03.975936] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T20:36:04.102415] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-01T20:36:04.902373] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-01T20:36:05.195713] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T20:36:05.702390] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-01T20:36:06.368464] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T20:36:06.502392] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-01T20:36:06.641415] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T20:36:07.036408] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T20:36:07.302411] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-01T20:36:08.102411] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-01T20:36:08.877005] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T20:36:08.908196] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-01T20:36:08.950400] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T20:36:09.702416] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-01T20:36:10.198329] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T20:36:10.256513] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T20:36:10.502376] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-01T20:36:11.063880] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-01T20:36:11.302428] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-01T20:36:11.999319] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T20:36:12.102388] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-01T20:36:12.902405] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-01T20:36:13.277114] [DEBUG] [REMOTE ] NRP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:36:13.277440] [WARN ] [REMOTE ] NRP: No data returned for month 2025-10 [2025-10-01T20:36:13.277547] [FATAL] [REMOTE ] NRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:36:13.277666] [FATAL] [MAIN ] NRP: Failed to fetch primary data. [2025-10-01T20:36:13.277737] [WARN ] [MAIN ] NRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:36:13.277866] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-01T20:36:13.277966] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-01T20:36:13.278023] [INFO ] [LOCAL ] NRP: Starting deletion of derivative data. [2025-10-01T20:36:13.278377] [DEBUG] [LOCAL ] NRP: Deleted derivative data file. [2025-10-01T20:36:13.278527] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRP took 28.9s. Estimated remaining: 1h 58m 36s. Rate: 7.1 symbols/min [2025-10-01T20:36:13.467291] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T20:36:13.486589] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:36:13.498574] [DEBUG] [LOCAL ] NRUC: Loaded 3096 existing records from primary storage. [2025-10-01T20:36:13.498836] [INFO ] [MAIN ] NRUC: Loaded 3096 existing records. [2025-10-01T20:36:13.689528] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:36:13.689786] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-01T20:36:13.689844] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-01T20:36:13.690083] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-01T20:36:13.690144] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-01T20:36:13.711330] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-01T20:36:14.089304] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:36:14.502376] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-01T20:36:14.943331] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T20:36:15.154677] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-01T20:36:15.302416] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-01T20:36:15.961222] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-01T20:36:16.102408] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-01T20:36:16.795112] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T20:36:16.902414] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-01T20:36:17.576760] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-01T20:36:17.702416] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-01T20:36:18.375847] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-01T20:36:18.502400] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-01T20:36:19.198928] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T20:36:19.302402] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-01T20:36:20.036485] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T20:36:20.102411] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-01T20:36:20.386561] [DEBUG] [REMOTE ] NRK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:36:20.386921] [WARN ] [REMOTE ] NRK: No data returned for month 2025-10 [2025-10-01T20:36:20.387010] [FATAL] [REMOTE ] NRK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:36:20.387129] [FATAL] [MAIN ] NRK: Failed to fetch primary data. [2025-10-01T20:36:20.387205] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:36:20.387281] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-01T20:36:20.387348] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-01T20:36:20.387387] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-10-01T20:36:20.387865] [DEBUG] [LOCAL ] NRK: Deleted derivative data file. [2025-10-01T20:36:20.388043] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRK took 37.5s. Estimated remaining: 1h 58m 27s. Rate: 7.1 symbols/min [2025-10-01T20:36:20.583247] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:36:20.635779] [DEBUG] [LOCAL ] NSA: Loaded 44689 existing records from primary storage. [2025-10-01T20:36:20.636119] [INFO ] [MAIN ] NSA: Loaded 44689 existing records. [2025-10-01T20:36:20.849174] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:36:20.850000] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-01T20:36:20.850062] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-01T20:36:20.850919] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-10-01T20:36:20.850981] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-01T20:36:20.912006] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-01T20:36:21.263835] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:36:21.702430] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-01T20:36:22.502351] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-01T20:36:22.612959] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T20:36:23.123625] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-01T20:36:23.302407] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-01T20:36:23.352488] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T20:36:23.521618] [DEBUG] [REMOTE ] NRT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:36:23.522047] [WARN ] [REMOTE ] NRT: No data returned for month 2025-10 [2025-10-01T20:36:23.522143] [FATAL] [REMOTE ] NRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:36:23.522291] [FATAL] [MAIN ] NRT: Failed to fetch primary data. [2025-10-01T20:36:23.522374] [WARN ] [MAIN ] NRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:36:23.522464] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-01T20:36:23.522547] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-01T20:36:23.522681] [INFO ] [LOCAL ] NRT: Starting deletion of derivative data. [2025-10-01T20:36:23.523167] [DEBUG] [LOCAL ] NRT: Deleted derivative data file. [2025-10-01T20:36:23.523273] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRT took 36.6s. Estimated remaining: 1h 58m 15s. Rate: 7.1 symbols/min [2025-10-01T20:36:23.706752] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:36:23.706970] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-01T20:36:23.707026] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-01T20:36:23.707136] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-01T20:36:23.707178] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-01T20:36:23.707219] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-01T20:36:23.707252] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-01T20:36:24.103320] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-01T20:36:24.103198] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:36:24.497559] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-01T20:36:24.902380] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-01T20:36:25.702357] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-01T20:36:25.973829] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T20:36:26.502374] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-01T20:36:27.085197] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T20:36:27.214439] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T20:36:27.302384] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-01T20:36:28.102357] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-01T20:36:28.215560] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T20:36:28.665633] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-01T20:36:28.902390] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-01T20:36:29.702395] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-01T20:36:29.826229] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T20:36:30.502379] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-01T20:36:31.127867] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T20:36:31.302387] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-01T20:36:32.052894] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T20:36:32.102355] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-01T20:36:32.902393] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-01T20:36:33.185456] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T20:36:33.398438] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T20:36:33.422670] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-01T20:36:33.702382] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-01T20:36:34.123011] [DEBUG] [REMOTE ] NRGV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:36:34.123415] [WARN ] [REMOTE ] NRGV: No data returned for month 2025-10 [2025-10-01T20:36:34.123508] [FATAL] [REMOTE ] NRGV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:36:34.123591] [FATAL] [MAIN ] NRGV: Failed to fetch primary data. [2025-10-01T20:36:34.123678] [WARN ] [MAIN ] NRGV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:36:34.123750] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-01T20:36:34.123815] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-01T20:36:34.123852] [INFO ] [LOCAL ] NRGV: Starting deletion of derivative data. [2025-10-01T20:36:34.123892] [DEBUG] [LOCAL ] NRGV: No derivative data file found to delete. [2025-10-01T20:36:34.123939] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRGV took 52.2s. Estimated remaining: 1h 58m 8s. Rate: 7.1 symbols/min [2025-10-01T20:36:34.332741] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:36:34.372869] [DEBUG] [LOCAL ] NSP: Loaded 34943 existing records from primary storage. [2025-10-01T20:36:34.373158] [INFO ] [MAIN ] NSP: Loaded 34943 existing records. [2025-10-01T20:36:34.507477] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-01T20:36:34.579079] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:36:34.579427] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-01T20:36:34.579485] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-01T20:36:34.579750] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-10-01T20:36:34.579811] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-01T20:36:34.787419] [DEBUG] [REMOTE ] NRUC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:36:34.852105] [WARN ] [REMOTE ] NRUC: No data returned for month 2025-10 [2025-10-01T20:36:34.870369] [FATAL] [REMOTE ] NRUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:36:34.896438] [FATAL] [MAIN ] NRUC: Failed to fetch primary data. [2025-10-01T20:36:34.896577] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:36:34.896987] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-01T20:36:34.902439] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-01T20:36:34.912724] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-01T20:36:34.928322] [DEBUG] [LOCAL ] NRUC: Deleted derivative data file. [2025-10-01T20:36:34.940038] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NRUC took 21.7s. Estimated remaining: 1h 57m 56s. Rate: 7.1 symbols/min [2025-10-01T20:36:35.097193] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:36:35.170384] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:36:35.194370] [DEBUG] [LOCAL ] NTB: Loaded 20264 existing records from primary storage. [2025-10-01T20:36:35.194620] [INFO ] [MAIN ] NTB: Loaded 20264 existing records. [2025-10-01T20:36:35.307464] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-01T20:36:35.397892] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:36:35.398121] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-01T20:36:35.398173] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-01T20:36:35.398431] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-01T20:36:35.398495] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-01T20:36:35.791695] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:36:36.102374] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-01T20:36:36.825335] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T20:36:36.902376] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-01T20:36:37.000552] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:36:37.702391] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-01T20:36:38.226853] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T20:36:38.502377] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-01T20:36:39.131315] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T20:36:39.302398] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-01T20:36:39.467244] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T20:36:40.102429] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-01T20:36:40.731905] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T20:36:40.902380] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-01T20:36:41.348857] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T20:36:41.702383] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-01T20:36:42.502353] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-01T20:36:42.587714] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T20:36:42.694323] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T20:36:43.302388] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-01T20:36:43.719530] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T20:36:44.102369] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-01T20:36:44.492115] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T20:36:44.902426] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-01T20:36:45.702392] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-01T20:36:45.762384] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T20:36:46.419090] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T20:36:46.502362] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-01T20:36:46.591966] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T20:36:47.302377] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-01T20:36:47.748704] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T20:36:48.102390] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-01T20:36:48.193482] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-01T20:36:48.902394] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-01T20:36:49.699787] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T20:36:49.708528] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-01T20:36:50.502375] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-01T20:36:50.534064] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T20:36:50.792193] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T20:36:51.302394] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-01T20:36:51.391577] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T20:36:52.102349] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-01T20:36:52.516596] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T20:36:52.902367] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-01T20:36:53.001228] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T20:36:53.702348] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-01T20:36:54.021476] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T20:36:54.502370] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-01T20:36:54.794316] [DEBUG] [REMOTE ] NSC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:36:54.794635] [WARN ] [REMOTE ] NSC: No data returned for month 2025-10 [2025-10-01T20:36:54.794749] [FATAL] [REMOTE ] NSC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:36:54.794841] [FATAL] [MAIN ] NSC: Failed to fetch primary data. [2025-10-01T20:36:54.794902] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:36:54.795012] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-01T20:36:54.795087] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-01T20:36:54.795125] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-01T20:36:54.795165] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-01T20:36:54.795210] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSC took 31.3s. Estimated remaining: 1h 57m 53s. Rate: 7.1 symbols/min [2025-10-01T20:36:54.979336] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:36:54.979799] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-01T20:36:54.979853] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-01T20:36:54.979973] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-01T20:36:54.980015] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-01T20:36:54.980056] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-01T20:36:54.980091] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-01T20:36:55.302377] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-01T20:36:55.384504] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:36:55.412313] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T20:36:56.102432] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-01T20:36:56.362609] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T20:36:56.761263] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T20:36:56.902422] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-01T20:36:57.702393] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-01T20:36:58.331759] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T20:36:58.502376] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-01T20:36:58.784147] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T20:36:58.993363] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T20:36:59.302405] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-01T20:37:00.102450] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-01T20:37:00.902373] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-01T20:37:01.034379] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T20:37:01.458439] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T20:37:01.702450] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-01T20:37:01.865837] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T20:37:02.389837] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T20:37:02.502378] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-01T20:37:03.302586] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-01T20:37:03.704319] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T20:37:04.102427] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-01T20:37:04.705613] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T20:37:04.902384] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-01T20:37:05.302593] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T20:37:05.702363] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-01T20:37:05.740080] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T20:37:05.965593] [DEBUG] [REMOTE ] NSA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:05.965921] [WARN ] [REMOTE ] NSA: No data returned for month 2025-10 [2025-10-01T20:37:05.966038] [FATAL] [REMOTE ] NSA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:05.966150] [FATAL] [MAIN ] NSA: Failed to fetch primary data. [2025-10-01T20:37:05.966219] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:05.966291] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-01T20:37:05.966358] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-01T20:37:05.966396] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-01T20:37:05.966631] [DEBUG] [LOCAL ] NSA: Deleted derivative data file. [2025-10-01T20:37:05.966754] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSA took 45.6s. Estimated remaining: 1h 57m 46s. Rate: 7.1 symbols/min [2025-10-01T20:37:06.151940] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:06.209870] [DEBUG] [LOCAL ] NTR: Loaded 52573 existing records from primary storage. [2025-10-01T20:37:06.210211] [INFO ] [MAIN ] NTR: Loaded 52573 existing records. [2025-10-01T20:37:06.405598] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:37:06.405830] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-01T20:37:06.405880] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-01T20:37:06.406333] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-01T20:37:06.406395] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-01T20:37:06.507522] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-01T20:37:06.766593] [DEBUG] [REMOTE ] NTB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:06.782586] [WARN ] [REMOTE ] NTB: No data returned for month 2025-10 [2025-10-01T20:37:06.789862] [FATAL] [REMOTE ] NTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:06.811723] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:06.807377] [FATAL] [MAIN ] NTB: Failed to fetch primary data. [2025-10-01T20:37:06.812189] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:06.812315] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-01T20:37:06.812424] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-01T20:37:06.812506] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-01T20:37:06.813033] [DEBUG] [LOCAL ] NTB: Deleted derivative data file. [2025-10-01T20:37:06.813194] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 31.9s. Estimated remaining: 1h 57m 34s. Rate: 7.1 symbols/min [2025-10-01T20:37:07.017492] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:07.067023] [DEBUG] [LOCAL ] NTST: Loaded 43461 existing records from primary storage. [2025-10-01T20:37:07.067324] [INFO ] [MAIN ] NTST: Loaded 43461 existing records. [2025-10-01T20:37:07.260042] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:37:07.260311] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-01T20:37:07.260367] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-01T20:37:07.260624] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-01T20:37:07.260718] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-01T20:37:07.307466] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-01T20:37:07.675756] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:07.812936] [DEBUG] [REMOTE ] NSP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:07.813273] [WARN ] [REMOTE ] NSP: No data returned for month 2025-10 [2025-10-01T20:37:07.813389] [FATAL] [REMOTE ] NSP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:07.813525] [FATAL] [MAIN ] NSP: Failed to fetch primary data. [2025-10-01T20:37:07.813616] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:07.813735] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-01T20:37:07.813815] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-01T20:37:07.813859] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-01T20:37:07.814228] [DEBUG] [LOCAL ] NSP: Deleted derivative data file. [2025-10-01T20:37:07.814344] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NSP took 33.7s. Estimated remaining: 1h 57m 21s. Rate: 7.1 symbols/min [2025-10-01T20:37:08.009348] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:08.073557] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-01T20:37:08.074038] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-10-01T20:37:08.107550] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-01T20:37:08.270888] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:37:08.271089] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-01T20:37:08.271139] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-01T20:37:08.271752] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-10-01T20:37:08.271817] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-01T20:37:08.691342] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:08.902418] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-01T20:37:09.702356] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-01T20:37:10.447529] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-01T20:37:10.502408] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-01T20:37:11.302381] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-01T20:37:11.410733] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-01T20:37:11.484571] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T20:37:11.790932] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-01T20:37:12.102380] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-01T20:37:12.442606] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T20:37:12.902380] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-01T20:37:13.307530] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T20:37:13.702398] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-01T20:37:14.502397] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-01T20:37:15.061399] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T20:37:15.302369] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-01T20:37:15.570977] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-01T20:37:15.671932] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T20:37:16.102375] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-01T20:37:16.538471] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T20:37:16.902392] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-01T20:37:17.702430] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-01T20:37:18.008446] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T20:37:18.296598] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T20:37:18.502380] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-01T20:37:19.302387] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-01T20:37:19.967094] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-01T20:37:20.102405] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-01T20:37:20.191081] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T20:37:20.805436] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T20:37:20.902378] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-01T20:37:21.210956] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T20:37:21.394795] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T20:37:21.702373] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-01T20:37:22.502421] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-01T20:37:22.990828] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T20:37:23.302354] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-01T20:37:23.595047] [DEBUG] [REMOTE ] NTEST: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:23.595421] [WARN ] [REMOTE ] NTEST: No data returned for month 2025-10 [2025-10-01T20:37:23.595511] [FATAL] [REMOTE ] NTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:23.595597] [FATAL] [MAIN ] NTEST: Failed to fetch primary data. [2025-10-01T20:37:23.595687] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:23.595789] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-01T20:37:23.595863] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-01T20:37:23.595933] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-01T20:37:23.596000] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-01T20:37:23.596062] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTEST took 28.8s. Estimated remaining: 1h 57m 17s. Rate: 7.1 symbols/min [2025-10-01T20:37:23.817747] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T20:37:23.851761] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:23.852326] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-01T20:37:23.852501] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-01T20:37:23.852625] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-01T20:37:23.852775] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-01T20:37:23.853120] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-01T20:37:23.853170] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-01T20:37:24.111907] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-01T20:37:24.246626] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:24.902401] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-01T20:37:25.613495] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-01T20:37:25.702382] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-01T20:37:26.244841] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-01T20:37:26.502435] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-01T20:37:26.639842] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T20:37:27.302406] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-01T20:37:28.102365] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-01T20:37:28.229076] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T20:37:28.902360] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-01T20:37:29.023265] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T20:37:29.434625] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-01T20:37:29.702389] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-01T20:37:30.507552] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-01T20:37:30.518515] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T20:37:31.302391] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-01T20:37:32.007793] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-01T20:37:32.102391] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-01T20:37:32.138957] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T20:37:32.902386] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-01T20:37:32.933062] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T20:37:33.702373] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-01T20:37:34.267355] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-01T20:37:34.502375] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-01T20:37:34.825577] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T20:37:35.090612] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T20:37:35.302283] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-01T20:37:35.559696] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-01T20:37:36.102366] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-01T20:37:36.902387] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-01T20:37:37.108741] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T20:37:37.702403] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-01T20:37:37.778959] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T20:37:37.902603] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T20:37:38.502380] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-01T20:37:39.302358] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-01T20:37:39.384945] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T20:37:39.605397] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T20:37:40.102394] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-01T20:37:40.906992] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-01T20:37:40.912833] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T20:37:41.019228] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T20:37:41.702383] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-01T20:37:42.502355] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-01T20:37:42.641274] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T20:37:42.736352] [DEBUG] [REMOTE ] NTST: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:42.736717] [WARN ] [REMOTE ] NTST: No data returned for month 2025-10 [2025-10-01T20:37:42.736811] [FATAL] [REMOTE ] NTST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:42.736893] [FATAL] [MAIN ] NTST: Failed to fetch primary data. [2025-10-01T20:37:42.736966] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:42.737039] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-01T20:37:42.737104] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-01T20:37:42.737142] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-01T20:37:42.737518] [DEBUG] [LOCAL ] NTST: Deleted derivative data file. [2025-10-01T20:37:42.737633] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTST took 35.9s. Estimated remaining: 1h 57m 14s. Rate: 7.1 symbols/min [2025-10-01T20:37:42.933029] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:42.969004] [DEBUG] [LOCAL ] NUS: Loaded 36380 existing records from primary storage. [2025-10-01T20:37:42.980773] [INFO ] [MAIN ] NUS: Loaded 36380 existing records. [2025-10-01T20:37:43.065566] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-01T20:37:43.224523] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:37:43.224799] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-01T20:37:43.224860] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-01T20:37:43.225210] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-10-01T20:37:43.225273] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-01T20:37:43.307552] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-01T20:37:43.613496] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:44.102404] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-01T20:37:44.902401] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-01T20:37:45.602294] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T20:37:45.705716] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-01T20:37:45.709121] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-01T20:37:45.816153] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T20:37:45.947384] [DEBUG] [REMOTE ] NTR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:45.947769] [WARN ] [REMOTE ] NTR: No data returned for month 2025-10 [2025-10-01T20:37:45.947876] [FATAL] [REMOTE ] NTR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:45.947959] [FATAL] [MAIN ] NTR: Failed to fetch primary data. [2025-10-01T20:37:45.948023] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:45.948094] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-01T20:37:45.948173] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-01T20:37:45.948229] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-01T20:37:45.948512] [DEBUG] [LOCAL ] NTR: Deleted derivative data file. [2025-10-01T20:37:45.948601] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NTR took 40.0s. Estimated remaining: 1h 57m 3s. Rate: 7.1 symbols/min [2025-10-01T20:37:46.128515] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:46.151228] [DEBUG] [LOCAL ] NUV: Loaded 23385 existing records from primary storage. [2025-10-01T20:37:46.151517] [INFO ] [MAIN ] NUV: Loaded 23385 existing records. [2025-10-01T20:37:46.353586] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:37:46.353848] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-01T20:37:46.353897] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-01T20:37:46.354132] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-01T20:37:46.354192] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-01T20:37:46.508932] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-01T20:37:46.759222] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:47.302361] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-01T20:37:47.488517] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T20:37:48.102390] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-01T20:37:48.902420] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-01T20:37:49.451591] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T20:37:49.702364] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-01T20:37:49.872734] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-01T20:37:50.236606] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T20:37:50.502393] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-01T20:37:50.828943] [DEBUG] [REMOTE ] NU: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:50.829322] [WARN ] [REMOTE ] NU: No data returned for month 2025-10 [2025-10-01T20:37:50.829488] [FATAL] [REMOTE ] NU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:50.829681] [FATAL] [MAIN ] NU: Failed to fetch primary data. [2025-10-01T20:37:50.829754] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:50.829825] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-01T20:37:50.829910] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-01T20:37:50.829997] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-01T20:37:50.830535] [DEBUG] [LOCAL ] NU: Deleted derivative data file. [2025-10-01T20:37:50.830671] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NU took 43.0s. Estimated remaining: 1h 56m 52s. Rate: 7.1 symbols/min [2025-10-01T20:37:50.962798] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T20:37:51.039103] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:51.092985] [DEBUG] [LOCAL ] NUVB: Loaded 51245 existing records from primary storage. [2025-10-01T20:37:51.093364] [INFO ] [MAIN ] NUVB: Loaded 51245 existing records. [2025-10-01T20:37:51.287127] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:37:51.287339] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-01T20:37:51.287387] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-01T20:37:51.287825] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-01T20:37:51.287886] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-01T20:37:51.310207] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-01T20:37:51.694853] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:52.102422] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-01T20:37:52.369762] [DEBUG] [REMOTE ] NUE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:37:52.370110] [WARN ] [REMOTE ] NUE: No data returned for month 2025-10 [2025-10-01T20:37:52.370200] [FATAL] [REMOTE ] NUE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:37:52.370306] [FATAL] [MAIN ] NUE: Failed to fetch primary data. [2025-10-01T20:37:52.370383] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:37:52.370457] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-01T20:37:52.370522] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-01T20:37:52.370560] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-01T20:37:52.370600] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-01T20:37:52.370699] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUE took 28.8s. Estimated remaining: 1h 56m 40s. Rate: 7.1 symbols/min [2025-10-01T20:37:52.580986] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:37:52.581257] [DEBUG] [LOCAL ] NUW: No existing data file found in primary storage. [2025-10-01T20:37:52.581315] [WARN ] [MAIN ] NUW: No existing data found, performing full refresh instead. [2025-10-01T20:37:52.581427] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-01T20:37:52.581471] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-01T20:37:52.581514] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-01T20:37:52.581549] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-01T20:37:52.904103] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-01T20:37:53.044901] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:37:53.075540] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T20:37:53.702460] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-01T20:37:54.502433] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-01T20:37:54.708973] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-01T20:37:54.844137] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T20:37:55.290625] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T20:37:55.302355] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-01T20:37:56.102398] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-01T20:37:56.144849] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T20:37:56.902377] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-01T20:37:57.700025] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T20:37:57.703136] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-01T20:37:58.483908] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T20:37:58.502331] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-01T20:37:58.940325] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-01T20:37:59.302376] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-01T20:37:59.433214] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T20:38:00.102395] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-01T20:38:00.902376] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-01T20:38:01.219880] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T20:38:01.702395] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-01T20:38:01.771809] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T20:38:01.881325] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T20:38:02.502386] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-01T20:38:02.688727] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T20:38:03.108286] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T20:38:03.302395] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-01T20:38:03.896270] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T20:38:04.102395] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-01T20:38:04.902387] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-01T20:38:05.702373] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-01T20:38:05.935596] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T20:38:06.502363] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-01T20:38:06.536782] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T20:38:06.624785] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T20:38:07.302394] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-01T20:38:07.939948] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-01T20:38:08.102404] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-01T20:38:08.297031] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T20:38:08.549376] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T20:38:08.902413] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-01T20:38:09.702424] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-01T20:38:10.350806] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T20:38:10.502420] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-01T20:38:11.272630] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T20:38:11.302542] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-01T20:38:11.588800] [DEBUG] [REMOTE ] NUW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:38:11.589135] [WARN ] [REMOTE ] NUW: No data returned for month 2025-10 [2025-10-01T20:38:11.589224] [FATAL] [REMOTE ] NUW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:38:11.589349] [FATAL] [MAIN ] NUW: Failed to fetch primary data. [2025-10-01T20:38:11.589417] [WARN ] [MAIN ] NUW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:38:11.589490] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-01T20:38:11.589555] [DEBUG] [LOCAL ] NUW: No primary data file found to delete. [2025-10-01T20:38:11.589592] [INFO ] [LOCAL ] NUW: Starting deletion of derivative data. [2025-10-01T20:38:11.589632] [DEBUG] [LOCAL ] NUW: No derivative data file found to delete. [2025-10-01T20:38:11.589727] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUW took 19.2s. Estimated remaining: 1h 56m 37s. Rate: 7.1 symbols/min [2025-10-01T20:38:11.826595] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:38:11.828637] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T20:38:11.876488] [DEBUG] [LOCAL ] NVG: Loaded 27446 existing records from primary storage. [2025-10-01T20:38:11.876801] [INFO ] [MAIN ] NVG: Loaded 27446 existing records. [2025-10-01T20:38:12.101948] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:38:12.102454] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-01T20:38:12.102275] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-01T20:38:12.102987] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-01T20:38:12.104681] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-01T20:38:12.104747] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-01T20:38:12.506201] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:38:12.902406] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-01T20:38:13.702404] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-01T20:38:14.156451] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-01T20:38:14.263499] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T20:38:14.502417] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-01T20:38:14.788105] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T20:38:15.302390] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-01T20:38:15.583357] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T20:38:16.102396] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-01T20:38:16.802731] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T20:38:16.902445] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-01T20:38:17.702395] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-01T20:38:18.071541] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T20:38:18.258678] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-01T20:38:18.502434] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-01T20:38:18.764218] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T20:38:19.302382] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-01T20:38:20.102436] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-01T20:38:20.375380] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T20:38:20.902352] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-01T20:38:21.007694] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T20:38:21.393705] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T20:38:21.702433] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-01T20:38:22.502388] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-01T20:38:22.911813] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-01T20:38:23.302347] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-01T20:38:23.334517] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T20:38:23.513254] [DEBUG] [REMOTE ] NUVB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:38:23.513578] [WARN ] [REMOTE ] NUVB: No data returned for month 2025-10 [2025-10-01T20:38:23.513709] [FATAL] [REMOTE ] NUVB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:38:23.513816] [FATAL] [MAIN ] NUVB: Failed to fetch primary data. [2025-10-01T20:38:23.513888] [WARN ] [MAIN ] NUVB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:38:23.513968] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-01T20:38:23.514077] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-01T20:38:23.514125] [INFO ] [LOCAL ] NUVB: Starting deletion of derivative data. [2025-10-01T20:38:23.514705] [DEBUG] [LOCAL ] NUVB: Deleted derivative data file. [2025-10-01T20:38:23.514807] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUVB took 32.7s. Estimated remaining: 1h 56m 31s. Rate: 7.1 symbols/min [2025-10-01T20:38:23.716828] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:38:23.729373] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T20:38:23.766855] [DEBUG] [LOCAL ] NVGS: Loaded 30770 existing records from primary storage. [2025-10-01T20:38:23.767125] [INFO ] [MAIN ] NVGS: Loaded 30770 existing records. [2025-10-01T20:38:23.982371] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:38:23.982913] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-01T20:38:23.982982] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-01T20:38:23.983471] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-01T20:38:23.983547] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-01T20:38:24.107538] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-01T20:38:24.382116] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:38:24.902382] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-01T20:38:25.392334] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T20:38:25.702378] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-01T20:38:25.991789] [DEBUG] [REMOTE ] NUV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:38:25.992287] [WARN ] [REMOTE ] NUV: No data returned for month 2025-10 [2025-10-01T20:38:25.992397] [FATAL] [REMOTE ] NUV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:38:25.992511] [FATAL] [MAIN ] NUV: Failed to fetch primary data. [2025-10-01T20:38:25.992616] [WARN ] [MAIN ] NUV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:38:25.992723] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-01T20:38:25.992797] [DEBUG] [LOCAL ] NUV: No primary data file found to delete. [2025-10-01T20:38:25.992846] [INFO ] [LOCAL ] NUV: Starting deletion of derivative data. [2025-10-01T20:38:25.993291] [DEBUG] [LOCAL ] NUV: Deleted derivative data file. [2025-10-01T20:38:25.993433] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUV took 40.0s. Estimated remaining: 1h 56m 19s. Rate: 7.1 symbols/min [2025-10-01T20:38:26.194923] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:38:26.218535] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T20:38:26.275767] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-01T20:38:26.276111] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-10-01T20:38:26.482487] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:38:26.482754] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-01T20:38:26.482807] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-01T20:38:26.483106] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-01T20:38:26.483164] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-01T20:38:26.502481] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-01T20:38:26.844565] [DEBUG] [REMOTE ] NUS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:38:26.861038] [WARN ] [REMOTE ] NUS: No data returned for month 2025-10 [2025-10-01T20:38:26.871458] [FATAL] [REMOTE ] NUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:38:26.892466] [FATAL] [MAIN ] NUS: Failed to fetch primary data. [2025-10-01T20:38:26.909494] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:38:26.925032] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-01T20:38:26.928120] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-01T20:38:26.931869] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-01T20:38:26.931786] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:38:26.932337] [DEBUG] [LOCAL ] NUS: Deleted derivative data file. [2025-10-01T20:38:26.932481] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NUS took 44.2s. Estimated remaining: 1h 56m 7s. Rate: 7.1 symbols/min [2025-10-01T20:38:27.123888] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:38:27.124062] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-01T20:38:27.124101] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-01T20:38:27.124216] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-01T20:38:27.124259] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-01T20:38:27.124303] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-01T20:38:27.124382] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-01T20:38:27.302475] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-01T20:38:27.542217] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:38:28.102388] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-01T20:38:28.902391] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-01T20:38:29.263976] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T20:38:29.621944] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-01T20:38:29.702384] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-01T20:38:30.006520] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T20:38:30.502379] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-01T20:38:31.302392] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-01T20:38:31.774215] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T20:38:32.102367] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-01T20:38:32.347258] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-01T20:38:32.440902] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T20:38:32.902402] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-01T20:38:32.964146] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T20:38:33.702403] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-01T20:38:34.078423] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T20:38:34.405718] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T20:38:34.502394] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-01T20:38:35.259286] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T20:38:35.302403] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-01T20:38:36.102420] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-01T20:38:36.537292] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T20:38:36.902410] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-01T20:38:37.702425] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-01T20:38:38.211261] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T20:38:38.368551] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-01T20:38:38.502435] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-01T20:38:38.673142] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T20:38:39.302416] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-01T20:38:40.102396] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-01T20:38:40.719782] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-01T20:38:40.730085] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T20:38:40.902357] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-01T20:38:41.233493] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-01T20:38:41.588938] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T20:38:41.702418] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-01T20:38:42.502387] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-01T20:38:42.982796] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T20:38:43.302395] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-01T20:38:43.912965] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T20:38:44.102454] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-01T20:38:44.688282] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T20:38:44.902441] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-01T20:38:45.621057] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T20:38:45.702422] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-01T20:38:46.118400] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-01T20:38:46.502395] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-01T20:38:47.168933] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T20:38:47.189327] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-01T20:38:47.302422] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-01T20:38:47.492209] [DEBUG] [REMOTE ] NVG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:38:47.492592] [WARN ] [REMOTE ] NVG: No data returned for month 2025-10 [2025-10-01T20:38:47.492698] [FATAL] [REMOTE ] NVG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:38:47.492796] [FATAL] [MAIN ] NVG: Failed to fetch primary data. [2025-10-01T20:38:47.492861] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:38:47.492914] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-01T20:38:47.493005] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-01T20:38:47.493063] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-10-01T20:38:47.493335] [DEBUG] [LOCAL ] NVG: Deleted derivative data file. [2025-10-01T20:38:47.493426] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVG took 35.9s. Estimated remaining: 1h 56m 4s. Rate: 7.1 symbols/min [2025-10-01T20:38:47.699066] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:38:47.738430] [DEBUG] [LOCAL ] NVRI: Loaded 38693 existing records from primary storage. [2025-10-01T20:38:47.738755] [INFO ] [MAIN ] NVRI: Loaded 38693 existing records. [2025-10-01T20:38:47.998385] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:38:47.998688] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-01T20:38:47.998764] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-01T20:38:47.999957] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-10-01T20:38:48.000020] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-01T20:38:48.107532] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-01T20:38:48.436298] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:38:48.902419] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-01T20:38:49.702429] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-01T20:38:50.167272] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T20:38:50.284110] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T20:38:50.502434] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-01T20:38:50.789401] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-01T20:38:51.302392] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-01T20:38:52.021702] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T20:38:52.102414] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-01T20:38:52.902429] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-01T20:38:53.585623] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T20:38:53.702396] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-01T20:38:53.785201] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T20:38:54.030341] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-10-01T20:38:54.502424] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-01T20:38:55.134991] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T20:38:55.302400] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-01T20:38:55.592555] [DEBUG] [REMOTE ] NVR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:38:55.592969] [WARN ] [REMOTE ] NVR: No data returned for month 2025-10 [2025-10-01T20:38:55.593065] [FATAL] [REMOTE ] NVR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:38:55.593153] [FATAL] [MAIN ] NVR: Failed to fetch primary data. [2025-10-01T20:38:55.593190] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:38:55.593256] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-01T20:38:55.593331] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-01T20:38:55.593367] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-10-01T20:38:55.593436] [DEBUG] [LOCAL ] NVR: No derivative data file found to delete. [2025-10-01T20:38:55.593505] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVR took 28.7s. Estimated remaining: 1h 55m 56s. Rate: 7.1 symbols/min [2025-10-01T20:38:55.788586] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:38:55.848106] [DEBUG] [LOCAL ] NVS: Loaded 51548 existing records from primary storage. [2025-10-01T20:38:55.848502] [INFO ] [MAIN ] NVS: Loaded 51548 existing records. [2025-10-01T20:38:56.048686] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:38:56.048931] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-01T20:38:56.048982] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-01T20:38:56.049508] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-01T20:38:56.049595] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-01T20:38:56.113380] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-01T20:38:56.469496] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:38:56.902364] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-01T20:38:57.392750] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-01T20:38:57.560841] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T20:38:57.702399] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-01T20:38:58.502361] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-01T20:38:58.678452] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T20:38:59.302407] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-01T20:38:59.993889] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T20:39:00.102425] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-01T20:39:00.571634] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-01T20:39:00.902361] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-01T20:39:01.248323] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T20:39:01.280215] [DEBUG] [REMOTE ] NVGS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:39:01.280553] [WARN ] [REMOTE ] NVGS: No data returned for month 2025-10 [2025-10-01T20:39:01.280738] [FATAL] [REMOTE ] NVGS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:39:01.280827] [FATAL] [MAIN ] NVGS: Failed to fetch primary data. [2025-10-01T20:39:01.280869] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:39:01.280946] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-01T20:39:01.281015] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-01T20:39:01.281055] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-01T20:39:01.281587] [DEBUG] [LOCAL ] NVGS: Deleted derivative data file. [2025-10-01T20:39:01.281705] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVGS took 37.8s. Estimated remaining: 1h 55m 46s. Rate: 7.1 symbols/min [2025-10-01T20:39:01.468712] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:39:01.501806] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-01T20:39:01.564775] [DEBUG] [LOCAL ] NVST: Loaded 51607 existing records from primary storage. [2025-10-01T20:39:01.565153] [INFO ] [MAIN ] NVST: Loaded 51607 existing records. [2025-10-01T20:39:01.707519] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-01T20:39:01.769195] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:39:01.769435] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-01T20:39:01.769517] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-01T20:39:01.770142] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-10-01T20:39:01.770240] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-01T20:39:02.211980] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:39:02.502449] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-01T20:39:03.302365] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-01T20:39:03.660059] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-01T20:39:04.082530] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T20:39:04.102364] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-01T20:39:04.902418] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-01T20:39:05.459908] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T20:39:05.702390] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-01T20:39:06.092010] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-01T20:39:06.502379] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-01T20:39:06.751620] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T20:39:06.845018] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T20:39:07.302454] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-01T20:39:08.102370] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-01T20:39:08.559377] [DEBUG] [REMOTE ] NVO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:39:08.573481] [WARN ] [REMOTE ] NVO: No data returned for month 2025-10 [2025-10-01T20:39:08.576730] [FATAL] [REMOTE ] NVO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:39:08.577017] [FATAL] [MAIN ] NVO: Failed to fetch primary data. [2025-10-01T20:39:08.577474] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:39:08.579877] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-01T20:39:08.591124] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-01T20:39:08.592075] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-01T20:39:08.592558] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-01T20:39:08.593061] [DEBUG] [LOCAL ] NVO: Deleted derivative data file. [2025-10-01T20:39:08.593183] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVO took 42.6s. Estimated remaining: 1h 55m 37s. Rate: 7.1 symbols/min [2025-10-01T20:39:08.779610] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:39:08.810988] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T20:39:08.868699] [DEBUG] [LOCAL ] NVT: Loaded 51509 existing records from primary storage. [2025-10-01T20:39:08.869092] [INFO ] [MAIN ] NVT: Loaded 51509 existing records. [2025-10-01T20:39:08.907522] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-01T20:39:09.088273] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:39:09.088517] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-01T20:39:09.088567] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-01T20:39:09.089382] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-10-01T20:39:09.089445] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-01T20:39:09.514930] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:39:09.702441] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-01T20:39:10.432970] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T20:39:10.502371] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-01T20:39:11.302392] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-01T20:39:11.692663] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T20:39:12.102387] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-01T20:39:12.153574] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T20:39:12.595074] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T20:39:12.902421] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-01T20:39:13.667962] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T20:39:13.702358] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-01T20:39:14.502392] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-01T20:39:14.699123] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T20:39:15.302363] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-01T20:39:15.385870] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T20:39:16.102361] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-01T20:39:16.365342] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T20:39:16.902357] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-01T20:39:17.204540] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T20:39:17.702394] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-01T20:39:17.903527] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T20:39:18.438595] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T20:39:18.502379] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-01T20:39:19.302777] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-01T20:39:19.305596] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T20:39:20.102384] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-01T20:39:20.146498] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T20:39:20.389589] [DEBUG] [REMOTE ] NVRI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:39:20.389959] [WARN ] [REMOTE ] NVRI: No data returned for month 2025-10 [2025-10-01T20:39:20.390077] [FATAL] [REMOTE ] NVRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:39:20.390201] [FATAL] [MAIN ] NVRI: Failed to fetch primary data. [2025-10-01T20:39:20.390289] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:39:20.390404] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-01T20:39:20.390489] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-01T20:39:20.390542] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-01T20:39:20.390955] [DEBUG] [LOCAL ] NVRI: Deleted derivative data file. [2025-10-01T20:39:20.391060] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVRI took 32.9s. Estimated remaining: 1h 55m 30s. Rate: 7.1 symbols/min [2025-10-01T20:39:20.572456] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:39:20.634580] [DEBUG] [LOCAL ] NWG: Loaded 51523 existing records from primary storage. [2025-10-01T20:39:20.634969] [INFO ] [MAIN ] NWG: Loaded 51523 existing records. [2025-10-01T20:39:20.835705] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:39:20.835949] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-01T20:39:20.836009] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-01T20:39:20.836529] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-01T20:39:20.836632] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-01T20:39:20.907452] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-01T20:39:21.243302] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:39:21.276639] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T20:39:21.702374] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-01T20:39:22.502374] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-01T20:39:22.626429] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T20:39:23.302360] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-01T20:39:23.720041] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T20:39:24.102361] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-01T20:39:24.202170] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T20:39:24.893102] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T20:39:24.902351] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-01T20:39:25.702346] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-01T20:39:26.071439] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-01T20:39:26.502397] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-01T20:39:26.710306] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T20:39:27.302376] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-01T20:39:27.493875] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T20:39:28.102385] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-01T20:39:28.310526] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T20:39:28.694338] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T20:39:28.902373] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-01T20:39:29.707865] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-01T20:39:29.727041] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T20:39:30.502352] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-01T20:39:30.750101] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T20:39:30.761707] [DEBUG] [REMOTE ] NVS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:39:30.762537] [WARN ] [REMOTE ] NVS: No data returned for month 2025-10 [2025-10-01T20:39:30.762702] [FATAL] [REMOTE ] NVS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:39:30.762961] [FATAL] [MAIN ] NVS: Failed to fetch primary data. [2025-10-01T20:39:30.763057] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:39:30.763164] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-01T20:39:30.763294] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-01T20:39:30.763381] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-01T20:39:30.764576] [DEBUG] [LOCAL ] NVS: Deleted derivative data file. [2025-10-01T20:39:30.767132] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVS took 35.2s. Estimated remaining: 1h 55m 23s. Rate: 7.1 symbols/min [2025-10-01T20:39:30.952537] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:39:30.983280] [DEBUG] [LOCAL ] NWN: Loaded 26736 existing records from primary storage. [2025-10-01T20:39:30.983529] [INFO ] [MAIN ] NWN: Loaded 26736 existing records. [2025-10-01T20:39:31.174830] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:39:31.175082] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-01T20:39:31.175151] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-01T20:39:31.175777] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-10-01T20:39:31.175842] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-01T20:39:31.319534] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-01T20:39:31.586237] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:39:31.615569] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T20:39:32.102420] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-01T20:39:32.863015] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T20:39:32.902396] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-01T20:39:33.236201] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T20:39:33.702388] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-01T20:39:34.502393] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-01T20:39:34.897207] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T20:39:35.274964] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T20:39:35.302336] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-01T20:39:35.508268] [DEBUG] [REMOTE ] NVT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:39:35.508574] [WARN ] [REMOTE ] NVT: No data returned for month 2025-10 [2025-10-01T20:39:35.508715] [FATAL] [REMOTE ] NVT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:39:35.508814] [FATAL] [MAIN ] NVT: Failed to fetch primary data. [2025-10-01T20:39:35.508885] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:39:35.508962] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-01T20:39:35.509032] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-01T20:39:35.509070] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-01T20:39:35.509528] [DEBUG] [LOCAL ] NVT: Deleted derivative data file. [2025-10-01T20:39:35.509793] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NVT took 26.9s. Estimated remaining: 1h 55m 12s. Rate: 7.1 symbols/min [2025-10-01T20:39:35.702071] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:39:35.717412] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-01T20:39:35.759588] [DEBUG] [LOCAL ] NX: Loaded 33148 existing records from primary storage. [2025-10-01T20:39:35.759912] [INFO ] [MAIN ] NX: Loaded 33148 existing records. [2025-10-01T20:39:35.951596] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:39:35.951873] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-01T20:39:35.951923] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-01T20:39:35.952276] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-10-01T20:39:35.952337] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-01T20:39:36.108712] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-01T20:39:36.344679] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:39:36.902381] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-01T20:39:37.702364] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-01T20:39:38.076088] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T20:39:38.099813] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T20:39:38.502436] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-01T20:39:38.885959] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T20:39:39.302416] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-01T20:39:40.102439] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-01T20:39:40.394206] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T20:39:40.902426] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-01T20:39:41.107736] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T20:39:41.199972] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T20:39:41.702393] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-01T20:39:41.884136] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T20:39:42.502421] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-01T20:39:43.302437] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-01T20:39:43.627317] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-01T20:39:43.960081] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T20:39:44.102417] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-01T20:39:44.359718] [DEBUG] [REMOTE ] NVST: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:39:44.360039] [WARN ] [REMOTE ] NVST: No data returned for month 2025-10 [2025-10-01T20:39:44.360131] [FATAL] [REMOTE ] NVST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:39:44.360219] [FATAL] [MAIN ] NVST: Failed to fetch primary data. [2025-10-01T20:39:44.360286] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:39:44.360361] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-01T20:39:44.360429] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-01T20:39:44.360468] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-01T20:39:44.360789] [DEBUG] [LOCAL ] NVST: Deleted derivative data file. [2025-10-01T20:39:44.360894] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NVST took 43.1s. Estimated remaining: 1h 55m 4s. Rate: 7.1 symbols/min [2025-10-01T20:39:44.551784] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:39:44.558540] [DEBUG] [LOCAL ] NXC: Loaded 4191 existing records from primary storage. [2025-10-01T20:39:44.558763] [INFO ] [MAIN ] NXC: Loaded 4191 existing records. [2025-10-01T20:39:44.766429] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:39:44.766883] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-01T20:39:44.767086] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-01T20:39:44.774395] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-01T20:39:44.785819] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-01T20:39:44.836102] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T20:39:44.907604] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-01T20:39:45.188861] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:39:45.702397] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-01T20:39:46.343074] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-01T20:39:46.475842] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T20:39:46.502382] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-01T20:39:46.898789] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-01T20:39:47.302383] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-01T20:39:47.935408] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T20:39:48.102424] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-01T20:39:48.898256] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T20:39:48.902395] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-01T20:39:49.702392] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-01T20:39:50.312370] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T20:39:50.430406] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T20:39:50.502369] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-01T20:39:51.255363] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T20:39:51.302392] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-01T20:39:52.102434] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-01T20:39:52.658455] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T20:39:52.902427] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-01T20:39:53.591585] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T20:39:53.679022] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T20:39:53.702438] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-01T20:39:54.502390] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-01T20:39:54.982561] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T20:39:55.302381] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-01T20:39:56.013937] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T20:39:56.102401] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-01T20:39:56.429163] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T20:39:56.631105] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T20:39:56.902398] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-01T20:39:57.702376] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-01T20:39:58.331588] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T20:39:58.502377] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-01T20:39:58.708480] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T20:39:59.302387] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-01T20:39:59.933791] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T20:40:00.102400] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-01T20:40:00.437739] [DEBUG] [REMOTE ] NWN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:00.438131] [WARN ] [REMOTE ] NWN: No data returned for month 2025-10 [2025-10-01T20:40:00.438229] [FATAL] [REMOTE ] NWN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:00.438319] [FATAL] [MAIN ] NWN: Failed to fetch primary data. [2025-10-01T20:40:00.438385] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:00.438500] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-01T20:40:00.438581] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-01T20:40:00.438622] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-01T20:40:00.439121] [DEBUG] [LOCAL ] NWN: Deleted derivative data file. [2025-10-01T20:40:00.439256] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NWN took 29.7s. Estimated remaining: 1h 54m 59s. Rate: 7.1 symbols/min [2025-10-01T20:40:00.902406] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-01T20:40:00.990347] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T20:40:01.702419] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-01T20:40:02.188112] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T20:40:02.502398] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-01T20:40:03.056396] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T20:40:03.302391] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-01T20:40:04.021100] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T20:40:04.102399] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-01T20:40:04.151367] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-01T20:40:04.902397] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-01T20:40:05.556054] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T20:40:05.702391] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-01T20:40:05.934433] [DEBUG] [REMOTE ] NXC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:05.934844] [WARN ] [REMOTE ] NXC: No data returned for month 2025-10 [2025-10-01T20:40:05.934935] [FATAL] [REMOTE ] NXC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:05.935017] [FATAL] [MAIN ] NXC: Failed to fetch primary data. [2025-10-01T20:40:05.935091] [WARN ] [MAIN ] NXC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:05.935172] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-01T20:40:05.935244] [DEBUG] [LOCAL ] NXC: No primary data file found to delete. [2025-10-01T20:40:05.935281] [INFO ] [LOCAL ] NXC: Starting deletion of derivative data. [2025-10-01T20:40:05.935727] [DEBUG] [LOCAL ] NXC: Deleted derivative data file. [2025-10-01T20:40:05.935816] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NXC took 21.6s. Estimated remaining: 1h 54m 49s. Rate: 7.1 symbols/min [2025-10-01T20:40:06.455894] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T20:40:06.502349] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-01T20:40:07.302451] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-01T20:40:08.435725] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T20:40:08.447353] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-01T20:40:08.668632] [DEBUG] [REMOTE ] NWG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:08.668999] [WARN ] [REMOTE ] NWG: No data returned for month 2025-10 [2025-10-01T20:40:08.669094] [FATAL] [REMOTE ] NWG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:08.669186] [FATAL] [MAIN ] NWG: Failed to fetch primary data. [2025-10-01T20:40:08.669252] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:08.669370] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-01T20:40:08.669449] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-01T20:40:08.669488] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-01T20:40:08.669829] [DEBUG] [LOCAL ] NWG: Deleted derivative data file. [2025-10-01T20:40:08.669963] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NWG took 48.3s. Estimated remaining: 1h 54m 38s. Rate: 7.1 symbols/min [2025-10-01T20:40:08.751538] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T20:40:08.902433] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-01T20:40:09.221990] [DEBUG] [REMOTE ] NX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:09.222300] [WARN ] [REMOTE ] NX: No data returned for month 2025-10 [2025-10-01T20:40:09.222393] [FATAL] [REMOTE ] NX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:09.222477] [FATAL] [MAIN ] NX: Failed to fetch primary data. [2025-10-01T20:40:09.222517] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:09.222559] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-01T20:40:09.222615] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-01T20:40:09.222681] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-01T20:40:09.223097] [DEBUG] [LOCAL ] NX: Deleted derivative data file. [2025-10-01T20:40:09.223186] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NX took 33.7s. Estimated remaining: 1h 54m 25s. Rate: 7.1 symbols/min [2025-10-01T20:40:09.852358] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:09.946283] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:10.042087] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:10.048220] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:10.049268] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-01T20:40:10.049425] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-01T20:40:10.049574] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-01T20:40:10.049637] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-01T20:40:10.049751] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-01T20:40:10.049798] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-01T20:40:10.155029] [DEBUG] [LOCAL ] NXG: Loaded 10416 existing records from primary storage. [2025-10-01T20:40:10.185118] [INFO ] [MAIN ] NXG: Loaded 10416 existing records. [2025-10-01T20:40:10.225800] [DEBUG] [LOCAL ] NXDT: Loaded 16164 existing records from primary storage. [2025-10-01T20:40:10.264838] [INFO ] [MAIN ] NXDT: Loaded 16164 existing records. [2025-10-01T20:40:10.659790] [DEBUG] [LOCAL ] NXE: Loaded 52986 existing records from primary storage. [2025-10-01T20:40:10.796469] [INFO ] [MAIN ] NXE: Loaded 52986 existing records. [2025-10-01T20:40:10.906745] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:40:10.997752] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:40:11.031116] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-01T20:40:11.003306] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-01T20:40:11.034825] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-01T20:40:11.049937] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-01T20:40:11.080324] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:11.091159] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-01T20:40:11.091321] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-01T20:40:11.103528] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-01T20:40:11.114194] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-01T20:40:11.126493] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-01T20:40:11.427616] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:40:11.446167] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-01T20:40:11.451583] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-01T20:40:11.482174] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-01T20:40:11.500618] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-01T20:40:11.566532] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:11.620715] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-01T20:40:11.689701] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:11.753982] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-01T20:40:11.965083] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:12.034336] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-01T20:40:12.074212] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-01T20:40:12.116541] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-01T20:40:12.248219] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-01T20:40:12.280502] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXDR took 3.1s. Estimated remaining: 1h 54m 14s. Rate: 7.1 symbols/min [2025-10-01T20:40:12.325858] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:12.379288] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-01T20:40:12.483254] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:12.515134] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-01T20:40:12.624063] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:12.635226] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-01T20:40:12.731930] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:12.749503] [DEBUG] [LOCAL ] NXJ: Loaded 14895 existing records from primary storage. [2025-10-01T20:40:12.749810] [INFO ] [MAIN ] NXJ: Loaded 14895 existing records. [2025-10-01T20:40:12.956106] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:40:12.956351] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-01T20:40:12.956401] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-01T20:40:12.956792] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-01T20:40:12.956870] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-01T20:40:13.366385] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T20:40:13.389003] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:13.391705] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-01T20:40:13.702365] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-01T20:40:13.830599] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T20:40:14.085786] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T20:40:14.502378] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-01T20:40:14.730698] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-01T20:40:15.061722] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T20:40:15.302397] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-01T20:40:15.872880] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T20:40:16.102378] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-01T20:40:16.113704] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T20:40:16.902381] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-01T20:40:17.100067] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T20:40:17.702358] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-01T20:40:17.869194] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T20:40:18.502356] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-01T20:40:18.590833] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T20:40:19.042859] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-01T20:40:19.302380] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-01T20:40:20.102364] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-01T20:40:20.121695] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-01T20:40:20.902393] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-01T20:40:21.702413] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-01T20:40:21.971325] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T20:40:22.152545] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-01T20:40:22.502379] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-01T20:40:22.527571] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T20:40:23.302359] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-01T20:40:23.512890] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T20:40:23.908482] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T20:40:24.102418] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-01T20:40:24.902353] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-01T20:40:25.702385] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-01T20:40:25.843924] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T20:40:26.019633] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T20:40:26.502379] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-01T20:40:26.516812] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T20:40:27.302364] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-01T20:40:27.520494] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T20:40:28.092165] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T20:40:28.102334] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-01T20:40:28.902367] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-01T20:40:28.969674] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T20:40:29.700679] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T20:40:29.702739] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-01T20:40:30.502436] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-01T20:40:30.850581] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T20:40:31.302384] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-01T20:40:32.089782] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T20:40:32.102364] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-01T20:40:32.217733] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T20:40:32.902366] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-01T20:40:33.062693] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T20:40:33.702390] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-01T20:40:33.859488] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T20:40:33.935960] [DEBUG] [REMOTE ] NXJ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:33.936281] [WARN ] [REMOTE ] NXJ: No data returned for month 2025-10 [2025-10-01T20:40:33.936374] [FATAL] [REMOTE ] NXJ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:33.936460] [FATAL] [MAIN ] NXJ: Failed to fetch primary data. [2025-10-01T20:40:33.936525] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:33.936599] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-01T20:40:33.936691] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-01T20:40:33.936748] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-10-01T20:40:33.937119] [DEBUG] [LOCAL ] NXJ: Deleted derivative data file. [2025-10-01T20:40:33.937221] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXJ took 21.6s. Estimated remaining: 1h 54m 12s. Rate: 7.1 symbols/min [2025-10-01T20:40:34.134540] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:34.139594] [DEBUG] [LOCAL ] NXN: Loaded 2330 existing records from primary storage. [2025-10-01T20:40:34.139819] [INFO ] [MAIN ] NXN: Loaded 2330 existing records. [2025-10-01T20:40:34.343978] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:40:34.344242] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-01T20:40:34.344328] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-01T20:40:34.344498] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-01T20:40:34.344556] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-01T20:40:34.509420] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-01T20:40:34.744775] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:34.768919] [DEBUG] [REMOTE ] NXG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:34.769249] [WARN ] [REMOTE ] NXG: No data returned for month 2025-10 [2025-10-01T20:40:34.769337] [FATAL] [REMOTE ] NXG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:34.769482] [FATAL] [MAIN ] NXG: Failed to fetch primary data. [2025-10-01T20:40:34.769550] [WARN ] [MAIN ] NXG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:34.769624] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-01T20:40:34.769727] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-01T20:40:34.769773] [INFO ] [LOCAL ] NXG: Starting deletion of derivative data. [2025-10-01T20:40:34.770129] [DEBUG] [LOCAL ] NXG: Deleted derivative data file. [2025-10-01T20:40:34.770220] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXG took 25.5s. Estimated remaining: 1h 54m 0s. Rate: 7.1 symbols/min [2025-10-01T20:40:34.970689] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:34.985988] [DEBUG] [LOCAL ] NXP: Loaded 12397 existing records from primary storage. [2025-10-01T20:40:34.986219] [INFO ] [MAIN ] NXP: Loaded 12397 existing records. [2025-10-01T20:40:35.185422] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:40:35.185730] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-01T20:40:35.185791] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-01T20:40:35.186097] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-01T20:40:35.186159] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-01T20:40:35.307518] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-01T20:40:35.575028] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:36.102439] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-01T20:40:36.902364] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-01T20:40:37.149287] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T20:40:37.234222] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T20:40:37.702392] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-01T20:40:37.807388] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T20:40:38.364131] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T20:40:38.502414] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-01T20:40:39.302384] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-01T20:40:39.364782] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T20:40:39.915509] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T20:40:40.102424] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-01T20:40:40.777938] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T20:40:40.902401] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-01T20:40:41.440680] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T20:40:41.702381] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-01T20:40:42.502386] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-01T20:40:43.302369] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-01T20:40:43.530404] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T20:40:43.582364] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T20:40:43.856268] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T20:40:44.102406] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-01T20:40:44.607160] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-01T20:40:44.902426] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-01T20:40:45.702396] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-01T20:40:45.806722] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T20:40:46.502382] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-01T20:40:46.547357] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T20:40:47.302395] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-01T20:40:47.842180] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-01T20:40:48.102353] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-01T20:40:48.341406] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T20:40:48.747549] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T20:40:48.902422] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-01T20:40:49.618393] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T20:40:49.702381] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-01T20:40:50.370173] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T20:40:50.502403] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-01T20:40:51.178684] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T20:40:51.302405] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-01T20:40:52.102392] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-01T20:40:52.387347] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T20:40:52.653959] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T20:40:52.902452] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-01T20:40:53.543158] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T20:40:53.702425] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-01T20:40:54.387787] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T20:40:54.502443] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-01T20:40:55.302423] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-01T20:40:56.102356] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-01T20:40:56.316031] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T20:40:56.320308] [DEBUG] [REMOTE ] NXDT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:40:56.321155] [WARN ] [REMOTE ] NXDT: No data returned for month 2025-10 [2025-10-01T20:40:56.321259] [FATAL] [REMOTE ] NXDT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:40:56.321339] [FATAL] [MAIN ] NXDT: Failed to fetch primary data. [2025-10-01T20:40:56.321406] [WARN ] [MAIN ] NXDT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:40:56.321484] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-01T20:40:56.321608] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-01T20:40:56.321697] [INFO ] [LOCAL ] NXDT: Starting deletion of derivative data. [2025-10-01T20:40:56.322009] [DEBUG] [LOCAL ] NXDT: Deleted derivative data file. [2025-10-01T20:40:56.322127] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXDT took 47.1s. Estimated remaining: 1h 53m 58s. Rate: 7.1 symbols/min [2025-10-01T20:40:56.513731] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:40:56.550454] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T20:40:56.577175] [DEBUG] [LOCAL ] NXRT: Loaded 19076 existing records from primary storage. [2025-10-01T20:40:56.577544] [INFO ] [MAIN ] NXRT: Loaded 19076 existing records. [2025-10-01T20:40:56.776175] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:40:56.776409] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-01T20:40:56.776456] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-01T20:40:56.776773] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-10-01T20:40:56.776833] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-01T20:40:56.907493] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-01T20:40:57.172214] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:40:57.492456] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-01T20:40:57.702423] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-01T20:40:58.502394] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-01T20:40:58.926722] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T20:40:59.302405] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-01T20:41:00.102414] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-01T20:41:00.268562] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T20:41:00.357488] [DEBUG] [REMOTE ] NXN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:41:00.357891] [WARN ] [REMOTE ] NXN: No data returned for month 2025-10 [2025-10-01T20:41:00.357986] [FATAL] [REMOTE ] NXN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:41:00.358070] [FATAL] [MAIN ] NXN: Failed to fetch primary data. [2025-10-01T20:41:00.358135] [WARN ] [MAIN ] NXN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:41:00.358216] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-01T20:41:00.358283] [DEBUG] [LOCAL ] NXN: No primary data file found to delete. [2025-10-01T20:41:00.358320] [INFO ] [LOCAL ] NXN: Starting deletion of derivative data. [2025-10-01T20:41:00.358713] [DEBUG] [LOCAL ] NXN: Deleted derivative data file. [2025-10-01T20:41:00.358803] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXN took 26.4s. Estimated remaining: 1h 53m 48s. Rate: 7.1 symbols/min [2025-10-01T20:41:00.604064] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:41:00.627605] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-01T20:41:00.627986] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-01T20:41:00.631195] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-01T20:41:00.630970] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-01T20:41:00.631366] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-01T20:41:00.642802] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-01T20:41:00.643082] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-01T20:41:00.907585] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-01T20:41:01.069396] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:41:01.702386] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-01T20:41:02.245837] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-01T20:41:02.502377] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-01T20:41:02.966228] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-01T20:41:03.302383] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-01T20:41:03.481976] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T20:41:03.595848] [DEBUG] [REMOTE ] NXE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:41:03.596184] [WARN ] [REMOTE ] NXE: No data returned for month 2025-10 [2025-10-01T20:41:03.596293] [FATAL] [REMOTE ] NXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:41:03.596438] [FATAL] [MAIN ] NXE: Failed to fetch primary data. [2025-10-01T20:41:03.596526] [WARN ] [MAIN ] NXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:41:03.596628] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-01T20:41:03.596746] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-01T20:41:03.596792] [INFO ] [LOCAL ] NXE: Starting deletion of derivative data. [2025-10-01T20:41:03.597115] [DEBUG] [LOCAL ] NXE: Deleted derivative data file. [2025-10-01T20:41:03.597224] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXE took 54.4s. Estimated remaining: 1h 53m 36s. Rate: 7.1 symbols/min [2025-10-01T20:41:03.794735] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:41:03.846085] [DEBUG] [LOCAL ] NYT: Loaded 49842 existing records from primary storage. [2025-10-01T20:41:03.846434] [INFO ] [MAIN ] NYT: Loaded 49842 existing records. [2025-10-01T20:41:04.051807] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:41:04.052069] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-01T20:41:04.052131] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-01T20:41:04.052514] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-10-01T20:41:04.052575] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-01T20:41:04.107532] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-01T20:41:04.481051] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:41:04.684530] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T20:41:04.902382] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-01T20:41:05.702365] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-01T20:41:05.933279] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T20:41:06.502369] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-01T20:41:06.634562] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T20:41:06.923960] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T20:41:07.302384] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-01T20:41:08.102411] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-01T20:41:08.508071] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T20:41:08.902422] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-01T20:41:09.702368] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-01T20:41:09.775056] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T20:41:10.020119] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-01T20:41:10.461213] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T20:41:10.502380] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-01T20:41:10.767402] [DEBUG] [REMOTE ] NXP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:41:10.767764] [WARN ] [REMOTE ] NXP: No data returned for month 2025-10 [2025-10-01T20:41:10.767886] [FATAL] [REMOTE ] NXP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:41:10.767998] [FATAL] [MAIN ] NXP: Failed to fetch primary data. [2025-10-01T20:41:10.768066] [WARN ] [MAIN ] NXP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:41:10.768142] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-01T20:41:10.768214] [DEBUG] [LOCAL ] NXP: No primary data file found to delete. [2025-10-01T20:41:10.768252] [INFO ] [LOCAL ] NXP: Starting deletion of derivative data. [2025-10-01T20:41:10.768724] [DEBUG] [LOCAL ] NXP: Deleted derivative data file. [2025-10-01T20:41:10.768836] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXP took 36.0s. Estimated remaining: 1h 53m 27s. Rate: 7.1 symbols/min [2025-10-01T20:41:10.970668] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:41:11.003453] [DEBUG] [LOCAL ] NZF: Loaded 28940 existing records from primary storage. [2025-10-01T20:41:11.003764] [INFO ] [MAIN ] NZF: Loaded 28940 existing records. [2025-10-01T20:41:11.195367] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:41:11.195665] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-01T20:41:11.195727] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-01T20:41:11.196317] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-01T20:41:11.196409] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-01T20:41:11.304461] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-01T20:41:11.594168] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:41:11.762835] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T20:41:12.102389] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-01T20:41:12.902394] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-01T20:41:13.315337] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-01T20:41:13.641358] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T20:41:13.702397] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-01T20:41:14.502422] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-01T20:41:15.302411] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-01T20:41:15.481091] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T20:41:15.649609] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T20:41:15.731738] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T20:41:16.102383] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-01T20:41:16.902382] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-01T20:41:17.283426] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-01T20:41:17.428832] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T20:41:17.702387] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-01T20:41:18.502385] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-01T20:41:18.893891] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T20:41:19.302389] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-01T20:41:19.647206] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T20:41:20.102381] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-01T20:41:20.548530] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T20:41:20.902386] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-01T20:41:21.329320] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T20:41:21.702364] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-01T20:41:21.798813] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-01T20:41:22.502384] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-01T20:41:22.857356] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T20:41:23.302379] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-01T20:41:24.102399] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-01T20:41:24.226202] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T20:41:24.394761] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T20:41:24.902376] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-01T20:41:25.186051] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T20:41:25.702380] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-01T20:41:26.167923] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-01T20:41:26.502383] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-01T20:41:26.749989] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T20:41:26.845193] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-01T20:41:27.302434] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-01T20:41:27.517171] [DEBUG] [REMOTE ] NXRT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:41:27.517537] [WARN ] [REMOTE ] NXRT: No data returned for month 2025-10 [2025-10-01T20:41:27.517638] [FATAL] [REMOTE ] NXRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:41:27.517761] [FATAL] [MAIN ] NXRT: Failed to fetch primary data. [2025-10-01T20:41:27.517863] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:41:27.517940] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-01T20:41:27.518029] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-01T20:41:27.518114] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-01T20:41:27.518545] [DEBUG] [LOCAL ] NXRT: Deleted derivative data file. [2025-10-01T20:41:27.518760] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NXRT took 31.2s. Estimated remaining: 1h 53m 23s. Rate: 7.1 symbols/min [2025-10-01T20:41:27.720472] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:41:27.721066] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-01T20:41:27.721130] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-01T20:41:27.721303] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-01T20:41:27.721362] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-01T20:41:27.721473] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-01T20:41:27.721540] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-01T20:41:28.110341] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-01T20:41:28.116472] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:41:28.902389] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-01T20:41:29.533066] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T20:41:29.594475] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T20:41:29.702412] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-01T20:41:30.502362] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-01T20:41:30.631501] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T20:41:31.302403] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-01T20:41:31.876952] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T20:41:32.102370] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-01T20:41:32.902412] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-01T20:41:33.129513] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T20:41:33.534546] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T20:41:33.555445] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T20:41:33.702400] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-01T20:41:33.941957] [DEBUG] [REMOTE ] NZF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:41:33.942267] [WARN ] [REMOTE ] NZF: No data returned for month 2025-10 [2025-10-01T20:41:33.942358] [FATAL] [REMOTE ] NZF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:41:33.942440] [FATAL] [MAIN ] NZF: Failed to fetch primary data. [2025-10-01T20:41:33.942504] [WARN ] [MAIN ] NZF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:41:33.942576] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-01T20:41:33.942659] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-01T20:41:33.942720] [INFO ] [LOCAL ] NZF: Starting deletion of derivative data. [2025-10-01T20:41:33.943147] [DEBUG] [LOCAL ] NZF: Deleted derivative data file. [2025-10-01T20:41:33.943245] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NZF took 23.2s. Estimated remaining: 1h 53m 14s. Rate: 7.1 symbols/min [2025-10-01T20:41:34.139437] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:41:34.196849] [DEBUG] [LOCAL ] OBDC: Loaded 51656 existing records from primary storage. [2025-10-01T20:41:34.197331] [INFO ] [MAIN ] OBDC: Loaded 51656 existing records. [2025-10-01T20:41:34.419232] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:41:34.419532] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-01T20:41:34.419588] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-01T20:41:34.421871] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-01T20:41:34.421936] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-01T20:41:34.507570] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-01T20:41:34.820703] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:41:34.821525] [DEBUG] [REMOTE ] NYC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:41:34.822162] [WARN ] [REMOTE ] NYC: No data returned for month 2025-10 [2025-10-01T20:41:34.822256] [FATAL] [REMOTE ] NYC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:41:34.822345] [FATAL] [MAIN ] NYC: Failed to fetch primary data. [2025-10-01T20:41:34.822410] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:41:34.822482] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-01T20:41:34.822548] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-01T20:41:34.822585] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-01T20:41:34.822626] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-01T20:41:34.822718] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NYC took 34.5s. Estimated remaining: 1h 53m 1s. Rate: 7.1 symbols/min [2025-10-01T20:41:35.019966] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:41:35.038712] [DEBUG] [LOCAL ] OBK: Loaded 16175 existing records from primary storage. [2025-10-01T20:41:35.039055] [INFO ] [MAIN ] OBK: Loaded 16175 existing records. [2025-10-01T20:41:35.241112] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:41:35.241483] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-01T20:41:35.241544] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-01T20:41:35.241910] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-01T20:41:35.241972] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-01T20:41:35.307474] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-01T20:41:35.686626] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:41:36.102361] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-01T20:41:36.269094] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T20:41:36.902405] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-01T20:41:37.702458] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-01T20:41:37.933192] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T20:41:37.968238] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T20:41:38.502452] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-01T20:41:39.302373] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-01T20:41:39.446349] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T20:41:39.603451] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T20:41:40.102388] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-01T20:41:40.262044] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T20:41:40.902395] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-01T20:41:41.668199] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T20:41:41.702363] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-01T20:41:41.982734] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T20:41:42.502426] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-01T20:41:43.302369] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-01T20:41:43.350885] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T20:41:43.372708] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T20:41:44.102408] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-01T20:41:44.897124] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T20:41:44.902336] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-01T20:41:44.988956] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T20:41:45.702421] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-01T20:41:45.852170] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T20:41:46.502428] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-01T20:41:47.302422] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-01T20:41:47.654460] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T20:41:48.102451] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-01T20:41:48.255230] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T20:41:48.301677] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T20:41:48.902411] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-01T20:41:49.711193] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-01T20:41:49.742011] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T20:41:49.832051] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T20:41:50.502428] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-01T20:41:50.581747] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T20:41:51.302418] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-01T20:41:52.102402] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-01T20:41:52.241119] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T20:41:52.764320] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T20:41:52.902410] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-01T20:41:53.186607] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T20:41:53.702401] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-01T20:41:54.502382] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-01T20:41:54.584301] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T20:41:54.645789] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T20:41:55.302444] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-01T20:41:55.641701] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T20:41:56.102360] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-01T20:41:56.342176] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T20:41:56.902417] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-01T20:41:57.136219] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T20:41:57.702499] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-01T20:41:57.816486] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T20:41:57.943850] [DEBUG] [REMOTE ] NYT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:41:57.944216] [WARN ] [REMOTE ] NYT: No data returned for month 2025-10 [2025-10-01T20:41:57.944337] [FATAL] [REMOTE ] NYT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:41:57.944462] [FATAL] [MAIN ] NYT: Failed to fetch primary data. [2025-10-01T20:41:57.944529] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:41:57.944618] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-01T20:41:57.944764] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-01T20:41:57.944840] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-01T20:41:57.945229] [DEBUG] [LOCAL ] NYT: Deleted derivative data file. [2025-10-01T20:41:57.945353] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. NYT took 54.3s. Estimated remaining: 1h 53m 0s. Rate: 7.1 symbols/min [2025-10-01T20:41:58.140772] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:41:58.186784] [DEBUG] [LOCAL ] OC: Loaded 44563 existing records from primary storage. [2025-10-01T20:41:58.187128] [INFO ] [MAIN ] OC: Loaded 44563 existing records. [2025-10-01T20:41:58.383555] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:41:58.383826] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-01T20:41:58.383888] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-01T20:41:58.384591] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-10-01T20:41:58.384699] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-01T20:41:58.507524] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-01T20:41:58.774760] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:41:59.302400] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-01T20:42:00.102394] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-01T20:42:00.564015] [DEBUG] [REMOTE ] O: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:42:00.564399] [WARN ] [REMOTE ] O: No data returned for month 2025-10 [2025-10-01T20:42:00.564518] [FATAL] [REMOTE ] O: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:42:00.564677] [FATAL] [MAIN ] O: Failed to fetch primary data. [2025-10-01T20:42:00.564768] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:42:00.564861] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-01T20:42:00.564965] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-01T20:42:00.565038] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-01T20:42:00.565121] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-01T20:42:00.565222] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. O took 33.0s. Estimated remaining: 1h 52m 49s. Rate: 7.1 symbols/min [2025-10-01T20:42:00.797268] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:42:00.831538] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-01T20:42:00.845970] [DEBUG] [LOCAL ] OCFT: Loaded 8374 existing records from primary storage. [2025-10-01T20:42:00.846530] [INFO ] [MAIN ] OCFT: Loaded 8374 existing records. [2025-10-01T20:42:00.907446] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-01T20:42:01.056531] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:42:01.057101] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-01T20:42:01.057175] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-01T20:42:01.057635] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-01T20:42:01.057759] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-01T20:42:01.295398] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T20:42:01.526292] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:42:01.702440] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-01T20:42:02.001516] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T20:42:02.377979] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T20:42:02.502434] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-01T20:42:03.302405] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-01T20:42:03.474133] [DEBUG] [REMOTE ] OBK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:42:03.474483] [WARN ] [REMOTE ] OBK: No data returned for month 2025-10 [2025-10-01T20:42:03.474575] [FATAL] [REMOTE ] OBK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:42:03.474685] [FATAL] [MAIN ] OBK: Failed to fetch primary data. [2025-10-01T20:42:03.474777] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:42:03.474858] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-01T20:42:03.474942] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-01T20:42:03.475004] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-01T20:42:03.475410] [DEBUG] [LOCAL ] OBK: Deleted derivative data file. [2025-10-01T20:42:03.475523] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OBK took 28.7s. Estimated remaining: 1h 52m 37s. Rate: 7.1 symbols/min [2025-10-01T20:42:03.666212] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:42:03.676672] [DEBUG] [LOCAL ] ODC: Loaded 8422 existing records from primary storage. [2025-10-01T20:42:03.676870] [INFO ] [MAIN ] ODC: Loaded 8422 existing records. [2025-10-01T20:42:03.873122] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:42:03.873326] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-01T20:42:03.873374] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-01T20:42:03.873732] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-01T20:42:03.873793] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-01T20:42:04.107510] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-01T20:42:04.285973] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:42:04.466202] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-01T20:42:04.833986] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T20:42:04.902416] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-01T20:42:05.702389] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-01T20:42:06.502356] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-01T20:42:06.509907] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T20:42:06.552450] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T20:42:07.302426] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-01T20:42:07.338732] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T20:42:08.102377] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-01T20:42:08.173046] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T20:42:08.902428] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-01T20:42:09.702418] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-01T20:42:10.189992] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T20:42:10.191020] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T20:42:10.502380] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-01T20:42:11.116579] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-01T20:42:11.302366] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-01T20:42:11.373416] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T20:42:11.764487] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T20:42:12.102388] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-01T20:42:12.902396] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-01T20:42:12.961204] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T20:42:13.706258] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-01T20:42:13.709985] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T20:42:14.502417] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-01T20:42:15.302388] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-01T20:42:15.319293] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T20:42:15.456503] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T20:42:16.102388] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-01T20:42:16.902353] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-01T20:42:16.927025] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T20:42:17.178881] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T20:42:17.702384] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-01T20:42:17.905158] [DEBUG] [REMOTE ] OBDC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:42:17.905463] [WARN ] [REMOTE ] OBDC: No data returned for month 2025-10 [2025-10-01T20:42:17.905554] [FATAL] [REMOTE ] OBDC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:42:17.905669] [FATAL] [MAIN ] OBDC: Failed to fetch primary data. [2025-10-01T20:42:17.905741] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:42:17.905833] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-01T20:42:17.905924] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-01T20:42:17.905986] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-01T20:42:17.906341] [DEBUG] [LOCAL ] OBDC: Deleted derivative data file. [2025-10-01T20:42:17.906429] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OBDC took 44.0s. Estimated remaining: 1h 52m 32s. Rate: 7.1 symbols/min [2025-10-01T20:42:18.094667] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:42:18.122585] [DEBUG] [LOCAL ] ODV: Loaded 26643 existing records from primary storage. [2025-10-01T20:42:18.122906] [INFO ] [MAIN ] ODV: Loaded 26643 existing records. [2025-10-01T20:42:18.323199] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:42:18.323467] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-01T20:42:18.323524] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-01T20:42:18.324175] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-01T20:42:18.324237] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-01T20:42:18.525290] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-01T20:42:18.743883] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:42:18.774275] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T20:42:19.211981] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T20:42:19.302385] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-01T20:42:20.077165] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T20:42:20.102335] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-01T20:42:20.902376] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-01T20:42:21.006199] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-01T20:42:21.702387] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-01T20:42:21.953954] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T20:42:22.502455] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-01T20:42:22.746990] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T20:42:23.302434] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-01T20:42:23.395583] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T20:42:24.102394] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-01T20:42:24.149866] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T20:42:24.902385] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-01T20:42:24.931230] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T20:42:25.702400] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-01T20:42:25.791886] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T20:42:26.238329] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T20:42:26.502448] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-01T20:42:27.302434] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-01T20:42:27.538025] [DEBUG] [REMOTE ] ODC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:42:27.538508] [WARN ] [REMOTE ] ODC: No data returned for month 2025-10 [2025-10-01T20:42:27.538613] [FATAL] [REMOTE ] ODC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:42:27.538734] [FATAL] [MAIN ] ODC: Failed to fetch primary data. [2025-10-01T20:42:27.538808] [WARN ] [MAIN ] ODC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:42:27.538882] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-01T20:42:27.538951] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-01T20:42:27.538990] [INFO ] [LOCAL ] ODC: Starting deletion of derivative data. [2025-10-01T20:42:27.539498] [DEBUG] [LOCAL ] ODC: Deleted derivative data file. [2025-10-01T20:42:27.539703] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. ODC took 24.1s. Estimated remaining: 1h 52m 24s. Rate: 7.1 symbols/min [2025-10-01T20:42:27.743342] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:42:27.790230] [DEBUG] [LOCAL ] OEC: Loaded 37119 existing records from primary storage. [2025-10-01T20:42:27.790573] [INFO ] [MAIN ] OEC: Loaded 37119 existing records. [2025-10-01T20:42:27.995499] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:42:27.995958] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-01T20:42:27.996018] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-01T20:42:27.996280] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-01T20:42:27.996408] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-01T20:42:28.110255] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-01T20:42:28.405762] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:42:28.434471] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T20:42:28.902365] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-01T20:42:29.172543] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-01T20:42:29.702453] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-01T20:42:30.058134] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T20:42:30.502421] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-01T20:42:30.880739] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T20:42:31.132367] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T20:42:31.302381] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-01T20:42:31.560989] [DEBUG] [REMOTE ] OCFT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:42:31.561375] [WARN ] [REMOTE ] OCFT: No data returned for month 2025-10 [2025-10-01T20:42:31.561488] [FATAL] [REMOTE ] OCFT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:42:31.561598] [FATAL] [MAIN ] OCFT: Failed to fetch primary data. [2025-10-01T20:42:31.561690] [WARN ] [MAIN ] OCFT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:42:31.561761] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-01T20:42:31.561826] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-01T20:42:31.561862] [INFO ] [LOCAL ] OCFT: Starting deletion of derivative data. [2025-10-01T20:42:31.562135] [DEBUG] [LOCAL ] OCFT: Deleted derivative data file. [2025-10-01T20:42:31.562285] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. OCFT took 31.0s. Estimated remaining: 1h 52m 13s. Rate: 7.1 symbols/min [2025-10-01T20:42:31.754034] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:42:31.777934] [DEBUG] [LOCAL ] OFG: Loaded 21598 existing records from primary storage. [2025-10-01T20:42:31.778202] [INFO ] [MAIN ] OFG: Loaded 21598 existing records. [2025-10-01T20:42:31.984474] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:42:31.984759] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-01T20:42:31.984815] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-01T20:42:31.985136] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-10-01T20:42:31.985198] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-01T20:42:32.107542] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-01T20:42:32.379952] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:42:32.902425] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-01T20:42:33.702375] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-01T20:42:33.860208] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T20:42:34.443480] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T20:42:34.502469] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-01T20:42:35.129420] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T20:42:35.302413] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-01T20:42:35.608799] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T20:42:36.102401] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-01T20:42:36.801831] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T20:42:36.902420] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-01T20:42:37.702362] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-01T20:42:38.053670] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T20:42:38.083904] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T20:42:38.502418] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-01T20:42:39.266868] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T20:42:39.302336] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-01T20:42:39.347568] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T20:42:40.102433] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-01T20:42:40.791838] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T20:42:40.902363] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-01T20:42:41.429311] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T20:42:41.702400] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-01T20:42:42.321738] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T20:42:42.502442] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-01T20:42:43.030708] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T20:42:43.302424] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-01T20:42:43.711273] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T20:42:44.102387] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-01T20:42:44.898080] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T20:42:44.907523] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-01T20:42:45.284966] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T20:42:45.702383] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-01T20:42:46.091551] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T20:42:46.502404] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-01T20:42:47.302368] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-01T20:42:47.435194] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T20:42:48.102358] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-01T20:42:48.150238] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T20:42:48.384615] [DEBUG] [REMOTE ] OC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:42:48.384996] [WARN ] [REMOTE ] OC: No data returned for month 2025-10 [2025-10-01T20:42:48.385108] [FATAL] [REMOTE ] OC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:42:48.385209] [FATAL] [MAIN ] OC: Failed to fetch primary data. [2025-10-01T20:42:48.385280] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:42:48.385378] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-01T20:42:48.385469] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-01T20:42:48.385522] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-01T20:42:48.385979] [DEBUG] [LOCAL ] OC: Deleted derivative data file. [2025-10-01T20:42:48.386068] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OC took 50.4s. Estimated remaining: 1h 52m 9s. Rate: 7.1 symbols/min [2025-10-01T20:42:48.589835] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:42:48.643579] [DEBUG] [LOCAL ] OGE: Loaded 46316 existing records from primary storage. [2025-10-01T20:42:48.644016] [INFO ] [MAIN ] OGE: Loaded 46316 existing records. [2025-10-01T20:42:48.850485] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:42:48.850836] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-01T20:42:48.850921] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-01T20:42:48.858768] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-10-01T20:42:48.872300] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-01T20:42:48.906265] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-01T20:42:48.914760] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T20:42:49.162586] [DEBUG] [REMOTE ] ODV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:42:49.183618] [WARN ] [REMOTE ] ODV: No data returned for month 2025-10 [2025-10-01T20:42:49.186720] [FATAL] [REMOTE ] ODV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:42:49.192493] [FATAL] [MAIN ] ODV: Failed to fetch primary data. [2025-10-01T20:42:49.202861] [WARN ] [MAIN ] ODV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:42:49.213195] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-01T20:42:49.239927] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-01T20:42:49.249540] [INFO ] [LOCAL ] ODV: Starting deletion of derivative data. [2025-10-01T20:42:49.274447] [DEBUG] [LOCAL ] ODV: Deleted derivative data file. [2025-10-01T20:42:49.274383] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:42:49.274619] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. ODV took 31.4s. Estimated remaining: 1h 51m 57s. Rate: 7.1 symbols/min [2025-10-01T20:42:49.464511] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:42:49.527939] [DEBUG] [LOCAL ] OGN: Loaded 53097 existing records from primary storage. [2025-10-01T20:42:49.528506] [INFO ] [MAIN ] OGN: Loaded 53097 existing records. [2025-10-01T20:42:49.711744] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-01T20:42:49.746108] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:42:49.746406] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-01T20:42:49.746462] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-01T20:42:49.747026] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-10-01T20:42:49.747088] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-01T20:42:50.148418] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:42:50.502404] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-01T20:42:51.302420] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-01T20:42:51.554692] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T20:42:51.819530] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T20:42:52.102379] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-01T20:42:52.823001] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T20:42:52.902353] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-01T20:42:53.300905] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T20:42:53.513878] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T20:42:53.702389] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-01T20:42:54.502448] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-01T20:42:54.782262] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-01T20:42:55.302398] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-01T20:42:56.102342] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-01T20:42:56.134525] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T20:42:56.232702] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T20:42:56.902379] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-01T20:42:57.327558] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T20:42:57.702408] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-01T20:42:58.393860] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T20:42:58.502378] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-01T20:42:58.630499] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T20:42:59.302400] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-01T20:43:00.084241] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T20:43:00.102346] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-01T20:43:00.811367] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T20:43:00.902372] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-01T20:43:01.702380] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-01T20:43:01.799918] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:43:01.851984] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T20:43:01.938591] [DEBUG] [REMOTE ] OEC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:01.939015] [WARN ] [REMOTE ] OEC: No data returned for month 2025-10 [2025-10-01T20:43:01.939124] [FATAL] [REMOTE ] OEC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:01.939252] [FATAL] [MAIN ] OEC: Failed to fetch primary data. [2025-10-01T20:43:01.939340] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:01.939470] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-01T20:43:01.939625] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-01T20:43:01.939728] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-01T20:43:01.940462] [DEBUG] [LOCAL ] OEC: Deleted derivative data file. [2025-10-01T20:43:01.940608] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OEC took 34.4s. Estimated remaining: 1h 51m 50s. Rate: 7.1 symbols/min [2025-10-01T20:43:02.170404] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:02.217352] [DEBUG] [LOCAL ] OGS: Loaded 34179 existing records from primary storage. [2025-10-01T20:43:02.217744] [INFO ] [MAIN ] OGS: Loaded 34179 existing records. [2025-10-01T20:43:02.437477] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:43:02.437724] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-01T20:43:02.437781] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-01T20:43:02.438297] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-10-01T20:43:02.438358] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-01T20:43:02.507575] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-01T20:43:02.872730] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:43:03.302387] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-01T20:43:04.102379] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-01T20:43:04.453842] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T20:43:04.699171] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T20:43:04.902393] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-01T20:43:05.254103] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T20:43:05.702418] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-01T20:43:06.261529] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T20:43:06.502383] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-01T20:43:06.587623] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T20:43:07.302379] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-01T20:43:07.866241] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T20:43:08.102363] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-01T20:43:08.295204] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T20:43:08.902381] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-01T20:43:09.455985] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T20:43:09.570549] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T20:43:09.702377] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-01T20:43:10.502368] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-01T20:43:10.671206] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T20:43:10.785936] [DEBUG] [REMOTE ] OFG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:10.786271] [WARN ] [REMOTE ] OFG: No data returned for month 2025-10 [2025-10-01T20:43:10.786363] [FATAL] [REMOTE ] OFG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:10.786467] [FATAL] [MAIN ] OFG: Failed to fetch primary data. [2025-10-01T20:43:10.786542] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:10.786615] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-01T20:43:10.786714] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-01T20:43:10.786762] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-01T20:43:10.787114] [DEBUG] [LOCAL ] OFG: Deleted derivative data file. [2025-10-01T20:43:10.787245] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OFG took 39.2s. Estimated remaining: 1h 51m 42s. Rate: 7.1 symbols/min [2025-10-01T20:43:10.967763] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:11.029282] [DEBUG] [LOCAL ] OHI: Loaded 51989 existing records from primary storage. [2025-10-01T20:43:11.029625] [INFO ] [MAIN ] OHI: Loaded 51989 existing records. [2025-10-01T20:43:11.228328] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:43:11.228550] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-01T20:43:11.228598] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-01T20:43:11.230022] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-10-01T20:43:11.230102] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-01T20:43:11.307549] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-01T20:43:11.618489] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:43:12.102406] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-01T20:43:12.902390] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-01T20:43:13.007631] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T20:43:13.649252] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T20:43:13.702394] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-01T20:43:13.770411] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T20:43:14.502388] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-01T20:43:15.232358] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T20:43:15.302368] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-01T20:43:15.382378] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T20:43:16.102382] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-01T20:43:16.902374] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-01T20:43:16.980464] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T20:43:17.046285] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T20:43:17.702375] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-01T20:43:18.416412] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T20:43:18.502392] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-01T20:43:19.308361] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-01T20:43:19.322413] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T20:43:19.655510] [DEBUG] [REMOTE ] OGN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:19.655919] [WARN ] [REMOTE ] OGN: No data returned for month 2025-10 [2025-10-01T20:43:19.656048] [FATAL] [REMOTE ] OGN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:19.656156] [FATAL] [MAIN ] OGN: Failed to fetch primary data. [2025-10-01T20:43:19.656226] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:19.656302] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-01T20:43:19.656377] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-01T20:43:19.656422] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-01T20:43:19.656797] [DEBUG] [LOCAL ] OGN: Deleted derivative data file. [2025-10-01T20:43:19.656904] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGN took 30.4s. Estimated remaining: 1h 51m 34s. Rate: 7.1 symbols/min [2025-10-01T20:43:19.861421] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:19.909465] [DEBUG] [LOCAL ] OI: Loaded 47157 existing records from primary storage. [2025-10-01T20:43:19.909801] [INFO ] [MAIN ] OI: Loaded 47157 existing records. [2025-10-01T20:43:20.099836] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T20:43:20.104083] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-01T20:43:20.142962] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:43:20.144895] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-01T20:43:20.145369] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-01T20:43:20.146823] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-10-01T20:43:20.146895] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-01T20:43:20.553758] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:43:20.902395] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-01T20:43:21.702358] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-01T20:43:21.887063] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T20:43:22.507556] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-01T20:43:22.528233] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T20:43:22.880839] [DEBUG] [REMOTE ] OGE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:22.881214] [WARN ] [REMOTE ] OGE: No data returned for month 2025-10 [2025-10-01T20:43:22.881306] [FATAL] [REMOTE ] OGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:22.881418] [FATAL] [MAIN ] OGE: Failed to fetch primary data. [2025-10-01T20:43:22.881505] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:22.881687] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-01T20:43:22.881797] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-01T20:43:22.881848] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-01T20:43:22.882228] [DEBUG] [LOCAL ] OGE: Deleted derivative data file. [2025-10-01T20:43:22.882340] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OGE took 34.5s. Estimated remaining: 1h 51m 23s. Rate: 7.1 symbols/min [2025-10-01T20:43:23.070988] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:23.086328] [DEBUG] [LOCAL ] OIA: Loaded 13804 existing records from primary storage. [2025-10-01T20:43:23.086550] [INFO ] [MAIN ] OIA: Loaded 13804 existing records. [2025-10-01T20:43:23.295412] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:43:23.295761] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-01T20:43:23.295949] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-01T20:43:23.296269] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-01T20:43:23.296333] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-01T20:43:23.308152] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-01T20:43:23.692964] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:43:23.724391] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T20:43:24.102377] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-01T20:43:24.705124] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T20:43:24.902456] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-01T20:43:25.363831] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T20:43:25.702406] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-01T20:43:26.435408] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T20:43:26.502382] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-01T20:43:27.250547] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T20:43:27.302375] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-01T20:43:27.647908] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T20:43:28.102440] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-01T20:43:28.316933] [DEBUG] [REMOTE ] OGS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:28.317289] [WARN ] [REMOTE ] OGS: No data returned for month 2025-10 [2025-10-01T20:43:28.317381] [FATAL] [REMOTE ] OGS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:28.317469] [FATAL] [MAIN ] OGS: Failed to fetch primary data. [2025-10-01T20:43:28.317533] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:28.317609] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-01T20:43:28.317711] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-01T20:43:28.317765] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-01T20:43:28.318218] [DEBUG] [LOCAL ] OGS: Deleted derivative data file. [2025-10-01T20:43:28.318357] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OGS took 26.4s. Estimated remaining: 1h 51m 13s. Rate: 7.1 symbols/min [2025-10-01T20:43:28.532198] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:28.578015] [DEBUG] [LOCAL ] OII: Loaded 42500 existing records from primary storage. [2025-10-01T20:43:28.578328] [INFO ] [MAIN ] OII: Loaded 42500 existing records. [2025-10-01T20:43:28.778418] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:43:28.778921] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-01T20:43:28.779065] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-01T20:43:28.779954] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-10-01T20:43:28.780016] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-01T20:43:28.907718] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-01T20:43:29.240837] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:43:29.243922] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:43:29.702383] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-01T20:43:30.031956] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T20:43:30.502444] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-01T20:43:31.291259] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T20:43:31.302338] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-01T20:43:32.102356] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-01T20:43:32.173703] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T20:43:32.902394] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-01T20:43:33.107237] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T20:43:33.358459] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-01T20:43:33.702384] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-01T20:43:34.181951] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T20:43:34.502420] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-01T20:43:35.302392] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-01T20:43:35.684799] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T20:43:36.015931] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T20:43:36.102421] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-01T20:43:36.784447] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T20:43:36.902395] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-01T20:43:37.702450] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-01T20:43:37.868246] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T20:43:37.934474] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T20:43:38.502438] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-01T20:43:39.261999] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T20:43:39.302381] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-01T20:43:40.102391] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-01T20:43:40.211981] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T20:43:40.851996] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T20:43:40.902561] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-01T20:43:40.902493] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T20:43:41.702431] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-01T20:43:42.502348] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-01T20:43:42.784111] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T20:43:43.302394] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-01T20:43:43.471127] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T20:43:43.515613] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T20:43:44.102394] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-01T20:43:44.728372] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T20:43:44.902397] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-01T20:43:45.576088] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T20:43:45.699618] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T20:43:45.702505] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-01T20:43:46.502375] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-01T20:43:46.598022] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T20:43:47.302431] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-01T20:43:47.829549] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T20:43:48.102384] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-01T20:43:48.188971] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-01T20:43:48.902391] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-01T20:43:49.547276] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T20:43:49.702379] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-01T20:43:50.041605] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T20:43:50.502377] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-01T20:43:51.302359] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-01T20:43:51.370711] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T20:43:51.561955] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T20:43:52.102402] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-01T20:43:52.351123] [DEBUG] [REMOTE ] OIA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:52.351449] [WARN ] [REMOTE ] OIA: No data returned for month 2025-10 [2025-10-01T20:43:52.351543] [FATAL] [REMOTE ] OIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:52.351630] [FATAL] [MAIN ] OIA: Failed to fetch primary data. [2025-10-01T20:43:52.351727] [WARN ] [MAIN ] OIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:52.351832] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-01T20:43:52.351932] [DEBUG] [LOCAL ] OIA: No primary data file found to delete. [2025-10-01T20:43:52.351991] [INFO ] [LOCAL ] OIA: Starting deletion of derivative data. [2025-10-01T20:43:52.352362] [DEBUG] [LOCAL ] OIA: Deleted derivative data file. [2025-10-01T20:43:52.352477] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OIA took 29.5s. Estimated remaining: 1h 51m 12s. Rate: 7.1 symbols/min [2025-10-01T20:43:52.542930] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:52.588211] [DEBUG] [LOCAL ] OIS: Loaded 40448 existing records from primary storage. [2025-10-01T20:43:52.588516] [INFO ] [MAIN ] OIS: Loaded 40448 existing records. [2025-10-01T20:43:52.793012] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:43:52.793211] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-01T20:43:52.793261] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-01T20:43:52.794076] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-01T20:43:52.794139] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-01T20:43:52.908765] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-01T20:43:53.200194] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:43:53.233849] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T20:43:53.702392] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-01T20:43:54.502402] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-01T20:43:54.584123] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T20:43:54.861066] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T20:43:55.302430] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-01T20:43:56.021322] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T20:43:56.102389] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-01T20:43:56.427947] [DEBUG] [REMOTE ] OI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:56.428315] [WARN ] [REMOTE ] OI: No data returned for month 2025-10 [2025-10-01T20:43:56.428412] [FATAL] [REMOTE ] OI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:56.428496] [FATAL] [MAIN ] OI: Failed to fetch primary data. [2025-10-01T20:43:56.428560] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:56.428636] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-01T20:43:56.428745] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-01T20:43:56.428785] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-01T20:43:56.429258] [DEBUG] [LOCAL ] OI: Deleted derivative data file. [2025-10-01T20:43:56.429368] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OI took 36.8s. Estimated remaining: 1h 51m 1s. Rate: 7.1 symbols/min [2025-10-01T20:43:56.634352] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:56.634586] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-01T20:43:56.634639] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-01T20:43:56.634807] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-01T20:43:56.634863] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-01T20:43:56.634911] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-01T20:43:56.634948] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-01T20:43:56.911479] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-01T20:43:57.059876] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:43:57.084239] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T20:43:57.702389] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-01T20:43:58.507483] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-01T20:43:58.530008] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T20:43:58.639761] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T20:43:58.797413] [DEBUG] [REMOTE ] OII: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:43:58.797777] [WARN ] [REMOTE ] OII: No data returned for month 2025-10 [2025-10-01T20:43:58.797896] [FATAL] [REMOTE ] OII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:43:58.797989] [FATAL] [MAIN ] OII: Failed to fetch primary data. [2025-10-01T20:43:58.798054] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:43:58.798134] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-01T20:43:58.798202] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-01T20:43:58.798240] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-01T20:43:58.798711] [DEBUG] [LOCAL ] OII: Deleted derivative data file. [2025-10-01T20:43:58.798801] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OII took 30.5s. Estimated remaining: 1h 50m 50s. Rate: 7.1 symbols/min [2025-10-01T20:43:59.006587] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:43:59.006848] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-01T20:43:59.006907] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-01T20:43:59.007033] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-01T20:43:59.007079] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-01T20:43:59.007125] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-01T20:43:59.007162] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-01T20:43:59.309147] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-01T20:43:59.442229] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:00.042680] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T20:44:00.102380] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-01T20:44:00.902372] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-01T20:44:01.165143] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T20:44:01.702387] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-01T20:44:02.502353] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-01T20:44:03.302391] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-01T20:44:03.591831] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T20:44:03.947051] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (3.04 seconds). [2025-10-01T20:44:04.012922] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T20:44:04.014361] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T20:44:04.102381] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-01T20:44:04.902381] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-01T20:44:05.420423] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T20:44:05.586110] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T20:44:05.702380] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-01T20:44:06.502405] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-01T20:44:07.302416] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-01T20:44:08.009169] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T20:44:08.102478] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-01T20:44:08.111562] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T20:44:08.370285] [DEBUG] [REMOTE ] OHI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:44:08.370699] [WARN ] [REMOTE ] OHI: No data returned for month 2025-10 [2025-10-01T20:44:08.370795] [FATAL] [REMOTE ] OHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:44:08.370878] [FATAL] [MAIN ] OHI: Failed to fetch primary data. [2025-10-01T20:44:08.370939] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:44:08.371023] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-01T20:44:08.371129] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-01T20:44:08.371188] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-01T20:44:08.371703] [DEBUG] [LOCAL ] OHI: Deleted derivative data file. [2025-10-01T20:44:08.371821] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OHI took 57.6s. Estimated remaining: 1h 50m 42s. Rate: 7.1 symbols/min [2025-10-01T20:44:08.585417] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:44:08.648838] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-10-01T20:44:08.680239] [DEBUG] [LOCAL ] OLN: Loaded 51761 existing records from primary storage. [2025-10-01T20:44:08.680576] [INFO ] [MAIN ] OLN: Loaded 51761 existing records. [2025-10-01T20:44:08.879512] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:44:08.879748] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-01T20:44:08.879804] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-01T20:44:08.881092] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-10-01T20:44:08.881156] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-01T20:44:08.911810] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-01T20:44:09.291580] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:09.702379] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-01T20:44:10.502365] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-01T20:44:10.605787] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T20:44:10.905419] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-01T20:44:11.302393] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-01T20:44:12.102413] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-01T20:44:12.318174] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T20:44:12.902378] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-01T20:44:13.702361] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-01T20:44:13.789914] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-01T20:44:13.873186] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-01T20:44:14.049592] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T20:44:14.261570] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-01T20:44:14.502377] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-01T20:44:15.302398] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-01T20:44:16.027992] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T20:44:16.102383] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-01T20:44:16.765024] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-01T20:44:16.902332] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-01T20:44:17.702389] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-01T20:44:18.221388] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T20:44:18.279817] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-10-01T20:44:18.502385] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-01T20:44:18.614783] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T20:44:19.302423] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-01T20:44:20.102390] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-01T20:44:20.860142] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T20:44:20.902444] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-01T20:44:21.027880] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-01T20:44:21.589361] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T20:44:21.702392] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-01T20:44:22.027913] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T20:44:22.502435] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-01T20:44:22.745836] [DEBUG] [REMOTE ] OIS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:44:22.746174] [WARN ] [REMOTE ] OIS: No data returned for month 2025-10 [2025-10-01T20:44:22.746272] [FATAL] [REMOTE ] OIS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:44:22.746367] [FATAL] [MAIN ] OIS: Failed to fetch primary data. [2025-10-01T20:44:22.746434] [WARN ] [MAIN ] OIS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:44:22.746511] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-01T20:44:22.746595] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-01T20:44:22.746686] [INFO ] [LOCAL ] OIS: Starting deletion of derivative data. [2025-10-01T20:44:22.747180] [DEBUG] [LOCAL ] OIS: Deleted derivative data file. [2025-10-01T20:44:22.747281] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OIS took 30.4s. Estimated remaining: 1h 50m 36s. Rate: 7.1 symbols/min [2025-10-01T20:44:22.957043] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:44:22.969596] [DEBUG] [LOCAL ] OLP: Loaded 9868 existing records from primary storage. [2025-10-01T20:44:22.969938] [INFO ] [MAIN ] OLP: Loaded 9868 existing records. [2025-10-01T20:44:23.199067] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:44:23.199288] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-01T20:44:23.199341] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-01T20:44:23.199920] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-01T20:44:23.199983] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-01T20:44:23.308701] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-01T20:44:23.660410] [DEBUG] [REMOTE ] OKE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:44:23.666971] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:23.667465] [WARN ] [REMOTE ] OKE: No data returned for month 2025-10 [2025-10-01T20:44:23.668096] [FATAL] [REMOTE ] OKE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:44:23.668553] [FATAL] [MAIN ] OKE: Failed to fetch primary data. [2025-10-01T20:44:23.670881] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T20:44:23.669035] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:44:23.671305] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-01T20:44:23.681262] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-01T20:44:23.681769] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-01T20:44:23.682247] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-01T20:44:23.682311] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OKE took 27.3s. Estimated remaining: 1h 50m 24s. Rate: 7.1 symbols/min [2025-10-01T20:44:23.878489] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:44:23.878733] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-01T20:44:23.878783] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-01T20:44:23.878898] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-01T20:44:23.878941] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-01T20:44:23.879026] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-01T20:44:23.879128] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-01T20:44:24.109129] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-01T20:44:24.287259] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:24.902411] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-01T20:44:25.661727] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-01T20:44:25.702353] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-01T20:44:26.103983] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-01T20:44:26.502422] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-01T20:44:27.302441] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-01T20:44:27.510738] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T20:44:28.102387] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-01T20:44:28.568458] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-10-01T20:44:28.662223] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T20:44:28.902442] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-01T20:44:29.144166] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T20:44:29.702394] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-01T20:44:30.502464] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-01T20:44:30.808274] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T20:44:31.099948] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T20:44:31.302383] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-01T20:44:32.102406] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-01T20:44:32.273073] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-01T20:44:32.902359] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-01T20:44:33.061823] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T20:44:33.106042] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T20:44:33.702429] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-01T20:44:34.445614] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T20:44:34.502409] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-01T20:44:35.302390] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-01T20:44:35.398307] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T20:44:35.670974] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-01T20:44:36.094254] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T20:44:36.102332] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-01T20:44:36.902397] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-01T20:44:36.928682] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T20:44:37.702401] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-01T20:44:38.061171] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T20:44:38.502421] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-01T20:44:38.819476] [DEBUG] [REMOTE ] OKLO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:44:38.820126] [WARN ] [REMOTE ] OKLO: No data returned for month 2025-10 [2025-10-01T20:44:38.820243] [FATAL] [REMOTE ] OKLO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:44:38.820531] [FATAL] [MAIN ] OKLO: Failed to fetch primary data. [2025-10-01T20:44:38.820639] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:44:38.820789] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-01T20:44:38.820945] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-01T20:44:38.821006] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-01T20:44:38.821054] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-01T20:44:38.821128] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OKLO took 40.0s. Estimated remaining: 1h 50m 19s. Rate: 7.1 symbols/min [2025-10-01T20:44:39.038995] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:44:39.097709] [DEBUG] [LOCAL ] OMF: Loaded 46163 existing records from primary storage. [2025-10-01T20:44:39.098205] [INFO ] [MAIN ] OMF: Loaded 46163 existing records. [2025-10-01T20:44:39.223954] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T20:44:39.308044] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-01T20:44:39.315292] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:44:39.317284] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-01T20:44:39.317403] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-01T20:44:39.319421] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-01T20:44:39.319495] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-01T20:44:39.699686] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:40.102455] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-01T20:44:40.262629] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T20:44:40.902417] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-01T20:44:41.057032] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-01T20:44:41.609808] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T20:44:41.702423] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-01T20:44:42.502431] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-01T20:44:43.251385] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T20:44:43.302369] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-01T20:44:44.023358] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T20:44:44.104869] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-01T20:44:44.111535] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T20:44:44.752843] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T20:44:44.902397] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-01T20:44:45.702476] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-01T20:44:46.502381] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-01T20:44:46.630850] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T20:44:46.671269] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T20:44:46.850187] [DEBUG] [REMOTE ] OMC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:44:46.850668] [WARN ] [REMOTE ] OMC: No data returned for month 2025-10 [2025-10-01T20:44:46.850778] [FATAL] [REMOTE ] OMC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:44:46.850909] [FATAL] [MAIN ] OMC: Failed to fetch primary data. [2025-10-01T20:44:46.851006] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:44:46.851097] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-01T20:44:46.851217] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-01T20:44:46.851288] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-01T20:44:46.851359] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-01T20:44:46.851462] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OMC took 23.2s. Estimated remaining: 1h 50m 10s. Rate: 7.1 symbols/min [2025-10-01T20:44:47.083840] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:44:47.128003] [DEBUG] [LOCAL ] OMI: Loaded 45815 existing records from primary storage. [2025-10-01T20:44:47.128372] [INFO ] [MAIN ] OMI: Loaded 45815 existing records. [2025-10-01T20:44:47.302370] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-01T20:44:47.325097] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:44:47.325428] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-01T20:44:47.325539] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-01T20:44:47.326466] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-10-01T20:44:47.326539] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-01T20:44:47.714663] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:48.082102] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T20:44:48.102357] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-01T20:44:48.902392] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-01T20:44:49.702400] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-01T20:44:49.741581] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T20:44:49.806232] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T20:44:50.502420] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-01T20:44:51.302363] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-01T20:44:51.441292] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T20:44:52.102408] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-01T20:44:52.162213] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T20:44:52.468861] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T20:44:52.902392] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-01T20:44:53.103290] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T20:44:53.702395] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-01T20:44:54.443663] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T20:44:54.502420] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-01T20:44:55.128428] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T20:44:55.302351] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-01T20:44:55.600300] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T20:44:56.102393] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-01T20:44:56.851354] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T20:44:56.902354] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-01T20:44:57.233916] [DEBUG] [REMOTE ] OLN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:44:57.234498] [WARN ] [REMOTE ] OLN: No data returned for month 2025-10 [2025-10-01T20:44:57.234700] [FATAL] [REMOTE ] OLN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:44:57.234818] [FATAL] [MAIN ] OLN: Failed to fetch primary data. [2025-10-01T20:44:57.234891] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:44:57.234966] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-01T20:44:57.235065] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-01T20:44:57.235130] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-01T20:44:57.235598] [DEBUG] [LOCAL ] OLN: Deleted derivative data file. [2025-10-01T20:44:57.235740] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OLN took 48.9s. Estimated remaining: 1h 50m 3s. Rate: 7.1 symbols/min [2025-10-01T20:44:57.424957] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:44:57.434751] [DEBUG] [LOCAL ] ONIT: Loaded 7735 existing records from primary storage. [2025-10-01T20:44:57.434994] [INFO ] [MAIN ] ONIT: Loaded 7735 existing records. [2025-10-01T20:44:57.631705] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T20:44:57.652012] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:44:57.659261] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-01T20:44:57.659357] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-01T20:44:57.660092] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-01T20:44:57.660158] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-01T20:44:57.707472] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-01T20:44:57.933839] [DEBUG] [REMOTE ] OLP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:44:57.951754] [WARN ] [REMOTE ] OLP: No data returned for month 2025-10 [2025-10-01T20:44:57.975931] [FATAL] [REMOTE ] OLP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:44:57.976049] [FATAL] [MAIN ] OLP: Failed to fetch primary data. [2025-10-01T20:44:57.981814] [WARN ] [MAIN ] OLP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:44:57.987025] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-01T20:44:58.002523] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-01T20:44:58.022370] [INFO ] [LOCAL ] OLP: Starting deletion of derivative data. [2025-10-01T20:44:58.060878] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:58.054843] [DEBUG] [LOCAL ] OLP: Deleted derivative data file. [2025-10-01T20:44:58.061362] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OLP took 35.3s. Estimated remaining: 1h 49m 51s. Rate: 7.1 symbols/min [2025-10-01T20:44:58.248052] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:44:58.278101] [DEBUG] [LOCAL ] ONL: Loaded 30730 existing records from primary storage. [2025-10-01T20:44:58.278387] [INFO ] [MAIN ] ONL: Loaded 30730 existing records. [2025-10-01T20:44:58.474033] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:44:58.474293] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-01T20:44:58.474348] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-01T20:44:58.475088] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-01T20:44:58.475151] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-01T20:44:58.502413] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-01T20:44:58.861677] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:44:59.302380] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-01T20:45:00.102356] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-01T20:45:00.282367] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T20:45:00.507928] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T20:45:00.902444] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-01T20:45:01.410086] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T20:45:01.702433] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-01T20:45:02.502383] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-01T20:45:02.638861] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T20:45:03.302349] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-01T20:45:03.485053] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T20:45:03.673305] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T20:45:04.102383] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-01T20:45:04.902390] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-01T20:45:05.056157] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T20:45:05.314626] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T20:45:05.493750] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-01T20:45:05.702386] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-01T20:45:06.379458] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T20:45:06.502398] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-01T20:45:07.302384] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-01T20:45:07.868985] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T20:45:08.102380] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-01T20:45:08.886632] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T20:45:08.913825] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-01T20:45:08.920597] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T20:45:09.702382] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-01T20:45:10.502371] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-01T20:45:10.584753] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T20:45:11.302385] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-01T20:45:11.515347] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T20:45:11.900463] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T20:45:12.102380] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-01T20:45:12.876495] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T20:45:12.902363] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-01T20:45:13.698437] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T20:45:13.705988] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-01T20:45:14.182726] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-01T20:45:14.502357] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-01T20:45:14.549735] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T20:45:15.302424] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-01T20:45:16.102367] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-01T20:45:16.188064] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T20:45:16.203171] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T20:45:16.431994] [DEBUG] [REMOTE ] OMF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:45:16.432370] [WARN ] [REMOTE ] OMF: No data returned for month 2025-10 [2025-10-01T20:45:16.432472] [FATAL] [REMOTE ] OMF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:45:16.432584] [FATAL] [MAIN ] OMF: Failed to fetch primary data. [2025-10-01T20:45:16.432723] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:45:16.432814] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-01T20:45:16.432895] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-01T20:45:16.432949] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-01T20:45:16.433389] [DEBUG] [LOCAL ] OMF: Deleted derivative data file. [2025-10-01T20:45:16.433492] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMF took 37.6s. Estimated remaining: 1h 49m 47s. Rate: 7.1 symbols/min [2025-10-01T20:45:16.629245] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:45:16.681808] [DEBUG] [LOCAL ] ONON: Loaded 53612 existing records from primary storage. [2025-10-01T20:45:16.682170] [INFO ] [MAIN ] ONON: Loaded 53612 existing records. [2025-10-01T20:45:16.882749] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:45:16.882957] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-01T20:45:16.883005] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-01T20:45:16.884270] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-01T20:45:16.884333] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-01T20:45:16.907519] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-01T20:45:17.329835] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:45:17.702399] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-01T20:45:18.435971] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T20:45:18.502426] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-01T20:45:19.302384] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-01T20:45:19.443180] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T20:45:20.102472] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-01T20:45:20.122096] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T20:45:20.558536] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T20:45:20.902420] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-01T20:45:21.286127] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T20:45:21.702458] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-01T20:45:22.502356] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-01T20:45:22.539831] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T20:45:22.866155] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-01T20:45:23.302500] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-01T20:45:24.102397] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-01T20:45:24.216002] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T20:45:24.454425] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T20:45:24.902401] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-01T20:45:25.702388] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-01T20:45:25.721473] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T20:45:25.990022] [DEBUG] [REMOTE ] ONL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:45:26.005845] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T20:45:26.003952] [WARN ] [REMOTE ] ONL: No data returned for month 2025-10 [2025-10-01T20:45:26.016459] [FATAL] [REMOTE ] ONL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:45:26.016998] [FATAL] [MAIN ] ONL: Failed to fetch primary data. [2025-10-01T20:45:26.017085] [WARN ] [MAIN ] ONL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:45:26.017176] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-01T20:45:26.017254] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-01T20:45:26.017294] [INFO ] [LOCAL ] ONL: Starting deletion of derivative data. [2025-10-01T20:45:26.018338] [DEBUG] [LOCAL ] ONL: Deleted derivative data file. [2025-10-01T20:45:26.018730] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONL took 28.0s. Estimated remaining: 1h 49m 39s. Rate: 7.1 symbols/min [2025-10-01T20:45:26.202782] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:45:26.226552] [DEBUG] [LOCAL ] ONTF: Loaded 22578 existing records from primary storage. [2025-10-01T20:45:26.226924] [INFO ] [MAIN ] ONTF: Loaded 22578 existing records. [2025-10-01T20:45:26.408278] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:45:26.408565] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-01T20:45:26.408618] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-01T20:45:26.410060] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-01T20:45:26.410125] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-01T20:45:26.509743] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-01T20:45:26.776760] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:45:26.845152] [DEBUG] [REMOTE ] OMI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:45:26.845672] [WARN ] [REMOTE ] OMI: No data returned for month 2025-10 [2025-10-01T20:45:26.845801] [FATAL] [REMOTE ] OMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:45:26.845944] [FATAL] [MAIN ] OMI: Failed to fetch primary data. [2025-10-01T20:45:26.846019] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:45:26.846133] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-01T20:45:26.846211] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-01T20:45:26.846252] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-01T20:45:26.846602] [DEBUG] [LOCAL ] OMI: Deleted derivative data file. [2025-10-01T20:45:26.846743] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. OMI took 40.0s. Estimated remaining: 1h 49m 27s. Rate: 7.1 symbols/min [2025-10-01T20:45:27.039133] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:45:27.090061] [DEBUG] [LOCAL ] ONTO: Loaded 46658 existing records from primary storage. [2025-10-01T20:45:27.090439] [INFO ] [MAIN ] ONTO: Loaded 46658 existing records. [2025-10-01T20:45:27.294837] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:45:27.295076] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-01T20:45:27.295125] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-01T20:45:27.296844] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-10-01T20:45:27.296907] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-01T20:45:27.308803] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-01T20:45:27.748371] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:45:28.102421] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-01T20:45:28.233615] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T20:45:28.902418] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-01T20:45:29.211326] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T20:45:29.702441] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-01T20:45:30.502502] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-01T20:45:30.778374] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T20:45:31.300555] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T20:45:31.302427] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-01T20:45:31.334535] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T20:45:32.102455] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-01T20:45:32.413721] [DEBUG] [REMOTE ] ONIT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:45:32.414091] [WARN ] [REMOTE ] ONIT: No data returned for month 2025-10 [2025-10-01T20:45:32.414202] [FATAL] [REMOTE ] ONIT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:45:32.414308] [FATAL] [MAIN ] ONIT: Failed to fetch primary data. [2025-10-01T20:45:32.414387] [WARN ] [MAIN ] ONIT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:45:32.414505] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-01T20:45:32.414617] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-01T20:45:32.414762] [INFO ] [LOCAL ] ONIT: Starting deletion of derivative data. [2025-10-01T20:45:32.415262] [DEBUG] [LOCAL ] ONIT: Deleted derivative data file. [2025-10-01T20:45:32.415366] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONIT took 35.2s. Estimated remaining: 1h 49m 17s. Rate: 7.1 symbols/min [2025-10-01T20:45:32.902450] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-01T20:45:33.350018] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T20:45:33.702371] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-01T20:45:34.502450] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-01T20:45:34.680129] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T20:45:35.302427] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-01T20:45:35.424192] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T20:45:35.969397] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-01T20:45:36.102387] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-01T20:45:36.902362] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-01T20:45:37.170339] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-01T20:45:37.702363] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-01T20:45:38.005316] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T20:45:38.035254] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-01T20:45:38.502398] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-01T20:45:39.302411] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-01T20:45:39.476535] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T20:45:40.107552] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-01T20:45:40.125807] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T20:45:40.154281] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T20:45:40.902439] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-01T20:45:41.702357] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-01T20:45:41.980920] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T20:45:42.502401] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-01T20:45:42.771491] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T20:45:43.311719] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-01T20:45:43.336544] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-01T20:45:44.102370] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-01T20:45:44.439253] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T20:45:44.489370] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T20:45:44.902390] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-01T20:45:45.702378] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-01T20:45:45.950080] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T20:45:46.175147] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-01T20:45:46.502396] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-01T20:45:47.302367] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-01T20:45:47.460399] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T20:45:47.492475] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T20:45:47.550229] [DEBUG] [REMOTE ] ONON: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:45:47.550565] [WARN ] [REMOTE ] ONON: No data returned for month 2025-10 [2025-10-01T20:45:47.550733] [FATAL] [REMOTE ] ONON: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:45:47.550863] [FATAL] [MAIN ] ONON: Failed to fetch primary data. [2025-10-01T20:45:47.550948] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:45:47.551037] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-01T20:45:47.551130] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-01T20:45:47.551187] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-01T20:45:47.552026] [DEBUG] [LOCAL ] ONON: Deleted derivative data file. [2025-10-01T20:45:47.552129] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONON took 31.1s. Estimated remaining: 1h 49m 12s. Rate: 7.1 symbols/min [2025-10-01T20:45:48.102413] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-01T20:45:48.902410] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-01T20:45:49.591147] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T20:45:49.702372] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-01T20:45:50.092055] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T20:45:50.502439] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-01T20:45:51.431210] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T20:45:51.442034] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-01T20:45:51.693062] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T20:45:52.102395] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-01T20:45:52.334001] [DEBUG] [REMOTE ] ONTF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:45:52.334346] [WARN ] [REMOTE ] ONTF: No data returned for month 2025-10 [2025-10-01T20:45:52.334460] [FATAL] [REMOTE ] ONTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:45:52.334595] [FATAL] [MAIN ] ONTF: Failed to fetch primary data. [2025-10-01T20:45:52.334708] [WARN ] [MAIN ] ONTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:45:52.334803] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-01T20:45:52.334887] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-01T20:45:52.334926] [INFO ] [LOCAL ] ONTF: Starting deletion of derivative data. [2025-10-01T20:45:52.335357] [DEBUG] [LOCAL ] ONTF: Deleted derivative data file. [2025-10-01T20:45:52.335450] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTF took 26.3s. Estimated remaining: 1h 49m 1s. Rate: 7.1 symbols/min [2025-10-01T20:45:53.283422] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T20:45:53.294774] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-01T20:45:53.617465] [DEBUG] [REMOTE ] ONTO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:45:53.617871] [WARN ] [REMOTE ] ONTO: No data returned for month 2025-10 [2025-10-01T20:45:53.617969] [FATAL] [REMOTE ] ONTO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:45:53.618053] [FATAL] [MAIN ] ONTO: Failed to fetch primary data. [2025-10-01T20:45:53.618120] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:45:53.618193] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-01T20:45:53.618257] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-01T20:45:53.618292] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-01T20:45:53.618795] [DEBUG] [LOCAL ] ONTO: Deleted derivative data file. [2025-10-01T20:45:53.618886] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. ONTO took 26.8s. Estimated remaining: 1h 48m 50s. Rate: 7.1 symbols/min [2025-10-01T20:45:54.379414] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:45:54.466222] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:45:54.469609] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:45:54.491429] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:45:54.511696] [DEBUG] [LOCAL ] OPP: Loaded 11643 existing records from primary storage. [2025-10-01T20:45:54.512221] [INFO ] [MAIN ] OPP: Loaded 11643 existing records. [2025-10-01T20:45:54.586596] [DEBUG] [LOCAL ] OOMA: Loaded 18846 existing records from primary storage. [2025-10-01T20:45:54.635520] [INFO ] [MAIN ] OOMA: Loaded 18846 existing records. [2025-10-01T20:45:54.641730] [DEBUG] [LOCAL ] OPAD: Loaded 21396 existing records from primary storage. [2025-10-01T20:45:54.702939] [INFO ] [MAIN ] OPAD: Loaded 21396 existing records. [2025-10-01T20:45:54.938391] [DEBUG] [LOCAL ] OPFI: Loaded 46477 existing records from primary storage. [2025-10-01T20:45:54.984410] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:45:54.994940] [INFO ] [MAIN ] OPFI: Loaded 46477 existing records. [2025-10-01T20:45:55.068351] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-01T20:45:55.095776] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-01T20:45:55.169638] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-01T20:45:55.174984] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-01T20:45:55.188234] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:45:55.245706] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-01T20:45:55.307725] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-01T20:45:55.424079] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-01T20:45:55.515556] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:45:55.487761] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:45:55.521014] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-01T20:45:55.538775] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-01T20:45:55.539135] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-01T20:45:55.562125] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-01T20:45:55.614836] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-01T20:45:55.614718] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-01T20:45:55.678765] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-01T20:45:55.712254] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-01T20:45:55.771917] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-01T20:45:56.741763] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:45:56.851279] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:45:56.906224] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-01T20:45:56.895071] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-01T20:45:57.047160] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:45:57.050517] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-01T20:45:57.142562] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:45:57.142957] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-01T20:45:57.855249] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T20:45:57.860154] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-01T20:45:57.904277] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T20:45:57.906936] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-01T20:45:58.101832] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T20:45:58.502358] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-01T20:45:58.525596] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T20:45:58.658332] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T20:45:58.735354] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T20:45:59.107221] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T20:45:59.302376] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-01T20:45:59.963008] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T20:46:00.102426] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-01T20:46:00.902386] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-01T20:46:01.702388] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-01T20:46:01.910943] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T20:46:02.285176] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-01T20:46:02.405761] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-01T20:46:02.502392] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-01T20:46:03.302404] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-01T20:46:04.086267] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T20:46:04.088958] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T20:46:04.103293] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-01T20:46:04.785526] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T20:46:04.902382] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-01T20:46:05.702376] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-01T20:46:06.502359] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-01T20:46:06.514298] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T20:46:06.869496] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T20:46:07.302396] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-01T20:46:07.491992] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T20:46:08.102388] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-01T20:46:08.902392] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-01T20:46:09.069981] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T20:46:09.094481] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T20:46:09.358745] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-01T20:46:09.702373] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-01T20:46:10.502395] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-01T20:46:11.123351] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T20:46:11.303119] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-01T20:46:11.306704] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T20:46:12.102416] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-01T20:46:12.902393] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-01T20:46:12.957882] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T20:46:13.044064] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T20:46:13.702440] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-01T20:46:14.298187] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T20:46:14.502402] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-01T20:46:14.580100] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T20:46:15.302439] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-01T20:46:15.728436] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T20:46:15.949902] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T20:46:16.102386] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-01T20:46:16.902378] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-01T20:46:17.318547] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T20:46:17.702413] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-01T20:46:18.388708] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T20:46:18.502382] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-01T20:46:19.302352] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-01T20:46:19.431794] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T20:46:19.692886] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T20:46:20.102394] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-01T20:46:20.767274] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-01T20:46:20.902423] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-01T20:46:20.980565] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T20:46:21.702385] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-01T20:46:22.392461] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T20:46:22.502391] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-01T20:46:22.600780] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T20:46:23.302393] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-01T20:46:24.102426] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-01T20:46:24.350524] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T20:46:24.842742] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-01T20:46:24.902381] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-01T20:46:25.154077] [DEBUG] [REMOTE ] OPAD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:46:25.154424] [WARN ] [REMOTE ] OPAD: No data returned for month 2025-10 [2025-10-01T20:46:25.154531] [FATAL] [REMOTE ] OPAD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:46:25.154616] [FATAL] [MAIN ] OPAD: Failed to fetch primary data. [2025-10-01T20:46:25.154702] [WARN ] [MAIN ] OPAD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:46:25.154778] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-01T20:46:25.154843] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-01T20:46:25.154881] [INFO ] [LOCAL ] OPAD: Starting deletion of derivative data. [2025-10-01T20:46:25.155293] [DEBUG] [LOCAL ] OPAD: Deleted derivative data file. [2025-10-01T20:46:25.155406] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPAD took 31.5s. Estimated remaining: 1h 48m 52s. Rate: 7.1 symbols/min [2025-10-01T20:46:25.352545] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:46:25.352791] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-01T20:46:25.352879] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-01T20:46:25.353007] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-01T20:46:25.353048] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-01T20:46:25.353090] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-01T20:46:25.353123] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-01T20:46:25.705419] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-01T20:46:25.798335] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:46:25.833239] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T20:46:26.102855] [DEBUG] [REMOTE ] OOMA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:46:26.103178] [WARN ] [REMOTE ] OOMA: No data returned for month 2025-10 [2025-10-01T20:46:26.103275] [FATAL] [REMOTE ] OOMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:46:26.103358] [FATAL] [MAIN ] OOMA: Failed to fetch primary data. [2025-10-01T20:46:26.103422] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:46:26.103497] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-01T20:46:26.103562] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-01T20:46:26.103600] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-01T20:46:26.103963] [DEBUG] [LOCAL ] OOMA: Deleted derivative data file. [2025-10-01T20:46:26.104084] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OOMA took 32.5s. Estimated remaining: 1h 48m 40s. Rate: 7.1 symbols/min [2025-10-01T20:46:26.295494] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:46:26.347703] [DEBUG] [LOCAL ] OR: Loaded 46074 existing records from primary storage. [2025-10-01T20:46:26.348095] [INFO ] [MAIN ] OR: Loaded 46074 existing records. [2025-10-01T20:46:26.513210] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-01T20:46:26.568481] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:46:26.568933] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-01T20:46:26.568988] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-01T20:46:26.569535] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-01T20:46:26.569599] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-01T20:46:26.966085] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:46:27.302431] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-01T20:46:27.434870] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T20:46:28.102397] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-01T20:46:28.364216] [DEBUG] [REMOTE ] OPFI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:46:28.364585] [WARN ] [REMOTE ] OPFI: No data returned for month 2025-10 [2025-10-01T20:46:28.364738] [FATAL] [REMOTE ] OPFI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:46:28.364875] [FATAL] [MAIN ] OPFI: Failed to fetch primary data. [2025-10-01T20:46:28.364999] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:46:28.365104] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-01T20:46:28.365188] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-01T20:46:28.365272] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-01T20:46:28.365789] [DEBUG] [LOCAL ] OPFI: Deleted derivative data file. [2025-10-01T20:46:28.365897] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPFI took 34.7s. Estimated remaining: 1h 48m 29s. Rate: 7.1 symbols/min [2025-10-01T20:46:28.568903] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:46:28.598586] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T20:46:28.646971] [DEBUG] [LOCAL ] ORA: Loaded 32445 existing records from primary storage. [2025-10-01T20:46:28.647374] [INFO ] [MAIN ] ORA: Loaded 32445 existing records. [2025-10-01T20:46:28.854524] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:46:28.854828] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-01T20:46:28.854887] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-01T20:46:28.856423] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-10-01T20:46:28.856496] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-01T20:46:28.907617] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-01T20:46:29.263190] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:46:29.702380] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-01T20:46:30.455022] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-01T20:46:30.502367] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-01T20:46:30.595805] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T20:46:31.208710] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T20:46:31.302453] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-01T20:46:32.102422] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-01T20:46:32.902375] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-01T20:46:33.007726] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T20:46:33.120186] [DEBUG] [REMOTE ] OPP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:46:33.120536] [WARN ] [REMOTE ] OPP: No data returned for month 2025-10 [2025-10-01T20:46:33.120634] [FATAL] [REMOTE ] OPP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:46:33.120842] [FATAL] [MAIN ] OPP: Failed to fetch primary data. [2025-10-01T20:46:33.120915] [WARN ] [MAIN ] OPP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:46:33.120987] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-01T20:46:33.121055] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-10-01T20:46:33.121094] [INFO ] [LOCAL ] OPP: Starting deletion of derivative data. [2025-10-01T20:46:33.121547] [DEBUG] [LOCAL ] OPP: Deleted derivative data file. [2025-10-01T20:46:33.121672] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPP took 39.5s. Estimated remaining: 1h 48m 18s. Rate: 7.1 symbols/min [2025-10-01T20:46:33.313391] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:46:33.370573] [DEBUG] [LOCAL ] ORC: Loaded 52357 existing records from primary storage. [2025-10-01T20:46:33.370953] [INFO ] [MAIN ] ORC: Loaded 52357 existing records. [2025-10-01T20:46:33.587287] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:46:33.587510] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-01T20:46:33.587561] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-01T20:46:33.597148] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-01T20:46:33.612071] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-01T20:46:33.619319] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T20:46:33.703530] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-01T20:46:34.017442] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:46:34.502412] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-01T20:46:35.296250] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T20:46:35.302331] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-01T20:46:35.368444] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T20:46:36.102396] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-01T20:46:36.756698] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T20:46:36.902386] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-01T20:46:37.702391] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-01T20:46:37.751757] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T20:46:38.417252] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-01T20:46:38.502427] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-01T20:46:39.060071] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T20:46:39.302383] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-01T20:46:39.856901] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T20:46:40.102358] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-01T20:46:40.187051] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T20:46:40.902386] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-01T20:46:41.702386] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-01T20:46:42.044515] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:46:42.483051] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T20:46:42.502380] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-01T20:46:43.271800] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T20:46:43.302356] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-01T20:46:43.773374] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T20:46:44.102389] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-01T20:46:44.902404] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-01T20:46:45.376835] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-01T20:46:45.608346] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T20:46:45.702377] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-01T20:46:46.502392] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-01T20:46:46.537038] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T20:46:46.712941] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T20:46:47.302390] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-01T20:46:48.102399] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-01T20:46:48.213298] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T20:46:48.701897] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-01T20:46:48.902419] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-01T20:46:49.310227] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T20:46:49.702377] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-01T20:46:50.447095] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-01T20:46:50.502385] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-01T20:46:51.302381] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-01T20:46:51.759072] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-01T20:46:52.102387] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-01T20:46:52.178060] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T20:46:52.179772] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T20:46:52.902377] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-01T20:46:53.702384] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-01T20:46:53.836377] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T20:46:54.234009] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T20:46:54.502377] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-01T20:46:54.537714] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T20:46:55.302402] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-01T20:46:55.593354] [DEBUG] [REMOTE ] OPY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:46:55.593703] [WARN ] [REMOTE ] OPY: No data returned for month 2025-10 [2025-10-01T20:46:55.593810] [FATAL] [REMOTE ] OPY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:46:55.593922] [FATAL] [MAIN ] OPY: Failed to fetch primary data. [2025-10-01T20:46:55.593990] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:46:55.594065] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-01T20:46:55.594165] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-01T20:46:55.594210] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-01T20:46:55.594252] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-01T20:46:55.594302] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. OPY took 30.4s. Estimated remaining: 1h 48m 17s. Rate: 7.1 symbols/min [2025-10-01T20:46:55.777452] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:46:55.777696] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-01T20:46:55.777755] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-01T20:46:55.777889] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-01T20:46:55.777948] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-01T20:46:55.778000] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-01T20:46:55.778051] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-01T20:46:56.122049] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-01T20:46:56.167463] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:46:56.237499] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T20:46:56.902389] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-01T20:46:57.702582] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-01T20:46:57.705496] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T20:46:58.502390] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-01T20:46:59.308007] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-01T20:46:59.322972] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-01T20:46:59.982996] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T20:47:00.102387] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-01T20:47:00.283532] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-01T20:47:00.337488] [DEBUG] [REMOTE ] ORA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:00.337951] [WARN ] [REMOTE ] ORA: No data returned for month 2025-10 [2025-10-01T20:47:00.338044] [FATAL] [REMOTE ] ORA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:00.338136] [FATAL] [MAIN ] ORA: Failed to fetch primary data. [2025-10-01T20:47:00.338200] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:00.338273] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-01T20:47:00.338338] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-01T20:47:00.338376] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-01T20:47:00.338729] [DEBUG] [LOCAL ] ORA: Deleted derivative data file. [2025-10-01T20:47:00.338831] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. ORA took 32.0s. Estimated remaining: 1h 48m 6s. Rate: 7.1 symbols/min [2025-10-01T20:47:00.541386] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:00.541690] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-01T20:47:00.541761] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-01T20:47:00.541907] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-01T20:47:00.541965] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-01T20:47:00.542014] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-01T20:47:00.542049] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-01T20:47:00.909078] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-01T20:47:00.932290] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:00.965318] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T20:47:01.702384] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-01T20:47:02.502417] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-01T20:47:03.302380] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-01T20:47:03.389051] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:47:03.534462] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-01T20:47:04.102359] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-01T20:47:04.358052] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-01T20:47:04.902372] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-01T20:47:05.173261] [DEBUG] [REMOTE ] OR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:05.173689] [WARN ] [REMOTE ] OR: No data returned for month 2025-10 [2025-10-01T20:47:05.173960] [FATAL] [REMOTE ] OR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:05.174238] [FATAL] [MAIN ] OR: Failed to fetch primary data. [2025-10-01T20:47:05.174455] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:05.174556] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-01T20:47:05.205245] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-01T20:47:05.205428] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-01T20:47:05.206061] [DEBUG] [LOCAL ] OR: Deleted derivative data file. [2025-10-01T20:47:05.207350] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. OR took 39.1s. Estimated remaining: 1h 47m 56s. Rate: 7.1 symbols/min [2025-10-01T20:47:05.207272] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T20:47:05.415990] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:05.452589] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T20:47:05.487137] [DEBUG] [LOCAL ] ORN: Loaded 31091 existing records from primary storage. [2025-10-01T20:47:05.487461] [INFO ] [MAIN ] ORN: Loaded 31091 existing records. [2025-10-01T20:47:05.684283] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:47:05.684529] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-01T20:47:05.684579] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-01T20:47:05.685180] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-01T20:47:05.685242] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-01T20:47:05.707700] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-01T20:47:06.087622] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:06.502392] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-01T20:47:07.302393] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-01T20:47:07.913107] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T20:47:07.950991] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-01T20:47:08.102387] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-01T20:47:08.902405] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-01T20:47:09.017064] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T20:47:09.160513] [DEBUG] [REMOTE ] ORC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:09.160945] [WARN ] [REMOTE ] ORC: No data returned for month 2025-10 [2025-10-01T20:47:09.161021] [FATAL] [REMOTE ] ORC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:09.161107] [FATAL] [MAIN ] ORC: Failed to fetch primary data. [2025-10-01T20:47:09.161185] [WARN ] [MAIN ] ORC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:09.161278] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-01T20:47:09.161347] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-01T20:47:09.161387] [INFO ] [LOCAL ] ORC: Starting deletion of derivative data. [2025-10-01T20:47:09.161808] [DEBUG] [LOCAL ] ORC: Deleted derivative data file. [2025-10-01T20:47:09.161922] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORC took 36.0s. Estimated remaining: 1h 47m 45s. Rate: 7.1 symbols/min [2025-10-01T20:47:09.355816] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:09.412278] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-10-01T20:47:09.412679] [INFO ] [MAIN ] OSCR: Loaded 53722 existing records. [2025-10-01T20:47:09.621980] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:47:09.622228] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-01T20:47:09.622276] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-01T20:47:09.622877] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-10-01T20:47:09.622937] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-01T20:47:09.707512] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-01T20:47:10.022816] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:10.502412] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-01T20:47:10.542945] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-01T20:47:11.074568] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T20:47:11.302386] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-01T20:47:12.102413] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-01T20:47:12.271446] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T20:47:12.902423] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-01T20:47:13.305681] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-01T20:47:13.597432] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-01T20:47:13.702406] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-01T20:47:14.502402] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-01T20:47:14.885813] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T20:47:15.302405] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-01T20:47:15.932526] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T20:47:16.057571] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-01T20:47:16.102346] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-01T20:47:16.902405] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-01T20:47:17.141523] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T20:47:17.702400] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-01T20:47:18.116134] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-01T20:47:18.308896] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T20:47:18.502452] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-01T20:47:19.214184] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T20:47:19.302378] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-01T20:47:19.460692] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T20:47:20.102394] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-01T20:47:20.902404] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-01T20:47:21.315793] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-01T20:47:21.342993] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T20:47:21.702452] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-01T20:47:22.502428] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-01T20:47:23.302352] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-01T20:47:23.594526] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-01T20:47:23.812922] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-01T20:47:24.102384] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-01T20:47:24.278979] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T20:47:24.316791] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T20:47:24.902388] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-01T20:47:25.702395] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-01T20:47:26.507535] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-01T20:47:26.529566] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T20:47:26.756637] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-01T20:47:27.093790] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T20:47:27.302394] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-01T20:47:28.102354] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-01T20:47:28.557043] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T20:47:28.902408] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-01T20:47:29.134724] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T20:47:29.201378] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T20:47:29.702397] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-01T20:47:30.502395] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-01T20:47:31.227626] [DEBUG] [REMOTE ] ORN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:31.228050] [WARN ] [REMOTE ] ORN: No data returned for month 2025-10 [2025-10-01T20:47:31.228162] [FATAL] [REMOTE ] ORN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:31.228252] [FATAL] [MAIN ] ORN: Failed to fetch primary data. [2025-10-01T20:47:31.228319] [WARN ] [MAIN ] ORN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:31.228397] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-01T20:47:31.228478] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-01T20:47:31.228538] [INFO ] [LOCAL ] ORN: Starting deletion of derivative data. [2025-10-01T20:47:31.228984] [DEBUG] [LOCAL ] ORN: Deleted derivative data file. [2025-10-01T20:47:31.229101] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORN took 26.0s. Estimated remaining: 1h 47m 43s. Rate: 7.1 symbols/min [2025-10-01T20:47:31.307503] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-01T20:47:31.476487] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:31.511070] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-01T20:47:31.511358] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-01T20:47:31.511578] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-01T20:47:31.512365] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-01T20:47:31.514521] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-01T20:47:31.514939] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-01T20:47:31.525848] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-01T20:47:31.830008] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-01T20:47:31.961589] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:32.102364] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-01T20:47:32.489324] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T20:47:32.902391] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-01T20:47:33.583271] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T20:47:33.702382] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-01T20:47:34.502398] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-01T20:47:34.746897] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-01T20:47:35.279201] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T20:47:35.302341] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-01T20:47:35.925404] [DEBUG] [REMOTE ] ORI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:35.925777] [WARN ] [REMOTE ] ORI: No data returned for month 2025-10 [2025-10-01T20:47:35.925888] [FATAL] [REMOTE ] ORI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:35.926019] [FATAL] [MAIN ] ORI: Failed to fetch primary data. [2025-10-01T20:47:35.926107] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:35.926204] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-01T20:47:35.926303] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-01T20:47:35.926363] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-01T20:47:35.926410] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-01T20:47:35.926473] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORI took 35.6s. Estimated remaining: 1h 47m 33s. Rate: 7.1 symbols/min [2025-10-01T20:47:36.114491] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-01T20:47:36.119108] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:36.119491] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-01T20:47:36.120381] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-01T20:47:36.120518] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-01T20:47:36.120576] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-01T20:47:36.120639] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-01T20:47:36.120746] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-01T20:47:36.527717] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:36.556927] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-01T20:47:36.613922] [DEBUG] [REMOTE ] ORCL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:36.614279] [WARN ] [REMOTE ] ORCL: No data returned for month 2025-10 [2025-10-01T20:47:36.614369] [FATAL] [REMOTE ] ORCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:36.614456] [FATAL] [MAIN ] ORCL: Failed to fetch primary data. [2025-10-01T20:47:36.614518] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:36.614602] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-01T20:47:36.614722] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-01T20:47:36.614799] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-01T20:47:36.614886] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-01T20:47:36.614944] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. ORCL took 41.0s. Estimated remaining: 1h 47m 21s. Rate: 7.1 symbols/min [2025-10-01T20:47:36.809828] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:36.810042] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-01T20:47:36.810087] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-01T20:47:36.810205] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-01T20:47:36.810248] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-01T20:47:36.810291] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-01T20:47:36.810326] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-01T20:47:36.907574] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-01T20:47:37.214413] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:37.284909] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:37.285240] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-01T20:47:37.285333] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:37.285388] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-01T20:47:37.285451] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:37.285525] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-01T20:47:37.285591] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-01T20:47:37.285630] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-01T20:47:37.285717] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-01T20:47:37.285775] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OTF took 1.4s. Estimated remaining: 1h 47m 9s. Rate: 7.1 symbols/min [2025-10-01T20:47:37.482091] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:37.534923] [DEBUG] [LOCAL ] OUT: Loaded 47822 existing records from primary storage. [2025-10-01T20:47:37.535331] [INFO ] [MAIN ] OUT: Loaded 47822 existing records. [2025-10-01T20:47:37.707534] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-01T20:47:37.748914] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:47:37.749132] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-01T20:47:37.749229] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-01T20:47:37.749883] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-10-01T20:47:37.749945] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-01T20:47:38.163020] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:38.502388] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-01T20:47:38.634719] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T20:47:39.302383] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-01T20:47:40.102390] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-01T20:47:40.904621] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-01T20:47:40.911540] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T20:47:41.011608] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T20:47:41.068520] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-01T20:47:41.702388] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-01T20:47:42.502427] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-01T20:47:42.588832] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T20:47:43.302369] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-01T20:47:43.409813] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T20:47:44.040325] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-01T20:47:44.102369] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-01T20:47:44.902938] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-01T20:47:44.906992] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T20:47:45.702382] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-01T20:47:45.831330] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T20:47:46.502383] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-01T20:47:47.252923] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T20:47:47.302372] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-01T20:47:47.508396] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-01T20:47:48.103581] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-01T20:47:48.108502] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T20:47:48.706233] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T20:47:48.902362] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-01T20:47:49.005400] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T20:47:49.702408] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-01T20:47:50.502354] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-01T20:47:50.532530] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T20:47:50.623055] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T20:47:51.302387] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-01T20:47:52.102360] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-01T20:47:52.282160] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T20:47:52.523459] [DEBUG] [REMOTE ] OSCR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:47:52.523853] [WARN ] [REMOTE ] OSCR: No data returned for month 2025-10 [2025-10-01T20:47:52.523955] [FATAL] [REMOTE ] OSCR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:47:52.524068] [FATAL] [MAIN ] OSCR: Failed to fetch primary data. [2025-10-01T20:47:52.524148] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:47:52.524223] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-01T20:47:52.524313] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-01T20:47:52.524368] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-01T20:47:52.524829] [DEBUG] [LOCAL ] OSCR: Deleted derivative data file. [2025-10-01T20:47:52.524990] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSCR took 43.4s. Estimated remaining: 1h 47m 4s. Rate: 7.1 symbols/min [2025-10-01T20:47:52.712266] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:47:52.739702] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T20:47:52.799975] [DEBUG] [LOCAL ] OVV: Loaded 53519 existing records from primary storage. [2025-10-01T20:47:52.800387] [INFO ] [MAIN ] OVV: Loaded 53519 existing records. [2025-10-01T20:47:52.907533] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-01T20:47:52.996290] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:47:52.996522] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-01T20:47:52.996571] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-01T20:47:52.997585] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-10-01T20:47:52.997698] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-01T20:47:53.391778] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:47:53.702368] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-01T20:47:53.873257] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T20:47:54.502384] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-01T20:47:55.228299] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-01T20:47:55.302376] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-01T20:47:55.630546] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T20:47:55.823264] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-01T20:47:56.102381] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-01T20:47:56.902354] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-01T20:47:57.033055] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T20:47:57.702376] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-01T20:47:58.502390] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-01T20:47:59.022806] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T20:47:59.238557] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T20:47:59.302385] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-01T20:47:59.436718] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-01T20:48:00.102395] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-01T20:48:00.902385] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-01T20:48:01.189116] [DEBUG] [REMOTE ] OTIS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:48:01.189444] [WARN ] [REMOTE ] OTIS: No data returned for month 2025-10 [2025-10-01T20:48:01.189539] [FATAL] [REMOTE ] OTIS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:48:01.189620] [FATAL] [MAIN ] OTIS: Failed to fetch primary data. [2025-10-01T20:48:01.189707] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:48:01.189781] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-01T20:48:01.189861] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-01T20:48:01.189918] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-01T20:48:01.189962] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-01T20:48:01.190010] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OTIS took 24.6s. Estimated remaining: 1h 46m 55s. Rate: 7.1 symbols/min [2025-10-01T20:48:01.381174] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:48:01.412772] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-01T20:48:01.477511] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-10-01T20:48:01.477893] [INFO ] [MAIN ] OWL: Loaded 53555 existing records. [2025-10-01T20:48:01.676800] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:48:01.677029] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-01T20:48:01.677116] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-01T20:48:01.677968] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-01T20:48:01.678030] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-01T20:48:01.709058] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-01T20:48:02.090982] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T20:48:02.140863] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:48:02.502380] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-01T20:48:03.130842] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T20:48:03.302380] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-01T20:48:04.102363] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-01T20:48:04.365691] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T20:48:04.786086] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T20:48:04.902445] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-01T20:48:05.702349] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-01T20:48:05.792414] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T20:48:06.502439] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-01T20:48:06.739751] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-01T20:48:07.007089] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-01T20:48:07.302379] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-01T20:48:08.111440] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-01T20:48:08.117054] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T20:48:08.902404] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-01T20:48:09.191249] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T20:48:09.714678] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-01T20:48:09.722823] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T20:48:10.131440] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T20:48:10.502388] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-01T20:48:11.302357] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-01T20:48:11.422016] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T20:48:11.847201] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T20:48:12.102401] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-01T20:48:12.902393] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-01T20:48:13.157787] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T20:48:13.168209] [DEBUG] [REMOTE ] OSK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:48:13.169299] [WARN ] [REMOTE ] OSK: No data returned for month 2025-10 [2025-10-01T20:48:13.169392] [FATAL] [REMOTE ] OSK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:48:13.169464] [FATAL] [MAIN ] OSK: Failed to fetch primary data. [2025-10-01T20:48:13.169528] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:48:13.169601] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-01T20:48:13.169690] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-01T20:48:13.169746] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-01T20:48:13.169791] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-01T20:48:13.169839] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OSK took 41.9s. Estimated remaining: 1h 46m 48s. Rate: 7.1 symbols/min [2025-10-01T20:48:13.359163] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:48:13.372195] [DEBUG] [LOCAL ] OWLT: Loaded 8831 existing records from primary storage. [2025-10-01T20:48:13.372504] [INFO ] [MAIN ] OWLT: Loaded 8831 existing records. [2025-10-01T20:48:13.573580] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:48:13.573824] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-01T20:48:13.573890] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-01T20:48:13.574303] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-01T20:48:13.574366] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-01T20:48:13.714695] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-01T20:48:14.055261] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:48:14.106287] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-01T20:48:14.502452] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-01T20:48:14.732093] [DEBUG] [REMOTE ] OUT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:48:14.732509] [WARN ] [REMOTE ] OUT: No data returned for month 2025-10 [2025-10-01T20:48:14.732617] [FATAL] [REMOTE ] OUT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:48:14.732787] [FATAL] [MAIN ] OUT: Failed to fetch primary data. [2025-10-01T20:48:14.732911] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:48:14.732983] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-01T20:48:14.733068] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-01T20:48:14.733131] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-01T20:48:14.733596] [DEBUG] [LOCAL ] OUT: Deleted derivative data file. [2025-10-01T20:48:14.733747] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OUT took 37.4s. Estimated remaining: 1h 46m 37s. Rate: 7.1 symbols/min [2025-10-01T20:48:14.946605] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:48:14.983856] [DEBUG] [LOCAL ] OXM: Loaded 33295 existing records from primary storage. [2025-10-01T20:48:14.984219] [INFO ] [MAIN ] OXM: Loaded 33295 existing records. [2025-10-01T20:48:15.198938] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:48:15.199248] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-01T20:48:15.199301] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-01T20:48:15.199584] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-10-01T20:48:15.199680] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-01T20:48:15.311342] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-01T20:48:15.612380] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:48:15.656232] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:48:16.102358] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-01T20:48:16.144279] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T20:48:16.902435] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-01T20:48:17.573086] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T20:48:17.702436] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-01T20:48:18.010169] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T20:48:18.502425] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-01T20:48:19.302373] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-01T20:48:19.404121] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T20:48:19.976185] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-01T20:48:20.102393] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-01T20:48:20.157402] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T20:48:20.902423] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-01T20:48:21.702415] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-01T20:48:21.952136] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T20:48:22.502387] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-01T20:48:22.561573] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T20:48:22.615079] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T20:48:23.302396] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-01T20:48:24.038518] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-01T20:48:24.102404] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-01T20:48:24.339296] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T20:48:24.902392] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-01T20:48:25.702398] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-01T20:48:25.971310] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T20:48:26.502409] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-01T20:48:26.680366] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T20:48:26.790765] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T20:48:26.955570] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T20:48:27.302435] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-01T20:48:28.102415] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-01T20:48:28.831964] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T20:48:28.902399] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-01T20:48:29.056203] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T20:48:29.146201] [DEBUG] [REMOTE ] OVV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:48:29.146507] [WARN ] [REMOTE ] OVV: No data returned for month 2025-10 [2025-10-01T20:48:29.146664] [FATAL] [REMOTE ] OVV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:48:29.146759] [FATAL] [MAIN ] OVV: Failed to fetch primary data. [2025-10-01T20:48:29.146803] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:48:29.146849] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-01T20:48:29.146907] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-01T20:48:29.146944] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-01T20:48:29.147257] [DEBUG] [LOCAL ] OVV: Deleted derivative data file. [2025-10-01T20:48:29.147346] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OVV took 36.6s. Estimated remaining: 1h 46m 31s. Rate: 7.1 symbols/min [2025-10-01T20:48:29.346461] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:48:29.346684] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-01T20:48:29.346739] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-01T20:48:29.346855] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-01T20:48:29.346897] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-01T20:48:29.346943] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-01T20:48:29.346976] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-01T20:48:29.707491] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-01T20:48:29.769795] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:48:30.502381] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-01T20:48:31.302360] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-01T20:48:31.501875] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T20:48:31.639522] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T20:48:32.102397] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-01T20:48:32.295066] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-01T20:48:32.902426] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-01T20:48:33.670090] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T20:48:33.702394] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-01T20:48:34.204061] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-01T20:48:34.502369] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-01T20:48:35.132887] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T20:48:35.302395] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-01T20:48:35.422502] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T20:48:35.926570] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T20:48:36.102397] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-01T20:48:36.902399] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-01T20:48:36.990674] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T20:48:37.157890] [DEBUG] [REMOTE ] OWL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:48:37.158230] [WARN ] [REMOTE ] OWL: No data returned for month 2025-10 [2025-10-01T20:48:37.158353] [FATAL] [REMOTE ] OWL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:48:37.158440] [FATAL] [MAIN ] OWL: Failed to fetch primary data. [2025-10-01T20:48:37.158479] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:48:37.158544] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-01T20:48:37.158609] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-01T20:48:37.158672] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-01T20:48:37.159015] [DEBUG] [LOCAL ] OWL: Deleted derivative data file. [2025-10-01T20:48:37.159106] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OWL took 36.0s. Estimated remaining: 1h 46m 22s. Rate: 7.1 symbols/min [2025-10-01T20:48:37.350458] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:48:37.411606] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-10-01T20:48:37.412101] [INFO ] [MAIN ] PAAS: Loaded 53603 existing records. [2025-10-01T20:48:37.612015] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:48:37.612296] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-01T20:48:37.612350] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-01T20:48:37.613427] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-01T20:48:37.613521] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-01T20:48:37.707473] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-01T20:48:38.012092] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:48:38.502437] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-01T20:48:38.820554] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T20:48:39.204368] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T20:48:39.302385] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-01T20:48:40.102380] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-01T20:48:40.458213] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T20:48:40.902427] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-01T20:48:41.617086] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T20:48:41.702390] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-01T20:48:41.986105] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T20:48:42.502396] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-01T20:48:42.870435] [DEBUG] [REMOTE ] OWLT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:48:42.870822] [WARN ] [REMOTE ] OWLT: No data returned for month 2025-10 [2025-10-01T20:48:42.870921] [FATAL] [REMOTE ] OWLT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:48:42.871049] [FATAL] [MAIN ] OWLT: Failed to fetch primary data. [2025-10-01T20:48:42.871136] [WARN ] [MAIN ] OWLT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:48:42.871227] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-01T20:48:42.871326] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-01T20:48:42.871395] [INFO ] [LOCAL ] OWLT: Starting deletion of derivative data. [2025-10-01T20:48:42.871934] [DEBUG] [LOCAL ] OWLT: Deleted derivative data file. [2025-10-01T20:48:42.872069] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OWLT took 29.7s. Estimated remaining: 1h 46m 12s. Rate: 7.1 symbols/min [2025-10-01T20:48:43.076022] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:48:43.091130] [DEBUG] [LOCAL ] PAC: Loaded 11555 existing records from primary storage. [2025-10-01T20:48:43.091378] [INFO ] [MAIN ] PAC: Loaded 11555 existing records. [2025-10-01T20:48:43.303195] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-01T20:48:43.307329] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:48:43.308884] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-01T20:48:43.362582] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-01T20:48:43.374034] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T20:48:43.373162] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-01T20:48:43.374194] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-01T20:48:43.789542] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:48:44.102384] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-01T20:48:44.315406] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T20:48:44.902380] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-01T20:48:45.213140] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T20:48:45.702369] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-01T20:48:46.502398] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-01T20:48:46.643436] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T20:48:46.950996] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T20:48:47.099056] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T20:48:47.302375] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-01T20:48:48.102383] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-01T20:48:48.902342] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-01T20:48:48.985812] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T20:48:49.167476] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-01T20:48:49.702384] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-01T20:48:50.468006] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T20:48:50.502388] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-01T20:48:50.627147] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T20:48:51.302384] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-01T20:48:51.565376] [DEBUG] [REMOTE ] OXM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:48:51.565728] [WARN ] [REMOTE ] OXM: No data returned for month 2025-10 [2025-10-01T20:48:51.565841] [FATAL] [REMOTE ] OXM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:48:51.565928] [FATAL] [MAIN ] OXM: Failed to fetch primary data. [2025-10-01T20:48:51.566002] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:48:51.566075] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-01T20:48:51.566139] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-01T20:48:51.566175] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-01T20:48:51.566554] [DEBUG] [LOCAL ] OXM: Deleted derivative data file. [2025-10-01T20:48:51.566666] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OXM took 36.8s. Estimated remaining: 1h 46m 4s. Rate: 7.1 symbols/min [2025-10-01T20:48:51.750074] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:48:51.785375] [DEBUG] [LOCAL ] PACK: Loaded 31771 existing records from primary storage. [2025-10-01T20:48:51.785740] [INFO ] [MAIN ] PACK: Loaded 31771 existing records. [2025-10-01T20:48:51.978920] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:48:51.979258] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-01T20:48:51.979339] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-01T20:48:51.981365] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-01T20:48:51.981445] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-01T20:48:52.106365] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-01T20:48:52.373542] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:48:52.416381] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T20:48:52.902396] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-01T20:48:52.986855] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T20:48:53.702380] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-01T20:48:54.502394] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-01T20:48:54.773420] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T20:48:54.956893] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T20:48:55.302384] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-01T20:48:55.408968] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T20:48:56.102386] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-01T20:48:56.324140] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T20:48:56.902369] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-01T20:48:57.702383] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-01T20:48:58.185166] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T20:48:58.217462] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T20:48:58.502384] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-01T20:48:58.696206] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T20:48:59.302373] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-01T20:49:00.102422] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-01T20:49:00.278741] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T20:49:00.451623] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T20:49:00.902365] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-01T20:49:01.196947] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T20:49:01.582891] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T20:49:01.702372] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-01T20:49:02.502350] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-01T20:49:02.605888] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T20:49:03.302378] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-01T20:49:03.973041] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T20:49:04.102377] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-01T20:49:04.330584] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T20:49:04.428321] [DEBUG] [REMOTE ] OXY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:49:04.428844] [WARN ] [REMOTE ] OXY: No data returned for month 2025-10 [2025-10-01T20:49:04.428969] [FATAL] [REMOTE ] OXY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:49:04.429095] [FATAL] [MAIN ] OXY: Failed to fetch primary data. [2025-10-01T20:49:04.429180] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:49:04.429278] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-01T20:49:04.429384] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-01T20:49:04.429460] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-01T20:49:04.429551] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-01T20:49:04.429639] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. OXY took 35.3s. Estimated remaining: 1h 45m 58s. Rate: 7.1 symbols/min [2025-10-01T20:49:04.619061] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:49:04.656402] [DEBUG] [LOCAL ] PACS: Loaded 34461 existing records from primary storage. [2025-10-01T20:49:04.656722] [INFO ] [MAIN ] PACS: Loaded 34461 existing records. [2025-10-01T20:49:04.854557] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:49:04.854787] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-01T20:49:04.854838] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-01T20:49:04.856150] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-01T20:49:04.856214] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-01T20:49:04.907726] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-01T20:49:05.275920] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:49:05.702383] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-01T20:49:06.502452] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-01T20:49:07.199416] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-01T20:49:07.302351] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-01T20:49:07.412484] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T20:49:07.519734] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T20:49:08.102399] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-01T20:49:08.902396] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-01T20:49:09.355707] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T20:49:09.443126] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-01T20:49:09.702396] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-01T20:49:10.332626] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T20:49:10.502421] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-01T20:49:11.302431] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-01T20:49:11.935228] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-01T20:49:11.950513] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T20:49:12.102387] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-01T20:49:12.323913] [DEBUG] [REMOTE ] PAAS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:49:12.324287] [WARN ] [REMOTE ] PAAS: No data returned for month 2025-10 [2025-10-01T20:49:12.324383] [FATAL] [REMOTE ] PAAS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:49:12.324474] [FATAL] [MAIN ] PAAS: Failed to fetch primary data. [2025-10-01T20:49:12.324544] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:49:12.324628] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-01T20:49:12.324749] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-01T20:49:12.324799] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-01T20:49:12.325319] [DEBUG] [LOCAL ] PAAS: Deleted derivative data file. [2025-10-01T20:49:12.325412] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PAAS took 35.2s. Estimated remaining: 1h 45m 49s. Rate: 7.1 symbols/min [2025-10-01T20:49:12.512862] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:49:12.536759] [DEBUG] [LOCAL ] PAG: Loaded 21779 existing records from primary storage. [2025-10-01T20:49:12.537032] [INFO ] [MAIN ] PAG: Loaded 21779 existing records. [2025-10-01T20:49:12.753098] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:49:12.753527] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-01T20:49:12.753724] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-01T20:49:12.760376] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-10-01T20:49:12.771586] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-01T20:49:12.778612] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T20:49:12.907482] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-01T20:49:13.179818] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:49:13.702405] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-01T20:49:14.080492] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T20:49:14.502433] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-01T20:49:14.765952] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T20:49:15.302402] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-01T20:49:16.071173] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T20:49:16.102345] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-01T20:49:16.902366] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-01T20:49:17.024225] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T20:49:17.138822] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T20:49:17.702436] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-01T20:49:18.020408] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T20:49:18.309386] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T20:49:18.502393] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-01T20:49:19.302442] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-01T20:49:19.757910] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T20:49:20.102382] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-01T20:49:20.691481] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T20:49:20.902430] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-01T20:49:21.167749] [DEBUG] [REMOTE ] PAC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:49:21.171663] [WARN ] [REMOTE ] PAC: No data returned for month 2025-10 [2025-10-01T20:49:21.171764] [FATAL] [REMOTE ] PAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:49:21.171900] [FATAL] [MAIN ] PAC: Failed to fetch primary data. [2025-10-01T20:49:21.171987] [WARN ] [MAIN ] PAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:49:21.172076] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-01T20:49:21.172159] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-01T20:49:21.172212] [INFO ] [LOCAL ] PAC: Starting deletion of derivative data. [2025-10-01T20:49:21.172608] [DEBUG] [LOCAL ] PAC: Deleted derivative data file. [2025-10-01T20:49:21.172755] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PAC took 38.3s. Estimated remaining: 1h 45m 41s. Rate: 7.1 symbols/min [2025-10-01T20:49:21.360797] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:49:21.418083] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T20:49:21.443347] [DEBUG] [LOCAL ] PAGS: Loaded 52710 existing records from primary storage. [2025-10-01T20:49:21.443746] [INFO ] [MAIN ] PAGS: Loaded 52710 existing records. [2025-10-01T20:49:21.636370] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:49:21.636564] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-01T20:49:21.636612] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-01T20:49:21.638952] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-01T20:49:21.639030] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-01T20:49:21.707504] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-01T20:49:22.035498] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:49:22.502432] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-01T20:49:23.302407] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-01T20:49:23.685561] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T20:49:23.794568] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-01T20:49:24.102388] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-01T20:49:24.470673] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T20:49:24.902359] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-01T20:49:24.935540] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T20:49:25.702402] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-01T20:49:26.207476] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T20:49:26.502380] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-01T20:49:27.087148] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T20:49:27.302441] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-01T20:49:28.102352] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-01T20:49:28.192692] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T20:49:28.220917] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T20:49:28.902391] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-01T20:49:29.559543] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T20:49:29.702395] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-01T20:49:30.201257] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T20:49:30.502380] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-01T20:49:31.119317] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T20:49:31.302424] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-01T20:49:31.679004] [DEBUG] [REMOTE ] PACS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:49:31.679322] [WARN ] [REMOTE ] PACS: No data returned for month 2025-10 [2025-10-01T20:49:31.679429] [FATAL] [REMOTE ] PACS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:49:31.679533] [FATAL] [MAIN ] PACS: Failed to fetch primary data. [2025-10-01T20:49:31.679607] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:49:31.679708] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-01T20:49:31.679780] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-01T20:49:31.679821] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-01T20:49:31.680115] [DEBUG] [LOCAL ] PACS: Deleted derivative data file. [2025-10-01T20:49:31.680205] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACS took 27.3s. Estimated remaining: 1h 45m 33s. Rate: 7.1 symbols/min [2025-10-01T20:49:31.869293] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:49:31.874202] [DEBUG] [LOCAL ] PAI: Loaded 2692 existing records from primary storage. [2025-10-01T20:49:31.874615] [INFO ] [MAIN ] PAI: Loaded 2692 existing records. [2025-10-01T20:49:32.086788] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:49:32.087096] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-01T20:49:32.087267] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-01T20:49:32.094342] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-01T20:49:32.108260] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T20:49:32.104126] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-01T20:49:32.107480] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-01T20:49:32.518895] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:49:32.902396] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-01T20:49:33.699032] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T20:49:33.708830] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-01T20:49:33.848903] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T20:49:34.445297] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T20:49:34.502418] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-01T20:49:35.302387] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-01T20:49:35.561406] [DEBUG] [REMOTE ] PACK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:49:35.561809] [WARN ] [REMOTE ] PACK: No data returned for month 2025-10 [2025-10-01T20:49:35.561900] [FATAL] [REMOTE ] PACK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:49:35.562031] [FATAL] [MAIN ] PACK: Failed to fetch primary data. [2025-10-01T20:49:35.562118] [WARN ] [MAIN ] PACK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:49:35.562193] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-01T20:49:35.562260] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-01T20:49:35.562299] [INFO ] [LOCAL ] PACK: Starting deletion of derivative data. [2025-10-01T20:49:35.562748] [DEBUG] [LOCAL ] PACK: Deleted derivative data file. [2025-10-01T20:49:35.562840] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PACK took 44.0s. Estimated remaining: 1h 45m 22s. Rate: 7.1 symbols/min [2025-10-01T20:49:35.721418] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T20:49:35.780219] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:49:35.780467] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-01T20:49:35.780525] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-01T20:49:35.780664] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-01T20:49:35.780723] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-01T20:49:35.780770] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-01T20:49:35.780805] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-01T20:49:36.107530] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-01T20:49:36.165089] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:49:36.840913] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T20:49:36.902388] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-01T20:49:37.158625] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:49:37.159012] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-01T20:49:37.159103] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:49:37.159157] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-01T20:49:37.159229] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:49:37.159302] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-01T20:49:37.159366] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-01T20:49:37.159402] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-01T20:49:37.159472] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-01T20:49:37.159542] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAII took 1.6s. Estimated remaining: 1h 45m 11s. Rate: 7.1 symbols/min [2025-10-01T20:49:37.344109] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:49:37.377007] [DEBUG] [LOCAL ] PAM: Loaded 28078 existing records from primary storage. [2025-10-01T20:49:37.377320] [INFO ] [MAIN ] PAM: Loaded 28078 existing records. [2025-10-01T20:49:37.571848] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:49:37.572046] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-01T20:49:37.572094] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-01T20:49:37.572926] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-01T20:49:37.572989] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-01T20:49:37.707456] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-01T20:49:37.960824] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:49:38.317154] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T20:49:38.502386] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-01T20:49:39.001795] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-01T20:49:39.302390] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-01T20:49:40.102400] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-01T20:49:40.902355] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-01T20:49:40.938071] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T20:49:41.521932] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-01T20:49:41.702346] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-01T20:49:41.788140] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:49:42.502394] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-01T20:49:42.775779] [DEBUG] [REMOTE ] PAG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:49:42.776098] [WARN ] [REMOTE ] PAG: No data returned for month 2025-10 [2025-10-01T20:49:42.776195] [FATAL] [REMOTE ] PAG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:49:42.776307] [FATAL] [MAIN ] PAG: Failed to fetch primary data. [2025-10-01T20:49:42.776376] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:49:42.776468] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-01T20:49:42.776537] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-01T20:49:42.776580] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-01T20:49:42.776871] [DEBUG] [LOCAL ] PAG: Deleted derivative data file. [2025-10-01T20:49:42.777061] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAG took 30.5s. Estimated remaining: 1h 45m 1s. Rate: 7.1 symbols/min [2025-10-01T20:49:42.962948] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:49:42.998802] [DEBUG] [LOCAL ] PAR: Loaded 32688 existing records from primary storage. [2025-10-01T20:49:42.999083] [INFO ] [MAIN ] PAR: Loaded 32688 existing records. [2025-10-01T20:49:43.202581] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:49:43.202980] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-01T20:49:43.203084] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-01T20:49:43.204455] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-01T20:49:43.204521] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-01T20:49:43.304845] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-01T20:49:43.615942] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:49:43.646382] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:49:44.102374] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-01T20:49:44.495047] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T20:49:44.902374] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-01T20:49:45.702364] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-01T20:49:45.939918] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T20:49:46.207137] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T20:49:46.502378] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-01T20:49:47.079544] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T20:49:47.302385] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-01T20:49:47.754410] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T20:49:48.102379] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-01T20:49:48.817554] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T20:49:48.902412] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-01T20:49:49.459567] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T20:49:49.702376] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-01T20:49:50.277686] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T20:49:50.502415] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-01T20:49:50.856992] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T20:49:51.302383] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-01T20:49:51.742866] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T20:49:51.966471] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T20:49:52.102375] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-01T20:49:52.902375] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-01T20:49:53.492749] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T20:49:53.619199] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T20:49:53.702380] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-01T20:49:54.502349] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-01T20:49:54.736490] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T20:49:55.302380] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-01T20:49:56.102375] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-01T20:49:56.313797] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T20:49:56.414905] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T20:49:56.902379] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-01T20:49:57.606266] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T20:49:57.702426] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-01T20:49:57.776639] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:49:58.502408] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-01T20:49:59.302366] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-01T20:49:59.367625] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T20:49:59.729156] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T20:50:00.102384] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-01T20:50:00.222231] [DEBUG] [REMOTE ] PAI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-01T20:50:00.222636] [WARN ] [REMOTE ] PAI: No data returned for month 2025-08 [2025-10-01T20:50:00.222801] [FATAL] [REMOTE ] PAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:00.222925] [FATAL] [MAIN ] PAI: Failed to fetch primary data. [2025-10-01T20:50:00.223001] [WARN ] [MAIN ] PAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:00.223077] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-01T20:50:00.223174] [DEBUG] [LOCAL ] PAI: No primary data file found to delete. [2025-10-01T20:50:00.223231] [INFO ] [LOCAL ] PAI: Starting deletion of derivative data. [2025-10-01T20:50:00.223667] [DEBUG] [LOCAL ] PAI: Deleted derivative data file. [2025-10-01T20:50:00.223776] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAI took 28.5s. Estimated remaining: 1h 44m 57s. Rate: 7.1 symbols/min [2025-10-01T20:50:00.427406] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:00.478081] [DEBUG] [LOCAL ] PARR: Loaded 48332 existing records from primary storage. [2025-10-01T20:50:00.478408] [INFO ] [MAIN ] PARR: Loaded 48332 existing records. [2025-10-01T20:50:00.685074] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:50:00.685507] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-01T20:50:00.685669] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-01T20:50:00.693351] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-10-01T20:50:00.704592] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-01T20:50:00.711097] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T20:50:00.908783] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-01T20:50:01.115456] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:01.702373] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-01T20:50:01.896719] [DEBUG] [REMOTE ] PAM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:50:01.897084] [WARN ] [REMOTE ] PAM: No data returned for month 2025-10 [2025-10-01T20:50:01.897202] [FATAL] [REMOTE ] PAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:01.897362] [FATAL] [MAIN ] PAM: Failed to fetch primary data. [2025-10-01T20:50:01.897447] [WARN ] [MAIN ] PAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:01.897549] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-01T20:50:01.897630] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-01T20:50:01.897737] [INFO ] [LOCAL ] PAM: Starting deletion of derivative data. [2025-10-01T20:50:01.898078] [DEBUG] [LOCAL ] PAM: Deleted derivative data file. [2025-10-01T20:50:01.898169] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 24.7s. Estimated remaining: 1h 44m 45s. Rate: 7.1 symbols/min [2025-10-01T20:50:02.090923] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:02.159824] [DEBUG] [LOCAL ] PATH: Loaded 53677 existing records from primary storage. [2025-10-01T20:50:02.160198] [INFO ] [MAIN ] PATH: Loaded 53677 existing records. [2025-10-01T20:50:02.364778] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:50:02.365212] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-01T20:50:02.365464] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-01T20:50:02.374038] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-01T20:50:02.386837] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-01T20:50:02.394126] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T20:50:02.509917] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-01T20:50:02.809468] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:03.302422] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-01T20:50:03.945889] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T20:50:04.102402] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-01T20:50:04.585914] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T20:50:04.902390] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-01T20:50:05.214004] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T20:50:05.702396] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-01T20:50:06.502381] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-01T20:50:06.656742] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T20:50:07.302417] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-01T20:50:07.520220] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T20:50:08.022617] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T20:50:08.102419] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-01T20:50:08.902408] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-01T20:50:09.702365] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-01T20:50:09.747133] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T20:50:09.935221] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-01T20:50:10.502377] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-01T20:50:10.742689] [DEBUG] [REMOTE ] PAR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:50:10.746940] [WARN ] [REMOTE ] PAR: No data returned for month 2025-10 [2025-10-01T20:50:10.747767] [FATAL] [REMOTE ] PAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:10.749367] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-01T20:50:10.749571] [FATAL] [MAIN ] PAR: Failed to fetch primary data. [2025-10-01T20:50:10.760909] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:10.761212] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-01T20:50:10.761748] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-01T20:50:10.761806] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-01T20:50:10.762365] [DEBUG] [LOCAL ] PAR: Deleted derivative data file. [2025-10-01T20:50:10.762466] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAR took 28.0s. Estimated remaining: 1h 44m 37s. Rate: 7.1 symbols/min [2025-10-01T20:50:10.948369] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:10.971380] [DEBUG] [LOCAL ] PAXS: Loaded 20871 existing records from primary storage. [2025-10-01T20:50:10.971891] [INFO ] [MAIN ] PAXS: Loaded 20871 existing records. [2025-10-01T20:50:11.171015] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:50:11.180478] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-01T20:50:11.195726] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-01T20:50:11.197400] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-01T20:50:11.197334] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T20:50:11.197609] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-01T20:50:11.307557] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-01T20:50:11.612636] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:12.102427] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-01T20:50:12.902399] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-01T20:50:13.111050] [DEBUG] [REMOTE ] PAGS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:50:13.111454] [WARN ] [REMOTE ] PAGS: No data returned for month 2025-10 [2025-10-01T20:50:13.111682] [FATAL] [REMOTE ] PAGS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:13.111793] [FATAL] [MAIN ] PAGS: Failed to fetch primary data. [2025-10-01T20:50:13.111862] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:13.111934] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-01T20:50:13.112000] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-01T20:50:13.112039] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-01T20:50:13.112289] [DEBUG] [LOCAL ] PAGS: Deleted derivative data file. [2025-10-01T20:50:13.112397] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAGS took 51.9s. Estimated remaining: 1h 44m 26s. Rate: 7.1 symbols/min [2025-10-01T20:50:13.309675] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:13.349564] [DEBUG] [LOCAL ] PAY: Loaded 38045 existing records from primary storage. [2025-10-01T20:50:13.349910] [INFO ] [MAIN ] PAY: Loaded 38045 existing records. [2025-10-01T20:50:13.577669] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:50:13.579757] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T20:50:13.579952] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-01T20:50:13.589332] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-01T20:50:13.600635] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-01T20:50:13.620013] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-01T20:50:13.670758] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-01T20:50:13.708772] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-01T20:50:14.045790] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:14.502351] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-01T20:50:14.875918] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T20:50:15.302383] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-01T20:50:16.102398] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-01T20:50:16.497118] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T20:50:16.916768] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-01T20:50:16.943252] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-01T20:50:17.702391] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-01T20:50:17.841799] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T20:50:17.884569] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T20:50:18.502426] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-01T20:50:19.302386] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-01T20:50:19.917443] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-01T20:50:19.949321] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T20:50:20.102397] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-01T20:50:20.902364] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-01T20:50:20.998553] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T20:50:21.702441] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-01T20:50:22.376322] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T20:50:22.466125] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-01T20:50:22.502378] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-01T20:50:23.302366] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-01T20:50:23.537983] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T20:50:24.102437] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-01T20:50:24.646754] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T20:50:24.854025] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-01T20:50:24.902360] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-01T20:50:25.129621] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T20:50:25.702420] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-01T20:50:26.502389] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-01T20:50:26.851613] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T20:50:27.307545] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-01T20:50:27.323791] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T20:50:27.820015] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T20:50:28.102347] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-01T20:50:28.511236] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T20:50:28.902404] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-01T20:50:29.702394] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-01T20:50:29.834332] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T20:50:30.502415] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-01T20:50:31.127199] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-01T20:50:31.163326] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T20:50:31.302351] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-01T20:50:31.349388] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T20:50:32.102409] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-01T20:50:32.868434] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T20:50:32.902349] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-01T20:50:33.702376] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-01T20:50:34.230871] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-01T20:50:34.400138] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T20:50:34.502406] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-01T20:50:34.972259] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T20:50:35.302411] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-01T20:50:36.102382] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-01T20:50:36.870997] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T20:50:36.902377] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-01T20:50:36.954897] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-01T20:50:37.702374] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-01T20:50:37.853801] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T20:50:38.265318] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T20:50:38.502353] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-01T20:50:38.571849] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T20:50:39.302399] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-01T20:50:40.102388] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-01T20:50:40.190941] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T20:50:40.339775] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T20:50:40.902377] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-01T20:50:41.123624] [DEBUG] [REMOTE ] PARR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:50:41.123995] [WARN ] [REMOTE ] PARR: No data returned for month 2025-10 [2025-10-01T20:50:41.124112] [FATAL] [REMOTE ] PARR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:41.124217] [FATAL] [MAIN ] PARR: Failed to fetch primary data. [2025-10-01T20:50:41.124286] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:41.124357] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-01T20:50:41.124440] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-01T20:50:41.124497] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-01T20:50:41.124853] [DEBUG] [LOCAL ] PARR: Deleted derivative data file. [2025-10-01T20:50:41.124954] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PARR took 40.9s. Estimated remaining: 1h 44m 26s. Rate: 7.1 symbols/min [2025-10-01T20:50:41.326345] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:41.326596] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-01T20:50:41.326785] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-01T20:50:41.326964] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-01T20:50:41.327012] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-01T20:50:41.327056] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-01T20:50:41.327091] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-01T20:50:41.658789] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T20:50:41.704180] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-01T20:50:41.803588] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:41.982718] [DEBUG] [REMOTE ] PATH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:50:41.983086] [WARN ] [REMOTE ] PATH: No data returned for month 2025-10 [2025-10-01T20:50:41.983232] [FATAL] [REMOTE ] PATH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:41.983381] [FATAL] [MAIN ] PATH: Failed to fetch primary data. [2025-10-01T20:50:41.983469] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:41.983562] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-01T20:50:41.983675] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-01T20:50:41.983740] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-01T20:50:41.984090] [DEBUG] [LOCAL ] PATH: Deleted derivative data file. [2025-10-01T20:50:41.984209] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PATH took 40.1s. Estimated remaining: 1h 44m 14s. Rate: 7.1 symbols/min [2025-10-01T20:50:42.182441] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:42.224631] [DEBUG] [LOCAL ] PB: Loaded 41405 existing records from primary storage. [2025-10-01T20:50:42.225018] [INFO ] [MAIN ] PB: Loaded 41405 existing records. [2025-10-01T20:50:42.429111] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:50:42.429340] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-01T20:50:42.429387] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-01T20:50:42.430524] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-10-01T20:50:42.430620] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-01T20:50:42.511404] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-01T20:50:42.859363] [DEBUG] [REMOTE ] PAXS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:50:42.858829] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:42.859986] [WARN ] [REMOTE ] PAXS: No data returned for month 2025-10 [2025-10-01T20:50:42.860079] [FATAL] [REMOTE ] PAXS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:42.860151] [FATAL] [MAIN ] PAXS: Failed to fetch primary data. [2025-10-01T20:50:42.860220] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:42.860293] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-01T20:50:42.860356] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-01T20:50:42.860394] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-01T20:50:42.860844] [DEBUG] [LOCAL ] PAXS: Deleted derivative data file. [2025-10-01T20:50:42.860942] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PAXS took 32.1s. Estimated remaining: 1h 44m 2s. Rate: 7.1 symbols/min [2025-10-01T20:50:43.058271] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:43.104289] [DEBUG] [LOCAL ] PBA: Loaded 48873 existing records from primary storage. [2025-10-01T20:50:43.104614] [INFO ] [MAIN ] PBA: Loaded 48873 existing records. [2025-10-01T20:50:43.302810] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:50:43.302874] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-01T20:50:43.303235] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-01T20:50:43.304120] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-01T20:50:43.305843] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-01T20:50:43.305910] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-01T20:50:43.575532] [DEBUG] [REMOTE ] PAY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:50:43.606535] [WARN ] [REMOTE ] PAY: No data returned for month 2025-10 [2025-10-01T20:50:43.618732] [FATAL] [REMOTE ] PAY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:50:43.619128] [FATAL] [MAIN ] PAY: Failed to fetch primary data. [2025-10-01T20:50:43.629699] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:50:43.640051] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-01T20:50:43.650434] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-01T20:50:43.667793] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-01T20:50:43.683041] [DEBUG] [LOCAL ] PAY: Deleted derivative data file. [2025-10-01T20:50:43.707141] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:43.703782] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAY took 30.6s. Estimated remaining: 1h 43m 50s. Rate: 7.1 symbols/min [2025-10-01T20:50:43.912945] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:50:43.966534] [DEBUG] [LOCAL ] PBF: Loaded 53115 existing records from primary storage. [2025-10-01T20:50:43.966968] [INFO ] [MAIN ] PBF: Loaded 53115 existing records. [2025-10-01T20:50:44.107466] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-01T20:50:44.181524] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:50:44.181745] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-01T20:50:44.181843] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-01T20:50:44.183857] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-10-01T20:50:44.183921] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-01T20:50:44.583197] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:50:44.902394] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-01T20:50:45.628731] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T20:50:45.702359] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-01T20:50:45.787604] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T20:50:46.502385] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-01T20:50:47.090752] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T20:50:47.302396] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-01T20:50:48.088405] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T20:50:48.102334] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-01T20:50:48.325070] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T20:50:48.903440] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-01T20:50:48.910096] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T20:50:49.702386] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-01T20:50:50.502370] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-01T20:50:50.725612] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T20:50:51.075770] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-01T20:50:51.302390] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-01T20:50:51.395021] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T20:50:52.102395] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-01T20:50:52.902391] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-01T20:50:53.004601] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T20:50:53.392534] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T20:50:53.702376] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-01T20:50:53.749280] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T20:50:54.502406] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-01T20:50:55.302738] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-01T20:50:55.302640] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T20:50:56.039211] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T20:50:56.102376] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-01T20:50:56.716963] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T20:50:56.902375] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-01T20:50:57.702380] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-01T20:50:58.239708] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-01T20:50:58.431722] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T20:50:58.492544] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T20:50:58.502325] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-01T20:50:59.302375] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-01T20:50:59.370338] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T20:51:00.102419] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-01T20:51:00.902406] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-01T20:51:01.327495] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-01T20:51:01.496037] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T20:51:01.633015] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T20:51:01.702402] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-01T20:51:02.502389] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-01T20:51:03.155534] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T20:51:03.302366] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-01T20:51:03.384748] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T20:51:04.102415] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-01T20:51:04.902370] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-01T20:51:04.977039] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T20:51:05.172353] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T20:51:05.702392] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-01T20:51:06.502390] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-01T20:51:06.721968] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T20:51:06.733107] [DEBUG] [REMOTE ] PAYC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:51:06.734145] [WARN ] [REMOTE ] PAYC: No data returned for month 2025-10 [2025-10-01T20:51:06.734591] [FATAL] [REMOTE ] PAYC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:51:06.734764] [FATAL] [MAIN ] PAYC: Failed to fetch primary data. [2025-10-01T20:51:06.734855] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:51:06.734955] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-01T20:51:06.735040] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-01T20:51:06.735081] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-01T20:51:06.735140] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-01T20:51:06.735228] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PAYC took 25.6s. Estimated remaining: 1h 43m 48s. Rate: 7.1 symbols/min [2025-10-01T20:51:06.926098] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:51:06.958954] [DEBUG] [LOCAL ] PBH: Loaded 31774 existing records from primary storage. [2025-10-01T20:51:06.959283] [INFO ] [MAIN ] PBH: Loaded 31774 existing records. [2025-10-01T20:51:07.156542] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:51:07.156978] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-01T20:51:07.157096] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-01T20:51:07.157938] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-10-01T20:51:07.158002] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-01T20:51:07.316553] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-01T20:51:07.590071] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:51:07.639637] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T20:51:08.102427] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-01T20:51:08.902408] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-01T20:51:09.273571] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T20:51:09.433258] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-01T20:51:09.702398] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-01T20:51:10.473517] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T20:51:10.502441] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-01T20:51:11.302535] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-01T20:51:11.454632] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T20:51:12.102404] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-01T20:51:12.105732] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T20:51:12.717954] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T20:51:12.902420] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-01T20:51:13.702409] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-01T20:51:14.034928] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T20:51:14.141872] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T20:51:14.502437] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-01T20:51:15.302429] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-01T20:51:15.478298] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T20:51:15.630771] [DEBUG] [REMOTE ] PBF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:51:15.631205] [WARN ] [REMOTE ] PBF: No data returned for month 2025-10 [2025-10-01T20:51:15.631301] [FATAL] [REMOTE ] PBF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:51:15.631384] [FATAL] [MAIN ] PBF: Failed to fetch primary data. [2025-10-01T20:51:15.631451] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:51:15.631525] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-01T20:51:15.631593] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-01T20:51:15.631632] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-01T20:51:15.632172] [DEBUG] [LOCAL ] PBF: Deleted derivative data file. [2025-10-01T20:51:15.632277] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBF took 31.9s. Estimated remaining: 1h 43m 40s. Rate: 7.1 symbols/min [2025-10-01T20:51:16.102380] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-01T20:51:16.426413] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T20:51:16.902400] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-01T20:51:17.160478] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T20:51:17.702391] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-01T20:51:18.502432] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-01T20:51:18.741925] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T20:51:18.989950] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T20:51:19.302413] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-01T20:51:19.755698] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T20:51:20.102435] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-01T20:51:20.902444] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-01T20:51:20.997519] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T20:51:21.702397] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-01T20:51:21.832154] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T20:51:22.029952] [DEBUG] [REMOTE ] PB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:51:22.030264] [WARN ] [REMOTE ] PB: No data returned for month 2025-10 [2025-10-01T20:51:22.030376] [FATAL] [REMOTE ] PB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:51:22.030501] [FATAL] [MAIN ] PB: Failed to fetch primary data. [2025-10-01T20:51:22.030580] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:51:22.030683] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-01T20:51:22.030786] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-01T20:51:22.030841] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-01T20:51:22.031229] [DEBUG] [LOCAL ] PB: Deleted derivative data file. [2025-10-01T20:51:22.031354] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PB took 40.0s. Estimated remaining: 1h 43m 31s. Rate: 7.1 symbols/min [2025-10-01T20:51:22.426035] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T20:51:22.502407] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-01T20:51:23.302425] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-01T20:51:23.636543] [DEBUG] [REMOTE ] PBA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:51:23.636957] [WARN ] [REMOTE ] PBA: No data returned for month 2025-10 [2025-10-01T20:51:23.637072] [FATAL] [REMOTE ] PBA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:51:23.637207] [FATAL] [MAIN ] PBA: Failed to fetch primary data. [2025-10-01T20:51:23.637283] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:51:23.637356] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-01T20:51:23.637422] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-01T20:51:23.637458] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-01T20:51:23.637824] [DEBUG] [LOCAL ] PBA: Deleted derivative data file. [2025-10-01T20:51:23.641035] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBA took 40.8s. Estimated remaining: 1h 43m 19s. Rate: 7.1 symbols/min [2025-10-01T20:51:23.785365] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T20:51:24.102432] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-01T20:51:25.072318] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T20:51:25.078590] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-01T20:51:26.538349] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T20:51:26.546134] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-01T20:51:28.083360] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T20:51:28.091585] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-01T20:51:29.560369] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T20:51:29.569278] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-01T20:51:29.752185] [DEBUG] [REMOTE ] PBH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:51:29.752512] [WARN ] [REMOTE ] PBH: No data returned for month 2025-10 [2025-10-01T20:51:29.752606] [FATAL] [REMOTE ] PBH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:51:29.752739] [FATAL] [MAIN ] PBH: Failed to fetch primary data. [2025-10-01T20:51:29.752793] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:51:29.752864] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-01T20:51:29.752931] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-01T20:51:29.752968] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-01T20:51:29.753276] [DEBUG] [LOCAL ] PBH: Deleted derivative data file. [2025-10-01T20:51:29.753383] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBH took 23.0s. Estimated remaining: 1h 43m 10s. Rate: 7.1 symbols/min [2025-10-01T20:51:30.459997] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:51:30.511486] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:51:30.509540] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:51:30.605908] [DEBUG] [LOCAL ] PCF: Loaded 8853 existing records from primary storage. [2025-10-01T20:51:30.605447] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:51:30.610958] [INFO ] [MAIN ] PCF: Loaded 8853 existing records. [2025-10-01T20:51:30.676569] [DEBUG] [LOCAL ] PBT: Loaded 17222 existing records from primary storage. [2025-10-01T20:51:30.704406] [INFO ] [MAIN ] PBT: Loaded 17222 existing records. [2025-10-01T20:51:31.001046] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:51:31.012861] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-01T20:51:31.049807] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-01T20:51:31.049157] [DEBUG] [LOCAL ] PBI: Loaded 49983 existing records from primary storage. [2025-10-01T20:51:31.071192] [INFO ] [MAIN ] PBI: Loaded 49983 existing records. [2025-10-01T20:51:31.076389] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-01T20:51:31.094807] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-01T20:51:31.339935] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:51:31.369390] [DEBUG] [LOCAL ] PBR: Loaded 53712 existing records from primary storage. [2025-10-01T20:51:31.384736] [INFO ] [MAIN ] PBR: Loaded 53712 existing records. [2025-10-01T20:51:31.384603] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-01T20:51:31.412382] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-01T20:51:31.459493] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-01T20:51:31.470075] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-01T20:51:31.654706] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:51:31.681956] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-01T20:51:31.762550] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-01T20:51:31.895602] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-10-01T20:51:31.939295] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-01T20:51:32.019724] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:51:32.131814] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-01T20:51:32.210924] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-01T20:51:32.281758] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-01T20:51:32.303068] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-01T20:51:32.610826] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:51:32.693827] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-01T20:51:32.824952] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:51:32.858508] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-01T20:51:33.218106] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:51:33.218529] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-01T20:51:33.304939] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:51:33.305297] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-01T20:51:33.940575] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T20:51:33.945032] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-01T20:51:34.052064] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T20:51:34.056905] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-01T20:51:34.633970] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T20:51:34.637164] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-01T20:51:34.896725] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T20:51:34.900672] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-01T20:51:35.061090] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T20:51:35.071933] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-01T20:51:35.594412] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T20:51:35.614566] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-01T20:51:35.634803] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-01T20:51:35.675327] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T20:51:36.102376] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-01T20:51:36.428329] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T20:51:36.764259] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T20:51:36.902423] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-01T20:51:37.702384] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-01T20:51:38.011385] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T20:51:38.318800] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-01T20:51:38.502427] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-01T20:51:38.557043] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T20:51:39.302402] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-01T20:51:40.102365] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-01T20:51:40.167181] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T20:51:40.902375] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-01T20:51:41.089392] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T20:51:41.617733] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-01T20:51:41.702376] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-01T20:51:42.502360] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-01T20:51:42.718477] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T20:51:42.748290] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T20:51:43.302397] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-01T20:51:44.102405] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-01T20:51:44.736214] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-01T20:51:44.902384] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-01T20:51:44.948186] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T20:51:44.998470] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T20:51:45.702417] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-01T20:51:46.502406] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-01T20:51:46.813529] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T20:51:47.310262] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-01T20:51:47.316469] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-01T20:51:48.102384] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-01T20:51:48.322007] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T20:51:48.492059] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T20:51:48.902420] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-01T20:51:49.702376] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-01T20:51:50.351587] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-01T20:51:50.396513] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T20:51:50.502350] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-01T20:51:50.639385] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T20:51:51.302368] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-01T20:51:52.102398] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-01T20:51:52.241696] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T20:51:52.462065] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T20:51:52.902383] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-01T20:51:53.465225] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T20:51:53.702357] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-01T20:51:53.890056] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T20:51:54.502384] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-01T20:51:54.629032] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T20:51:55.302382] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-01T20:51:56.102353] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-01T20:51:56.363428] [DEBUG] [REMOTE ] PBT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:51:56.363824] [WARN ] [REMOTE ] PBT: No data returned for month 2025-10 [2025-10-01T20:51:56.363980] [FATAL] [REMOTE ] PBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:51:56.364103] [FATAL] [MAIN ] PBT: Failed to fetch primary data. [2025-10-01T20:51:56.364155] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:51:56.364260] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-01T20:51:56.364350] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-01T20:51:56.364446] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-01T20:51:56.364893] [DEBUG] [LOCAL ] PBT: Deleted derivative data file. [2025-10-01T20:51:56.365016] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PBT took 26.6s. Estimated remaining: 1h 43m 9s. Rate: 7.1 symbols/min [2025-10-01T20:51:56.559079] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:51:56.559368] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-01T20:51:56.559549] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-01T20:51:56.559805] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-01T20:51:56.559890] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-01T20:51:56.560010] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-01T20:51:56.560061] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-01T20:51:56.904012] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-01T20:51:56.912053] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-01T20:51:57.011372] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:51:57.112229] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T20:51:57.702464] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-01T20:51:57.841549] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T20:51:58.502477] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-01T20:51:59.302425] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-01T20:51:59.438282] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T20:51:59.965285] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-01T20:52:00.028296] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T20:52:00.102360] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-01T20:52:00.902495] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-01T20:52:01.195465] [DEBUG] [REMOTE ] PCF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:01.196002] [WARN ] [REMOTE ] PCF: No data returned for month 2025-10 [2025-10-01T20:52:01.196556] [FATAL] [REMOTE ] PCF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:01.196835] [FATAL] [MAIN ] PCF: Failed to fetch primary data. [2025-10-01T20:52:01.196958] [WARN ] [MAIN ] PCF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:01.197044] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-01T20:52:01.197138] [DEBUG] [LOCAL ] PCF: No primary data file found to delete. [2025-10-01T20:52:01.197183] [INFO ] [LOCAL ] PCF: Starting deletion of derivative data. [2025-10-01T20:52:01.197709] [DEBUG] [LOCAL ] PCF: Deleted derivative data file. [2025-10-01T20:52:01.197822] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PCF took 31.4s. Estimated remaining: 1h 42m 59s. Rate: 7.1 symbols/min [2025-10-01T20:52:01.406608] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:01.415752] [DEBUG] [LOCAL ] PCM: Loaded 6787 existing records from primary storage. [2025-10-01T20:52:01.415983] [INFO ] [MAIN ] PCM: Loaded 6787 existing records. [2025-10-01T20:52:01.629096] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:52:01.629353] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-01T20:52:01.629419] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-01T20:52:01.629832] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-01T20:52:01.629897] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-01T20:52:01.706738] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-01T20:52:02.037199] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:02.117615] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-01T20:52:02.502370] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-01T20:52:02.620342] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T20:52:02.745066] [DEBUG] [REMOTE ] PBR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:02.745450] [WARN ] [REMOTE ] PBR: No data returned for month 2025-10 [2025-10-01T20:52:02.745544] [FATAL] [REMOTE ] PBR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:02.745689] [FATAL] [MAIN ] PBR: Failed to fetch primary data. [2025-10-01T20:52:02.745774] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:02.745861] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-01T20:52:02.745964] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-01T20:52:02.746027] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-01T20:52:02.746509] [DEBUG] [LOCAL ] PBR: Deleted derivative data file. [2025-10-01T20:52:02.746605] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBR took 32.9s. Estimated remaining: 1h 42m 48s. Rate: 7.1 symbols/min [2025-10-01T20:52:03.029008] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:03.072427] [DEBUG] [LOCAL ] PCN: Loaded 24445 existing records from primary storage. [2025-10-01T20:52:03.072894] [INFO ] [MAIN ] PCN: Loaded 24445 existing records. [2025-10-01T20:52:03.305685] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-01T20:52:03.361004] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:52:03.362126] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-01T20:52:03.362225] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-01T20:52:03.363445] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-01T20:52:03.363521] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-01T20:52:03.882491] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:04.102379] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-01T20:52:04.268942] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T20:52:04.902425] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-01T20:52:05.702365] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-01T20:52:05.791327] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T20:52:06.028608] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T20:52:06.502374] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-01T20:52:06.580924] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T20:52:06.770787] [DEBUG] [REMOTE ] PBI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:06.771094] [WARN ] [REMOTE ] PBI: No data returned for month 2025-10 [2025-10-01T20:52:06.771189] [FATAL] [REMOTE ] PBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:06.771270] [FATAL] [MAIN ] PBI: Failed to fetch primary data. [2025-10-01T20:52:06.771340] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:06.771414] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-01T20:52:06.771480] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-01T20:52:06.771520] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-01T20:52:06.771941] [DEBUG] [LOCAL ] PBI: Deleted derivative data file. [2025-10-01T20:52:06.772045] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBI took 37.0s. Estimated remaining: 1h 42m 37s. Rate: 7.1 symbols/min [2025-10-01T20:52:06.963718] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:07.016955] [DEBUG] [LOCAL ] PCOR: Loaded 48025 existing records from primary storage. [2025-10-01T20:52:07.017301] [INFO ] [MAIN ] PCOR: Loaded 48025 existing records. [2025-10-01T20:52:07.215389] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:52:07.215725] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-01T20:52:07.215785] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-01T20:52:07.218853] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-01T20:52:07.218916] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-01T20:52:07.307568] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-01T20:52:07.623928] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:08.102433] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-01T20:52:08.573086] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T20:52:08.902425] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-01T20:52:09.038343] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T20:52:09.702357] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-01T20:52:10.082464] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T20:52:10.310849] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-01T20:52:10.502433] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-01T20:52:11.302420] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-01T20:52:11.976042] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T20:52:12.102398] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-01T20:52:12.552909] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T20:52:12.902461] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-01T20:52:12.931817] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-01T20:52:13.702382] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-01T20:52:14.036537] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T20:52:14.502367] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-01T20:52:14.534833] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T20:52:15.302432] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-01T20:52:15.438201] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T20:52:16.102411] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-01T20:52:16.674033] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T20:52:16.902361] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-01T20:52:17.154209] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T20:52:17.702338] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-01T20:52:18.090363] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T20:52:18.502365] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-01T20:52:18.715551] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T20:52:19.302370] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-01T20:52:19.684495] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T20:52:20.102348] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-01T20:52:20.157022] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T20:52:20.848741] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T20:52:20.902388] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-01T20:52:21.702372] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-01T20:52:21.766413] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T20:52:22.058409] [DEBUG] [REMOTE ] PCG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:22.058765] [WARN ] [REMOTE ] PCG: No data returned for month 2025-10 [2025-10-01T20:52:22.058849] [FATAL] [REMOTE ] PCG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:22.058932] [FATAL] [MAIN ] PCG: Failed to fetch primary data. [2025-10-01T20:52:22.058996] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:22.059068] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-01T20:52:22.059133] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-01T20:52:22.059169] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-01T20:52:22.059209] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-01T20:52:22.059272] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCG took 25.7s. Estimated remaining: 1h 42m 32s. Rate: 7.1 symbols/min [2025-10-01T20:52:22.249845] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:22.262715] [DEBUG] [LOCAL ] PCQ: Loaded 12294 existing records from primary storage. [2025-10-01T20:52:22.262959] [INFO ] [MAIN ] PCQ: Loaded 12294 existing records. [2025-10-01T20:52:22.465295] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:52:22.465521] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-01T20:52:22.465576] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-01T20:52:22.466370] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-01T20:52:22.466455] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-01T20:52:22.507628] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-01T20:52:22.930780] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:23.302378] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-01T20:52:23.734300] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T20:52:23.988430] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T20:52:24.102407] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-01T20:52:24.902392] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-01T20:52:25.242912] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T20:52:25.367843] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T20:52:25.702384] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-01T20:52:26.365431] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T20:52:26.502382] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-01T20:52:27.302408] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-01T20:52:28.017615] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T20:52:28.102406] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-01T20:52:28.361628] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T20:52:28.618790] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T20:52:28.902378] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-01T20:52:29.702386] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-01T20:52:30.502387] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-01T20:52:30.636742] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T20:52:31.092189] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T20:52:31.302425] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-01T20:52:31.338313] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T20:52:32.102407] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-01T20:52:32.721967] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T20:52:32.902386] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-01T20:52:33.004617] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T20:52:33.541740] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T20:52:33.702402] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-01T20:52:34.502402] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-01T20:52:35.116052] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T20:52:35.302401] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-01T20:52:35.788209] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T20:52:36.102382] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-01T20:52:36.165979] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T20:52:36.352102] [DEBUG] [REMOTE ] PCM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:36.352438] [WARN ] [REMOTE ] PCM: No data returned for month 2025-10 [2025-10-01T20:52:36.352532] [FATAL] [REMOTE ] PCM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:36.352619] [FATAL] [MAIN ] PCM: Failed to fetch primary data. [2025-10-01T20:52:36.352708] [WARN ] [MAIN ] PCM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:36.352782] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-01T20:52:36.352848] [DEBUG] [LOCAL ] PCM: No primary data file found to delete. [2025-10-01T20:52:36.352885] [INFO ] [LOCAL ] PCM: Starting deletion of derivative data. [2025-10-01T20:52:36.353155] [DEBUG] [LOCAL ] PCM: Deleted derivative data file. [2025-10-01T20:52:36.353267] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCM took 35.2s. Estimated remaining: 1h 42m 26s. Rate: 7.1 symbols/min [2025-10-01T20:52:36.562276] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:36.628590] [DEBUG] [LOCAL ] PD: Loaded 47886 existing records from primary storage. [2025-10-01T20:52:36.628976] [INFO ] [MAIN ] PD: Loaded 47886 existing records. [2025-10-01T20:52:36.837949] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:52:36.838168] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-01T20:52:36.838215] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-01T20:52:36.839242] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-01T20:52:36.839305] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-01T20:52:36.907446] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-01T20:52:37.158511] [DEBUG] [REMOTE ] PCN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:37.179856] [WARN ] [REMOTE ] PCN: No data returned for month 2025-10 [2025-10-01T20:52:37.179991] [FATAL] [REMOTE ] PCN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:37.189876] [FATAL] [MAIN ] PCN: Failed to fetch primary data. [2025-10-01T20:52:37.193328] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:37.193443] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-01T20:52:37.193558] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-01T20:52:37.199323] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-10-01T20:52:37.215069] [DEBUG] [LOCAL ] PCN: Deleted derivative data file. [2025-10-01T20:52:37.236342] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCN took 34.5s. Estimated remaining: 1h 42m 14s. Rate: 7.1 symbols/min [2025-10-01T20:52:37.398177] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:37.471819] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:37.472078] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-01T20:52:37.472131] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-01T20:52:37.472260] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-01T20:52:37.472307] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-01T20:52:37.472350] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-01T20:52:37.472384] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-01T20:52:37.707461] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-01T20:52:37.865623] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:38.502393] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-01T20:52:38.791096] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-01T20:52:39.302395] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-01T20:52:39.401724] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:52:39.606258] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-01T20:52:40.102420] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-01T20:52:40.902386] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-01T20:52:41.332152] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-01T20:52:41.701747] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T20:52:41.705203] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-01T20:52:42.502412] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-01T20:52:42.770886] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T20:52:43.302392] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-01T20:52:43.978013] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T20:52:44.102383] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-01T20:52:44.902369] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-01T20:52:44.927401] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T20:52:44.997226] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T20:52:45.373562] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T20:52:45.702369] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-01T20:52:46.172830] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T20:52:46.502393] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-01T20:52:47.302383] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-01T20:52:47.689058] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-01T20:52:48.102359] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-01T20:52:48.154045] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T20:52:48.498328] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-01T20:52:48.902386] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-01T20:52:49.702380] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-01T20:52:50.217289] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-01T20:52:50.424701] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T20:52:50.502379] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-01T20:52:50.858839] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-01T20:52:51.302388] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-01T20:52:51.747217] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T20:52:52.102374] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-01T20:52:52.902374] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-01T20:52:53.658522] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T20:52:53.702361] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-01T20:52:53.906981] [DEBUG] [REMOTE ] PCOR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:53.907296] [WARN ] [REMOTE ] PCOR: No data returned for month 2025-10 [2025-10-01T20:52:53.907397] [FATAL] [REMOTE ] PCOR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:53.907501] [FATAL] [MAIN ] PCOR: Failed to fetch primary data. [2025-10-01T20:52:53.907571] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:53.907664] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-01T20:52:53.907746] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-01T20:52:53.907784] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-01T20:52:53.908205] [DEBUG] [LOCAL ] PCOR: Deleted derivative data file. [2025-10-01T20:52:53.908324] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCOR took 47.1s. Estimated remaining: 1h 42m 9s. Rate: 7.1 symbols/min [2025-10-01T20:52:54.092485] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:54.146103] [DEBUG] [LOCAL ] PDI: Loaded 50069 existing records from primary storage. [2025-10-01T20:52:54.146693] [INFO ] [MAIN ] PDI: Loaded 50069 existing records. [2025-10-01T20:52:54.363446] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:52:54.363849] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-01T20:52:54.363923] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-01T20:52:54.374244] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-01T20:52:54.387981] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-01T20:52:54.471801] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T20:52:54.507892] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-01T20:52:54.841733] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:55.302405] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-01T20:52:55.377243] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T20:52:56.102394] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-01T20:52:56.902379] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-01T20:52:57.112790] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T20:52:57.253623] [DEBUG] [REMOTE ] PDCC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:52:57.253994] [WARN ] [REMOTE ] PDCC: No data returned for month 2025-10 [2025-10-01T20:52:57.254086] [FATAL] [REMOTE ] PDCC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:52:57.254167] [FATAL] [MAIN ] PDCC: Failed to fetch primary data. [2025-10-01T20:52:57.254278] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:52:57.254355] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-01T20:52:57.254421] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-01T20:52:57.254458] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-01T20:52:57.254497] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-01T20:52:57.254555] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PDCC took 20.0s. Estimated remaining: 1h 41m 58s. Rate: 7.1 symbols/min [2025-10-01T20:52:57.448492] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:52:57.499260] [DEBUG] [LOCAL ] PDM: Loaded 39613 existing records from primary storage. [2025-10-01T20:52:57.499557] [INFO ] [MAIN ] PDM: Loaded 39613 existing records. [2025-10-01T20:52:57.698316] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:52:57.698522] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-01T20:52:57.698571] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-01T20:52:57.699535] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-01T20:52:57.699598] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-01T20:52:57.711132] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-01T20:52:58.114617] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:52:58.144533] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T20:52:58.502422] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-01T20:52:58.596251] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-01T20:52:59.302384] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-01T20:53:00.102406] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-01T20:53:00.188303] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T20:53:00.902406] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-01T20:53:01.090288] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T20:53:01.702358] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-01T20:53:01.794949] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:53:02.502418] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-01T20:53:02.748723] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-01T20:53:03.302349] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-01T20:53:03.545552] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T20:53:03.604510] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T20:53:04.102397] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-01T20:53:04.902362] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-01T20:53:05.325482] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T20:53:05.625253] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T20:53:05.702377] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-01T20:53:05.907483] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T20:53:06.502391] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-01T20:53:06.862450] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T20:53:07.302405] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-01T20:53:07.655479] [DEBUG] [REMOTE ] PCQ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:53:07.655865] [WARN ] [REMOTE ] PCQ: No data returned for month 2025-10 [2025-10-01T20:53:07.655937] [FATAL] [REMOTE ] PCQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:53:07.656018] [FATAL] [MAIN ] PCQ: Failed to fetch primary data. [2025-10-01T20:53:07.656084] [WARN ] [MAIN ] PCQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:53:07.656157] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-01T20:53:07.656220] [DEBUG] [LOCAL ] PCQ: No primary data file found to delete. [2025-10-01T20:53:07.656256] [INFO ] [LOCAL ] PCQ: Starting deletion of derivative data. [2025-10-01T20:53:07.656487] [DEBUG] [LOCAL ] PCQ: Deleted derivative data file. [2025-10-01T20:53:07.656588] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PCQ took 45.6s. Estimated remaining: 1h 41m 51s. Rate: 7.1 symbols/min [2025-10-01T20:53:07.862270] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:53:07.900345] [DEBUG] [LOCAL ] PDO: Loaded 31349 existing records from primary storage. [2025-10-01T20:53:07.900676] [INFO ] [MAIN ] PDO: Loaded 31349 existing records. [2025-10-01T20:53:08.108534] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-01T20:53:08.133570] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:53:08.134834] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-01T20:53:08.134892] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-01T20:53:08.136328] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-01T20:53:08.136392] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-01T20:53:08.560420] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:53:08.605685] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-01T20:53:08.902396] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-01T20:53:09.608174] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T20:53:09.702372] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-01T20:53:10.499318] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T20:53:10.507529] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-01T20:53:11.302381] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-01T20:53:11.788830] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T20:53:12.078455] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T20:53:12.102345] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-01T20:53:12.518528] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T20:53:12.902375] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-01T20:53:13.642403] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T20:53:13.702360] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-01T20:53:14.395151] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T20:53:14.502372] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-01T20:53:15.037139] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T20:53:15.302452] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-01T20:53:15.766818] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T20:53:16.102410] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-01T20:53:16.902374] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-01T20:53:17.314576] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-01T20:53:17.344726] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T20:53:17.702370] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-01T20:53:18.507456] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-01T20:53:18.521635] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T20:53:19.302386] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-01T20:53:19.537810] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T20:53:19.843242] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T20:53:20.102440] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-01T20:53:20.774614] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T20:53:20.902405] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-01T20:53:21.080931] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T20:53:21.333485] [DEBUG] [REMOTE ] PD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:53:21.333914] [WARN ] [REMOTE ] PD: No data returned for month 2025-10 [2025-10-01T20:53:21.334020] [FATAL] [REMOTE ] PD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:53:21.334116] [FATAL] [MAIN ] PD: Failed to fetch primary data. [2025-10-01T20:53:21.334197] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:53:21.334284] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-01T20:53:21.334370] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-01T20:53:21.334440] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-01T20:53:21.334830] [DEBUG] [LOCAL ] PD: Deleted derivative data file. [2025-10-01T20:53:21.335000] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PD took 45.0s. Estimated remaining: 1h 41m 44s. Rate: 7.1 symbols/min [2025-10-01T20:53:21.524914] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:53:21.543393] [DEBUG] [LOCAL ] PDS: Loaded 17707 existing records from primary storage. [2025-10-01T20:53:21.543633] [INFO ] [MAIN ] PDS: Loaded 17707 existing records. [2025-10-01T20:53:21.710335] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-01T20:53:21.745414] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:53:21.745616] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-01T20:53:21.745696] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-01T20:53:21.746823] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-01T20:53:21.746892] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-01T20:53:22.156007] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:53:22.502393] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-01T20:53:23.259122] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T20:53:23.302363] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-01T20:53:23.447977] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T20:53:23.559634] [DEBUG] [REMOTE ] PDM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:53:23.560069] [WARN ] [REMOTE ] PDM: No data returned for month 2025-10 [2025-10-01T20:53:23.560172] [FATAL] [REMOTE ] PDM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:53:23.560259] [FATAL] [MAIN ] PDM: Failed to fetch primary data. [2025-10-01T20:53:23.560322] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:53:23.560394] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-01T20:53:23.560457] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-01T20:53:23.560493] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-01T20:53:23.560925] [DEBUG] [LOCAL ] PDM: Deleted derivative data file. [2025-10-01T20:53:23.561014] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDM took 26.3s. Estimated remaining: 1h 41m 33s. Rate: 7.1 symbols/min [2025-10-01T20:53:23.770255] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:53:23.789674] [DEBUG] [LOCAL ] PDT: Loaded 17328 existing records from primary storage. [2025-10-01T20:53:23.789920] [INFO ] [MAIN ] PDT: Loaded 17328 existing records. [2025-10-01T20:53:24.006257] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:53:24.006495] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-01T20:53:24.006568] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-01T20:53:24.007258] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-01T20:53:24.007340] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-01T20:53:24.107782] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-01T20:53:24.425594] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:53:24.902381] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-01T20:53:25.701925] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T20:53:25.711346] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-01T20:53:25.954575] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T20:53:26.502356] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-01T20:53:26.797618] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T20:53:27.302384] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-01T20:53:27.502824] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T20:53:28.102380] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-01T20:53:28.740738] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T20:53:28.902388] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-01T20:53:29.702366] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-01T20:53:30.142869] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-01T20:53:30.331938] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T20:53:30.451050] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T20:53:30.502346] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-01T20:53:31.302361] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-01T20:53:31.589689] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T20:53:32.102405] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-01T20:53:32.284721] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T20:53:32.902386] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-01T20:53:33.201769] [DEBUG] [REMOTE ] PDO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:53:33.202106] [WARN ] [REMOTE ] PDO: No data returned for month 2025-10 [2025-10-01T20:53:33.202201] [FATAL] [REMOTE ] PDO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:53:33.202312] [FATAL] [MAIN ] PDO: Failed to fetch primary data. [2025-10-01T20:53:33.202383] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:53:33.202460] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-01T20:53:33.202552] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-01T20:53:33.202610] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-01T20:53:33.203166] [DEBUG] [LOCAL ] PDO: Deleted derivative data file. [2025-10-01T20:53:33.203259] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDO took 25.5s. Estimated remaining: 1h 41m 25s. Rate: 7.1 symbols/min [2025-10-01T20:53:33.387134] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:53:33.402171] [DEBUG] [LOCAL ] PDX: Loaded 14361 existing records from primary storage. [2025-10-01T20:53:33.402398] [INFO ] [MAIN ] PDX: Loaded 14361 existing records. [2025-10-01T20:53:33.601404] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:53:33.601703] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-01T20:53:33.601840] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-01T20:53:33.602382] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-01T20:53:33.602446] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-01T20:53:33.705258] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-01T20:53:33.843439] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T20:53:34.071559] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:53:34.502387] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-01T20:53:34.936312] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T20:53:35.302355] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-01T20:53:35.411282] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T20:53:36.102384] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-01T20:53:36.592776] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T20:53:36.902371] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-01T20:53:37.702348] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-01T20:53:37.731065] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T20:53:37.891062] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T20:53:38.502385] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-01T20:53:39.302408] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-01T20:53:39.636429] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T20:53:39.679033] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-01T20:53:40.102345] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-01T20:53:40.183405] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T20:53:40.336948] [DEBUG] [REMOTE ] PDI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:53:40.337272] [WARN ] [REMOTE ] PDI: No data returned for month 2025-10 [2025-10-01T20:53:40.337369] [FATAL] [REMOTE ] PDI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:53:40.337453] [FATAL] [MAIN ] PDI: Failed to fetch primary data. [2025-10-01T20:53:40.337519] [WARN ] [MAIN ] PDI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:53:40.337598] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-01T20:53:40.337711] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-01T20:53:40.337770] [INFO ] [LOCAL ] PDI: Starting deletion of derivative data. [2025-10-01T20:53:40.338176] [DEBUG] [LOCAL ] PDI: Deleted derivative data file. [2025-10-01T20:53:40.338266] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDI took 46.4s. Estimated remaining: 1h 41m 16s. Rate: 7.1 symbols/min [2025-10-01T20:53:40.532134] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:53:40.583578] [DEBUG] [LOCAL ] PEB: Loaded 50648 existing records from primary storage. [2025-10-01T20:53:40.583956] [INFO ] [MAIN ] PEB: Loaded 50648 existing records. [2025-10-01T20:53:40.780093] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:53:40.780377] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-01T20:53:40.780466] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-01T20:53:40.782220] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-10-01T20:53:40.782281] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-01T20:53:40.907468] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-01T20:53:41.183204] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:53:41.702371] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-01T20:53:42.066592] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T20:53:42.502382] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-01T20:53:43.302393] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-01T20:53:43.369584] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T20:53:43.421961] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T20:53:43.986988] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T20:53:44.102388] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-01T20:53:44.902375] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-01T20:53:45.121995] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T20:53:45.702369] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-01T20:53:46.502380] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-01T20:53:46.808077] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T20:53:47.105633] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-01T20:53:47.302453] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-01T20:53:47.620918] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T20:53:48.102388] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-01T20:53:48.275700] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T20:53:48.902374] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-01T20:53:49.150770] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T20:53:49.702365] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-01T20:53:50.502357] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-01T20:53:50.539028] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T20:53:50.624746] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T20:53:51.302355] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-01T20:53:51.593671] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T20:53:51.670555] [DEBUG] [REMOTE ] PDS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:53:51.670972] [WARN ] [REMOTE ] PDS: No data returned for month 2025-10 [2025-10-01T20:53:51.671104] [FATAL] [REMOTE ] PDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:53:51.671212] [FATAL] [MAIN ] PDS: Failed to fetch primary data. [2025-10-01T20:53:51.671281] [WARN ] [MAIN ] PDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:53:51.671355] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-01T20:53:51.671420] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-01T20:53:51.671456] [INFO ] [LOCAL ] PDS: Starting deletion of derivative data. [2025-10-01T20:53:51.671932] [DEBUG] [LOCAL ] PDS: Deleted derivative data file. [2025-10-01T20:53:51.672032] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDS took 30.3s. Estimated remaining: 1h 41m 9s. Rate: 7.1 symbols/min [2025-10-01T20:53:51.873704] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:53:51.873878] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-01T20:53:51.873917] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-01T20:53:51.874035] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-01T20:53:51.874077] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-01T20:53:51.874119] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-01T20:53:51.874154] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-01T20:53:52.107529] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-01T20:53:52.285797] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:53:52.902401] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-01T20:53:53.326554] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T20:53:53.702393] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-01T20:53:54.485886] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T20:53:54.502337] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-01T20:53:54.834428] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T20:53:55.302409] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-01T20:53:56.076730] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T20:53:56.102381] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-01T20:53:56.344870] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T20:53:56.902362] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-01T20:53:56.953627] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T20:53:57.702356] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-01T20:53:57.964241] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T20:53:58.502382] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-01T20:53:59.302356] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-01T20:53:59.477179] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T20:53:59.636435] [DEBUG] [REMOTE ] PDT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:53:59.647633] [WARN ] [REMOTE ] PDT: No data returned for month 2025-10 [2025-10-01T20:53:59.648242] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T20:53:59.648462] [FATAL] [REMOTE ] PDT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:53:59.652506] [FATAL] [MAIN ] PDT: Failed to fetch primary data. [2025-10-01T20:53:59.652913] [WARN ] [MAIN ] PDT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:53:59.653005] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-01T20:53:59.653503] [DEBUG] [LOCAL ] PDT: No primary data file found to delete. [2025-10-01T20:53:59.653559] [INFO ] [LOCAL ] PDT: Starting deletion of derivative data. [2025-10-01T20:53:59.653953] [DEBUG] [LOCAL ] PDT: Deleted derivative data file. [2025-10-01T20:53:59.654038] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDT took 36.1s. Estimated remaining: 1h 41m 0s. Rate: 7.1 symbols/min [2025-10-01T20:53:59.847454] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:53:59.878628] [DEBUG] [LOCAL ] PEN: Loaded 30150 existing records from primary storage. [2025-10-01T20:53:59.878962] [INFO ] [MAIN ] PEN: Loaded 30150 existing records. [2025-10-01T20:54:00.070186] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:54:00.070439] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-01T20:54:00.070494] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-01T20:54:00.072257] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-10-01T20:54:00.072320] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-01T20:54:00.107501] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-01T20:54:00.476528] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:00.902394] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-01T20:54:01.702374] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-01T20:54:01.846224] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T20:54:02.119556] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T20:54:02.502401] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-01T20:54:03.302380] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-01T20:54:03.526196] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T20:54:03.565019] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T20:54:04.102376] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-01T20:54:04.547836] [DEBUG] [REMOTE ] PDX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:54:04.548196] [WARN ] [REMOTE ] PDX: No data returned for month 2025-10 [2025-10-01T20:54:04.548312] [FATAL] [REMOTE ] PDX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:54:04.548401] [FATAL] [MAIN ] PDX: Failed to fetch primary data. [2025-10-01T20:54:04.548441] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:54:04.548573] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-01T20:54:04.548731] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-01T20:54:04.548785] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-01T20:54:04.549140] [DEBUG] [LOCAL ] PDX: Deleted derivative data file. [2025-10-01T20:54:04.549232] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PDX took 31.3s. Estimated remaining: 1h 40m 50s. Rate: 7.1 symbols/min [2025-10-01T20:54:04.736939] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T20:54:04.770252] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:54:04.783819] [DEBUG] [LOCAL ] PEO: Loaded 11004 existing records from primary storage. [2025-10-01T20:54:04.784052] [INFO ] [MAIN ] PEO: Loaded 11004 existing records. [2025-10-01T20:54:04.904285] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-01T20:54:04.993613] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:54:04.993849] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-01T20:54:04.993898] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-01T20:54:04.994721] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-01T20:54:04.994789] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-01T20:54:05.442315] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:05.702374] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-01T20:54:06.341223] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T20:54:06.502397] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-01T20:54:06.593604] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T20:54:07.302418] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-01T20:54:08.102373] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-01T20:54:08.297511] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T20:54:08.733563] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T20:54:08.902396] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-01T20:54:09.185172] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T20:54:09.702382] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-01T20:54:10.502337] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-01T20:54:10.603265] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T20:54:11.302356] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-01T20:54:11.367428] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T20:54:11.639089] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T20:54:12.102397] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-01T20:54:12.902374] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-01T20:54:13.049338] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T20:54:13.702353] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-01T20:54:13.812062] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T20:54:13.848687] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T20:54:14.502401] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-01T20:54:15.302382] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-01T20:54:15.514967] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T20:54:16.048971] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T20:54:16.102400] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-01T20:54:16.285247] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T20:54:16.902389] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-01T20:54:17.702379] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-01T20:54:17.789897] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T20:54:18.502442] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-01T20:54:18.769405] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T20:54:19.272066] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T20:54:19.287413] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T20:54:19.302336] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-01T20:54:20.102371] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-01T20:54:20.176353] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T20:54:20.902444] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-01T20:54:21.702368] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-01T20:54:21.748387] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T20:54:21.862588] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T20:54:22.502446] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-01T20:54:23.302404] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-01T20:54:23.382358] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T20:54:23.546794] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T20:54:24.102413] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-01T20:54:24.429954] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T20:54:24.902422] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-01T20:54:25.215405] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T20:54:25.702387] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-01T20:54:26.502366] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-01T20:54:26.600555] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T20:54:27.302359] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-01T20:54:27.577829] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T20:54:27.800943] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T20:54:27.810719] [DEBUG] [REMOTE ] PEG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:54:27.811601] [WARN ] [REMOTE ] PEG: No data returned for month 2025-10 [2025-10-01T20:54:27.811757] [FATAL] [REMOTE ] PEG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:54:27.811864] [FATAL] [MAIN ] PEG: Failed to fetch primary data. [2025-10-01T20:54:27.811940] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:54:27.812014] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-01T20:54:27.812156] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-01T20:54:27.812223] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-01T20:54:27.812276] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-01T20:54:27.812349] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEG took 36.1s. Estimated remaining: 1h 40m 48s. Rate: 7.1 symbols/min [2025-10-01T20:54:28.008521] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:54:28.024127] [DEBUG] [LOCAL ] PERF: Loaded 14022 existing records from primary storage. [2025-10-01T20:54:28.024438] [INFO ] [MAIN ] PERF: Loaded 14022 existing records. [2025-10-01T20:54:28.107451] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-01T20:54:28.224306] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:54:28.224507] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-01T20:54:28.224554] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-01T20:54:28.224998] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-01T20:54:28.225076] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-01T20:54:28.605444] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:28.902379] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-01T20:54:29.580100] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T20:54:29.702389] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-01T20:54:30.133852] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T20:54:30.502407] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-01T20:54:30.857525] [DEBUG] [REMOTE ] PEB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:54:30.857925] [WARN ] [REMOTE ] PEB: No data returned for month 2025-10 [2025-10-01T20:54:30.858020] [FATAL] [REMOTE ] PEB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:54:30.858107] [FATAL] [MAIN ] PEB: Failed to fetch primary data. [2025-10-01T20:54:30.858171] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:54:30.858260] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-01T20:54:30.858350] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-01T20:54:30.858393] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-01T20:54:30.858915] [DEBUG] [LOCAL ] PEB: Deleted derivative data file. [2025-10-01T20:54:30.859021] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEB took 50.5s. Estimated remaining: 1h 40m 37s. Rate: 7.1 symbols/min [2025-10-01T20:54:31.057699] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T20:54:31.093331] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:54:31.093518] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-01T20:54:31.093559] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-01T20:54:31.093706] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-01T20:54:31.093761] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-01T20:54:31.093806] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-01T20:54:31.093843] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-01T20:54:31.307743] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-01T20:54:31.506528] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:32.102364] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-01T20:54:32.382101] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:54:32.382428] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-01T20:54:32.382548] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:54:32.382606] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-01T20:54:32.382673] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:54:32.382752] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-01T20:54:32.382819] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-01T20:54:32.382858] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-01T20:54:32.382901] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-01T20:54:32.382952] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEW took 1.5s. Estimated remaining: 1h 40m 26s. Rate: 7.1 symbols/min [2025-10-01T20:54:32.607420] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:54:32.608616] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T20:54:32.624015] [DEBUG] [LOCAL ] PFD: Loaded 5139 existing records from primary storage. [2025-10-01T20:54:32.624340] [INFO ] [MAIN ] PFD: Loaded 5139 existing records. [2025-10-01T20:54:32.827695] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:54:32.827945] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-01T20:54:32.828002] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-01T20:54:32.828336] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-01T20:54:32.828395] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-01T20:54:32.907545] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-01T20:54:33.212470] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:33.229076] [DEBUG] [REMOTE ] PEO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:54:33.229423] [WARN ] [REMOTE ] PEO: No data returned for month 2025-10 [2025-10-01T20:54:33.229517] [FATAL] [REMOTE ] PEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:54:33.229613] [FATAL] [MAIN ] PEO: Failed to fetch primary data. [2025-10-01T20:54:33.229719] [WARN ] [MAIN ] PEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:54:33.229847] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-01T20:54:33.229927] [DEBUG] [LOCAL ] PEO: No primary data file found to delete. [2025-10-01T20:54:33.229966] [INFO ] [LOCAL ] PEO: Starting deletion of derivative data. [2025-10-01T20:54:33.230340] [DEBUG] [LOCAL ] PEO: Deleted derivative data file. [2025-10-01T20:54:33.230433] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PEO took 28.7s. Estimated remaining: 1h 40m 14s. Rate: 7.1 symbols/min [2025-10-01T20:54:33.431570] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:54:33.431812] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-01T20:54:33.431869] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-01T20:54:33.431980] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-01T20:54:33.432024] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-01T20:54:33.432067] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-01T20:54:33.432102] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-01T20:54:33.707627] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-01T20:54:33.832199] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:34.502393] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-01T20:54:34.898988] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T20:54:35.302380] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-01T20:54:35.679292] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-01T20:54:36.102393] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-01T20:54:36.352052] [DEBUG] [REMOTE ] PEN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:54:36.352390] [WARN ] [REMOTE ] PEN: No data returned for month 2025-10 [2025-10-01T20:54:36.352485] [FATAL] [REMOTE ] PEN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:54:36.352567] [FATAL] [MAIN ] PEN: Failed to fetch primary data. [2025-10-01T20:54:36.352623] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:54:36.352711] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-01T20:54:36.352775] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-01T20:54:36.352811] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-01T20:54:36.353073] [DEBUG] [LOCAL ] PEN: Deleted derivative data file. [2025-10-01T20:54:36.353173] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PEN took 36.7s. Estimated remaining: 1h 40m 3s. Rate: 7.1 symbols/min [2025-10-01T20:54:36.537608] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:54:36.581261] [DEBUG] [LOCAL ] PFGC: Loaded 46820 existing records from primary storage. [2025-10-01T20:54:36.581598] [INFO ] [MAIN ] PFGC: Loaded 46820 existing records. [2025-10-01T20:54:36.783503] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:54:36.783768] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-01T20:54:36.783823] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-01T20:54:36.786361] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-10-01T20:54:36.786424] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-01T20:54:36.902897] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-01T20:54:37.192968] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:37.702366] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-01T20:54:37.764607] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-01T20:54:37.893932] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T20:54:38.502355] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-01T20:54:38.653074] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T20:54:39.063619] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-01T20:54:39.302390] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-01T20:54:40.030756] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T20:54:40.102376] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-01T20:54:40.861815] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T20:54:40.902343] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-01T20:54:41.581230] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T20:54:41.702380] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-01T20:54:42.215673] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-01T20:54:42.502374] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-01T20:54:43.154510] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T20:54:43.302389] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-01T20:54:43.939956] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-01T20:54:44.102407] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-01T20:54:44.902357] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-01T20:54:44.960257] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-01T20:54:45.702375] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-01T20:54:46.502365] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-01T20:54:47.109189] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T20:54:47.264270] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T20:54:47.302334] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-01T20:54:47.591362] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-01T20:54:47.922014] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T20:54:48.102383] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-01T20:54:48.902369] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-01T20:54:48.997012] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T20:54:49.158935] [DEBUG] [REMOTE ] PFD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:54:49.159308] [WARN ] [REMOTE ] PFD: No data returned for month 2025-10 [2025-10-01T20:54:49.159407] [FATAL] [REMOTE ] PFD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:54:49.159530] [FATAL] [MAIN ] PFD: Failed to fetch primary data. [2025-10-01T20:54:49.159602] [WARN ] [MAIN ] PFD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:54:49.159704] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-01T20:54:49.159789] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-01T20:54:49.159894] [INFO ] [LOCAL ] PFD: Starting deletion of derivative data. [2025-10-01T20:54:49.160244] [DEBUG] [LOCAL ] PFD: Deleted derivative data file. [2025-10-01T20:54:49.160334] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PFD took 16.8s. Estimated remaining: 1h 39m 57s. Rate: 7.1 symbols/min [2025-10-01T20:54:49.355910] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:54:49.365449] [DEBUG] [LOCAL ] PFH: Loaded 6818 existing records from primary storage. [2025-10-01T20:54:49.365693] [INFO ] [MAIN ] PFH: Loaded 6818 existing records. [2025-10-01T20:54:49.565083] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:54:49.565274] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-01T20:54:49.565357] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-01T20:54:49.565933] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-01T20:54:49.565996] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-01T20:54:49.707470] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-01T20:54:49.971993] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:54:50.502347] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-01T20:54:50.638625] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T20:54:51.302354] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-01T20:54:51.381222] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T20:54:52.102379] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-01T20:54:52.788824] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T20:54:52.902432] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-01T20:54:53.618459] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T20:54:53.702412] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-01T20:54:53.990555] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-01T20:54:54.502401] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-01T20:54:54.923330] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T20:54:55.302456] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-01T20:54:56.102594] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-01T20:54:56.162339] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T20:54:56.902372] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-01T20:54:57.147728] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-01T20:54:57.285188] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T20:54:57.702399] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-01T20:54:58.502391] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-01T20:54:58.820306] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T20:54:59.302401] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-01T20:54:59.358473] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T20:55:00.102366] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-01T20:55:00.350837] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-01T20:55:00.697210] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-01T20:55:00.894427] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T20:55:00.903592] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-01T20:55:01.702435] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-01T20:55:01.927425] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-01T20:55:02.502375] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-01T20:55:02.772819] [DEBUG] [REMOTE ] PERF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:55:02.773146] [WARN ] [REMOTE ] PERF: No data returned for month 2025-10 [2025-10-01T20:55:02.773245] [FATAL] [REMOTE ] PERF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:55:02.773356] [FATAL] [MAIN ] PERF: Failed to fetch primary data. [2025-10-01T20:55:02.773445] [WARN ] [MAIN ] PERF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:55:02.773530] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-01T20:55:02.773615] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-01T20:55:02.773704] [INFO ] [LOCAL ] PERF: Starting deletion of derivative data. [2025-10-01T20:55:02.774318] [DEBUG] [LOCAL ] PERF: Deleted derivative data file. [2025-10-01T20:55:02.774425] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PERF took 35.0s. Estimated remaining: 1h 39m 51s. Rate: 7.1 symbols/min [2025-10-01T20:55:02.970836] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:55:02.986317] [DEBUG] [LOCAL ] PFL: Loaded 13601 existing records from primary storage. [2025-10-01T20:55:02.986599] [INFO ] [MAIN ] PFL: Loaded 13601 existing records. [2025-10-01T20:55:03.203178] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:55:03.203676] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-01T20:55:03.203798] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-01T20:55:03.214533] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-01T20:55:03.228951] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-01T20:55:03.307489] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-01T20:55:03.286881] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T20:55:03.649868] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:55:04.102370] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-01T20:55:04.217973] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-01T20:55:04.902447] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-01T20:55:05.702363] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-01T20:55:05.774967] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T20:55:06.020503] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T20:55:06.502358] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-01T20:55:06.560005] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-01T20:55:07.302395] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-01T20:55:08.102384] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-01T20:55:08.861344] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T20:55:08.902347] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-01T20:55:09.110370] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T20:55:09.296852] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-01T20:55:09.702388] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-01T20:55:10.485933] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T20:55:10.502339] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-01T20:55:11.302385] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-01T20:55:11.836458] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-01T20:55:12.102402] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-01T20:55:12.243675] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T20:55:12.318170] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T20:55:12.781097] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T20:55:12.902420] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-01T20:55:13.702372] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-01T20:55:14.502425] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-01T20:55:14.662040] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T20:55:15.302414] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-01T20:55:15.333596] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T20:55:15.489273] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-01T20:55:16.102389] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-01T20:55:16.324623] [DEBUG] [REMOTE ] PFH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:55:16.325041] [WARN ] [REMOTE ] PFH: No data returned for month 2025-10 [2025-10-01T20:55:16.325145] [FATAL] [REMOTE ] PFH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:55:16.325269] [FATAL] [MAIN ] PFH: Failed to fetch primary data. [2025-10-01T20:55:16.325342] [WARN ] [MAIN ] PFH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:55:16.325419] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-01T20:55:16.325490] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-01T20:55:16.325530] [INFO ] [LOCAL ] PFH: Starting deletion of derivative data. [2025-10-01T20:55:16.326104] [DEBUG] [LOCAL ] PFH: Deleted derivative data file. [2025-10-01T20:55:16.326200] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFH took 27.2s. Estimated remaining: 1h 39m 44s. Rate: 7.1 symbols/min [2025-10-01T20:55:16.559974] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T20:55:16.564351] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:55:16.612915] [DEBUG] [LOCAL ] PFLT: Loaded 43709 existing records from primary storage. [2025-10-01T20:55:16.613316] [INFO ] [MAIN ] PFLT: Loaded 43709 existing records. [2025-10-01T20:55:16.824529] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:55:16.824807] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-01T20:55:16.824860] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-01T20:55:16.826553] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-01T20:55:16.826618] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-01T20:55:16.907559] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-01T20:55:17.230150] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:55:17.702384] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-01T20:55:18.013222] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T20:55:18.502390] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-01T20:55:19.302362] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-01T20:55:19.446775] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T20:55:20.102381] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-01T20:55:20.403402] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T20:55:20.902382] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-01T20:55:21.473139] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-01T20:55:21.685848] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T20:55:21.702355] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-01T20:55:21.958393] [DEBUG] [REMOTE ] PFGC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:55:21.958734] [WARN ] [REMOTE ] PFGC: No data returned for month 2025-10 [2025-10-01T20:55:21.958849] [FATAL] [REMOTE ] PFGC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:55:21.958993] [FATAL] [MAIN ] PFGC: Failed to fetch primary data. [2025-10-01T20:55:21.959081] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:55:21.959179] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-01T20:55:21.959297] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-01T20:55:21.959356] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-01T20:55:21.959694] [DEBUG] [LOCAL ] PFGC: Deleted derivative data file. [2025-10-01T20:55:21.959817] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFGC took 45.6s. Estimated remaining: 1h 39m 35s. Rate: 7.1 symbols/min [2025-10-01T20:55:22.145429] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:55:22.166059] [DEBUG] [LOCAL ] PFN: Loaded 21730 existing records from primary storage. [2025-10-01T20:55:22.166310] [INFO ] [MAIN ] PFN: Loaded 21730 existing records. [2025-10-01T20:55:22.363348] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:55:22.363788] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-01T20:55:22.363895] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-01T20:55:22.365372] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-01T20:55:22.365435] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-01T20:55:22.506051] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-01T20:55:22.779493] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T20:55:22.820737] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:55:23.302411] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-01T20:55:23.483272] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T20:55:24.102427] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-01T20:55:24.357825] [DEBUG] [REMOTE ] PFE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:55:24.358208] [WARN ] [REMOTE ] PFE: No data returned for month 2025-10 [2025-10-01T20:55:24.358341] [FATAL] [REMOTE ] PFE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:55:24.358431] [FATAL] [MAIN ] PFE: Failed to fetch primary data. [2025-10-01T20:55:24.358469] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:55:24.358539] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-01T20:55:24.358604] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-01T20:55:24.358640] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-01T20:55:24.358737] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-01T20:55:24.358788] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFE took 51.1s. Estimated remaining: 1h 39m 23s. Rate: 7.1 symbols/min [2025-10-01T20:55:24.564923] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:55:24.565225] [DEBUG] [LOCAL ] PFO: No existing data file found in primary storage. [2025-10-01T20:55:24.565449] [WARN ] [MAIN ] PFO: No existing data found, performing full refresh instead. [2025-10-01T20:55:24.565706] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-01T20:55:24.565810] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-01T20:55:24.565920] [DEBUG] [LOCAL ] PFO: No primary data file found to delete. [2025-10-01T20:55:24.565975] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-01T20:55:24.720419] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T20:55:24.906483] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-01T20:55:24.991534] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:55:25.702406] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-01T20:55:26.038091] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T20:55:26.502393] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-01T20:55:27.302393] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-01T20:55:27.497504] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T20:55:27.558559] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T20:55:27.992249] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T20:55:28.102395] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-01T20:55:28.591733] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T20:55:28.902381] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-01T20:55:29.702380] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-01T20:55:29.883256] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T20:55:30.415853] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-01T20:55:30.502388] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-01T20:55:31.198917] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-01T20:55:31.302391] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-01T20:55:32.102381] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-01T20:55:32.454061] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T20:55:32.826444] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T20:55:32.902387] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-01T20:55:33.702430] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-01T20:55:34.278982] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T20:55:34.502353] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-01T20:55:34.519095] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T20:55:35.200048] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T20:55:35.302403] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-01T20:55:36.102404] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-01T20:55:36.400911] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T20:55:36.902385] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-01T20:55:37.333711] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T20:55:37.702405] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-01T20:55:37.936112] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T20:55:38.502372] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-01T20:55:38.856102] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T20:55:39.302377] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-01T20:55:39.502515] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T20:55:40.102384] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-01T20:55:40.493319] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T20:55:40.656439] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T20:55:40.902366] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-01T20:55:41.701954] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T20:55:41.704062] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-01T20:55:41.995378] [DEBUG] [REMOTE ] PFL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:55:41.995734] [WARN ] [REMOTE ] PFL: No data returned for month 2025-10 [2025-10-01T20:55:41.995830] [FATAL] [REMOTE ] PFL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:55:41.995916] [FATAL] [MAIN ] PFL: Failed to fetch primary data. [2025-10-01T20:55:41.995983] [WARN ] [MAIN ] PFL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:55:41.996077] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-01T20:55:41.996169] [DEBUG] [LOCAL ] PFL: No primary data file found to delete. [2025-10-01T20:55:41.996232] [INFO ] [LOCAL ] PFL: Starting deletion of derivative data. [2025-10-01T20:55:41.996585] [DEBUG] [LOCAL ] PFL: Deleted derivative data file. [2025-10-01T20:55:41.996717] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFL took 39.2s. Estimated remaining: 1h 39m 19s. Rate: 7.1 symbols/min [2025-10-01T20:55:42.185369] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:55:42.230684] [DEBUG] [LOCAL ] PFS: Loaded 35582 existing records from primary storage. [2025-10-01T20:55:42.231046] [INFO ] [MAIN ] PFS: Loaded 35582 existing records. [2025-10-01T20:55:42.426844] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:55:42.427149] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-01T20:55:42.427257] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-01T20:55:42.429326] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-10-01T20:55:42.429398] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-01T20:55:42.507540] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-01T20:55:42.814288] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:55:43.302386] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-01T20:55:44.102381] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-01T20:55:44.195794] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T20:55:44.898404] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T20:55:44.907828] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-01T20:55:45.260538] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T20:55:45.702391] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-01T20:55:46.502383] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-01T20:55:46.521550] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:55:46.586637] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T20:55:47.302405] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-01T20:55:47.671723] [DEBUG] [REMOTE ] PFO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:55:47.692581] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T20:55:47.689521] [WARN ] [REMOTE ] PFO: No data returned for month 2025-10 [2025-10-01T20:55:47.692981] [FATAL] [REMOTE ] PFO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:55:47.693168] [FATAL] [MAIN ] PFO: Failed to fetch primary data. [2025-10-01T20:55:47.693260] [WARN ] [MAIN ] PFO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:55:47.693433] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-01T20:55:47.693582] [DEBUG] [LOCAL ] PFO: No primary data file found to delete. [2025-10-01T20:55:47.693684] [INFO ] [LOCAL ] PFO: Starting deletion of derivative data. [2025-10-01T20:55:47.705900] [DEBUG] [LOCAL ] PFO: No derivative data file found to delete. [2025-10-01T20:55:47.706070] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFO took 23.3s. Estimated remaining: 1h 39m 9s. Rate: 7.1 symbols/min [2025-10-01T20:55:47.983417] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:55:48.033888] [DEBUG] [LOCAL ] PFSI: Loaded 28610 existing records from primary storage. [2025-10-01T20:55:48.034332] [INFO ] [MAIN ] PFSI: Loaded 28610 existing records. [2025-10-01T20:55:48.107503] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-01T20:55:48.289318] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:55:48.289577] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-01T20:55:48.289630] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-01T20:55:48.292053] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-01T20:55:48.292117] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-01T20:55:48.690145] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:55:48.902450] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-01T20:55:49.702368] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-01T20:55:49.879961] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T20:55:50.071683] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T20:55:50.502362] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-01T20:55:50.650753] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T20:55:50.730192] [DEBUG] [REMOTE ] PFN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:55:50.730580] [WARN ] [REMOTE ] PFN: No data returned for month 2025-10 [2025-10-01T20:55:50.730726] [FATAL] [REMOTE ] PFN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:55:50.730855] [FATAL] [MAIN ] PFN: Failed to fetch primary data. [2025-10-01T20:55:50.730947] [WARN ] [MAIN ] PFN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:55:50.731039] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-01T20:55:50.731131] [DEBUG] [LOCAL ] PFN: No primary data file found to delete. [2025-10-01T20:55:50.731193] [INFO ] [LOCAL ] PFN: Starting deletion of derivative data. [2025-10-01T20:55:50.731771] [DEBUG] [LOCAL ] PFN: Deleted derivative data file. [2025-10-01T20:55:50.731900] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFN took 28.8s. Estimated remaining: 1h 38m 58s. Rate: 7.1 symbols/min [2025-10-01T20:55:50.966389] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:55:50.966585] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-01T20:55:50.966628] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-01T20:55:50.966762] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-01T20:55:50.966805] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-01T20:55:50.966848] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-01T20:55:50.966883] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-01T20:55:51.307521] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-01T20:55:51.367507] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:55:52.102436] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-01T20:55:52.741993] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T20:55:52.902413] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-01T20:55:53.702422] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-01T20:55:54.405128] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T20:55:54.407113] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-01T20:55:54.502386] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-01T20:55:54.660707] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T20:55:55.302383] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-01T20:55:56.102445] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-01T20:55:56.550064] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-01T20:55:56.765992] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-01T20:55:56.902418] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-01T20:55:57.489747] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T20:55:57.702388] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-01T20:55:58.488099] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T20:55:58.502377] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-01T20:55:59.199395] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T20:55:59.302378] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-01T20:56:00.102433] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-01T20:56:00.182732] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T20:56:00.593607] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T20:56:00.902387] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-01T20:56:01.702420] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-01T20:56:01.730926] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T20:56:02.200011] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T20:56:02.502378] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-01T20:56:03.302436] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-01T20:56:04.009622] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-01T20:56:04.083349] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T20:56:04.102339] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-01T20:56:04.791950] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T20:56:04.902410] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-01T20:56:05.702408] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-01T20:56:05.921174] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T20:56:06.364839] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T20:56:06.502423] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-01T20:56:06.800961] [DEBUG] [REMOTE ] PFLT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:56:06.801321] [WARN ] [REMOTE ] PFLT: No data returned for month 2025-10 [2025-10-01T20:56:06.801400] [FATAL] [REMOTE ] PFLT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:56:06.801488] [FATAL] [MAIN ] PFLT: Failed to fetch primary data. [2025-10-01T20:56:06.801556] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:56:06.801633] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-01T20:56:06.801736] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-01T20:56:06.801779] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-01T20:56:06.802207] [DEBUG] [LOCAL ] PFLT: Deleted derivative data file. [2025-10-01T20:56:06.802322] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFLT took 50.5s. Estimated remaining: 1h 38m 53s. Rate: 7.1 symbols/min [2025-10-01T20:56:06.994963] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:56:07.003186] [DEBUG] [LOCAL ] PGP: Loaded 5471 existing records from primary storage. [2025-10-01T20:56:07.003416] [INFO ] [MAIN ] PGP: Loaded 5471 existing records. [2025-10-01T20:56:07.212995] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:56:07.213233] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-01T20:56:07.213383] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-01T20:56:07.213825] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-01T20:56:07.213947] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-01T20:56:07.307507] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-01T20:56:07.635857] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:56:07.674892] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T20:56:08.102423] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-01T20:56:08.852144] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T20:56:08.902393] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-01T20:56:09.702413] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-01T20:56:10.219223] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T20:56:10.384520] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-01T20:56:10.406074] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-01T20:56:10.502380] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-01T20:56:11.041429] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T20:56:11.302388] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-01T20:56:12.055665] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T20:56:12.102406] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-01T20:56:12.775620] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-01T20:56:12.902414] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-01T20:56:13.702409] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-01T20:56:13.835587] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-01T20:56:14.502432] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-01T20:56:15.302419] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-01T20:56:15.881609] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-01T20:56:16.102379] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-01T20:56:16.164683] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T20:56:16.761705] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T20:56:16.902419] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-01T20:56:17.702390] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-01T20:56:18.337920] [DEBUG] [REMOTE ] PFS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:56:18.339474] [WARN ] [REMOTE ] PFS: No data returned for month 2025-10 [2025-10-01T20:56:18.339346] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T20:56:18.339902] [FATAL] [REMOTE ] PFS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:56:18.340148] [FATAL] [MAIN ] PFS: Failed to fetch primary data. [2025-10-01T20:56:18.346492] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:56:18.346707] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-01T20:56:18.346786] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-01T20:56:18.347133] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-01T20:56:18.347480] [DEBUG] [LOCAL ] PFS: Deleted derivative data file. [2025-10-01T20:56:18.347588] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFS took 36.4s. Estimated remaining: 1h 38m 46s. Rate: 7.1 symbols/min [2025-10-01T20:56:18.502406] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-01T20:56:18.552450] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:56:18.552816] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-01T20:56:18.552891] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-01T20:56:18.553305] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-01T20:56:18.553363] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-01T20:56:18.553484] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-01T20:56:18.564532] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-01T20:56:18.601359] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-01T20:56:19.044468] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:56:19.302384] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-01T20:56:19.875580] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T20:56:20.102404] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-01T20:56:20.902405] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-01T20:56:20.994508] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T20:56:21.702376] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-01T20:56:21.747743] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-01T20:56:22.192579] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-01T20:56:22.502377] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-01T20:56:23.302386] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-01T20:56:23.536327] [DEBUG] [REMOTE ] PFSI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:56:23.536750] [WARN ] [REMOTE ] PFSI: No data returned for month 2025-10 [2025-10-01T20:56:23.536882] [FATAL] [REMOTE ] PFSI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:56:23.537021] [FATAL] [MAIN ] PFSI: Failed to fetch primary data. [2025-10-01T20:56:23.537107] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:56:23.537197] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-01T20:56:23.537282] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-01T20:56:23.537338] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-01T20:56:23.537775] [DEBUG] [LOCAL ] PFSI: Deleted derivative data file. [2025-10-01T20:56:23.537933] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 35.8s. Estimated remaining: 1h 38m 36s. Rate: 7.1 symbols/min [2025-10-01T20:56:23.781044] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:56:23.813558] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-01T20:56:23.873472] [DEBUG] [LOCAL ] PGRE: Loaded 46650 existing records from primary storage. [2025-10-01T20:56:23.873913] [INFO ] [MAIN ] PGRE: Loaded 46650 existing records. [2025-10-01T20:56:24.077447] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:56:24.077711] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-01T20:56:24.077828] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-01T20:56:24.080000] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-01T20:56:24.080066] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-01T20:56:24.107583] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-01T20:56:24.481948] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:56:24.818874] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-01T20:56:24.905285] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-01T20:56:24.908675] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-01T20:56:25.702424] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-01T20:56:26.206705] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T20:56:26.502384] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-01T20:56:27.302407] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-01T20:56:27.610810] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T20:56:27.830415] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T20:56:28.102390] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-01T20:56:28.406154] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T20:56:28.858631] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T20:56:28.902426] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-01T20:56:29.644554] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T20:56:29.702392] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-01T20:56:30.502395] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-01T20:56:31.194952] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T20:56:31.302439] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-01T20:56:31.717090] [DEBUG] [REMOTE ] PG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:56:31.717458] [WARN ] [REMOTE ] PG: No data returned for month 2025-10 [2025-10-01T20:56:31.717554] [FATAL] [REMOTE ] PG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:56:31.717698] [FATAL] [MAIN ] PG: Failed to fetch primary data. [2025-10-01T20:56:31.717776] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:56:31.717825] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-01T20:56:31.717938] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-01T20:56:31.717993] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-01T20:56:31.718036] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-01T20:56:31.718108] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PG took 41.0s. Estimated remaining: 1h 38m 28s. Rate: 7.1 symbols/min [2025-10-01T20:56:31.904052] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:56:31.911547] [DEBUG] [LOCAL ] PGZ: Loaded 5450 existing records from primary storage. [2025-10-01T20:56:31.911757] [INFO ] [MAIN ] PGZ: Loaded 5450 existing records. [2025-10-01T20:56:32.107525] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-01T20:56:32.130985] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:56:32.132302] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-01T20:56:32.132380] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-01T20:56:32.132876] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-01T20:56:32.132972] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-01T20:56:32.538333] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:56:32.725670] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-01T20:56:32.902389] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-01T20:56:33.251835] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T20:56:33.702390] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-01T20:56:33.795741] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T20:56:34.502391] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-01T20:56:34.742437] [DEBUG] [REMOTE ] PGP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:56:34.742890] [WARN ] [REMOTE ] PGP: No data returned for month 2025-10 [2025-10-01T20:56:34.742989] [FATAL] [REMOTE ] PGP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:56:34.743075] [FATAL] [MAIN ] PGP: Failed to fetch primary data. [2025-10-01T20:56:34.743157] [WARN ] [MAIN ] PGP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:56:34.743243] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-01T20:56:34.743324] [DEBUG] [LOCAL ] PGP: No primary data file found to delete. [2025-10-01T20:56:34.743378] [INFO ] [LOCAL ] PGP: Starting deletion of derivative data. [2025-10-01T20:56:34.743895] [DEBUG] [LOCAL ] PGP: Deleted derivative data file. [2025-10-01T20:56:34.744008] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PGP took 27.9s. Estimated remaining: 1h 38m 17s. Rate: 7.1 symbols/min [2025-10-01T20:56:34.931112] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:56:34.931322] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-01T20:56:34.931365] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-01T20:56:34.931499] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-01T20:56:34.931564] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-01T20:56:34.931670] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-01T20:56:34.931746] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-01T20:56:35.302599] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-01T20:56:35.331490] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:56:35.978526] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-01T20:56:36.012834] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T20:56:36.102383] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-01T20:56:36.902392] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-01T20:56:37.702355] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-01T20:56:37.735526] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T20:56:38.389929] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T20:56:38.475237] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T20:56:38.502393] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-01T20:56:39.023928] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-01T20:56:39.302430] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-01T20:56:40.083245] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T20:56:40.102397] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-01T20:56:40.902386] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-01T20:56:41.702395] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-01T20:56:41.988318] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T20:56:42.502382] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-01T20:56:42.699992] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T20:56:43.302380] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-01T20:56:43.714739] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-01T20:56:44.102385] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-01T20:56:44.272235] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T20:56:44.639491] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T20:56:44.902396] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-01T20:56:45.702377] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-01T20:56:45.820867] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T20:56:46.358873] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T20:56:46.502449] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-01T20:56:46.827488] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T20:56:47.302379] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-01T20:56:47.822109] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-01T20:56:48.043036] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T20:56:48.102429] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-01T20:56:48.902418] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-01T20:56:49.702386] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-01T20:56:49.967226] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T20:56:50.502391] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-01T20:56:50.800951] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T20:56:50.995405] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T20:56:51.302407] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-01T20:56:51.826957] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-01T20:56:52.102400] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-01T20:56:52.902382] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-01T20:56:53.043452] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T20:56:53.668089] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T20:56:53.702339] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-01T20:56:54.196364] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T20:56:54.219163] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-01T20:56:54.502387] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-01T20:56:54.785563] [DEBUG] [REMOTE ] PGZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:56:54.785961] [WARN ] [REMOTE ] PGZ: No data returned for month 2025-10 [2025-10-01T20:56:54.786056] [FATAL] [REMOTE ] PGZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:56:54.786147] [FATAL] [MAIN ] PGZ: Failed to fetch primary data. [2025-10-01T20:56:54.786191] [WARN ] [MAIN ] PGZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:56:54.786239] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-01T20:56:54.786304] [DEBUG] [LOCAL ] PGZ: No primary data file found to delete. [2025-10-01T20:56:54.786343] [INFO ] [LOCAL ] PGZ: Starting deletion of derivative data. [2025-10-01T20:56:54.786747] [DEBUG] [LOCAL ] PGZ: Deleted derivative data file. [2025-10-01T20:56:54.786861] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 23.1s. Estimated remaining: 1h 38m 13s. Rate: 7.1 symbols/min [2025-10-01T20:56:54.975086] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:56:54.986397] [DEBUG] [LOCAL ] PHD: Loaded 10332 existing records from primary storage. [2025-10-01T20:56:54.986624] [INFO ] [MAIN ] PHD: Loaded 10332 existing records. [2025-10-01T20:56:55.183302] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:56:55.183566] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-01T20:56:55.183624] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-01T20:56:55.184554] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-10-01T20:56:55.184619] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-01T20:56:55.307605] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-01T20:56:55.580773] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:56:56.102428] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-01T20:56:56.902443] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-01T20:56:57.126434] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T20:56:57.702402] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-01T20:56:58.142245] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-01T20:56:58.482478] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T20:56:58.498253] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T20:56:58.502332] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-01T20:56:59.302397] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-01T20:56:59.339999] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T20:56:59.606883] [DEBUG] [REMOTE ] PGRE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:56:59.607293] [WARN ] [REMOTE ] PGRE: No data returned for month 2025-10 [2025-10-01T20:56:59.607403] [FATAL] [REMOTE ] PGRE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:56:59.607527] [FATAL] [MAIN ] PGRE: Failed to fetch primary data. [2025-10-01T20:56:59.607614] [WARN ] [MAIN ] PGRE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:56:59.607736] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-01T20:56:59.607813] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-01T20:56:59.607872] [INFO ] [LOCAL ] PGRE: Starting deletion of derivative data. [2025-10-01T20:56:59.608294] [DEBUG] [LOCAL ] PGRE: Deleted derivative data file. [2025-10-01T20:56:59.608384] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGRE took 36.1s. Estimated remaining: 1h 38m 3s. Rate: 7.1 symbols/min [2025-10-01T20:57:00.102424] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-01T20:57:00.902421] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-01T20:57:00.918873] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T20:57:01.102008] [DEBUG] [REMOTE ] PGR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:57:01.102366] [WARN ] [REMOTE ] PGR: No data returned for month 2025-10 [2025-10-01T20:57:01.102443] [FATAL] [REMOTE ] PGR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:57:01.102550] [FATAL] [MAIN ] PGR: Failed to fetch primary data. [2025-10-01T20:57:01.102623] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:57:01.102734] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-01T20:57:01.102802] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-01T20:57:01.102841] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-01T20:57:01.102884] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-01T20:57:01.102955] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PGR took 42.8s. Estimated remaining: 1h 37m 52s. Rate: 7.1 symbols/min [2025-10-01T20:57:01.702394] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-01T20:57:02.502365] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-01T20:57:03.312684] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T20:57:03.315544] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-01T20:57:03.355999] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T20:57:04.008045] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T20:57:04.102438] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-01T20:57:04.760547] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T20:57:04.902362] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-01T20:57:05.702373] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-01T20:57:05.743043] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T20:57:06.502435] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-01T20:57:07.219453] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T20:57:07.311713] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-01T20:57:07.314969] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T20:57:08.102432] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-01T20:57:08.202443] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-01T20:57:08.902381] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-01T20:57:09.688034] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T20:57:09.702337] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-01T20:57:09.946693] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T20:57:10.502473] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-01T20:57:10.704497] [DEBUG] [REMOTE ] PHD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:57:10.704894] [WARN ] [REMOTE ] PHD: No data returned for month 2025-10 [2025-10-01T20:57:10.704987] [FATAL] [REMOTE ] PHD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:57:10.705103] [FATAL] [MAIN ] PHD: Failed to fetch primary data. [2025-10-01T20:57:10.705173] [WARN ] [MAIN ] PHD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:57:10.705245] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-01T20:57:10.705308] [DEBUG] [LOCAL ] PHD: No primary data file found to delete. [2025-10-01T20:57:10.705343] [INFO ] [LOCAL ] PHD: Starting deletion of derivative data. [2025-10-01T20:57:10.705840] [DEBUG] [LOCAL ] PHD: Deleted derivative data file. [2025-10-01T20:57:10.705928] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PHD took 15.9s. Estimated remaining: 1h 37m 44s. Rate: 7.1 symbols/min [2025-10-01T20:57:10.949600] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T20:57:11.302398] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-01T20:57:11.576107] [DEBUG] [REMOTE ] PH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:57:11.576416] [WARN ] [REMOTE ] PH: No data returned for month 2025-10 [2025-10-01T20:57:11.576508] [FATAL] [REMOTE ] PH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:57:11.576595] [FATAL] [MAIN ] PH: Failed to fetch primary data. [2025-10-01T20:57:11.576684] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:57:11.576760] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-01T20:57:11.576827] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-01T20:57:11.576866] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-01T20:57:11.576908] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-01T20:57:11.576970] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PH took 36.8s. Estimated remaining: 1h 37m 32s. Rate: 7.1 symbols/min [2025-10-01T20:57:12.273156] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:57:12.294937] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:57:12.371061] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:57:12.373892] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:57:12.391206] [DEBUG] [LOCAL ] PHI: Loaded 14996 existing records from primary storage. [2025-10-01T20:57:12.391461] [INFO ] [MAIN ] PHI: Loaded 14996 existing records. [2025-10-01T20:57:12.585259] [DEBUG] [LOCAL ] PHK: Loaded 26275 existing records from primary storage. [2025-10-01T20:57:12.604890] [INFO ] [MAIN ] PHK: Loaded 26275 existing records. [2025-10-01T20:57:12.677953] [DEBUG] [LOCAL ] PHG: Loaded 46099 existing records from primary storage. [2025-10-01T20:57:12.664919] [DEBUG] [LOCAL ] PHIN: Loaded 32689 existing records from primary storage. [2025-10-01T20:57:12.725020] [INFO ] [MAIN ] PHIN: Loaded 32689 existing records. [2025-10-01T20:57:12.707467] [INFO ] [MAIN ] PHG: Loaded 46099 existing records. [2025-10-01T20:57:12.760064] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:57:12.814526] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-01T20:57:12.872709] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-01T20:57:13.030520] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-01T20:57:13.147980] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:57:13.174193] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-01T20:57:13.128312] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-01T20:57:13.184639] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-01T20:57:13.245865] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-01T20:57:13.302972] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:57:13.299670] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-01T20:57:13.369449] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-01T20:57:13.388219] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-01T20:57:13.478291] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:57:13.513765] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-01T20:57:13.513486] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-10-01T20:57:13.528217] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-01T20:57:13.560103] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-01T20:57:13.613189] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-01T20:57:13.691849] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-01T20:57:14.482819] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:57:14.565991] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-01T20:57:14.797329] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:57:14.816464] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-01T20:57:14.967572] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:57:14.978242] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-01T20:57:15.041762] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:57:15.042078] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-01T20:57:15.798472] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T20:57:15.802094] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-01T20:57:16.209050] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T20:57:16.215040] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-01T20:57:16.349406] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T20:57:16.505865] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T20:57:16.680162] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T20:57:16.902395] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-01T20:57:17.353923] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T20:57:17.559280] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T20:57:17.702396] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-01T20:57:18.502386] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-01T20:57:19.302366] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-01T20:57:19.468569] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T20:57:19.837741] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T20:57:20.102475] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-01T20:57:20.337748] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T20:57:20.902409] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-01T20:57:21.665625] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-01T20:57:21.702356] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-01T20:57:21.815575] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T20:57:22.502379] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-01T20:57:22.940524] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T20:57:23.302385] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-01T20:57:23.883234] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T20:57:24.102363] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-01T20:57:24.499373] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T20:57:24.902382] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-01T20:57:25.038786] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T20:57:25.702387] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-01T20:57:26.470294] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T20:57:26.502379] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-01T20:57:26.902229] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T20:57:27.302394] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-01T20:57:27.510852] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T20:57:28.102397] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-01T20:57:28.498054] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T20:57:28.902386] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-01T20:57:29.702384] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-01T20:57:29.831856] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T20:57:30.235751] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T20:57:30.493921] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T20:57:30.502327] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-01T20:57:31.302387] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-01T20:57:31.751067] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T20:57:32.102469] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-01T20:57:32.821818] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T20:57:32.902394] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-01T20:57:33.476389] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T20:57:33.702382] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-01T20:57:33.957460] [DEBUG] [REMOTE ] PHI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:57:33.958130] [WARN ] [REMOTE ] PHI: No data returned for month 2025-10 [2025-10-01T20:57:33.958304] [FATAL] [REMOTE ] PHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:57:33.958413] [FATAL] [MAIN ] PHI: Failed to fetch primary data. [2025-10-01T20:57:33.958484] [WARN ] [MAIN ] PHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:57:33.958557] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-01T20:57:33.958623] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-01T20:57:33.958718] [INFO ] [LOCAL ] PHI: Starting deletion of derivative data. [2025-10-01T20:57:33.959242] [DEBUG] [LOCAL ] PHI: Deleted derivative data file. [2025-10-01T20:57:33.959349] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 22.4s. Estimated remaining: 1h 37m 29s. Rate: 7.1 symbols/min [2025-10-01T20:57:34.164058] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:57:34.164435] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-01T20:57:34.164630] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-01T20:57:34.164929] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-01T20:57:34.165006] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-01T20:57:34.165109] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-01T20:57:34.165237] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-01T20:57:34.308785] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T20:57:34.509639] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-01T20:57:34.602231] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:57:35.302375] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-01T20:57:35.943279] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T20:57:36.102345] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-01T20:57:36.243559] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T20:57:36.902575] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-01T20:57:37.702377] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-01T20:57:37.916724] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T20:57:38.462448] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T20:57:38.502375] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-01T20:57:39.105590] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T20:57:39.302380] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-01T20:57:39.647325] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T20:57:40.102377] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-01T20:57:40.902363] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-01T20:57:41.136380] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T20:57:41.702372] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-01T20:57:42.007323] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T20:57:42.259203] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T20:57:42.502402] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-01T20:57:42.837775] [DEBUG] [REMOTE ] PHIN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:57:42.838171] [WARN ] [REMOTE ] PHIN: No data returned for month 2025-10 [2025-10-01T20:57:42.838273] [FATAL] [REMOTE ] PHIN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:57:42.838389] [FATAL] [MAIN ] PHIN: Failed to fetch primary data. [2025-10-01T20:57:42.838475] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:57:42.838574] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-01T20:57:42.838669] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-01T20:57:42.838727] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-01T20:57:42.839249] [DEBUG] [LOCAL ] PHIN: Deleted derivative data file. [2025-10-01T20:57:42.846596] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHIN took 31.2s. Estimated remaining: 1h 37m 21s. Rate: 7.1 symbols/min [2025-10-01T20:57:43.053336] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:57:43.104852] [DEBUG] [LOCAL ] PHR: Loaded 37388 existing records from primary storage. [2025-10-01T20:57:43.105196] [INFO ] [MAIN ] PHR: Loaded 37388 existing records. [2025-10-01T20:57:43.310553] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:57:43.304216] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-01T20:57:43.311289] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-01T20:57:43.312321] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-01T20:57:43.313404] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-01T20:57:43.313486] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-01T20:57:43.609869] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T20:57:43.768176] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:57:44.102387] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-01T20:57:44.848542] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T20:57:44.902344] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-01T20:57:45.449283] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T20:57:45.702424] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-01T20:57:45.944221] [DEBUG] [REMOTE ] PHK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:57:45.944578] [WARN ] [REMOTE ] PHK: No data returned for month 2025-10 [2025-10-01T20:57:45.944708] [FATAL] [REMOTE ] PHK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:57:45.944799] [FATAL] [MAIN ] PHK: Failed to fetch primary data. [2025-10-01T20:57:45.944865] [WARN ] [MAIN ] PHK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:57:45.944938] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-01T20:57:45.945005] [DEBUG] [LOCAL ] PHK: No primary data file found to delete. [2025-10-01T20:57:45.945042] [INFO ] [LOCAL ] PHK: Starting deletion of derivative data. [2025-10-01T20:57:45.945489] [DEBUG] [LOCAL ] PHK: Deleted derivative data file. [2025-10-01T20:57:45.945580] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHK took 34.4s. Estimated remaining: 1h 37m 10s. Rate: 7.1 symbols/min [2025-10-01T20:57:46.141283] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:57:46.192694] [DEBUG] [LOCAL ] PII: Loaded 48956 existing records from primary storage. [2025-10-01T20:57:46.193099] [INFO ] [MAIN ] PII: Loaded 48956 existing records. [2025-10-01T20:57:46.401693] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:57:46.401912] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-01T20:57:46.401962] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-01T20:57:46.404225] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-10-01T20:57:46.404288] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-01T20:57:46.508153] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-01T20:57:46.809411] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:57:46.841968] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T20:57:47.302391] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-01T20:57:48.102376] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-01T20:57:48.268045] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T20:57:48.902406] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-01T20:57:49.199144] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T20:57:49.474785] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T20:57:49.702388] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-01T20:57:50.309868] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T20:57:50.502436] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-01T20:57:51.302360] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-01T20:57:51.564541] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T20:57:51.901099] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T20:57:52.102402] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-01T20:57:52.669771] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T20:57:52.902391] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-01T20:57:53.210764] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T20:57:53.702413] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-01T20:57:54.502364] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-01T20:57:54.678815] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T20:57:55.302376] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-01T20:57:55.488958] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-01T20:57:56.065937] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T20:57:56.102355] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-01T20:57:56.619515] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T20:57:56.902686] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-01T20:57:57.702389] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-01T20:57:58.053153] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T20:57:58.096488] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T20:57:58.502424] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-01T20:57:59.302352] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-01T20:57:59.425422] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T20:57:59.872430] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T20:58:00.102387] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-01T20:58:00.902374] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-01T20:58:01.212992] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T20:58:01.702428] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-01T20:58:02.085281] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-01T20:58:02.502390] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-01T20:58:02.661748] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T20:58:02.846033] [DEBUG] [REMOTE ] PHG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:02.846373] [WARN ] [REMOTE ] PHG: No data returned for month 2025-10 [2025-10-01T20:58:02.846519] [FATAL] [REMOTE ] PHG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:02.846670] [FATAL] [MAIN ] PHG: Failed to fetch primary data. [2025-10-01T20:58:02.846744] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:02.846836] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-01T20:58:02.846918] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-01T20:58:02.846997] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-01T20:58:02.847384] [DEBUG] [LOCAL ] PHG: Deleted derivative data file. [2025-10-01T20:58:02.847493] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHG took 51.3s. Estimated remaining: 1h 37m 5s. Rate: 7.1 symbols/min [2025-10-01T20:58:03.054263] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:03.062483] [DEBUG] [LOCAL ] PIM: Loaded 4790 existing records from primary storage. [2025-10-01T20:58:03.062736] [INFO ] [MAIN ] PIM: Loaded 4790 existing records. [2025-10-01T20:58:03.267911] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:58:03.268434] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-01T20:58:03.268590] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-01T20:58:03.269027] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-01T20:58:03.269156] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-01T20:58:03.310026] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-01T20:58:03.478766] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T20:58:03.756367] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:04.102405] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-01T20:58:04.786360] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T20:58:04.902355] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-01T20:58:05.284380] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T20:58:05.702402] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-01T20:58:06.261363] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T20:58:06.502455] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-01T20:58:07.179237] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T20:58:07.302371] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-01T20:58:07.926088] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T20:58:08.102351] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-01T20:58:08.187122] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T20:58:08.902389] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-01T20:58:08.917196] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T20:58:09.702422] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-01T20:58:10.502348] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-01T20:58:10.552182] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T20:58:11.302437] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-01T20:58:11.351626] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T20:58:12.102355] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-01T20:58:12.281510] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T20:58:12.760627] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T20:58:12.902375] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-01T20:58:13.153237] [DEBUG] [REMOTE ] PHR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:13.153551] [WARN ] [REMOTE ] PHR: No data returned for month 2025-10 [2025-10-01T20:58:13.153684] [FATAL] [REMOTE ] PHR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:13.153812] [FATAL] [MAIN ] PHR: Failed to fetch primary data. [2025-10-01T20:58:13.153884] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:13.153961] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-01T20:58:13.154062] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-01T20:58:13.154115] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-01T20:58:13.154488] [DEBUG] [LOCAL ] PHR: Deleted derivative data file. [2025-10-01T20:58:13.154606] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHR took 30.3s. Estimated remaining: 1h 36m 58s. Rate: 7.1 symbols/min [2025-10-01T20:58:13.341367] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:13.357434] [DEBUG] [LOCAL ] PINE: Loaded 14075 existing records from primary storage. [2025-10-01T20:58:13.357731] [INFO ] [MAIN ] PINE: Loaded 14075 existing records. [2025-10-01T20:58:13.556259] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:58:13.556606] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-01T20:58:13.556809] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-01T20:58:13.557330] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-01T20:58:13.557481] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-01T20:58:13.707129] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-01T20:58:13.964878] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:13.993745] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T20:58:14.502398] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-01T20:58:15.188225] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T20:58:15.305704] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-01T20:58:15.307157] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T20:58:15.533876] [DEBUG] [REMOTE ] PHM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:15.534184] [WARN ] [REMOTE ] PHM: No data returned for month 2025-10 [2025-10-01T20:58:15.534310] [FATAL] [REMOTE ] PHM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:15.534465] [FATAL] [MAIN ] PHM: Failed to fetch primary data. [2025-10-01T20:58:15.534557] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:15.534676] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-01T20:58:15.534772] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-01T20:58:15.534819] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-01T20:58:15.534865] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-01T20:58:15.534917] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PHM took 41.6s. Estimated remaining: 1h 36m 47s. Rate: 7.1 symbols/min [2025-10-01T20:58:15.723348] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:15.781257] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-01T20:58:15.781681] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-10-01T20:58:16.011479] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:58:16.011758] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-01T20:58:16.011815] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-01T20:58:16.013132] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-01T20:58:16.013196] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-01T20:58:16.107508] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-01T20:58:16.424327] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:16.902377] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-01T20:58:17.190464] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T20:58:17.204935] [DEBUG] [REMOTE ] PII: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:17.205202] [WARN ] [REMOTE ] PII: No data returned for month 2025-10 [2025-10-01T20:58:17.205293] [FATAL] [REMOTE ] PII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:17.205365] [FATAL] [MAIN ] PII: Failed to fetch primary data. [2025-10-01T20:58:17.205428] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:17.205500] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-01T20:58:17.205564] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-01T20:58:17.205600] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-01T20:58:17.206090] [DEBUG] [LOCAL ] PII: Deleted derivative data file. [2025-10-01T20:58:17.206196] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PII took 31.3s. Estimated remaining: 1h 36m 35s. Rate: 7.1 symbols/min [2025-10-01T20:58:17.406234] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:17.425052] [DEBUG] [LOCAL ] PIPR: Loaded 14870 existing records from primary storage. [2025-10-01T20:58:17.425339] [INFO ] [MAIN ] PIPR: Loaded 14870 existing records. [2025-10-01T20:58:17.653883] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:58:17.654101] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-01T20:58:17.654151] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-01T20:58:17.654696] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-10-01T20:58:17.654759] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-01T20:58:17.707582] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-01T20:58:18.100590] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:18.449462] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-01T20:58:18.502404] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-01T20:58:19.192753] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T20:58:19.302399] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-01T20:58:20.102399] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-01T20:58:20.902394] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-01T20:58:21.217440] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T20:58:21.421566] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T20:58:21.702391] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-01T20:58:21.781689] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T20:58:22.502394] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-01T20:58:23.302387] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-01T20:58:23.548883] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T20:58:23.631935] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T20:58:24.042665] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T20:58:24.102378] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-01T20:58:24.902387] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-01T20:58:25.593325] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T20:58:25.702381] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-01T20:58:25.849318] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T20:58:26.097961] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-01T20:58:26.502380] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-01T20:58:27.302372] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-01T20:58:27.468518] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T20:58:28.102394] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-01T20:58:28.311579] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T20:58:28.902418] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-01T20:58:29.016963] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T20:58:29.702387] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-01T20:58:29.715550] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T20:58:30.502442] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-01T20:58:31.302380] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-01T20:58:31.777227] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T20:58:31.878614] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-01T20:58:32.005904] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T20:58:32.102386] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-01T20:58:32.902389] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-01T20:58:32.993206] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T20:58:33.702350] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-01T20:58:34.105354] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-01T20:58:34.502365] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-01T20:58:34.730844] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T20:58:35.302403] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-01T20:58:35.390137] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-01T20:58:35.943036] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-01T20:58:36.102406] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-01T20:58:36.902358] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-01T20:58:36.918760] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T20:58:37.702366] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-01T20:58:37.884343] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T20:58:37.935021] [DEBUG] [REMOTE ] PIM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:37.935316] [WARN ] [REMOTE ] PIM: No data returned for month 2025-10 [2025-10-01T20:58:37.935408] [FATAL] [REMOTE ] PIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:37.935490] [FATAL] [MAIN ] PIM: Failed to fetch primary data. [2025-10-01T20:58:37.935556] [WARN ] [MAIN ] PIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:37.935632] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-01T20:58:37.935786] [DEBUG] [LOCAL ] PIM: No primary data file found to delete. [2025-10-01T20:58:37.935867] [INFO ] [LOCAL ] PIM: Starting deletion of derivative data. [2025-10-01T20:58:37.936198] [DEBUG] [LOCAL ] PIM: Deleted derivative data file. [2025-10-01T20:58:37.936300] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PIM took 35.1s. Estimated remaining: 1h 36m 32s. Rate: 7.1 symbols/min [2025-10-01T20:58:38.136103] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:38.160451] [DEBUG] [LOCAL ] PJT: Loaded 21762 existing records from primary storage. [2025-10-01T20:58:38.160759] [INFO ] [MAIN ] PJT: Loaded 21762 existing records. [2025-10-01T20:58:38.361242] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:58:38.361440] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-01T20:58:38.361489] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-01T20:58:38.363340] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-10-01T20:58:38.363404] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-01T20:58:38.507464] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-01T20:58:38.807835] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:39.302379] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-01T20:58:40.102420] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-01T20:58:40.479746] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T20:58:40.867747] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-01T20:58:40.902341] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-01T20:58:40.999482] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T20:58:41.702374] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-01T20:58:42.060297] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T20:58:42.502372] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-01T20:58:43.302382] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-01T20:58:43.494751] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T20:58:43.598917] [DEBUG] [REMOTE ] PINE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:43.599296] [WARN ] [REMOTE ] PINE: No data returned for month 2025-10 [2025-10-01T20:58:43.599404] [FATAL] [REMOTE ] PINE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:43.599531] [FATAL] [MAIN ] PINE: Failed to fetch primary data. [2025-10-01T20:58:43.599609] [WARN ] [MAIN ] PINE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:43.599721] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-01T20:58:43.599800] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-01T20:58:43.599844] [INFO ] [LOCAL ] PINE: Starting deletion of derivative data. [2025-10-01T20:58:43.600218] [DEBUG] [LOCAL ] PINE: Deleted derivative data file. [2025-10-01T20:58:43.600324] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINE took 30.4s. Estimated remaining: 1h 36m 22s. Rate: 7.1 symbols/min [2025-10-01T20:58:43.842209] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-01T20:58:43.845848] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:43.912815] [DEBUG] [LOCAL ] PK: Loaded 52824 existing records from primary storage. [2025-10-01T20:58:43.913181] [INFO ] [MAIN ] PK: Loaded 52824 existing records. [2025-10-01T20:58:44.108319] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-01T20:58:44.113813] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:58:44.115030] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-01T20:58:44.115084] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-01T20:58:44.117201] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-10-01T20:58:44.117267] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-01T20:58:44.518066] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:44.902389] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-01T20:58:45.702364] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-01T20:58:46.230526] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-01T20:58:46.502371] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-01T20:58:46.550159] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T20:58:46.933894] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T20:58:47.302377] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-01T20:58:48.102356] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-01T20:58:48.489851] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T20:58:48.902360] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-01T20:58:48.981101] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T20:58:49.018191] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T20:58:49.702402] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-01T20:58:50.502368] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-01T20:58:50.635265] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-01T20:58:51.035312] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-01T20:58:51.302363] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-01T20:58:51.815467] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T20:58:52.102394] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-01T20:58:52.902372] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-01T20:58:53.108207] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T20:58:53.702383] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-01T20:58:54.023143] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T20:58:54.041211] [DEBUG] [REMOTE ] PIPR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:54.041579] [WARN ] [REMOTE ] PIPR: No data returned for month 2025-10 [2025-10-01T20:58:54.041703] [FATAL] [REMOTE ] PIPR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:54.041803] [FATAL] [MAIN ] PIPR: Failed to fetch primary data. [2025-10-01T20:58:54.041870] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:54.041946] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-01T20:58:54.042016] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-01T20:58:54.042055] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-01T20:58:54.042379] [DEBUG] [LOCAL ] PIPR: Deleted derivative data file. [2025-10-01T20:58:54.042475] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PIPR took 36.8s. Estimated remaining: 1h 36m 15s. Rate: 7.1 symbols/min [2025-10-01T20:58:54.231213] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:54.265285] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-01T20:58:54.288863] [DEBUG] [LOCAL ] PKE: Loaded 12852 existing records from primary storage. [2025-10-01T20:58:54.289165] [INFO ] [MAIN ] PKE: Loaded 12852 existing records. [2025-10-01T20:58:54.495197] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:58:54.495472] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-01T20:58:54.495529] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-01T20:58:54.495982] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-01T20:58:54.496045] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-01T20:58:54.507857] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-01T20:58:54.752355] [DEBUG] [REMOTE ] PINS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:58:54.772404] [WARN ] [REMOTE ] PINS: No data returned for month 2025-10 [2025-10-01T20:58:54.797214] [FATAL] [REMOTE ] PINS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:58:54.799846] [FATAL] [MAIN ] PINS: Failed to fetch primary data. [2025-10-01T20:58:54.810858] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:58:54.816129] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-01T20:58:54.821386] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-01T20:58:54.826601] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-01T20:58:54.846712] [DEBUG] [LOCAL ] PINS: Deleted derivative data file. [2025-10-01T20:58:54.852125] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PINS took 39.3s. Estimated remaining: 1h 36m 3s. Rate: 7.1 symbols/min [2025-10-01T20:58:54.955973] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:55.083301] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:58:55.083468] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-01T20:58:55.083510] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-01T20:58:55.083621] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-01T20:58:55.083696] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-01T20:58:55.083758] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-01T20:58:55.083800] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-01T20:58:55.307479] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-01T20:58:55.478119] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:58:56.102399] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-01T20:58:56.902381] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-01T20:58:57.214968] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T20:58:57.354518] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T20:58:57.702383] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-01T20:58:58.044239] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T20:58:58.502425] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-01T20:58:59.302383] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-01T20:58:59.598866] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T20:58:59.830995] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T20:59:00.102372] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-01T20:59:00.185565] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T20:59:00.902422] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-01T20:59:01.375704] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T20:59:01.702389] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-01T20:59:02.502388] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-01T20:59:02.800194] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T20:59:02.970892] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T20:59:03.302387] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-01T20:59:03.426981] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T20:59:04.102416] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-01T20:59:04.902359] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-01T20:59:04.994022] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T20:59:05.702366] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-01T20:59:05.894575] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T20:59:05.919059] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T20:59:06.502379] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-01T20:59:07.302373] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-01T20:59:07.340932] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T20:59:07.359848] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T20:59:08.102386] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-01T20:59:08.345382] [DEBUG] [REMOTE ] PJT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:59:08.345726] [WARN ] [REMOTE ] PJT: No data returned for month 2025-10 [2025-10-01T20:59:08.345815] [FATAL] [REMOTE ] PJT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:59:08.345943] [FATAL] [MAIN ] PJT: Failed to fetch primary data. [2025-10-01T20:59:08.346014] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:59:08.346086] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-01T20:59:08.346152] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-01T20:59:08.346188] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-01T20:59:08.346482] [DEBUG] [LOCAL ] PJT: Deleted derivative data file. [2025-10-01T20:59:08.346570] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PJT took 30.4s. Estimated remaining: 1h 35m 57s. Rate: 7.1 symbols/min [2025-10-01T20:59:08.537969] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:59:08.559720] [DEBUG] [LOCAL ] PKST: Loaded 18879 existing records from primary storage. [2025-10-01T20:59:08.560056] [INFO ] [MAIN ] PKST: Loaded 18879 existing records. [2025-10-01T20:59:08.758598] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:59:08.758879] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-01T20:59:08.758929] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-01T20:59:08.759917] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-01T20:59:08.760000] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-01T20:59:08.904785] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-01T20:59:09.182347] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:59:09.214168] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T20:59:09.702382] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-01T20:59:09.812277] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T20:59:10.502401] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-01T20:59:11.302385] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-01T20:59:11.452711] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T20:59:11.747376] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T20:59:12.102402] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-01T20:59:12.634087] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T20:59:12.902407] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-01T20:59:13.702338] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-01T20:59:13.787117] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T20:59:13.939052] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T20:59:14.502427] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-01T20:59:15.302356] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-01T20:59:15.541632] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:59:15.580781] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T20:59:16.102386] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-01T20:59:16.197460] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T20:59:16.731041] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T20:59:16.902398] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-01T20:59:17.702372] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-01T20:59:17.769708] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T20:59:17.896173] [DEBUG] [REMOTE ] PK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:59:17.896528] [WARN ] [REMOTE ] PK: No data returned for month 2025-10 [2025-10-01T20:59:17.896615] [FATAL] [REMOTE ] PK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:59:17.896739] [FATAL] [MAIN ] PK: Failed to fetch primary data. [2025-10-01T20:59:17.896808] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:59:17.896886] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-01T20:59:17.896950] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-01T20:59:17.896986] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-01T20:59:17.897384] [DEBUG] [LOCAL ] PK: Deleted derivative data file. [2025-10-01T20:59:17.897479] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PK took 34.3s. Estimated remaining: 1h 35m 49s. Rate: 7.1 symbols/min [2025-10-01T20:59:18.078454] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:59:18.102049] [DEBUG] [LOCAL ] PKX: Loaded 24346 existing records from primary storage. [2025-10-01T20:59:18.102341] [INFO ] [MAIN ] PKX: Loaded 24346 existing records. [2025-10-01T20:59:18.299210] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:59:18.299416] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-01T20:59:18.299465] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-01T20:59:18.300124] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-01T20:59:18.300185] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-01T20:59:18.503778] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-01T20:59:18.706745] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:59:19.302386] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-01T20:59:19.848286] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T20:59:20.102378] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-01T20:59:20.902372] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-01T20:59:20.960402] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T20:59:21.241598] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T20:59:21.702415] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-01T20:59:22.439496] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T20:59:22.502423] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-01T20:59:23.026418] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T20:59:23.302392] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-01T20:59:23.563329] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T20:59:24.102386] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-01T20:59:24.306623] [DEBUG] [REMOTE ] PKE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:59:24.307206] [WARN ] [REMOTE ] PKE: No data returned for month 2025-10 [2025-10-01T20:59:24.307810] [FATAL] [REMOTE ] PKE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:59:24.308028] [FATAL] [MAIN ] PKE: Failed to fetch primary data. [2025-10-01T20:59:24.308109] [WARN ] [MAIN ] PKE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:59:24.308208] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-01T20:59:24.308334] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-01T20:59:24.308403] [INFO ] [LOCAL ] PKE: Starting deletion of derivative data. [2025-10-01T20:59:24.308852] [DEBUG] [LOCAL ] PKE: Deleted derivative data file. [2025-10-01T20:59:24.308966] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKE took 30.3s. Estimated remaining: 1h 35m 39s. Rate: 7.1 symbols/min [2025-10-01T20:59:24.502842] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T20:59:24.530580] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:59:24.586456] [DEBUG] [LOCAL ] PL: Loaded 53131 existing records from primary storage. [2025-10-01T20:59:24.586828] [INFO ] [MAIN ] PL: Loaded 53131 existing records. [2025-10-01T20:59:24.781458] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:59:24.781731] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-01T20:59:24.781788] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-01T20:59:24.783370] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-01T20:59:24.783458] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-01T20:59:24.907521] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-01T20:59:25.172725] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:59:25.702382] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-01T20:59:26.161048] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T20:59:26.502393] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-01T20:59:26.972107] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T20:59:27.302376] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-01T20:59:27.542109] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T20:59:28.102406] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-01T20:59:28.716982] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T20:59:28.902397] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-01T20:59:29.702407] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-01T20:59:29.810956] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T20:59:30.502416] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-01T20:59:30.555939] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T20:59:30.743782] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-01T20:59:31.302384] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-01T20:59:32.063537] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-01T20:59:32.098821] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T20:59:32.107628] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-01T20:59:32.902389] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-01T20:59:33.613266] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T20:59:33.702393] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-01T20:59:34.502394] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-01T20:59:34.894365] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-01T20:59:35.221595] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T20:59:35.302354] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-01T20:59:35.408752] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-01T20:59:36.102378] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-01T20:59:36.359097] [DEBUG] [REMOTE ] PKG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:59:36.359416] [WARN ] [REMOTE ] PKG: No data returned for month 2025-10 [2025-10-01T20:59:36.359529] [FATAL] [REMOTE ] PKG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:59:36.359631] [FATAL] [MAIN ] PKG: Failed to fetch primary data. [2025-10-01T20:59:36.359725] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:59:36.359821] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-01T20:59:36.359926] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-01T20:59:36.359998] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-01T20:59:36.360069] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-01T20:59:36.360121] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKG took 41.5s. Estimated remaining: 1h 35m 32s. Rate: 7.1 symbols/min [2025-10-01T20:59:36.554527] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:59:36.554864] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-01T20:59:36.555044] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-01T20:59:36.555311] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-01T20:59:36.574258] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-01T20:59:36.575115] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-01T20:59:36.576064] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T20:59:36.576177] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-01T20:59:36.907498] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-01T20:59:36.984257] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:59:37.702389] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-01T20:59:38.264941] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T20:59:38.424581] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T20:59:38.502388] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-01T20:59:39.302394] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-01T20:59:39.834223] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T20:59:40.102393] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-01T20:59:40.902382] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-01T20:59:41.244730] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T20:59:41.376929] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T20:59:41.702375] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-01T20:59:42.503739] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-01T20:59:42.505083] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T20:59:43.147755] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-01T20:59:43.302386] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-01T20:59:44.102354] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-01T20:59:44.360597] [DEBUG] [REMOTE ] PKST: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:59:44.364031] [WARN ] [REMOTE ] PKST: No data returned for month 2025-10 [2025-10-01T20:59:44.366091] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T20:59:44.366184] [FATAL] [REMOTE ] PKST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:59:44.377317] [FATAL] [MAIN ] PKST: Failed to fetch primary data. [2025-10-01T20:59:44.378696] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:59:44.378869] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-01T20:59:44.378983] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-01T20:59:44.379059] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-01T20:59:44.379756] [DEBUG] [LOCAL ] PKST: Deleted derivative data file. [2025-10-01T20:59:44.379918] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKST took 36.0s. Estimated remaining: 1h 35m 24s. Rate: 7.1 symbols/min [2025-10-01T20:59:44.607789] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:59:44.665282] [DEBUG] [LOCAL ] PLNT: Loaded 48308 existing records from primary storage. [2025-10-01T20:59:44.665590] [INFO ] [MAIN ] PLNT: Loaded 48308 existing records. [2025-10-01T20:59:44.866507] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:59:44.866749] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-01T20:59:44.866804] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-01T20:59:44.867881] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-10-01T20:59:44.867966] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-01T20:59:44.907536] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-01T20:59:45.277268] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:59:45.492129] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-01T20:59:45.702361] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-01T20:59:46.502371] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-01T20:59:46.812241] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T20:59:46.939761] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T20:59:47.302417] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-01T20:59:48.102409] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-01T20:59:48.416813] [DEBUG] [REMOTE ] PKX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T20:59:48.417165] [WARN ] [REMOTE ] PKX: No data returned for month 2025-10 [2025-10-01T20:59:48.417261] [FATAL] [REMOTE ] PKX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T20:59:48.417356] [FATAL] [MAIN ] PKX: Failed to fetch primary data. [2025-10-01T20:59:48.417427] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T20:59:48.417503] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-01T20:59:48.417579] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-01T20:59:48.417628] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-01T20:59:48.418041] [DEBUG] [LOCAL ] PKX: Deleted derivative data file. [2025-10-01T20:59:48.418134] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 30.5s. Estimated remaining: 1h 35m 13s. Rate: 7.1 symbols/min [2025-10-01T20:59:48.610283] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T20:59:48.641602] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-01T20:59:48.671950] [DEBUG] [LOCAL ] PLOW: Loaded 20380 existing records from primary storage. [2025-10-01T20:59:48.672259] [INFO ] [MAIN ] PLOW: Loaded 20380 existing records. [2025-10-01T20:59:48.869536] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T20:59:48.869899] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-01T20:59:48.870049] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-01T20:59:48.870611] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-10-01T20:59:48.870714] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-01T20:59:48.907590] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-01T20:59:49.261564] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T20:59:49.353634] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T20:59:49.702394] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-01T20:59:50.502365] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-01T20:59:51.012943] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-01T20:59:51.306727] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-01T20:59:51.318044] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T20:59:51.332427] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T20:59:52.102383] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-01T20:59:52.902346] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-01T20:59:53.235733] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T20:59:53.408313] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-01T20:59:53.702388] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-01T20:59:54.502380] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-01T20:59:55.232023] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-01T20:59:55.302346] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-01T20:59:55.535994] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-01T20:59:56.102387] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-01T20:59:56.573113] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T20:59:56.902404] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-01T20:59:57.325416] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T20:59:57.702342] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-01T20:59:57.787881] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-01T20:59:58.502350] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-01T20:59:58.746373] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T20:59:59.302372] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-01T20:59:59.576808] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T21:00:00.102385] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-01T21:00:00.391401] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T21:00:00.473743] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-01T21:00:00.902432] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-01T21:00:01.702446] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-01T21:00:02.403863] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-01T21:00:02.502431] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-01T21:00:02.561352] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T21:00:03.302403] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-01T21:00:04.102429] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-01T21:00:04.352267] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-01T21:00:04.602216] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-01T21:00:04.902430] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-01T21:00:05.244805] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T21:00:05.246373] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T21:00:05.702415] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-01T21:00:06.502359] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-01T21:00:06.776815] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T21:00:07.302402] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-01T21:00:07.500290] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T21:00:07.641452] [DEBUG] [REMOTE ] PLD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:00:07.641797] [WARN ] [REMOTE ] PLD: No data returned for month 2025-10 [2025-10-01T21:00:07.641931] [FATAL] [REMOTE ] PLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:00:07.642043] [FATAL] [MAIN ] PLD: Failed to fetch primary data. [2025-10-01T21:00:07.642112] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:00:07.642187] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-01T21:00:07.642255] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-01T21:00:07.642292] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-01T21:00:07.642357] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-01T21:00:07.642418] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PLD took 31.3s. Estimated remaining: 1h 35m 9s. Rate: 7.1 symbols/min [2025-10-01T21:00:07.838827] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:00:07.877507] [DEBUG] [LOCAL ] PLYM: Loaded 33413 existing records from primary storage. [2025-10-01T21:00:07.877815] [INFO ] [MAIN ] PLYM: Loaded 33413 existing records. [2025-10-01T21:00:08.084254] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:00:08.084492] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-01T21:00:08.084568] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-01T21:00:08.085950] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-01T21:00:08.086048] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-01T21:00:08.109855] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-01T21:00:08.290386] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-01T21:00:08.409143] [DEBUG] [REMOTE ] PL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:00:08.435514] [WARN ] [REMOTE ] PL: No data returned for month 2025-10 [2025-10-01T21:00:08.449069] [FATAL] [REMOTE ] PL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:00:08.465310] [FATAL] [MAIN ] PL: Failed to fetch primary data. [2025-10-01T21:00:08.472262] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:00:08.478148] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-01T21:00:08.516124] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-01T21:00:08.528318] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-01T21:00:08.562043] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:00:08.562518] [DEBUG] [LOCAL ] PL: Deleted derivative data file. [2025-10-01T21:00:08.562810] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PL took 44.3s. Estimated remaining: 1h 34m 58s. Rate: 7.1 symbols/min [2025-10-01T21:00:08.791683] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:00:08.791865] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-01T21:00:08.791909] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-01T21:00:08.792037] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-01T21:00:08.792083] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-01T21:00:08.792185] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-01T21:00:08.792236] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-01T21:00:08.907490] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-01T21:00:09.177388] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:00:09.702370] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-01T21:00:10.090246] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T21:00:10.502416] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-01T21:00:11.302410] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-01T21:00:11.618809] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-01T21:00:11.941434] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T21:00:12.102376] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-01T21:00:12.268778] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T21:00:12.902378] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-01T21:00:13.211698] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T21:00:13.702368] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-01T21:00:14.502444] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-01T21:00:14.965223] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-01T21:00:15.302357] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-01T21:00:15.474588] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T21:00:15.534282] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T21:00:16.102420] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-01T21:00:16.902421] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-01T21:00:17.702421] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-01T21:00:17.854728] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-01T21:00:18.279248] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-01T21:00:18.502359] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-01T21:00:18.589032] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T21:00:18.743087] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T21:00:19.302416] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-01T21:00:20.102384] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-01T21:00:20.755847] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-01T21:00:20.902432] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-01T21:00:21.005413] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:00:21.432480] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T21:00:21.702430] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-01T21:00:22.502378] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-01T21:00:23.028958] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T21:00:23.174135] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-01T21:00:23.302375] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-01T21:00:23.544268] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T21:00:24.102387] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-01T21:00:24.829959] [DEBUG] [REMOTE ] PLOW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:00:24.830442] [WARN ] [REMOTE ] PLOW: No data returned for month 2025-10 [2025-10-01T21:00:24.830567] [FATAL] [REMOTE ] PLOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:00:24.830710] [FATAL] [MAIN ] PLOW: Failed to fetch primary data. [2025-10-01T21:00:24.830800] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:00:24.830905] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-01T21:00:24.831010] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-01T21:00:24.831069] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-01T21:00:24.831513] [DEBUG] [LOCAL ] PLOW: Deleted derivative data file. [2025-10-01T21:00:24.831711] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLOW took 36.4s. Estimated remaining: 1h 34m 52s. Rate: 7.1 symbols/min [2025-10-01T21:00:24.907587] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-01T21:00:25.030961] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T21:00:25.191302] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:00:25.220493] [DEBUG] [LOCAL ] PML: Loaded 21122 existing records from primary storage. [2025-10-01T21:00:25.220867] [INFO ] [MAIN ] PML: Loaded 21122 existing records. [2025-10-01T21:00:25.501573] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:00:25.501933] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-01T21:00:25.502000] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-01T21:00:25.502783] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-01T21:00:25.502875] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-01T21:00:25.707569] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-01T21:00:25.944170] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:00:26.502379] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-01T21:00:26.954130] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T21:00:26.994302] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-01T21:00:27.302413] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-01T21:00:27.343129] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T21:00:28.102385] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-01T21:00:28.686299] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T21:00:28.902389] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-01T21:00:29.702395] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-01T21:00:29.895333] [DEBUG] [REMOTE ] PLNT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:00:29.895677] [WARN ] [REMOTE ] PLNT: No data returned for month 2025-10 [2025-10-01T21:00:29.895778] [FATAL] [REMOTE ] PLNT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:00:29.895871] [FATAL] [MAIN ] PLNT: Failed to fetch primary data. [2025-10-01T21:00:29.895938] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:00:29.896015] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-01T21:00:29.896081] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-01T21:00:29.896119] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-01T21:00:29.896437] [DEBUG] [LOCAL ] PLNT: Deleted derivative data file. [2025-10-01T21:00:29.896538] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLNT took 45.5s. Estimated remaining: 1h 34m 42s. Rate: 7.1 symbols/min [2025-10-01T21:00:30.065728] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T21:00:30.107118] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:00:30.118353] [DEBUG] [LOCAL ] PMM: Loaded 10685 existing records from primary storage. [2025-10-01T21:00:30.118714] [INFO ] [MAIN ] PMM: Loaded 10685 existing records. [2025-10-01T21:00:30.318991] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:00:30.319390] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-01T21:00:30.319466] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-01T21:00:30.337562] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-01T21:00:30.341420] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-01T21:00:30.439854] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-01T21:00:30.507459] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-01T21:00:30.769095] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:00:31.302377] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-01T21:00:32.102382] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-01T21:00:32.240758] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T21:00:32.902365] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-01T21:00:33.107425] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T21:00:33.258138] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T21:00:33.702382] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-01T21:00:34.511886] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-01T21:00:34.517604] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T21:00:34.742784] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T21:00:35.302387] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-01T21:00:35.523495] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T21:00:36.102389] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-01T21:00:36.571407] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T21:00:36.902384] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-01T21:00:37.702355] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-01T21:00:37.917678] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T21:00:37.967530] [DEBUG] [REMOTE ] PLYM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:00:37.968024] [WARN ] [REMOTE ] PLYM: No data returned for month 2025-10 [2025-10-01T21:00:37.968131] [FATAL] [REMOTE ] PLYM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:00:37.968218] [FATAL] [MAIN ] PLYM: Failed to fetch primary data. [2025-10-01T21:00:37.968302] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:00:37.968380] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-01T21:00:37.968461] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-01T21:00:37.968547] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-01T21:00:37.968854] [DEBUG] [LOCAL ] PLYM: Deleted derivative data file. [2025-10-01T21:00:37.968956] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PLYM took 30.3s. Estimated remaining: 1h 34m 34s. Rate: 7.1 symbols/min [2025-10-01T21:00:38.160721] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:00:38.192672] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T21:00:38.211442] [DEBUG] [LOCAL ] PMO: Loaded 10528 existing records from primary storage. [2025-10-01T21:00:38.211694] [INFO ] [MAIN ] PMO: Loaded 10528 existing records. [2025-10-01T21:00:38.397415] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:00:38.397667] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-01T21:00:38.397731] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-01T21:00:38.398148] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-01T21:00:38.398210] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-01T21:00:38.507468] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-01T21:00:38.802693] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:00:39.302378] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-01T21:00:40.102404] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-01T21:00:40.631639] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T21:00:40.681885] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-01T21:00:40.757363] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T21:00:40.902383] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-01T21:00:41.677930] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T21:00:41.702371] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-01T21:00:42.502385] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-01T21:00:42.786169] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T21:00:43.302394] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-01T21:00:43.504923] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T21:00:44.102423] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-01T21:00:44.546898] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T21:00:44.902362] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-01T21:00:44.982152] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T21:00:45.200709] [DEBUG] [REMOTE ] PM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:00:45.201037] [WARN ] [REMOTE ] PM: No data returned for month 2025-10 [2025-10-01T21:00:45.201154] [FATAL] [REMOTE ] PM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:00:45.201234] [FATAL] [MAIN ] PM: Failed to fetch primary data. [2025-10-01T21:00:45.201304] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:00:45.201377] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-01T21:00:45.201457] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-01T21:00:45.201513] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-01T21:00:45.201598] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-01T21:00:45.201694] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PM took 36.6s. Estimated remaining: 1h 34m 25s. Rate: 7.1 symbols/min [2025-10-01T21:00:45.393676] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:00:45.439276] [DEBUG] [LOCAL ] PMT: Loaded 40156 existing records from primary storage. [2025-10-01T21:00:45.439671] [INFO ] [MAIN ] PMT: Loaded 40156 existing records. [2025-10-01T21:00:45.638969] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:00:45.639191] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-01T21:00:45.639246] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-01T21:00:45.640341] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-10-01T21:00:45.640407] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-01T21:00:45.707762] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-01T21:00:46.041206] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:00:46.502346] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-01T21:00:46.674827] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T21:00:47.302408] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-01T21:00:47.775178] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T21:00:48.102406] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-01T21:00:48.553091] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T21:00:48.902388] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-01T21:00:49.640172] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T21:00:49.702415] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-01T21:00:49.972704] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T21:00:50.502391] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-01T21:00:51.082422] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T21:00:51.302389] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-01T21:00:51.470813] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T21:00:52.102382] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-01T21:00:52.724695] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T21:00:52.902403] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-01T21:00:52.967990] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T21:00:53.702388] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-01T21:00:53.978956] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T21:00:54.502396] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-01T21:00:55.302384] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-01T21:00:55.375913] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T21:00:55.489172] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T21:00:56.102395] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-01T21:00:56.132184] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T21:00:56.405426] [DEBUG] [REMOTE ] PML: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:00:56.405910] [WARN ] [REMOTE ] PML: No data returned for month 2025-10 [2025-10-01T21:00:56.406029] [FATAL] [REMOTE ] PML: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:00:56.406152] [FATAL] [MAIN ] PML: Failed to fetch primary data. [2025-10-01T21:00:56.406238] [WARN ] [MAIN ] PML: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:00:56.406326] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-01T21:00:56.406429] [DEBUG] [LOCAL ] PML: No primary data file found to delete. [2025-10-01T21:00:56.406502] [INFO ] [LOCAL ] PML: Starting deletion of derivative data. [2025-10-01T21:00:56.407112] [DEBUG] [LOCAL ] PML: Deleted derivative data file. [2025-10-01T21:00:56.407223] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PML took 31.6s. Estimated remaining: 1h 34m 17s. Rate: 7.1 symbols/min [2025-10-01T21:00:56.614245] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:00:56.614868] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-01T21:00:56.614928] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-01T21:00:56.615087] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-01T21:00:56.615145] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-01T21:00:56.615198] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-01T21:00:56.615236] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-01T21:00:56.907503] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-01T21:00:57.009965] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:00:57.702399] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-01T21:00:57.779307] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T21:00:58.502401] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-01T21:00:58.966088] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-01T21:00:59.155064] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T21:00:59.302394] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-01T21:00:59.733269] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-01T21:01:00.102427] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-01T21:01:00.814774] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-01T21:01:00.902431] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-01T21:01:01.702355] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-01T21:01:01.936404] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T21:01:02.502369] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-01T21:01:02.625306] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T21:01:03.302388] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-01T21:01:03.354464] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T21:01:04.102384] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-01T21:01:04.219205] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T21:01:04.902391] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-01T21:01:05.702432] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-01T21:01:05.786845] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T21:01:05.833268] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-01T21:01:06.502394] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-01T21:01:06.566264] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T21:01:06.704028] [DEBUG] [REMOTE ] PMM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:06.704348] [WARN ] [REMOTE ] PMM: No data returned for month 2025-10 [2025-10-01T21:01:06.704442] [FATAL] [REMOTE ] PMM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:06.704552] [FATAL] [MAIN ] PMM: Failed to fetch primary data. [2025-10-01T21:01:06.704625] [WARN ] [MAIN ] PMM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:06.704725] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-01T21:01:06.704846] [DEBUG] [LOCAL ] PMM: No primary data file found to delete. [2025-10-01T21:01:06.704907] [INFO ] [LOCAL ] PMM: Starting deletion of derivative data. [2025-10-01T21:01:06.705505] [DEBUG] [LOCAL ] PMM: Deleted derivative data file. [2025-10-01T21:01:06.705607] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMM took 36.8s. Estimated remaining: 1h 34m 10s. Rate: 7.1 symbols/min [2025-10-01T21:01:06.895338] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:06.895537] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-01T21:01:06.895581] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-01T21:01:06.895727] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-01T21:01:06.895774] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-01T21:01:06.895817] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-01T21:01:06.895849] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-01T21:01:07.313114] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-01T21:01:07.320217] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:07.582483] [DEBUG] [REMOTE ] PMO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:07.582875] [WARN ] [REMOTE ] PMO: No data returned for month 2025-10 [2025-10-01T21:01:07.582974] [FATAL] [REMOTE ] PMO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:07.583063] [FATAL] [MAIN ] PMO: Failed to fetch primary data. [2025-10-01T21:01:07.583105] [WARN ] [MAIN ] PMO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:07.583147] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-01T21:01:07.583214] [DEBUG] [LOCAL ] PMO: No primary data file found to delete. [2025-10-01T21:01:07.583262] [INFO ] [LOCAL ] PMO: Starting deletion of derivative data. [2025-10-01T21:01:07.583591] [DEBUG] [LOCAL ] PMO: Deleted derivative data file. [2025-10-01T21:01:07.583747] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMO took 29.6s. Estimated remaining: 1h 33m 58s. Rate: 7.1 symbols/min [2025-10-01T21:01:07.815605] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:07.815852] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-01T21:01:07.815935] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-01T21:01:07.816101] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-01T21:01:07.816166] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-01T21:01:07.816249] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-01T21:01:07.816338] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-01T21:01:08.107517] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-01T21:01:08.213086] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:08.589925] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T21:01:08.902427] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-01T21:01:09.431696] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-01T21:01:09.702394] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-01T21:01:09.967804] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:09.968172] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-01T21:01:09.968298] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:09.968386] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-01T21:01:09.968454] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:09.968528] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-01T21:01:09.968597] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-01T21:01:09.968635] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-01T21:01:09.968730] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-01T21:01:09.968852] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTV took 3.3s. Estimated remaining: 1h 33m 47s. Rate: 7.1 symbols/min [2025-10-01T21:01:10.160455] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:10.160675] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-01T21:01:10.160760] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-01T21:01:10.160878] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-01T21:01:10.160920] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-01T21:01:10.160962] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-01T21:01:10.160995] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-01T21:01:10.514153] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-01T21:01:10.560116] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:11.302436] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-01T21:01:12.102401] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-01T21:01:12.137151] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:01:12.387275] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:12.387678] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-01T21:01:12.387769] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:12.387823] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-01T21:01:12.387885] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:12.388003] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-01T21:01:12.388139] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-01T21:01:12.388201] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-01T21:01:12.388248] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-01T21:01:12.388356] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMTW took 4.8s. Estimated remaining: 1h 33m 36s. Rate: 7.1 symbols/min [2025-10-01T21:01:12.583735] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:12.593072] [DEBUG] [LOCAL ] PNI: Loaded 6775 existing records from primary storage. [2025-10-01T21:01:12.593351] [INFO ] [MAIN ] PNI: Loaded 6775 existing records. [2025-10-01T21:01:12.792744] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:01:12.792972] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-01T21:01:12.793021] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-01T21:01:12.793425] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-01T21:01:12.793486] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-01T21:01:12.907929] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-01T21:01:13.199497] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:13.334638] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-01T21:01:13.702421] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-01T21:01:14.155292] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T21:01:14.502392] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-01T21:01:14.664552] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T21:01:14.933266] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T21:01:15.302400] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-01T21:01:16.102439] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-01T21:01:16.541126] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-01T21:01:16.902446] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-01T21:01:16.978491] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T21:01:17.321883] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-01T21:01:17.702426] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-01T21:01:18.057117] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-01T21:01:18.502398] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-01T21:01:18.773237] [DEBUG] [REMOTE ] PMTU: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:18.773558] [WARN ] [REMOTE ] PMTU: No data returned for month 2025-10 [2025-10-01T21:01:18.773714] [FATAL] [REMOTE ] PMTU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:18.773839] [FATAL] [MAIN ] PMTU: Failed to fetch primary data. [2025-10-01T21:01:18.773907] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:18.774005] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-01T21:01:18.774110] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-01T21:01:18.774167] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-01T21:01:18.774294] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-01T21:01:18.774416] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMTU took 22.4s. Estimated remaining: 1h 33m 27s. Rate: 7.1 symbols/min [2025-10-01T21:01:18.974582] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:19.021307] [DEBUG] [LOCAL ] PNNT: Loaded 32785 existing records from primary storage. [2025-10-01T21:01:19.021671] [INFO ] [MAIN ] PNNT: Loaded 32785 existing records. [2025-10-01T21:01:19.219223] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:01:19.219468] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-01T21:01:19.219519] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-01T21:01:19.221856] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-01T21:01:19.221929] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-01T21:01:19.307542] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-01T21:01:19.664165] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:20.102389] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-01T21:01:20.902439] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-01T21:01:20.928869] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T21:01:21.196958] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T21:01:21.702415] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-01T21:01:22.427225] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-01T21:01:22.502375] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-01T21:01:22.553147] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T21:01:23.302388] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-01T21:01:23.540945] [DEBUG] [REMOTE ] PMT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:23.541304] [WARN ] [REMOTE ] PMT: No data returned for month 2025-10 [2025-10-01T21:01:23.541401] [FATAL] [REMOTE ] PMT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:23.541488] [FATAL] [MAIN ] PMT: Failed to fetch primary data. [2025-10-01T21:01:23.541529] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:23.541597] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-01T21:01:23.541748] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-01T21:01:23.541826] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-01T21:01:23.542442] [DEBUG] [LOCAL ] PMT: Deleted derivative data file. [2025-10-01T21:01:23.542589] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PMT took 38.3s. Estimated remaining: 1h 33m 17s. Rate: 7.1 symbols/min [2025-10-01T21:01:23.743171] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:23.743509] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-01T21:01:23.743569] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-01T21:01:23.743711] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-01T21:01:23.743767] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-01T21:01:23.743812] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-01T21:01:23.743898] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-01T21:01:24.102591] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-01T21:01:24.186959] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:24.204635] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:01:24.902435] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-01T21:01:25.103841] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T21:01:25.702408] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-01T21:01:26.308227] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T21:01:26.502416] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-01T21:01:26.786441] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T21:01:27.302402] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-01T21:01:28.102422] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-01T21:01:28.254200] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T21:01:28.700850] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T21:01:28.845448] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T21:01:28.902410] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-01T21:01:29.584787] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T21:01:29.702392] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-01T21:01:30.502404] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-01T21:01:31.098178] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T21:01:31.302391] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-01T21:01:31.966027] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T21:01:32.102386] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-01T21:01:32.259158] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T21:01:32.902377] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-01T21:01:33.637622] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T21:01:33.702386] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-01T21:01:34.502384] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-01T21:01:34.918605] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T21:01:35.179460] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T21:01:35.302347] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-01T21:01:35.414058] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T21:01:36.102390] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-01T21:01:36.902474] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-01T21:01:37.348968] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T21:01:37.702403] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-01T21:01:37.905959] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T21:01:38.502433] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-01T21:01:38.583299] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T21:01:39.302419] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-01T21:01:39.346426] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-01T21:01:39.603684] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T21:01:40.102396] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-01T21:01:40.902413] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-01T21:01:40.947248] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T21:01:41.141918] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T21:01:41.702424] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-01T21:01:42.502389] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-01T21:01:42.763918] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T21:01:43.163535] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T21:01:43.302440] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-01T21:01:43.605045] [DEBUG] [REMOTE ] PNI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:43.605365] [WARN ] [REMOTE ] PNI: No data returned for month 2025-10 [2025-10-01T21:01:43.605454] [FATAL] [REMOTE ] PNI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:43.605544] [FATAL] [MAIN ] PNI: Failed to fetch primary data. [2025-10-01T21:01:43.605583] [WARN ] [MAIN ] PNI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:43.605675] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-01T21:01:43.605754] [DEBUG] [LOCAL ] PNI: No primary data file found to delete. [2025-10-01T21:01:43.605792] [INFO ] [LOCAL ] PNI: Starting deletion of derivative data. [2025-10-01T21:01:43.606149] [DEBUG] [LOCAL ] PNI: Deleted derivative data file. [2025-10-01T21:01:43.606242] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNI took 31.2s. Estimated remaining: 1h 33m 13s. Rate: 7.1 symbols/min [2025-10-01T21:01:43.819383] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:43.819605] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-01T21:01:43.819687] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-01T21:01:43.819804] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-01T21:01:43.819848] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-01T21:01:43.819891] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-01T21:01:43.819924] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-01T21:01:44.102533] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-01T21:01:44.243828] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:44.277140] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T21:01:44.902375] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-01T21:01:45.702429] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-01T21:01:45.990456] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T21:01:46.502378] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-01T21:01:46.505837] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T21:01:47.302351] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-01T21:01:47.400071] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T21:01:48.102363] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-01T21:01:48.175228] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T21:01:48.902362] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-01T21:01:48.982423] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T21:01:49.702364] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-01T21:01:49.983685] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T21:01:50.502438] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-01T21:01:50.680859] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T21:01:51.302423] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-01T21:01:51.421278] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:01:51.627032] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T21:01:52.102440] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-01T21:01:52.902385] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-01T21:01:53.113022] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T21:01:53.351069] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T21:01:53.702455] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-01T21:01:54.382479] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T21:01:54.502418] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-01T21:01:55.302410] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-01T21:01:55.540406] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:01:55.949590] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T21:01:56.102583] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-01T21:01:56.336625] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T21:01:56.902389] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-01T21:01:57.165674] [DEBUG] [REMOTE ] PNNT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:57.166111] [WARN ] [REMOTE ] PNNT: No data returned for month 2025-10 [2025-10-01T21:01:57.166724] [FATAL] [REMOTE ] PNNT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:57.166913] [FATAL] [MAIN ] PNNT: Failed to fetch primary data. [2025-10-01T21:01:57.166983] [WARN ] [MAIN ] PNNT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:57.167063] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-01T21:01:57.167147] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-01T21:01:57.167209] [INFO ] [LOCAL ] PNNT: Starting deletion of derivative data. [2025-10-01T21:01:57.167602] [DEBUG] [LOCAL ] PNNT: Deleted derivative data file. [2025-10-01T21:01:57.167744] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 38.4s. Estimated remaining: 1h 33m 7s. Rate: 7.1 symbols/min [2025-10-01T21:01:57.364597] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:57.417555] [DEBUG] [LOCAL ] POR: Loaded 47013 existing records from primary storage. [2025-10-01T21:01:57.418060] [INFO ] [MAIN ] POR: Loaded 47013 existing records. [2025-10-01T21:01:57.622312] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:01:57.622633] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-01T21:01:57.622765] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-01T21:01:57.624050] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-10-01T21:01:57.624112] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-01T21:01:57.705980] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-01T21:01:57.985265] [DEBUG] [REMOTE ] PNR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:01:58.027397] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:58.020424] [WARN ] [REMOTE ] PNR: No data returned for month 2025-10 [2025-10-01T21:01:58.027796] [FATAL] [REMOTE ] PNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:01:58.028224] [FATAL] [MAIN ] PNR: Failed to fetch primary data. [2025-10-01T21:01:58.028301] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:01:58.028378] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-01T21:01:58.028452] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-01T21:01:58.028490] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-01T21:01:58.028530] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-01T21:01:58.028583] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNR took 34.5s. Estimated remaining: 1h 32m 55s. Rate: 7.1 symbols/min [2025-10-01T21:01:58.244183] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-01T21:01:58.242339] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:01:58.293081] [DEBUG] [LOCAL ] POST: Loaded 38818 existing records from primary storage. [2025-10-01T21:01:58.293372] [INFO ] [MAIN ] POST: Loaded 38818 existing records. [2025-10-01T21:01:58.485928] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:01:58.486194] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-01T21:01:58.486254] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-01T21:01:58.487196] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-10-01T21:01:58.487258] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-01T21:01:58.510575] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-01T21:01:58.916097] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:01:59.302403] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-01T21:02:00.102420] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-01T21:02:00.229637] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T21:02:00.508688] [DEBUG] [REMOTE ] PNC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:02:00.509056] [WARN ] [REMOTE ] PNC: No data returned for month 2025-10 [2025-10-01T21:02:00.509150] [FATAL] [REMOTE ] PNC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:02:00.509235] [FATAL] [MAIN ] PNC: Failed to fetch primary data. [2025-10-01T21:02:00.509273] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:02:00.509350] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-01T21:02:00.509487] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-01T21:02:00.509580] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-01T21:02:00.509673] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-01T21:02:00.509746] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNC took 50.5s. Estimated remaining: 1h 32m 45s. Rate: 7.1 symbols/min [2025-10-01T21:02:00.700593] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:02:00.700883] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-01T21:02:00.701118] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-01T21:02:00.701327] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-01T21:02:00.701530] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-01T21:02:00.701618] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-01T21:02:00.701780] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-01T21:02:00.925907] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-01T21:02:01.020496] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T21:02:01.172675] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:02:01.702427] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-01T21:02:02.502367] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-01T21:02:02.551481] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T21:02:03.302481] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-01T21:02:03.629915] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-01T21:02:04.102388] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-01T21:02:04.163273] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T21:02:04.659985] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T21:02:04.902392] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-01T21:02:05.702354] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-01T21:02:05.825235] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T21:02:06.503480] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-01T21:02:06.506906] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T21:02:07.210783] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T21:02:07.302402] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-01T21:02:08.102375] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-01T21:02:08.376246] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-01T21:02:08.810900] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T21:02:08.902396] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-01T21:02:09.415882] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T21:02:09.702460] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-01T21:02:10.493320] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T21:02:10.503217] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-01T21:02:11.302509] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-01T21:02:11.307987] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T21:02:12.095113] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T21:02:12.103145] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-01T21:02:12.902373] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-01T21:02:13.204885] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T21:02:13.540521] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T21:02:13.702392] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-01T21:02:14.176999] [DEBUG] [REMOTE ] PNW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:02:14.177362] [WARN ] [REMOTE ] PNW: No data returned for month 2025-10 [2025-10-01T21:02:14.177479] [FATAL] [REMOTE ] PNW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:02:14.177600] [FATAL] [MAIN ] PNW: Failed to fetch primary data. [2025-10-01T21:02:14.177718] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:02:14.177809] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-01T21:02:14.177892] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-01T21:02:14.177989] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-01T21:02:14.178081] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-01T21:02:14.178164] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. PNW took 30.6s. Estimated remaining: 1h 32m 38s. Rate: 7.1 symbols/min [2025-10-01T21:02:14.385611] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:02:14.385983] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-01T21:02:14.386044] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-01T21:02:14.386176] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-01T21:02:14.386247] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-01T21:02:14.386350] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-01T21:02:14.386422] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-01T21:02:14.507462] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-01T21:02:14.802982] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:02:14.826597] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T21:02:15.302389] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-01T21:02:16.102433] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-01T21:02:16.428553] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T21:02:16.902416] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-01T21:02:17.194091] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T21:02:17.707726] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-01T21:02:17.726515] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T21:02:18.214981] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T21:02:18.502389] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-01T21:02:19.302360] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-01T21:02:19.690111] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T21:02:20.102370] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-01T21:02:20.229539] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T21:02:20.566552] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T21:02:20.902380] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-01T21:02:21.531096] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T21:02:21.702407] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-01T21:02:22.448463] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T21:02:22.502405] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-01T21:02:23.302371] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-01T21:02:23.407483] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T21:02:24.102379] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-01T21:02:24.330285] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T21:02:24.707526] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T21:02:24.902430] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-01T21:02:25.702390] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-01T21:02:25.778554] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T21:02:26.502382] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-01T21:02:26.722870] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T21:02:27.302382] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-01T21:02:27.735028] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T21:02:28.102367] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-01T21:02:28.283619] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T21:02:28.902399] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-01T21:02:29.038635] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T21:02:29.193542] [DEBUG] [REMOTE ] POR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:02:29.193929] [WARN ] [REMOTE ] POR: No data returned for month 2025-10 [2025-10-01T21:02:29.194022] [FATAL] [REMOTE ] POR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:02:29.194111] [FATAL] [MAIN ] POR: Failed to fetch primary data. [2025-10-01T21:02:29.194177] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:02:29.194253] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-01T21:02:29.194320] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-01T21:02:29.194358] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-01T21:02:29.194899] [DEBUG] [LOCAL ] POR: Deleted derivative data file. [2025-10-01T21:02:29.195005] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POR took 32.0s. Estimated remaining: 1h 32m 32s. Rate: 7.1 symbols/min [2025-10-01T21:02:29.401322] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:02:29.421336] [DEBUG] [LOCAL ] PPT: Loaded 20144 existing records from primary storage. [2025-10-01T21:02:29.421569] [INFO ] [MAIN ] PPT: Loaded 20144 existing records. [2025-10-01T21:02:29.608293] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:02:29.608507] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-01T21:02:29.608554] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-01T21:02:29.609187] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-01T21:02:29.609250] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-01T21:02:29.707750] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-01T21:02:30.020738] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:02:30.206803] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T21:02:30.502371] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-01T21:02:31.302372] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-01T21:02:31.418416] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T21:02:31.994858] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T21:02:32.102435] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-01T21:02:32.821457] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T21:02:32.902402] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-01T21:02:33.187680] [DEBUG] [REMOTE ] POST: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:02:33.188034] [WARN ] [REMOTE ] POST: No data returned for month 2025-10 [2025-10-01T21:02:33.188137] [FATAL] [REMOTE ] POST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:02:33.188226] [FATAL] [MAIN ] POST: Failed to fetch primary data. [2025-10-01T21:02:33.188293] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:02:33.188369] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-01T21:02:33.188436] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-01T21:02:33.188476] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-01T21:02:33.188808] [DEBUG] [LOCAL ] POST: Deleted derivative data file. [2025-10-01T21:02:33.188901] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. POST took 35.2s. Estimated remaining: 1h 32m 22s. Rate: 7.1 symbols/min [2025-10-01T21:02:33.702358] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-01T21:02:34.017205] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T21:02:34.502401] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-01T21:02:35.304395] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-01T21:02:35.311402] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:02:35.387138] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T21:02:36.102430] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-01T21:02:36.912387] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-01T21:02:36.913806] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T21:02:37.168346] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T21:02:37.180584] [DEBUG] [REMOTE ] PPG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:02:37.181494] [WARN ] [REMOTE ] PPG: No data returned for month 2025-10 [2025-10-01T21:02:37.181682] [FATAL] [REMOTE ] PPG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:02:37.182247] [FATAL] [MAIN ] PPG: Failed to fetch primary data. [2025-10-01T21:02:37.182328] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:02:37.182410] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-01T21:02:37.182490] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-01T21:02:37.182886] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-01T21:02:37.183152] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-01T21:02:37.183246] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPG took 36.7s. Estimated remaining: 1h 32m 12s. Rate: 7.1 symbols/min [2025-10-01T21:02:37.702388] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-01T21:02:38.502377] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-01T21:02:39.042266] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T21:02:39.302513] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-01T21:02:40.190818] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T21:02:40.202236] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-01T21:02:40.469553] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T21:02:40.902399] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-01T21:02:41.996134] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T21:02:42.001356] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-01T21:02:42.230631] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-01T21:02:42.502409] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-01T21:02:43.118487] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T21:02:43.302384] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-01T21:02:44.038479] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T21:02:44.102469] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-01T21:02:44.684940] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-01T21:02:44.902434] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-01T21:02:45.941230] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T21:02:45.945517] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-01T21:02:46.226829] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-01T21:02:46.502381] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-01T21:02:46.758058] [DEBUG] [REMOTE ] PPL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:02:46.758399] [WARN ] [REMOTE ] PPL: No data returned for month 2025-10 [2025-10-01T21:02:46.758487] [FATAL] [REMOTE ] PPL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:02:46.758573] [FATAL] [MAIN ] PPL: Failed to fetch primary data. [2025-10-01T21:02:46.758636] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:02:46.758733] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-01T21:02:46.758798] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-01T21:02:46.758834] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-01T21:02:46.758873] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-01T21:02:46.758918] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPL took 32.6s. Estimated remaining: 1h 32m 4s. Rate: 7.1 symbols/min [2025-10-01T21:02:47.214171] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T21:02:47.302453] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-01T21:02:47.569707] [DEBUG] [REMOTE ] PPT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:02:47.570057] [WARN ] [REMOTE ] PPT: No data returned for month 2025-10 [2025-10-01T21:02:47.570148] [FATAL] [REMOTE ] PPT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:02:47.570257] [FATAL] [MAIN ] PPT: Failed to fetch primary data. [2025-10-01T21:02:47.570340] [WARN ] [MAIN ] PPT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:02:47.570433] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-01T21:02:47.570527] [DEBUG] [LOCAL ] PPT: No primary data file found to delete. [2025-10-01T21:02:47.570605] [INFO ] [LOCAL ] PPT: Starting deletion of derivative data. [2025-10-01T21:02:47.570960] [DEBUG] [LOCAL ] PPT: Deleted derivative data file. [2025-10-01T21:02:47.571052] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PPT took 18.4s. Estimated remaining: 1h 31m 52s. Rate: 7.1 symbols/min [2025-10-01T21:02:48.367414] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:02:48.440012] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:02:48.435442] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:02:48.442204] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-10-01T21:02:48.441615] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:02:48.442989] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-10-01T21:02:48.443811] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-01T21:02:48.445028] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-01T21:02:48.445429] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-10-01T21:02:48.445489] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-01T21:02:48.722778] [DEBUG] [LOCAL ] PRG: Loaded 29789 existing records from primary storage. [2025-10-01T21:02:48.766901] [DEBUG] [LOCAL ] PRA: Loaded 34973 existing records from primary storage. [2025-10-01T21:02:48.749925] [INFO ] [MAIN ] PRG: Loaded 29789 existing records. [2025-10-01T21:02:48.800295] [INFO ] [MAIN ] PRA: Loaded 34973 existing records. [2025-10-01T21:02:49.058270] [DEBUG] [LOCAL ] PR: Loaded 53610 existing records from primary storage. [2025-10-01T21:02:49.198795] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:02:49.241107] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-01T21:02:49.230082] [INFO ] [MAIN ] PR: Loaded 53610 existing records. [2025-10-01T21:02:49.397277] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:02:49.428914] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:02:49.465885] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-01T21:02:49.471147] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-01T21:02:49.487458] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-10-01T21:02:49.513446] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-01T21:02:49.513325] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-01T21:02:49.567157] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-01T21:02:49.683542] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:02:49.683704] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-10-01T21:02:49.713020] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-01T21:02:49.713283] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-01T21:02:49.718507] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-01T21:02:49.723955] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-10-01T21:02:49.771794] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-01T21:02:50.085309] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T21:02:50.160924] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-01T21:02:50.783942] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-01T21:02:50.811278] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:02:50.828343] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-01T21:02:50.881827] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-01T21:02:50.947793] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:02:51.009052] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:02:51.302407] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-01T21:02:51.354487] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T21:02:52.102411] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-01T21:02:52.240087] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T21:02:52.406046] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-01T21:02:52.902424] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-01T21:02:53.426043] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-01T21:02:53.702419] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-01T21:02:53.951158] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T21:02:54.361391] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-01T21:02:54.502417] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-01T21:02:55.106087] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T21:02:55.302453] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-01T21:02:55.731768] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T21:02:56.102432] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-01T21:02:56.645310] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-01T21:02:56.902425] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-01T21:02:57.702513] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-01T21:02:58.030081] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T21:02:58.502400] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-01T21:02:59.302401] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-01T21:02:59.742010] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-01T21:02:59.851872] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T21:02:59.982486] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T21:03:00.102375] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-01T21:03:00.559305] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T21:03:00.902431] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-01T21:03:01.223486] [DEBUG] [REMOTE ] PRCS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:03:01.223886] [WARN ] [REMOTE ] PRCS: No data returned for month 2025-10 [2025-10-01T21:03:01.224024] [FATAL] [REMOTE ] PRCS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:03:01.224123] [FATAL] [MAIN ] PRCS: Failed to fetch primary data. [2025-10-01T21:03:01.224188] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:03:01.224263] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-01T21:03:01.224336] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-10-01T21:03:01.224375] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-10-01T21:03:01.224415] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-10-01T21:03:01.224492] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 13.6s. Estimated remaining: 1h 31m 46s. Rate: 7.1 symbols/min [2025-10-01T21:03:01.444672] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:03:01.503341] [DEBUG] [LOCAL ] PRGO: Loaded 46912 existing records from primary storage. [2025-10-01T21:03:01.503716] [INFO ] [MAIN ] PRGO: Loaded 46912 existing records. [2025-10-01T21:03:01.729971] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-01T21:03:01.736408] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:03:01.737526] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-01T21:03:01.737602] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-01T21:03:01.739892] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-10-01T21:03:01.739958] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-01T21:03:02.144219] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:03:02.502394] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-01T21:03:02.942408] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T21:03:03.302414] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-01T21:03:03.876680] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T21:03:04.102427] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-01T21:03:04.726797] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T21:03:04.902383] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-01T21:03:05.615147] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T21:03:05.702362] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-01T21:03:06.493451] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T21:03:06.504149] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-01T21:03:07.302385] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-01T21:03:07.477821] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T21:03:08.026730] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T21:03:08.102350] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-01T21:03:08.902398] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-01T21:03:08.942511] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T21:03:09.674862] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T21:03:09.702361] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-01T21:03:10.153515] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T21:03:10.502414] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-01T21:03:11.302359] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-01T21:03:11.491794] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T21:03:11.957088] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T21:03:12.102428] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-01T21:03:12.902358] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-01T21:03:13.111023] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T21:03:13.173046] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T21:03:13.702383] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-01T21:03:14.502377] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-01T21:03:14.551476] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T21:03:15.076284] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T21:03:15.302459] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-01T21:03:16.102377] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-01T21:03:16.527456] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T21:03:16.902468] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-01T21:03:17.135587] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T21:03:17.588206] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T21:03:17.702386] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-01T21:03:18.502385] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-01T21:03:18.645455] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T21:03:18.879806] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T21:03:19.302498] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-01T21:03:19.796188] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T21:03:20.102382] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-01T21:03:20.368080] [DEBUG] [REMOTE ] PRA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:03:20.368425] [WARN ] [REMOTE ] PRA: No data returned for month 2025-10 [2025-10-01T21:03:20.368519] [FATAL] [REMOTE ] PRA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:03:20.368612] [FATAL] [MAIN ] PRA: Failed to fetch primary data. [2025-10-01T21:03:20.368701] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:03:20.368781] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-01T21:03:20.368849] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-01T21:03:20.368887] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-01T21:03:20.369387] [DEBUG] [LOCAL ] PRA: Deleted derivative data file. [2025-10-01T21:03:20.369500] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRA took 32.8s. Estimated remaining: 1h 31m 41s. Rate: 7.1 symbols/min [2025-10-01T21:03:20.569494] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:03:20.577314] [DEBUG] [LOCAL ] PRH: Loaded 4774 existing records from primary storage. [2025-10-01T21:03:20.577552] [INFO ] [MAIN ] PRH: Loaded 4774 existing records. [2025-10-01T21:03:20.792855] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:03:20.793251] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-01T21:03:20.793412] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-01T21:03:20.793770] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-01T21:03:20.802869] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-01T21:03:20.894154] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T21:03:20.907506] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-01T21:03:21.243019] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:03:21.702396] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-01T21:03:21.934572] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T21:03:22.502385] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-01T21:03:23.302388] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-01T21:03:23.669850] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-01T21:03:24.102384] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-01T21:03:24.181722] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T21:03:24.797133] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T21:03:24.902405] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-01T21:03:25.702386] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-01T21:03:26.190372] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-01T21:03:26.223352] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T21:03:26.355845] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-01T21:03:26.502374] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-01T21:03:26.989836] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T21:03:27.302402] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-01T21:03:28.102405] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-01T21:03:28.902383] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-01T21:03:29.096428] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T21:03:29.702406] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-01T21:03:30.068043] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-01T21:03:30.143086] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T21:03:30.502393] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-01T21:03:30.670404] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T21:03:31.302422] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-01T21:03:31.535026] [DEBUG] [REMOTE ] PRG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:03:31.535415] [WARN ] [REMOTE ] PRG: No data returned for month 2025-10 [2025-10-01T21:03:31.535505] [FATAL] [REMOTE ] PRG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:03:31.535593] [FATAL] [MAIN ] PRG: Failed to fetch primary data. [2025-10-01T21:03:31.535728] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:03:31.535804] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-01T21:03:31.535869] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-01T21:03:31.535906] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-01T21:03:31.536205] [DEBUG] [LOCAL ] PRG: Deleted derivative data file. [2025-10-01T21:03:31.536319] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRG took 43.9s. Estimated remaining: 1h 31m 34s. Rate: 7.1 symbols/min [2025-10-01T21:03:31.738401] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:03:31.758698] [DEBUG] [LOCAL ] PRI: Loaded 18278 existing records from primary storage. [2025-10-01T21:03:31.758951] [INFO ] [MAIN ] PRI: Loaded 18278 existing records. [2025-10-01T21:03:31.963825] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:03:31.964074] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-01T21:03:31.964123] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-01T21:03:31.965148] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-10-01T21:03:31.965209] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-01T21:03:32.107607] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-01T21:03:32.373462] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:03:32.407415] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-01T21:03:32.902364] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-01T21:03:33.702384] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-01T21:03:33.955817] [DEBUG] [REMOTE ] PR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:03:33.956139] [WARN ] [REMOTE ] PR: No data returned for month 2025-10 [2025-10-01T21:03:33.956235] [FATAL] [REMOTE ] PR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:03:33.956322] [FATAL] [MAIN ] PR: Failed to fetch primary data. [2025-10-01T21:03:33.956390] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:03:33.956466] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-01T21:03:33.956534] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-01T21:03:33.956573] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-01T21:03:33.957088] [DEBUG] [LOCAL ] PR: Deleted derivative data file. [2025-10-01T21:03:33.957320] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PR took 46.4s. Estimated remaining: 1h 31m 23s. Rate: 7.1 symbols/min [2025-10-01T21:03:34.113522] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-01T21:03:34.111735] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T21:03:34.226542] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:03:34.279443] [DEBUG] [LOCAL ] PRIM: Loaded 44341 existing records from primary storage. [2025-10-01T21:03:34.279903] [INFO ] [MAIN ] PRIM: Loaded 44341 existing records. [2025-10-01T21:03:34.498357] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:03:34.498589] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-01T21:03:34.498719] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-01T21:03:34.501453] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-01T21:03:34.501518] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-01T21:03:34.507568] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-01T21:03:34.934356] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:03:35.302429] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-01T21:03:35.574331] [DEBUG] [REMOTE ] PRGO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:03:35.574718] [WARN ] [REMOTE ] PRGO: No data returned for month 2025-10 [2025-10-01T21:03:35.574839] [FATAL] [REMOTE ] PRGO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:03:35.574926] [FATAL] [MAIN ] PRGO: Failed to fetch primary data. [2025-10-01T21:03:35.575024] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:03:35.575110] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-01T21:03:35.575434] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-01T21:03:35.575550] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-01T21:03:35.576054] [DEBUG] [LOCAL ] PRGO: Deleted derivative data file. [2025-10-01T21:03:35.576157] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRGO took 34.4s. Estimated remaining: 1h 31m 12s. Rate: 7.1 symbols/min [2025-10-01T21:03:35.761134] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T21:03:35.801032] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:03:35.840765] [DEBUG] [LOCAL ] PRKS: Loaded 42482 existing records from primary storage. [2025-10-01T21:03:35.841059] [INFO ] [MAIN ] PRKS: Loaded 42482 existing records. [2025-10-01T21:03:36.039255] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:03:36.039473] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-01T21:03:36.039522] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-01T21:03:36.041547] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-01T21:03:36.041611] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-01T21:03:36.108359] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-01T21:03:36.441757] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:03:36.876215] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T21:03:36.902353] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-01T21:03:37.702422] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-01T21:03:37.710405] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T21:03:38.502380] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-01T21:03:39.302364] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-01T21:03:39.382174] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T21:03:39.540500] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T21:03:40.102392] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-01T21:03:40.859632] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T21:03:40.902413] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-01T21:03:41.370957] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T21:03:41.527416] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-01T21:03:41.702404] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-01T21:03:42.384260] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T21:03:42.502395] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-01T21:03:43.302413] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-01T21:03:43.769132] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T21:03:43.937636] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-01T21:03:44.102404] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-01T21:03:44.902413] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-01T21:03:45.702384] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-01T21:03:45.916335] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T21:03:46.504128] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-01T21:03:46.509910] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T21:03:46.565802] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T21:03:47.174901] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T21:03:47.302390] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-01T21:03:48.102382] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-01T21:03:48.685340] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-01T21:03:48.902346] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-01T21:03:49.167316] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T21:03:49.702378] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-01T21:03:49.953098] [DEBUG] [REMOTE ] PRH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:03:49.953407] [WARN ] [REMOTE ] PRH: No data returned for month 2025-10 [2025-10-01T21:03:49.953499] [FATAL] [REMOTE ] PRH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:03:49.953579] [FATAL] [MAIN ] PRH: Failed to fetch primary data. [2025-10-01T21:03:49.953670] [WARN ] [MAIN ] PRH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:03:49.953743] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-01T21:03:49.953806] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-01T21:03:49.953845] [INFO ] [LOCAL ] PRH: Starting deletion of derivative data. [2025-10-01T21:03:49.954335] [DEBUG] [LOCAL ] PRH: Deleted derivative data file. [2025-10-01T21:03:49.954423] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRH took 29.6s. Estimated remaining: 1h 31m 6s. Rate: 7.1 symbols/min [2025-10-01T21:03:50.154675] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:03:50.175146] [DEBUG] [LOCAL ] PRLB: Loaded 20503 existing records from primary storage. [2025-10-01T21:03:50.175557] [INFO ] [MAIN ] PRLB: Loaded 20503 existing records. [2025-10-01T21:03:50.312258] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T21:03:50.401118] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:03:50.401371] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-01T21:03:50.401459] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-01T21:03:50.402296] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-10-01T21:03:50.402357] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-01T21:03:50.507510] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-01T21:03:50.806890] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:03:51.302403] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-01T21:03:52.102366] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-01T21:03:52.193813] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T21:03:52.407671] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T21:03:52.902409] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-01T21:03:53.386544] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T21:03:53.702415] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-01T21:03:53.734878] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T21:03:54.502414] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-01T21:03:55.295677] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T21:03:55.304306] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-01T21:03:55.592524] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T21:03:56.102401] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-01T21:03:56.173537] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T21:03:56.902421] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-01T21:03:57.204811] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T21:03:57.702412] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-01T21:03:58.502988] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-01T21:03:58.506276] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T21:03:58.625998] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T21:03:59.302406] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-01T21:04:00.102378] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-01T21:04:00.411048] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T21:04:00.902374] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-01T21:04:01.114717] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T21:04:01.263616] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T21:04:01.702393] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-01T21:04:02.502424] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-01T21:04:02.544955] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T21:04:02.944077] [DEBUG] [REMOTE ] PRI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:02.944765] [WARN ] [REMOTE ] PRI: No data returned for month 2025-10 [2025-10-01T21:04:02.946451] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T21:04:02.946615] [FATAL] [REMOTE ] PRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:02.956016] [FATAL] [MAIN ] PRI: Failed to fetch primary data. [2025-10-01T21:04:02.956498] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:02.956614] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-01T21:04:02.957070] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-01T21:04:02.957131] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-01T21:04:02.957571] [DEBUG] [LOCAL ] PRI: Deleted derivative data file. [2025-10-01T21:04:02.957711] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRI took 31.4s. Estimated remaining: 1h 30m 59s. Rate: 7.1 symbols/min [2025-10-01T21:04:03.143523] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:03.196603] [DEBUG] [LOCAL ] PRM: Loaded 44640 existing records from primary storage. [2025-10-01T21:04:03.196969] [INFO ] [MAIN ] PRM: Loaded 44640 existing records. [2025-10-01T21:04:03.306572] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-01T21:04:03.392783] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:04:03.393036] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-01T21:04:03.393085] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-01T21:04:03.394051] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-01T21:04:03.394114] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-01T21:04:03.790607] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:04.102378] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-01T21:04:04.902415] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-01T21:04:05.116438] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T21:04:05.705216] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-01T21:04:05.710369] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T21:04:06.282489] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T21:04:06.502401] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-01T21:04:06.521249] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-01T21:04:06.796098] [DEBUG] [REMOTE ] PRIM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:06.796465] [WARN ] [REMOTE ] PRIM: No data returned for month 2025-10 [2025-10-01T21:04:06.796561] [FATAL] [REMOTE ] PRIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:06.796674] [FATAL] [MAIN ] PRIM: Failed to fetch primary data. [2025-10-01T21:04:06.796751] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:06.796829] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-01T21:04:06.796896] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-01T21:04:06.796934] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-01T21:04:06.797307] [DEBUG] [LOCAL ] PRIM: Deleted derivative data file. [2025-10-01T21:04:06.797402] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRIM took 32.8s. Estimated remaining: 1h 30m 49s. Rate: 7.1 symbols/min [2025-10-01T21:04:06.983053] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:07.036167] [DEBUG] [LOCAL ] PRMB: Loaded 53145 existing records from primary storage. [2025-10-01T21:04:07.036588] [INFO ] [MAIN ] PRMB: Loaded 53145 existing records. [2025-10-01T21:04:07.245919] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:04:07.246244] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-01T21:04:07.246319] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-01T21:04:07.248371] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-01T21:04:07.248450] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-01T21:04:07.307492] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-01T21:04:07.681885] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:08.102395] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-01T21:04:08.565103] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T21:04:08.902429] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-01T21:04:09.542782] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T21:04:09.702412] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-01T21:04:10.237692] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T21:04:10.502401] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-01T21:04:11.007727] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T21:04:11.302394] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-01T21:04:12.076891] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T21:04:12.102439] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-01T21:04:12.435287] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T21:04:12.902380] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-01T21:04:13.702361] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-01T21:04:13.736676] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T21:04:14.297547] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T21:04:14.502396] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-01T21:04:15.108561] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T21:04:15.302376] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-01T21:04:15.627378] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T21:04:16.102412] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-01T21:04:16.902406] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-01T21:04:17.044494] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T21:04:17.282487] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T21:04:17.702395] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-01T21:04:18.502342] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-01T21:04:18.606759] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:04:19.302347] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-01T21:04:19.329587] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T21:04:19.375088] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T21:04:20.102392] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-01T21:04:20.902384] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-01T21:04:20.966733] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T21:04:21.710306] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-01T21:04:21.734695] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T21:04:22.502341] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-01T21:04:22.597331] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T21:04:22.836708] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T21:04:23.302394] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-01T21:04:23.527826] [DEBUG] [REMOTE ] PRKS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:23.528184] [WARN ] [REMOTE ] PRKS: No data returned for month 2025-10 [2025-10-01T21:04:23.528295] [FATAL] [REMOTE ] PRKS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:23.528431] [FATAL] [MAIN ] PRKS: Failed to fetch primary data. [2025-10-01T21:04:23.528500] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:23.528584] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-01T21:04:23.528701] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-01T21:04:23.528770] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-01T21:04:23.529146] [DEBUG] [LOCAL ] PRKS: Deleted derivative data file. [2025-10-01T21:04:23.529272] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRKS took 48.0s. Estimated remaining: 1h 30m 43s. Rate: 7.1 symbols/min [2025-10-01T21:04:23.734313] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:23.774261] [DEBUG] [LOCAL ] PRO: Loaded 38163 existing records from primary storage. [2025-10-01T21:04:23.774631] [INFO ] [MAIN ] PRO: Loaded 38163 existing records. [2025-10-01T21:04:23.973957] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:04:23.974389] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-01T21:04:23.974556] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-01T21:04:23.975439] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-01T21:04:23.975510] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-01T21:04:24.105604] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-01T21:04:24.337875] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T21:04:24.467272] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:24.902361] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-01T21:04:25.702374] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-01T21:04:26.063620] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T21:04:26.321530] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T21:04:26.502412] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-01T21:04:26.704729] [DEBUG] [REMOTE ] PRLB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:26.705059] [WARN ] [REMOTE ] PRLB: No data returned for month 2025-10 [2025-10-01T21:04:26.705154] [FATAL] [REMOTE ] PRLB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:26.705249] [FATAL] [MAIN ] PRLB: Failed to fetch primary data. [2025-10-01T21:04:26.705332] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:26.705409] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-01T21:04:26.705513] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-01T21:04:26.705565] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-01T21:04:26.705887] [DEBUG] [LOCAL ] PRLB: Deleted derivative data file. [2025-10-01T21:04:26.705978] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRLB took 36.8s. Estimated remaining: 1h 30m 33s. Rate: 7.1 symbols/min [2025-10-01T21:04:26.893455] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:26.893671] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-01T21:04:26.893730] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-01T21:04:26.893847] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-01T21:04:26.893942] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-01T21:04:26.893998] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-01T21:04:26.894034] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-01T21:04:27.290664] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:27.302347] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-01T21:04:27.401854] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T21:04:28.102377] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-01T21:04:28.573268] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T21:04:28.902436] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-01T21:04:29.449857] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T21:04:29.702404] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-01T21:04:30.148440] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:30.148805] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-01T21:04:30.148898] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:30.148985] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-01T21:04:30.149111] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:30.149217] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-01T21:04:30.149374] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-01T21:04:30.149438] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-01T21:04:30.149556] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-01T21:04:30.149716] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRSU took 3.4s. Estimated remaining: 1h 30m 23s. Rate: 7.1 symbols/min [2025-10-01T21:04:30.289087] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T21:04:30.374600] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:30.381119] [DEBUG] [LOCAL ] PRT: Loaded 5302 existing records from primary storage. [2025-10-01T21:04:30.381286] [INFO ] [MAIN ] PRT: Loaded 5302 existing records. [2025-10-01T21:04:30.507463] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-01T21:04:30.575260] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:04:30.575592] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-01T21:04:30.575695] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-01T21:04:30.576021] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-01T21:04:30.576085] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-01T21:04:30.961206] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:31.302409] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-01T21:04:32.102358] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-01T21:04:32.409026] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T21:04:32.670784] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T21:04:32.902417] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-01T21:04:33.702407] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-01T21:04:33.910776] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T21:04:34.382606] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T21:04:34.502389] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-01T21:04:34.829549] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T21:04:35.302390] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-01T21:04:35.407758] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T21:04:36.102385] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-01T21:04:36.902368] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-01T21:04:36.972685] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T21:04:37.212814] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T21:04:37.702396] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-01T21:04:38.507468] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-01T21:04:38.527803] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T21:04:38.872412] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T21:04:39.302466] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-01T21:04:40.102448] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-01T21:04:40.323598] [DEBUG] [REMOTE ] PRM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:40.324177] [WARN ] [REMOTE ] PRM: No data returned for month 2025-10 [2025-10-01T21:04:40.324281] [FATAL] [REMOTE ] PRM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:40.324392] [FATAL] [MAIN ] PRM: Failed to fetch primary data. [2025-10-01T21:04:40.324432] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:40.324479] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-01T21:04:40.324770] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-01T21:04:40.324986] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-01T21:04:40.325415] [DEBUG] [LOCAL ] PRM: Deleted derivative data file. [2025-10-01T21:04:40.325609] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRM took 37.4s. Estimated remaining: 1h 30m 15s. Rate: 7.1 symbols/min [2025-10-01T21:04:40.525941] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:40.526512] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-01T21:04:40.538503] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-01T21:04:40.565019] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-01T21:04:40.565353] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-01T21:04:40.566155] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-01T21:04:40.568431] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-01T21:04:40.568235] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-01T21:04:40.907618] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-01T21:04:41.014639] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:41.018482] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T21:04:41.702434] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-01T21:04:42.008768] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T21:04:42.502444] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-01T21:04:43.130159] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T21:04:43.159166] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T21:04:43.302415] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-01T21:04:44.102428] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-01T21:04:44.879269] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T21:04:44.902346] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-01T21:04:45.702401] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-01T21:04:45.895181] [DEBUG] [REMOTE ] PRMB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:45.895514] [WARN ] [REMOTE ] PRMB: No data returned for month 2025-10 [2025-10-01T21:04:45.895609] [FATAL] [REMOTE ] PRMB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:45.895756] [FATAL] [MAIN ] PRMB: Failed to fetch primary data. [2025-10-01T21:04:45.895827] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:45.895903] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-01T21:04:45.896003] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-01T21:04:45.896063] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-01T21:04:45.896339] [DEBUG] [LOCAL ] PRMB: Deleted derivative data file. [2025-10-01T21:04:45.896429] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRMB took 39.1s. Estimated remaining: 1h 30m 5s. Rate: 7.1 symbols/min [2025-10-01T21:04:46.108619] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:46.124785] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-01T21:04:46.124978] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-01T21:04:46.126899] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-01T21:04:46.125672] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-01T21:04:46.137220] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-01T21:04:46.137345] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-01T21:04:46.137403] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-01T21:04:46.518851] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-01T21:04:46.569074] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:46.606371] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T21:04:47.217441] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T21:04:47.302426] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-01T21:04:47.869197] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-01T21:04:48.102384] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-01T21:04:48.624353] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T21:04:48.902416] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-01T21:04:49.702401] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-01T21:04:50.509691] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-01T21:04:50.515275] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:04:50.922079] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-01T21:04:51.302362] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-01T21:04:51.573702] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-01T21:04:51.774717] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T21:04:52.102400] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-01T21:04:52.540269] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T21:04:52.902385] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-01T21:04:53.702387] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-01T21:04:54.407838] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T21:04:54.502378] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-01T21:04:54.742310] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T21:04:55.182064] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T21:04:55.302399] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-01T21:04:55.953705] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T21:04:56.102381] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-01T21:04:56.420462] [DEBUG] [REMOTE ] PRO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:56.420837] [WARN ] [REMOTE ] PRO: No data returned for month 2025-10 [2025-10-01T21:04:56.420950] [FATAL] [REMOTE ] PRO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:56.421064] [FATAL] [MAIN ] PRO: Failed to fetch primary data. [2025-10-01T21:04:56.421134] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:56.421214] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-01T21:04:56.421283] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-01T21:04:56.421322] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-01T21:04:56.421724] [DEBUG] [LOCAL ] PRO: Deleted derivative data file. [2025-10-01T21:04:56.421816] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRO took 32.9s. Estimated remaining: 1h 29m 58s. Rate: 7.1 symbols/min [2025-10-01T21:04:56.627625] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:56.627871] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-01T21:04:56.628001] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-01T21:04:56.628167] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-01T21:04:56.628210] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-01T21:04:56.628265] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-01T21:04:56.628299] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-01T21:04:56.907581] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-01T21:04:57.038505] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:04:57.587277] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-01T21:04:57.702380] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-01T21:04:58.502381] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-01T21:04:58.700595] [DEBUG] [REMOTE ] PRT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:04:58.700999] [WARN ] [REMOTE ] PRT: No data returned for month 2025-10 [2025-10-01T21:04:58.701103] [FATAL] [REMOTE ] PRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:04:58.701191] [FATAL] [MAIN ] PRT: Failed to fetch primary data. [2025-10-01T21:04:58.701231] [WARN ] [MAIN ] PRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:04:58.701300] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-01T21:04:58.701364] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-01T21:04:58.701405] [INFO ] [LOCAL ] PRT: Starting deletion of derivative data. [2025-10-01T21:04:58.701714] [DEBUG] [LOCAL ] PRT: Deleted derivative data file. [2025-10-01T21:04:58.701805] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRT took 28.6s. Estimated remaining: 1h 29m 47s. Rate: 7.1 symbols/min [2025-10-01T21:04:58.893071] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:04:58.902498] [DEBUG] [LOCAL ] PSBD: Loaded 7055 existing records from primary storage. [2025-10-01T21:04:58.902738] [INFO ] [MAIN ] PSBD: Loaded 7055 existing records. [2025-10-01T21:04:59.100894] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:04:59.101243] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-01T21:04:59.101379] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-01T21:04:59.101827] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-01T21:04:59.101894] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-01T21:04:59.304224] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-01T21:04:59.405675] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:04:59.550981] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:00.102385] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-01T21:05:00.387811] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-01T21:05:00.902444] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-01T21:05:01.343213] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-01T21:05:01.702469] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-01T21:05:01.935469] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T21:05:02.162330] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T21:05:02.502422] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-01T21:05:02.917260] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-01T21:05:03.302384] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-01T21:05:04.102407] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-01T21:05:04.592415] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T21:05:04.902394] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-01T21:05:05.364327] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-01T21:05:05.702407] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-01T21:05:06.376262] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T21:05:06.502391] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-01T21:05:06.558810] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T21:05:06.766337] [DEBUG] [REMOTE ] PRVS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:05:06.766685] [WARN ] [REMOTE ] PRVS: No data returned for month 2025-10 [2025-10-01T21:05:06.766827] [FATAL] [REMOTE ] PRVS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:05:06.766904] [FATAL] [MAIN ] PRVS: Failed to fetch primary data. [2025-10-01T21:05:06.766974] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:05:06.767048] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-01T21:05:06.767111] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-01T21:05:06.767147] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-01T21:05:06.767187] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-01T21:05:06.767236] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRVS took 20.9s. Estimated remaining: 1h 29m 38s. Rate: 7.1 symbols/min [2025-10-01T21:05:06.953615] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:05:06.963101] [DEBUG] [LOCAL ] PSF: Loaded 6917 existing records from primary storage. [2025-10-01T21:05:06.963351] [INFO ] [MAIN ] PSF: Loaded 6917 existing records. [2025-10-01T21:05:07.167194] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:05:07.167638] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-01T21:05:07.167724] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-01T21:05:07.169273] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-01T21:05:07.169338] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-01T21:05:07.307682] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-01T21:05:07.596074] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:08.102399] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-01T21:05:08.902356] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-01T21:05:08.978747] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T21:05:09.685385] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T21:05:09.702349] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-01T21:05:10.107783] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-01T21:05:10.502462] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-01T21:05:11.253016] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T21:05:11.291179] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T21:05:11.302340] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-01T21:05:12.102388] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-01T21:05:12.902384] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-01T21:05:12.991377] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T21:05:13.523736] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T21:05:13.702402] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-01T21:05:13.899122] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T21:05:14.186256] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-01T21:05:14.502386] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-01T21:05:15.302387] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-01T21:05:16.053812] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T21:05:16.102380] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-01T21:05:16.747117] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-01T21:05:16.902392] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-01T21:05:17.702375] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-01T21:05:17.814180] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T21:05:17.844621] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T21:05:18.502374] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-01T21:05:19.077713] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T21:05:19.302358] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-01T21:05:19.525438] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T21:05:19.891438] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T21:05:20.102385] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-01T21:05:20.902395] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-01T21:05:21.702431] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-01T21:05:21.800304] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-01T21:05:21.802624] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T21:05:22.389693] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-01T21:05:22.502396] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-01T21:05:23.302412] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-01T21:05:23.310147] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T21:05:24.102399] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-01T21:05:24.902407] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-01T21:05:25.121985] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T21:05:25.665734] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T21:05:25.702390] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-01T21:05:25.731484] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T21:05:26.502431] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-01T21:05:27.014936] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T21:05:27.097960] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T21:05:27.302406] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-01T21:05:28.102423] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-01T21:05:28.906500] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-01T21:05:28.908762] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T21:05:29.073995] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T21:05:29.158183] [DEBUG] [REMOTE ] PRU: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:05:29.158548] [WARN ] [REMOTE ] PRU: No data returned for month 2025-10 [2025-10-01T21:05:29.158665] [FATAL] [REMOTE ] PRU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:05:29.158771] [FATAL] [MAIN ] PRU: Failed to fetch primary data. [2025-10-01T21:05:29.158836] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:05:29.158935] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-01T21:05:29.159041] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-01T21:05:29.159115] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-01T21:05:29.159186] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-01T21:05:29.159241] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PRU took 48.8s. Estimated remaining: 1h 29m 35s. Rate: 7.1 symbols/min [2025-10-01T21:05:29.348375] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:05:29.380137] [DEBUG] [LOCAL ] PSFE: Loaded 30067 existing records from primary storage. [2025-10-01T21:05:29.380438] [INFO ] [MAIN ] PSFE: Loaded 30067 existing records. [2025-10-01T21:05:29.577852] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:05:29.578172] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-01T21:05:29.578253] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-01T21:05:29.579516] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-01T21:05:29.579583] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-01T21:05:29.707521] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-01T21:05:29.995476] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:30.023020] [DEBUG] [REMOTE ] PSBD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:05:30.023407] [WARN ] [REMOTE ] PSBD: No data returned for month 2025-10 [2025-10-01T21:05:30.023503] [FATAL] [REMOTE ] PSBD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:05:30.023632] [FATAL] [MAIN ] PSBD: Failed to fetch primary data. [2025-10-01T21:05:30.023748] [WARN ] [MAIN ] PSBD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:05:30.023858] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-01T21:05:30.023975] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-01T21:05:30.024050] [INFO ] [LOCAL ] PSBD: Starting deletion of derivative data. [2025-10-01T21:05:30.024512] [DEBUG] [LOCAL ] PSBD: Deleted derivative data file. [2025-10-01T21:05:30.024628] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSBD took 31.3s. Estimated remaining: 1h 29m 24s. Rate: 7.1 symbols/min [2025-10-01T21:05:30.221799] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:05:30.277853] [DEBUG] [LOCAL ] PSN: Loaded 46029 existing records from primary storage. [2025-10-01T21:05:30.278206] [INFO ] [MAIN ] PSN: Loaded 46029 existing records. [2025-10-01T21:05:30.477279] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:05:30.477515] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-01T21:05:30.477568] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-01T21:05:30.479506] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-10-01T21:05:30.479572] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-01T21:05:30.510604] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-01T21:05:30.893174] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:31.302395] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-01T21:05:31.509923] [DEBUG] [REMOTE ] PSA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:05:31.510237] [WARN ] [REMOTE ] PSA: No data returned for month 2025-10 [2025-10-01T21:05:31.510349] [FATAL] [REMOTE ] PSA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:05:31.510444] [FATAL] [MAIN ] PSA: Failed to fetch primary data. [2025-10-01T21:05:31.510508] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:05:31.510582] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-01T21:05:31.510683] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-01T21:05:31.510739] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-01T21:05:31.510782] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-01T21:05:31.510831] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSA took 35.1s. Estimated remaining: 1h 29m 13s. Rate: 7.1 symbols/min [2025-10-01T21:05:31.701071] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:05:31.747358] [DEBUG] [LOCAL ] PSO: Loaded 37006 existing records from primary storage. [2025-10-01T21:05:31.747726] [INFO ] [MAIN ] PSO: Loaded 37006 existing records. [2025-10-01T21:05:31.973864] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:05:31.975614] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T21:05:31.975819] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-01T21:05:31.982274] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-01T21:05:31.984493] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-01T21:05:31.984556] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-01T21:05:32.107507] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-01T21:05:32.383158] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:32.902386] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-01T21:05:33.408355] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T21:05:33.702427] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-01T21:05:34.259088] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T21:05:34.502405] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-01T21:05:35.272806] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T21:05:35.302346] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-01T21:05:35.815265] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T21:05:36.102399] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-01T21:05:36.886422] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T21:05:36.902331] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-01T21:05:37.219507] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-01T21:05:37.702427] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-01T21:05:38.502455] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-01T21:05:38.565759] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T21:05:38.836449] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T21:05:39.302409] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-01T21:05:39.583056] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T21:05:40.102404] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-01T21:05:40.484031] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T21:05:40.902451] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-01T21:05:41.433705] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T21:05:41.702385] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-01T21:05:42.268249] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T21:05:42.502393] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-01T21:05:43.071007] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T21:05:43.302363] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-01T21:05:43.553718] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T21:05:44.102427] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-01T21:05:44.460256] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T21:05:44.794095] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T21:05:44.902389] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-01T21:05:45.702391] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-01T21:05:46.326975] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T21:05:46.502442] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-01T21:05:47.302393] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-01T21:05:47.639326] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T21:05:47.698523] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T21:05:48.102381] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-01T21:05:48.447212] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T21:05:48.902363] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-01T21:05:49.567548] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T21:05:49.702361] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-01T21:05:49.797564] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T21:05:50.006319] [DEBUG] [REMOTE ] PSFE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:05:50.006714] [WARN ] [REMOTE ] PSFE: No data returned for month 2025-10 [2025-10-01T21:05:50.006808] [FATAL] [REMOTE ] PSFE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:05:50.006888] [FATAL] [MAIN ] PSFE: Failed to fetch primary data. [2025-10-01T21:05:50.006952] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:05:50.007025] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-01T21:05:50.007090] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-01T21:05:50.007126] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-01T21:05:50.007509] [DEBUG] [LOCAL ] PSFE: Deleted derivative data file. [2025-10-01T21:05:50.007611] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSFE took 20.8s. Estimated remaining: 1h 29m 8s. Rate: 7.1 symbols/min [2025-10-01T21:05:50.205380] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:05:50.247831] [DEBUG] [LOCAL ] PSQH: Loaded 34894 existing records from primary storage. [2025-10-01T21:05:50.248147] [INFO ] [MAIN ] PSQH: Loaded 34894 existing records. [2025-10-01T21:05:50.439107] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:05:50.439382] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-01T21:05:50.439435] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-01T21:05:50.441395] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-01T21:05:50.441460] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-01T21:05:50.508266] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-01T21:05:50.838112] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:51.302403] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-01T21:05:51.362767] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T21:05:52.102427] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-01T21:05:52.854447] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T21:05:52.902353] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-01T21:05:52.917531] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T21:05:53.702396] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-01T21:05:53.966861] [DEBUG] [REMOTE ] PSF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:05:53.967253] [WARN ] [REMOTE ] PSF: No data returned for month 2025-10 [2025-10-01T21:05:53.967374] [FATAL] [REMOTE ] PSF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:05:53.967479] [FATAL] [MAIN ] PSF: Failed to fetch primary data. [2025-10-01T21:05:53.967557] [WARN ] [MAIN ] PSF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:05:53.967667] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-01T21:05:53.967765] [DEBUG] [LOCAL ] PSF: No primary data file found to delete. [2025-10-01T21:05:53.967812] [INFO ] [LOCAL ] PSF: Starting deletion of derivative data. [2025-10-01T21:05:53.972117] [DEBUG] [LOCAL ] PSF: Deleted derivative data file. [2025-10-01T21:05:53.972354] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSF took 47.2s. Estimated remaining: 1h 28m 58s. Rate: 7.1 symbols/min [2025-10-01T21:05:54.169951] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:05:54.234398] [DEBUG] [LOCAL ] PSTG: Loaded 52841 existing records from primary storage. [2025-10-01T21:05:54.234829] [INFO ] [MAIN ] PSTG: Loaded 52841 existing records. [2025-10-01T21:05:54.434811] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:05:54.435110] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-01T21:05:54.435180] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-01T21:05:54.436963] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-10-01T21:05:54.437026] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-01T21:05:54.506782] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-01T21:05:54.836609] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T21:05:54.890903] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:55.302403] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-01T21:05:56.102377] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-01T21:05:56.304014] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T21:05:56.902413] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-01T21:05:57.572194] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-01T21:05:57.667232] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T21:05:57.702413] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-01T21:05:57.963332] [DEBUG] [REMOTE ] PSN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:05:57.963692] [WARN ] [REMOTE ] PSN: No data returned for month 2025-10 [2025-10-01T21:05:57.963784] [FATAL] [REMOTE ] PSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:05:57.963866] [FATAL] [MAIN ] PSN: Failed to fetch primary data. [2025-10-01T21:05:57.963951] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:05:57.964039] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-01T21:05:57.964186] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-01T21:05:57.964251] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-01T21:05:57.964680] [DEBUG] [LOCAL ] PSN: Deleted derivative data file. [2025-10-01T21:05:57.964771] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSN took 27.9s. Estimated remaining: 1h 28m 48s. Rate: 7.1 symbols/min [2025-10-01T21:05:58.158375] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:05:58.179169] [DEBUG] [LOCAL ] PSTL: Loaded 20068 existing records from primary storage. [2025-10-01T21:05:58.179453] [INFO ] [MAIN ] PSTL: Loaded 20068 existing records. [2025-10-01T21:05:58.413809] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:05:58.414290] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-01T21:05:58.414414] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-01T21:05:58.424415] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-01T21:05:58.439495] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-01T21:05:58.508532] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-01T21:05:58.516200] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T21:05:58.865449] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:05:59.302383] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-01T21:06:00.102437] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-01T21:06:00.708802] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-01T21:06:00.755838] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T21:06:00.902389] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-01T21:06:01.702375] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-01T21:06:02.022031] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T21:06:02.095359] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T21:06:02.502485] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-01T21:06:03.256258] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T21:06:03.302354] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-01T21:06:04.036731] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T21:06:04.102386] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-01T21:06:04.902368] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-01T21:06:05.009171] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T21:06:05.429084] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T21:06:05.702357] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-01T21:06:06.077999] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T21:06:06.502402] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-01T21:06:07.302385] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-01T21:06:07.657941] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T21:06:07.751890] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T21:06:08.102386] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-01T21:06:08.203856] [DEBUG] [REMOTE ] PSO: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-01T21:06:08.204191] [WARN ] [REMOTE ] PSO: No data returned for month 2025-08 [2025-10-01T21:06:08.204283] [FATAL] [REMOTE ] PSO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:06:08.204363] [FATAL] [MAIN ] PSO: Failed to fetch primary data. [2025-10-01T21:06:08.204427] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:06:08.204500] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-01T21:06:08.204565] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-01T21:06:08.204600] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-01T21:06:08.204986] [DEBUG] [LOCAL ] PSO: Deleted derivative data file. [2025-10-01T21:06:08.205108] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSO took 36.7s. Estimated remaining: 1h 28m 40s. Rate: 7.1 symbols/min [2025-10-01T21:06:08.389405] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:06:08.389603] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-01T21:06:08.389673] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-01T21:06:08.389793] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-01T21:06:08.389888] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-01T21:06:08.389955] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-01T21:06:08.389991] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-01T21:06:08.810792] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:06:08.896685] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T21:06:08.904912] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-01T21:06:09.702422] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-01T21:06:10.230713] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T21:06:10.502476] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-01T21:06:11.302408] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-01T21:06:11.803116] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-01T21:06:12.078127] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T21:06:12.102347] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-01T21:06:12.410025] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T21:06:12.902383] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-01T21:06:13.702394] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-01T21:06:13.910610] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T21:06:14.027676] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T21:06:14.502377] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-01T21:06:15.155837] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T21:06:15.302384] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-01T21:06:15.631684] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T21:06:16.102364] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-01T21:06:16.814810] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T21:06:16.902370] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-01T21:06:17.543862] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T21:06:17.702385] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-01T21:06:17.950523] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-01T21:06:18.502374] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-01T21:06:19.192684] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T21:06:19.302380] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-01T21:06:20.102386] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-01T21:06:20.341632] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T21:06:20.628783] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T21:06:20.902389] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-01T21:06:21.702355] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-01T21:06:21.880051] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T21:06:22.492882] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T21:06:22.502329] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-01T21:06:22.790285] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T21:06:23.302383] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-01T21:06:23.585695] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T21:06:24.102443] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-01T21:06:24.902394] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-01T21:06:24.928875] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T21:06:25.229138] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-01T21:06:25.702421] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-01T21:06:26.502366] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-01T21:06:26.820582] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T21:06:27.302399] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-01T21:06:28.102441] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-01T21:06:28.418249] [DEBUG] [REMOTE ] PSTL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:06:28.418577] [WARN ] [REMOTE ] PSTL: No data returned for month 2025-10 [2025-10-01T21:06:28.418718] [FATAL] [REMOTE ] PSTL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:06:28.418815] [FATAL] [MAIN ] PSTL: Failed to fetch primary data. [2025-10-01T21:06:28.418897] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:06:28.418972] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-01T21:06:28.419038] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-01T21:06:28.419076] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-01T21:06:28.419436] [DEBUG] [LOCAL ] PSTL: Deleted derivative data file. [2025-10-01T21:06:28.419548] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSTL took 30.5s. Estimated remaining: 1h 28m 35s. Rate: 7.1 symbols/min [2025-10-01T21:06:28.610046] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:06:28.626018] [DEBUG] [LOCAL ] PTA: Loaded 14822 existing records from primary storage. [2025-10-01T21:06:28.626255] [INFO ] [MAIN ] PTA: Loaded 14822 existing records. [2025-10-01T21:06:28.826391] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:06:28.826637] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-01T21:06:28.826734] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-01T21:06:28.827179] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-01T21:06:28.827242] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-01T21:06:29.237181] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:06:29.237698] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-01T21:06:29.286956] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-01T21:06:29.437137] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (3.73 seconds). [2025-10-01T21:06:29.702360] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-01T21:06:30.196265] [DEBUG] [REMOTE ] PSTG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:06:30.196575] [WARN ] [REMOTE ] PSTG: No data returned for month 2025-10 [2025-10-01T21:06:30.196689] [FATAL] [REMOTE ] PSTG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:06:30.196836] [FATAL] [MAIN ] PSTG: Failed to fetch primary data. [2025-10-01T21:06:30.196906] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:06:30.196978] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-01T21:06:30.197042] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-01T21:06:30.197078] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-01T21:06:30.197531] [DEBUG] [LOCAL ] PSTG: Deleted derivative data file. [2025-10-01T21:06:30.197630] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTG took 36.2s. Estimated remaining: 1h 28m 25s. Rate: 7.1 symbols/min [2025-10-01T21:06:30.393208] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:06:30.431228] [DEBUG] [LOCAL ] PTY: Loaded 37302 existing records from primary storage. [2025-10-01T21:06:30.431537] [INFO ] [MAIN ] PTY: Loaded 37302 existing records. [2025-10-01T21:06:30.507477] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-01T21:06:30.668693] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T21:06:30.676212] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:06:30.676603] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-01T21:06:30.676828] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-01T21:06:30.679142] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-01T21:06:30.679208] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-01T21:06:31.103213] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:06:31.302342] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-01T21:06:31.560182] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (5.06 seconds). [2025-10-01T21:06:32.102397] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-01T21:06:32.417353] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T21:06:32.812409] [DEBUG] [REMOTE ] PSQH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:06:32.812807] [WARN ] [REMOTE ] PSQH: No data returned for month 2025-10 [2025-10-01T21:06:32.812905] [FATAL] [REMOTE ] PSQH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:06:32.813002] [FATAL] [MAIN ] PSQH: Failed to fetch primary data. [2025-10-01T21:06:32.813080] [WARN ] [MAIN ] PSQH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:06:32.813158] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-01T21:06:32.813223] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-01T21:06:32.813260] [INFO ] [LOCAL ] PSQH: Starting deletion of derivative data. [2025-10-01T21:06:32.813615] [DEBUG] [LOCAL ] PSQH: Deleted derivative data file. [2025-10-01T21:06:32.813752] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSQH took 42.8s. Estimated remaining: 1h 28m 14s. Rate: 7.1 symbols/min [2025-10-01T21:06:32.907700] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-01T21:06:33.010494] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:06:33.053794] [DEBUG] [LOCAL ] PUK: Loaded 44765 existing records from primary storage. [2025-10-01T21:06:33.054101] [INFO ] [MAIN ] PUK: Loaded 44765 existing records. [2025-10-01T21:06:33.252116] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:06:33.252351] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-01T21:06:33.252401] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-01T21:06:33.253265] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-01T21:06:33.253327] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-01T21:06:33.684987] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:06:33.687382] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:06:33.702340] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-01T21:06:33.796823] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T21:06:34.502399] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-01T21:06:35.302391] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-01T21:06:35.460510] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T21:06:36.102373] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-01T21:06:36.268706] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T21:06:36.902358] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-01T21:06:36.981578] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T21:06:37.702372] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-01T21:06:37.840045] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T21:06:37.979884] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T21:06:38.502419] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-01T21:06:39.169801] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T21:06:39.302394] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-01T21:06:40.102380] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-01T21:06:40.829930] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T21:06:40.902363] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-01T21:06:41.121563] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T21:06:41.428493] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-01T21:06:41.702379] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-01T21:06:42.502407] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-01T21:06:42.641444] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T21:06:43.207543] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T21:06:43.268609] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T21:06:43.302361] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-01T21:06:44.102450] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-01T21:06:44.902371] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-01T21:06:45.702424] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-01T21:06:45.748613] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-01T21:06:45.877619] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T21:06:45.907217] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T21:06:46.502409] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-01T21:06:46.985337] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-01T21:06:47.302400] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-01T21:06:48.102367] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-01T21:06:48.309438] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T21:06:48.344718] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:06:48.902376] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-01T21:06:49.366021] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T21:06:49.702395] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-01T21:06:50.502364] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-01T21:06:50.670379] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T21:06:51.116893] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T21:06:51.302363] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-01T21:06:51.918261] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T21:06:52.102428] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-01T21:06:52.829073] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T21:06:52.902385] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-01T21:06:53.377692] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-01T21:06:53.702408] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-01T21:06:54.502355] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-01T21:06:54.620098] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T21:06:54.734039] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T21:06:54.758576] [DEBUG] [REMOTE ] PSX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:06:54.758976] [WARN ] [REMOTE ] PSX: No data returned for month 2025-10 [2025-10-01T21:06:54.759087] [FATAL] [REMOTE ] PSX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:06:54.759212] [FATAL] [MAIN ] PSX: Failed to fetch primary data. [2025-10-01T21:06:54.759294] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:06:54.759378] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-01T21:06:54.759495] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-01T21:06:54.759561] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-01T21:06:54.759631] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-01T21:06:54.759743] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PSX took 46.6s. Estimated remaining: 1h 28m 10s. Rate: 7.1 symbols/min [2025-10-01T21:06:54.985446] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:06:55.034526] [DEBUG] [LOCAL ] PUMP: Loaded 49391 existing records from primary storage. [2025-10-01T21:06:55.035029] [INFO ] [MAIN ] PUMP: Loaded 49391 existing records. [2025-10-01T21:06:55.245140] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:06:55.245354] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-01T21:06:55.245406] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-01T21:06:55.246297] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-10-01T21:06:55.246359] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-01T21:06:55.307615] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-01T21:06:55.675360] [DEBUG] [REMOTE ] PTA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:06:55.695672] [WARN ] [REMOTE ] PTA: No data returned for month 2025-10 [2025-10-01T21:06:55.702813] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:06:55.703122] [FATAL] [REMOTE ] PTA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:06:55.703285] [FATAL] [MAIN ] PTA: Failed to fetch primary data. [2025-10-01T21:06:55.703745] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:06:55.703826] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-01T21:06:55.703898] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-01T21:06:55.703937] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-01T21:06:55.704349] [DEBUG] [LOCAL ] PTA: Deleted derivative data file. [2025-10-01T21:06:55.704492] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTA took 27.3s. Estimated remaining: 1h 27m 59s. Rate: 7.1 symbols/min [2025-10-01T21:06:55.900039] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:06:55.948619] [DEBUG] [LOCAL ] PVH: Loaded 50414 existing records from primary storage. [2025-10-01T21:06:55.948983] [INFO ] [MAIN ] PVH: Loaded 50414 existing records. [2025-10-01T21:06:56.112482] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-01T21:06:56.146479] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:06:56.146752] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-01T21:06:56.146807] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-01T21:06:56.149283] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-10-01T21:06:56.149350] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-01T21:06:56.537573] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:06:56.902405] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-01T21:06:57.702374] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-01T21:06:57.907392] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T21:06:58.502382] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-01T21:06:58.634243] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T21:06:59.302392] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-01T21:06:59.510258] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T21:06:59.966718] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T21:07:00.102403] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-01T21:07:00.902359] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-01T21:07:01.184709] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T21:07:01.692179] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T21:07:01.703345] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-01T21:07:02.314521] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T21:07:02.502461] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-01T21:07:02.870464] [DEBUG] [REMOTE ] PTY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:07:02.870937] [WARN ] [REMOTE ] PTY: No data returned for month 2025-10 [2025-10-01T21:07:02.871057] [FATAL] [REMOTE ] PTY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:07:02.871188] [FATAL] [MAIN ] PTY: Failed to fetch primary data. [2025-10-01T21:07:02.871272] [WARN ] [MAIN ] PTY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:07:02.871365] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-01T21:07:02.871445] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-01T21:07:02.871487] [INFO ] [LOCAL ] PTY: Starting deletion of derivative data. [2025-10-01T21:07:02.871849] [DEBUG] [LOCAL ] PTY: Deleted derivative data file. [2025-10-01T21:07:02.871949] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PTY took 32.7s. Estimated remaining: 1h 27m 50s. Rate: 7.1 symbols/min [2025-10-01T21:07:03.079570] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:07:03.086747] [DEBUG] [LOCAL ] PVL: Loaded 4765 existing records from primary storage. [2025-10-01T21:07:03.087105] [INFO ] [MAIN ] PVL: Loaded 4765 existing records. [2025-10-01T21:07:03.296482] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:07:03.296835] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-01T21:07:03.297022] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-01T21:07:03.297426] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-01T21:07:03.297574] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-01T21:07:03.309243] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-01T21:07:03.454270] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T21:07:03.714115] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:07:04.102391] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-01T21:07:04.902389] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-01T21:07:05.024756] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:07:05.675881] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T21:07:05.702346] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-01T21:07:06.502384] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-01T21:07:06.711232] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T21:07:07.303506] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T21:07:07.303173] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-01T21:07:07.483095] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T21:07:08.102389] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-01T21:07:08.552053] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T21:07:08.902441] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-01T21:07:09.702357] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-01T21:07:09.992082] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T21:07:10.295021] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T21:07:10.502369] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-01T21:07:10.558737] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T21:07:11.302405] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-01T21:07:12.102401] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-01T21:07:12.197061] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T21:07:12.257578] [DEBUG] [REMOTE ] PUK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:07:12.258026] [WARN ] [REMOTE ] PUK: No data returned for month 2025-10 [2025-10-01T21:07:12.258123] [FATAL] [REMOTE ] PUK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:07:12.258223] [FATAL] [MAIN ] PUK: Failed to fetch primary data. [2025-10-01T21:07:12.258290] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:07:12.258368] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-01T21:07:12.258437] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-01T21:07:12.258477] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-01T21:07:12.258866] [DEBUG] [LOCAL ] PUK: Deleted derivative data file. [2025-10-01T21:07:12.258964] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUK took 39.4s. Estimated remaining: 1h 27m 42s. Rate: 7.1 symbols/min [2025-10-01T21:07:12.447839] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:07:12.448081] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-01T21:07:12.448128] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-01T21:07:12.448245] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-01T21:07:12.448288] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-01T21:07:12.448332] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-01T21:07:12.448367] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-01T21:07:12.838957] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:07:12.902361] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-01T21:07:13.184194] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T21:07:13.702725] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-01T21:07:14.502394] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-01T21:07:14.557716] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T21:07:15.302397] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-01T21:07:15.579533] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T21:07:15.925195] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-01T21:07:16.102372] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-01T21:07:16.455278] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T21:07:16.830979] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T21:07:16.902394] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-01T21:07:17.560449] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-01T21:07:17.702374] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-01T21:07:18.414048] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-01T21:07:18.502385] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-01T21:07:19.278283] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T21:07:19.302404] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-01T21:07:20.102382] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-01T21:07:20.902375] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-01T21:07:21.480259] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-01T21:07:21.702366] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-01T21:07:22.042292] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T21:07:22.370344] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T21:07:22.502393] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-01T21:07:22.719023] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T21:07:23.302383] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-01T21:07:24.102403] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-01T21:07:24.266039] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T21:07:24.906279] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-01T21:07:24.911937] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T21:07:25.579809] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T21:07:25.702405] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-01T21:07:26.098330] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-01T21:07:26.502416] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-01T21:07:27.261727] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T21:07:27.302373] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-01T21:07:27.818740] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T21:07:28.102389] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-01T21:07:28.287720] [DEBUG] [REMOTE ] PUMP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:07:28.288077] [WARN ] [REMOTE ] PUMP: No data returned for month 2025-10 [2025-10-01T21:07:28.288190] [FATAL] [REMOTE ] PUMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:07:28.288279] [FATAL] [MAIN ] PUMP: Failed to fetch primary data. [2025-10-01T21:07:28.288318] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:07:28.288375] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-01T21:07:28.288484] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-01T21:07:28.288540] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-01T21:07:28.288909] [DEBUG] [LOCAL ] PUMP: Deleted derivative data file. [2025-10-01T21:07:28.289025] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PUMP took 33.5s. Estimated remaining: 1h 27m 36s. Rate: 7.1 symbols/min [2025-10-01T21:07:28.475223] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:07:28.511373] [DEBUG] [LOCAL ] PX: Loaded 34583 existing records from primary storage. [2025-10-01T21:07:28.511677] [INFO ] [MAIN ] PX: Loaded 34583 existing records. [2025-10-01T21:07:28.700116] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:07:28.700319] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-01T21:07:28.700367] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-01T21:07:28.702469] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-01T21:07:28.702531] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-01T21:07:28.903000] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-01T21:07:29.111043] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:07:29.145719] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T21:07:29.484383] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-01T21:07:29.702429] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-01T21:07:29.958050] [DEBUG] [REMOTE ] PVH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:07:29.958366] [WARN ] [REMOTE ] PVH: No data returned for month 2025-10 [2025-10-01T21:07:29.958488] [FATAL] [REMOTE ] PVH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:07:29.958618] [FATAL] [MAIN ] PVH: Failed to fetch primary data. [2025-10-01T21:07:29.958742] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:07:29.958841] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-01T21:07:29.958951] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-01T21:07:29.959024] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-01T21:07:29.959561] [DEBUG] [LOCAL ] PVH: Deleted derivative data file. [2025-10-01T21:07:29.959711] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PVH took 34.3s. Estimated remaining: 1h 27m 25s. Rate: 7.1 symbols/min [2025-10-01T21:07:30.150290] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:07:30.150459] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-01T21:07:30.150500] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-01T21:07:30.150618] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-01T21:07:30.150710] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-01T21:07:30.150782] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-01T21:07:30.150866] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-01T21:07:30.507497] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-01T21:07:30.540282] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:07:30.803475] [DEBUG] [REMOTE ] PVL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:07:30.803841] [WARN ] [REMOTE ] PVL: No data returned for month 2025-10 [2025-10-01T21:07:30.803946] [FATAL] [REMOTE ] PVL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:07:30.804034] [FATAL] [MAIN ] PVL: Failed to fetch primary data. [2025-10-01T21:07:30.804074] [WARN ] [MAIN ] PVL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:07:30.804144] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-01T21:07:30.804256] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-01T21:07:30.804321] [INFO ] [LOCAL ] PVL: Starting deletion of derivative data. [2025-10-01T21:07:30.804639] [DEBUG] [LOCAL ] PVL: Deleted derivative data file. [2025-10-01T21:07:30.804757] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PVL took 27.9s. Estimated remaining: 1h 27m 14s. Rate: 7.1 symbols/min [2025-10-01T21:07:31.066564] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:07:31.098767] [DEBUG] [LOCAL ] QD: Loaded 27991 existing records from primary storage. [2025-10-01T21:07:31.099069] [INFO ] [MAIN ] QD: Loaded 27991 existing records. [2025-10-01T21:07:31.290671] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:07:31.290946] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-01T21:07:31.291004] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-01T21:07:31.291675] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-01T21:07:31.291738] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-01T21:07:31.307577] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-01T21:07:31.702576] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:07:32.102379] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-01T21:07:32.902392] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-01T21:07:33.702454] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-01T21:07:34.356877] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (3.05 seconds). [2025-10-01T21:07:34.408998] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T21:07:34.502374] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-01T21:07:35.031038] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T21:07:35.302380] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-01T21:07:35.644723] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T21:07:36.102404] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-01T21:07:36.134715] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T21:07:36.902431] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-01T21:07:37.702428] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-01T21:07:38.913934] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (6.81 seconds). [2025-10-01T21:07:38.925158] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-01T21:07:39.008113] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-10-01T21:07:39.191092] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T21:07:39.302388] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-01T21:07:39.517308] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-01T21:07:40.102381] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-01T21:07:40.902409] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-01T21:07:41.029562] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-01T21:07:41.458578] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T21:07:41.533835] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-01T21:07:41.702392] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-01T21:07:42.312997] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T21:07:42.502387] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-01T21:07:43.302376] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-01T21:07:43.700272] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-01T21:07:43.872560] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T21:07:44.102383] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-01T21:07:44.902416] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-01T21:07:45.405302] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-01T21:07:45.695240] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T21:07:45.703079] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-01T21:07:46.502409] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-01T21:07:46.753819] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T21:07:47.042799] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T21:07:47.302397] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-01T21:07:48.102428] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-01T21:07:48.833380] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T21:07:48.902388] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-01T21:07:49.309048] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-01T21:07:49.335732] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T21:07:49.702398] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-01T21:07:50.502357] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-01T21:07:50.673560] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-01T21:07:50.841671] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T21:07:51.302421] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-01T21:07:52.063317] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T21:07:52.102353] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-01T21:07:52.902368] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-01T21:07:53.282951] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T21:07:53.702385] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-01T21:07:53.995397] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-01T21:07:54.422197] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T21:07:54.502460] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-01T21:07:55.302448] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-01T21:07:55.632919] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T21:07:56.102382] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-01T21:07:56.668778] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T21:07:56.869346] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-01T21:07:56.902367] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-01T21:07:57.710203] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-01T21:07:57.715856] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:07:58.213812] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T21:07:58.502394] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-01T21:07:58.622489] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T21:07:58.695819] [DEBUG] [REMOTE ] PWR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:07:58.696149] [WARN ] [REMOTE ] PWR: No data returned for month 2025-10 [2025-10-01T21:07:58.696240] [FATAL] [REMOTE ] PWR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:07:58.696344] [FATAL] [MAIN ] PWR: Failed to fetch primary data. [2025-10-01T21:07:58.696420] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:07:58.696501] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-01T21:07:58.696581] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-01T21:07:58.696662] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-01T21:07:58.696736] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-01T21:07:58.696789] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PWR took 46.4s. Estimated remaining: 1h 27m 13s. Rate: 7.1 symbols/min [2025-10-01T21:07:58.882492] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:07:58.929301] [DEBUG] [LOCAL ] QGEN: Loaded 49069 existing records from primary storage. [2025-10-01T21:07:58.929619] [INFO ] [MAIN ] QGEN: Loaded 49069 existing records. [2025-10-01T21:07:59.120512] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:07:59.120751] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-01T21:07:59.120807] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-01T21:07:59.123074] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-01T21:07:59.123140] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-01T21:07:59.305549] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-01T21:07:59.499849] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:00.102383] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-01T21:08:00.902414] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-01T21:08:01.189617] [DEBUG] [REMOTE ] PX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:08:01.190045] [WARN ] [REMOTE ] PX: No data returned for month 2025-10 [2025-10-01T21:08:01.190161] [FATAL] [REMOTE ] PX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:08:01.190302] [FATAL] [MAIN ] PX: Failed to fetch primary data. [2025-10-01T21:08:01.190392] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:08:01.190478] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-01T21:08:01.190610] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-01T21:08:01.190712] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-01T21:08:01.191074] [DEBUG] [LOCAL ] PX: Deleted derivative data file. [2025-10-01T21:08:01.191184] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. PX took 32.9s. Estimated remaining: 1h 27m 2s. Rate: 7.1 symbols/min [2025-10-01T21:08:01.388448] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:08:01.440666] [DEBUG] [LOCAL ] QS: Loaded 53743 existing records from primary storage. [2025-10-01T21:08:01.441015] [INFO ] [MAIN ] QS: Loaded 53743 existing records. [2025-10-01T21:08:01.630623] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:08:01.631003] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-01T21:08:01.631061] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-01T21:08:01.632432] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-01T21:08:01.632498] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-01T21:08:01.706627] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-01T21:08:01.957620] [DEBUG] [REMOTE ] QD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:08:01.958709] [WARN ] [REMOTE ] QD: No data returned for month 2025-10 [2025-10-01T21:08:01.958925] [FATAL] [REMOTE ] QD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:08:02.014205] [FATAL] [MAIN ] QD: Failed to fetch primary data. [2025-10-01T21:08:02.094308] [WARN ] [MAIN ] QD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:08:02.094859] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-01T21:08:02.094966] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-01T21:08:02.095165] [INFO ] [LOCAL ] QD: Starting deletion of derivative data. [2025-10-01T21:08:02.094203] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:02.095731] [DEBUG] [LOCAL ] QD: Deleted derivative data file. [2025-10-01T21:08:02.110140] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QD took 31.3s. Estimated remaining: 1h 26m 51s. Rate: 7.1 symbols/min [2025-10-01T21:08:02.208385] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-01T21:08:02.327845] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:08:02.379687] [DEBUG] [LOCAL ] QSR: Loaded 52419 existing records from primary storage. [2025-10-01T21:08:02.380039] [INFO ] [MAIN ] QSR: Loaded 52419 existing records. [2025-10-01T21:08:02.505769] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-01T21:08:02.581342] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:08:02.582183] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-01T21:08:02.582439] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-01T21:08:02.595768] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-01T21:08:02.618566] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-01T21:08:02.668019] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-10-01T21:08:03.038131] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:03.302376] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-01T21:08:04.102387] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-01T21:08:04.902380] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-01T21:08:05.171529] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-01T21:08:05.702394] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-01T21:08:05.822427] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T21:08:05.937615] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-01T21:08:06.502393] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-01T21:08:06.957518] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T21:08:07.302388] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-01T21:08:07.452219] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T21:08:08.102363] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-01T21:08:08.179451] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-01T21:08:08.264273] [DEBUG] [REMOTE ] QBTS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:08:08.264678] [WARN ] [REMOTE ] QBTS: No data returned for month 2025-10 [2025-10-01T21:08:08.264791] [FATAL] [REMOTE ] QBTS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:08:08.264890] [FATAL] [MAIN ] QBTS: Failed to fetch primary data. [2025-10-01T21:08:08.264963] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:08:08.265051] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-01T21:08:08.265129] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-01T21:08:08.265174] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-01T21:08:08.265224] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-01T21:08:08.265300] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QBTS took 38.3s. Estimated remaining: 1h 26m 42s. Rate: 7.1 symbols/min [2025-10-01T21:08:08.902359] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-01T21:08:08.946574] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T21:08:09.702386] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-01T21:08:10.502486] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-01T21:08:10.912579] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-01T21:08:11.302403] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-01T21:08:11.516824] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T21:08:12.102394] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-01T21:08:12.241567] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T21:08:12.902383] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-01T21:08:13.685701] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-01T21:08:13.702340] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-01T21:08:13.982939] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T21:08:14.502386] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-01T21:08:14.645550] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T21:08:15.302369] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-01T21:08:16.073737] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-01T21:08:16.102361] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-01T21:08:16.150876] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T21:08:16.902366] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-01T21:08:17.177110] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T21:08:17.702381] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-01T21:08:18.332748] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-01T21:08:18.502366] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-01T21:08:18.594638] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T21:08:19.156181] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T21:08:19.302431] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-01T21:08:20.102386] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-01T21:08:20.862638] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T21:08:20.913239] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-01T21:08:20.916068] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-01T21:08:21.702341] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-01T21:08:21.819864] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T21:08:22.502429] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-01T21:08:22.895964] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-01T21:08:23.302374] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-01T21:08:24.412601] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T21:08:24.424911] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-01T21:08:24.596918] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-01T21:08:24.902402] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-01T21:08:25.221116] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T21:08:25.702427] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-01T21:08:26.033178] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T21:08:26.502404] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-01T21:08:27.441323] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T21:08:27.453271] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-01T21:08:27.500593] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-01T21:08:27.781202] [DEBUG] [REMOTE ] QSR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:08:27.781551] [WARN ] [REMOTE ] QSR: No data returned for month 2025-10 [2025-10-01T21:08:27.781681] [FATAL] [REMOTE ] QSR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:08:27.781806] [FATAL] [MAIN ] QSR: Failed to fetch primary data. [2025-10-01T21:08:27.781879] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:08:27.781961] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-01T21:08:27.782056] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-01T21:08:27.782129] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-01T21:08:27.782624] [DEBUG] [LOCAL ] QSR: Deleted derivative data file. [2025-10-01T21:08:27.782769] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QSR took 25.7s. Estimated remaining: 1h 26m 37s. Rate: 7.1 symbols/min [2025-10-01T21:08:28.102443] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-01T21:08:28.268822] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T21:08:28.902390] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-01T21:08:29.138213] [DEBUG] [REMOTE ] QGEN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:08:29.138554] [WARN ] [REMOTE ] QGEN: No data returned for month 2025-10 [2025-10-01T21:08:29.138683] [FATAL] [REMOTE ] QGEN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:08:29.138788] [FATAL] [MAIN ] QGEN: Failed to fetch primary data. [2025-10-01T21:08:29.138856] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:08:29.138933] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-01T21:08:29.139003] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-01T21:08:29.139091] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-01T21:08:29.139435] [DEBUG] [LOCAL ] QGEN: Deleted derivative data file. [2025-10-01T21:08:29.139526] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QGEN took 30.4s. Estimated remaining: 1h 26m 26s. Rate: 7.1 symbols/min [2025-10-01T21:08:31.015521] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-01T21:08:31.028133] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-01T21:08:31.283370] [DEBUG] [REMOTE ] QS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:08:31.283724] [WARN ] [REMOTE ] QS: No data returned for month 2025-10 [2025-10-01T21:08:31.283813] [FATAL] [REMOTE ] QS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:08:31.283904] [FATAL] [MAIN ] QS: Failed to fetch primary data. [2025-10-01T21:08:31.283971] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:08:31.284043] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-01T21:08:31.284108] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-01T21:08:31.284145] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-01T21:08:31.284383] [DEBUG] [LOCAL ] QS: Deleted derivative data file. [2025-10-01T21:08:31.284474] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QS took 30.1s. Estimated remaining: 1h 26m 15s. Rate: 7.1 symbols/min [2025-10-01T21:08:32.016938] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:08:32.018174] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:08:31.997697] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:08:32.094451] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:08:32.104272] [DEBUG] [LOCAL ] QVCD: Loaded 4494 existing records from primary storage. [2025-10-01T21:08:32.104796] [INFO ] [MAIN ] QVCD: Loaded 4494 existing records. [2025-10-01T21:08:32.160980] [DEBUG] [LOCAL ] QUAD: Loaded 23347 existing records from primary storage. [2025-10-01T21:08:32.206336] [INFO ] [MAIN ] QUAD: Loaded 23347 existing records. [2025-10-01T21:08:32.231067] [DEBUG] [LOCAL ] QVCC: Loaded 8910 existing records from primary storage. [2025-10-01T21:08:32.299533] [INFO ] [MAIN ] QVCC: Loaded 8910 existing records. [2025-10-01T21:08:32.460812] [DEBUG] [LOCAL ] QTWO: Loaded 38997 existing records from primary storage. [2025-10-01T21:08:32.537484] [INFO ] [MAIN ] QTWO: Loaded 38997 existing records. [2025-10-01T21:08:32.538485] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:08:32.648074] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-01T21:08:32.675056] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-01T21:08:32.754737] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-01T21:08:32.837558] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-01T21:08:32.897117] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:08:32.930707] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-01T21:08:32.951338] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-01T21:08:32.980425] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-01T21:08:33.000892] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-01T21:08:33.082180] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:08:33.174792] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:08:33.196619] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-01T21:08:33.231859] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-01T21:08:33.249720] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-01T21:08:33.270336] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-01T21:08:33.294052] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-01T21:08:33.299148] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-01T21:08:33.304484] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-01T21:08:33.386271] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-01T21:08:34.246942] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:34.337893] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-01T21:08:34.469498] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:34.517451] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-01T21:08:34.626844] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:34.646590] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-01T21:08:34.734803] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:34.735137] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-01T21:08:35.488279] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T21:08:35.494157] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-01T21:08:35.518777] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T21:08:35.521793] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-01T21:08:35.531223] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T21:08:35.534677] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-01T21:08:35.971685] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T21:08:36.102443] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-01T21:08:36.154775] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-01T21:08:36.237616] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T21:08:36.456606] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-01T21:08:36.595058] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T21:08:36.902374] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-01T21:08:37.702435] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-01T21:08:38.508755] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-01T21:08:38.519945] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T21:08:38.932459] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-01T21:08:38.985862] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T21:08:39.302391] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-01T21:08:39.723826] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-01T21:08:40.102392] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-01T21:08:40.850744] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T21:08:40.902372] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-01T21:08:41.702379] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-01T21:08:42.286281] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T21:08:42.321368] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T21:08:42.502405] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-01T21:08:43.302415] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-01T21:08:43.879307] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T21:08:44.027053] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T21:08:44.102366] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-01T21:08:44.754706] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T21:08:44.902352] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-01T21:08:45.507058] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T21:08:45.702427] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-01T21:08:46.069512] [DEBUG] [REMOTE ] QVCD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:08:46.069931] [WARN ] [REMOTE ] QVCD: No data returned for month 2025-10 [2025-10-01T21:08:46.070031] [FATAL] [REMOTE ] QVCD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:08:46.070115] [FATAL] [MAIN ] QVCD: Failed to fetch primary data. [2025-10-01T21:08:46.070182] [WARN ] [MAIN ] QVCD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:08:46.070260] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-01T21:08:46.070359] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-01T21:08:46.070417] [INFO ] [LOCAL ] QVCD: Starting deletion of derivative data. [2025-10-01T21:08:46.070934] [DEBUG] [LOCAL ] QVCD: Deleted derivative data file. [2025-10-01T21:08:46.071025] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 14.8s. Estimated remaining: 1h 26m 9s. Rate: 7.1 symbols/min [2025-10-01T21:08:46.275313] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:08:46.364066] [DEBUG] [LOCAL ] QXO: Loaded 53245 existing records from primary storage. [2025-10-01T21:08:46.364519] [INFO ] [MAIN ] QXO: Loaded 53245 existing records. [2025-10-01T21:08:46.507585] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-01T21:08:46.678440] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:08:46.678722] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-01T21:08:46.678792] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-01T21:08:46.681279] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-01T21:08:46.681445] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-01T21:08:47.250500] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:08:47.265945] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T21:08:47.302445] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-01T21:08:48.102445] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-01T21:08:48.902369] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-01T21:08:49.094004] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T21:08:49.702438] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-01T21:08:49.737400] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T21:08:49.830324] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T21:08:50.502367] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-01T21:08:50.880097] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T21:08:51.302384] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-01T21:08:52.006797] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T21:08:52.102425] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-01T21:08:52.599155] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T21:08:52.887598] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T21:08:52.902373] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-01T21:08:53.704728] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-01T21:08:53.708739] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T21:08:54.502390] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-01T21:08:55.243915] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T21:08:55.302348] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-01T21:08:55.900687] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T21:08:56.102390] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-01T21:08:56.902357] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-01T21:08:56.950861] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T21:08:56.986373] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T21:08:57.702382] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-01T21:08:58.066366] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T21:08:58.502403] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-01T21:08:58.837226] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T21:08:59.302394] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-01T21:09:00.102420] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-01T21:09:00.391832] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-01T21:09:00.435219] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T21:09:00.902391] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-01T21:09:01.644037] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T21:09:01.707466] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-01T21:09:01.717901] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T21:09:02.502381] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-01T21:09:03.279216] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T21:09:03.302339] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-01T21:09:03.334797] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T21:09:03.890828] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T21:09:04.102380] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-01T21:09:04.902407] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-01T21:09:05.682856] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T21:09:05.702360] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-01T21:09:05.987091] [DEBUG] [REMOTE ] QTWO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:09:05.987409] [WARN ] [REMOTE ] QTWO: No data returned for month 2025-10 [2025-10-01T21:09:05.987500] [FATAL] [REMOTE ] QTWO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:09:05.987584] [FATAL] [MAIN ] QTWO: Failed to fetch primary data. [2025-10-01T21:09:05.987670] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:09:05.987743] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-01T21:09:05.987807] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-01T21:09:05.987843] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-01T21:09:05.991617] [DEBUG] [LOCAL ] QTWO: Deleted derivative data file. [2025-10-01T21:09:05.991772] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QTWO took 34.7s. Estimated remaining: 1h 26m 5s. Rate: 7.1 symbols/min [2025-10-01T21:09:06.120576] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T21:09:06.200220] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:09:06.233366] [DEBUG] [LOCAL ] R: Loaded 29054 existing records from primary storage. [2025-10-01T21:09:06.233846] [INFO ] [MAIN ] R: Loaded 29054 existing records. [2025-10-01T21:09:06.421289] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:09:06.421492] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-01T21:09:06.421540] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-01T21:09:06.422818] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-10-01T21:09:06.422879] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-01T21:09:06.507510] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-01T21:09:06.833638] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:09:07.302384] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-01T21:09:07.515173] [DEBUG] [REMOTE ] QUAD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:09:07.515546] [WARN ] [REMOTE ] QUAD: No data returned for month 2025-10 [2025-10-01T21:09:07.515665] [FATAL] [REMOTE ] QUAD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:09:07.515770] [FATAL] [MAIN ] QUAD: Failed to fetch primary data. [2025-10-01T21:09:07.515837] [WARN ] [MAIN ] QUAD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:09:07.515910] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-01T21:09:07.515977] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-01T21:09:07.516016] [INFO ] [LOCAL ] QUAD: Starting deletion of derivative data. [2025-10-01T21:09:07.516303] [DEBUG] [LOCAL ] QUAD: Deleted derivative data file. [2025-10-01T21:09:07.516396] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 36.2s. Estimated remaining: 1h 25m 54s. Rate: 7.1 symbols/min [2025-10-01T21:09:07.716452] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:09:07.740778] [DEBUG] [LOCAL ] RA: Loaded 21757 existing records from primary storage. [2025-10-01T21:09:07.741059] [INFO ] [MAIN ] RA: Loaded 21757 existing records. [2025-10-01T21:09:07.943456] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:09:07.943714] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-01T21:09:07.943773] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-01T21:09:07.945119] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-01T21:09:07.945183] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-01T21:09:08.107536] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-01T21:09:08.366528] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:09:08.548492] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T21:09:08.902383] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-01T21:09:09.381052] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T21:09:09.702391] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-01T21:09:09.834685] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T21:09:10.502396] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-01T21:09:10.702513] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T21:09:11.302374] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-01T21:09:11.656298] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:09:12.102383] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-01T21:09:12.743104] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T21:09:12.902392] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-01T21:09:12.919944] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T21:09:13.702395] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-01T21:09:13.911265] [DEBUG] [REMOTE ] QVCC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:09:13.911684] [WARN ] [REMOTE ] QVCC: No data returned for month 2025-10 [2025-10-01T21:09:13.911799] [FATAL] [REMOTE ] QVCC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:09:13.911924] [FATAL] [MAIN ] QVCC: Failed to fetch primary data. [2025-10-01T21:09:13.912008] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:09:13.912080] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-01T21:09:13.912146] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-01T21:09:13.912185] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-01T21:09:13.912638] [DEBUG] [LOCAL ] QVCC: Deleted derivative data file. [2025-10-01T21:09:13.912825] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QVCC took 42.6s. Estimated remaining: 1h 25m 45s. Rate: 7.1 symbols/min [2025-10-01T21:09:14.119068] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:09:14.162843] [DEBUG] [LOCAL ] RACE: Loaded 32575 existing records from primary storage. [2025-10-01T21:09:14.163169] [INFO ] [MAIN ] RACE: Loaded 32575 existing records. [2025-10-01T21:09:14.381930] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:09:14.390409] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-01T21:09:14.403545] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-01T21:09:14.405569] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-01T21:09:14.405507] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T21:09:14.405838] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-01T21:09:14.507517] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-01T21:09:14.853841] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:09:15.302383] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-01T21:09:15.778088] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T21:09:16.102389] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-01T21:09:16.711294] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T21:09:16.902369] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-01T21:09:17.702353] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-01T21:09:18.151144] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-01T21:09:18.371241] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T21:09:18.473030] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T21:09:18.502352] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-01T21:09:19.302352] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-01T21:09:19.653304] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T21:09:20.102409] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-01T21:09:20.902339] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-01T21:09:21.084340] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T21:09:21.688458] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T21:09:21.702340] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-01T21:09:21.970304] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T21:09:22.502443] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-01T21:09:23.128802] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T21:09:23.302394] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-01T21:09:24.102384] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-01T21:09:24.439087] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T21:09:24.515044] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-01T21:09:24.902392] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-01T21:09:25.702433] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-01T21:09:25.904527] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T21:09:26.502380] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-01T21:09:26.933890] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T21:09:27.302389] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-01T21:09:27.345227] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-01T21:09:28.102391] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-01T21:09:28.339887] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T21:09:28.749841] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:09:28.902415] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-01T21:09:29.437068] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T21:09:29.702437] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-01T21:09:30.502353] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-01T21:09:30.697301] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T21:09:30.745945] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T21:09:31.302369] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-01T21:09:32.102402] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-01T21:09:32.531481] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-01T21:09:32.558347] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T21:09:32.902345] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-01T21:09:33.115035] [DEBUG] [REMOTE ] R: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:09:33.115331] [WARN ] [REMOTE ] R: No data returned for month 2025-10 [2025-10-01T21:09:33.115422] [FATAL] [REMOTE ] R: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:09:33.115533] [FATAL] [MAIN ] R: Failed to fetch primary data. [2025-10-01T21:09:33.115631] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:09:33.115726] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-01T21:09:33.115791] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-01T21:09:33.115827] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-01T21:09:33.116192] [DEBUG] [LOCAL ] R: Deleted derivative data file. [2025-10-01T21:09:33.116292] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. R took 27.1s. Estimated remaining: 1h 25m 40s. Rate: 7.1 symbols/min [2025-10-01T21:09:33.305238] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:09:33.320075] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T21:09:33.360918] [DEBUG] [LOCAL ] RAMP: Loaded 37507 existing records from primary storage. [2025-10-01T21:09:33.361252] [INFO ] [MAIN ] RAMP: Loaded 37507 existing records. [2025-10-01T21:09:33.552129] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:09:33.552334] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-01T21:09:33.552383] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-01T21:09:33.553872] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-10-01T21:09:33.553935] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-01T21:09:33.707519] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-01T21:09:33.942051] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:09:34.502402] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-01T21:09:35.013444] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T21:09:35.302428] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-01T21:09:35.570576] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T21:09:36.102405] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-01T21:09:36.687880] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T21:09:36.902369] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-01T21:09:37.327074] [DEBUG] [REMOTE ] RA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:09:37.327405] [WARN ] [REMOTE ] RA: No data returned for month 2025-10 [2025-10-01T21:09:37.327501] [FATAL] [REMOTE ] RA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:09:37.327586] [FATAL] [MAIN ] RA: Failed to fetch primary data. [2025-10-01T21:09:37.327681] [WARN ] [MAIN ] RA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:09:37.327758] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-01T21:09:37.327830] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-01T21:09:37.327869] [INFO ] [LOCAL ] RA: Starting deletion of derivative data. [2025-10-01T21:09:37.328302] [DEBUG] [LOCAL ] RA: Deleted derivative data file. [2025-10-01T21:09:37.328400] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RA took 29.8s. Estimated remaining: 1h 25m 30s. Rate: 7.1 symbols/min [2025-10-01T21:09:37.513411] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:09:37.563577] [DEBUG] [LOCAL ] RBA: Loaded 45858 existing records from primary storage. [2025-10-01T21:09:37.563910] [INFO ] [MAIN ] RBA: Loaded 45858 existing records. [2025-10-01T21:09:37.707497] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-01T21:09:37.766019] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:09:37.766724] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-01T21:09:37.766785] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-01T21:09:37.769134] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-10-01T21:09:37.769202] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-01T21:09:38.170520] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:09:38.204313] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-01T21:09:38.502401] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-01T21:09:39.237362] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T21:09:39.302393] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-01T21:09:40.102425] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-01T21:09:40.226827] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T21:09:40.857761] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T21:09:40.902358] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-01T21:09:41.590311] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T21:09:41.702393] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-01T21:09:41.985930] [DEBUG] [REMOTE ] QXO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:09:41.986256] [WARN ] [REMOTE ] QXO: No data returned for month 2025-10 [2025-10-01T21:09:41.986348] [FATAL] [REMOTE ] QXO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:09:41.986429] [FATAL] [MAIN ] QXO: Failed to fetch primary data. [2025-10-01T21:09:41.986493] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:09:41.986614] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-01T21:09:41.986720] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-01T21:09:41.986766] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-01T21:09:41.987084] [DEBUG] [LOCAL ] QXO: Deleted derivative data file. [2025-10-01T21:09:41.987184] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. QXO took 55.9s. Estimated remaining: 1h 25m 20s. Rate: 7.1 symbols/min [2025-10-01T21:09:42.173243] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:09:42.190981] [DEBUG] [LOCAL ] RBC: Loaded 15117 existing records from primary storage. [2025-10-01T21:09:42.191341] [INFO ] [MAIN ] RBC: Loaded 15117 existing records. [2025-10-01T21:09:42.388732] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:09:42.407333] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-01T21:09:42.407510] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-01T21:09:42.408943] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T21:09:42.409007] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-10-01T21:09:42.409231] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-01T21:09:42.507542] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-01T21:09:42.818045] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:09:43.302383] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-01T21:09:44.022271] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T21:09:44.102378] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-01T21:09:44.452788] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T21:09:44.902366] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-01T21:09:45.581590] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T21:09:45.702377] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-01T21:09:45.983234] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T21:09:46.502370] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-01T21:09:47.302352] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-01T21:09:47.337894] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T21:09:47.572288] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T21:09:48.102377] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-01T21:09:48.888040] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T21:09:48.902327] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-01T21:09:49.197334] [DEBUG] [REMOTE ] RACE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:09:49.197694] [WARN ] [REMOTE ] RACE: No data returned for month 2025-10 [2025-10-01T21:09:49.197790] [FATAL] [REMOTE ] RACE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:09:49.197889] [FATAL] [MAIN ] RACE: Failed to fetch primary data. [2025-10-01T21:09:49.197985] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:09:49.198063] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-01T21:09:49.198132] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-01T21:09:49.198209] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-01T21:09:49.198468] [DEBUG] [LOCAL ] RACE: Deleted derivative data file. [2025-10-01T21:09:49.198567] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RACE took 35.3s. Estimated remaining: 1h 25m 11s. Rate: 7.1 symbols/min [2025-10-01T21:09:49.397136] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:09:49.454325] [DEBUG] [LOCAL ] RBLX: Loaded 53716 existing records from primary storage. [2025-10-01T21:09:49.454751] [INFO ] [MAIN ] RBLX: Loaded 53716 existing records. [2025-10-01T21:09:49.661352] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:09:49.661551] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-01T21:09:49.661601] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-01T21:09:49.664059] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-10-01T21:09:49.664127] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-01T21:09:49.712625] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-01T21:09:50.021857] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T21:09:50.117972] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:09:50.502348] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-01T21:09:50.825148] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T21:09:51.302382] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-01T21:09:52.102365] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-01T21:09:52.172601] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T21:09:52.881363] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T21:09:52.902339] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-01T21:09:53.285222] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T21:09:53.702404] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-01T21:09:54.017274] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T21:09:54.502415] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-01T21:09:55.308156] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-01T21:09:55.325506] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:09:56.102458] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-01T21:09:56.129378] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T21:09:56.766764] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-01T21:09:56.902399] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-01T21:09:57.702381] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-01T21:09:57.858084] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T21:09:57.922237] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T21:09:58.502379] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-01T21:09:58.721424] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T21:09:59.302390] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-01T21:10:00.102396] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-01T21:10:00.325760] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T21:10:00.417173] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T21:10:00.902402] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-01T21:10:01.702394] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-01T21:10:02.292155] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-01T21:10:02.507579] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-01T21:10:02.538575] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T21:10:03.222734] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T21:10:03.302385] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-01T21:10:03.613634] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T21:10:04.102380] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-01T21:10:04.902410] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-01T21:10:04.931689] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T21:10:05.289124] [DEBUG] [REMOTE ] RBC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:10:05.289539] [WARN ] [REMOTE ] RBC: No data returned for month 2025-10 [2025-10-01T21:10:05.289715] [FATAL] [REMOTE ] RBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:10:05.289849] [FATAL] [MAIN ] RBC: Failed to fetch primary data. [2025-10-01T21:10:05.289935] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:10:05.290028] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-01T21:10:05.290112] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-01T21:10:05.290163] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-01T21:10:05.290665] [DEBUG] [LOCAL ] RBC: Deleted derivative data file. [2025-10-01T21:10:05.290781] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RBC took 23.3s. Estimated remaining: 1h 25m 5s. Rate: 7.1 symbols/min [2025-10-01T21:10:05.533101] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:10:05.540856] [DEBUG] [LOCAL ] RBOT: Loaded 5197 existing records from primary storage. [2025-10-01T21:10:05.541086] [INFO ] [MAIN ] RBOT: Loaded 5197 existing records. [2025-10-01T21:10:05.709842] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-01T21:10:05.752318] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:10:05.753917] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-01T21:10:05.754151] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-01T21:10:05.754553] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-01T21:10:05.754623] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-01T21:10:06.097171] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T21:10:06.189223] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:10:06.502395] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-01T21:10:07.302380] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-01T21:10:08.001462] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-01T21:10:08.107528] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-01T21:10:08.124703] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T21:10:08.231801] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T21:10:08.356155] [DEBUG] [REMOTE ] RAMP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:10:08.356478] [WARN ] [REMOTE ] RAMP: No data returned for month 2025-10 [2025-10-01T21:10:08.356576] [FATAL] [REMOTE ] RAMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:10:08.356709] [FATAL] [MAIN ] RAMP: Failed to fetch primary data. [2025-10-01T21:10:08.356778] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:10:08.356849] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-01T21:10:08.356914] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-01T21:10:08.356951] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-01T21:10:08.357334] [DEBUG] [LOCAL ] RAMP: Deleted derivative data file. [2025-10-01T21:10:08.357434] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RAMP took 35.2s. Estimated remaining: 1h 24m 55s. Rate: 7.1 symbols/min [2025-10-01T21:10:08.544110] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:10:08.600493] [DEBUG] [LOCAL ] RBRK: Loaded 53132 existing records from primary storage. [2025-10-01T21:10:08.600900] [INFO ] [MAIN ] RBRK: Loaded 53132 existing records. [2025-10-01T21:10:08.789717] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:10:08.789997] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-01T21:10:08.790057] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-01T21:10:08.791282] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-01T21:10:08.791344] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-01T21:10:08.907491] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-01T21:10:09.199424] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:10:09.702393] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-01T21:10:10.502424] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-01T21:10:10.689047] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T21:10:10.718805] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T21:10:11.302390] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-01T21:10:12.102411] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-01T21:10:12.859992] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-01T21:10:12.902346] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-01T21:10:12.939805] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T21:10:13.018505] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T21:10:13.702375] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-01T21:10:14.009591] [DEBUG] [REMOTE ] RBA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:10:14.009979] [WARN ] [REMOTE ] RBA: No data returned for month 2025-10 [2025-10-01T21:10:14.010093] [FATAL] [REMOTE ] RBA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:10:14.010222] [FATAL] [MAIN ] RBA: Failed to fetch primary data. [2025-10-01T21:10:14.010359] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:10:14.010435] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-01T21:10:14.010514] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-01T21:10:14.010572] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-01T21:10:14.010900] [DEBUG] [LOCAL ] RBA: Deleted derivative data file. [2025-10-01T21:10:14.010991] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBA took 36.7s. Estimated remaining: 1h 24m 45s. Rate: 7.1 symbols/min [2025-10-01T21:10:14.220722] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:10:14.272179] [DEBUG] [LOCAL ] RC: Loaded 48947 existing records from primary storage. [2025-10-01T21:10:14.272494] [INFO ] [MAIN ] RC: Loaded 48947 existing records. [2025-10-01T21:10:14.474264] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:10:14.474832] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-01T21:10:14.474895] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-01T21:10:14.476074] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-01T21:10:14.476139] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-01T21:10:14.509621] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-01T21:10:14.894636] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:10:15.225580] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-01T21:10:15.302381] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-01T21:10:16.102375] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-01T21:10:16.642949] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-01T21:10:16.766943] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T21:10:16.902321] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-01T21:10:17.462328] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-01T21:10:17.702400] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-01T21:10:17.730119] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T21:10:18.502423] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-01T21:10:19.302392] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-01T21:10:19.491041] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T21:10:19.913948] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T21:10:20.102371] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-01T21:10:20.522994] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T21:10:20.902370] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-01T21:10:21.432262] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T21:10:21.702417] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-01T21:10:22.286112] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-01T21:10:22.502441] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-01T21:10:22.583284] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T21:10:23.302388] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-01T21:10:23.310864] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T21:10:24.102848] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-01T21:10:24.685755] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T21:10:24.902379] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-01T21:10:25.047255] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T21:10:25.702442] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-01T21:10:26.502453] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-01T21:10:27.302568] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-01T21:10:27.480201] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T21:10:27.603690] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-01T21:10:27.927398] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T21:10:28.102378] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-01T21:10:28.345116] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:10:28.365161] [DEBUG] [REMOTE ] RBOT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:10:28.365471] [WARN ] [REMOTE ] RBOT: No data returned for month 2025-10 [2025-10-01T21:10:28.365612] [FATAL] [REMOTE ] RBOT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:10:28.365730] [FATAL] [MAIN ] RBOT: Failed to fetch primary data. [2025-10-01T21:10:28.365800] [WARN ] [MAIN ] RBOT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:10:28.365894] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-01T21:10:28.366038] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-01T21:10:28.366095] [INFO ] [LOCAL ] RBOT: Starting deletion of derivative data. [2025-10-01T21:10:28.366518] [DEBUG] [LOCAL ] RBOT: Deleted derivative data file. [2025-10-01T21:10:28.366637] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBOT took 23.1s. Estimated remaining: 1h 24m 39s. Rate: 7.1 symbols/min [2025-10-01T21:10:28.580402] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:10:28.580574] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-01T21:10:28.580614] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-01T21:10:28.580755] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-01T21:10:28.580802] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-01T21:10:28.580849] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-01T21:10:28.580894] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-01T21:10:28.907459] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-01T21:10:28.978888] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:10:29.702416] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-01T21:10:30.502429] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-01T21:10:31.302397] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-01T21:10:31.311581] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T21:10:31.358171] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-01T21:10:31.567447] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T21:10:32.102446] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-01T21:10:32.701311] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T21:10:32.902385] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-01T21:10:33.344960] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T21:10:33.702449] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-01T21:10:34.322124] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T21:10:34.502447] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-01T21:10:35.225806] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-01T21:10:35.302357] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-01T21:10:35.472094] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T21:10:35.992098] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T21:10:36.102387] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-01T21:10:36.902377] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-01T21:10:37.702416] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-01T21:10:38.381569] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T21:10:38.502364] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-01T21:10:38.613145] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-01T21:10:38.990876] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-01T21:10:39.302372] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-01T21:10:39.504745] [DEBUG] [REMOTE ] RBLX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:10:39.505107] [WARN ] [REMOTE ] RBLX: No data returned for month 2025-10 [2025-10-01T21:10:39.505198] [FATAL] [REMOTE ] RBLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:10:39.505292] [FATAL] [MAIN ] RBLX: Failed to fetch primary data. [2025-10-01T21:10:39.505382] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:10:39.505472] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-01T21:10:39.505580] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-01T21:10:39.505672] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-01T21:10:39.506175] [DEBUG] [LOCAL ] RBLX: Deleted derivative data file. [2025-10-01T21:10:39.506307] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBLX took 50.3s. Estimated remaining: 1h 24m 31s. Rate: 7.1 symbols/min [2025-10-01T21:10:39.722074] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:10:39.722290] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-01T21:10:39.722347] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-01T21:10:39.722462] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-01T21:10:39.722512] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-01T21:10:39.722557] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-01T21:10:39.722591] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-01T21:10:40.115724] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-01T21:10:40.121906] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:10:40.196006] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T21:10:40.628238] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T21:10:40.902373] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-01T21:10:41.697491] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T21:10:41.702332] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-01T21:10:42.254344] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T21:10:42.502390] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-01T21:10:43.019025] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-01T21:10:43.302440] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-01T21:10:44.102379] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-01T21:10:44.533624] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-01T21:10:44.902363] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-01T21:10:45.112590] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T21:10:45.702420] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-01T21:10:46.389466] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-01T21:10:46.502424] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-01T21:10:46.593126] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T21:10:46.943363] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T21:10:47.302385] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-01T21:10:48.102448] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-01T21:10:48.902421] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-01T21:10:49.152232] [DEBUG] [REMOTE ] RCB: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:10:49.152596] [WARN ] [REMOTE ] RCB: No data returned for month 2025-10 [2025-10-01T21:10:49.152724] [FATAL] [REMOTE ] RCB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:10:49.152813] [FATAL] [MAIN ] RCB: Failed to fetch primary data. [2025-10-01T21:10:49.152877] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:10:49.152930] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-01T21:10:49.153019] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-01T21:10:49.153077] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-01T21:10:49.153124] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-01T21:10:49.153200] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RCB took 20.8s. Estimated remaining: 1h 24m 23s. Rate: 7.1 symbols/min [2025-10-01T21:10:49.356157] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:10:49.407350] [DEBUG] [LOCAL ] RCI: Loaded 48628 existing records from primary storage. [2025-10-01T21:10:49.407739] [INFO ] [MAIN ] RCI: Loaded 48628 existing records. [2025-10-01T21:10:49.639839] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:10:49.640501] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-01T21:10:49.640577] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-01T21:10:49.656565] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-01T21:10:49.669301] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-01T21:10:49.725116] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-01T21:10:49.726949] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T21:10:49.761575] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-01T21:10:50.170150] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:10:50.309560] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T21:10:50.502406] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-01T21:10:51.302418] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-01T21:10:52.102396] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-01T21:10:52.243172] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T21:10:52.903192] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-01T21:10:52.905229] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T21:10:53.109083] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T21:10:53.702420] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-01T21:10:54.149243] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-01T21:10:54.502364] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-01T21:10:55.238441] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-01T21:10:55.302415] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-01T21:10:55.611334] [DEBUG] [REMOTE ] RBRK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:10:55.611711] [WARN ] [REMOTE ] RBRK: No data returned for month 2025-10 [2025-10-01T21:10:55.611807] [FATAL] [REMOTE ] RBRK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:10:55.611930] [FATAL] [MAIN ] RBRK: Failed to fetch primary data. [2025-10-01T21:10:55.612004] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:10:55.612081] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-01T21:10:55.612170] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-01T21:10:55.612233] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-01T21:10:55.612747] [DEBUG] [LOCAL ] RBRK: Deleted derivative data file. [2025-10-01T21:10:55.612853] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RBRK took 47.3s. Estimated remaining: 1h 24m 14s. Rate: 7.1 symbols/min [2025-10-01T21:10:55.879191] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:10:55.879500] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-01T21:10:55.879630] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-01T21:10:55.879840] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-01T21:10:55.879945] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-01T21:10:55.880092] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-01T21:10:55.880157] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-01T21:10:56.104008] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-01T21:10:56.297202] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T21:10:56.373260] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:10:56.653014] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T21:10:56.902375] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-01T21:10:57.702416] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-01T21:10:58.311628] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T21:10:58.502396] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-01T21:10:58.650324] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T21:10:59.172496] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T21:10:59.302435] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-01T21:11:00.102387] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-01T21:11:00.330446] [DEBUG] [REMOTE ] RC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:11:00.330852] [WARN ] [REMOTE ] RC: No data returned for month 2025-10 [2025-10-01T21:11:00.330950] [FATAL] [REMOTE ] RC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:11:00.331034] [FATAL] [MAIN ] RC: Failed to fetch primary data. [2025-10-01T21:11:00.331101] [WARN ] [MAIN ] RC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:11:00.331178] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-01T21:11:00.331249] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-01T21:11:00.331291] [INFO ] [LOCAL ] RC: Starting deletion of derivative data. [2025-10-01T21:11:00.331561] [DEBUG] [LOCAL ] RC: Deleted derivative data file. [2025-10-01T21:11:00.331732] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RC took 46.3s. Estimated remaining: 1h 24m 4s. Rate: 7.1 symbols/min [2025-10-01T21:11:00.531383] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:11:00.548964] [DEBUG] [LOCAL ] RCS: Loaded 11474 existing records from primary storage. [2025-10-01T21:11:00.549176] [INFO ] [MAIN ] RCS: Loaded 11474 existing records. [2025-10-01T21:11:00.746005] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:11:00.746343] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-01T21:11:00.746420] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-01T21:11:00.747009] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-01T21:11:00.747086] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-01T21:11:00.911329] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-01T21:11:01.159529] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:11:01.190466] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T21:11:01.540908] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T21:11:01.702395] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-01T21:11:02.502454] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-01T21:11:02.848560] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T21:11:03.242518] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T21:11:03.302399] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-01T21:11:04.102389] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-01T21:11:04.902410] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-01T21:11:05.319945] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-01T21:11:05.338301] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T21:11:05.702376] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-01T21:11:06.400289] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T21:11:06.502364] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-01T21:11:06.596933] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T21:11:07.302388] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-01T21:11:07.397510] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T21:11:08.102383] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-01T21:11:08.362450] [DEBUG] [REMOTE ] RCD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:11:08.362840] [WARN ] [REMOTE ] RCD: No data returned for month 2025-10 [2025-10-01T21:11:08.362944] [FATAL] [REMOTE ] RCD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:11:08.363067] [FATAL] [MAIN ] RCD: Failed to fetch primary data. [2025-10-01T21:11:08.363140] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:11:08.363215] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-01T21:11:08.363283] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-01T21:11:08.363323] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-01T21:11:08.363365] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-01T21:11:08.363430] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCD took 28.9s. Estimated remaining: 1h 23m 56s. Rate: 7.1 symbols/min [2025-10-01T21:11:08.556391] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:11:08.601673] [DEBUG] [LOCAL ] RCUS: Loaded 42393 existing records from primary storage. [2025-10-01T21:11:08.602050] [INFO ] [MAIN ] RCUS: Loaded 42393 existing records. [2025-10-01T21:11:08.823219] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:11:08.824517] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-01T21:11:08.824606] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-01T21:11:08.825837] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-10-01T21:11:08.825930] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-01T21:11:08.911758] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-01T21:11:08.984579] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T21:11:09.285317] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:11:09.702379] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-01T21:11:09.979848] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T21:11:10.502384] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-01T21:11:11.200769] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T21:11:11.302396] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-01T21:11:12.102392] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-01T21:11:12.583879] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-01T21:11:12.691772] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T21:11:12.902341] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-01T21:11:12.986908] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T21:11:13.702410] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-01T21:11:14.502386] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-01T21:11:14.649999] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T21:11:14.962408] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-01T21:11:15.302418] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-01T21:11:15.906059] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T21:11:16.102442] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-01T21:11:16.841828] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T21:11:16.902388] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-01T21:11:17.702374] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-01T21:11:18.201761] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-01T21:11:18.440041] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T21:11:18.502373] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-01T21:11:18.579352] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T21:11:19.302389] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-01T21:11:20.102416] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-01T21:11:20.466925] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T21:11:20.902382] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-01T21:11:21.022092] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T21:11:21.702361] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-01T21:11:21.851727] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T21:11:22.184302] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-01T21:11:22.502400] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-01T21:11:23.102664] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T21:11:23.173860] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T21:11:23.302433] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-01T21:11:24.102429] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-01T21:11:24.902355] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-01T21:11:25.286913] [DEBUG] [REMOTE ] RCS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:11:25.287432] [WARN ] [REMOTE ] RCS: No data returned for month 2025-10 [2025-10-01T21:11:25.287528] [FATAL] [REMOTE ] RCS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:11:25.287665] [FATAL] [MAIN ] RCS: Failed to fetch primary data. [2025-10-01T21:11:25.287737] [WARN ] [MAIN ] RCS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:11:25.287829] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-01T21:11:25.287965] [DEBUG] [LOCAL ] RCS: No primary data file found to delete. [2025-10-01T21:11:25.288045] [INFO ] [LOCAL ] RCS: Starting deletion of derivative data. [2025-10-01T21:11:25.288773] [DEBUG] [LOCAL ] RCS: Deleted derivative data file. [2025-10-01T21:11:25.288899] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 25.0s. Estimated remaining: 1h 23m 50s. Rate: 7.1 symbols/min [2025-10-01T21:11:25.479866] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:11:25.517081] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-01T21:11:25.591920] [DEBUG] [LOCAL ] RDDT: Loaded 53780 existing records from primary storage. [2025-10-01T21:11:25.592308] [INFO ] [MAIN ] RDDT: Loaded 53780 existing records. [2025-10-01T21:11:25.709313] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-01T21:11:25.849130] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T21:11:25.847169] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:11:25.858975] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-01T21:11:25.859228] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-01T21:11:25.861226] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-10-01T21:11:25.861303] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-01T21:11:26.244351] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:11:26.502394] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-01T21:11:27.302357] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-01T21:11:27.735078] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-01T21:11:28.102403] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-01T21:11:28.902369] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-01T21:11:28.936520] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T21:11:29.085532] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-01T21:11:29.702424] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-01T21:11:29.759364] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T21:11:30.502366] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-01T21:11:31.012724] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-01T21:11:31.302422] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-01T21:11:32.103795] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-01T21:11:32.106720] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-01T21:11:32.301101] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T21:11:32.902376] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-01T21:11:33.131286] [DEBUG] [REMOTE ] RCI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:11:33.147824] [WARN ] [REMOTE ] RCI: No data returned for month 2025-10 [2025-10-01T21:11:33.148501] [FATAL] [REMOTE ] RCI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:11:33.149883] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T21:11:33.150167] [FATAL] [MAIN ] RCI: Failed to fetch primary data. [2025-10-01T21:11:33.160698] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:11:33.161231] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-01T21:11:33.161510] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-01T21:11:33.161561] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-01T21:11:33.162092] [DEBUG] [LOCAL ] RCI: Deleted derivative data file. [2025-10-01T21:11:33.162191] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCI took 44.0s. Estimated remaining: 1h 23m 41s. Rate: 7.1 symbols/min [2025-10-01T21:11:33.368278] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:11:33.416513] [DEBUG] [LOCAL ] RDN: Loaded 45113 existing records from primary storage. [2025-10-01T21:11:33.416877] [INFO ] [MAIN ] RDN: Loaded 45113 existing records. [2025-10-01T21:11:33.628830] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:11:33.629081] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-01T21:11:33.629132] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-01T21:11:33.630667] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-10-01T21:11:33.630733] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-01T21:11:33.703481] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-01T21:11:34.011657] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T21:11:34.101711] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:11:34.502384] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-01T21:11:34.796050] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T21:11:35.302404] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-01T21:11:35.570853] [DEBUG] [REMOTE ] RCL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:11:35.571168] [WARN ] [REMOTE ] RCL: No data returned for month 2025-10 [2025-10-01T21:11:35.571259] [FATAL] [REMOTE ] RCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:11:35.571343] [FATAL] [MAIN ] RCL: Failed to fetch primary data. [2025-10-01T21:11:35.571406] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:11:35.571479] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-01T21:11:35.571543] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-01T21:11:35.571580] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-01T21:11:35.571620] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-01T21:11:35.571713] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCL took 40.0s. Estimated remaining: 1h 23m 31s. Rate: 7.1 symbols/min [2025-10-01T21:11:35.764908] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:11:35.819212] [DEBUG] [LOCAL ] RDW: Loaded 52028 existing records from primary storage. [2025-10-01T21:11:35.819531] [INFO ] [MAIN ] RDW: Loaded 52028 existing records. [2025-10-01T21:11:36.014482] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:11:36.014964] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-01T21:11:36.015089] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-01T21:11:36.016078] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-01T21:11:36.016141] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-01T21:11:36.108505] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-01T21:11:36.328516] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T21:11:36.461862] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:11:36.902394] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-01T21:11:37.702452] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-01T21:11:38.502422] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-01T21:11:38.566918] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T21:11:38.694416] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-01T21:11:39.302394] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-01T21:11:39.350669] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T21:11:40.102404] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-01T21:11:40.214115] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T21:11:40.523353] [DEBUG] [REMOTE ] RCUS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:11:40.523793] [WARN ] [REMOTE ] RCUS: No data returned for month 2025-10 [2025-10-01T21:11:40.523903] [FATAL] [REMOTE ] RCUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:11:40.523998] [FATAL] [MAIN ] RCUS: Failed to fetch primary data. [2025-10-01T21:11:40.524072] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:11:40.524155] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-01T21:11:40.524260] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-01T21:11:40.524327] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-01T21:11:40.524790] [DEBUG] [LOCAL ] RCUS: Deleted derivative data file. [2025-10-01T21:11:40.524896] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RCUS took 32.2s. Estimated remaining: 1h 23m 21s. Rate: 7.1 symbols/min [2025-10-01T21:11:40.818463] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:11:40.893457] [DEBUG] [LOCAL ] RDY: Loaded 46821 existing records from primary storage. [2025-10-01T21:11:40.893893] [INFO ] [MAIN ] RDY: Loaded 46821 existing records. [2025-10-01T21:11:40.907564] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-01T21:11:41.115131] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:11:41.115427] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-01T21:11:41.115497] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-01T21:11:41.117816] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-01T21:11:41.117906] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-01T21:11:41.537210] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:11:41.702415] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-01T21:11:41.962414] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-01T21:11:42.502407] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-01T21:11:42.634448] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T21:11:43.302395] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-01T21:11:43.438090] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T21:11:44.102418] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-01T21:11:44.902380] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-01T21:11:44.940500] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T21:11:45.026426] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-01T21:11:45.702393] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-01T21:11:45.950557] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T21:11:46.502394] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-01T21:11:46.644260] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T21:11:47.302391] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-01T21:11:48.102383] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-01T21:11:48.380000] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-01T21:11:48.785266] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-01T21:11:48.902364] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-01T21:11:48.935590] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T21:11:49.702388] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-01T21:11:49.997281] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T21:11:50.502406] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-01T21:11:50.927411] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-01T21:11:51.302385] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-01T21:11:52.102353] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-01T21:11:52.162168] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T21:11:52.252832] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-01T21:11:52.902381] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-01T21:11:52.940114] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T21:11:53.702363] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-01T21:11:54.204051] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-01T21:11:54.502407] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-01T21:11:54.740515] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T21:11:54.975854] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T21:11:55.302399] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-01T21:11:56.102349] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-01T21:11:56.303783] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T21:11:56.907502] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-01T21:11:56.921621] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T21:11:57.702391] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-01T21:11:58.393490] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-01T21:11:58.502379] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-01T21:11:59.302386] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-01T21:11:59.360557] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T21:11:59.424622] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-01T21:12:00.102413] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-01T21:12:00.902366] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-01T21:12:01.226937] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-01T21:12:01.437223] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-01T21:12:01.702387] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-01T21:12:01.997001] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T21:12:02.502389] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-01T21:12:03.244536] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-01T21:12:03.302350] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-01T21:12:04.102373] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-01T21:12:04.230073] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T21:12:04.667985] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-01T21:12:04.902382] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-01T21:12:05.709409] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-01T21:12:05.712274] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T21:12:05.804436] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-01T21:12:05.857241] [DEBUG] [REMOTE ] RDDT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:05.857556] [WARN ] [REMOTE ] RDDT: No data returned for month 2025-10 [2025-10-01T21:12:05.857675] [FATAL] [REMOTE ] RDDT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:05.857768] [FATAL] [MAIN ] RDDT: Failed to fetch primary data. [2025-10-01T21:12:05.857838] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:05.857914] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-01T21:12:05.858024] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-01T21:12:05.858063] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-01T21:12:05.858555] [DEBUG] [LOCAL ] RDDT: Deleted derivative data file. [2025-10-01T21:12:05.858687] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDDT took 40.6s. Estimated remaining: 1h 23m 18s. Rate: 7.1 symbols/min [2025-10-01T21:12:06.041292] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:06.089628] [DEBUG] [LOCAL ] RELX: Loaded 47872 existing records from primary storage. [2025-10-01T21:12:06.089960] [INFO ] [MAIN ] RELX: Loaded 47872 existing records. [2025-10-01T21:12:06.290117] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:12:06.290326] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-01T21:12:06.290444] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-01T21:12:06.293077] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-01T21:12:06.293141] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-01T21:12:06.507542] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-01T21:12:06.736772] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:06.739366] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T21:12:07.302374] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-01T21:12:07.581863] [DEBUG] [REMOTE ] RDY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:07.582201] [WARN ] [REMOTE ] RDY: No data returned for month 2025-10 [2025-10-01T21:12:07.582296] [FATAL] [REMOTE ] RDY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:07.582411] [FATAL] [MAIN ] RDY: Failed to fetch primary data. [2025-10-01T21:12:07.582552] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:07.582667] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-01T21:12:07.582769] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-01T21:12:07.582828] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-01T21:12:07.583305] [DEBUG] [LOCAL ] RDY: Deleted derivative data file. [2025-10-01T21:12:07.583400] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDY took 27.1s. Estimated remaining: 1h 23m 8s. Rate: 7.1 symbols/min [2025-10-01T21:12:07.774314] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:07.814708] [DEBUG] [LOCAL ] RERE: Loaded 41062 existing records from primary storage. [2025-10-01T21:12:07.815033] [INFO ] [MAIN ] RERE: Loaded 41062 existing records. [2025-10-01T21:12:08.015789] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:12:08.016086] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-01T21:12:08.016141] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-01T21:12:08.018020] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-01T21:12:08.018082] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-01T21:12:08.108242] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-01T21:12:08.423139] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:08.902437] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-01T21:12:09.030975] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-01T21:12:09.491026] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T21:12:09.702458] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-01T21:12:10.502374] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-01T21:12:10.575410] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:12:10.821603] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T21:12:10.984455] [DEBUG] [REMOTE ] RDN: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:10.984819] [WARN ] [REMOTE ] RDN: No data returned for month 2025-10 [2025-10-01T21:12:10.984908] [FATAL] [REMOTE ] RDN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:10.984990] [FATAL] [MAIN ] RDN: Failed to fetch primary data. [2025-10-01T21:12:10.985050] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:10.985136] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-01T21:12:10.985200] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-01T21:12:10.985236] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-01T21:12:10.985526] [DEBUG] [LOCAL ] RDN: Deleted derivative data file. [2025-10-01T21:12:10.985630] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDN took 37.8s. Estimated remaining: 1h 22m 58s. Rate: 7.1 symbols/min [2025-10-01T21:12:11.175852] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:11.224078] [DEBUG] [LOCAL ] RES: Loaded 47433 existing records from primary storage. [2025-10-01T21:12:11.224485] [INFO ] [MAIN ] RES: Loaded 47433 existing records. [2025-10-01T21:12:11.307533] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-01T21:12:11.429717] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:12:11.429988] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-01T21:12:11.430046] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-01T21:12:11.431061] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-01T21:12:11.431122] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-01T21:12:11.822370] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:12.102398] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-01T21:12:12.355532] [DEBUG] [REMOTE ] RDW: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:12.355952] [WARN ] [REMOTE ] RDW: No data returned for month 2025-10 [2025-10-01T21:12:12.356042] [FATAL] [REMOTE ] RDW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:12.356132] [FATAL] [MAIN ] RDW: Failed to fetch primary data. [2025-10-01T21:12:12.356201] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:12.356275] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-01T21:12:12.356385] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-01T21:12:12.356459] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-01T21:12:12.356816] [DEBUG] [LOCAL ] RDW: Deleted derivative data file. [2025-10-01T21:12:12.356903] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RDW took 36.8s. Estimated remaining: 1h 22m 47s. Rate: 7.1 symbols/min [2025-10-01T21:12:12.563267] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:12.606277] [DEBUG] [LOCAL ] REVG: Loaded 40744 existing records from primary storage. [2025-10-01T21:12:12.606610] [INFO ] [MAIN ] REVG: Loaded 40744 existing records. [2025-10-01T21:12:12.799543] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:12:12.799846] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-01T21:12:12.799903] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-01T21:12:12.801427] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-01T21:12:12.801490] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-01T21:12:12.907568] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-01T21:12:13.219737] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:13.222756] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T21:12:13.702421] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-01T21:12:14.502448] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-01T21:12:14.643037] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T21:12:15.302373] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-01T21:12:15.494262] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-01T21:12:16.102384] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-01T21:12:16.132425] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T21:12:16.710793] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T21:12:16.902400] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-01T21:12:17.702409] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-01T21:12:17.968007] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T21:12:18.375485] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T21:12:18.502397] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-01T21:12:18.708106] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-01T21:12:19.302395] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-01T21:12:20.102403] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-01T21:12:20.280821] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T21:12:20.820812] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T21:12:20.902394] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-01T21:12:21.550264] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T21:12:21.702403] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-01T21:12:22.502363] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-01T21:12:22.711492] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T21:12:23.302394] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-01T21:12:23.466550] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T21:12:24.066627] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T21:12:24.102415] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-01T21:12:24.902392] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-01T21:12:25.175681] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T21:12:25.702385] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-01T21:12:25.949507] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T21:12:26.108591] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T21:12:26.502380] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-01T21:12:27.167638] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T21:12:27.302391] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-01T21:12:28.102364] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-01T21:12:28.271020] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T21:12:28.344035] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T21:12:28.902441] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-01T21:12:29.711050] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-01T21:12:29.733661] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T21:12:30.067011] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T21:12:30.502382] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-01T21:12:31.302377] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-01T21:12:31.373334] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T21:12:32.102452] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-01T21:12:32.198214] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:12:32.844693] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-01T21:12:32.902436] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-01T21:12:33.702467] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-01T21:12:33.909366] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T21:12:34.513895] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-01T21:12:34.526461] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T21:12:35.302422] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-01T21:12:35.620776] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T21:12:36.102379] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-01T21:12:36.178787] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T21:12:36.902385] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-01T21:12:37.108623] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T21:12:37.702371] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-01T21:12:37.782674] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T21:12:38.199529] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T21:12:38.502405] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-01T21:12:39.302498] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-01T21:12:39.388357] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T21:12:39.950723] [DEBUG] [REMOTE ] RELX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:39.951411] [WARN ] [REMOTE ] RELX: No data returned for month 2025-10 [2025-10-01T21:12:39.951606] [FATAL] [REMOTE ] RELX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:39.951765] [FATAL] [MAIN ] RELX: Failed to fetch primary data. [2025-10-01T21:12:39.951816] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:39.951859] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-01T21:12:39.951934] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-01T21:12:39.951993] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-01T21:12:39.952288] [DEBUG] [LOCAL ] RELX: Deleted derivative data file. [2025-10-01T21:12:39.952391] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RELX took 34.1s. Estimated remaining: 1h 22m 44s. Rate: 7.1 symbols/min [2025-10-01T21:12:40.112466] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-01T21:12:40.158508] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T21:12:40.192833] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:40.209664] [DEBUG] [LOCAL ] REX: Loaded 14075 existing records from primary storage. [2025-10-01T21:12:40.209943] [INFO ] [MAIN ] REX: Loaded 14075 existing records. [2025-10-01T21:12:40.403482] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:12:40.403735] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-01T21:12:40.403792] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-01T21:12:40.404500] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-10-01T21:12:40.404561] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-01T21:12:40.802869] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:40.902386] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-01T21:12:41.702392] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-01T21:12:41.895420] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T21:12:42.353073] [DEBUG] [REMOTE ] RERE: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:42.353462] [WARN ] [REMOTE ] RERE: No data returned for month 2025-10 [2025-10-01T21:12:42.353554] [FATAL] [REMOTE ] RERE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:42.353670] [FATAL] [MAIN ] RERE: Failed to fetch primary data. [2025-10-01T21:12:42.353744] [WARN ] [MAIN ] RERE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:42.353820] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-01T21:12:42.353902] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-01T21:12:42.353957] [INFO ] [LOCAL ] RERE: Starting deletion of derivative data. [2025-10-01T21:12:42.354280] [DEBUG] [LOCAL ] RERE: Deleted derivative data file. [2025-10-01T21:12:42.354381] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. RERE took 34.8s. Estimated remaining: 1h 22m 34s. Rate: 7.1 symbols/min [2025-10-01T21:12:42.508259] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-01T21:12:42.578483] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T21:12:42.576668] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:42.648511] [DEBUG] [LOCAL ] REXR: Loaded 52091 existing records from primary storage. [2025-10-01T21:12:42.649127] [INFO ] [MAIN ] REXR: Loaded 52091 existing records. [2025-10-01T21:12:42.841409] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:12:42.841687] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-01T21:12:42.841747] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-01T21:12:42.843782] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-10-01T21:12:42.843846] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-01T21:12:43.232264] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:43.302399] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-01T21:12:43.645151] [DEBUG] [REMOTE ] RES: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:43.645481] [WARN ] [REMOTE ] RES: No data returned for month 2025-10 [2025-10-01T21:12:43.645570] [FATAL] [REMOTE ] RES: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:43.645719] [FATAL] [MAIN ] RES: Failed to fetch primary data. [2025-10-01T21:12:43.645794] [WARN ] [MAIN ] RES: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:43.645868] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-01T21:12:43.645939] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-01T21:12:43.645986] [INFO ] [LOCAL ] RES: Starting deletion of derivative data. [2025-10-01T21:12:43.646442] [DEBUG] [LOCAL ] RES: Deleted derivative data file. [2025-10-01T21:12:43.646572] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. RES took 32.7s. Estimated remaining: 1h 22m 23s. Rate: 7.1 symbols/min [2025-10-01T21:12:43.801363] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T21:12:43.855311] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:43.905384] [DEBUG] [LOCAL ] REZI: Loaded 46920 existing records from primary storage. [2025-10-01T21:12:43.905815] [INFO ] [MAIN ] REZI: Loaded 46920 existing records. [2025-10-01T21:12:44.098492] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:12:44.098773] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-01T21:12:44.098834] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-01T21:12:44.100415] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-10-01T21:12:44.100477] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-01T21:12:44.111943] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-01T21:12:44.506913] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:44.902430] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-01T21:12:45.702410] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-01T21:12:45.839298] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T21:12:46.146563] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T21:12:46.502413] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-01T21:12:47.302433] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-01T21:12:47.378505] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T21:12:47.723457] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T21:12:48.102410] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-01T21:12:48.902360] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-01T21:12:49.077548] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T21:12:49.338315] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T21:12:49.654128] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T21:12:49.702354] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-01T21:12:50.502403] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-01T21:12:51.206257] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T21:12:51.302382] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-01T21:12:52.102374] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-01T21:12:52.133540] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T21:12:52.902386] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-01T21:12:53.101181] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T21:12:53.702400] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-01T21:12:53.828951] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T21:12:53.965118] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-01T21:12:54.502422] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-01T21:12:55.302374] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-01T21:12:55.450983] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T21:12:55.526515] [DEBUG] [REMOTE ] REVG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:12:55.526855] [WARN ] [REMOTE ] REVG: No data returned for month 2025-10 [2025-10-01T21:12:55.526949] [FATAL] [REMOTE ] REVG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:12:55.527095] [FATAL] [MAIN ] REVG: Failed to fetch primary data. [2025-10-01T21:12:55.527166] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:12:55.527247] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-01T21:12:55.527319] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-01T21:12:55.527360] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-01T21:12:55.527942] [DEBUG] [LOCAL ] REVG: Deleted derivative data file. [2025-10-01T21:12:55.528032] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REVG took 43.2s. Estimated remaining: 1h 22m 16s. Rate: 7.1 symbols/min [2025-10-01T21:12:55.712423] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:12:55.724987] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-01T21:12:55.725115] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-01T21:12:55.725901] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-01T21:12:55.726724] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-01T21:12:55.726588] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T21:12:55.731979] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-01T21:12:55.732079] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-01T21:12:56.107437] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-01T21:12:56.111504] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:12:56.902388] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-01T21:12:57.079455] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T21:12:57.702381] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-01T21:12:58.502370] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-01T21:12:58.742537] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T21:12:58.766912] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T21:12:59.302390] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-01T21:12:59.948822] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T21:13:00.006212] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T21:13:00.102370] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-01T21:13:00.902384] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-01T21:13:01.702462] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-01T21:13:01.969386] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T21:13:02.402794] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T21:13:02.502363] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-01T21:13:02.823506] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T21:13:03.302401] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-01T21:13:03.713744] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-01T21:13:04.102375] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-01T21:13:04.357263] [DEBUG] [REMOTE ] REX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:13:04.357596] [WARN ] [REMOTE ] REX: No data returned for month 2025-10 [2025-10-01T21:13:04.357747] [FATAL] [REMOTE ] REX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:13:04.357893] [FATAL] [MAIN ] REX: Failed to fetch primary data. [2025-10-01T21:13:04.357985] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:13:04.358077] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-01T21:13:04.358160] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-01T21:13:04.358201] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-01T21:13:04.358616] [DEBUG] [LOCAL ] REX: Deleted derivative data file. [2025-10-01T21:13:04.358737] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REX took 24.4s. Estimated remaining: 1h 22m 7s. Rate: 7.1 symbols/min [2025-10-01T21:13:04.545373] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:13:04.559030] [DEBUG] [LOCAL ] RFI: Loaded 10454 existing records from primary storage. [2025-10-01T21:13:04.559307] [INFO ] [MAIN ] RFI: Loaded 10454 existing records. [2025-10-01T21:13:04.752497] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:13:04.752750] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-01T21:13:04.752802] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-01T21:13:04.753188] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-01T21:13:04.753248] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-01T21:13:04.907491] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-01T21:13:05.143779] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:13:05.428446] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-01T21:13:05.702421] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-01T21:13:06.502406] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-01T21:13:06.813696] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T21:13:07.302386] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-01T21:13:07.589014] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T21:13:08.102343] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-01T21:13:08.246320] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T21:13:08.520133] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T21:13:08.902445] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-01T21:13:09.496589] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T21:13:09.629628] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T21:13:09.702359] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-01T21:13:10.502462] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-01T21:13:11.302460] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-01T21:13:11.707252] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-01T21:13:12.102389] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-01T21:13:12.508002] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T21:13:12.902369] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-01T21:13:12.938777] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T21:13:13.702354] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-01T21:13:13.888118] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T21:13:14.405754] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T21:13:14.502412] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-01T21:13:15.156840] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:13:15.302392] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-01T21:13:16.102414] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-01T21:13:16.508905] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-01T21:13:16.836439] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T21:13:16.902388] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-01T21:13:17.643634] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T21:13:17.702426] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-01T21:13:18.502392] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-01T21:13:18.743146] [DEBUG] [REMOTE ] REXR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:13:18.743468] [WARN ] [REMOTE ] REXR: No data returned for month 2025-10 [2025-10-01T21:13:18.743574] [FATAL] [REMOTE ] REXR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:13:18.743759] [FATAL] [MAIN ] REXR: Failed to fetch primary data. [2025-10-01T21:13:18.743866] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:13:18.743962] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-01T21:13:18.744084] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-01T21:13:18.744151] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-01T21:13:18.744582] [DEBUG] [LOCAL ] REXR: Deleted derivative data file. [2025-10-01T21:13:18.744764] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REXR took 36.4s. Estimated remaining: 1h 22m 1s. Rate: 7.1 symbols/min [2025-10-01T21:13:18.949430] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:13:19.000983] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T21:13:19.021379] [DEBUG] [LOCAL ] RFL: Loaded 11125 existing records from primary storage. [2025-10-01T21:13:19.021792] [INFO ] [MAIN ] RFL: Loaded 11125 existing records. [2025-10-01T21:13:19.229441] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:13:19.229689] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-01T21:13:19.229749] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-01T21:13:19.230176] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-01T21:13:19.230246] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-01T21:13:19.311635] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-01T21:13:19.650944] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:13:19.698361] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-01T21:13:20.102396] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-01T21:13:20.351270] [DEBUG] [REMOTE ] REZI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:13:20.351671] [WARN ] [REMOTE ] REZI: No data returned for month 2025-10 [2025-10-01T21:13:20.351817] [FATAL] [REMOTE ] REZI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:13:20.351964] [FATAL] [MAIN ] REZI: Failed to fetch primary data. [2025-10-01T21:13:20.352048] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:13:20.352137] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-01T21:13:20.352208] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-01T21:13:20.352248] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-01T21:13:20.352556] [DEBUG] [LOCAL ] REZI: Deleted derivative data file. [2025-10-01T21:13:20.352697] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. REZI took 36.7s. Estimated remaining: 1h 21m 50s. Rate: 7.1 symbols/min [2025-10-01T21:13:20.549428] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:13:20.556045] [DEBUG] [LOCAL ] RFM: Loaded 4155 existing records from primary storage. [2025-10-01T21:13:20.556267] [INFO ] [MAIN ] RFM: Loaded 4155 existing records. [2025-10-01T21:13:20.755476] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:13:20.755735] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-01T21:13:20.755790] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-01T21:13:20.756182] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-01T21:13:20.756242] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-01T21:13:20.910012] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-01T21:13:21.160235] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:13:21.192927] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T21:13:21.702356] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-01T21:13:21.861138] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T21:13:22.135712] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-01T21:13:22.502427] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-01T21:13:23.111919] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T21:13:23.302383] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-01T21:13:24.102386] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-01T21:13:24.227114] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T21:13:24.797878] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-01T21:13:24.902384] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-01T21:13:25.702415] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-01T21:13:25.871308] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T21:13:26.241344] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T21:13:26.502394] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-01T21:13:27.174136] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T21:13:27.302372] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-01T21:13:27.914607] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T21:13:28.102399] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-01T21:13:28.902408] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-01T21:13:28.928862] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T21:13:29.702369] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-01T21:13:29.838716] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T21:13:30.439357] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-01T21:13:30.502381] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-01T21:13:31.302425] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-01T21:13:31.485906] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T21:13:32.102416] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-01T21:13:32.157213] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-01T21:13:32.902430] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-01T21:13:33.602923] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T21:13:33.702396] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-01T21:13:34.056599] [DEBUG] [REMOTE ] RF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:13:34.057016] [WARN ] [REMOTE ] RF: No data returned for month 2025-10 [2025-10-01T21:13:34.057219] [FATAL] [REMOTE ] RF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:13:34.057333] [FATAL] [MAIN ] RF: Failed to fetch primary data. [2025-10-01T21:13:34.057402] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:13:34.057479] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-01T21:13:34.057744] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-01T21:13:34.057878] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-01T21:13:34.058231] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-01T21:13:34.058363] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RF took 38.5s. Estimated remaining: 1h 21m 43s. Rate: 7.1 symbols/min [2025-10-01T21:13:34.151568] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T21:13:34.297122] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:13:34.308185] [DEBUG] [LOCAL ] RFMZ: Loaded 8740 existing records from primary storage. [2025-10-01T21:13:34.308443] [INFO ] [MAIN ] RFMZ: Loaded 8740 existing records. [2025-10-01T21:13:34.498548] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:13:34.498829] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-01T21:13:34.498881] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-01T21:13:34.499323] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-01T21:13:34.499387] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-01T21:13:34.510752] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-01T21:13:34.903101] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:13:35.302382] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-01T21:13:35.555716] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T21:13:36.102403] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-01T21:13:36.242743] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T21:13:36.772526] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T21:13:36.902381] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-01T21:13:37.515313] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T21:13:37.702377] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-01T21:13:37.967850] [DEBUG] [REMOTE ] RFI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:13:37.968207] [WARN ] [REMOTE ] RFI: No data returned for month 2025-10 [2025-10-01T21:13:37.968333] [FATAL] [REMOTE ] RFI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:13:37.968442] [FATAL] [MAIN ] RFI: Failed to fetch primary data. [2025-10-01T21:13:37.968514] [WARN ] [MAIN ] RFI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:13:37.968593] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-01T21:13:37.968686] [DEBUG] [LOCAL ] RFI: No primary data file found to delete. [2025-10-01T21:13:37.968745] [INFO ] [LOCAL ] RFI: Starting deletion of derivative data. [2025-10-01T21:13:37.969057] [DEBUG] [LOCAL ] RFI: Deleted derivative data file. [2025-10-01T21:13:37.969159] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFI took 33.6s. Estimated remaining: 1h 21m 33s. Rate: 7.1 symbols/min [2025-10-01T21:13:38.171129] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:13:38.203914] [DEBUG] [LOCAL ] RGA: Loaded 29726 existing records from primary storage. [2025-10-01T21:13:38.204256] [INFO ] [MAIN ] RGA: Loaded 29726 existing records. [2025-10-01T21:13:38.425206] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:13:38.425439] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-01T21:13:38.425489] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-01T21:13:38.426352] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-10-01T21:13:38.426420] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-01T21:13:38.507498] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-01T21:13:38.895914] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:13:39.094811] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T21:13:39.302366] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-01T21:13:39.937507] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-01T21:13:40.102415] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-01T21:13:40.902459] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-01T21:13:41.113616] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T21:13:41.582765] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T21:13:41.702387] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-01T21:13:42.269410] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T21:13:42.502403] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-01T21:13:43.302359] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-01T21:13:43.443921] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T21:13:44.102380] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-01T21:13:44.716808] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T21:13:44.784146] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-01T21:13:44.902392] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-01T21:13:45.567373] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T21:13:45.702411] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-01T21:13:46.502400] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-01T21:13:47.187033] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T21:13:47.291126] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T21:13:47.302343] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-01T21:13:47.566445] [DEBUG] [REMOTE ] RFL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:13:47.566970] [WARN ] [REMOTE ] RFL: No data returned for month 2025-10 [2025-10-01T21:13:47.567059] [FATAL] [REMOTE ] RFL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:13:47.567159] [FATAL] [MAIN ] RFL: Failed to fetch primary data. [2025-10-01T21:13:47.567219] [WARN ] [MAIN ] RFL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:13:47.567288] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-01T21:13:47.567354] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-01T21:13:47.567392] [INFO ] [LOCAL ] RFL: Starting deletion of derivative data. [2025-10-01T21:13:47.567872] [DEBUG] [LOCAL ] RFL: Deleted derivative data file. [2025-10-01T21:13:47.568003] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFL took 28.8s. Estimated remaining: 1h 21m 25s. Rate: 7.1 symbols/min [2025-10-01T21:13:47.760597] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:13:47.783096] [DEBUG] [LOCAL ] RGR: Loaded 20604 existing records from primary storage. [2025-10-01T21:13:47.783351] [INFO ] [MAIN ] RGR: Loaded 20604 existing records. [2025-10-01T21:13:47.975586] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:13:47.975836] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-01T21:13:47.975893] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-01T21:13:47.977026] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-10-01T21:13:47.977099] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-01T21:13:48.107453] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-01T21:13:48.364490] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:13:48.813940] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-01T21:13:48.902382] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-01T21:13:49.690694] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T21:13:49.702370] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-01T21:13:50.502388] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-01T21:13:50.554830] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T21:13:51.302380] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-01T21:13:51.978873] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T21:13:52.004476] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T21:13:52.102374] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-01T21:13:52.632143] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-01T21:13:52.902364] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-01T21:13:53.676108] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T21:13:53.702376] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-01T21:13:54.313265] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T21:13:54.502388] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-01T21:13:55.302350] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-01T21:13:55.638240] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T21:13:56.102382] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-01T21:13:56.363397] [DEBUG] [REMOTE ] RFM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:13:56.363830] [WARN ] [REMOTE ] RFM: No data returned for month 2025-10 [2025-10-01T21:13:56.363924] [FATAL] [REMOTE ] RFM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:13:56.364006] [FATAL] [MAIN ] RFM: Failed to fetch primary data. [2025-10-01T21:13:56.364070] [WARN ] [MAIN ] RFM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:13:56.364145] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-01T21:13:56.364210] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-01T21:13:56.364246] [INFO ] [LOCAL ] RFM: Starting deletion of derivative data. [2025-10-01T21:13:56.364559] [DEBUG] [LOCAL ] RFM: Deleted derivative data file. [2025-10-01T21:13:56.364692] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RFM took 36.0s. Estimated remaining: 1h 21m 17s. Rate: 7.1 symbols/min [2025-10-01T21:13:56.565815] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:13:56.589134] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T21:13:56.591376] [DEBUG] [LOCAL ] RGT: Loaded 2785 existing records from primary storage. [2025-10-01T21:13:56.591744] [INFO ] [MAIN ] RGT: Loaded 2785 existing records. [2025-10-01T21:13:56.789824] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:13:56.790026] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-01T21:13:56.790076] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-01T21:13:56.790331] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-01T21:13:56.790394] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-01T21:13:56.907470] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-01T21:13:57.226631] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:13:57.702378] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-01T21:13:58.074804] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T21:13:58.490822] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T21:13:58.502379] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-01T21:13:59.117391] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T21:13:59.302381] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-01T21:14:00.102375] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-01T21:14:00.112573] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T21:14:00.689365] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T21:14:00.902380] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-01T21:14:01.702401] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-01T21:14:02.061291] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T21:14:02.502382] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-01T21:14:02.900880] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T21:14:03.302389] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-01T21:14:03.701062] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T21:14:03.806458] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-01T21:14:04.102394] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-01T21:14:04.714419] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T21:14:04.902406] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-01T21:14:05.702381] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-01T21:14:06.337396] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-01T21:14:06.477216] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T21:14:06.502371] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-01T21:14:07.258868] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T21:14:07.302367] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-01T21:14:07.931220] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T21:14:08.102398] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-01T21:14:08.902387] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-01T21:14:09.331729] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T21:14:09.503070] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T21:14:09.702403] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-01T21:14:09.978249] [DEBUG] [REMOTE ] RFMZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:09.978586] [WARN ] [REMOTE ] RFMZ: No data returned for month 2025-10 [2025-10-01T21:14:09.978698] [FATAL] [REMOTE ] RFMZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:09.978791] [FATAL] [MAIN ] RFMZ: Failed to fetch primary data. [2025-10-01T21:14:09.978856] [WARN ] [MAIN ] RFMZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:09.978928] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-01T21:14:09.979014] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-01T21:14:09.979069] [INFO ] [LOCAL ] RFMZ: Starting deletion of derivative data. [2025-10-01T21:14:09.979620] [DEBUG] [LOCAL ] RFMZ: Deleted derivative data file. [2025-10-01T21:14:09.979762] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RFMZ took 35.9s. Estimated remaining: 1h 21m 10s. Rate: 7.1 symbols/min [2025-10-01T21:14:10.502405] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-01T21:14:11.302392] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-01T21:14:11.765326] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-01T21:14:12.102384] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-01T21:14:12.644849] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T21:14:12.902434] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-01T21:14:13.378175] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-01T21:14:13.405310] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T21:14:13.702373] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-01T21:14:14.502409] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-01T21:14:14.816439] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T21:14:15.302432] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-01T21:14:15.659485] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-01T21:14:15.996135] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T21:14:16.102422] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-01T21:14:16.902421] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-01T21:14:17.410411] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-01T21:14:17.514549] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T21:14:17.702392] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-01T21:14:17.928146] [DEBUG] [REMOTE ] RGT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:17.928506] [WARN ] [REMOTE ] RGT: No data returned for month 2025-10 [2025-10-01T21:14:17.928669] [FATAL] [REMOTE ] RGT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:17.928835] [FATAL] [MAIN ] RGT: Failed to fetch primary data. [2025-10-01T21:14:17.928923] [WARN ] [MAIN ] RGT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:17.929019] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-01T21:14:17.929104] [DEBUG] [LOCAL ] RGT: No primary data file found to delete. [2025-10-01T21:14:17.929144] [INFO ] [LOCAL ] RGT: Starting deletion of derivative data. [2025-10-01T21:14:17.929441] [DEBUG] [LOCAL ] RGT: Deleted derivative data file. [2025-10-01T21:14:17.929534] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 21.6s. Estimated remaining: 1h 21m 1s. Rate: 7.1 symbols/min [2025-10-01T21:14:18.502433] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-01T21:14:18.761151] [DEBUG] [REMOTE ] RGA: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:18.761586] [WARN ] [REMOTE ] RGA: No data returned for month 2025-10 [2025-10-01T21:14:18.761706] [FATAL] [REMOTE ] RGA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:18.761796] [FATAL] [MAIN ] RGA: Failed to fetch primary data. [2025-10-01T21:14:18.761861] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:18.761931] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-01T21:14:18.761996] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-01T21:14:18.762032] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-01T21:14:18.762369] [DEBUG] [LOCAL ] RGA: Deleted derivative data file. [2025-10-01T21:14:18.762458] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGA took 40.8s. Estimated remaining: 1h 20m 51s. Rate: 7.1 symbols/min [2025-10-01T21:14:19.302406] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-01T21:14:20.442124] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T21:14:20.447528] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-01T21:14:21.580342] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T21:14:21.585556] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-01T21:14:22.854188] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T21:14:22.860880] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-01T21:14:23.071258] [DEBUG] [REMOTE ] RGR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:23.071601] [WARN ] [REMOTE ] RGR: No data returned for month 2025-10 [2025-10-01T21:14:23.071740] [FATAL] [REMOTE ] RGR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:23.071849] [FATAL] [MAIN ] RGR: Failed to fetch primary data. [2025-10-01T21:14:23.071919] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:23.071994] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-01T21:14:23.072061] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-01T21:14:23.072098] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-01T21:14:23.072500] [DEBUG] [LOCAL ] RGR: Deleted derivative data file. [2025-10-01T21:14:23.072592] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RGR took 35.5s. Estimated remaining: 1h 20m 41s. Rate: 7.1 symbols/min [2025-10-01T21:14:23.793929] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:23.822033] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:23.864630] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:23.887301] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:23.888167] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-01T21:14:23.890341] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-01T21:14:23.890842] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-01T21:14:23.890916] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-01T21:14:23.891003] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-01T21:14:23.891069] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-01T21:14:24.226771] [DEBUG] [LOCAL ] RHP: Loaded 41313 existing records from primary storage. [2025-10-01T21:14:24.267706] [INFO ] [MAIN ] RHP: Loaded 41313 existing records. [2025-10-01T21:14:24.296270] [DEBUG] [LOCAL ] RHI: Loaded 49260 existing records from primary storage. [2025-10-01T21:14:24.338781] [INFO ] [MAIN ] RHI: Loaded 49260 existing records. [2025-10-01T21:14:24.307783] [DEBUG] [LOCAL ] RH: Loaded 47576 existing records from primary storage. [2025-10-01T21:14:24.362571] [INFO ] [MAIN ] RH: Loaded 47576 existing records. [2025-10-01T21:14:24.809124] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:24.856473] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-01T21:14:24.989579] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:14:25.057799] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-01T21:14:25.064138] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:14:25.066778] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-01T21:14:25.066713] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-01T21:14:25.069769] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-01T21:14:25.071195] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:14:25.071548] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-01T21:14:25.071619] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-01T21:14:25.071814] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-01T21:14:25.071891] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-01T21:14:25.078208] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-10-01T21:14:25.090206] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-10-01T21:14:25.102104] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-01T21:14:25.090290] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-01T21:14:25.314412] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:25.465422] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-01T21:14:25.535982] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:25.544136] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-01T21:14:25.648403] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:25.799768] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-01T21:14:25.871565] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-01T21:14:25.966915] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-01T21:14:26.082489] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-01T21:14:26.119668] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 3.0s. Estimated remaining: 1h 20m 31s. Rate: 7.1 symbols/min [2025-10-01T21:14:26.231248] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:26.371480] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-01T21:14:26.366038] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:26.450574] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:26.445972] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-01T21:14:26.451050] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-01T21:14:26.530443] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:26.596865] [DEBUG] [LOCAL ] RIG: Loaded 53670 existing records from primary storage. [2025-10-01T21:14:26.597247] [INFO ] [MAIN ] RIG: Loaded 53670 existing records. [2025-10-01T21:14:26.798300] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:14:26.798509] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-01T21:14:26.798594] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-01T21:14:26.800663] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-01T21:14:26.800726] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-01T21:14:27.195959] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:27.196351] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-01T21:14:27.865569] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T21:14:27.876112] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-01T21:14:28.088764] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T21:14:28.096874] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-01T21:14:28.168722] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T21:14:28.177993] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-01T21:14:28.847695] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T21:14:28.902436] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-01T21:14:29.212821] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T21:14:29.431096] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T21:14:29.480258] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T21:14:29.702390] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-01T21:14:30.502386] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-01T21:14:30.920008] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T21:14:31.163287] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T21:14:31.302399] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-01T21:14:32.015942] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T21:14:32.102429] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-01T21:14:32.902391] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-01T21:14:33.091423] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T21:14:33.702399] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-01T21:14:33.875319] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T21:14:34.497944] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T21:14:34.507237] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-01T21:14:35.302352] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-01T21:14:35.503062] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T21:14:36.102349] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-01T21:14:36.585049] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-01T21:14:36.902362] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-01T21:14:37.077474] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T21:14:37.702397] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-01T21:14:38.024522] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T21:14:38.502401] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-01T21:14:38.706701] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T21:14:39.234694] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T21:14:39.302410] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-01T21:14:40.102359] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-01T21:14:40.185294] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:14:40.902413] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-01T21:14:41.259104] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T21:14:41.702358] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-01T21:14:41.906972] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T21:14:42.502356] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-01T21:14:42.668083] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T21:14:43.302436] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-01T21:14:43.358711] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T21:14:44.102408] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-01T21:14:44.469065] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-01T21:14:44.831948] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T21:14:44.902364] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-01T21:14:45.707548] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-01T21:14:45.718139] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:14:46.502351] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-01T21:14:46.781316] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T21:14:47.302382] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-01T21:14:47.483686] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T21:14:47.678105] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T21:14:48.102389] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-01T21:14:48.902364] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-01T21:14:49.351885] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-01T21:14:49.702383] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-01T21:14:49.875341] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T21:14:50.201389] [DEBUG] [REMOTE ] RH: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:50.201753] [WARN ] [REMOTE ] RH: No data returned for month 2025-10 [2025-10-01T21:14:50.201848] [FATAL] [REMOTE ] RH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:50.201948] [FATAL] [MAIN ] RH: Failed to fetch primary data. [2025-10-01T21:14:50.202069] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:50.202148] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-01T21:14:50.202215] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-01T21:14:50.202250] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-01T21:14:50.202530] [DEBUG] [LOCAL ] RH: Deleted derivative data file. [2025-10-01T21:14:50.202630] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RH took 27.1s. Estimated remaining: 1h 20m 27s. Rate: 7.1 symbols/min [2025-10-01T21:14:50.399906] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:50.455556] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-10-01T21:14:50.456172] [INFO ] [MAIN ] RIO: Loaded 53394 existing records. [2025-10-01T21:14:50.509678] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-01T21:14:50.570569] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T21:14:50.689758] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:14:50.689969] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-01T21:14:50.690019] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-01T21:14:50.692128] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-01T21:14:50.692205] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-01T21:14:51.108352] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:51.302404] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-01T21:14:52.102389] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-01T21:14:52.809463] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-01T21:14:52.902373] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-01T21:14:53.318943] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-01T21:14:53.625696] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T21:14:53.702387] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-01T21:14:53.980834] [DEBUG] [REMOTE ] RHP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:53.981193] [WARN ] [REMOTE ] RHP: No data returned for month 2025-10 [2025-10-01T21:14:53.981286] [FATAL] [REMOTE ] RHP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:53.981369] [FATAL] [MAIN ] RHP: Failed to fetch primary data. [2025-10-01T21:14:53.981431] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:53.981508] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-01T21:14:53.981574] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-01T21:14:53.981618] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-01T21:14:53.982019] [DEBUG] [LOCAL ] RHP: Deleted derivative data file. [2025-10-01T21:14:53.982118] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHP took 30.9s. Estimated remaining: 1h 20m 17s. Rate: 7.1 symbols/min [2025-10-01T21:14:54.185876] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:54.246685] [DEBUG] [LOCAL ] RITM: Loaded 52825 existing records from primary storage. [2025-10-01T21:14:54.246998] [INFO ] [MAIN ] RITM: Loaded 52825 existing records. [2025-10-01T21:14:54.444444] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:14:54.444688] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-01T21:14:54.444748] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-01T21:14:54.445931] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-01T21:14:54.445993] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-01T21:14:54.507096] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-01T21:14:54.851387] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:54.887838] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-01T21:14:55.302380] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-01T21:14:56.102368] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-01T21:14:56.358520] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T21:14:56.902409] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-01T21:14:57.419294] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T21:14:57.702389] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-01T21:14:57.739274] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T21:14:58.502361] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-01T21:14:58.968486] [DEBUG] [REMOTE ] RIG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:14:58.968845] [WARN ] [REMOTE ] RIG: No data returned for month 2025-10 [2025-10-01T21:14:58.968940] [FATAL] [REMOTE ] RIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:14:58.969036] [FATAL] [MAIN ] RIG: Failed to fetch primary data. [2025-10-01T21:14:58.969142] [WARN ] [MAIN ] RIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:14:58.969237] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-01T21:14:58.969433] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-01T21:14:58.969490] [INFO ] [LOCAL ] RIG: Starting deletion of derivative data. [2025-10-01T21:14:58.984921] [DEBUG] [LOCAL ] RIG: Deleted derivative data file. [2025-10-01T21:14:58.994361] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RIG took 32.9s. Estimated remaining: 1h 20m 7s. Rate: 7.1 symbols/min [2025-10-01T21:14:59.061198] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-01T21:14:59.206978] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:14:59.225518] [DEBUG] [LOCAL ] RIV: Loaded 12159 existing records from primary storage. [2025-10-01T21:14:59.225808] [INFO ] [MAIN ] RIV: Loaded 12159 existing records. [2025-10-01T21:14:59.311246] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-01T21:14:59.435862] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:14:59.436079] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-01T21:14:59.436130] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-01T21:14:59.436587] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-01T21:14:59.436687] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-01T21:14:59.833399] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:14:59.910143] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-01T21:15:00.102378] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-01T21:15:00.902381] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-01T21:15:01.380994] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-01T21:15:01.702384] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-01T21:15:01.871087] [DEBUG] [REMOTE ] RHI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:15:01.871396] [WARN ] [REMOTE ] RHI: No data returned for month 2025-10 [2025-10-01T21:15:01.871488] [FATAL] [REMOTE ] RHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:15:01.871571] [FATAL] [MAIN ] RHI: Failed to fetch primary data. [2025-10-01T21:15:01.871637] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:15:01.871736] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-01T21:15:01.871802] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-01T21:15:01.871841] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-01T21:15:01.872133] [DEBUG] [LOCAL ] RHI: Deleted derivative data file. [2025-10-01T21:15:01.872240] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RHI took 38.8s. Estimated remaining: 1h 19m 57s. Rate: 7.1 symbols/min [2025-10-01T21:15:02.068595] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:15:02.068887] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-01T21:15:02.068942] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-01T21:15:02.069052] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-01T21:15:02.069095] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-01T21:15:02.069137] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-01T21:15:02.069175] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-01T21:15:02.208213] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-01T21:15:02.503786] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-01T21:15:02.537519] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:15:03.008077] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-01T21:15:03.302403] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-01T21:15:03.552747] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T21:15:04.102386] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-01T21:15:04.902403] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-01T21:15:04.939737] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T21:15:05.345573] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-01T21:15:05.702386] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-01T21:15:06.466797] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T21:15:06.502369] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-01T21:15:07.302387] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-01T21:15:07.970473] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-01T21:15:08.102376] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-01T21:15:08.256319] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T21:15:08.356367] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T21:15:08.902428] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-01T21:15:09.702399] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-01T21:15:10.280754] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-01T21:15:10.477422] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T21:15:10.502378] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-01T21:15:10.574861] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T21:15:11.302381] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-01T21:15:12.102354] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-01T21:15:12.444479] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T21:15:12.902429] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-01T21:15:13.221310] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T21:15:13.222381] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T21:15:13.702400] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-01T21:15:14.502352] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-01T21:15:14.569621] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T21:15:14.769212] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T21:15:15.302424] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-01T21:15:16.102391] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-01T21:15:16.555767] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-01T21:15:16.902395] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-01T21:15:16.987493] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T21:15:17.702436] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-01T21:15:17.910251] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T21:15:18.502432] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-01T21:15:18.628234] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T21:15:19.302472] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-01T21:15:19.750783] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-01T21:15:20.102416] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-01T21:15:20.197570] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T21:15:20.902431] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-01T21:15:21.560180] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T21:15:21.658680] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-01T21:15:21.702359] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-01T21:15:22.065484] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-01T21:15:22.502426] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-01T21:15:23.302446] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-01T21:15:23.821817] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-01T21:15:24.102385] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-01T21:15:24.718828] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-01T21:15:24.770532] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T21:15:24.902434] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-01T21:15:25.702435] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-01T21:15:26.224390] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-01T21:15:26.502467] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-01T21:15:26.746980] [DEBUG] [REMOTE ] RIO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:15:26.747359] [WARN ] [REMOTE ] RIO: No data returned for month 2025-10 [2025-10-01T21:15:26.747481] [FATAL] [REMOTE ] RIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:15:26.747592] [FATAL] [MAIN ] RIO: Failed to fetch primary data. [2025-10-01T21:15:26.747692] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:15:26.747768] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-01T21:15:26.747883] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-01T21:15:26.747957] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-01T21:15:26.748461] [DEBUG] [LOCAL ] RIO: Deleted derivative data file. [2025-10-01T21:15:26.748567] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIO took 36.5s. Estimated remaining: 1h 19m 54s. Rate: 7.1 symbols/min [2025-10-01T21:15:26.959171] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:15:26.959684] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-01T21:15:26.960168] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-01T21:15:26.960802] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-01T21:15:26.961040] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-01T21:15:26.961389] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-01T21:15:26.978614] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-01T21:15:27.062275] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-01T21:15:27.307456] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-01T21:15:27.409369] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T21:15:27.520714] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:15:28.102460] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-01T21:15:28.902454] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-01T21:15:29.435754] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-01T21:15:29.702403] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-01T21:15:29.830100] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T21:15:30.004107] [DEBUG] [REMOTE ] RITM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:15:30.004487] [WARN ] [REMOTE ] RITM: No data returned for month 2025-10 [2025-10-01T21:15:30.004602] [FATAL] [REMOTE ] RITM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:15:30.004755] [FATAL] [MAIN ] RITM: Failed to fetch primary data. [2025-10-01T21:15:30.004844] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:15:30.004945] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-01T21:15:30.005049] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-01T21:15:30.005107] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-01T21:15:30.005356] [DEBUG] [LOCAL ] RITM: Deleted derivative data file. [2025-10-01T21:15:30.005467] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RITM took 36.0s. Estimated remaining: 1h 19m 44s. Rate: 7.1 symbols/min [2025-10-01T21:15:30.194755] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:15:30.194954] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-01T21:15:30.194992] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-01T21:15:30.195136] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-01T21:15:30.195204] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-01T21:15:30.195261] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-01T21:15:30.195297] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-01T21:15:30.504676] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-01T21:15:30.599341] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:15:30.913167] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-01T21:15:31.302437] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-01T21:15:31.548847] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T21:15:32.102396] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-01T21:15:32.357850] [DEBUG] [REMOTE ] RJF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:15:32.358216] [WARN ] [REMOTE ] RJF: No data returned for month 2025-10 [2025-10-01T21:15:32.358310] [FATAL] [REMOTE ] RJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:15:32.358397] [FATAL] [MAIN ] RJF: Failed to fetch primary data. [2025-10-01T21:15:32.358463] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:15:32.358536] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-01T21:15:32.358603] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-01T21:15:32.358667] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-01T21:15:32.358740] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-01T21:15:32.358791] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RJF took 30.5s. Estimated remaining: 1h 19m 33s. Rate: 7.1 symbols/min [2025-10-01T21:15:32.548336] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:15:32.583506] [DEBUG] [LOCAL ] RLI: Loaded 33400 existing records from primary storage. [2025-10-01T21:15:32.583882] [INFO ] [MAIN ] RLI: Loaded 33400 existing records. [2025-10-01T21:15:32.816432] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:15:32.816811] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-01T21:15:32.816872] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-01T21:15:32.825606] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-10-01T21:15:32.839295] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-01T21:15:32.906391] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-01T21:15:32.906288] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T21:15:33.271411] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:15:33.702445] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-01T21:15:34.502391] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-01T21:15:34.902775] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-01T21:15:34.904307] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T21:15:35.302428] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-01T21:15:35.470791] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-01T21:15:36.102422] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-01T21:15:36.902377] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-01T21:15:37.149349] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-01T21:15:37.702395] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-01T21:15:37.850587] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T21:15:38.126059] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T21:15:38.502395] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-01T21:15:39.216342] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T21:15:39.302386] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-01T21:15:40.103079] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-01T21:15:40.106025] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T21:15:40.689627] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T21:15:40.902422] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-01T21:15:41.702367] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-01T21:15:41.946260] [DEBUG] [REMOTE ] RIV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:15:41.946571] [WARN ] [REMOTE ] RIV: No data returned for month 2025-10 [2025-10-01T21:15:41.946687] [FATAL] [REMOTE ] RIV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:15:41.946778] [FATAL] [MAIN ] RIV: Failed to fetch primary data. [2025-10-01T21:15:41.946841] [WARN ] [MAIN ] RIV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:15:41.946915] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-01T21:15:41.946980] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-01T21:15:41.947015] [INFO ] [LOCAL ] RIV: Starting deletion of derivative data. [2025-10-01T21:15:41.947331] [DEBUG] [LOCAL ] RIV: Deleted derivative data file. [2025-10-01T21:15:41.947424] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RIV took 43.0s. Estimated remaining: 1h 19m 25s. Rate: 7.1 symbols/min [2025-10-01T21:15:42.139089] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:15:42.187140] [DEBUG] [LOCAL ] RLJ: Loaded 48102 existing records from primary storage. [2025-10-01T21:15:42.187496] [INFO ] [MAIN ] RLJ: Loaded 48102 existing records. [2025-10-01T21:15:42.386835] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:15:42.387537] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-01T21:15:42.387913] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-01T21:15:42.399608] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-01T21:15:42.418772] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-01T21:15:42.477676] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-01T21:15:42.510019] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-01T21:15:42.557219] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T21:15:42.873108] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:15:43.302398] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-01T21:15:44.102396] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-01T21:15:44.361818] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T21:15:44.902406] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-01T21:15:45.414050] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-01T21:15:45.451411] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T21:15:45.702383] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-01T21:15:46.502395] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-01T21:15:46.729772] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T21:15:46.913287] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T21:15:47.302432] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-01T21:15:48.102381] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-01T21:15:48.514812] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T21:15:48.902428] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-01T21:15:49.010900] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T21:15:49.434183] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T21:15:49.702377] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-01T21:15:50.502381] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-01T21:15:50.908215] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T21:15:51.130487] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-01T21:15:51.302390] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-01T21:15:52.102406] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-01T21:15:52.244968] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T21:15:52.737272] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T21:15:52.902398] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-01T21:15:53.702405] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-01T21:15:54.109290] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-01T21:15:54.502453] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-01T21:15:54.748111] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T21:15:55.302362] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-01T21:15:55.406517] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T21:15:56.102369] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-01T21:15:56.431873] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T21:15:56.902383] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-01T21:15:57.702357] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-01T21:15:57.839791] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T21:15:57.886596] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-01T21:15:58.387152] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T21:15:58.502387] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-01T21:15:59.302503] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-01T21:15:59.394261] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T21:16:00.102426] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-01T21:16:00.234767] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T21:16:00.902415] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-01T21:16:01.676405] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-01T21:16:01.707465] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-01T21:16:01.723902] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T21:16:02.239841] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T21:16:02.502400] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-01T21:16:03.302367] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-01T21:16:03.376939] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T21:16:03.496206] [DEBUG] [REMOTE ] RLI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:03.496611] [WARN ] [REMOTE ] RLI: No data returned for month 2025-10 [2025-10-01T21:16:03.496738] [FATAL] [REMOTE ] RLI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:03.496829] [FATAL] [MAIN ] RLI: Failed to fetch primary data. [2025-10-01T21:16:03.496869] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:03.496929] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-01T21:16:03.497030] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-01T21:16:03.497091] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-01T21:16:03.497443] [DEBUG] [LOCAL ] RLI: Deleted derivative data file. [2025-10-01T21:16:03.497566] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RLI took 31.1s. Estimated remaining: 1h 19m 21s. Rate: 7.1 symbols/min [2025-10-01T21:16:03.699171] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:03.713300] [DEBUG] [LOCAL ] RLTY: Loaded 11138 existing records from primary storage. [2025-10-01T21:16:03.713663] [INFO ] [MAIN ] RLTY: Loaded 11138 existing records. [2025-10-01T21:16:03.909694] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:16:03.910045] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-01T21:16:03.910169] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-01T21:16:03.910577] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-01T21:16:03.910668] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-01T21:16:04.102941] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-01T21:16:04.339769] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:04.369040] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T21:16:04.548207] [DEBUG] [REMOTE ] RL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:04.548561] [WARN ] [REMOTE ] RL: No data returned for month 2025-10 [2025-10-01T21:16:04.548678] [FATAL] [REMOTE ] RL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:04.548776] [FATAL] [MAIN ] RL: Failed to fetch primary data. [2025-10-01T21:16:04.548841] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:04.548913] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-01T21:16:04.548978] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-01T21:16:04.549015] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-01T21:16:04.549054] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-01T21:16:04.549101] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RL took 34.5s. Estimated remaining: 1h 19m 10s. Rate: 7.1 symbols/min [2025-10-01T21:16:04.752464] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:04.798593] [DEBUG] [LOCAL ] RLX: Loaded 48332 existing records from primary storage. [2025-10-01T21:16:04.798929] [INFO ] [MAIN ] RLX: Loaded 48332 existing records. [2025-10-01T21:16:04.907466] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-01T21:16:04.999593] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:16:04.999837] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-01T21:16:04.999929] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-01T21:16:05.001002] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-01T21:16:05.001064] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-01T21:16:05.433625] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:05.702419] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-01T21:16:06.502452] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-01T21:16:06.769203] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T21:16:07.302431] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-01T21:16:07.591858] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T21:16:08.102442] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-01T21:16:08.740462] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T21:16:08.883669] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-01T21:16:08.903712] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-01T21:16:08.907481] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T21:16:09.179287] [DEBUG] [REMOTE ] RLJ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:09.179615] [WARN ] [REMOTE ] RLJ: No data returned for month 2025-10 [2025-10-01T21:16:09.179761] [FATAL] [REMOTE ] RLJ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:09.179899] [FATAL] [MAIN ] RLJ: Failed to fetch primary data. [2025-10-01T21:16:09.179980] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:09.180054] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-01T21:16:09.180146] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-01T21:16:09.180201] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-01T21:16:09.180683] [DEBUG] [LOCAL ] RLJ: Deleted derivative data file. [2025-10-01T21:16:09.180828] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RLJ took 27.2s. Estimated remaining: 1h 19m 0s. Rate: 7.1 symbols/min [2025-10-01T21:16:09.398979] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:09.409265] [DEBUG] [LOCAL ] RM: Loaded 7611 existing records from primary storage. [2025-10-01T21:16:09.409526] [INFO ] [MAIN ] RM: Loaded 7611 existing records. [2025-10-01T21:16:09.626434] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:16:09.626718] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-01T21:16:09.626779] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-01T21:16:09.627205] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-01T21:16:09.627278] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-01T21:16:09.707504] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-01T21:16:10.045140] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:10.502399] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-01T21:16:11.243742] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T21:16:11.302390] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-01T21:16:11.658701] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-01T21:16:12.102415] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-01T21:16:12.195927] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T21:16:12.902377] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-01T21:16:12.970038] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T21:16:13.120970] [DEBUG] [REMOTE ] RKT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:13.121315] [WARN ] [REMOTE ] RKT: No data returned for month 2025-10 [2025-10-01T21:16:13.121425] [FATAL] [REMOTE ] RKT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:13.121521] [FATAL] [MAIN ] RKT: Failed to fetch primary data. [2025-10-01T21:16:13.121593] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:13.121698] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-01T21:16:13.121774] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-01T21:16:13.121817] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-01T21:16:13.121863] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-01T21:16:13.121920] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RKT took 46.4s. Estimated remaining: 1h 18m 50s. Rate: 7.1 symbols/min [2025-10-01T21:16:13.302950] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:13.323735] [DEBUG] [LOCAL ] RMAX: Loaded 21475 existing records from primary storage. [2025-10-01T21:16:13.324042] [INFO ] [MAIN ] RMAX: Loaded 21475 existing records. [2025-10-01T21:16:13.514241] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:16:13.514519] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-01T21:16:13.514578] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-01T21:16:13.515184] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-01T21:16:13.515245] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-01T21:16:13.702426] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-01T21:16:13.895417] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:14.502396] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-01T21:16:14.853726] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T21:16:15.302403] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-01T21:16:15.424355] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T21:16:16.102390] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-01T21:16:16.591708] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T21:16:16.867269] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-01T21:16:16.902392] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-01T21:16:17.702366] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-01T21:16:17.782577] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T21:16:18.502408] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-01T21:16:18.850926] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:16:19.302401] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-01T21:16:19.396812] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T21:16:20.102350] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-01T21:16:20.409789] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T21:16:20.902400] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-01T21:16:20.939732] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T21:16:21.702437] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-01T21:16:22.502421] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-01T21:16:22.641614] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T21:16:22.871756] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T21:16:23.302376] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-01T21:16:23.377043] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T21:16:24.102391] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-01T21:16:24.902376] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-01T21:16:25.160521] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T21:16:25.210578] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T21:16:25.702423] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-01T21:16:25.721905] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T21:16:26.502396] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-01T21:16:27.302377] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-01T21:16:27.487819] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T21:16:27.664024] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T21:16:28.102381] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-01T21:16:28.195517] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T21:16:28.902408] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-01T21:16:29.702382] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-01T21:16:29.929335] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T21:16:30.006119] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T21:16:30.171211] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T21:16:30.502431] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-01T21:16:31.294767] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T21:16:31.302331] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-01T21:16:32.102392] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-01T21:16:32.255781] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T21:16:32.748122] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T21:16:32.902435] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-01T21:16:33.702437] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-01T21:16:34.502380] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-01T21:16:34.579120] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:16:34.619218] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T21:16:35.302380] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-01T21:16:35.828426] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T21:16:36.102390] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-01T21:16:36.220730] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T21:16:36.902415] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-01T21:16:37.702431] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-01T21:16:37.835527] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T21:16:38.502364] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-01T21:16:38.503341] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T21:16:38.678605] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T21:16:39.302393] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-01T21:16:39.566035] [DEBUG] [REMOTE ] RLTY: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:39.566370] [WARN ] [REMOTE ] RLTY: No data returned for month 2025-10 [2025-10-01T21:16:39.566468] [FATAL] [REMOTE ] RLTY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:39.566583] [FATAL] [MAIN ] RLTY: Failed to fetch primary data. [2025-10-01T21:16:39.566734] [WARN ] [MAIN ] RLTY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:39.566809] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-01T21:16:39.566915] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-01T21:16:39.566978] [INFO ] [LOCAL ] RLTY: Starting deletion of derivative data. [2025-10-01T21:16:39.567328] [DEBUG] [LOCAL ] RLTY: Deleted derivative data file. [2025-10-01T21:16:39.567437] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RLTY took 36.1s. Estimated remaining: 1h 18m 47s. Rate: 7.1 symbols/min [2025-10-01T21:16:39.767151] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:39.767359] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-01T21:16:39.767404] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-01T21:16:39.767550] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-01T21:16:39.767620] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-01T21:16:39.767733] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-01T21:16:39.767797] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-01T21:16:40.103688] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-01T21:16:40.176303] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:40.293700] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T21:16:40.378111] [DEBUG] [REMOTE ] RM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:40.378432] [WARN ] [REMOTE ] RM: No data returned for month 2025-10 [2025-10-01T21:16:40.378523] [FATAL] [REMOTE ] RM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:40.378631] [FATAL] [MAIN ] RM: Failed to fetch primary data. [2025-10-01T21:16:40.378722] [WARN ] [MAIN ] RM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:40.378795] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-01T21:16:40.378862] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-01T21:16:40.378944] [INFO ] [LOCAL ] RM: Starting deletion of derivative data. [2025-10-01T21:16:40.379327] [DEBUG] [LOCAL ] RM: Deleted derivative data file. [2025-10-01T21:16:40.379454] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RM took 31.2s. Estimated remaining: 1h 18m 37s. Rate: 7.1 symbols/min [2025-10-01T21:16:40.617217] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:40.624504] [DEBUG] [LOCAL ] RMI: Loaded 4698 existing records from primary storage. [2025-10-01T21:16:40.624742] [INFO ] [MAIN ] RMI: Loaded 4698 existing records. [2025-10-01T21:16:40.827263] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:16:40.827496] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-01T21:16:40.827547] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-01T21:16:40.828527] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-01T21:16:40.828605] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-01T21:16:40.907550] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-01T21:16:41.260206] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:41.702430] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-01T21:16:42.502402] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-01T21:16:42.636681] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T21:16:42.752429] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T21:16:43.302379] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-01T21:16:43.839401] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T21:16:44.084195] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:16:44.102396] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-01T21:16:44.902360] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-01T21:16:45.230763] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T21:16:45.464251] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T21:16:45.702400] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-01T21:16:45.933935] [DEBUG] [REMOTE ] RMAX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:45.934264] [WARN ] [REMOTE ] RMAX: No data returned for month 2025-10 [2025-10-01T21:16:45.934356] [FATAL] [REMOTE ] RMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:45.934437] [FATAL] [MAIN ] RMAX: Failed to fetch primary data. [2025-10-01T21:16:45.934501] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:45.934572] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-01T21:16:45.934637] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-01T21:16:45.934716] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-01T21:16:45.935133] [DEBUG] [LOCAL ] RMAX: Deleted derivative data file. [2025-10-01T21:16:45.935223] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMAX took 32.8s. Estimated remaining: 1h 18m 27s. Rate: 7.1 symbols/min [2025-10-01T21:16:46.120233] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:46.133109] [DEBUG] [LOCAL ] RMM: Loaded 10526 existing records from primary storage. [2025-10-01T21:16:46.133383] [INFO ] [MAIN ] RMM: Loaded 10526 existing records. [2025-10-01T21:16:46.352898] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:16:46.353205] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-01T21:16:46.353260] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-01T21:16:46.353914] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-01T21:16:46.353974] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-01T21:16:46.508899] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-01T21:16:46.755509] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:46.838874] [DEBUG] [REMOTE ] RLX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:16:46.839211] [WARN ] [REMOTE ] RLX: No data returned for month 2025-10 [2025-10-01T21:16:46.839309] [FATAL] [REMOTE ] RLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:16:46.839442] [FATAL] [MAIN ] RLX: Failed to fetch primary data. [2025-10-01T21:16:46.839525] [WARN ] [MAIN ] RLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:16:46.839620] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-01T21:16:46.839749] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-01T21:16:46.839832] [INFO ] [LOCAL ] RLX: Starting deletion of derivative data. [2025-10-01T21:16:46.840195] [DEBUG] [LOCAL ] RLX: Deleted derivative data file. [2025-10-01T21:16:46.840314] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RLX took 42.3s. Estimated remaining: 1h 18m 16s. Rate: 7.1 symbols/min [2025-10-01T21:16:47.030452] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:16:47.037012] [DEBUG] [LOCAL ] RMMZ: Loaded 4812 existing records from primary storage. [2025-10-01T21:16:47.037219] [INFO ] [MAIN ] RMMZ: Loaded 4812 existing records. [2025-10-01T21:16:47.232240] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:16:47.232493] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-01T21:16:47.232562] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-01T21:16:47.232881] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-01T21:16:47.232953] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-01T21:16:47.307557] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-01T21:16:47.635780] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:16:48.102403] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-01T21:16:48.902348] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-01T21:16:49.221332] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T21:16:49.288676] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-01T21:16:49.516764] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T21:16:49.702410] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-01T21:16:50.502359] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-01T21:16:50.559580] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T21:16:51.217102] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T21:16:51.302377] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-01T21:16:52.102362] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-01T21:16:52.182384] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T21:16:52.702501] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T21:16:52.902378] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-01T21:16:53.681712] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T21:16:53.702370] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-01T21:16:54.369051] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T21:16:54.502387] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-01T21:16:55.302358] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-01T21:16:55.448573] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T21:16:55.701396] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-01T21:16:56.102375] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-01T21:16:56.860764] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T21:16:56.902361] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-01T21:16:57.702393] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-01T21:16:57.738248] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-01T21:16:58.502398] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-01T21:16:59.176198] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T21:16:59.302377] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-01T21:16:59.351242] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T21:16:59.857216] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T21:17:00.102413] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-01T21:17:00.902360] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-01T21:17:00.922969] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T21:17:01.702428] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-01T21:17:02.444574] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T21:17:02.502405] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-01T21:17:02.825899] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T21:17:03.302365] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-01T21:17:03.617286] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T21:17:04.102420] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-01T21:17:04.902401] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-01T21:17:05.271504] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T21:17:05.272403] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T21:17:05.477218] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T21:17:05.702375] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-01T21:17:06.390816] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T21:17:06.502402] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-01T21:17:07.150015] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T21:17:07.302430] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-01T21:17:08.102355] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-01T21:17:08.358897] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T21:17:08.902455] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-01T21:17:09.174921] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T21:17:09.702422] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-01T21:17:09.948950] [DEBUG] [REMOTE ] RMI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:17:09.949269] [WARN ] [REMOTE ] RMI: No data returned for month 2025-10 [2025-10-01T21:17:09.949368] [FATAL] [REMOTE ] RMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:17:09.949480] [FATAL] [MAIN ] RMI: Failed to fetch primary data. [2025-10-01T21:17:09.949577] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:17:09.949698] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-01T21:17:09.949791] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-01T21:17:09.949845] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-01T21:17:09.950312] [DEBUG] [LOCAL ] RMI: Deleted derivative data file. [2025-10-01T21:17:09.950447] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMI took 29.6s. Estimated remaining: 1h 18m 12s. Rate: 7.1 symbols/min [2025-10-01T21:17:10.137914] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:17:10.156552] [DEBUG] [LOCAL ] RMT: Loaded 17334 existing records from primary storage. [2025-10-01T21:17:10.156870] [INFO ] [MAIN ] RMT: Loaded 17334 existing records. [2025-10-01T21:17:10.363180] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:17:10.363418] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-01T21:17:10.363490] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-01T21:17:10.364928] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-01T21:17:10.364995] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-01T21:17:10.502413] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-01T21:17:10.779305] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:17:10.807864] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T21:17:11.242901] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T21:17:11.302416] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-01T21:17:12.102376] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-01T21:17:12.415854] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T21:17:12.821843] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T21:17:12.902384] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-01T21:17:13.702347] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-01T21:17:13.940897] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T21:17:14.454208] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T21:17:14.502333] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-01T21:17:15.159895] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-01T21:17:15.302385] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-01T21:17:16.102385] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-01T21:17:16.802746] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T21:17:16.902373] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-01T21:17:17.071502] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T21:17:17.162502] [DEBUG] [REMOTE ] RMMZ: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:17:17.162869] [WARN ] [REMOTE ] RMMZ: No data returned for month 2025-10 [2025-10-01T21:17:17.162991] [FATAL] [REMOTE ] RMMZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:17:17.163114] [FATAL] [MAIN ] RMMZ: Failed to fetch primary data. [2025-10-01T21:17:17.163203] [WARN ] [MAIN ] RMMZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:17:17.163332] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-01T21:17:17.163427] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-01T21:17:17.163485] [INFO ] [LOCAL ] RMMZ: Starting deletion of derivative data. [2025-10-01T21:17:17.164001] [DEBUG] [LOCAL ] RMMZ: Deleted derivative data file. [2025-10-01T21:17:17.164094] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMMZ took 30.3s. Estimated remaining: 1h 18m 4s. Rate: 7.1 symbols/min [2025-10-01T21:17:17.348006] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:17:17.408436] [DEBUG] [LOCAL ] RNG: Loaded 48009 existing records from primary storage. [2025-10-01T21:17:17.408769] [INFO ] [MAIN ] RNG: Loaded 48009 existing records. [2025-10-01T21:17:17.604840] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:17:17.605076] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-01T21:17:17.605128] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-01T21:17:17.606126] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-01T21:17:17.606190] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-01T21:17:17.707514] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-01T21:17:18.005047] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:17:18.502426] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-01T21:17:18.951160] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T21:17:19.302396] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-01T21:17:20.102406] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-01T21:17:20.178608] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T21:17:20.902402] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-01T21:17:21.033936] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T21:17:21.195349] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-01T21:17:21.702394] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-01T21:17:22.473870] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T21:17:22.502347] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-01T21:17:22.533172] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T21:17:23.302363] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-01T21:17:23.526303] [DEBUG] [REMOTE ] RMM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:17:23.526728] [WARN ] [REMOTE ] RMM: No data returned for month 2025-10 [2025-10-01T21:17:23.526886] [FATAL] [REMOTE ] RMM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:17:23.527006] [FATAL] [MAIN ] RMM: Failed to fetch primary data. [2025-10-01T21:17:23.527078] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:17:23.527153] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-01T21:17:23.527220] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-01T21:17:23.527258] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-01T21:17:23.527534] [DEBUG] [LOCAL ] RMM: Deleted derivative data file. [2025-10-01T21:17:23.527635] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMM took 37.6s. Estimated remaining: 1h 17m 54s. Rate: 7.1 symbols/min [2025-10-01T21:17:23.721897] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:17:23.742878] [DEBUG] [LOCAL ] RNGR: Loaded 20354 existing records from primary storage. [2025-10-01T21:17:23.743121] [INFO ] [MAIN ] RNGR: Loaded 20354 existing records. [2025-10-01T21:17:23.942988] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:17:23.943207] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-01T21:17:23.943265] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-01T21:17:23.944355] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-01T21:17:23.944417] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-01T21:17:24.107492] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-01T21:17:24.366312] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:17:24.384926] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T21:17:24.902379] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-01T21:17:25.245801] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T21:17:25.702519] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-01T21:17:26.502408] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-01T21:17:26.725122] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T21:17:26.748943] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T21:17:27.302402] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-01T21:17:28.102372] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-01T21:17:28.205396] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T21:17:28.261630] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T21:17:28.902379] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-01T21:17:29.303866] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T21:17:29.702356] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-01T21:17:30.063220] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T21:17:30.502360] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-01T21:17:31.302365] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-01T21:17:31.419538] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T21:17:32.102387] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-01T21:17:32.266048] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T21:17:32.349468] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T21:17:32.361421] [DEBUG] [REMOTE ] RMD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:17:32.361814] [WARN ] [REMOTE ] RMD: No data returned for month 2025-10 [2025-10-01T21:17:32.361929] [FATAL] [REMOTE ] RMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:17:32.362047] [FATAL] [MAIN ] RMD: Failed to fetch primary data. [2025-10-01T21:17:32.362145] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:17:32.362238] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-01T21:17:32.362329] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-01T21:17:32.362390] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-01T21:17:32.362451] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-01T21:17:32.362520] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMD took 52.8s. Estimated remaining: 1h 17m 46s. Rate: 7.1 symbols/min [2025-10-01T21:17:32.553234] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:17:32.571996] [DEBUG] [LOCAL ] RNP: Loaded 15706 existing records from primary storage. [2025-10-01T21:17:32.572253] [INFO ] [MAIN ] RNP: Loaded 15706 existing records. [2025-10-01T21:17:32.757456] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:17:32.757719] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-01T21:17:32.757777] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-01T21:17:32.758298] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-01T21:17:32.758361] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-01T21:17:32.909176] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-01T21:17:33.140843] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:17:33.702397] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-01T21:17:34.502416] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-01T21:17:34.763226] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T21:17:34.830737] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-01T21:17:35.302386] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-01T21:17:35.415379] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-01T21:17:35.545250] [DEBUG] [REMOTE ] RMT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:17:35.545569] [WARN ] [REMOTE ] RMT: No data returned for month 2025-10 [2025-10-01T21:17:35.545682] [FATAL] [REMOTE ] RMT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:17:35.545782] [FATAL] [MAIN ] RMT: Failed to fetch primary data. [2025-10-01T21:17:35.545853] [WARN ] [MAIN ] RMT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:17:35.545926] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-01T21:17:35.546028] [DEBUG] [LOCAL ] RMT: No primary data file found to delete. [2025-10-01T21:17:35.546067] [INFO ] [LOCAL ] RMT: Starting deletion of derivative data. [2025-10-01T21:17:35.546371] [DEBUG] [LOCAL ] RMT: Deleted derivative data file. [2025-10-01T21:17:35.546475] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 25.6s. Estimated remaining: 1h 17m 36s. Rate: 7.1 symbols/min [2025-10-01T21:17:35.725408] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:17:35.765740] [DEBUG] [LOCAL ] RNR: Loaded 33936 existing records from primary storage. [2025-10-01T21:17:35.766046] [INFO ] [MAIN ] RNR: Loaded 33936 existing records. [2025-10-01T21:17:35.958865] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:17:35.959091] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-01T21:17:35.959141] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-01T21:17:35.960218] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-10-01T21:17:35.960279] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-01T21:17:36.110403] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-01T21:17:36.346604] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:17:36.902344] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-01T21:17:37.028580] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-01T21:17:37.702415] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-01T21:17:38.502397] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-01T21:17:38.551138] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T21:17:39.202416] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T21:17:39.302408] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-01T21:17:39.843328] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T21:17:40.102358] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-01T21:17:40.137018] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T21:17:40.902409] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-01T21:17:41.101392] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T21:17:41.702442] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-01T21:17:42.229321] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T21:17:42.502395] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-01T21:17:43.088496] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T21:17:43.302401] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-01T21:17:44.088073] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T21:17:44.102322] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-01T21:17:44.275573] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T21:17:44.902359] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-01T21:17:45.185263] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T21:17:45.702387] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-01T21:17:46.410297] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T21:17:46.502391] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-01T21:17:47.017425] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T21:17:47.302368] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-01T21:17:47.378884] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-01T21:17:48.102411] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-01T21:17:48.432384] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T21:17:48.902381] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-01T21:17:49.618329] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T21:17:49.702397] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-01T21:17:49.995878] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T21:17:50.502382] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-01T21:17:51.302349] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-01T21:17:51.479331] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T21:17:51.608680] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T21:17:52.102394] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-01T21:17:52.315839] [DEBUG] [REMOTE ] RNGR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:17:52.316179] [WARN ] [REMOTE ] RNGR: No data returned for month 2025-10 [2025-10-01T21:17:52.316279] [FATAL] [REMOTE ] RNGR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:17:52.316395] [FATAL] [MAIN ] RNGR: Failed to fetch primary data. [2025-10-01T21:17:52.316477] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:17:52.316565] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-01T21:17:52.316691] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-01T21:17:52.316759] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-01T21:17:52.317503] [DEBUG] [LOCAL ] RNGR: Deleted derivative data file. [2025-10-01T21:17:52.317623] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNGR took 28.8s. Estimated remaining: 1h 17m 30s. Rate: 7.1 symbols/min [2025-10-01T21:17:52.508544] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:17:52.550602] [DEBUG] [LOCAL ] RNST: Loaded 37066 existing records from primary storage. [2025-10-01T21:17:52.550910] [INFO ] [MAIN ] RNST: Loaded 37066 existing records. [2025-10-01T21:17:52.755122] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:17:52.755340] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-01T21:17:52.755388] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-01T21:17:52.757354] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-10-01T21:17:52.757426] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-01T21:17:52.916367] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-01T21:17:53.160606] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:17:53.189190] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T21:17:53.702385] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-01T21:17:53.959064] [DEBUG] [REMOTE ] RNG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:17:53.959382] [WARN ] [REMOTE ] RNG: No data returned for month 2025-10 [2025-10-01T21:17:53.959473] [FATAL] [REMOTE ] RNG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:17:53.959583] [FATAL] [MAIN ] RNG: Failed to fetch primary data. [2025-10-01T21:17:53.959674] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:17:53.959763] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-01T21:17:53.959830] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-01T21:17:53.959867] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-01T21:17:53.960317] [DEBUG] [LOCAL ] RNG: Deleted derivative data file. [2025-10-01T21:17:53.960419] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNG took 36.8s. Estimated remaining: 1h 17m 19s. Rate: 7.1 symbols/min [2025-10-01T21:17:54.149383] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:17:54.160357] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T21:17:54.184708] [DEBUG] [LOCAL ] ROG: Loaded 22976 existing records from primary storage. [2025-10-01T21:17:54.184974] [INFO ] [MAIN ] ROG: Loaded 22976 existing records. [2025-10-01T21:17:54.379211] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:17:54.379426] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-01T21:17:54.379474] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-01T21:17:54.380070] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-10-01T21:17:54.380130] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-01T21:17:54.507461] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-01T21:17:54.816227] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:17:55.302389] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-01T21:17:56.102404] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-01T21:17:56.127171] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T21:17:56.418810] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T21:17:56.902421] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-01T21:17:57.598793] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T21:17:57.692303] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T21:17:57.702335] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-01T21:17:58.502394] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-01T21:17:58.784441] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T21:17:59.302397] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-01T21:17:59.379818] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T21:18:00.102400] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-01T21:18:00.773484] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T21:18:00.902440] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-01T21:18:01.702392] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-01T21:18:01.850099] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T21:18:02.445457] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T21:18:02.502396] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-01T21:18:02.619474] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T21:18:03.302419] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-01T21:18:03.976993] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T21:18:04.102414] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-01T21:18:04.579559] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-01T21:18:04.902366] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-01T21:18:05.143909] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T21:18:05.702398] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-01T21:18:05.920702] [DEBUG] [REMOTE ] RNP: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:18:05.921050] [WARN ] [REMOTE ] RNP: No data returned for month 2025-10 [2025-10-01T21:18:05.921138] [FATAL] [REMOTE ] RNP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:18:05.921222] [FATAL] [MAIN ] RNP: Failed to fetch primary data. [2025-10-01T21:18:05.921290] [WARN ] [MAIN ] RNP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:18:05.921363] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-01T21:18:05.921428] [DEBUG] [LOCAL ] RNP: No primary data file found to delete. [2025-10-01T21:18:05.921466] [INFO ] [LOCAL ] RNP: Starting deletion of derivative data. [2025-10-01T21:18:05.921813] [DEBUG] [LOCAL ] RNP: Deleted derivative data file. [2025-10-01T21:18:05.921903] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNP took 33.6s. Estimated remaining: 1h 17m 12s. Rate: 7.1 symbols/min [2025-10-01T21:18:06.108071] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:18:06.108248] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-01T21:18:06.108286] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-01T21:18:06.108405] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-01T21:18:06.108447] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-01T21:18:06.108489] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-01T21:18:06.108522] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-01T21:18:06.512488] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:18:06.504368] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-01T21:18:06.580200] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:18:07.302387] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-01T21:18:08.102364] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-01T21:18:08.204237] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:18:08.902387] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-01T21:18:09.104635] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-01T21:18:09.674778] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T21:18:09.702355] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-01T21:18:10.422521] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T21:18:10.502393] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-01T21:18:11.302422] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-01T21:18:11.509970] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T21:18:11.799072] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-01T21:18:12.102424] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-01T21:18:12.902399] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-01T21:18:12.944944] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T21:18:13.233195] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T21:18:13.702382] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-01T21:18:14.395419] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T21:18:14.502433] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-01T21:18:15.190314] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T21:18:15.302412] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-01T21:18:15.519716] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T21:18:16.102407] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-01T21:18:16.902382] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-01T21:18:17.208147] [DEBUG] [REMOTE ] RNR: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:18:17.211785] [WARN ] [REMOTE ] RNR: No data returned for month 2025-10 [2025-10-01T21:18:17.212064] [FATAL] [REMOTE ] RNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:18:17.212301] [FATAL] [MAIN ] RNR: Failed to fetch primary data. [2025-10-01T21:18:17.214121] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-01T21:18:17.212710] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:18:17.223680] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-01T21:18:17.224141] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-01T21:18:17.224564] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-01T21:18:17.224960] [DEBUG] [LOCAL ] RNR: Deleted derivative data file. [2025-10-01T21:18:17.225047] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNR took 41.7s. Estimated remaining: 1h 17m 4s. Rate: 7.1 symbols/min [2025-10-01T21:18:17.430163] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:18:17.430547] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-01T21:18:17.430720] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-01T21:18:17.430914] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-01T21:18:17.437214] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-01T21:18:17.448597] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-01T21:18:17.449745] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T21:18:17.449907] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-01T21:18:17.707682] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-01T21:18:18.054125] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:18:18.502429] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-01T21:18:19.080138] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T21:18:19.302426] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-01T21:18:19.593952] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T21:18:20.102366] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-01T21:18:20.355535] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T21:18:20.902401] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-01T21:18:21.359830] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-01T21:18:21.702387] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-01T21:18:22.502404] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-01T21:18:22.681688] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T21:18:22.753735] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T21:18:23.302381] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-01T21:18:24.102410] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-01T21:18:24.358035] [DEBUG] [REMOTE ] ROG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:18:24.358403] [WARN ] [REMOTE ] ROG: No data returned for month 2025-10 [2025-10-01T21:18:24.358505] [FATAL] [REMOTE ] ROG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:18:24.358589] [FATAL] [MAIN ] ROG: Failed to fetch primary data. [2025-10-01T21:18:24.358680] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:18:24.358757] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-01T21:18:24.358822] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-01T21:18:24.358889] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-01T21:18:24.359279] [DEBUG] [LOCAL ] ROG: Deleted derivative data file. [2025-10-01T21:18:24.359368] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 30.4s. Estimated remaining: 1h 16m 55s. Rate: 7.1 symbols/min [2025-10-01T21:18:24.554546] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:18:24.589793] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T21:18:24.642314] [DEBUG] [LOCAL ] RPM: Loaded 41394 existing records from primary storage. [2025-10-01T21:18:24.642762] [INFO ] [MAIN ] RPM: Loaded 41394 existing records. [2025-10-01T21:18:24.855238] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:18:24.855713] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-01T21:18:24.855812] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-01T21:18:24.857327] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-10-01T21:18:24.857394] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-01T21:18:24.906315] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-01T21:18:25.092876] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T21:18:25.304967] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:18:25.702412] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-01T21:18:26.502368] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-01T21:18:26.838528] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T21:18:27.305752] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-01T21:18:27.311375] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T21:18:27.639169] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T21:18:28.102404] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-01T21:18:28.902392] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-01T21:18:28.958383] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T21:18:29.172411] [DEBUG] [REMOTE ] RNST: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:18:29.172791] [WARN ] [REMOTE ] RNST: No data returned for month 2025-10 [2025-10-01T21:18:29.172882] [FATAL] [REMOTE ] RNST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:18:29.173007] [FATAL] [MAIN ] RNST: Failed to fetch primary data. [2025-10-01T21:18:29.173089] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:18:29.173180] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-01T21:18:29.173267] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-01T21:18:29.173321] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-01T21:18:29.173794] [DEBUG] [LOCAL ] RNST: Deleted derivative data file. [2025-10-01T21:18:29.173886] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. RNST took 36.9s. Estimated remaining: 1h 16m 46s. Rate: 7.1 symbols/min [2025-10-01T21:18:29.364906] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:18:29.384136] [DEBUG] [LOCAL ] RPT: Loaded 19160 existing records from primary storage. [2025-10-01T21:18:29.384382] [INFO ] [MAIN ] RPT: Loaded 19160 existing records. [2025-10-01T21:18:29.583557] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:18:29.583964] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-01T21:18:29.584023] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-01T21:18:29.584692] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-01T21:18:29.584755] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-01T21:18:29.703032] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-01T21:18:30.001448] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:18:30.037971] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T21:18:30.502427] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-01T21:18:31.302369] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-01T21:18:31.483384] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T21:18:31.584807] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T21:18:32.102421] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-01T21:18:32.902411] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-01T21:18:33.043151] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T21:18:33.584476] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T21:18:33.702369] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-01T21:18:33.961969] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T21:18:34.502388] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-01T21:18:35.117457] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T21:18:35.302389] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-01T21:18:35.608420] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T21:18:36.102411] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-01T21:18:36.856689] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T21:18:36.902376] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-01T21:18:37.702366] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-01T21:18:37.735479] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T21:18:38.502369] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-01T21:18:38.711875] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T21:18:39.302425] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-01T21:18:39.371866] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T21:18:39.433775] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T21:18:40.102470] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-01T21:18:40.902410] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-01T21:18:41.005995] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T21:18:41.107805] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T21:18:41.702486] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-01T21:18:42.508291] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-01T21:18:42.525058] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:18:42.788719] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T21:18:43.302420] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-01T21:18:43.951473] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T21:18:44.102351] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-01T21:18:44.902395] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-01T21:18:45.107633] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T21:18:45.702448] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-01T21:18:45.768278] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T21:18:46.079855] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T21:18:46.502380] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-01T21:18:46.832225] [DEBUG] [REMOTE ] ROK: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:18:46.832562] [WARN ] [REMOTE ] ROK: No data returned for month 2025-10 [2025-10-01T21:18:46.832679] [FATAL] [REMOTE ] ROK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:18:46.832785] [FATAL] [MAIN ] ROK: Failed to fetch primary data. [2025-10-01T21:18:46.832852] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:18:46.832927] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-01T21:18:46.832992] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-01T21:18:46.833031] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-01T21:18:46.833075] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-01T21:18:46.833360] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROK took 40.9s. Estimated remaining: 1h 16m 40s. Rate: 7.1 symbols/min [2025-10-01T21:18:47.010280] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:18:47.047739] [DEBUG] [LOCAL ] RQI: Loaded 29124 existing records from primary storage. [2025-10-01T21:18:47.048139] [INFO ] [MAIN ] RQI: Loaded 29124 existing records. [2025-10-01T21:18:47.229173] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:18:47.229416] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-01T21:18:47.229532] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-01T21:18:47.231099] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-01T21:18:47.231161] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-01T21:18:47.306239] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-01T21:18:47.597723] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:18:47.698841] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-01T21:18:48.102408] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-01T21:18:48.902382] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-01T21:18:49.153765] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T21:18:49.543922] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T21:18:49.566992] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T21:18:49.702401] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-01T21:18:50.502381] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-01T21:18:50.914310] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T21:18:51.302381] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-01T21:18:51.934763] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-01T21:18:52.102358] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-01T21:18:52.485828] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T21:18:52.902410] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-01T21:18:53.454082] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T21:18:53.702461] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-01T21:18:54.016913] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-01T21:18:54.502431] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-01T21:18:55.257338] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T21:18:55.302359] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-01T21:18:55.636476] [DEBUG] [REMOTE ] RPM: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:18:55.636955] [WARN ] [REMOTE ] RPM: No data returned for month 2025-10 [2025-10-01T21:18:55.637056] [FATAL] [REMOTE ] RPM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:18:55.637165] [FATAL] [MAIN ] RPM: Failed to fetch primary data. [2025-10-01T21:18:55.637232] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:18:55.637310] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-01T21:18:55.637382] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-01T21:18:55.637419] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-01T21:18:55.638166] [DEBUG] [LOCAL ] RPM: Deleted derivative data file. [2025-10-01T21:18:55.638502] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. RPM took 31.3s. Estimated remaining: 1h 16m 32s. Rate: 7.1 symbols/min [2025-10-01T21:18:55.840414] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:18:55.837705] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T21:18:55.907787] [DEBUG] [LOCAL ] RRC: Loaded 52785 existing records from primary storage. [2025-10-01T21:18:55.908572] [INFO ] [MAIN ] RRC: Loaded 52785 existing records. [2025-10-01T21:18:56.098931] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:18:56.099295] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-01T21:18:56.099356] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-01T21:18:56.100582] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-10-01T21:18:56.100684] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-01T21:18:56.111716] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-01T21:18:56.458809] [DEBUG] [REMOTE ] RPT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:18:56.471364] [WARN ] [REMOTE ] RPT: No data returned for month 2025-10 [2025-10-01T21:18:56.482382] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:18:56.482474] [FATAL] [REMOTE ] RPT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:18:56.482772] [FATAL] [MAIN ] RPT: Failed to fetch primary data. [2025-10-01T21:18:56.483132] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:18:56.483213] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-01T21:18:56.483290] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-01T21:18:56.483329] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-10-01T21:18:56.483578] [DEBUG] [LOCAL ] RPT: Deleted derivative data file. [2025-10-01T21:18:56.483721] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPT took 27.3s. Estimated remaining: 1h 16m 21s. Rate: 7.1 symbols/min [2025-10-01T21:18:56.675427] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:18:56.722811] [DEBUG] [LOCAL ] RRX: Loaded 41071 existing records from primary storage. [2025-10-01T21:18:56.723172] [INFO ] [MAIN ] RRX: Loaded 41071 existing records. [2025-10-01T21:18:56.913835] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-01T21:18:56.920127] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:18:56.921671] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-01T21:18:56.921738] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-01T21:18:56.922832] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-10-01T21:18:56.922899] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-01T21:18:57.355258] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:18:57.702440] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-01T21:18:58.272925] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T21:18:58.502469] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-01T21:18:59.302435] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-01T21:18:59.464065] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T21:19:00.102420] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-01T21:19:00.396796] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T21:19:00.512138] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T21:19:00.902415] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-01T21:19:01.702511] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-01T21:19:01.838758] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T21:19:02.511386] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-01T21:19:02.516505] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T21:19:02.804948] [DEBUG] [REMOTE ] ROL: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:19:02.805514] [WARN ] [REMOTE ] ROL: No data returned for month 2025-10 [2025-10-01T21:19:02.805631] [FATAL] [REMOTE ] ROL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:19:02.805799] [FATAL] [MAIN ] ROL: Failed to fetch primary data. [2025-10-01T21:19:02.805879] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:19:02.805961] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-01T21:19:02.806052] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-01T21:19:02.806119] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-01T21:19:02.806169] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-01T21:19:02.806382] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. ROL took 45.6s. Estimated remaining: 1h 16m 12s. Rate: 7.1 symbols/min [2025-10-01T21:19:02.989887] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:19:03.011625] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T21:19:03.043855] [DEBUG] [LOCAL ] RS: Loaded 25380 existing records from primary storage. [2025-10-01T21:19:03.044174] [INFO ] [MAIN ] RS: Loaded 25380 existing records. [2025-10-01T21:19:03.237876] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:19:03.238224] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-01T21:19:03.238289] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-01T21:19:03.239369] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-10-01T21:19:03.239433] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-01T21:19:03.307813] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-01T21:19:03.653665] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:19:04.102384] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-01T21:19:04.759361] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:19:04.902411] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-01T21:19:05.533207] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T21:19:05.702426] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-01T21:19:06.386781] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T21:19:06.502351] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-01T21:19:07.200761] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T21:19:07.302398] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-01T21:19:08.001300] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T21:19:08.102383] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-01T21:19:08.902366] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-01T21:19:09.177815] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T21:19:09.189607] [DEBUG] [REMOTE ] RQI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:19:09.190762] [WARN ] [REMOTE ] RQI: No data returned for month 2025-10 [2025-10-01T21:19:09.190855] [FATAL] [REMOTE ] RQI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:19:09.190951] [FATAL] [MAIN ] RQI: Failed to fetch primary data. [2025-10-01T21:19:09.191016] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:19:09.191091] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-01T21:19:09.191171] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-01T21:19:09.191229] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-01T21:19:09.191585] [DEBUG] [LOCAL ] RQI: Deleted derivative data file. [2025-10-01T21:19:09.191722] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RQI took 22.4s. Estimated remaining: 1h 16m 3s. Rate: 7.1 symbols/min [2025-10-01T21:19:09.397622] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:19:09.404244] [DEBUG] [LOCAL ] RSF: Loaded 4187 existing records from primary storage. [2025-10-01T21:19:09.404451] [INFO ] [MAIN ] RSF: Loaded 4187 existing records. [2025-10-01T21:19:09.600536] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T21:19:09.628532] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:19:09.629552] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-01T21:19:09.629605] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-01T21:19:09.629908] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-01T21:19:09.629969] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-01T21:19:09.707638] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-01T21:19:10.061162] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:19:10.502456] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-01T21:19:11.115892] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-01T21:19:11.302421] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-01T21:19:11.446342] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T21:19:12.102388] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-01T21:19:12.902359] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-01T21:19:13.101850] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T21:19:13.537072] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T21:19:13.537757] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T21:19:13.702438] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-01T21:19:14.502410] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-01T21:19:15.199815] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T21:19:15.302362] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-01T21:19:15.340131] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T21:19:15.823510] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-01T21:19:16.102401] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-01T21:19:16.902403] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-01T21:19:17.691186] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T21:19:17.702330] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-01T21:19:18.502360] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-01T21:19:18.569791] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T21:19:18.853010] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T21:19:18.945238] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T21:19:19.302385] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-01T21:19:20.102387] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-01T21:19:20.902383] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-01T21:19:21.126127] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T21:19:21.517309] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T21:19:21.596489] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-01T21:19:21.702431] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-01T21:19:22.430686] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-01T21:19:22.502353] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-01T21:19:23.243620] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T21:19:23.302355] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-01T21:19:24.102565] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-01T21:19:24.754905] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T21:19:24.902375] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-01T21:19:24.980633] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T21:19:25.360048] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T21:19:25.702379] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-01T21:19:26.067577] [DEBUG] [REMOTE ] RSF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:19:26.068033] [WARN ] [REMOTE ] RSF: No data returned for month 2025-10 [2025-10-01T21:19:26.068127] [FATAL] [REMOTE ] RSF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:19:26.068208] [FATAL] [MAIN ] RSF: Failed to fetch primary data. [2025-10-01T21:19:26.068271] [WARN ] [MAIN ] RSF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:19:26.068340] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-01T21:19:26.068429] [DEBUG] [LOCAL ] RSF: No primary data file found to delete. [2025-10-01T21:19:26.068487] [INFO ] [LOCAL ] RSF: Starting deletion of derivative data. [2025-10-01T21:19:26.068950] [DEBUG] [LOCAL ] RSF: Deleted derivative data file. [2025-10-01T21:19:26.069059] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RSF took 16.9s. Estimated remaining: 1h 15m 57s. Rate: 7.1 symbols/min [2025-10-01T21:19:26.264977] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:19:26.265196] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-01T21:19:26.265254] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-01T21:19:26.265366] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-01T21:19:26.265409] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-01T21:19:26.265451] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-01T21:19:26.265485] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-01T21:19:26.507809] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-01T21:19:26.679269] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:19:27.302386] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-01T21:19:27.854803] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T21:19:28.102402] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-01T21:19:28.902360] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-01T21:19:28.997322] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T21:19:29.289762] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T21:19:29.702382] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-01T21:19:30.502356] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-01T21:19:30.793285] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T21:19:31.302369] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-01T21:19:31.460312] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T21:19:31.493850] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T21:19:32.102397] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-01T21:19:32.902395] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-01T21:19:33.203456] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T21:19:33.574203] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T21:19:33.702367] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-01T21:19:34.322211] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T21:19:34.502367] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-01T21:19:35.302396] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-01T21:19:35.616913] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-01T21:19:35.781540] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T21:19:36.102382] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-01T21:19:36.902356] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-01T21:19:37.163038] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T21:19:37.406596] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-01T21:19:37.702386] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-01T21:19:38.502398] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-01T21:19:38.947274] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-01T21:19:38.973274] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T21:19:39.302398] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-01T21:19:39.688152] [DEBUG] [REMOTE ] RS: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:19:39.688482] [WARN ] [REMOTE ] RS: No data returned for month 2025-10 [2025-10-01T21:19:39.688578] [FATAL] [REMOTE ] RS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:19:39.688715] [FATAL] [MAIN ] RS: Failed to fetch primary data. [2025-10-01T21:19:39.688790] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:19:39.688864] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-01T21:19:39.688930] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-01T21:19:39.688984] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-01T21:19:39.689423] [DEBUG] [LOCAL ] RS: Deleted derivative data file. [2025-10-01T21:19:39.689514] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RS took 36.9s. Estimated remaining: 1h 15m 50s. Rate: 7.1 symbols/min [2025-10-01T21:19:39.875902] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:19:39.922805] [DEBUG] [LOCAL ] RSI: Loaded 46868 existing records from primary storage. [2025-10-01T21:19:39.923238] [INFO ] [MAIN ] RSI: Loaded 46868 existing records. [2025-10-01T21:19:40.112324] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-01T21:19:40.118205] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:19:40.119368] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-01T21:19:40.119444] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-01T21:19:40.128338] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-01T21:19:40.143014] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-01T21:19:40.219504] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T21:19:40.535866] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:19:40.902415] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-01T21:19:41.702366] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-01T21:19:41.926506] [DEBUG] [REMOTE ] RRX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:19:41.926849] [WARN ] [REMOTE ] RRX: No data returned for month 2025-10 [2025-10-01T21:19:41.926938] [FATAL] [REMOTE ] RRX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:19:41.927049] [FATAL] [MAIN ] RRX: Failed to fetch primary data. [2025-10-01T21:19:41.927133] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:19:41.927250] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-01T21:19:41.927344] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-01T21:19:41.927397] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-01T21:19:41.927817] [DEBUG] [LOCAL ] RRX: Deleted derivative data file. [2025-10-01T21:19:41.927936] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRX took 45.4s. Estimated remaining: 1h 15m 39s. Rate: 7.1 symbols/min [2025-10-01T21:19:42.119671] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:19:42.153600] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-01T21:19:42.192514] [DEBUG] [LOCAL ] RSKD: Loaded 33520 existing records from primary storage. [2025-10-01T21:19:42.192831] [INFO ] [MAIN ] RSKD: Loaded 33520 existing records. [2025-10-01T21:19:42.389996] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:19:42.390192] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-01T21:19:42.390241] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-01T21:19:42.391055] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-01T21:19:42.391120] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-01T21:19:42.506265] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-01T21:19:42.838168] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T21:19:42.843874] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:19:43.302382] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-01T21:19:44.102423] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-01T21:19:44.153036] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T21:19:44.719278] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T21:19:44.902382] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-01T21:19:45.702384] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-01T21:19:45.922533] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T21:19:46.502480] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-01T21:19:46.554524] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T21:19:47.099239] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T21:19:47.302374] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-01T21:19:47.520611] [DEBUG] [REMOTE ] RRC: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:19:47.520972] [WARN ] [REMOTE ] RRC: No data returned for month 2025-10 [2025-10-01T21:19:47.521131] [FATAL] [REMOTE ] RRC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:19:47.521280] [FATAL] [MAIN ] RRC: Failed to fetch primary data. [2025-10-01T21:19:47.521350] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:19:47.521449] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-01T21:19:47.521555] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-01T21:19:47.521618] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-01T21:19:47.522032] [DEBUG] [LOCAL ] RRC: Deleted derivative data file. [2025-10-01T21:19:47.522213] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RRC took 51.9s. Estimated remaining: 1h 15m 30s. Rate: 7.1 symbols/min [2025-10-01T21:19:47.917766] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T21:19:48.102377] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-01T21:19:48.902397] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-01T21:19:49.520325] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T21:19:49.702376] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-01T21:19:50.502377] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-01T21:19:50.765721] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T21:19:51.232753] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T21:19:51.302428] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-01T21:19:52.102350] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-01T21:19:52.307543] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T21:19:52.418104] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T21:19:52.902383] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-01T21:19:53.702432] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-01T21:19:53.861973] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T21:19:54.334028] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T21:19:54.502402] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-01T21:19:55.302438] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-01T21:19:55.660240] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-01T21:19:56.102369] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-01T21:19:56.269724] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T21:19:56.438376] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T21:19:56.902385] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-01T21:19:57.668996] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T21:19:57.702404] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-01T21:19:57.866061] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T21:19:58.502397] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-01T21:19:59.302406] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-01T21:19:59.416327] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T21:19:59.566320] [DEBUG] [REMOTE ] RSG: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:19:59.566640] [WARN ] [REMOTE ] RSG: No data returned for month 2025-10 [2025-10-01T21:19:59.566758] [FATAL] [REMOTE ] RSG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:19:59.566844] [FATAL] [MAIN ] RSG: Failed to fetch primary data. [2025-10-01T21:19:59.566910] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:19:59.566983] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-01T21:19:59.567074] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-01T21:19:59.567131] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-01T21:19:59.567179] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-01T21:19:59.567244] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSG took 33.5s. Estimated remaining: 1h 15m 23s. Rate: 7.1 symbols/min [2025-10-01T21:19:59.985003] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T21:20:00.102385] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-01T21:20:00.902399] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-01T21:20:01.470245] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T21:20:01.702469] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-01T21:20:02.416858] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T21:20:02.502455] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-01T21:20:02.844040] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T21:20:02.912986] [DEBUG] [REMOTE ] RSKD: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:20:02.913430] [WARN ] [REMOTE ] RSKD: No data returned for month 2025-10 [2025-10-01T21:20:02.913581] [FATAL] [REMOTE ] RSKD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:20:02.913724] [FATAL] [MAIN ] RSKD: Failed to fetch primary data. [2025-10-01T21:20:02.913811] [WARN ] [MAIN ] RSKD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:20:02.913920] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-01T21:20:02.914032] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-01T21:20:02.914174] [INFO ] [LOCAL ] RSKD: Starting deletion of derivative data. [2025-10-01T21:20:02.914789] [DEBUG] [LOCAL ] RSKD: Deleted derivative data file. [2025-10-01T21:20:02.914903] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSKD took 21.0s. Estimated remaining: 1h 15m 13s. Rate: 7.1 symbols/min [2025-10-01T21:20:03.302411] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-01T21:20:05.220922] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T21:20:05.231773] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-01T21:20:07.139425] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T21:20:07.150841] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-01T21:20:08.916946] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T21:20:08.928009] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-01T21:20:09.148791] [DEBUG] [REMOTE ] RSI: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:20:09.149084] [WARN ] [REMOTE ] RSI: No data returned for month 2025-10 [2025-10-01T21:20:09.149174] [FATAL] [REMOTE ] RSI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:20:09.149255] [FATAL] [MAIN ] RSI: Failed to fetch primary data. [2025-10-01T21:20:09.149320] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:20:09.149392] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-01T21:20:09.149494] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-01T21:20:09.149578] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-01T21:20:09.149924] [DEBUG] [LOCAL ] RSI: Deleted derivative data file. [2025-10-01T21:20:09.150016] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSI took 29.5s. Estimated remaining: 1h 15m 4s. Rate: 7.1 symbols/min [2025-10-01T21:20:09.855136] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:20:09.919030] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:20:09.990231] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-01T21:20:10.006083] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:20:10.006337] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-01T21:20:09.993524] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:20:10.006562] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-01T21:20:10.007284] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-01T21:20:10.007520] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-01T21:20:10.007731] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-01T21:20:10.007590] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-01T21:20:10.007821] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-01T21:20:10.007927] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-01T21:20:10.008143] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-01T21:20:10.020475] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-01T21:20:10.045550] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-01T21:20:10.381978] [DEBUG] [LOCAL ] RVT: Loaded 26728 existing records from primary storage. [2025-10-01T21:20:10.436612] [INFO ] [MAIN ] RVT: Loaded 26728 existing records. [2025-10-01T21:20:10.488792] [DEBUG] [LOCAL ] RTO: Loaded 40020 existing records from primary storage. [2025-10-01T21:20:10.579247] [INFO ] [MAIN ] RTO: Loaded 40020 existing records. [2025-10-01T21:20:11.285324] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:20:11.253160] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:20:11.306104] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:20:11.330252] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-01T21:20:11.302524] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-01T21:20:11.329979] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:20:11.331955] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-01T21:20:11.330842] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-01T21:20:11.333248] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-01T21:20:11.332994] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-01T21:20:11.333407] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-01T21:20:11.333535] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-01T21:20:11.338929] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-01T21:20:11.373029] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-01T21:20:12.139840] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:20:12.149294] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-01T21:20:12.181731] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:20:12.182072] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-01T21:20:13.231949] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T21:20:13.241845] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-01T21:20:13.563379] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-01T21:20:13.575359] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-01T21:20:13.686052] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T21:20:13.693627] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-01T21:20:13.759889] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:20:13.768165] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-01T21:20:14.872902] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T21:20:14.882519] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-01T21:20:15.109544] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-01T21:20:15.115778] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-01T21:20:15.337665] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T21:20:15.348602] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-01T21:20:15.464774] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T21:20:15.475113] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-01T21:20:16.210129] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T21:20:16.225175] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-01T21:20:16.299622] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-01T21:20:16.902343] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-01T21:20:16.992907] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T21:20:17.081935] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T21:20:17.702378] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-01T21:20:18.015929] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T21:20:18.447733] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T21:20:18.502361] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-01T21:20:18.935247] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T21:20:19.302377] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-01T21:20:20.102400] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-01T21:20:20.138817] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T21:20:20.691015] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T21:20:20.902379] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-01T21:20:21.702362] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-01T21:20:21.810306] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T21:20:22.502444] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-01T21:20:22.646084] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T21:20:23.055796] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-01T21:20:23.302397] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-01T21:20:24.102371] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-01T21:20:24.519160] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T21:20:24.800723] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-01T21:20:24.902381] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-01T21:20:25.702396] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-01T21:20:26.047912] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T21:20:26.369609] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T21:20:26.502463] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-01T21:20:27.302388] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-01T21:20:27.720261] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-01T21:20:27.913882] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-01T21:20:28.102420] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-01T21:20:28.834948] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T21:20:28.902400] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-01T21:20:29.702414] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-01T21:20:30.236672] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-01T21:20:30.342486] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-01T21:20:30.502411] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-01T21:20:30.917410] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T21:20:31.302399] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-01T21:20:32.102391] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-01T21:20:32.335465] [DEBUG] [REMOTE ] RVT: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:20:32.335846] [WARN ] [REMOTE ] RVT: No data returned for month 2025-10 [2025-10-01T21:20:32.335961] [FATAL] [REMOTE ] RVT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:20:32.336069] [FATAL] [MAIN ] RVT: Failed to fetch primary data. [2025-10-01T21:20:32.336143] [WARN ] [MAIN ] RVT: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:20:32.336215] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-01T21:20:32.336330] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-01T21:20:32.336381] [INFO ] [LOCAL ] RVT: Starting deletion of derivative data. [2025-10-01T21:20:32.336807] [DEBUG] [LOCAL ] RVT: Deleted derivative data file. [2025-10-01T21:20:32.336903] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 23.2s. Estimated remaining: 1h 14m 59s. Rate: 7.1 symbols/min [2025-10-01T21:20:32.532554] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:20:32.532912] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-01T21:20:32.532972] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-01T21:20:32.533086] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-01T21:20:32.533130] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-01T21:20:32.533174] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-01T21:20:32.533208] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-01T21:20:32.918752] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-01T21:20:32.966976] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:20:32.994462] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T21:20:33.038584] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-01T21:20:33.702378] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-01T21:20:34.502431] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-01T21:20:34.748743] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T21:20:35.288891] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T21:20:35.302352] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-01T21:20:36.057739] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T21:20:36.102360] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-01T21:20:36.902365] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-01T21:20:36.928889] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T21:20:37.703823] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-01T21:20:38.342375] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T21:20:38.502387] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-01T21:20:38.578357] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-01T21:20:38.781818] [DEBUG] [REMOTE ] RVLV: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:20:38.782143] [WARN ] [REMOTE ] RVLV: No data returned for month 2025-10 [2025-10-01T21:20:38.782235] [FATAL] [REMOTE ] RVLV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:20:38.782381] [FATAL] [MAIN ] RVLV: Failed to fetch primary data. [2025-10-01T21:20:38.782451] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:20:38.782535] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-01T21:20:38.782628] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-01T21:20:38.782720] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-01T21:20:38.782790] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-01T21:20:38.782841] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVLV took 29.6s. Estimated remaining: 1h 14m 50s. Rate: 7.1 symbols/min [2025-10-01T21:20:38.983809] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:20:39.025320] [DEBUG] [LOCAL ] RWT: Loaded 40864 existing records from primary storage. [2025-10-01T21:20:39.025962] [INFO ] [MAIN ] RWT: Loaded 40864 existing records. [2025-10-01T21:20:39.233485] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:20:39.233956] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-01T21:20:39.234018] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-01T21:20:39.235983] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-01T21:20:39.236047] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-01T21:20:39.302899] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-01T21:20:39.452391] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T21:20:39.715536] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:20:40.102388] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-01T21:20:40.362146] [DEBUG] [REMOTE ] RTO: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:20:40.362488] [WARN ] [REMOTE ] RTO: No data returned for month 2025-10 [2025-10-01T21:20:40.362580] [FATAL] [REMOTE ] RTO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:20:40.362701] [FATAL] [MAIN ] RTO: Failed to fetch primary data. [2025-10-01T21:20:40.362775] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:20:40.362850] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-01T21:20:40.362915] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-01T21:20:40.362952] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-01T21:20:40.363257] [DEBUG] [LOCAL ] RTO: Deleted derivative data file. [2025-10-01T21:20:40.363354] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTO took 31.2s. Estimated remaining: 1h 14m 40s. Rate: 7.1 symbols/min [2025-10-01T21:20:40.560336] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:20:40.560529] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-01T21:20:40.560569] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-01T21:20:40.560740] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-01T21:20:40.560793] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-01T21:20:40.560838] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-01T21:20:40.560873] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-01T21:20:40.902915] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-01T21:20:40.977639] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:20:41.006888] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T21:20:41.702382] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-01T21:20:41.999007] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-01T21:20:42.262385] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T21:20:42.502392] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-01T21:20:42.865158] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-01T21:20:43.302389] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-01T21:20:44.102382] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-01T21:20:44.582115] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-01T21:20:44.902382] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-01T21:20:45.325053] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T21:20:45.702406] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-01T21:20:45.771907] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T21:20:46.502389] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-01T21:20:47.302405] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-01T21:20:47.658971] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T21:20:47.740503] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T21:20:48.102417] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-01T21:20:48.776201] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T21:20:48.902388] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-01T21:20:49.416197] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T21:20:49.702395] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-01T21:20:50.176155] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T21:20:50.463336] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T21:20:50.502360] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-01T21:20:50.944728] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T21:20:51.302430] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-01T21:20:52.102408] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-01T21:20:52.540622] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T21:20:52.902353] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-01T21:20:53.024506] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T21:20:53.149174] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-01T21:20:53.702432] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-01T21:20:54.502391] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-01T21:20:54.840717] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-01T21:20:55.302362] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-01T21:20:55.422053] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T21:20:56.102395] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-01T21:20:56.902374] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-01T21:20:57.206098] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T21:20:57.473815] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T21:20:57.702395] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-01T21:20:57.923390] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T21:20:58.502432] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-01T21:20:59.014048] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-01T21:20:59.253308] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-01T21:20:59.302355] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-01T21:21:00.102395] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-01T21:21:00.902391] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-01T21:21:01.183462] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T21:21:01.283198] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-01T21:21:01.283921] [INFO ] [REMOTE ] RWTN: Full fetch complete (3132 records). [2025-10-01T21:21:01.284014] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-01T21:21:01.478514] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-01T21:21:01.478830] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:21:01.478907] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:21:01.478958] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-01T21:21:01.479014] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-01T21:21:01.479049] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-01T21:21:01.479103] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-01T21:21:01.479195] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RWTN took 21.1s. Estimated remaining: 1h 14m 35s. Rate: 7.1 symbols/min [2025-10-01T21:21:01.667003] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:01.667204] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-01T21:21:01.667289] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-01T21:21:01.667431] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-01T21:21:01.667474] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-01T21:21:01.667517] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-01T21:21:01.667554] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-01T21:21:01.707462] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-01T21:21:01.736495] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-01T21:21:01.766507] [INFO ] [REMOTE ] RTX: Full fetch complete (77733 records). [2025-10-01T21:21:01.777042] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-01T21:21:02.502880] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-01T21:21:02.528067] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:02.643772] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-01T21:21:02.643906] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-01T21:21:02.645422] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-01T21:21:02.645572] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-01T21:21:02.647616] [DEBUG] [LOCAL ] RTX: Trimmed 77733 records to 53707 (keeping 200 days of data) [2025-10-01T21:21:03.029431] [DEBUG] [LOCAL ] RTX: Primary data saved (53707 records). [2025-10-01T21:21:03.029590] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-01T21:21:03.029706] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RTX took 53.9s. Estimated remaining: 1h 14m 24s. Rate: 7.1 symbols/min [2025-10-01T21:21:03.226794] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:03.227126] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-01T21:21:03.227223] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-01T21:21:03.227679] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-01T21:21:03.241421] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-01T21:21:03.249818] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-01T21:21:03.250510] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-01T21:21:03.251489] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T21:21:03.306520] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-01T21:21:03.697785] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:03.813898] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-01T21:21:03.845628] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T21:21:04.102414] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-01T21:21:04.654939] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-01T21:21:04.902375] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-01T21:21:05.702416] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-01T21:21:05.908525] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:21:05.908908] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-01T21:21:05.909002] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:21:05.909055] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-01T21:21:05.909092] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:21:05.909156] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-01T21:21:05.909222] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-01T21:21:05.909260] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-01T21:21:05.909300] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-01T21:21:05.909349] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWTP took 2.9s. Estimated remaining: 1h 14m 14s. Rate: 7.1 symbols/min [2025-10-01T21:21:06.108774] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:06.158669] [DEBUG] [LOCAL ] RXO: Loaded 47822 existing records from primary storage. [2025-10-01T21:21:06.159048] [INFO ] [MAIN ] RXO: Loaded 47822 existing records. [2025-10-01T21:21:06.387777] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:21:06.388058] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-01T21:21:06.388116] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-01T21:21:06.389405] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-01T21:21:06.389470] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-01T21:21:06.504871] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-01T21:21:06.816594] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:06.847486] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T21:21:07.302413] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-01T21:21:07.762031] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-01T21:21:08.102455] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-01T21:21:08.228582] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T21:21:08.902406] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-01T21:21:09.513436] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T21:21:09.702396] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-01T21:21:10.156351] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T21:21:10.502463] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-01T21:21:10.667113] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T21:21:10.942400] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T21:21:11.302403] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-01T21:21:11.628511] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-01T21:21:12.102408] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-01T21:21:12.461748] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-01T21:21:12.902393] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-01T21:21:13.702431] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-01T21:21:14.502413] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-01T21:21:14.553528] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T21:21:15.013162] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T21:21:15.109607] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T21:21:15.302383] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-01T21:21:15.781334] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-01T21:21:16.102409] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-01T21:21:16.902435] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-01T21:21:17.641245] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T21:21:17.702437] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-01T21:21:18.030217] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T21:21:18.032090] [INFO ] [REMOTE ] RVTY: Full fetch complete (66670 records). [2025-10-01T21:21:18.032219] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-01T21:21:18.352363] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T21:21:18.519302] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-01T21:21:18.544299] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-10-01T21:21:18.544380] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-10-01T21:21:18.545922] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-10-01T21:21:18.546100] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-10-01T21:21:18.548401] [DEBUG] [LOCAL ] RVTY: Trimmed 66670 records to 47521 (keeping 200 days of data) [2025-10-01T21:21:18.890352] [DEBUG] [LOCAL ] RVTY: Primary data saved (47521 records). [2025-10-01T21:21:18.890493] [INFO ] [MAIN ] RVTY: Full history saved. [2025-10-01T21:21:18.890570] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RVTY took 46.6s. Estimated remaining: 1h 14m 7s. Rate: 7.1 symbols/min [2025-10-01T21:21:19.097267] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:19.155572] [DEBUG] [LOCAL ] RY: Loaded 47856 existing records from primary storage. [2025-10-01T21:21:19.156008] [INFO ] [MAIN ] RY: Loaded 47856 existing records. [2025-10-01T21:21:19.307446] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-01T21:21:19.413324] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:21:19.413835] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-01T21:21:19.413903] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-01T21:21:19.415459] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-01T21:21:19.415525] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-01T21:21:19.480000] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T21:21:19.510506] [INFO ] [REMOTE ] RWT: Full fetch complete (58824 records). [2025-10-01T21:21:19.537026] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-01T21:21:19.805785] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-01T21:21:19.840627] [INFO ] [REMOTE ] RWTO: Full fetch complete (4804 records). [2025-10-01T21:21:19.879183] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-01T21:21:20.107498] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-01T21:21:20.650974] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:20.693704] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T21:21:20.714328] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:21:20.736948] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-01T21:21:20.736758] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:21:20.737123] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-01T21:21:20.737197] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-01T21:21:20.737390] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-01T21:21:20.738678] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-01T21:21:20.738764] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-01T21:21:20.737515] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-01T21:21:20.739081] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-01T21:21:20.739230] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTO took 19.3s. Estimated remaining: 1h 13m 57s. Rate: 7.1 symbols/min [2025-10-01T21:21:20.842486] [DEBUG] [LOCAL ] RWT: Trimmed 58824 records to 40850 (keeping 200 days of data) [2025-10-01T21:21:20.927870] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-01T21:21:21.046926] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:21.210578] [DEBUG] [LOCAL ] RYAM: Loaded 35067 existing records from primary storage. [2025-10-01T21:21:21.212080] [INFO ] [MAIN ] RYAM: Loaded 35067 existing records. [2025-10-01T21:21:21.459263] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:21:21.464927] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-01T21:21:21.465365] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-01T21:21:21.470031] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-01T21:21:21.475665] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-01T21:21:21.497055] [DEBUG] [LOCAL ] RWT: Primary data saved (40850 records). [2025-10-01T21:21:21.529436] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-01T21:21:21.554209] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RWT took 42.8s. Estimated remaining: 1h 13m 46s. Rate: 7.1 symbols/min [2025-10-01T21:21:22.074894] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:22.187074] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:22.187760] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-01T21:21:22.225185] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-01T21:21:22.271537] [DEBUG] [LOCAL ] RYAN: Loaded 44426 existing records from primary storage. [2025-10-01T21:21:22.271897] [INFO ] [MAIN ] RYAN: Loaded 44426 existing records. [2025-10-01T21:21:22.493182] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:21:22.493447] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-01T21:21:22.493504] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-01T21:21:22.494803] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-01T21:21:22.494866] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-01T21:21:22.510274] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-01T21:21:22.942158] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:23.302394] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-01T21:21:23.566550] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T21:21:24.102363] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-01T21:21:24.145752] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T21:21:24.840105] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T21:21:24.902399] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-01T21:21:25.283616] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T21:21:25.702396] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-01T21:21:25.916377] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (4.99 seconds). [2025-10-01T21:21:26.502364] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-01T21:21:26.588143] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T21:21:27.307632] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-01T21:21:27.321671] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T21:21:28.107476] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-01T21:21:28.121002] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T21:21:28.590742] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T21:21:28.902373] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-01T21:21:29.280145] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-01T21:21:29.702405] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-01T21:21:30.374025] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T21:21:30.502409] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-01T21:21:31.273087] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T21:21:31.302349] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-01T21:21:31.989309] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T21:21:32.102413] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-01T21:21:32.677824] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T21:21:32.902391] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-01T21:21:33.390025] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T21:21:33.702380] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-01T21:21:34.502413] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-01T21:21:35.112551] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T21:21:35.244411] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-01T21:21:35.302376] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-01T21:21:36.102358] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-01T21:21:36.155702] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T21:21:36.283088] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T21:21:36.902391] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-01T21:21:37.702400] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-01T21:21:37.819521] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T21:21:38.255170] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T21:21:38.502379] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-01T21:21:38.904611] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-01T21:21:38.906294] [INFO ] [REMOTE ] RXO: Full fetch complete (68356 records). [2025-10-01T21:21:38.906405] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-01T21:21:39.309702] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-01T21:21:39.333948] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-01T21:21:39.334065] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-01T21:21:39.335163] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-01T21:21:39.335228] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-01T21:21:39.337030] [DEBUG] [LOCAL ] RXO: Trimmed 68356 records to 47845 (keeping 200 days of data) [2025-10-01T21:21:39.637147] [DEBUG] [LOCAL ] RXO: Primary data saved (47845 records). [2025-10-01T21:21:39.637297] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-01T21:21:39.637423] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RXO took 33.7s. Estimated remaining: 1h 13m 40s. Rate: 7.1 symbols/min [2025-10-01T21:21:39.827682] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:39.851062] [DEBUG] [LOCAL ] RYI: Loaded 21507 existing records from primary storage. [2025-10-01T21:21:39.851350] [INFO ] [MAIN ] RYI: Loaded 21507 existing records. [2025-10-01T21:21:40.062818] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:21:40.063105] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-01T21:21:40.063273] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-01T21:21:40.064079] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-01T21:21:40.064158] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-01T21:21:40.109383] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-01T21:21:40.484524] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:40.517284] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T21:21:40.652635] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T21:21:40.902377] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-01T21:21:41.702388] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-01T21:21:41.891340] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T21:21:42.276833] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T21:21:42.502395] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-01T21:21:42.690529] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-01T21:21:43.302388] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-01T21:21:44.090560] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T21:21:44.102328] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-01T21:21:44.146411] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T21:21:44.902395] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-01T21:21:45.259995] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T21:21:45.702354] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-01T21:21:45.984164] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T21:21:46.502508] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-01T21:21:47.163761] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T21:21:47.302374] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-01T21:21:47.528054] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T21:21:48.102397] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-01T21:21:48.902422] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-01T21:21:49.084110] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T21:21:49.150859] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T21:21:49.702370] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-01T21:21:50.022682] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T21:21:50.502427] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-01T21:21:51.058308] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T21:21:51.302379] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-01T21:21:51.483615] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T21:21:52.102417] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-01T21:21:52.814618] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T21:21:52.902390] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-01T21:21:53.196298] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T21:21:53.702418] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-01T21:21:53.899780] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T21:21:53.901074] [INFO ] [REMOTE ] RYAM: Full fetch complete (48976 records). [2025-10-01T21:21:53.901183] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-01T21:21:54.324754] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-01T21:21:54.324854] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-01T21:21:54.325812] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-01T21:21:54.325883] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-01T21:21:54.327521] [DEBUG] [LOCAL ] RYAM: Trimmed 48976 records to 35046 (keeping 200 days of data) [2025-10-01T21:21:54.511122] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-01T21:21:54.540887] [DEBUG] [LOCAL ] RYAM: Primary data saved (35046 records). [2025-10-01T21:21:54.541041] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-01T21:21:54.541131] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RYAM took 33.8s. Estimated remaining: 1h 13m 34s. Rate: 7.1 symbols/min [2025-10-01T21:21:54.734178] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:21:54.781521] [DEBUG] [LOCAL ] RYN: Loaded 45615 existing records from primary storage. [2025-10-01T21:21:54.781877] [INFO ] [MAIN ] RYN: Loaded 45615 existing records. [2025-10-01T21:21:54.979599] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:21:54.980109] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-01T21:21:54.980187] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-01T21:21:54.981610] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-01T21:21:54.981702] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-01T21:21:55.111005] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T21:21:55.308234] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-01T21:21:55.413330] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:21:55.967551] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T21:21:56.102345] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-01T21:21:56.489806] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T21:21:56.902401] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-01T21:21:57.702361] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-01T21:21:57.815455] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T21:21:58.403094] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T21:21:58.502437] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-01T21:21:59.257093] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T21:21:59.302361] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-01T21:21:59.623534] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T21:22:00.102446] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-01T21:22:00.456388] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T21:22:00.458222] [INFO ] [REMOTE ] RY: Full fetch complete (68712 records). [2025-10-01T21:22:00.458382] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-01T21:22:00.888600] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-01T21:22:00.888729] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-01T21:22:00.889799] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-01T21:22:00.889869] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-01T21:22:00.891454] [DEBUG] [LOCAL ] RY: Trimmed 68712 records to 47873 (keeping 200 days of data) [2025-10-01T21:22:00.952883] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-01T21:22:01.218811] [DEBUG] [LOCAL ] RY: Primary data saved (47873 records). [2025-10-01T21:22:01.218953] [INFO ] [MAIN ] RY: Full history saved. [2025-10-01T21:22:01.219049] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RY took 42.3s. Estimated remaining: 1h 13m 25s. Rate: 7.1 symbols/min [2025-10-01T21:22:01.408309] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:22:01.417473] [DEBUG] [LOCAL ] RZB: Loaded 6225 existing records from primary storage. [2025-10-01T21:22:01.417723] [INFO ] [MAIN ] RZB: Loaded 6225 existing records. [2025-10-01T21:22:01.616984] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:22:01.617385] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-01T21:22:01.617465] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-01T21:22:01.617887] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-01T21:22:01.617949] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-01T21:22:01.705069] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-01T21:22:01.919573] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T21:22:02.068664] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:22:02.422934] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T21:22:02.424210] [INFO ] [REMOTE ] RYI: Full fetch complete (32366 records). [2025-10-01T21:22:02.424340] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-01T21:22:02.508869] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-01T21:22:02.878921] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T21:22:03.138472] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-01T21:22:03.138704] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-01T21:22:03.139774] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-01T21:22:03.139859] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-01T21:22:03.141015] [DEBUG] [LOCAL ] RYI: Trimmed 32366 records to 21545 (keeping 200 days of data) [2025-10-01T21:22:03.297881] [DEBUG] [LOCAL ] RYI: Primary data saved (21545 records). [2025-10-01T21:22:03.301897] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-01T21:22:03.302102] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYI took 23.7s. Estimated remaining: 1h 13m 14s. Rate: 7.1 symbols/min [2025-10-01T21:22:03.298599] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-01T21:22:03.302384] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-01T21:22:03.516892] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:22:03.527077] [DEBUG] [LOCAL ] RZC: Loaded 6778 existing records from primary storage. [2025-10-01T21:22:03.527329] [INFO ] [MAIN ] RZC: Loaded 6778 existing records. [2025-10-01T21:22:03.754303] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:22:03.754522] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-01T21:22:03.754571] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-01T21:22:03.754960] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-01T21:22:03.755049] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-01T21:22:04.117051] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-01T21:22:04.174086] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:22:04.435550] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T21:22:04.437155] [INFO ] [REMOTE ] RYAN: Full fetch complete (63876 records). [2025-10-01T21:22:04.437253] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-01T21:22:04.874782] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-01T21:22:04.874886] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-01T21:22:04.875940] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-01T21:22:04.876007] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-01T21:22:04.877464] [DEBUG] [LOCAL ] RYAN: Trimmed 63876 records to 44469 (keeping 200 days of data) [2025-10-01T21:22:04.936202] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-01T21:22:05.180103] [DEBUG] [LOCAL ] RYAN: Primary data saved (44469 records). [2025-10-01T21:22:05.180300] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-01T21:22:05.180421] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYAN took 43.6s. Estimated remaining: 1h 13m 4s. Rate: 7.1 symbols/min [2025-10-01T21:22:05.376353] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:22:05.434841] [DEBUG] [LOCAL ] S: Loaded 53535 existing records from primary storage. [2025-10-01T21:22:05.435200] [INFO ] [MAIN ] S: Loaded 53535 existing records. [2025-10-01T21:22:05.652551] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:22:05.652967] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-01T21:22:05.653224] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-01T21:22:05.663990] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-01T21:22:05.682886] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-01T21:22:05.707500] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-01T21:22:05.709400] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T21:22:05.788199] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T21:22:06.130996] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:22:06.394042] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T21:22:06.502399] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-01T21:22:07.069327] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T21:22:07.302379] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-01T21:22:07.763413] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T21:22:08.102424] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-01T21:22:08.902423] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-01T21:22:09.702365] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-01T21:22:09.821691] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T21:22:10.337138] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T21:22:10.502415] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-01T21:22:10.767106] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T21:22:11.247872] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T21:22:11.302431] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-01T21:22:12.026833] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T21:22:12.102441] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-01T21:22:12.902385] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-01T21:22:13.577926] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-01T21:22:13.702516] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-01T21:22:13.802849] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:22:14.502389] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-01T21:22:14.982955] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-01T21:22:15.302443] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-01T21:22:15.789801] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-01T21:22:15.910110] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-01T21:22:16.102385] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-01T21:22:16.673256] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T21:22:16.902417] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-01T21:22:17.438538] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-01T21:22:17.702407] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-01T21:22:18.502401] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-01T21:22:18.672536] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T21:22:19.302420] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-01T21:22:20.102421] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-01T21:22:20.354749] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-01T21:22:20.732599] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T21:22:20.902421] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-01T21:22:20.960493] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T21:22:21.702399] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-01T21:22:22.176153] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-01T21:22:22.502376] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-01T21:22:22.998903] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-01T21:22:23.055421] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T21:22:23.302389] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-01T21:22:23.631809] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-01T21:22:23.633071] [INFO ] [REMOTE ] RZB: Full fetch complete (8665 records). [2025-10-01T21:22:23.633162] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-01T21:22:24.114318] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-01T21:22:24.167613] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-01T21:22:24.167729] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-01T21:22:24.168173] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-01T21:22:24.168249] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-01T21:22:24.169503] [DEBUG] [LOCAL ] RZB: Trimmed 8665 records to 6201 (keeping 200 days of data) [2025-10-01T21:22:24.215522] [DEBUG] [LOCAL ] RZB: Primary data saved (6201 records). [2025-10-01T21:22:24.215698] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-01T21:22:24.215895] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZB took 23.0s. Estimated remaining: 1h 12m 59s. Rate: 7.1 symbols/min [2025-10-01T21:22:24.412693] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:22:24.462995] [DEBUG] [LOCAL ] SA: Loaded 43298 existing records from primary storage. [2025-10-01T21:22:24.463337] [INFO ] [MAIN ] SA: Loaded 43298 existing records. [2025-10-01T21:22:24.657825] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:22:24.658095] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-01T21:22:24.658157] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-01T21:22:24.660603] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-01T21:22:24.660715] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-01T21:22:24.907542] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-01T21:22:25.064206] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:22:25.489821] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-01T21:22:25.649522] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T21:22:25.702358] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-01T21:22:26.418659] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T21:22:26.502397] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-01T21:22:27.302414] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-01T21:22:28.102424] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-01T21:22:28.160048] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T21:22:28.859507] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T21:22:28.902345] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-01T21:22:29.702392] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-01T21:22:29.743186] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T21:22:30.390430] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-01T21:22:30.502543] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-01T21:22:30.634210] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T21:22:30.853533] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-01T21:22:30.854414] [INFO ] [REMOTE ] RZC: Full fetch complete (9867 records). [2025-10-01T21:22:30.854504] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-01T21:22:31.314365] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-01T21:22:31.307876] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-01T21:22:31.314495] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-01T21:22:31.315594] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-01T21:22:31.315692] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-01T21:22:31.316349] [DEBUG] [LOCAL ] RZC: Trimmed 9867 records to 6792 (keeping 200 days of data) [2025-10-01T21:22:31.359882] [DEBUG] [LOCAL ] RZC: Primary data saved (6792 records). [2025-10-01T21:22:31.360017] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-01T21:22:31.360118] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RZC took 28.1s. Estimated remaining: 1h 12m 50s. Rate: 7.1 symbols/min [2025-10-01T21:22:31.548306] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:22:31.559588] [DEBUG] [LOCAL ] SABA: Loaded 9219 existing records from primary storage. [2025-10-01T21:22:31.559864] [INFO ] [MAIN ] SABA: Loaded 9219 existing records. [2025-10-01T21:22:31.752009] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:22:31.752254] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-01T21:22:31.752305] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-01T21:22:31.752676] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-01T21:22:31.752746] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-01T21:22:32.110200] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-01T21:22:32.142492] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:22:32.902411] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-01T21:22:33.190995] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-01T21:22:33.663399] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T21:22:33.702428] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-01T21:22:34.170347] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T21:22:34.502540] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-01T21:22:34.588559] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T21:22:35.302380] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-01T21:22:35.952921] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T21:22:36.102394] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-01T21:22:36.293674] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T21:22:36.902585] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-01T21:22:37.695588] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T21:22:37.704682] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-01T21:22:38.502413] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-01T21:22:39.302416] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-01T21:22:39.375486] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T21:22:39.927918] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-01T21:22:40.102400] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-01T21:22:40.372816] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T21:22:40.374570] [INFO ] [REMOTE ] RYN: Full fetch complete (64912 records). [2025-10-01T21:22:40.374715] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-01T21:22:40.819961] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-01T21:22:40.820050] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-01T21:22:40.821065] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-01T21:22:40.821259] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-01T21:22:40.822634] [DEBUG] [LOCAL ] RYN: Trimmed 64912 records to 45585 (keeping 200 days of data) [2025-10-01T21:22:40.924716] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-01T21:22:40.941733] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T21:22:41.155175] [DEBUG] [LOCAL ] RYN: Primary data saved (45585 records). [2025-10-01T21:22:41.155324] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-01T21:22:41.155444] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. RYN took 46.6s. Estimated remaining: 1h 12m 42s. Rate: 7.1 symbols/min [2025-10-01T21:22:41.341449] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:22:41.377864] [DEBUG] [LOCAL ] SAFE: Loaded 30266 existing records from primary storage. [2025-10-01T21:22:41.378207] [INFO ] [MAIN ] SAFE: Loaded 30266 existing records. [2025-10-01T21:22:41.602281] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:22:41.602565] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-01T21:22:41.602668] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-01T21:22:41.604046] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-01T21:22:41.604158] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-01T21:22:41.702995] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-01T21:22:42.136076] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:22:42.152660] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (5.25 seconds). [2025-10-01T21:22:42.502403] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-01T21:22:42.535148] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T21:22:43.088544] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-01T21:22:43.302409] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-01T21:22:43.737145] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T21:22:44.102357] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-01T21:22:44.168423] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T21:22:44.711157] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T21:22:44.902372] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-01T21:22:45.692402] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T21:22:45.702336] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-01T21:22:46.230446] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-01T21:22:46.502422] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-01T21:22:47.302437] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-01T21:22:47.914415] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T21:22:48.102400] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-01T21:22:48.902399] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-01T21:22:49.490074] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-01T21:22:49.702392] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-01T21:22:49.733806] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T21:22:49.859823] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T21:22:50.502400] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-01T21:22:51.099024] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T21:22:51.302411] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-01T21:22:52.059594] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T21:22:52.102380] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-01T21:22:52.902432] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-01T21:22:53.702415] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-01T21:23:07.020404] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (15.72 seconds). [2025-10-01T21:23:07.022185] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-10-01T21:23:07.022411] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-01T21:23:07.490157] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-01T21:23:07.490514] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-01T21:23:07.491693] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-01T21:23:07.491769] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-01T21:23:07.493819] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 53535 (keeping 200 days of data) [2025-10-01T21:23:07.840758] [DEBUG] [LOCAL ] S: Primary data saved (53535 records). [2025-10-01T21:23:07.840912] [INFO ] [MAIN ] S: Full history saved. [2025-10-01T21:23:07.841222] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. S took 1m 3s. Estimated remaining: 1h 12m 38s. Rate: 7.1 symbols/min [2025-10-01T21:23:08.041504] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:08.066169] [DEBUG] [LOCAL ] SAH: Loaded 21955 existing records from primary storage. [2025-10-01T21:23:08.066735] [INFO ] [MAIN ] SAH: Loaded 21955 existing records. [2025-10-01T21:23:08.271028] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:23:08.271474] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-01T21:23:08.271561] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-01T21:23:08.280725] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-01T21:23:08.294003] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-01T21:23:08.294788] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (14.59 seconds). [2025-10-01T21:23:08.404499] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-01T21:23:08.712277] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:08.712629] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-01T21:23:09.395623] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (16.49 seconds). [2025-10-01T21:23:09.396793] [INFO ] [REMOTE ] SABA: Full fetch complete (15539 records). [2025-10-01T21:23:09.396873] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-01T21:23:09.747793] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T21:23:09.772799] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-01T21:23:09.841948] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-01T21:23:09.842041] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-01T21:23:09.842544] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-01T21:23:09.842617] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-01T21:23:09.861609] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T21:23:09.867880] [DEBUG] [LOCAL ] SABA: Trimmed 15539 records to 9259 (keeping 200 days of data) [2025-10-01T21:23:09.869257] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-01T21:23:09.929895] [DEBUG] [LOCAL ] SABA: Primary data saved (9259 records). [2025-10-01T21:23:09.930024] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-01T21:23:09.930132] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SABA took 38.6s. Estimated remaining: 1h 12m 28s. Rate: 7.1 symbols/min [2025-10-01T21:23:10.124550] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:10.124768] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-01T21:23:10.124821] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-01T21:23:10.124934] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-01T21:23:10.124996] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-01T21:23:10.125071] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-01T21:23:10.125119] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-01T21:23:10.547748] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:10.548241] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-01T21:23:10.687567] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T21:23:10.692467] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-01T21:23:11.238989] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-01T21:23:11.240241] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-01T21:23:11.259496] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T21:23:11.266211] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-01T21:23:11.500675] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (19.40 seconds). [2025-10-01T21:23:11.517555] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-01T21:23:11.548635] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T21:23:11.554618] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-01T21:23:11.585272] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-01T21:23:11.586229] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-01T21:23:11.852718] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-01T21:23:11.853691] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-01T21:23:12.183791] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-01T21:23:12.184741] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-01T21:23:12.263468] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T21:23:12.271370] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-01T21:23:12.488155] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T21:23:12.494110] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-01T21:23:12.519616] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-01T21:23:12.520577] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-01T21:23:12.891317] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-01T21:23:12.892435] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-01T21:23:13.189597] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-01T21:23:13.190555] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-01T21:23:13.228781] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T21:23:13.237103] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-01T21:23:13.270179] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T21:23:13.284370] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-01T21:23:13.529007] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-01T21:23:13.530013] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-01T21:23:13.826387] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T21:23:13.834530] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-01T21:23:13.852598] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T21:23:13.853677] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-01T21:23:14.471632] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T21:23:14.478219] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-01T21:23:14.591578] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T21:23:14.593243] [INFO ] [REMOTE ] SA: Full fetch complete (62393 records). [2025-10-01T21:23:14.593455] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-01T21:23:15.059122] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-01T21:23:15.059244] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-01T21:23:15.068856] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-01T21:23:15.068952] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-01T21:23:15.070947] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T21:23:15.077100] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-01T21:23:15.082705] [DEBUG] [LOCAL ] SA: Trimmed 62393 records to 43403 (keeping 200 days of data) [2025-10-01T21:23:15.352240] [DEBUG] [LOCAL ] SA: Primary data saved (43403 records). [2025-10-01T21:23:15.352370] [INFO ] [MAIN ] SA: Full history saved. [2025-10-01T21:23:15.352481] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SA took 51.1s. Estimated remaining: 1h 12m 19s. Rate: 7.1 symbols/min [2025-10-01T21:23:15.535680] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:15.559223] [DEBUG] [LOCAL ] SAM: Loaded 21341 existing records from primary storage. [2025-10-01T21:23:15.559483] [INFO ] [MAIN ] SAM: Loaded 21341 existing records. [2025-10-01T21:23:15.759330] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:23:15.759561] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-01T21:23:15.759611] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-01T21:23:15.760367] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-01T21:23:15.760429] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-01T21:23:16.178736] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:16.179086] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-01T21:23:16.204489] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T21:23:16.209101] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-01T21:23:16.915326] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-01T21:23:16.916455] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-01T21:23:17.202309] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T21:23:17.203198] [INFO ] [REMOTE ] SAJ: Full fetch complete (923 records). [2025-10-01T21:23:17.203284] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-01T21:23:17.420330] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-01T21:23:17.420801] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:23:17.421139] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:23:17.431123] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-01T21:23:17.432183] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T21:23:17.437726] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-01T21:23:17.440920] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-01T21:23:17.449903] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-01T21:23:17.449769] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-01T21:23:17.451928] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAJ took 7.5s. Estimated remaining: 1h 12m 8s. Rate: 7.1 symbols/min [2025-10-01T21:23:17.454111] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T21:23:17.661048] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:17.702696] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-01T21:23:17.729253] [DEBUG] [LOCAL ] SAN: Loaded 53004 existing records from primary storage. [2025-10-01T21:23:17.729731] [INFO ] [MAIN ] SAN: Loaded 53004 existing records. [2025-10-01T21:23:17.945442] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:23:17.945693] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-01T21:23:17.945753] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-01T21:23:17.947351] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-01T21:23:17.947415] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-01T21:23:18.371978] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:18.502390] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-01T21:23:18.639054] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T21:23:18.858340] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (4.38 seconds). [2025-10-01T21:23:18.962923] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T21:23:19.302380] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-01T21:23:20.102398] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-01T21:23:20.289335] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T21:23:20.324247] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T21:23:20.902399] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-01T21:23:21.364204] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T21:23:21.702391] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-01T21:23:22.245831] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T21:23:22.502390] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-01T21:23:22.863257] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T21:23:23.302416] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-01T21:23:23.594364] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T21:23:24.102362] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-01T21:23:24.416204] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T21:23:24.902382] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-01T21:23:25.507089] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-01T21:23:25.508089] [INFO ] [REMOTE ] SAH: Full fetch complete (30490 records). [2025-10-01T21:23:25.508163] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-01T21:23:25.717583] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-01T21:23:25.948824] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-01T21:23:25.948932] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-01T21:23:25.949753] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-01T21:23:25.949966] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-01T21:23:25.977679] [DEBUG] [LOCAL ] SAH: Trimmed 30490 records to 21928 (keeping 200 days of data) [2025-10-01T21:23:25.979479] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T21:23:26.138672] [DEBUG] [LOCAL ] SAH: Primary data saved (21928 records). [2025-10-01T21:23:26.138833] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-01T21:23:26.138952] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 18.3s. Estimated remaining: 1h 11m 60s. Rate: 7.1 symbols/min [2025-10-01T21:23:26.334829] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:26.394734] [DEBUG] [LOCAL ] SAND: Loaded 51807 existing records from primary storage. [2025-10-01T21:23:26.395076] [INFO ] [MAIN ] SAND: Loaded 51807 existing records. [2025-10-01T21:23:26.507676] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-01T21:23:26.595294] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:23:26.596032] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-01T21:23:26.596083] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-01T21:23:26.598779] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-01T21:23:26.598842] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-01T21:23:26.711767] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-01T21:23:26.713947] [INFO ] [REMOTE ] SAFE: Full fetch complete (45062 records). [2025-10-01T21:23:26.729929] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-01T21:23:27.342800] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:27.323781] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-01T21:23:27.504909] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-01T21:23:27.504990] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-01T21:23:27.505814] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-01T21:23:27.505877] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-01T21:23:27.507122] [DEBUG] [LOCAL ] SAFE: Trimmed 45062 records to 30222 (keeping 200 days of data) [2025-10-01T21:23:27.719586] [DEBUG] [LOCAL ] SAFE: Primary data saved (30222 records). [2025-10-01T21:23:27.719753] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-01T21:23:27.719867] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAFE took 46.6s. Estimated remaining: 1h 11m 49s. Rate: 7.1 symbols/min [2025-10-01T21:23:27.917454] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:27.968084] [DEBUG] [LOCAL ] SAP: Loaded 49997 existing records from primary storage. [2025-10-01T21:23:27.968392] [INFO ] [MAIN ] SAP: Loaded 49997 existing records. [2025-10-01T21:23:28.107460] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-01T21:23:28.178582] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:23:28.179004] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-01T21:23:28.179081] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-01T21:23:28.180827] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-01T21:23:28.180890] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-01T21:23:28.479498] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T21:23:28.486160] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T21:23:28.651941] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:28.902390] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-01T21:23:29.702353] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-01T21:23:29.894560] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T21:23:30.502355] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-01T21:23:30.726987] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T21:23:31.089085] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T21:23:31.302379] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-01T21:23:31.622806] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T21:23:32.102396] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-01T21:23:32.902390] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-01T21:23:33.202985] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-01T21:23:33.518943] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T21:23:33.702408] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-01T21:23:34.255499] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T21:23:34.502435] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-01T21:23:34.863906] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T21:23:35.302387] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-01T21:23:36.112931] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-01T21:23:36.116394] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T21:23:36.168873] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T21:23:36.902409] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-01T21:23:37.702359] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-01T21:23:38.071399] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-01T21:23:38.502361] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-01T21:23:38.585224] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T21:23:39.302369] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-01T21:23:39.684714] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T21:23:40.102391] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-01T21:23:40.381280] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T21:23:40.634587] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T21:23:40.902406] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-01T21:23:40.985698] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-01T21:23:40.987007] [INFO ] [REMOTE ] SAM: Full fetch complete (30640 records). [2025-10-01T21:23:40.987136] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-01T21:23:41.408237] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-01T21:23:41.408379] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-01T21:23:41.409789] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-01T21:23:41.409874] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-01T21:23:41.411134] [DEBUG] [LOCAL ] SAM: Trimmed 30640 records to 21433 (keeping 200 days of data) [2025-10-01T21:23:41.562918] [DEBUG] [LOCAL ] SAM: Primary data saved (21433 records). [2025-10-01T21:23:41.563152] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-01T21:23:41.563292] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAM took 26.2s. Estimated remaining: 1h 11m 42s. Rate: 7.1 symbols/min [2025-10-01T21:23:41.707570] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-01T21:23:41.767257] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:41.767453] [DEBUG] [LOCAL ] SAR: No existing data file found in primary storage. [2025-10-01T21:23:41.767507] [WARN ] [MAIN ] SAR: No existing data found, performing full refresh instead. [2025-10-01T21:23:41.767619] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-01T21:23:41.767694] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-01T21:23:41.767754] [DEBUG] [LOCAL ] SAR: No primary data file found to delete. [2025-10-01T21:23:41.767791] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-01T21:23:42.192091] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:42.502363] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-01T21:23:42.856330] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T21:23:43.302353] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-01T21:23:43.499820] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T21:23:44.102339] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-01T21:23:44.432077] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T21:23:44.902374] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-01T21:23:45.044793] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T21:23:45.528018] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T21:23:45.702369] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-01T21:23:45.864134] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T21:23:46.502462] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-01T21:23:47.281494] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T21:23:47.302451] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-01T21:23:47.689878] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T21:23:48.102384] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-01T21:23:48.902408] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-01T21:23:49.237692] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T21:23:49.682839] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T21:23:49.702364] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-01T21:23:50.502410] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-01T21:23:50.579473] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T21:23:50.953764] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T21:23:51.302379] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-01T21:23:52.102367] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-01T21:23:52.285439] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T21:23:52.475795] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T21:23:52.477329] [INFO ] [REMOTE ] SAN: Full fetch complete (76246 records). [2025-10-01T21:23:52.477426] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-01T21:23:52.898231] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-01T21:23:52.898330] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-01T21:23:52.899476] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-01T21:23:52.899550] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-01T21:23:52.901101] [DEBUG] [LOCAL ] SAN: Trimmed 76246 records to 52993 (keeping 200 days of data) [2025-10-01T21:23:52.902408] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-01T21:23:53.207341] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T21:23:53.257392] [DEBUG] [LOCAL ] SAN: Primary data saved (52993 records). [2025-10-01T21:23:53.257555] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-01T21:23:53.257682] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAN took 35.8s. Estimated remaining: 1h 11m 35s. Rate: 7.1 symbols/min [2025-10-01T21:23:53.443926] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:23:53.491738] [DEBUG] [LOCAL ] SARO: Loaded 48623 existing records from primary storage. [2025-10-01T21:23:53.492088] [INFO ] [MAIN ] SARO: Loaded 48623 existing records. [2025-10-01T21:23:53.712290] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-01T21:23:53.720894] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:23:53.722147] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-01T21:23:53.722220] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-01T21:23:53.724465] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-01T21:23:53.724535] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-01T21:23:54.152794] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:23:54.502368] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-01T21:23:54.568005] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-01T21:23:54.778139] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-01T21:23:55.302399] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-01T21:23:56.041517] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T21:23:56.102395] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-01T21:23:56.902393] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-01T21:23:57.284995] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-01T21:23:57.601024] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T21:23:57.702345] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-01T21:23:57.945290] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-01T21:23:58.502403] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-01T21:23:59.302371] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-01T21:23:59.338894] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T21:23:59.499275] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-01T21:24:00.102404] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-01T21:24:00.902397] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-01T21:24:00.967276] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T21:24:01.387369] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T21:24:01.389078] [INFO ] [REMOTE ] SAND: Full fetch complete (74428 records). [2025-10-01T21:24:01.389319] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-01T21:24:01.707541] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-01T21:24:01.867260] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-01T21:24:01.872690] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-01T21:24:01.879905] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T21:24:01.879169] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-01T21:24:01.880122] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-01T21:24:01.885456] [DEBUG] [LOCAL ] SAND: Trimmed 74428 records to 51813 (keeping 200 days of data) [2025-10-01T21:24:02.229136] [DEBUG] [LOCAL ] SAND: Primary data saved (51813 records). [2025-10-01T21:24:02.229306] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-01T21:24:02.229431] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAND took 36.1s. Estimated remaining: 1h 11m 26s. Rate: 7.1 symbols/min [2025-10-01T21:24:02.420499] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:02.420750] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-01T21:24:02.420834] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-01T21:24:02.420977] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-01T21:24:02.421024] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-01T21:24:02.421109] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-01T21:24:02.421165] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-01T21:24:02.507495] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-01T21:24:02.815725] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:03.302353] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-01T21:24:03.640421] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T21:24:03.824475] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-01T21:24:04.102382] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-01T21:24:04.401535] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T21:24:04.902366] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-01T21:24:05.565516] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T21:24:05.567333] [INFO ] [REMOTE ] SAP: Full fetch complete (71855 records). [2025-10-01T21:24:05.567458] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-01T21:24:05.707469] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-01T21:24:06.012606] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-01T21:24:06.012724] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-01T21:24:06.013817] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-01T21:24:06.013884] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-01T21:24:06.015379] [DEBUG] [LOCAL ] SAP: Trimmed 71855 records to 50011 (keeping 200 days of data) [2025-10-01T21:24:06.113405] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-01T21:24:06.349997] [DEBUG] [LOCAL ] SAP: Primary data saved (50011 records). [2025-10-01T21:24:06.350285] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-01T21:24:06.350431] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAP took 38.6s. Estimated remaining: 1h 11m 17s. Rate: 7.1 symbols/min [2025-10-01T21:24:06.510408] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-01T21:24:06.546411] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:06.546984] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-01T21:24:06.547052] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-01T21:24:06.547190] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-01T21:24:06.547359] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-01T21:24:06.547451] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-01T21:24:06.547600] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-01T21:24:06.697326] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T21:24:06.995545] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:07.302425] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-01T21:24:07.628695] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T21:24:08.102395] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-01T21:24:08.460580] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-01T21:24:08.769144] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T21:24:08.902407] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-01T21:24:09.702406] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-01T21:24:09.884888] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T21:24:10.051231] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-01T21:24:10.502388] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-01T21:24:11.302404] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-01T21:24:11.941861] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-01T21:24:11.942924] [INFO ] [REMOTE ] SAR: Full fetch complete (22649 records). [2025-10-01T21:24:11.943005] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-01T21:24:12.105793] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-01T21:24:12.290476] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T21:24:12.410955] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-01T21:24:12.411040] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-01T21:24:12.411542] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-01T21:24:12.411583] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-01T21:24:12.412374] [DEBUG] [LOCAL ] SAR: Trimmed 22649 records to 16209 (keeping 200 days of data) [2025-10-01T21:24:12.519878] [DEBUG] [LOCAL ] SAR: Primary data saved (16209 records). [2025-10-01T21:24:12.520022] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-01T21:24:12.520101] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAR took 31.0s. Estimated remaining: 1h 11m 8s. Rate: 7.1 symbols/min [2025-10-01T21:24:12.672417] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-01T21:24:12.729147] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:12.729390] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-01T21:24:12.729448] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-01T21:24:12.729575] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-01T21:24:12.729635] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-01T21:24:12.729759] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-01T21:24:12.729801] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-01T21:24:12.905450] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-01T21:24:13.153137] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:13.351774] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-01T21:24:13.702398] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-01T21:24:14.031501] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-01T21:24:14.502394] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-01T21:24:14.875478] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-01T21:24:15.302396] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-01T21:24:16.102397] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-01T21:24:16.492465] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-01T21:24:16.749690] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T21:24:16.902390] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-01T21:24:17.315724] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-01T21:24:17.702398] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-01T21:24:18.053806] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-01T21:24:18.502388] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-01T21:24:18.832903] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-01T21:24:19.302380] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-01T21:24:19.602660] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-01T21:24:20.102381] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-01T21:24:20.445894] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-01T21:24:20.902376] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-01T21:24:21.301027] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-01T21:24:21.702379] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-01T21:24:21.960255] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-01T21:24:22.502379] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-01T21:24:23.302381] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-01T21:24:23.626515] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-01T21:24:23.861737] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T21:24:24.102393] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-01T21:24:24.902389] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-01T21:24:25.240294] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-01T21:24:25.698022] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T21:24:25.707556] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-01T21:24:25.998570] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-01T21:24:26.502377] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-01T21:24:26.942622] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-01T21:24:27.302380] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-01T21:24:27.522886] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-01T21:24:28.102376] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-01T21:24:28.363213] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-01T21:24:28.364017] [INFO ] [REMOTE ] SAT: Full fetch complete (1615 records). [2025-10-01T21:24:28.364089] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-01T21:24:28.566595] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-01T21:24:28.566854] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:24:28.566927] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:24:28.567001] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-01T21:24:28.567069] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-01T21:24:28.567105] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-01T21:24:28.567179] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-01T21:24:28.567261] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAT took 26.3s. Estimated remaining: 1h 11m 1s. Rate: 7.1 symbols/min [2025-10-01T21:24:28.751574] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:28.794005] [DEBUG] [LOCAL ] SB: Loaded 33140 existing records from primary storage. [2025-10-01T21:24:28.794310] [INFO ] [MAIN ] SB: Loaded 33140 existing records. [2025-10-01T21:24:28.907808] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-01T21:24:29.001388] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:24:29.001624] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-01T21:24:29.001708] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-01T21:24:29.002730] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-01T21:24:29.002796] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-01T21:24:29.360187] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T21:24:29.433988] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:29.702392] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-01T21:24:30.053379] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-01T21:24:30.502372] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-01T21:24:31.302439] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-01T21:24:31.716077] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-01T21:24:31.964477] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-01T21:24:32.102377] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-01T21:24:32.355104] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-01T21:24:32.902384] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-01T21:24:33.192855] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-01T21:24:33.702422] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-01T21:24:34.502406] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-01T21:24:35.052814] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-01T21:24:35.302394] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-01T21:24:35.646508] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-01T21:24:35.887035] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T21:24:36.102427] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-01T21:24:36.416260] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-01T21:24:36.417293] [INFO ] [REMOTE ] SAY: Full fetch complete (1395 records). [2025-10-01T21:24:36.417379] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-01T21:24:36.636751] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-01T21:24:36.637021] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:24:36.637125] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:24:36.637220] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-01T21:24:36.637338] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-01T21:24:36.637397] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-01T21:24:36.637444] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-01T21:24:36.637538] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SAY took 30.3s. Estimated remaining: 1h 10m 53s. Rate: 7.1 symbols/min [2025-10-01T21:24:36.824930] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:36.825093] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-01T21:24:36.825132] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-01T21:24:36.825266] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-01T21:24:36.825328] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-01T21:24:36.825377] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-01T21:24:36.825431] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-01T21:24:36.907475] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-01T21:24:37.225702] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:37.261972] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-01T21:24:37.702391] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-01T21:24:38.067131] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-01T21:24:38.502415] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-01T21:24:38.825712] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T21:24:39.302420] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-01T21:24:40.102416] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-01T21:24:40.702715] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T21:24:40.902396] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-01T21:24:41.007725] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-01T21:24:41.009377] [INFO ] [REMOTE ] SARO: Full fetch complete (69053 records). [2025-10-01T21:24:41.009482] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-01T21:24:41.122468] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:24:41.128800] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-01T21:24:41.149685] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:24:41.171615] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-01T21:24:41.177553] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:24:41.186742] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-01T21:24:41.212059] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-01T21:24:41.264621] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-01T21:24:41.290678] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-01T21:24:41.306608] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SBDS took 4.7s. Estimated remaining: 1h 10m 43s. Rate: 7.1 symbols/min [2025-10-01T21:24:41.615954] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-01T21:24:41.629869] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-01T21:24:41.631237] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-01T21:24:41.631343] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-01T21:24:41.655786] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:41.656714] [DEBUG] [LOCAL ] SARO: Trimmed 69053 records to 48609 (keeping 200 days of data) [2025-10-01T21:24:41.708710] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-01T21:24:41.809331] [DEBUG] [LOCAL ] SBH: Loaded 49770 existing records from primary storage. [2025-10-01T21:24:41.814755] [INFO ] [MAIN ] SBH: Loaded 49770 existing records. [2025-10-01T21:24:42.106893] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-01T21:24:42.116896] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:24:42.118814] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-01T21:24:42.118919] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-01T21:24:42.121702] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-01T21:24:42.122056] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-01T21:24:42.508359] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-01T21:24:42.622005] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:42.630623] [DEBUG] [LOCAL ] SARO: Primary data saved (48609 records). [2025-10-01T21:24:42.630806] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-01T21:24:42.630937] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SARO took 49.4s. Estimated remaining: 1h 10m 33s. Rate: 7.1 symbols/min [2025-10-01T21:24:42.833122] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:42.843333] [DEBUG] [LOCAL ] SBI: Loaded 7612 existing records from primary storage. [2025-10-01T21:24:42.843553] [INFO ] [MAIN ] SBI: Loaded 7612 existing records. [2025-10-01T21:24:42.959272] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-01T21:24:42.975840] [INFO ] [REMOTE ] SAZ: Full fetch complete (1825 records). [2025-10-01T21:24:42.981080] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-01T21:24:43.135974] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:24:43.164580] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-01T21:24:43.168569] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-01T21:24:43.168976] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-01T21:24:43.169047] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-01T21:24:43.304895] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-01T21:24:43.381537] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T21:24:43.432415] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:24:43.452340] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:24:43.471137] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-01T21:24:43.503065] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-01T21:24:43.527681] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-01T21:24:43.558900] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-01T21:24:43.565735] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SAZ took 31.0s. Estimated remaining: 1h 10m 22s. Rate: 7.1 symbols/min [2025-10-01T21:24:43.825113] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:43.870952] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:24:43.884803] [DEBUG] [LOCAL ] SBR: Loaded 7345 existing records from primary storage. [2025-10-01T21:24:43.885050] [INFO ] [MAIN ] SBR: Loaded 7345 existing records. [2025-10-01T21:24:44.082639] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:24:44.082895] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-01T21:24:44.082947] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-01T21:24:44.083276] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-01T21:24:44.083343] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-01T21:24:44.107518] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-01T21:24:44.473518] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:24:44.564265] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T21:24:44.902427] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-01T21:24:45.639050] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T21:24:45.690015] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:24:45.702342] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-01T21:24:46.502411] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-01T21:24:46.987934] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T21:24:47.302394] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-01T21:24:48.070738] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T21:24:48.102352] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-01T21:24:48.815140] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T21:24:48.902396] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-01T21:24:49.335485] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T21:24:49.472073] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-01T21:24:49.702419] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-01T21:24:50.445100] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T21:24:50.502437] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-01T21:24:51.302422] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-01T21:24:51.796865] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T21:24:52.044090] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T21:24:52.102346] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-01T21:24:52.683595] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T21:24:52.902396] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-01T21:24:53.702394] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-01T21:24:54.233728] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T21:24:54.404344] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-01T21:24:54.502415] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-01T21:24:55.302417] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-01T21:24:55.316888] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T21:24:56.102385] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-01T21:24:56.775311] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T21:24:56.849988] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T21:24:56.902344] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-01T21:24:57.702370] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-01T21:24:58.282871] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T21:24:58.502380] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-01T21:24:59.033510] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T21:24:59.302398] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-01T21:24:59.777299] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-01T21:25:00.102394] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-01T21:25:00.913499] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-01T21:25:00.924336] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:25:00.925354] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T21:25:01.702390] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-01T21:25:02.459625] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T21:25:02.502420] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-01T21:25:02.571595] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-01T21:25:03.302398] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-01T21:25:03.891672] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T21:25:04.102408] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-01T21:25:04.434598] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T21:25:04.678599] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T21:25:04.902407] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-01T21:25:05.258168] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-01T21:25:05.258962] [INFO ] [REMOTE ] SBI: Full fetch complete (10642 records). [2025-10-01T21:25:05.259069] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-01T21:25:05.650290] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-01T21:25:05.650374] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-01T21:25:05.650677] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-01T21:25:05.650740] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-01T21:25:05.651194] [DEBUG] [LOCAL ] SBI: Trimmed 10642 records to 7603 (keeping 200 days of data) [2025-10-01T21:25:05.698724] [DEBUG] [LOCAL ] SBI: Primary data saved (7603 records). [2025-10-01T21:25:05.698869] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-01T21:25:05.698971] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBI took 23.1s. Estimated remaining: 1h 10m 17s. Rate: 7.1 symbols/min [2025-10-01T21:25:05.710462] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-01T21:25:05.885763] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:25:05.935783] [DEBUG] [LOCAL ] SBS: Loaded 49479 existing records from primary storage. [2025-10-01T21:25:05.936147] [INFO ] [MAIN ] SBS: Loaded 49479 existing records. [2025-10-01T21:25:06.136352] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:25:06.136596] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-01T21:25:06.136666] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-01T21:25:06.138140] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-01T21:25:06.138204] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-01T21:25:06.510057] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-01T21:25:06.545215] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:25:06.589808] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T21:25:07.302438] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-01T21:25:08.102382] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-01T21:25:08.231245] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-01T21:25:08.697099] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T21:25:08.902379] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-01T21:25:09.702364] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-01T21:25:09.801445] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:25:10.475179] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-01T21:25:10.476537] [INFO ] [REMOTE ] SB: Full fetch complete (50358 records). [2025-10-01T21:25:10.476665] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-01T21:25:10.510228] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-01T21:25:10.717144] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T21:25:10.992300] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-01T21:25:10.992381] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-01T21:25:10.993321] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-01T21:25:10.993388] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-01T21:25:10.994492] [DEBUG] [LOCAL ] SB: Trimmed 50358 records to 33223 (keeping 200 days of data) [2025-10-01T21:25:11.195396] [DEBUG] [LOCAL ] SB: Primary data saved (33223 records). [2025-10-01T21:25:11.195555] [INFO ] [MAIN ] SB: Full history saved. [2025-10-01T21:25:11.195680] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SB took 42.6s. Estimated remaining: 1h 10m 8s. Rate: 7.1 symbols/min [2025-10-01T21:25:11.307690] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-01T21:25:11.391412] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:25:11.413369] [DEBUG] [LOCAL ] SBSI: Loaded 14739 existing records from primary storage. [2025-10-01T21:25:11.413848] [INFO ] [MAIN ] SBSI: Loaded 14739 existing records. [2025-10-01T21:25:11.625577] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:25:11.625953] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-01T21:25:11.626047] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-01T21:25:11.626972] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-01T21:25:11.627090] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-01T21:25:12.060435] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:25:12.102426] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-01T21:25:12.141115] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T21:25:12.172386] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T21:25:12.902368] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-01T21:25:13.057699] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T21:25:13.702395] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-01T21:25:14.077422] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T21:25:14.082057] [INFO ] [REMOTE ] SBH: Full fetch complete (72822 records). [2025-10-01T21:25:14.082178] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-01T21:25:14.511810] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-01T21:25:14.537598] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-01T21:25:14.537756] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-01T21:25:14.539082] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-01T21:25:14.539154] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-01T21:25:14.540789] [DEBUG] [LOCAL ] SBH: Trimmed 72822 records to 49787 (keeping 200 days of data) [2025-10-01T21:25:14.854493] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:25:14.876718] [DEBUG] [LOCAL ] SBH: Primary data saved (49787 records). [2025-10-01T21:25:14.876870] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-01T21:25:14.876958] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 33.5s. Estimated remaining: 1h 9m 58s. Rate: 7.1 symbols/min [2025-10-01T21:25:15.060934] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:25:15.113149] [DEBUG] [LOCAL ] SBSW: Loaded 53001 existing records from primary storage. [2025-10-01T21:25:15.113477] [INFO ] [MAIN ] SBSW: Loaded 53001 existing records. [2025-10-01T21:25:15.308268] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-01T21:25:15.314542] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:25:15.315107] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-01T21:25:15.316239] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-01T21:25:15.317674] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-01T21:25:15.317738] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-01T21:25:15.715090] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:25:16.102364] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-01T21:25:16.264400] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T21:25:16.282217] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T21:25:16.902402] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-01T21:25:17.702387] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-01T21:25:18.275745] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-01T21:25:18.370306] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-01T21:25:18.502344] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-01T21:25:18.593608] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T21:25:19.117395] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T21:25:19.302378] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-01T21:25:19.956567] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T21:25:20.102425] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-01T21:25:20.902380] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-01T21:25:21.022101] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T21:25:21.702396] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-01T21:25:22.502352] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-01T21:25:22.599509] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:25:23.302370] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-01T21:25:23.523305] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T21:25:23.556019] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T21:25:24.095151] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T21:25:24.102368] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-01T21:25:24.902407] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-01T21:25:25.682526] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T21:25:25.702359] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-01T21:25:26.053790] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-01T21:25:26.212840] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-01T21:25:26.213953] [INFO ] [REMOTE ] SBR: Full fetch complete (11137 records). [2025-10-01T21:25:26.214120] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-01T21:25:26.512736] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-01T21:25:26.669329] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-01T21:25:26.669800] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-01T21:25:26.670459] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-01T21:25:26.670537] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-01T21:25:26.671266] [DEBUG] [LOCAL ] SBR: Trimmed 11137 records to 7384 (keeping 200 days of data) [2025-10-01T21:25:26.725980] [DEBUG] [LOCAL ] SBR: Primary data saved (7384 records). [2025-10-01T21:25:26.726130] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-01T21:25:26.726264] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBR took 43.1s. Estimated remaining: 1h 9m 51s. Rate: 7.1 symbols/min [2025-10-01T21:25:27.302483] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-01T21:25:28.102405] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-01T21:25:28.380536] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T21:25:28.902388] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-01T21:25:28.969321] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T21:25:29.217861] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T21:25:29.702395] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-01T21:25:30.243782] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T21:25:30.502375] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-01T21:25:31.302426] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-01T21:25:31.679193] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T21:25:32.102439] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-01T21:25:32.319967] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T21:25:32.365891] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T21:25:32.902382] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-01T21:25:33.702401] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-01T21:25:34.131629] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-01T21:25:34.302724] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T21:25:34.502417] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-01T21:25:34.637458] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T21:25:35.302388] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-01T21:25:36.102398] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-01T21:25:36.239575] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T21:25:36.432546] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-01T21:25:36.902371] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-01T21:25:37.558224] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T21:25:37.702370] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-01T21:25:37.950381] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T21:25:38.502439] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-01T21:25:39.302384] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-01T21:25:39.553690] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T21:25:39.718362] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T21:25:39.720001] [INFO ] [REMOTE ] SBS: Full fetch complete (70142 records). [2025-10-01T21:25:39.720156] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-01T21:25:39.843177] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-01T21:25:39.844627] [INFO ] [REMOTE ] SBSI: Full fetch complete (21209 records). [2025-10-01T21:25:39.860512] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-01T21:25:40.118626] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-01T21:25:40.520857] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-01T21:25:40.524183] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-01T21:25:40.525322] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-01T21:25:40.525412] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-01T21:25:40.610439] [DEBUG] [LOCAL ] SBS: Trimmed 70142 records to 49476 (keeping 200 days of data) [2025-10-01T21:25:40.620717] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-01T21:25:40.620976] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-01T21:25:40.621215] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-01T21:25:40.621257] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-01T21:25:40.622012] [DEBUG] [LOCAL ] SBSI: Trimmed 21209 records to 14756 (keeping 200 days of data) [2025-10-01T21:25:40.849501] [DEBUG] [LOCAL ] SBSI: Primary data saved (14756 records). [2025-10-01T21:25:40.850790] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-01T21:25:40.851518] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBSI took 29.7s. Estimated remaining: 1h 9m 44s. Rate: 7.1 symbols/min [2025-10-01T21:25:41.048823] [DEBUG] [LOCAL ] SBS: Primary data saved (49476 records). [2025-10-01T21:25:41.049001] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-01T21:25:41.049112] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBS took 35.3s. Estimated remaining: 1h 9m 33s. Rate: 7.1 symbols/min [2025-10-01T21:25:42.173687] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-01T21:25:42.189858] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-01T21:25:44.439330] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-01T21:25:44.453169] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-01T21:25:45.905851] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-01T21:25:45.907861] [INFO ] [REMOTE ] SBSW: Full fetch complete (76522 records). [2025-10-01T21:25:45.908025] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-01T21:25:46.326842] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-01T21:25:46.326930] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-01T21:25:46.328100] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-01T21:25:46.328166] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-01T21:25:46.329754] [DEBUG] [LOCAL ] SBSW: Trimmed 76522 records to 53034 (keeping 200 days of data) [2025-10-01T21:25:46.669860] [DEBUG] [LOCAL ] SBSW: Primary data saved (53034 records). [2025-10-01T21:25:46.670006] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-01T21:25:46.670140] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 31.8s. Estimated remaining: 1h 9m 24s. Rate: 7.1 symbols/min [2025-10-01T21:25:47.729166] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:25:47.757337] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:25:47.759513] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:25:47.768710] [DEBUG] [LOCAL ] SCHW: No existing data file found in primary storage. [2025-10-01T21:25:47.768899] [WARN ] [MAIN ] SCHW: No existing data found, performing full refresh instead. [2025-10-01T21:25:47.768123] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:25:47.769168] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-01T21:25:47.769262] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-01T21:25:47.769470] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-10-01T21:25:47.769356] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-01T21:25:47.770550] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-01T21:25:47.770690] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-01T21:25:47.802363] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-01T21:25:47.830425] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-01T21:25:47.866726] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-01T21:25:47.878147] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-01T21:25:48.007360] [DEBUG] [LOCAL ] SCD: Loaded 12737 existing records from primary storage. [2025-10-01T21:25:48.042158] [INFO ] [MAIN ] SCD: Loaded 12737 existing records. [2025-10-01T21:25:48.339887] [DEBUG] [LOCAL ] SCCO: Loaded 49403 existing records from primary storage. [2025-10-01T21:25:48.418851] [INFO ] [MAIN ] SCCO: Loaded 49403 existing records. [2025-10-01T21:25:48.824074] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:25:48.896891] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-01T21:25:48.881337] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:25:48.902347] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-01T21:25:48.922134] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-01T21:25:48.930446] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-01T21:25:48.945980] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-01T21:25:49.217066] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:25:49.223789] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:25:49.236989] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-01T21:25:49.262489] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-01T21:25:49.262391] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-01T21:25:49.278238] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-01T21:25:49.288672] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-01T21:25:49.634062] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-01T21:25:49.659321] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-01T21:25:49.902791] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:25:49.908726] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-01T21:25:49.995089] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:25:49.995508] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-01T21:25:50.029728] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-01T21:25:50.030666] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-01T21:25:50.352197] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-01T21:25:50.353154] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-01T21:25:50.576619] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-01T21:25:50.577689] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-01T21:25:50.748188] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T21:25:50.750330] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-01T21:25:50.848484] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-01T21:25:50.849438] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-01T21:25:50.899229] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T21:25:50.910986] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-01T21:25:51.276395] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-01T21:25:51.302381] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-01T21:25:51.419852] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-01T21:25:51.620793] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T21:25:52.031605] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-01T21:25:52.102421] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-01T21:25:52.691331] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T21:25:52.837150] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T21:25:52.902388] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-01T21:25:53.706907] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-01T21:25:53.711527] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T21:25:54.502400] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-01T21:25:55.231372] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T21:25:55.302365] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-01T21:25:55.337048] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T21:25:56.102375] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-01T21:25:56.329808] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T21:25:56.902392] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-01T21:25:57.702393] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-01T21:25:57.956714] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-01T21:25:57.983999] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T21:25:58.176165] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T21:25:58.502416] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-01T21:25:59.302394] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-01T21:26:00.102433] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-01T21:26:00.464962] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-01T21:26:00.902391] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-01T21:26:01.179453] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T21:26:01.181630] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T21:26:01.313437] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-01T21:26:01.702418] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-01T21:26:02.502410] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-01T21:26:03.038618] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T21:26:03.302393] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-01T21:26:03.536499] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T21:26:03.579523] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-01T21:26:04.102403] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-01T21:26:04.902390] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-01T21:26:05.702547] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-01T21:26:05.971147] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-01T21:26:05.971972] [INFO ] [REMOTE ] SBXD: Full fetch complete (3087 records). [2025-10-01T21:26:05.972061] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-01T21:26:06.194897] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-01T21:26:06.195150] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:26:06.195284] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:26:06.195420] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-01T21:26:06.195614] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-01T21:26:06.195833] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-01T21:26:06.195985] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-01T21:26:06.196124] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SBXD took 19.5s. Estimated remaining: 1h 9m 18s. Rate: 7.1 symbols/min [2025-10-01T21:26:06.392604] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:26:06.428770] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-01T21:26:06.488842] [DEBUG] [LOCAL ] SCI: Loaded 46449 existing records from primary storage. [2025-10-01T21:26:06.489168] [INFO ] [MAIN ] SCI: Loaded 46449 existing records. [2025-10-01T21:26:06.512297] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-01T21:26:06.700521] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:26:06.700902] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-01T21:26:06.700998] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-01T21:26:06.703865] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-01T21:26:06.704002] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-01T21:26:07.149004] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-01T21:26:07.192899] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:26:07.302399] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-01T21:26:07.429735] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T21:26:08.102407] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-01T21:26:08.620609] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-01T21:26:08.621508] [INFO ] [REMOTE ] SCD: Full fetch complete (16476 records). [2025-10-01T21:26:08.621580] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-01T21:26:08.906724] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-01T21:26:09.083439] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-01T21:26:09.087220] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-01T21:26:09.087090] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T21:26:09.088000] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-01T21:26:09.100537] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-01T21:26:09.102948] [DEBUG] [LOCAL ] SCD: Trimmed 16476 records to 12798 (keeping 200 days of data) [2025-10-01T21:26:09.193438] [DEBUG] [LOCAL ] SCD: Primary data saved (12798 records). [2025-10-01T21:26:09.193583] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-01T21:26:09.193707] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCD took 22.5s. Estimated remaining: 1h 9m 8s. Rate: 7.1 symbols/min [2025-10-01T21:26:09.378606] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:26:09.395480] [DEBUG] [LOCAL ] SCL: Loaded 14882 existing records from primary storage. [2025-10-01T21:26:09.395744] [INFO ] [MAIN ] SCL: Loaded 14882 existing records. [2025-10-01T21:26:09.595072] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:26:09.595323] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-01T21:26:09.595380] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-01T21:26:09.596060] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-01T21:26:09.596141] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-01T21:26:09.705221] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-01T21:26:09.992623] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:26:10.397781] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T21:26:10.502355] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-01T21:26:11.302407] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-01T21:26:11.390616] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T21:26:12.102379] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-01T21:26:12.186950] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T21:26:12.226552] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T21:26:12.902402] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-01T21:26:13.702413] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-01T21:26:13.782584] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T21:26:14.502381] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-01T21:26:14.534032] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T21:26:14.677270] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T21:26:15.302388] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-01T21:26:16.032537] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T21:26:16.102387] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-01T21:26:16.137550] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-01T21:26:16.902392] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-01T21:26:17.489020] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T21:26:17.702377] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-01T21:26:18.502378] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-01T21:26:18.831955] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T21:26:19.302391] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-01T21:26:19.379805] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T21:26:20.104433] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-01T21:26:20.107602] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T21:26:20.465063] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T21:26:20.902374] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-01T21:26:21.435189] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-01T21:26:21.436784] [INFO ] [REMOTE ] SCCO: Full fetch complete (70900 records). [2025-10-01T21:26:21.436880] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-01T21:26:21.707587] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-01T21:26:21.886412] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-01T21:26:21.886515] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-01T21:26:21.887629] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-01T21:26:21.887718] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-01T21:26:21.889761] [DEBUG] [LOCAL ] SCCO: Trimmed 70900 records to 49412 (keeping 200 days of data) [2025-10-01T21:26:22.020054] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T21:26:22.234940] [DEBUG] [LOCAL ] SCCO: Primary data saved (49412 records). [2025-10-01T21:26:22.235114] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-01T21:26:22.235239] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCCO took 35.5s. Estimated remaining: 1h 9m 1s. Rate: 7.1 symbols/min [2025-10-01T21:26:22.425365] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:26:22.445968] [DEBUG] [LOCAL ] SCM: Loaded 19760 existing records from primary storage. [2025-10-01T21:26:22.446242] [INFO ] [MAIN ] SCM: Loaded 19760 existing records. [2025-10-01T21:26:22.507515] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-01T21:26:22.654152] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:26:22.654388] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-01T21:26:22.654439] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-01T21:26:22.655463] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-01T21:26:22.655529] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-01T21:26:23.067834] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:26:23.302370] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-01T21:26:23.537769] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T21:26:24.102352] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-01T21:26:24.314839] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-01T21:26:24.396418] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T21:26:24.902401] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-01T21:26:25.551072] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T21:26:25.702432] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-01T21:26:25.921099] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T21:26:26.502380] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-01T21:26:26.750455] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-01T21:26:27.302435] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-01T21:26:28.102371] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-01T21:26:28.502793] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-01T21:26:28.686240] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T21:26:28.902395] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-01T21:26:29.206371] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T21:26:29.702386] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-01T21:26:30.502360] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-01T21:26:30.535187] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T21:26:30.847307] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T21:26:31.302386] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-01T21:26:31.738956] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-01T21:26:32.102382] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-01T21:26:32.902002] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T21:26:32.905553] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-01T21:26:33.690890] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T21:26:33.702356] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-01T21:26:33.713364] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T21:26:34.502359] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-01T21:26:34.779573] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-01T21:26:35.302398] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-01T21:26:35.759396] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T21:26:35.761081] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-01T21:26:35.761182] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-01T21:26:36.107502] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-01T21:26:36.222585] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-01T21:26:36.222714] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-01T21:26:36.224015] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-01T21:26:36.224083] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-01T21:26:36.225715] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 53685 (keeping 200 days of data) [2025-10-01T21:26:36.570610] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T21:26:36.600580] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-01T21:26:36.600843] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-01T21:26:36.600984] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCHW took 49.9s. Estimated remaining: 1h 8m 54s. Rate: 7.1 symbols/min [2025-10-01T21:26:36.787433] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:26:36.833264] [DEBUG] [LOCAL ] SCS: Loaded 43358 existing records from primary storage. [2025-10-01T21:26:36.833559] [INFO ] [MAIN ] SCS: Loaded 43358 existing records. [2025-10-01T21:26:36.907560] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-01T21:26:37.046171] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:26:37.046430] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-01T21:26:37.046487] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-01T21:26:37.049018] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-01T21:26:37.049086] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-01T21:26:37.433031] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:26:37.708949] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-01T21:26:37.726509] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T21:26:38.169609] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T21:26:38.502392] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-01T21:26:38.750329] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T21:26:39.302441] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-01T21:26:40.034933] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T21:26:40.102409] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-01T21:26:40.231663] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-01T21:26:40.233249] [INFO ] [REMOTE ] SCI: Full fetch complete (67256 records). [2025-10-01T21:26:40.233374] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-01T21:26:40.680227] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-01T21:26:40.680367] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-01T21:26:40.681742] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-01T21:26:40.681825] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-01T21:26:40.683704] [DEBUG] [LOCAL ] SCI: Trimmed 67256 records to 46432 (keeping 200 days of data) [2025-10-01T21:26:40.922636] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-01T21:26:41.002593] [DEBUG] [LOCAL ] SCI: Primary data saved (46432 records). [2025-10-01T21:26:41.002751] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-01T21:26:41.002845] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCI took 34.8s. Estimated remaining: 1h 8m 45s. Rate: 7.1 symbols/min [2025-10-01T21:26:41.127710] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T21:26:41.207912] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:26:41.239661] [DEBUG] [LOCAL ] SD: Loaded 28653 existing records from primary storage. [2025-10-01T21:26:41.239967] [INFO ] [MAIN ] SD: Loaded 28653 existing records. [2025-10-01T21:26:41.439205] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:26:41.439425] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-01T21:26:41.439476] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-01T21:26:41.440424] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-01T21:26:41.440487] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-01T21:26:41.707556] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-01T21:26:41.830990] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:26:42.377869] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T21:26:42.477372] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-01T21:26:42.478398] [INFO ] [REMOTE ] SCL: Full fetch complete (21226 records). [2025-10-01T21:26:42.478478] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-01T21:26:42.507505] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-01T21:26:42.920526] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-01T21:26:42.920610] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-01T21:26:42.921209] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-01T21:26:42.921299] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-01T21:26:42.921950] [DEBUG] [LOCAL ] SCL: Trimmed 21226 records to 14887 (keeping 200 days of data) [2025-10-01T21:26:43.022963] [DEBUG] [LOCAL ] SCL: Primary data saved (14887 records). [2025-10-01T21:26:43.023588] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-01T21:26:43.023833] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCL took 33.8s. Estimated remaining: 1h 8m 34s. Rate: 7.1 symbols/min [2025-10-01T21:26:43.223004] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:26:43.235802] [DEBUG] [LOCAL ] SDHC: Loaded 10404 existing records from primary storage. [2025-10-01T21:26:43.236071] [INFO ] [MAIN ] SDHC: Loaded 10404 existing records. [2025-10-01T21:26:43.307513] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-01T21:26:43.435678] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:26:43.435891] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-01T21:26:43.435939] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-01T21:26:43.436495] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-01T21:26:43.436570] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-01T21:26:43.859180] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T21:26:43.864766] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:26:44.102358] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-01T21:26:44.291735] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T21:26:44.902413] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-01T21:26:45.162904] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T21:26:45.702404] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-01T21:26:46.281556] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T21:26:46.502390] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-01T21:26:46.873586] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T21:26:47.302391] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-01T21:26:47.909155] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T21:26:47.979380] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T21:26:48.102373] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-01T21:26:48.902413] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-01T21:26:49.345474] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T21:26:49.702431] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-01T21:26:50.448764] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T21:26:50.502407] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-01T21:26:50.624128] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T21:26:51.302358] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-01T21:26:51.318578] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T21:26:51.321633] [INFO ] [REMOTE ] SCM: Full fetch complete (28678 records). [2025-10-01T21:26:51.321745] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-01T21:26:51.739766] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-01T21:26:51.739894] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-01T21:26:51.740542] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-01T21:26:51.740604] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-01T21:26:51.741526] [DEBUG] [LOCAL ] SCM: Trimmed 28678 records to 19787 (keeping 200 days of data) [2025-10-01T21:26:51.877096] [DEBUG] [LOCAL ] SCM: Primary data saved (19787 records). [2025-10-01T21:26:51.877256] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-01T21:26:51.877386] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCM took 29.6s. Estimated remaining: 1h 8m 26s. Rate: 7.1 symbols/min [2025-10-01T21:26:52.058241] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:26:52.071092] [DEBUG] [LOCAL ] SDHY: Loaded 10544 existing records from primary storage. [2025-10-01T21:26:52.071334] [INFO ] [MAIN ] SDHY: Loaded 10544 existing records. [2025-10-01T21:26:52.104344] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-01T21:26:52.269871] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:26:52.270286] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-01T21:26:52.270422] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-01T21:26:52.284438] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T21:26:52.284493] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-01T21:26:52.289381] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-01T21:26:52.672374] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:26:52.902373] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-01T21:26:53.577302] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T21:26:53.702369] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-01T21:26:53.840743] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T21:26:54.502384] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-01T21:26:55.058619] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T21:26:55.302366] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-01T21:26:55.302436] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-01T21:26:56.102371] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-01T21:26:56.796170] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T21:26:56.902349] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-01T21:26:57.220356] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T21:26:57.702392] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-01T21:26:58.502373] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-01T21:26:58.545476] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T21:26:59.076226] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-01T21:26:59.196716] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T21:26:59.302445] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-01T21:27:00.102367] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-01T21:27:00.881686] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T21:27:00.902350] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-01T21:27:01.040861] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T21:27:01.690302] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T21:27:01.702332] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-01T21:27:02.502408] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-01T21:27:03.061231] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T21:27:03.302391] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-01T21:27:04.072818] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T21:27:04.102363] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-01T21:27:04.140612] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T21:27:04.886339] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T21:27:04.902346] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-01T21:27:05.474931] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-01T21:27:05.702417] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-01T21:27:06.468915] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T21:27:06.502351] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-01T21:27:07.296888] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-01T21:27:07.302329] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-01T21:27:08.102372] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-01T21:27:08.176379] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T21:27:08.902430] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-01T21:27:09.370409] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T21:27:09.551805] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T21:27:09.702383] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-01T21:27:10.467571] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T21:27:10.502410] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-01T21:27:11.302376] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-01T21:27:11.608560] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T21:27:11.610309] [INFO ] [REMOTE ] SCS: Full fetch complete (60706 records). [2025-10-01T21:27:11.610404] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-01T21:27:11.884208] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T21:27:11.912485] [INFO ] [REMOTE ] SDHC: Full fetch complete (17208 records). [2025-10-01T21:27:11.936252] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-01T21:27:12.129094] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-01T21:27:12.163197] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-01T21:27:12.173898] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-01T21:27:12.185335] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-01T21:27:12.195917] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-01T21:27:12.295797] [DEBUG] [LOCAL ] SCS: Trimmed 60706 records to 43438 (keeping 200 days of data) [2025-10-01T21:27:12.573914] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-01T21:27:12.574846] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-01T21:27:12.575747] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-01T21:27:12.576083] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-01T21:27:12.579262] [DEBUG] [LOCAL ] SDHC: Trimmed 17208 records to 10361 (keeping 200 days of data) [2025-10-01T21:27:12.661763] [DEBUG] [LOCAL ] SDHC: Primary data saved (10361 records). [2025-10-01T21:27:12.661965] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-01T21:27:12.662072] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 29.6s. Estimated remaining: 1h 8m 21s. Rate: 7.1 symbols/min [2025-10-01T21:27:12.905832] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-01T21:27:12.965736] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:27:13.018171] [DEBUG] [LOCAL ] SDRL: Loaded 41653 existing records from primary storage. [2025-10-01T21:27:13.029480] [INFO ] [MAIN ] SDRL: Loaded 41653 existing records. [2025-10-01T21:27:13.148915] [DEBUG] [LOCAL ] SCS: Primary data saved (43438 records). [2025-10-01T21:27:13.157937] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-01T21:27:13.158152] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SCS took 36.6s. Estimated remaining: 1h 8m 10s. Rate: 7.1 symbols/min [2025-10-01T21:27:13.359135] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T21:27:13.398813] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:27:13.405364] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-01T21:27:13.416116] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-01T21:27:13.428055] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-01T21:27:13.443533] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-01T21:27:13.513350] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:27:13.540483] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-10-01T21:27:13.563071] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-10-01T21:27:13.589110] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-01T21:27:13.591935] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-01T21:27:13.597738] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-01T21:27:13.597830] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-01T21:27:13.713777] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-01T21:27:13.857343] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-01T21:27:14.224469] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:27:14.299574] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:27:14.502377] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-01T21:27:14.985478] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-01T21:27:15.302383] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-01T21:27:16.082425] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:27:16.102338] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-01T21:27:16.471064] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T21:27:16.549112] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T21:27:16.902374] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-01T21:27:17.648129] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T21:27:17.702368] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-01T21:27:18.502384] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-01T21:27:19.100410] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T21:27:19.119373] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T21:27:19.302386] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-01T21:27:20.102363] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-01T21:27:20.902357] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-01T21:27:21.097343] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T21:27:21.189315] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T21:27:21.190174] [INFO ] [REMOTE ] SDHY: Full fetch complete (15837 records). [2025-10-01T21:27:21.190243] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-01T21:27:21.594748] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-01T21:27:21.594845] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-01T21:27:21.595256] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-01T21:27:21.595319] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-01T21:27:21.595883] [DEBUG] [LOCAL ] SDHY: Trimmed 15837 records to 10584 (keeping 200 days of data) [2025-10-01T21:27:21.663873] [DEBUG] [LOCAL ] SDHY: Primary data saved (10584 records). [2025-10-01T21:27:21.664029] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-01T21:27:21.664138] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 29.8s. Estimated remaining: 1h 8m 2s. Rate: 7.1 symbols/min [2025-10-01T21:27:21.707576] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-01T21:27:21.792545] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T21:27:21.804717] [INFO ] [REMOTE ] SD: Full fetch complete (41018 records). [2025-10-01T21:27:21.815071] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-01T21:27:21.920823] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:27:22.312602] [DEBUG] [LOCAL ] SEE: Loaded 48284 existing records from primary storage. [2025-10-01T21:27:22.323012] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-01T21:27:22.323194] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-01T21:27:22.324099] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-01T21:27:22.324307] [INFO ] [MAIN ] SEE: Loaded 48284 existing records. [2025-10-01T21:27:22.324181] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-01T21:27:22.436341] [DEBUG] [LOCAL ] SD: Trimmed 41018 records to 28680 (keeping 200 days of data) [2025-10-01T21:27:22.584955] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:27:22.569268] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-01T21:27:22.585540] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-01T21:27:22.586968] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-01T21:27:22.630232] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-01T21:27:22.630756] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-01T21:27:23.140098] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:27:23.176891] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T21:27:23.192514] [DEBUG] [LOCAL ] SD: Primary data saved (28680 records). [2025-10-01T21:27:23.193018] [INFO ] [MAIN ] SD: Full history saved. [2025-10-01T21:27:23.193153] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SD took 42.2s. Estimated remaining: 1h 7m 51s. Rate: 7.1 symbols/min [2025-10-01T21:27:23.307528] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-01T21:27:23.386670] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:27:23.405325] [DEBUG] [LOCAL ] SEG: Loaded 13636 existing records from primary storage. [2025-10-01T21:27:23.405580] [INFO ] [MAIN ] SEG: Loaded 13636 existing records. [2025-10-01T21:27:23.594035] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:27:23.594312] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-01T21:27:23.594361] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-01T21:27:23.595331] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-01T21:27:23.595394] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-01T21:27:23.991460] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:27:24.090744] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T21:27:24.102346] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-01T21:27:24.902385] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-01T21:27:25.173372] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T21:27:25.702349] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-01T21:27:25.745116] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T21:27:25.824810] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:27:26.502385] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-01T21:27:27.186885] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T21:27:27.302397] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-01T21:27:28.102389] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-01T21:27:28.259995] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T21:27:28.644883] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-01T21:27:28.902387] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-01T21:27:29.559330] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T21:27:29.708261] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-01T21:27:29.710451] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T21:27:30.502395] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-01T21:27:31.302407] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-01T21:27:31.702585] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-01T21:27:32.102397] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-01T21:27:32.157822] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T21:27:32.258529] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T21:27:32.902394] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-01T21:27:33.702413] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-01T21:27:34.029289] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-01T21:27:34.291487] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T21:27:34.502417] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-01T21:27:34.944140] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T21:27:35.302414] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-01T21:27:35.974794] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T21:27:36.102379] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-01T21:27:36.902394] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-01T21:27:37.226944] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T21:27:37.702423] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-01T21:27:38.354910] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-01T21:27:38.416166] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T21:27:38.448457] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-01T21:27:38.502397] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-01T21:27:39.302383] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-01T21:27:39.364392] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T21:27:40.102367] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-01T21:27:40.835158] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T21:27:40.902418] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-01T21:27:41.665524] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T21:27:41.702346] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-01T21:27:42.054126] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T21:27:42.502428] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-01T21:27:42.613048] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T21:27:43.302430] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-01T21:27:44.102364] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-01T21:27:44.685404] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-01T21:27:44.731700] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-01T21:27:44.902381] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-01T21:27:45.548283] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T21:27:45.702385] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-01T21:27:46.502393] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-01T21:27:46.879351] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-01T21:27:47.009132] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T21:27:47.010748] [INFO ] [REMOTE ] SE: Full fetch complete (77072 records). [2025-10-01T21:27:47.010898] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-01T21:27:47.305478] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-01T21:27:47.450442] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-01T21:27:47.450547] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-01T21:27:47.451619] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-01T21:27:47.451709] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-01T21:27:47.454626] [DEBUG] [LOCAL ] SE: Trimmed 77072 records to 53362 (keeping 200 days of data) [2025-10-01T21:27:47.572269] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T21:27:47.827863] [DEBUG] [LOCAL ] SE: Primary data saved (53362 records). [2025-10-01T21:27:47.828029] [INFO ] [MAIN ] SE: Full history saved. [2025-10-01T21:27:47.828118] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SE took 34.7s. Estimated remaining: 1h 7m 47s. Rate: 7.1 symbols/min [2025-10-01T21:27:48.015457] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:27:48.065309] [DEBUG] [LOCAL ] SEI: Loaded 49645 existing records from primary storage. [2025-10-01T21:27:48.065743] [INFO ] [MAIN ] SEI: Loaded 49645 existing records. [2025-10-01T21:27:48.107476] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-01T21:27:48.258479] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:27:48.258756] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-01T21:27:48.258811] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-01T21:27:48.261366] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-01T21:27:48.261448] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-01T21:27:48.662020] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:27:48.899314] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T21:27:48.907943] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-01T21:27:49.014806] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T21:27:49.702401] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-01T21:27:50.271140] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T21:27:50.502455] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-01T21:27:51.265431] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T21:27:51.302367] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-01T21:27:51.480432] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T21:27:51.481792] [INFO ] [REMOTE ] SDRL: Full fetch complete (61640 records). [2025-10-01T21:27:51.481909] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-01T21:27:51.829138] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T21:27:51.846233] [INFO ] [REMOTE ] SEG: Full fetch complete (19860 records). [2025-10-01T21:27:51.879396] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-01T21:27:52.016094] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-01T21:27:52.027045] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-01T21:27:52.028385] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-01T21:27:52.028847] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-01T21:27:52.087416] [DEBUG] [LOCAL ] SDRL: Trimmed 61640 records to 41610 (keeping 200 days of data) [2025-10-01T21:27:52.112385] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-01T21:27:52.437759] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-01T21:27:52.441598] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-01T21:27:52.442833] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-01T21:27:52.443182] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-01T21:27:52.445740] [DEBUG] [LOCAL ] SEG: Trimmed 19860 records to 13650 (keeping 200 days of data) [2025-10-01T21:27:52.678707] [DEBUG] [LOCAL ] SDRL: Primary data saved (41610 records). [2025-10-01T21:27:52.679386] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-01T21:27:52.679521] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SDRL took 40.0s. Estimated remaining: 1h 7m 38s. Rate: 7.1 symbols/min [2025-10-01T21:27:52.802585] [DEBUG] [LOCAL ] SEG: Primary data saved (13650 records). [2025-10-01T21:27:52.808443] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-01T21:27:52.818849] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEG took 29.6s. Estimated remaining: 1h 7m 27s. Rate: 7.1 symbols/min [2025-10-01T21:27:52.904211] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-01T21:27:52.933078] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:27:53.080008] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:27:53.112234] [DEBUG] [LOCAL ] SEM: Loaded 42779 existing records from primary storage. [2025-10-01T21:27:53.112560] [INFO ] [MAIN ] SEM: Loaded 42779 existing records. [2025-10-01T21:27:53.316376] [DEBUG] [LOCAL ] SEMR: Loaded 41502 existing records from primary storage. [2025-10-01T21:27:53.339964] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:27:53.340183] [INFO ] [MAIN ] SEMR: Loaded 41502 existing records. [2025-10-01T21:27:53.340344] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-01T21:27:53.374384] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-01T21:27:53.416390] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-01T21:27:53.439824] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-01T21:27:53.656886] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:27:53.677000] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-01T21:27:53.682811] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-01T21:27:53.732663] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-01T21:27:53.779354] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-01T21:27:54.249476] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:27:54.262747] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-01T21:27:54.374908] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-01T21:27:54.405459] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:27:54.502378] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-01T21:27:54.753053] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T21:27:55.302413] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-01T21:27:55.909340] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-01T21:27:56.035972] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T21:27:56.102372] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-01T21:27:56.611025] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T21:27:56.902390] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-01T21:27:57.576813] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T21:27:57.702387] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-01T21:27:58.032716] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T21:27:58.502384] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-01T21:27:59.302363] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-01T21:27:59.343931] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T21:27:59.952228] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T21:28:00.102374] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-01T21:28:00.902358] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-01T21:28:01.242787] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T21:28:01.412942] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T21:28:01.702430] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-01T21:28:01.903010] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T21:28:01.904993] [INFO ] [REMOTE ] SEE: Full fetch complete (69613 records). [2025-10-01T21:28:01.905135] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-01T21:28:02.354422] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-01T21:28:02.354517] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-01T21:28:02.355883] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-01T21:28:02.355954] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-01T21:28:02.357892] [DEBUG] [LOCAL ] SEE: Trimmed 69613 records to 48272 (keeping 200 days of data) [2025-10-01T21:28:02.545759] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-01T21:28:02.673437] [DEBUG] [LOCAL ] SEE: Primary data saved (48272 records). [2025-10-01T21:28:02.673576] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-01T21:28:02.673690] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEE took 41.0s. Estimated remaining: 1h 7m 19s. Rate: 7.1 symbols/min [2025-10-01T21:28:02.854773] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:28:02.913312] [DEBUG] [LOCAL ] SES: Loaded 51560 existing records from primary storage. [2025-10-01T21:28:02.913742] [INFO ] [MAIN ] SES: Loaded 51560 existing records. [2025-10-01T21:28:03.110122] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:28:03.110380] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-01T21:28:03.110452] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-01T21:28:03.112558] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-01T21:28:03.112628] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-01T21:28:03.303229] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-01T21:28:03.550381] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:28:03.553214] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T21:28:03.589287] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T21:28:04.102391] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-01T21:28:04.902371] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-01T21:28:04.939745] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T21:28:05.702415] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-01T21:28:05.943454] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T21:28:06.502373] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-01T21:28:06.742434] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T21:28:07.098768] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T21:28:07.302415] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-01T21:28:08.102363] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-01T21:28:08.288891] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T21:28:08.832964] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T21:28:08.902421] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-01T21:28:09.696578] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T21:28:09.705505] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-01T21:28:10.502387] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-01T21:28:11.222405] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T21:28:11.302361] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-01T21:28:11.371072] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-01T21:28:12.102355] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-01T21:28:12.247524] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T21:28:12.784011] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T21:28:12.902397] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-01T21:28:13.702401] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-01T21:28:14.490213] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-01T21:28:14.502338] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-01T21:28:14.834130] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T21:28:15.009489] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T21:28:15.302411] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-01T21:28:16.102369] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-01T21:28:16.902413] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-01T21:28:17.032570] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-01T21:28:17.072753] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T21:28:17.702355] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-01T21:28:18.052209] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T21:28:18.449462] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T21:28:18.502367] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-01T21:28:19.302380] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-01T21:28:19.379681] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:28:20.102359] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-01T21:28:20.192109] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T21:28:20.193529] [INFO ] [REMOTE ] SEM: Full fetch complete (61469 records). [2025-10-01T21:28:20.193632] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-01T21:28:20.582589] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-01T21:28:20.682109] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-01T21:28:20.682209] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-01T21:28:20.683277] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-01T21:28:20.683349] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-01T21:28:20.684775] [DEBUG] [LOCAL ] SEM: Trimmed 61469 records to 42748 (keeping 200 days of data) [2025-10-01T21:28:20.905450] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-01T21:28:20.960139] [DEBUG] [LOCAL ] SEM: Primary data saved (42748 records). [2025-10-01T21:28:20.960271] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-01T21:28:20.960404] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEM took 28.3s. Estimated remaining: 1h 7m 13s. Rate: 7.1 symbols/min [2025-10-01T21:28:21.144961] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:28:21.185942] [DEBUG] [LOCAL ] SF: Loaded 41564 existing records from primary storage. [2025-10-01T21:28:21.186243] [INFO ] [MAIN ] SF: Loaded 41564 existing records. [2025-10-01T21:28:21.379399] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:28:21.379632] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-01T21:28:21.379718] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-01T21:28:21.381701] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-01T21:28:21.381767] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-01T21:28:21.707521] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-01T21:28:21.768723] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:28:22.218030] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T21:28:22.219674] [INFO ] [REMOTE ] SEI: Full fetch complete (69898 records). [2025-10-01T21:28:22.219813] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-01T21:28:22.507617] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-01T21:28:22.661090] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-01T21:28:22.661238] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-01T21:28:22.662351] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-01T21:28:22.662438] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-01T21:28:22.664473] [DEBUG] [LOCAL ] SEI: Trimmed 69898 records to 49654 (keeping 200 days of data) [2025-10-01T21:28:22.697832] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-01T21:28:22.957766] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T21:28:23.060765] [DEBUG] [LOCAL ] SEI: Primary data saved (49654 records). [2025-10-01T21:28:23.060901] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-01T21:28:23.060998] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEI took 35.2s. Estimated remaining: 1h 7m 3s. Rate: 7.1 symbols/min [2025-10-01T21:28:23.244995] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:28:23.250797] [DEBUG] [LOCAL ] SFB: Loaded 4105 existing records from primary storage. [2025-10-01T21:28:23.250953] [INFO ] [MAIN ] SFB: Loaded 4105 existing records. [2025-10-01T21:28:23.302351] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-01T21:28:23.452663] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:28:23.452845] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-01T21:28:23.452910] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-01T21:28:23.453317] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-01T21:28:23.453381] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-01T21:28:23.853576] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:28:24.086067] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:28:24.102342] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-01T21:28:24.902391] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-01T21:28:25.259927] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T21:28:25.488628] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-01T21:28:25.702371] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-01T21:28:25.791859] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-01T21:28:26.176687] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-01T21:28:26.502364] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-01T21:28:27.302382] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-01T21:28:27.638520] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-01T21:28:28.026607] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T21:28:28.102371] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-01T21:28:28.902381] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-01T21:28:29.702431] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-01T21:28:30.379967] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-01T21:28:30.470915] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T21:28:30.502345] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-01T21:28:31.302410] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-01T21:28:31.343249] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T21:28:31.976888] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T21:28:32.102366] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-01T21:28:32.902400] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-01T21:28:33.509717] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T21:28:33.602341] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T21:28:33.643914] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-01T21:28:33.702366] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-01T21:28:34.502429] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-01T21:28:35.089404] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T21:28:35.302393] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-01T21:28:35.572460] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T21:28:35.708551] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-01T21:28:36.102378] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-01T21:28:36.902383] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-01T21:28:37.702387] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-01T21:28:38.014897] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T21:28:38.019353] [INFO ] [REMOTE ] SEMR: Full fetch complete (59208 records). [2025-10-01T21:28:38.019476] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-01T21:28:38.197480] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-01T21:28:38.516274] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-01T21:28:38.516145] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-01T21:28:38.550001] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-01T21:28:38.550090] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-01T21:28:38.551091] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-01T21:28:38.553598] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-01T21:28:38.554966] [DEBUG] [LOCAL ] SEMR: Trimmed 59208 records to 41589 (keeping 200 days of data) [2025-10-01T21:28:38.815216] [DEBUG] [LOCAL ] SEMR: Primary data saved (41589 records). [2025-10-01T21:28:38.815375] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-01T21:28:38.815491] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SEMR took 46.0s. Estimated remaining: 1h 6m 56s. Rate: 7.1 symbols/min [2025-10-01T21:28:39.006504] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:28:39.030613] [DEBUG] [LOCAL ] SFBS: Loaded 21044 existing records from primary storage. [2025-10-01T21:28:39.030915] [INFO ] [MAIN ] SFBS: Loaded 21044 existing records. [2025-10-01T21:28:39.235664] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:28:39.235906] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-01T21:28:39.235959] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-01T21:28:39.237102] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-01T21:28:39.237167] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-01T21:28:39.303710] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-01T21:28:39.645833] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:28:39.932687] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T21:28:40.102374] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-01T21:28:40.149992] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T21:28:40.786716] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-01T21:28:40.902456] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-01T21:28:41.702515] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-01T21:28:42.502434] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-01T21:28:42.582984] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-01T21:28:42.585693] [INFO ] [REMOTE ] SES: Full fetch complete (75087 records). [2025-10-01T21:28:42.585880] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-01T21:28:42.932297] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-01T21:28:43.035023] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-01T21:28:43.035245] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-01T21:28:43.036567] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-01T21:28:43.036717] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-01T21:28:43.038736] [DEBUG] [LOCAL ] SES: Trimmed 75087 records to 51558 (keeping 200 days of data) [2025-10-01T21:28:43.187488] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T21:28:43.303826] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-01T21:28:43.399629] [DEBUG] [LOCAL ] SES: Primary data saved (51558 records). [2025-10-01T21:28:43.399803] [INFO ] [MAIN ] SES: Full history saved. [2025-10-01T21:28:43.399914] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SES took 40.7s. Estimated remaining: 1h 6m 47s. Rate: 7.1 symbols/min [2025-10-01T21:28:43.590194] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:28:43.634943] [DEBUG] [LOCAL ] SFL: Loaded 45266 existing records from primary storage. [2025-10-01T21:28:43.635270] [INFO ] [MAIN ] SFL: Loaded 45266 existing records. [2025-10-01T21:28:43.728353] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-01T21:28:43.758028] [INFO ] [REMOTE ] SFB: Full fetch complete (5917 records). [2025-10-01T21:28:43.766050] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-01T21:28:44.016302] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:28:44.071019] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-01T21:28:44.071194] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-01T21:28:44.083541] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-01T21:28:44.107468] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-01T21:28:44.131232] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-01T21:28:44.493302] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-01T21:28:44.502570] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-01T21:28:44.520778] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-01T21:28:44.520907] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-01T21:28:44.585728] [DEBUG] [LOCAL ] SFB: Trimmed 5917 records to 4130 (keeping 200 days of data) [2025-10-01T21:28:44.747217] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:28:44.750937] [DEBUG] [LOCAL ] SFB: Primary data saved (4130 records). [2025-10-01T21:28:44.751023] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-01T21:28:44.751118] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SFB took 21.7s. Estimated remaining: 1h 6m 36s. Rate: 7.1 symbols/min [2025-10-01T21:28:44.910107] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-01T21:28:44.939197] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:28:44.993908] [DEBUG] [LOCAL ] SG: Loaded 53450 existing records from primary storage. [2025-10-01T21:28:44.994216] [INFO ] [MAIN ] SG: Loaded 53450 existing records. [2025-10-01T21:28:45.186325] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:28:45.186539] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-01T21:28:45.186599] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-01T21:28:45.188490] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-01T21:28:45.188559] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-01T21:28:45.601772] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:28:45.630137] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T21:28:45.702382] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-01T21:28:46.333729] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T21:28:46.502361] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-01T21:28:46.768288] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T21:28:47.302385] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-01T21:28:47.970968] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T21:28:48.102350] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-01T21:28:48.426784] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T21:28:48.902387] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-01T21:28:49.702362] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-01T21:28:49.755352] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T21:28:50.502355] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-01T21:28:50.637006] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T21:28:50.793223] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T21:28:51.302386] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-01T21:28:52.102363] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-01T21:28:52.318123] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T21:28:52.537505] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T21:28:52.902394] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-01T21:28:53.315749] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T21:28:53.702390] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-01T21:28:54.502362] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-01T21:28:54.623571] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T21:28:55.047193] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T21:28:55.302404] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-01T21:28:56.102382] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-01T21:28:56.312379] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T21:28:56.902364] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-01T21:28:56.966562] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T21:28:57.525793] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T21:28:57.702417] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-01T21:28:57.911881] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T21:28:58.502393] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-01T21:28:59.302359] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-01T21:28:59.416039] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T21:29:00.102356] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-01T21:29:00.174579] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T21:29:00.301333] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T21:29:00.302833] [INFO ] [REMOTE ] SF: Full fetch complete (59859 records). [2025-10-01T21:29:00.302926] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-01T21:29:00.731751] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-01T21:29:00.731891] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-01T21:29:00.733333] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-01T21:29:00.733408] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-01T21:29:00.734878] [DEBUG] [LOCAL ] SF: Trimmed 59859 records to 41562 (keeping 200 days of data) [2025-10-01T21:29:00.923897] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-01T21:29:01.009406] [DEBUG] [LOCAL ] SF: Primary data saved (41562 records). [2025-10-01T21:29:01.009536] [INFO ] [MAIN ] SF: Full history saved. [2025-10-01T21:29:01.009623] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SF took 40.0s. Estimated remaining: 1h 6m 30s. Rate: 7.1 symbols/min [2025-10-01T21:29:01.202971] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:01.247120] [DEBUG] [LOCAL ] SGHC: Loaded 45946 existing records from primary storage. [2025-10-01T21:29:01.247455] [INFO ] [MAIN ] SGHC: Loaded 45946 existing records. [2025-10-01T21:29:01.449330] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:29:01.449577] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-01T21:29:01.449638] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-01T21:29:01.451174] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-01T21:29:01.451236] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-01T21:29:01.707469] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-01T21:29:01.871000] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:01.996715] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T21:29:02.120773] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-01T21:29:02.502381] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-01T21:29:03.306893] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-01T21:29:03.317629] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T21:29:03.416328] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T21:29:04.102392] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-01T21:29:04.749699] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T21:29:04.902395] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-01T21:29:05.203203] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T21:29:05.702414] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-01T21:29:06.298483] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T21:29:06.502380] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-01T21:29:07.302395] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-01T21:29:07.543462] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T21:29:08.015768] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-01T21:29:08.075916] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T21:29:08.102340] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-01T21:29:08.902374] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-01T21:29:09.154195] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T21:29:09.159553] [INFO ] [REMOTE ] SFL: Full fetch complete (65677 records). [2025-10-01T21:29:09.159724] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-01T21:29:09.589920] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-01T21:29:09.590018] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-01T21:29:09.591147] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-01T21:29:09.591219] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-01T21:29:09.592791] [DEBUG] [LOCAL ] SFL: Trimmed 65677 records to 45252 (keeping 200 days of data) [2025-10-01T21:29:09.704057] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-01T21:29:09.874011] [DEBUG] [LOCAL ] SFL: Primary data saved (45252 records). [2025-10-01T21:29:09.874158] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-01T21:29:09.874246] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SFL took 26.5s. Estimated remaining: 1h 6m 21s. Rate: 7.1 symbols/min [2025-10-01T21:29:10.080600] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:10.081007] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-01T21:29:10.081073] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-01T21:29:10.081284] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-01T21:29:10.081342] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-01T21:29:10.081390] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-01T21:29:10.081433] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-01T21:29:10.367600] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T21:29:10.393358] [INFO ] [REMOTE ] SFBS: Full fetch complete (30255 records). [2025-10-01T21:29:10.404069] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-01T21:29:10.517044] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-01T21:29:10.545271] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:10.939594] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-01T21:29:10.939781] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-01T21:29:10.940563] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-01T21:29:10.951667] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-01T21:29:10.972974] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T21:29:10.984147] [DEBUG] [LOCAL ] SFBS: Trimmed 30255 records to 21055 (keeping 200 days of data) [2025-10-01T21:29:11.122905] [DEBUG] [LOCAL ] SFBS: Primary data saved (21055 records). [2025-10-01T21:29:11.123031] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-01T21:29:11.123142] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SFBS took 32.3s. Estimated remaining: 1h 6m 11s. Rate: 7.1 symbols/min [2025-10-01T21:29:11.307501] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-01T21:29:11.336175] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:11.348048] [DEBUG] [LOCAL ] SGU: Loaded 6718 existing records from primary storage. [2025-10-01T21:29:11.348374] [INFO ] [MAIN ] SGU: Loaded 6718 existing records. [2025-10-01T21:29:11.547550] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:29:11.575823] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:29:11.576425] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-01T21:29:11.576257] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-01T21:29:11.576600] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:29:11.576747] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-01T21:29:11.576851] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-01T21:29:11.576941] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:29:11.577107] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-01T21:29:11.577202] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-01T21:29:11.577277] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-01T21:29:11.577378] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-01T21:29:11.577474] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGI took 1.7s. Estimated remaining: 1h 6m 1s. Rate: 7.1 symbols/min [2025-10-01T21:29:11.577527] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-01T21:29:11.616067] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-01T21:29:11.899697] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:12.123278] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-01T21:29:12.228798] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:12.244370] [DEBUG] [LOCAL ] SHAK: Loaded 48993 existing records from primary storage. [2025-10-01T21:29:12.251593] [INFO ] [MAIN ] SHAK: Loaded 48993 existing records. [2025-10-01T21:29:12.315953] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T21:29:12.479886] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:29:12.480137] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-01T21:29:12.480209] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-01T21:29:12.481415] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-01T21:29:12.481493] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-01T21:29:12.887058] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:12.902349] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-01T21:29:13.702399] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-01T21:29:14.014714] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T21:29:14.152034] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T21:29:14.502378] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-01T21:29:15.090528] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-01T21:29:15.115637] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T21:29:15.302387] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-01T21:29:16.102383] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-01T21:29:16.349982] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T21:29:16.902381] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-01T21:29:17.249545] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:29:17.702390] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-01T21:29:18.502346] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-01T21:29:18.605569] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:29:18.904422] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-01T21:29:19.302367] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-01T21:29:19.366392] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T21:29:19.914763] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T21:29:20.102374] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-01T21:29:20.608630] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-01T21:29:20.902379] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-01T21:29:21.702388] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-01T21:29:22.502369] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-01T21:29:23.004484] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T21:29:23.027521] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-01T21:29:23.302359] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-01T21:29:23.572896] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T21:29:24.102396] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-01T21:29:24.742675] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T21:29:24.897787] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T21:29:24.907477] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-01T21:29:25.530470] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T21:29:25.702383] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-01T21:29:26.217451] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-01T21:29:26.502409] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-01T21:29:27.266032] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T21:29:27.302383] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-01T21:29:28.102417] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-01T21:29:28.902387] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-01T21:29:29.371586] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-01T21:29:29.610147] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T21:29:29.680825] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T21:29:29.702336] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-01T21:29:30.083572] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-01T21:29:30.084362] [INFO ] [REMOTE ] SGU: Full fetch complete (9000 records). [2025-10-01T21:29:30.084434] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-01T21:29:30.496214] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-01T21:29:30.496297] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-01T21:29:30.496570] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-01T21:29:30.496632] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-01T21:29:30.497165] [DEBUG] [LOCAL ] SGU: Trimmed 9000 records to 6708 (keeping 200 days of data) [2025-10-01T21:29:30.514513] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-01T21:29:30.540828] [DEBUG] [LOCAL ] SGU: Primary data saved (6708 records). [2025-10-01T21:29:30.541076] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-01T21:29:30.541172] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGU took 19.4s. Estimated remaining: 1h 5m 55s. Rate: 7.1 symbols/min [2025-10-01T21:29:30.725617] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:30.753409] [DEBUG] [LOCAL ] SHCO: Loaded 25925 existing records from primary storage. [2025-10-01T21:29:30.753721] [INFO ] [MAIN ] SHCO: Loaded 25925 existing records. [2025-10-01T21:29:30.949400] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:29:30.949684] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-01T21:29:30.949745] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-01T21:29:30.950409] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-01T21:29:30.950472] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-01T21:29:31.307523] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-01T21:29:31.385280] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:31.739124] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T21:29:32.102429] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-01T21:29:32.902455] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-01T21:29:33.400468] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-01T21:29:33.571318] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T21:29:33.702424] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-01T21:29:33.915857] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T21:29:34.502407] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-01T21:29:34.843195] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-01T21:29:34.845415] [INFO ] [REMOTE ] SG: Full fetch complete (77277 records). [2025-10-01T21:29:34.845529] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-01T21:29:35.288754] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-01T21:29:35.288842] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-01T21:29:35.289946] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-01T21:29:35.290013] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-01T21:29:35.291537] [DEBUG] [LOCAL ] SG: Trimmed 77277 records to 53451 (keeping 200 days of data) [2025-10-01T21:29:35.341629] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-01T21:29:35.630946] [DEBUG] [LOCAL ] SG: Primary data saved (53451 records). [2025-10-01T21:29:35.631089] [INFO ] [MAIN ] SG: Full history saved. [2025-10-01T21:29:35.631192] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SG took 50.9s. Estimated remaining: 1h 5m 45s. Rate: 7.1 symbols/min [2025-10-01T21:29:35.792381] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T21:29:35.846581] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:35.900555] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-10-01T21:29:35.900946] [INFO ] [MAIN ] SHEL: Loaded 53671 existing records. [2025-10-01T21:29:36.097464] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:29:36.097736] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-01T21:29:36.097796] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-01T21:29:36.099081] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-01T21:29:36.099155] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-01T21:29:36.111676] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-01T21:29:36.500592] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:36.891296] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T21:29:36.902334] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-01T21:29:37.065605] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T21:29:37.702348] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-01T21:29:37.838444] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-01T21:29:38.502417] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-01T21:29:39.302395] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-01T21:29:39.607269] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T21:29:39.639044] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T21:29:40.102386] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-01T21:29:40.902382] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-01T21:29:40.951603] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T21:29:41.118523] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T21:29:41.702391] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-01T21:29:42.489253] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T21:29:42.502342] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-01T21:29:42.708858] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T21:29:43.302450] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-01T21:29:44.102363] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-01T21:29:44.193399] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T21:29:44.820919] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T21:29:44.902385] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-01T21:29:45.703262] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-01T21:29:45.703145] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T21:29:46.502392] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-01T21:29:46.735735] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T21:29:47.302427] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-01T21:29:47.334436] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T21:29:47.612938] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T21:29:48.102404] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-01T21:29:48.842064] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T21:29:48.902396] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-01T21:29:49.702396] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-01T21:29:50.042029] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T21:29:50.274369] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T21:29:50.502404] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-01T21:29:50.655839] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-01T21:29:50.657298] [INFO ] [REMOTE ] SGHC: Full fetch complete (63686 records). [2025-10-01T21:29:50.657387] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-01T21:29:51.078437] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-01T21:29:51.078556] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-01T21:29:51.079581] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-01T21:29:51.079691] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-01T21:29:51.082365] [DEBUG] [LOCAL ] SGHC: Trimmed 63686 records to 46072 (keeping 200 days of data) [2025-10-01T21:29:51.304089] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-01T21:29:51.378098] [DEBUG] [LOCAL ] SGHC: Primary data saved (46072 records). [2025-10-01T21:29:51.378240] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-01T21:29:51.378349] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SGHC took 50.4s. Estimated remaining: 1h 5m 39s. Rate: 7.1 symbols/min [2025-10-01T21:29:51.562197] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:51.591330] [DEBUG] [LOCAL ] SHG: Loaded 26602 existing records from primary storage. [2025-10-01T21:29:51.591622] [INFO ] [MAIN ] SHG: Loaded 26602 existing records. [2025-10-01T21:29:51.782767] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:29:51.783062] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-01T21:29:51.783112] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-01T21:29:51.783972] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-01T21:29:51.784048] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-01T21:29:52.109025] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-01T21:29:52.200607] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:52.330618] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T21:29:52.559158] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-01T21:29:52.902404] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-01T21:29:53.702358] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-01T21:29:53.885295] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T21:29:54.228168] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T21:29:54.502372] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-01T21:29:55.213174] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T21:29:55.214432] [INFO ] [REMOTE ] SHCO: Full fetch complete (37793 records). [2025-10-01T21:29:55.214541] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-01T21:29:55.307459] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-01T21:29:55.649734] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-01T21:29:55.649986] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-01T21:29:55.650856] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-01T21:29:55.650939] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-01T21:29:55.653418] [DEBUG] [LOCAL ] SHCO: Trimmed 37793 records to 25860 (keeping 200 days of data) [2025-10-01T21:29:55.830874] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-01T21:29:55.848630] [DEBUG] [LOCAL ] SHCO: Primary data saved (25860 records). [2025-10-01T21:29:55.848763] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-01T21:29:55.848920] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHCO took 25.3s. Estimated remaining: 1h 5m 29s. Rate: 7.1 symbols/min [2025-10-01T21:29:56.033039] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:29:56.084995] [DEBUG] [LOCAL ] SHO: Loaded 49720 existing records from primary storage. [2025-10-01T21:29:56.085324] [INFO ] [MAIN ] SHO: Loaded 49720 existing records. [2025-10-01T21:29:56.108219] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-01T21:29:56.299945] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:29:56.301016] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-01T21:29:56.301077] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-01T21:29:56.302603] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-01T21:29:56.302698] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-01T21:29:56.690260] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T21:29:56.755770] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:29:56.902410] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-01T21:29:57.702387] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-01T21:29:58.157928] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T21:29:58.389815] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-01T21:29:58.502348] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-01T21:29:58.961835] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T21:29:59.302394] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-01T21:29:59.998945] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T21:30:00.102429] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-01T21:30:00.902431] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-01T21:30:01.177732] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T21:30:01.383805] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T21:30:01.386388] [INFO ] [REMOTE ] SHAK: Full fetch complete (70266 records). [2025-10-01T21:30:01.386488] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-01T21:30:01.710144] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-01T21:30:01.837581] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-01T21:30:01.837752] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-01T21:30:01.838907] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-01T21:30:01.838973] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-01T21:30:01.840733] [DEBUG] [LOCAL ] SHAK: Trimmed 70266 records to 48937 (keeping 200 days of data) [2025-10-01T21:30:02.192994] [DEBUG] [LOCAL ] SHAK: Primary data saved (48937 records). [2025-10-01T21:30:02.193200] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-01T21:30:02.193353] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHAK took 50.6s. Estimated remaining: 1h 5m 20s. Rate: 7.1 symbols/min [2025-10-01T21:30:02.391194] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:02.397681] [DEBUG] [LOCAL ] SHOC: Loaded 3506 existing records from primary storage. [2025-10-01T21:30:02.397924] [INFO ] [MAIN ] SHOC: Loaded 3506 existing records. [2025-10-01T21:30:02.513679] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-01T21:30:02.618726] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:30:02.619020] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-01T21:30:02.619080] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-01T21:30:02.619504] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-01T21:30:02.619576] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-01T21:30:02.717427] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T21:30:03.055948] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:03.128244] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T21:30:03.302435] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-01T21:30:04.037377] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T21:30:04.102399] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-01T21:30:04.740068] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-01T21:30:04.902395] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-01T21:30:05.568305] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T21:30:05.702408] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-01T21:30:06.428290] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-01T21:30:06.430553] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-01T21:30:06.430690] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-01T21:30:06.507509] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-01T21:30:06.869154] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-01T21:30:06.869290] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-01T21:30:06.870407] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-01T21:30:06.870475] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-01T21:30:06.872348] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 53671 (keeping 200 days of data) [2025-10-01T21:30:07.244096] [DEBUG] [LOCAL ] SHEL: Primary data saved (53671 records). [2025-10-01T21:30:07.244248] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-01T21:30:07.244334] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHEL took 31.6s. Estimated remaining: 1h 5m 11s. Rate: 7.1 symbols/min [2025-10-01T21:30:07.311758] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-01T21:30:07.470303] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:07.477625] [DEBUG] [LOCAL ] SHW: No existing data file found in primary storage. [2025-10-01T21:30:07.479899] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T21:30:07.480068] [WARN ] [MAIN ] SHW: No existing data found, performing full refresh instead. [2025-10-01T21:30:07.492484] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T21:30:07.496730] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-01T21:30:07.496831] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-01T21:30:07.496882] [DEBUG] [LOCAL ] SHW: No primary data file found to delete. [2025-10-01T21:30:07.496918] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-01T21:30:07.922345] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:08.102386] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-01T21:30:08.628062] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T21:30:08.902402] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-01T21:30:09.702424] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-01T21:30:09.850751] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T21:30:10.502389] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-01T21:30:10.812603] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-01T21:30:10.965533] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T21:30:11.302425] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-01T21:30:11.896716] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T21:30:12.102387] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-01T21:30:12.881737] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T21:30:12.902341] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-01T21:30:13.485681] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T21:30:13.587803] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-01T21:30:13.702379] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-01T21:30:14.502394] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-01T21:30:14.896471] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T21:30:15.302366] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-01T21:30:16.048427] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-01T21:30:16.049788] [INFO ] [REMOTE ] SHG: Full fetch complete (41201 records). [2025-10-01T21:30:16.049904] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-01T21:30:16.109431] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-01T21:30:16.392122] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T21:30:16.550841] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-01T21:30:16.550925] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-01T21:30:16.551706] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-01T21:30:16.551780] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-01T21:30:16.552784] [DEBUG] [LOCAL ] SHG: Trimmed 41201 records to 26523 (keeping 200 days of data) [2025-10-01T21:30:16.725156] [DEBUG] [LOCAL ] SHG: Primary data saved (26523 records). [2025-10-01T21:30:16.725303] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-01T21:30:16.725390] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHG took 25.3s. Estimated remaining: 1h 5m 3s. Rate: 7.1 symbols/min [2025-10-01T21:30:16.906827] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-01T21:30:16.929782] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:16.930019] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-01T21:30:16.930071] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-01T21:30:16.930183] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-01T21:30:16.930227] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-01T21:30:16.930271] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-01T21:30:16.930305] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-01T21:30:17.347708] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:17.702376] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-01T21:30:17.898236] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:30:17.898568] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-01T21:30:17.898680] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:30:17.898750] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-01T21:30:17.898816] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:30:17.898893] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-01T21:30:17.898958] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-01T21:30:17.898995] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-01T21:30:17.899051] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-01T21:30:17.899147] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SI took 1.2s. Estimated remaining: 1h 4m 52s. Rate: 7.1 symbols/min [2025-10-01T21:30:18.097498] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:18.129157] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T21:30:18.178403] [DEBUG] [LOCAL ] SID: Loaded 42311 existing records from primary storage. [2025-10-01T21:30:18.178756] [INFO ] [MAIN ] SID: Loaded 42311 existing records. [2025-10-01T21:30:18.379105] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:30:18.379382] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-01T21:30:18.379461] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-01T21:30:18.380519] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-01T21:30:18.380588] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-01T21:30:18.504703] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-01T21:30:18.514685] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T21:30:18.829280] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:19.302353] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-01T21:30:20.102349] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-01T21:30:20.222886] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:30:20.668024] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T21:30:20.902408] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-01T21:30:20.976947] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:30:21.702403] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-01T21:30:22.502381] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-01T21:30:22.531960] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T21:30:22.578878] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T21:30:23.302382] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-01T21:30:23.894246] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T21:30:24.102393] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-01T21:30:24.272690] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T21:30:24.575409] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T21:30:24.902425] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-01T21:30:25.243302] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-01T21:30:25.702416] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-01T21:30:26.502398] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-01T21:30:26.705708] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T21:30:26.707770] [INFO ] [REMOTE ] SHO: Full fetch complete (71044 records). [2025-10-01T21:30:26.707936] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-01T21:30:26.978722] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-01T21:30:27.196530] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-01T21:30:27.196616] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-01T21:30:27.197708] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-01T21:30:27.197773] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-01T21:30:27.199322] [DEBUG] [LOCAL ] SHO: Trimmed 71044 records to 49689 (keeping 200 days of data) [2025-10-01T21:30:27.302391] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-01T21:30:27.529535] [DEBUG] [LOCAL ] SHO: Primary data saved (49689 records). [2025-10-01T21:30:27.529742] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-01T21:30:27.529906] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHO took 31.7s. Estimated remaining: 1h 4m 44s. Rate: 7.1 symbols/min [2025-10-01T21:30:27.719602] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:27.767553] [DEBUG] [LOCAL ] SIG: Loaded 46241 existing records from primary storage. [2025-10-01T21:30:27.767911] [INFO ] [MAIN ] SIG: Loaded 46241 existing records. [2025-10-01T21:30:27.861606] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-01T21:30:27.976302] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:30:27.976522] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-01T21:30:27.976605] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-01T21:30:27.977694] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-01T21:30:27.977758] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-01T21:30:28.107601] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-01T21:30:28.379658] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:28.902435] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-01T21:30:29.702420] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-01T21:30:29.981007] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T21:30:30.384795] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T21:30:30.502394] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-01T21:30:31.047291] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T21:30:31.302430] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-01T21:30:32.102412] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-01T21:30:32.498545] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-01T21:30:32.902374] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-01T21:30:32.955986] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T21:30:33.480034] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T21:30:33.702399] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-01T21:30:34.357894] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T21:30:34.502412] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-01T21:30:34.994565] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T21:30:35.302357] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-01T21:30:35.343788] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T21:30:36.102397] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-01T21:30:36.425901] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T21:30:36.426888] [INFO ] [REMOTE ] SHOC: Full fetch complete (7357 records). [2025-10-01T21:30:36.426990] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-01T21:30:36.826273] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-01T21:30:36.826464] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-01T21:30:36.826743] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-01T21:30:36.826865] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-01T21:30:36.842170] [DEBUG] [LOCAL ] SHOC: Trimmed 7357 records to 3478 (keeping 200 days of data) [2025-10-01T21:30:36.864700] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T21:30:36.888752] [DEBUG] [LOCAL ] SHOC: Primary data saved (3478 records). [2025-10-01T21:30:36.888947] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-01T21:30:36.889065] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SHOC took 34.7s. Estimated remaining: 1h 4m 36s. Rate: 7.1 symbols/min [2025-10-01T21:30:36.910384] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-01T21:30:37.093099] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:37.117843] [DEBUG] [LOCAL ] SII: Loaded 23525 existing records from primary storage. [2025-10-01T21:30:37.118200] [INFO ] [MAIN ] SII: Loaded 23525 existing records. [2025-10-01T21:30:37.314206] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:30:37.314427] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-01T21:30:37.314508] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-01T21:30:37.315343] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-01T21:30:37.315410] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-01T21:30:37.706826] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:37.702758] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-01T21:30:38.311046] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T21:30:38.502399] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-01T21:30:39.302358] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-01T21:30:39.708081] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-01T21:30:40.102383] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-01T21:30:40.252673] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T21:30:40.316043] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T21:30:40.902379] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-01T21:30:41.702373] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-01T21:30:41.981754] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T21:30:42.502353] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-01T21:30:42.669750] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-01T21:30:42.908213] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T21:30:43.302396] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-01T21:30:44.113813] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-01T21:30:44.116822] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:30:44.399079] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T21:30:44.902421] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-01T21:30:45.506415] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T21:30:45.702383] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-01T21:30:46.515037] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-01T21:30:46.518276] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:30:47.302405] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-01T21:30:47.365253] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T21:30:47.752753] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T21:30:47.754487] [INFO ] [REMOTE ] SHW: Full fetch complete (72986 records). [2025-10-01T21:30:47.754759] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-01T21:30:48.107524] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-01T21:30:48.208013] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-01T21:30:48.208113] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-01T21:30:48.209170] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-01T21:30:48.209235] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-01T21:30:48.210728] [DEBUG] [LOCAL ] SHW: Trimmed 72986 records to 50319 (keeping 200 days of data) [2025-10-01T21:30:48.324370] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T21:30:48.566169] [DEBUG] [LOCAL ] SHW: Primary data saved (50319 records). [2025-10-01T21:30:48.566320] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-01T21:30:48.566434] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SHW took 41.3s. Estimated remaining: 1h 4m 28s. Rate: 7.1 symbols/min [2025-10-01T21:30:48.761889] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:48.795592] [DEBUG] [LOCAL ] SILA: Loaded 30891 existing records from primary storage. [2025-10-01T21:30:48.795934] [INFO ] [MAIN ] SILA: Loaded 30891 existing records. [2025-10-01T21:30:48.909053] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-01T21:30:48.999303] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:30:48.999520] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-01T21:30:48.999612] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-01T21:30:49.000402] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-01T21:30:49.000464] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-01T21:30:49.406521] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:49.702405] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-01T21:30:49.842832] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T21:30:49.883094] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T21:30:50.502403] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-01T21:30:51.198862] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T21:30:51.248264] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T21:30:51.302371] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-01T21:30:52.102406] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-01T21:30:52.548557] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T21:30:52.902404] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-01T21:30:53.557157] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T21:30:53.702416] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-01T21:30:54.476011] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T21:30:54.502927] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-01T21:30:54.502846] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T21:30:55.302386] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-01T21:30:56.107290] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-01T21:30:56.124673] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T21:30:56.167190] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T21:30:56.168714] [INFO ] [REMOTE ] SID: Full fetch complete (60865 records). [2025-10-01T21:30:56.168811] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-01T21:30:56.587604] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-01T21:30:56.587725] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-01T21:30:56.588702] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-01T21:30:56.588770] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-01T21:30:56.590089] [DEBUG] [LOCAL ] SID: Trimmed 60865 records to 42317 (keeping 200 days of data) [2025-10-01T21:30:56.836383] [DEBUG] [LOCAL ] SID: Primary data saved (42317 records). [2025-10-01T21:30:56.836524] [INFO ] [MAIN ] SID: Full history saved. [2025-10-01T21:30:56.836619] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SID took 38.9s. Estimated remaining: 1h 4m 20s. Rate: 7.1 symbols/min [2025-10-01T21:30:56.907512] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-01T21:30:57.022574] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:30:57.061578] [DEBUG] [LOCAL ] SITC: Loaded 41568 existing records from primary storage. [2025-10-01T21:30:57.061904] [INFO ] [MAIN ] SITC: Loaded 41568 existing records. [2025-10-01T21:30:57.258441] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:30:57.258668] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-01T21:30:57.258733] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-01T21:30:57.259750] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-01T21:30:57.259817] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-01T21:30:57.661982] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:30:57.684832] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:30:57.702365] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-01T21:30:57.723724] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T21:30:58.502401] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-01T21:30:59.302386] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-01T21:30:59.406870] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:30:59.737159] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T21:31:00.102402] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-01T21:31:00.453017] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T21:31:00.902352] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-01T21:31:01.099531] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T21:31:01.702406] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-01T21:31:01.969954] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T21:31:02.502433] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-01T21:31:02.753261] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T21:31:03.302380] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-01T21:31:03.933781] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T21:31:04.102398] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-01T21:31:04.423370] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T21:31:04.902382] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-01T21:31:05.565723] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T21:31:05.567012] [INFO ] [REMOTE ] SII: Full fetch complete (30178 records). [2025-10-01T21:31:05.567091] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-01T21:31:05.706778] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-01T21:31:05.763310] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-01T21:31:06.029852] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-01T21:31:06.029950] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-01T21:31:06.030729] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-01T21:31:06.030797] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-01T21:31:06.031886] [DEBUG] [LOCAL ] SII: Trimmed 30178 records to 23579 (keeping 200 days of data) [2025-10-01T21:31:06.182351] [DEBUG] [LOCAL ] SII: Primary data saved (23579 records). [2025-10-01T21:31:06.182494] [INFO ] [MAIN ] SII: Full history saved. [2025-10-01T21:31:06.182605] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SII took 29.3s. Estimated remaining: 1h 4m 11s. Rate: 7.1 symbols/min [2025-10-01T21:31:06.502419] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-01T21:31:06.867016] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T21:31:06.868569] [INFO ] [REMOTE ] SIG: Full fetch complete (67946 records). [2025-10-01T21:31:06.868730] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-01T21:31:07.304619] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-01T21:31:07.305040] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-01T21:31:07.305385] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-01T21:31:07.307247] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-01T21:31:07.307468] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-01T21:31:07.313216] [DEBUG] [LOCAL ] SIG: Trimmed 67946 records to 46221 (keeping 200 days of data) [2025-10-01T21:31:07.633762] [DEBUG] [LOCAL ] SIG: Primary data saved (46221 records). [2025-10-01T21:31:07.633913] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-01T21:31:07.634005] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SIG took 40.1s. Estimated remaining: 1h 4m 1s. Rate: 7.1 symbols/min [2025-10-01T21:31:07.734341] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T21:31:08.102392] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-01T21:31:08.448571] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T21:31:08.902540] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-01T21:31:08.940083] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T21:31:09.702367] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-01T21:31:10.599800] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:31:10.609047] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-01T21:31:10.847150] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T21:31:11.302378] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-01T21:31:11.990165] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T21:31:12.102365] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-01T21:31:12.558471] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-01T21:31:12.902393] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-01T21:31:13.264104] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T21:31:13.702353] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-01T21:31:13.840623] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-01T21:31:14.502376] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-01T21:31:15.284113] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T21:31:15.302337] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-01T21:31:15.625135] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T21:31:16.102383] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-01T21:31:16.737464] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T21:31:16.902381] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-01T21:31:16.918976] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T21:31:16.920136] [INFO ] [REMOTE ] SILA: Full fetch complete (45089 records). [2025-10-01T21:31:16.920227] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-01T21:31:17.369517] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-01T21:31:17.369630] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-01T21:31:17.370840] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-01T21:31:17.370920] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-01T21:31:17.372281] [DEBUG] [LOCAL ] SILA: Trimmed 45089 records to 30819 (keeping 200 days of data) [2025-10-01T21:31:17.646551] [DEBUG] [LOCAL ] SILA: Primary data saved (30819 records). [2025-10-01T21:31:17.646806] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-01T21:31:17.647017] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SILA took 29.1s. Estimated remaining: 1h 3m 53s. Rate: 7.1 symbols/min [2025-10-01T21:31:18.374052] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T21:31:18.389502] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-01T21:31:19.507719] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T21:31:19.509560] [INFO ] [REMOTE ] SITC: Full fetch complete (60963 records). [2025-10-01T21:31:19.509684] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-01T21:31:19.937780] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-01T21:31:19.937879] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-01T21:31:19.939006] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-01T21:31:19.939127] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-01T21:31:19.940514] [DEBUG] [LOCAL ] SITC: Trimmed 60963 records to 41600 (keeping 200 days of data) [2025-10-01T21:31:20.204697] [DEBUG] [LOCAL ] SITC: Primary data saved (41600 records). [2025-10-01T21:31:20.204835] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-01T21:31:20.204929] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 23.4s. Estimated remaining: 1h 3m 43s. Rate: 7.1 symbols/min [2025-10-01T21:31:20.870541] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:20.956420] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:20.965149] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:20.970635] [DEBUG] [LOCAL ] SJM: No existing data file found in primary storage. [2025-10-01T21:31:21.002011] [WARN ] [MAIN ] SJM: No existing data found, performing full refresh instead. [2025-10-01T21:31:21.023364] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-01T21:31:21.025058] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-01T21:31:21.025181] [DEBUG] [LOCAL ] SJM: No primary data file found to delete. [2025-10-01T21:31:21.024793] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:21.025255] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-01T21:31:21.278535] [DEBUG] [LOCAL ] SJT: Loaded 22341 existing records from primary storage. [2025-10-01T21:31:21.290133] [DEBUG] [LOCAL ] SKE: Loaded 35873 existing records from primary storage. [2025-10-01T21:31:21.316889] [INFO ] [MAIN ] SJT: Loaded 22341 existing records. [2025-10-01T21:31:21.372920] [INFO ] [MAIN ] SKE: Loaded 35873 existing records. [2025-10-01T21:31:21.408124] [DEBUG] [LOCAL ] SITE: Loaded 35018 existing records from primary storage. [2025-10-01T21:31:21.546846] [INFO ] [MAIN ] SITE: Loaded 35018 existing records. [2025-10-01T21:31:21.996484] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:22.149231] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:31:22.156619] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-01T21:31:22.156134] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:31:22.156978] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-01T21:31:22.158244] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-01T21:31:22.164055] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-01T21:31:22.171526] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-01T21:31:22.171414] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-01T21:31:22.210455] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-01T21:31:22.216849] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-01T21:31:22.291973] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:31:22.323989] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-01T21:31:22.433628] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-01T21:31:22.453448] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-01T21:31:22.503259] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-01T21:31:22.603192] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-01T21:31:23.204804] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:23.245612] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-01T21:31:23.430419] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:23.444527] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-01T21:31:23.553886] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:23.554260] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-01T21:31:23.834216] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T21:31:23.845742] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-01T21:31:24.424281] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T21:31:24.430237] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-01T21:31:24.719848] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T21:31:24.726160] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-01T21:31:24.848355] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T21:31:24.855579] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-01T21:31:25.241568] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T21:31:25.252002] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-01T21:31:25.465468] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T21:31:25.702361] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-01T21:31:26.138829] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T21:31:26.146947] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-01T21:31:26.342902] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T21:31:26.502424] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-01T21:31:26.954223] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T21:31:27.302360] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-01T21:31:27.546675] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T21:31:28.102348] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-01T21:31:28.600173] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T21:31:28.902429] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-01T21:31:29.325847] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T21:31:29.702392] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-01T21:31:30.502361] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-01T21:31:30.634041] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T21:31:30.919379] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-01T21:31:31.302439] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-01T21:31:31.938400] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T21:31:32.102396] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-01T21:31:32.426109] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T21:31:32.902426] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-01T21:31:33.690241] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T21:31:33.702343] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-01T21:31:33.763144] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T21:31:34.502429] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-01T21:31:35.125995] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T21:31:35.302402] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-01T21:31:36.102359] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-01T21:31:36.149441] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T21:31:36.315695] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T21:31:36.902372] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-01T21:31:37.418122] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T21:31:37.702442] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-01T21:31:38.502394] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-01T21:31:38.700965] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T21:31:38.944575] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T21:31:39.302411] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-01T21:31:39.357971] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-01T21:31:40.102409] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-01T21:31:40.902407] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-01T21:31:41.142398] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-01T21:31:41.478553] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T21:31:41.702446] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-01T21:31:41.957869] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-01T21:31:42.502453] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-01T21:31:43.302374] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-01T21:31:43.564615] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T21:31:43.592851] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T21:31:44.102425] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-01T21:31:44.696813] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T21:31:44.902378] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-01T21:31:45.702353] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-01T21:31:45.964309] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T21:31:46.341467] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T21:31:46.502393] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-01T21:31:46.696954] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T21:31:47.302437] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-01T21:31:47.955540] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:31:48.102393] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-01T21:31:48.781040] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T21:31:48.782564] [INFO ] [REMOTE ] SJT: Full fetch complete (32184 records). [2025-10-01T21:31:48.782703] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-01T21:31:48.907459] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-01T21:31:49.211845] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-01T21:31:49.212116] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-01T21:31:49.212899] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-01T21:31:49.212963] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-01T21:31:49.213860] [DEBUG] [LOCAL ] SJT: Trimmed 32184 records to 22413 (keeping 200 days of data) [2025-10-01T21:31:49.377187] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-01T21:31:49.393757] [DEBUG] [LOCAL ] SJT: Primary data saved (22413 records). [2025-10-01T21:31:49.394362] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-01T21:31:49.394528] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SJT took 29.2s. Estimated remaining: 1h 3m 40s. Rate: 7.1 symbols/min [2025-10-01T21:31:49.591956] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:49.600557] [DEBUG] [LOCAL ] SKIL: Loaded 6305 existing records from primary storage. [2025-10-01T21:31:49.600766] [INFO ] [MAIN ] SKIL: Loaded 6305 existing records. [2025-10-01T21:31:49.710712] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-01T21:31:49.801067] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:31:49.801275] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-01T21:31:49.801324] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-01T21:31:49.801623] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-01T21:31:49.801731] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-01T21:31:50.192240] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:50.416565] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T21:31:50.502395] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-01T21:31:50.970260] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T21:31:50.972058] [INFO ] [REMOTE ] SJM: Full fetch complete (72089 records). [2025-10-01T21:31:50.972200] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-01T21:31:51.309414] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-01T21:31:51.314366] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T21:31:51.417695] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-01T21:31:51.417795] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-01T21:31:51.418863] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-01T21:31:51.418934] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-01T21:31:51.420408] [DEBUG] [LOCAL ] SJM: Trimmed 72089 records to 50162 (keeping 200 days of data) [2025-10-01T21:31:51.749001] [DEBUG] [LOCAL ] SJM: Primary data saved (50162 records). [2025-10-01T21:31:51.749178] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-01T21:31:51.749334] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SJM took 31.5s. Estimated remaining: 1h 3m 30s. Rate: 7.1 symbols/min [2025-10-01T21:31:51.949573] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:51.962906] [DEBUG] [LOCAL ] SKLZ: Loaded 11935 existing records from primary storage. [2025-10-01T21:31:51.963149] [INFO ] [MAIN ] SKLZ: Loaded 11935 existing records. [2025-10-01T21:31:52.107558] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-01T21:31:52.168427] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:31:52.168628] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-01T21:31:52.168836] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-01T21:31:52.169245] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-01T21:31:52.169307] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-01T21:31:52.601870] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:52.759477] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T21:31:52.902384] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-01T21:31:53.642608] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T21:31:53.702365] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-01T21:31:53.796067] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T21:31:54.502426] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-01T21:31:54.685153] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T21:31:54.686436] [INFO ] [REMOTE ] SITE: Full fetch complete (49581 records). [2025-10-01T21:31:54.686538] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-01T21:31:55.132223] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T21:31:55.135150] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-01T21:31:55.137055] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-01T21:31:55.139034] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-01T21:31:55.139104] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-01T21:31:55.140370] [DEBUG] [LOCAL ] SITE: Trimmed 49581 records to 35012 (keeping 200 days of data) [2025-10-01T21:31:55.314773] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-01T21:31:55.371853] [DEBUG] [LOCAL ] SITE: Primary data saved (35012 records). [2025-10-01T21:31:55.372004] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-01T21:31:55.372092] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SITE took 35.2s. Estimated remaining: 1h 3m 20s. Rate: 7.1 symbols/min [2025-10-01T21:31:55.569143] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:55.607091] [DEBUG] [LOCAL ] SKM: Loaded 34975 existing records from primary storage. [2025-10-01T21:31:55.607382] [INFO ] [MAIN ] SKM: Loaded 34975 existing records. [2025-10-01T21:31:55.812087] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:31:55.812310] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-01T21:31:55.812358] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-01T21:31:55.813266] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-01T21:31:55.813327] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-01T21:31:56.114267] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-01T21:31:56.127716] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T21:31:56.213725] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:56.902351] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-01T21:31:57.321383] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T21:31:57.702459] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-01T21:31:57.971755] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T21:31:57.973086] [INFO ] [REMOTE ] SKE: Full fetch complete (50479 records). [2025-10-01T21:31:57.973163] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-01T21:31:58.419314] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-01T21:31:58.419471] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-01T21:31:58.420467] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-01T21:31:58.420549] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-01T21:31:58.421848] [DEBUG] [LOCAL ] SKE: Trimmed 50479 records to 35974 (keeping 200 days of data) [2025-10-01T21:31:58.508277] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-01T21:31:58.543266] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-01T21:31:58.656365] [DEBUG] [LOCAL ] SKE: Primary data saved (35974 records). [2025-10-01T21:31:58.656521] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-01T21:31:58.656612] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SKE took 38.5s. Estimated remaining: 1h 3m 10s. Rate: 7.1 symbols/min [2025-10-01T21:31:58.844723] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:31:58.888375] [DEBUG] [LOCAL ] SKT: Loaded 42511 existing records from primary storage. [2025-10-01T21:31:58.888760] [INFO ] [MAIN ] SKT: Loaded 42511 existing records. [2025-10-01T21:31:59.089134] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:31:59.089420] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-01T21:31:59.089479] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-01T21:31:59.090441] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-01T21:31:59.090505] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-01T21:31:59.307627] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-01T21:31:59.494945] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:31:59.587983] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-01T21:32:00.102397] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-01T21:32:00.323844] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T21:32:00.499360] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-01T21:32:00.902391] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-01T21:32:01.704071] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-01T21:32:01.706004] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T21:32:02.502395] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-01T21:32:03.202158] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T21:32:03.302389] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-01T21:32:03.732832] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T21:32:04.102385] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-01T21:32:04.776843] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T21:32:04.902391] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-01T21:32:05.493977] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T21:32:05.702387] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-01T21:32:06.175618] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T21:32:06.469054] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T21:32:06.502382] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-01T21:32:07.240002] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T21:32:07.302390] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-01T21:32:08.102378] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-01T21:32:08.694529] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-01T21:32:08.709948] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T21:32:08.902398] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-01T21:32:09.429860] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T21:32:09.702389] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-01T21:32:10.502401] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-01T21:32:11.276839] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T21:32:11.302367] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-01T21:32:12.107610] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-01T21:32:12.123366] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T21:32:12.599180] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-01T21:32:12.600032] [INFO ] [REMOTE ] SKIL: Full fetch complete (9982 records). [2025-10-01T21:32:12.600107] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-01T21:32:12.806241] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T21:32:12.907488] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-01T21:32:13.045662] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-01T21:32:13.045781] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-01T21:32:13.046082] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-01T21:32:13.046173] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-01T21:32:13.046703] [DEBUG] [LOCAL ] SKIL: Trimmed 9982 records to 6339 (keeping 200 days of data) [2025-10-01T21:32:13.086972] [DEBUG] [LOCAL ] SKIL: Primary data saved (6339 records). [2025-10-01T21:32:13.087120] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-01T21:32:13.087244] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKIL took 23.7s. Estimated remaining: 1h 3m 3s. Rate: 7.1 symbols/min [2025-10-01T21:32:13.275118] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:32:13.326125] [DEBUG] [LOCAL ] SKY: Loaded 37750 existing records from primary storage. [2025-10-01T21:32:13.326428] [INFO ] [MAIN ] SKY: Loaded 37750 existing records. [2025-10-01T21:32:13.520285] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:32:13.520588] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-01T21:32:13.520664] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-01T21:32:13.521534] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-01T21:32:13.521608] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-01T21:32:13.707285] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-01T21:32:13.937618] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:32:13.947500] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-01T21:32:14.502379] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-01T21:32:15.292175] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T21:32:15.302337] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-01T21:32:15.368412] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T21:32:16.102391] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-01T21:32:16.663811] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T21:32:16.902431] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-01T21:32:17.702396] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-01T21:32:17.764042] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T21:32:18.159157] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T21:32:18.502384] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-01T21:32:18.947396] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T21:32:19.302426] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-01T21:32:20.093024] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T21:32:20.102348] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-01T21:32:20.204057] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T21:32:20.704532] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T21:32:20.902390] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-01T21:32:21.702418] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-01T21:32:22.397516] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T21:32:22.502374] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-01T21:32:23.004780] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T21:32:23.302431] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-01T21:32:23.558326] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-01T21:32:24.102402] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-01T21:32:24.307959] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T21:32:24.902436] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-01T21:32:25.216055] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T21:32:25.702466] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-01T21:32:25.879425] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T21:32:26.502450] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-01T21:32:26.770615] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T21:32:27.302422] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-01T21:32:27.322616] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T21:32:28.102414] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-01T21:32:28.815336] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T21:32:28.902379] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-01T21:32:29.291863] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T21:32:29.702396] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-01T21:32:29.752081] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T21:32:29.753470] [INFO ] [REMOTE ] SKM: Full fetch complete (48059 records). [2025-10-01T21:32:29.753591] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-01T21:32:30.182100] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-01T21:32:30.182193] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-01T21:32:30.183079] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-01T21:32:30.183148] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-01T21:32:30.184386] [DEBUG] [LOCAL ] SKM: Trimmed 48059 records to 34920 (keeping 200 days of data) [2025-10-01T21:32:30.413580] [DEBUG] [LOCAL ] SKM: Primary data saved (34920 records). [2025-10-01T21:32:30.414060] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-01T21:32:30.414208] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKM took 35.0s. Estimated remaining: 1h 2m 57s. Rate: 7.1 symbols/min [2025-10-01T21:32:30.511322] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-01T21:32:30.606028] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:32:30.625284] [DEBUG] [LOCAL ] SKYH: Loaded 16576 existing records from primary storage. [2025-10-01T21:32:30.625536] [INFO ] [MAIN ] SKYH: Loaded 16576 existing records. [2025-10-01T21:32:30.819168] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:32:30.819466] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-01T21:32:30.819517] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-01T21:32:30.820483] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-01T21:32:30.820547] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-01T21:32:31.064909] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-01T21:32:31.111048] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18830 records). [2025-10-01T21:32:31.136384] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-01T21:32:31.307462] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-01T21:32:31.333440] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:32:31.581237] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T21:32:31.720456] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-01T21:32:31.720538] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-01T21:32:31.721001] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-01T21:32:31.721063] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-01T21:32:31.721676] [DEBUG] [LOCAL ] SKLZ: Trimmed 18830 records to 11725 (keeping 200 days of data) [2025-10-01T21:32:31.793871] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11725 records). [2025-10-01T21:32:31.794015] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-01T21:32:31.794143] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKLZ took 40.0s. Estimated remaining: 1h 2m 47s. Rate: 7.1 symbols/min [2025-10-01T21:32:32.003165] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:32:32.003496] [DEBUG] [LOCAL ] SLB: No existing data file found in primary storage. [2025-10-01T21:32:32.003550] [WARN ] [MAIN ] SLB: No existing data found, performing full refresh instead. [2025-10-01T21:32:32.003701] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-01T21:32:32.003756] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-01T21:32:32.003817] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-01T21:32:32.003852] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-01T21:32:32.107848] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-01T21:32:32.415780] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:32:32.767751] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T21:32:32.902449] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-01T21:32:33.703413] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T21:32:33.712703] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-01T21:32:34.502347] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-01T21:32:34.686281] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-01T21:32:34.779810] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T21:32:35.302423] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-01T21:32:36.063062] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T21:32:36.102344] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-01T21:32:36.271140] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T21:32:36.272455] [INFO ] [REMOTE ] SKT: Full fetch complete (60282 records). [2025-10-01T21:32:36.272535] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-01T21:32:36.689545] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-01T21:32:36.689630] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-01T21:32:36.690686] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-01T21:32:36.690757] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-01T21:32:36.692148] [DEBUG] [LOCAL ] SKT: Trimmed 60282 records to 42490 (keeping 200 days of data) [2025-10-01T21:32:36.920904] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-01T21:32:36.973069] [DEBUG] [LOCAL ] SKT: Primary data saved (42490 records). [2025-10-01T21:32:36.973203] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-01T21:32:36.973320] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKT took 38.3s. Estimated remaining: 1h 2m 38s. Rate: 7.1 symbols/min [2025-10-01T21:32:37.164898] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:32:37.207181] [DEBUG] [LOCAL ] SLF: Loaded 38760 existing records from primary storage. [2025-10-01T21:32:37.207512] [INFO ] [MAIN ] SLF: Loaded 38760 existing records. [2025-10-01T21:32:37.402873] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:32:37.403182] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-01T21:32:37.403297] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-01T21:32:37.404267] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-01T21:32:37.404330] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-01T21:32:37.707347] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-01T21:32:37.886146] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T21:32:37.890340] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:32:37.891679] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T21:32:38.502388] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-01T21:32:39.302423] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-01T21:32:39.941578] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T21:32:40.049049] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-01T21:32:40.102365] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-01T21:32:40.857108] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T21:32:40.862455] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T21:32:40.902353] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-01T21:32:41.702437] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-01T21:32:42.510243] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-01T21:32:42.528197] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T21:32:42.732097] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T21:32:43.302388] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-01T21:32:43.916973] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T21:32:44.102379] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-01T21:32:44.902401] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-01T21:32:45.053162] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T21:32:45.134043] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T21:32:45.702386] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-01T21:32:45.916566] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T21:32:45.917968] [INFO ] [REMOTE ] SKY: Full fetch complete (54698 records). [2025-10-01T21:32:45.918116] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-01T21:32:46.353231] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-01T21:32:46.353318] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-01T21:32:46.354267] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-01T21:32:46.354336] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-01T21:32:46.355579] [DEBUG] [LOCAL ] SKY: Trimmed 54698 records to 37776 (keeping 200 days of data) [2025-10-01T21:32:46.534063] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-01T21:32:46.601056] [DEBUG] [LOCAL ] SKY: Primary data saved (37776 records). [2025-10-01T21:32:46.601246] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-01T21:32:46.601422] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKY took 33.5s. Estimated remaining: 1h 2m 29s. Rate: 7.1 symbols/min [2025-10-01T21:32:46.801830] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:32:46.848811] [DEBUG] [LOCAL ] SLG: Loaded 45336 existing records from primary storage. [2025-10-01T21:32:46.849164] [INFO ] [MAIN ] SLG: Loaded 45336 existing records. [2025-10-01T21:32:47.051146] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:32:47.051419] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-01T21:32:47.051540] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-01T21:32:47.052872] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-01T21:32:47.052961] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-01T21:32:47.284858] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T21:32:47.307476] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-01T21:32:47.524627] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:32:47.791800] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T21:32:48.102383] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-01T21:32:48.890148] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T21:32:48.902354] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-01T21:32:49.702354] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-01T21:32:49.777630] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T21:32:50.492032] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T21:32:50.503063] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-01T21:32:51.310077] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-01T21:32:51.326495] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T21:32:51.439243] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-01T21:32:52.102399] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-01T21:32:52.902368] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-01T21:32:53.029513] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T21:32:53.384460] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T21:32:53.702405] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-01T21:32:54.174127] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T21:32:54.502425] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-01T21:32:55.302362] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-01T21:32:55.762328] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T21:32:55.968349] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T21:32:56.102366] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-01T21:32:56.234979] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T21:32:56.902397] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-01T21:32:57.620602] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T21:32:57.702408] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-01T21:32:57.880413] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T21:32:58.502392] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-01T21:32:59.039692] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-01T21:32:59.040969] [INFO ] [REMOTE ] SKYH: Full fetch complete (22407 records). [2025-10-01T21:32:59.041060] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-01T21:32:59.307552] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-01T21:32:59.495465] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-01T21:32:59.495574] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-01T21:32:59.496265] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-01T21:32:59.496351] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-01T21:32:59.497347] [DEBUG] [LOCAL ] SKYH: Trimmed 22407 records to 16585 (keeping 200 days of data) [2025-10-01T21:32:59.621796] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T21:32:59.653115] [DEBUG] [LOCAL ] SKYH: Primary data saved (16585 records). [2025-10-01T21:32:59.653314] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-01T21:32:59.653482] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SKYH took 29.2s. Estimated remaining: 1h 2m 22s. Rate: 7.1 symbols/min [2025-10-01T21:32:59.853184] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:32:59.894739] [DEBUG] [LOCAL ] SLGN: Loaded 40385 existing records from primary storage. [2025-10-01T21:32:59.895036] [INFO ] [MAIN ] SLGN: Loaded 40385 existing records. [2025-10-01T21:33:00.101459] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:33:00.101719] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-01T21:33:00.101777] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-01T21:33:00.102401] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-01T21:33:00.103827] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-01T21:33:00.103906] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-01T21:33:00.523468] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:00.902371] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-01T21:33:01.051234] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T21:33:01.389956] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T21:33:01.702380] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-01T21:33:02.349425] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T21:33:02.502402] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-01T21:33:03.302390] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-01T21:33:03.770171] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-01T21:33:03.968154] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-01T21:33:04.102402] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-01T21:33:04.405421] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T21:33:04.902384] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-01T21:33:05.702370] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-01T21:33:06.035216] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T21:33:06.502391] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-01T21:33:06.853622] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T21:33:07.130882] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T21:33:07.302403] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-01T21:33:08.102391] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-01T21:33:08.164023] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T21:33:08.880478] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T21:33:08.902346] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-01T21:33:09.378297] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T21:33:09.380002] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-01T21:33:09.380283] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-01T21:33:09.707537] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-01T21:33:09.821563] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-01T21:33:09.821697] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-01T21:33:09.822831] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-01T21:33:09.822910] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-01T21:33:09.824508] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-10-01T21:33:10.190279] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-01T21:33:10.190439] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-01T21:33:10.190608] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLB took 38.4s. Estimated remaining: 1h 2m 14s. Rate: 7.1 symbols/min [2025-10-01T21:33:10.386975] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:33:10.387244] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-01T21:33:10.387419] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-01T21:33:10.387557] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-01T21:33:10.387624] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-01T21:33:10.387908] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-01T21:33:10.387965] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-01T21:33:10.508248] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-01T21:33:10.551864] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T21:33:10.840120] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:11.302738] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-01T21:33:11.302638] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T21:33:12.067853] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T21:33:12.099496] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T21:33:12.107862] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-01T21:33:12.596688] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T21:33:12.902375] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-01T21:33:13.702381] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-01T21:33:14.212744] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T21:33:14.502332] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-01T21:33:15.302360] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-01T21:33:15.511716] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T21:33:15.512965] [INFO ] [REMOTE ] SLF: Full fetch complete (56317 records). [2025-10-01T21:33:15.513048] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-01T21:33:15.739243] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-01T21:33:16.002196] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-01T21:33:16.002295] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-01T21:33:16.003400] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-01T21:33:16.003472] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-01T21:33:16.004984] [DEBUG] [LOCAL ] SLF: Trimmed 56317 records to 38732 (keeping 200 days of data) [2025-10-01T21:33:16.102888] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-01T21:33:16.254930] [DEBUG] [LOCAL ] SLF: Primary data saved (38732 records). [2025-10-01T21:33:16.255068] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-01T21:33:16.255181] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLF took 39.3s. Estimated remaining: 1h 2m 5s. Rate: 7.1 symbols/min [2025-10-01T21:33:16.439906] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:33:16.443905] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-01T21:33:16.487802] [DEBUG] [LOCAL ] SLQT: Loaded 43498 existing records from primary storage. [2025-10-01T21:33:16.488193] [INFO ] [MAIN ] SLQT: Loaded 43498 existing records. [2025-10-01T21:33:16.692599] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:33:16.692960] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-01T21:33:16.693165] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-01T21:33:16.694262] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-01T21:33:16.694328] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-01T21:33:16.917255] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-01T21:33:16.944120] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T21:33:17.138102] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:17.309680] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-01T21:33:17.702465] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-01T21:33:18.502450] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-01T21:33:19.052058] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T21:33:19.302392] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-01T21:33:20.102368] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-01T21:33:20.171814] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T21:33:20.828854] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T21:33:20.902385] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-01T21:33:21.498097] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T21:33:21.702390] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-01T21:33:22.502355] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-01T21:33:22.594955] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T21:33:22.834497] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-01T21:33:23.266935] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T21:33:23.302352] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-01T21:33:24.102442] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-01T21:33:24.815266] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T21:33:24.902376] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-01T21:33:25.702439] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-01T21:33:25.759559] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T21:33:26.513452] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-01T21:33:26.519985] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T21:33:27.302393] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-01T21:33:27.360629] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T21:33:27.939478] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T21:33:28.102433] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-01T21:33:28.607708] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T21:33:28.902385] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-01T21:33:28.941005] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T21:33:29.702422] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-01T21:33:30.022936] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T21:33:30.024400] [INFO ] [REMOTE ] SLG: Full fetch complete (65120 records). [2025-10-01T21:33:30.024499] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-01T21:33:30.489000] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-01T21:33:30.489099] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-01T21:33:30.490163] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-01T21:33:30.490233] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-01T21:33:30.491716] [DEBUG] [LOCAL ] SLG: Trimmed 65120 records to 45322 (keeping 200 days of data) [2025-10-01T21:33:30.548511] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-01T21:33:30.788866] [DEBUG] [LOCAL ] SLG: Primary data saved (45322 records). [2025-10-01T21:33:30.789002] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-01T21:33:30.789084] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLG took 44.2s. Estimated remaining: 1h 1m 58s. Rate: 7.1 symbols/min [2025-10-01T21:33:30.901278] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-01T21:33:30.917503] [INFO ] [REMOTE ] SLGN: Full fetch complete (58472 records). [2025-10-01T21:33:30.933497] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-01T21:33:31.083001] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:33:31.307244] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-01T21:33:31.358419] [DEBUG] [LOCAL ] SLVM: Loaded 27905 existing records from primary storage. [2025-10-01T21:33:31.380421] [INFO ] [MAIN ] SLVM: Loaded 27905 existing records. [2025-10-01T21:33:31.582782] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-01T21:33:31.586933] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-01T21:33:31.587922] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-01T21:33:31.588038] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-01T21:33:31.646270] [DEBUG] [LOCAL ] SLGN: Trimmed 58472 records to 40426 (keeping 200 days of data) [2025-10-01T21:33:31.684026] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:33:31.684838] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-01T21:33:31.684925] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-01T21:33:31.738916] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-01T21:33:31.748286] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-01T21:33:31.781035] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T21:33:32.112299] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-01T21:33:32.232911] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:32.359465] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T21:33:32.407363] [DEBUG] [LOCAL ] SLGN: Primary data saved (40426 records). [2025-10-01T21:33:32.407501] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-01T21:33:32.407584] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLGN took 32.8s. Estimated remaining: 1h 1m 48s. Rate: 7.1 symbols/min [2025-10-01T21:33:32.592569] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:33:32.644553] [DEBUG] [LOCAL ] SM: Loaded 52321 existing records from primary storage. [2025-10-01T21:33:32.644931] [INFO ] [MAIN ] SM: Loaded 52321 existing records. [2025-10-01T21:33:32.725677] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T21:33:32.846452] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:33:32.846714] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-01T21:33:32.846778] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-01T21:33:32.847792] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-01T21:33:32.847852] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-01T21:33:32.907519] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-01T21:33:33.237103] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:33.702399] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-01T21:33:33.939547] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T21:33:34.502409] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-01T21:33:35.302377] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-01T21:33:35.600870] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T21:33:35.645982] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T21:33:36.102392] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-01T21:33:36.320229] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T21:33:36.902371] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-01T21:33:37.343923] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T21:33:37.702386] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-01T21:33:38.399736] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T21:33:38.502378] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-01T21:33:38.927403] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T21:33:39.302377] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-01T21:33:39.528442] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T21:33:40.102381] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-01T21:33:40.425245] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-01T21:33:40.912122] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-01T21:33:40.918198] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T21:33:41.702416] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-01T21:33:42.502422] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-01T21:33:42.569959] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T21:33:42.878557] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-01T21:33:43.302382] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-01T21:33:43.543796] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:33:43.563860] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-01T21:33:43.564610] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1051 records). [2025-10-01T21:33:43.564728] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-01T21:33:43.765904] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-01T21:33:43.766132] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:33:43.766206] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:33:43.766280] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-01T21:33:43.766359] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-01T21:33:43.766416] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-01T21:33:43.766475] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-01T21:33:43.766568] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLNZ took 33.6s. Estimated remaining: 1h 1m 40s. Rate: 7.1 symbols/min [2025-10-01T21:33:43.959682] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:33:43.959882] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-01T21:33:43.959935] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-01T21:33:43.960046] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-01T21:33:43.960089] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-01T21:33:43.960132] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-01T21:33:43.960164] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-01T21:33:44.115726] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-01T21:33:44.355616] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:44.902380] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-01T21:33:45.104514] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:33:45.104922] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-01T21:33:45.105021] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:33:45.105069] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-01T21:33:45.105107] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:33:45.105169] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-01T21:33:45.105235] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-01T21:33:45.105273] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-01T21:33:45.105313] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-01T21:33:45.105361] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SMA took 1.3s. Estimated remaining: 1h 1m 30s. Rate: 7.1 symbols/min [2025-10-01T21:33:45.290018] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:33:45.300562] [DEBUG] [LOCAL ] SMBK: Loaded 8147 existing records from primary storage. [2025-10-01T21:33:45.300827] [INFO ] [MAIN ] SMBK: Loaded 8147 existing records. [2025-10-01T21:33:45.498499] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:33:45.498801] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-01T21:33:45.498853] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-01T21:33:45.499311] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-01T21:33:45.499373] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-01T21:33:45.707551] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-01T21:33:45.906108] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:45.930126] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T21:33:46.502393] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-01T21:33:47.302363] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-01T21:33:47.418204] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T21:33:47.539108] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T21:33:47.540482] [INFO ] [REMOTE ] SLQT: Full fetch complete (63597 records). [2025-10-01T21:33:47.540579] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-01T21:33:47.963115] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-01T21:33:47.963216] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-01T21:33:47.964264] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-01T21:33:47.964331] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-01T21:33:47.965744] [DEBUG] [LOCAL ] SLQT: Trimmed 63597 records to 43514 (keeping 200 days of data) [2025-10-01T21:33:48.136091] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-01T21:33:48.230679] [DEBUG] [LOCAL ] SLQT: Primary data saved (43514 records). [2025-10-01T21:33:48.230826] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-01T21:33:48.230920] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SLQT took 32.0s. Estimated remaining: 1h 1m 20s. Rate: 7.1 symbols/min [2025-10-01T21:33:48.451268] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:33:48.469809] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T21:33:48.485832] [DEBUG] [LOCAL ] SMC: Loaded 11325 existing records from primary storage. [2025-10-01T21:33:48.486097] [INFO ] [MAIN ] SMC: Loaded 11325 existing records. [2025-10-01T21:33:48.678510] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:33:48.678729] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-01T21:33:48.678782] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-01T21:33:48.679243] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-01T21:33:48.679302] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-01T21:33:48.907485] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-01T21:33:49.080599] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:33:49.702354] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-01T21:33:49.985996] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T21:33:50.150686] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T21:33:50.164908] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-01T21:33:50.502385] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-01T21:33:51.302407] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-01T21:33:51.399325] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-01T21:33:52.095988] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T21:33:52.102333] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-01T21:33:52.764309] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T21:33:52.902414] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-01T21:33:53.702381] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-01T21:33:54.468202] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T21:33:54.502356] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-01T21:33:54.788534] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-01T21:33:55.302407] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-01T21:33:55.394684] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T21:33:56.102387] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-01T21:33:56.503828] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T21:33:56.572223] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-01T21:33:56.902409] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-01T21:33:57.702411] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-01T21:33:58.158750] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-01T21:33:58.502408] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-01T21:33:59.122080] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T21:33:59.302399] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-01T21:33:59.526881] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T21:34:00.102417] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-01T21:34:00.902368] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-01T21:34:00.988666] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T21:34:01.252842] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T21:34:01.702430] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-01T21:34:01.753132] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T21:34:02.502400] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-01T21:34:03.038318] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T21:34:03.302356] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-01T21:34:03.337148] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T21:34:04.102362] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-01T21:34:04.130174] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-01T21:34:04.131489] [INFO ] [REMOTE ] SLVM: Full fetch complete (39874 records). [2025-10-01T21:34:04.131581] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-01T21:34:04.556503] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-01T21:34:04.556608] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-01T21:34:04.557629] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-01T21:34:04.557731] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-01T21:34:04.558768] [DEBUG] [LOCAL ] SLVM: Trimmed 39874 records to 27991 (keeping 200 days of data) [2025-10-01T21:34:04.741591] [DEBUG] [LOCAL ] SLVM: Primary data saved (27991 records). [2025-10-01T21:34:04.741769] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-01T21:34:04.741863] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SLVM took 34.0s. Estimated remaining: 1h 1m 13s. Rate: 7.1 symbols/min [2025-10-01T21:34:04.907482] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-01T21:34:04.935410] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:34:04.986391] [DEBUG] [LOCAL ] SMFG: Loaded 48125 existing records from primary storage. [2025-10-01T21:34:04.986735] [INFO ] [MAIN ] SMFG: Loaded 48125 existing records. [2025-10-01T21:34:05.111415] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T21:34:05.199994] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:34:05.200239] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-01T21:34:05.200291] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-01T21:34:05.201665] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-01T21:34:05.201730] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-01T21:34:05.597502] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:34:05.702410] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-01T21:34:06.502400] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-01T21:34:06.638954] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T21:34:07.302393] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-01T21:34:07.394132] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T21:34:07.420773] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T21:34:08.102412] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-01T21:34:08.382152] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T21:34:08.387608] [INFO ] [REMOTE ] SM: Full fetch complete (75318 records). [2025-10-01T21:34:08.387781] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-01T21:34:08.918214] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-01T21:34:08.925531] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-01T21:34:08.925639] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-01T21:34:08.926867] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-01T21:34:08.927107] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-01T21:34:08.929120] [DEBUG] [LOCAL ] SM: Trimmed 75318 records to 52323 (keeping 200 days of data) [2025-10-01T21:34:09.294697] [DEBUG] [LOCAL ] SM: Primary data saved (52323 records). [2025-10-01T21:34:09.294859] [INFO ] [MAIN ] SM: Full history saved. [2025-10-01T21:34:09.294974] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SM took 36.9s. Estimated remaining: 1h 1m 4s. Rate: 7.1 symbols/min [2025-10-01T21:34:09.496243] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:34:09.544963] [DEBUG] [LOCAL ] SMG: Loaded 43737 existing records from primary storage. [2025-10-01T21:34:09.545517] [INFO ] [MAIN ] SMG: Loaded 43737 existing records. [2025-10-01T21:34:09.695175] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T21:34:09.703519] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-01T21:34:09.842593] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T21:34:09.877460] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:34:09.878342] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-01T21:34:09.878419] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-01T21:34:09.898154] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-01T21:34:09.898437] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-01T21:34:10.482987] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:34:10.502413] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-01T21:34:10.599144] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T21:34:11.302366] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-01T21:34:11.946130] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T21:34:12.102396] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-01T21:34:12.890837] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T21:34:12.908270] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-01T21:34:12.921011] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T21:34:13.702375] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-01T21:34:13.776206] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T21:34:14.502389] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-01T21:34:15.299557] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T21:34:15.302417] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-01T21:34:15.338209] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T21:34:15.919025] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T21:34:16.102435] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-01T21:34:16.902393] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-01T21:34:17.702381] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-01T21:34:17.963134] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T21:34:18.155466] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-01T21:34:18.156569] [INFO ] [REMOTE ] SMBK: Full fetch complete (11740 records). [2025-10-01T21:34:18.156688] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-01T21:34:18.505858] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-01T21:34:18.576914] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-01T21:34:18.577067] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-01T21:34:18.577418] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-01T21:34:18.577677] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-01T21:34:18.578439] [DEBUG] [LOCAL ] SMBK: Trimmed 11740 records to 8141 (keeping 200 days of data) [2025-10-01T21:34:18.646046] [DEBUG] [LOCAL ] SMBK: Primary data saved (8141 records). [2025-10-01T21:34:18.663160] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-01T21:34:18.663342] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMBK took 33.6s. Estimated remaining: 1h 0m 56s. Rate: 7.1 symbols/min [2025-10-01T21:34:18.730375] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T21:34:18.866436] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:34:18.882761] [DEBUG] [LOCAL ] SMHI: Loaded 13229 existing records from primary storage. [2025-10-01T21:34:18.883016] [INFO ] [MAIN ] SMHI: Loaded 13229 existing records. [2025-10-01T21:34:19.088902] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:34:19.089170] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-01T21:34:19.089221] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-01T21:34:19.089740] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-01T21:34:19.089804] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-01T21:34:19.311811] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-01T21:34:19.497260] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:34:20.102372] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-01T21:34:20.370129] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T21:34:20.543033] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T21:34:20.902404] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-01T21:34:21.441923] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T21:34:21.702387] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-01T21:34:21.723217] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T21:34:22.502401] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-01T21:34:22.756954] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T21:34:23.104550] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T21:34:23.302397] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-01T21:34:23.410059] [DEBUG] [REMOTE ] SMHI: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-01T21:34:23.410354] [WARN ] [REMOTE ] SMHI: No data returned for month 2025-02 [2025-10-01T21:34:23.410461] [FATAL] [REMOTE ] SMHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:34:23.410574] [FATAL] [MAIN ] SMHI: Failed to fetch primary data. [2025-10-01T21:34:23.410678] [WARN ] [MAIN ] SMHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:34:23.410755] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-01T21:34:23.410823] [DEBUG] [LOCAL ] SMHI: No primary data file found to delete. [2025-10-01T21:34:23.410861] [INFO ] [LOCAL ] SMHI: Starting deletion of derivative data. [2025-10-01T21:34:23.411244] [DEBUG] [LOCAL ] SMHI: Deleted derivative data file. [2025-10-01T21:34:23.411349] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMHI took 4.7s. Estimated remaining: 1h 0m 46s. Rate: 7.1 symbols/min [2025-10-01T21:34:23.597406] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:34:23.619236] [DEBUG] [LOCAL ] SMP: Loaded 19365 existing records from primary storage. [2025-10-01T21:34:23.619493] [INFO ] [MAIN ] SMP: Loaded 19365 existing records. [2025-10-01T21:34:23.812367] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:34:23.812578] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-01T21:34:23.812627] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-01T21:34:23.813241] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-01T21:34:23.813304] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-01T21:34:24.111578] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-01T21:34:24.209001] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:34:24.639311] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T21:34:24.640355] [INFO ] [REMOTE ] SMC: Full fetch complete (16655 records). [2025-10-01T21:34:24.640464] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-01T21:34:24.907548] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-01T21:34:25.065602] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-01T21:34:25.065714] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-01T21:34:25.066137] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-01T21:34:25.066181] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-01T21:34:25.066747] [DEBUG] [LOCAL ] SMC: Trimmed 16655 records to 11412 (keeping 200 days of data) [2025-10-01T21:34:25.137341] [DEBUG] [LOCAL ] SMC: Primary data saved (11412 records). [2025-10-01T21:34:25.137486] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-01T21:34:25.137572] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMC took 36.9s. Estimated remaining: 1h 0m 36s. Rate: 7.1 symbols/min [2025-10-01T21:34:25.327433] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:34:25.327620] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-10-01T21:34:25.327692] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-10-01T21:34:25.327854] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-01T21:34:25.327902] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-01T21:34:25.327949] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-01T21:34:25.327985] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-01T21:34:25.707538] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-01T21:34:25.714026] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:34:26.502352] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-01T21:34:26.563131] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T21:34:26.608759] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T21:34:27.302745] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-01T21:34:28.102362] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-01T21:34:28.365714] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T21:34:28.902697] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T21:34:28.902779] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-01T21:34:29.702388] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-01T21:34:29.737844] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T21:34:30.502354] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-01T21:34:30.726861] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-01T21:34:31.302398] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-01T21:34:31.428482] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T21:34:31.577963] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T21:34:32.102448] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-01T21:34:32.902383] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-01T21:34:32.944503] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T21:34:32.977988] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T21:34:33.702423] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-01T21:34:34.401960] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T21:34:34.502394] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-01T21:34:35.302412] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-01T21:34:36.102366] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-01T21:34:36.173780] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T21:34:36.214426] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-01T21:34:36.902381] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-01T21:34:36.986883] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:34:37.014029] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T21:34:37.702393] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-01T21:34:38.502386] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-01T21:34:38.847935] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T21:34:38.849527] [INFO ] [REMOTE ] SMFG: Full fetch complete (69010 records). [2025-10-01T21:34:38.849639] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-01T21:34:39.317471] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-01T21:34:39.313627] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-01T21:34:39.317690] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-01T21:34:39.320780] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-01T21:34:39.321122] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-01T21:34:39.322781] [DEBUG] [LOCAL ] SMFG: Trimmed 69010 records to 48138 (keeping 200 days of data) [2025-10-01T21:34:39.586889] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-01T21:34:39.681885] [DEBUG] [LOCAL ] SMFG: Primary data saved (48138 records). [2025-10-01T21:34:39.682069] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-01T21:34:39.682166] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMFG took 34.9s. Estimated remaining: 1h 0m 29s. Rate: 7.1 symbols/min [2025-10-01T21:34:39.875554] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:34:39.921741] [DEBUG] [LOCAL ] SMRT: Loaded 43860 existing records from primary storage. [2025-10-01T21:34:39.922059] [INFO ] [MAIN ] SMRT: Loaded 43860 existing records. [2025-10-01T21:34:40.118210] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-01T21:34:40.121344] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:34:40.122063] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-01T21:34:40.122964] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-01T21:34:40.132474] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-01T21:34:40.132688] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-01T21:34:40.213971] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T21:34:40.559199] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T21:34:40.604555] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:34:40.902568] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-01T21:34:41.702396] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-01T21:34:41.984569] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T21:34:42.502382] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-01T21:34:42.808634] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-01T21:34:43.245800] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T21:34:43.302343] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-01T21:34:43.460191] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T21:34:44.102397] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-01T21:34:44.819550] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T21:34:44.902380] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-01T21:34:44.936373] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T21:34:45.702385] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-01T21:34:46.502394] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-01T21:34:47.125851] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-01T21:34:47.127308] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T21:34:47.302438] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-01T21:34:47.424659] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-01T21:34:47.426142] [INFO ] [REMOTE ] SMG: Full fetch complete (62762 records). [2025-10-01T21:34:47.426297] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-01T21:34:47.869109] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-01T21:34:47.869200] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-01T21:34:47.870163] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-01T21:34:47.870230] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-01T21:34:47.873119] [DEBUG] [LOCAL ] SMG: Trimmed 62762 records to 43718 (keeping 200 days of data) [2025-10-01T21:34:48.102691] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-01T21:34:48.153316] [DEBUG] [LOCAL ] SMG: Primary data saved (43718 records). [2025-10-01T21:34:48.153445] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-01T21:34:48.153548] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMG took 38.9s. Estimated remaining: 1h 0m 21s. Rate: 7.1 symbols/min [2025-10-01T21:34:48.340853] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:34:48.374302] [DEBUG] [LOCAL ] SMWB: Loaded 32504 existing records from primary storage. [2025-10-01T21:34:48.374623] [INFO ] [MAIN ] SMWB: Loaded 32504 existing records. [2025-10-01T21:34:48.577714] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:34:48.578141] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-01T21:34:48.578286] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-01T21:34:48.579201] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-01T21:34:48.579275] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-01T21:34:48.917817] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-01T21:34:48.981165] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T21:34:49.071192] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:34:49.702349] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-01T21:34:50.050950] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T21:34:50.502380] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-01T21:34:50.706068] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-01T21:34:51.039901] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T21:34:51.302382] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-01T21:34:52.067225] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T21:34:52.102394] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-01T21:34:52.373922] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-01T21:34:52.902382] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-01T21:34:53.702381] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-01T21:34:54.322114] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T21:34:54.502445] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-01T21:34:54.780167] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-01T21:34:55.245401] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T21:34:55.246219] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T21:34:55.302375] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-01T21:34:56.102391] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-01T21:34:56.902392] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-01T21:34:57.024279] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T21:34:57.702397] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-01T21:34:58.311751] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T21:34:58.502380] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-01T21:34:58.998991] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-01T21:34:59.302358] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-01T21:34:59.400398] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T21:34:59.831725] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T21:35:00.102385] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-01T21:35:00.902395] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-01T21:35:01.523735] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-01T21:35:01.525024] [INFO ] [REMOTE ] SMP: Full fetch complete (26201 records). [2025-10-01T21:35:01.525146] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-01T21:35:01.709108] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-01T21:35:01.838471] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T21:35:02.182507] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-01T21:35:02.320534] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-01T21:35:02.320678] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-01T21:35:02.321551] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-01T21:35:02.321624] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-01T21:35:02.322787] [DEBUG] [LOCAL ] SMP: Trimmed 26201 records to 19309 (keeping 200 days of data) [2025-10-01T21:35:02.502903] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-01T21:35:02.508702] [DEBUG] [LOCAL ] SMP: Primary data saved (19309 records). [2025-10-01T21:35:02.510109] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-01T21:35:02.510270] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMP took 39.1s. Estimated remaining: 1h 0m 14s. Rate: 7.1 symbols/min [2025-10-01T21:35:02.840519] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:02.898729] [DEBUG] [LOCAL ] SN: Loaded 49762 existing records from primary storage. [2025-10-01T21:35:02.899071] [INFO ] [MAIN ] SN: Loaded 49762 existing records. [2025-10-01T21:35:03.111906] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:35:03.112252] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-01T21:35:03.112418] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-01T21:35:03.113996] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-01T21:35:03.114068] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-01T21:35:03.320691] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-01T21:35:03.474241] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T21:35:03.575597] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:03.762488] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T21:35:04.102383] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-01T21:35:04.902389] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-01T21:35:05.590209] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T21:35:05.702379] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-01T21:35:06.149282] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-01T21:35:06.230127] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T21:35:06.502399] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-01T21:35:07.302386] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-01T21:35:07.403290] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:35:07.512011] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T21:35:07.515547] [INFO ] [REMOTE ] SMRT: Full fetch complete (62090 records). [2025-10-01T21:35:07.515752] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-01T21:35:07.967593] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-01T21:35:07.967719] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-01T21:35:07.968827] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-01T21:35:07.968903] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-01T21:35:07.970327] [DEBUG] [LOCAL ] SMRT: Trimmed 62090 records to 43885 (keeping 200 days of data) [2025-10-01T21:35:08.102694] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-01T21:35:08.255120] [DEBUG] [LOCAL ] SMRT: Primary data saved (43885 records). [2025-10-01T21:35:08.255265] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-01T21:35:08.255366] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMRT took 28.6s. Estimated remaining: 1h 0m 5s. Rate: 7.1 symbols/min [2025-10-01T21:35:08.449423] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:08.449590] [DEBUG] [LOCAL ] SNA: No existing data file found in primary storage. [2025-10-01T21:35:08.449628] [WARN ] [MAIN ] SNA: No existing data found, performing full refresh instead. [2025-10-01T21:35:08.449786] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-01T21:35:08.449865] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-01T21:35:08.449930] [DEBUG] [LOCAL ] SNA: No primary data file found to delete. [2025-10-01T21:35:08.449965] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-01T21:35:08.836454] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T21:35:08.907451] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-01T21:35:08.914857] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:09.702404] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-01T21:35:09.778689] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T21:35:10.316953] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T21:35:10.502428] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-01T21:35:11.302406] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-01T21:35:11.767436] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T21:35:11.811150] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-01T21:35:11.814487] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-01T21:35:11.814714] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-01T21:35:12.102799] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-01T21:35:12.305946] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-01T21:35:12.306062] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-01T21:35:12.307536] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-01T21:35:12.307686] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-01T21:35:12.329227] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T21:35:12.330742] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53797 (keeping 200 days of data) [2025-10-01T21:35:12.702020] [DEBUG] [LOCAL ] SMR: Primary data saved (53797 records). [2025-10-01T21:35:12.702170] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-01T21:35:12.702264] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMR took 47.6s. Estimated remaining: 59m 55s. Rate: 7.1 symbols/min [2025-10-01T21:35:12.893903] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:12.902411] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-01T21:35:12.951672] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-01T21:35:12.952030] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-01T21:35:13.159107] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:35:13.159345] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-01T21:35:13.159396] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-01T21:35:13.160539] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-01T21:35:13.160605] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-01T21:35:13.565307] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:13.645046] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T21:35:13.702433] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-01T21:35:13.753945] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T21:35:13.755193] [INFO ] [REMOTE ] SMWB: Full fetch complete (49782 records). [2025-10-01T21:35:13.755303] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-01T21:35:14.201230] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-01T21:35:14.201348] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-01T21:35:14.202589] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-01T21:35:14.202708] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-01T21:35:14.204288] [DEBUG] [LOCAL ] SMWB: Trimmed 49782 records to 32455 (keeping 200 days of data) [2025-10-01T21:35:14.409049] [DEBUG] [LOCAL ] SMWB: Primary data saved (32455 records). [2025-10-01T21:35:14.409239] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-01T21:35:14.409357] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SMWB took 26.3s. Estimated remaining: 59m 45s. Rate: 7.1 symbols/min [2025-10-01T21:35:14.507570] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-01T21:35:14.615707] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:14.623083] [DEBUG] [LOCAL ] SNDA: Loaded 4543 existing records from primary storage. [2025-10-01T21:35:14.623293] [INFO ] [MAIN ] SNDA: Loaded 4543 existing records. [2025-10-01T21:35:14.839083] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:35:14.839318] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-01T21:35:14.839367] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-01T21:35:14.839708] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-01T21:35:14.839770] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-01T21:35:15.250016] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:15.302450] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-01T21:35:15.628359] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T21:35:16.045996] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-01T21:35:16.102356] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-01T21:35:16.140883] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T21:35:16.902389] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-01T21:35:17.702401] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-01T21:35:18.484159] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T21:35:18.510520] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-01T21:35:18.535785] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-01T21:35:18.675833] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T21:35:19.302410] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-01T21:35:20.102369] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-01T21:35:20.211346] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T21:35:20.902435] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-01T21:35:20.920460] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T21:35:21.547084] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-01T21:35:21.702424] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-01T21:35:22.314924] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T21:35:22.476385] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T21:35:22.502427] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-01T21:35:23.302413] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-01T21:35:24.102443] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-01T21:35:24.397289] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T21:35:24.742398] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T21:35:24.757462] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T21:35:24.902456] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-01T21:35:25.588704] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T21:35:25.702396] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-01T21:35:26.502379] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-01T21:35:26.961123] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T21:35:27.302385] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-01T21:35:28.102408] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-01T21:35:28.626030] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-01T21:35:28.902413] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-01T21:35:29.702411] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-01T21:35:30.072691] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-01T21:35:30.189760] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-01T21:35:30.502421] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-01T21:35:31.036477] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T21:35:31.302429] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-01T21:35:31.803833] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-01T21:35:32.102433] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-01T21:35:32.641107] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (5.34 seconds). [2025-10-01T21:35:32.712247] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T21:35:32.742143] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-01T21:35:32.902363] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-01T21:35:33.702395] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-01T21:35:34.502361] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-01T21:35:34.629271] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T21:35:34.953599] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T21:35:35.112185] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T21:35:35.302420] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-01T21:35:36.102405] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-01T21:35:36.798137] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T21:35:36.902392] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-01T21:35:37.554805] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T21:35:37.702393] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-01T21:35:38.258208] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-01T21:35:38.502446] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-01T21:35:39.302365] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-01T21:35:39.401118] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T21:35:39.676143] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T21:35:40.102383] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-01T21:35:40.469612] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-01T21:35:40.470353] [INFO ] [REMOTE ] SNDA: Full fetch complete (8109 records). [2025-10-01T21:35:40.470425] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-01T21:35:40.884111] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-01T21:35:40.884240] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-01T21:35:40.884523] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-01T21:35:40.884586] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-01T21:35:40.885039] [DEBUG] [LOCAL ] SNDA: Trimmed 8109 records to 4515 (keeping 200 days of data) [2025-10-01T21:35:40.904616] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-01T21:35:40.914897] [DEBUG] [LOCAL ] SNDA: Primary data saved (4515 records). [2025-10-01T21:35:40.915068] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-01T21:35:40.915195] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNDA took 26.5s. Estimated remaining: 59m 41s. Rate: 7.1 symbols/min [2025-10-01T21:35:41.120924] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:41.164731] [DEBUG] [LOCAL ] SNDR: Loaded 40697 existing records from primary storage. [2025-10-01T21:35:41.165100] [INFO ] [MAIN ] SNDR: Loaded 40697 existing records. [2025-10-01T21:35:41.375253] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:35:41.375465] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-01T21:35:41.375514] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-01T21:35:41.376388] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-01T21:35:41.376451] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-01T21:35:41.618821] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T21:35:41.704823] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-01T21:35:41.715471] [INFO ] [REMOTE ] SNA: Full fetch complete (38952 records). [2025-10-01T21:35:41.721436] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-01T21:35:41.915429] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:42.207983] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-01T21:35:42.313781] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-01T21:35:42.313886] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-01T21:35:42.314799] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-01T21:35:42.314881] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-01T21:35:42.316009] [DEBUG] [LOCAL ] SNA: Trimmed 38952 records to 25934 (keeping 200 days of data) [2025-10-01T21:35:42.488531] [DEBUG] [LOCAL ] SNA: Primary data saved (25934 records). [2025-10-01T21:35:42.488701] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-01T21:35:42.488799] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNA took 34.2s. Estimated remaining: 59m 31s. Rate: 7.1 symbols/min [2025-10-01T21:35:42.513012] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-01T21:35:42.681124] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:42.725373] [DEBUG] [LOCAL ] SNN: Loaded 44274 existing records from primary storage. [2025-10-01T21:35:42.725749] [INFO ] [MAIN ] SNN: Loaded 44274 existing records. [2025-10-01T21:35:42.923131] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:35:42.923398] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-01T21:35:42.923447] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-01T21:35:42.925457] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-01T21:35:42.925519] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-01T21:35:43.303923] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-01T21:35:43.367714] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:43.505951] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-01T21:35:44.102403] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-01T21:35:44.851376] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-01T21:35:44.888692] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:35:44.902351] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-01T21:35:45.287866] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T21:35:45.702423] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-01T21:35:46.502386] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-01T21:35:47.287886] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T21:35:47.308618] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-01T21:35:47.331438] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-01T21:35:47.537024] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T21:35:47.538570] [INFO ] [REMOTE ] SN: Full fetch complete (70980 records). [2025-10-01T21:35:47.538708] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-01T21:35:47.977492] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-01T21:35:47.977574] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-01T21:35:47.978615] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-01T21:35:47.978703] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-01T21:35:47.980180] [DEBUG] [LOCAL ] SN: Trimmed 70980 records to 49773 (keeping 200 days of data) [2025-10-01T21:35:48.102751] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-01T21:35:48.304860] [DEBUG] [LOCAL ] SN: Primary data saved (49773 records). [2025-10-01T21:35:48.305017] [INFO ] [MAIN ] SN: Full history saved. [2025-10-01T21:35:48.305142] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SN took 45.8s. Estimated remaining: 59m 22s. Rate: 7.1 symbols/min [2025-10-01T21:35:48.509170] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:48.509638] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-10-01T21:35:48.509716] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-10-01T21:35:48.509871] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-01T21:35:48.509929] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-01T21:35:48.509977] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-01T21:35:48.510010] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-01T21:35:48.913998] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-01T21:35:48.920455] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:48.948213] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T21:35:49.702376] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-01T21:35:50.021020] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T21:35:50.502403] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-01T21:35:50.897741] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-01T21:35:50.899376] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-01T21:35:50.899493] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-01T21:35:51.302490] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-01T21:35:51.351463] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-01T21:35:51.351575] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-01T21:35:51.352828] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-01T21:35:51.352900] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-01T21:35:51.354574] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 53796 (keeping 200 days of data) [2025-10-01T21:35:51.697280] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-01T21:35:51.697439] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-01T21:35:51.697565] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNAP took 39.0s. Estimated remaining: 59m 12s. Rate: 7.1 symbols/min [2025-10-01T21:35:51.908542] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:35:51.942838] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-01T21:35:51.993549] [DEBUG] [LOCAL ] SNV: Loaded 48852 existing records from primary storage. [2025-10-01T21:35:51.993892] [INFO ] [MAIN ] SNV: Loaded 48852 existing records. [2025-10-01T21:35:52.109460] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-01T21:35:52.227778] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:35:52.228384] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-01T21:35:52.228976] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-01T21:35:52.230322] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T21:35:52.239637] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-01T21:35:52.240034] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-01T21:35:52.644154] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:35:52.796049] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T21:35:52.902376] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-01T21:35:53.702403] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-01T21:35:54.390968] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T21:35:54.514376] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-01T21:35:54.539743] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-01T21:35:55.302389] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-01T21:35:55.376357] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:35:56.036004] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-01T21:35:56.102357] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-01T21:35:56.902381] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-01T21:35:57.366844] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-01T21:35:57.633877] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T21:35:57.702371] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-01T21:35:58.502364] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-01T21:35:58.545755] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T21:35:59.162720] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T21:35:59.302388] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-01T21:36:00.102425] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-01T21:36:00.504624] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-01T21:36:00.902401] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-01T21:36:01.061213] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T21:36:01.702390] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-01T21:36:01.846943] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T21:36:02.502373] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-01T21:36:02.927202] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-01T21:36:03.302354] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-01T21:36:03.481829] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T21:36:04.107486] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-01T21:36:04.122885] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T21:36:04.902380] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-01T21:36:05.702389] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-01T21:36:05.753803] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-01T21:36:05.948402] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T21:36:05.986915] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T21:36:06.502384] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-01T21:36:06.898902] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T21:36:07.302404] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-01T21:36:08.102435] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-01T21:36:08.845497] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-01T21:36:08.902393] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-01T21:36:08.972265] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T21:36:09.208543] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T21:36:09.702392] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-01T21:36:10.503987] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-01T21:36:11.312227] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-01T21:36:11.319120] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-01T21:36:11.363033] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T21:36:12.102367] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-01T21:36:12.187468] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:36:12.861348] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T21:36:12.902350] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-01T21:36:13.702406] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-01T21:36:13.743365] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T21:36:13.767085] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T21:36:13.768700] [INFO ] [REMOTE ] SNDR: Full fetch complete (59193 records). [2025-10-01T21:36:13.768812] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-01T21:36:14.235272] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-01T21:36:14.235367] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-01T21:36:14.236697] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-01T21:36:14.236786] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-01T21:36:14.238302] [DEBUG] [LOCAL ] SNDR: Trimmed 59193 records to 40712 (keeping 200 days of data) [2025-10-01T21:36:14.503946] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-01T21:36:14.512719] [DEBUG] [LOCAL ] SNDR: Primary data saved (40712 records). [2025-10-01T21:36:14.512862] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-01T21:36:14.512974] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNDR took 33.6s. Estimated remaining: 59m 7s. Rate: 7.1 symbols/min [2025-10-01T21:36:14.704379] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:14.745124] [DEBUG] [LOCAL ] SNX: Loaded 39987 existing records from primary storage. [2025-10-01T21:36:14.745435] [INFO ] [MAIN ] SNX: Loaded 39987 existing records. [2025-10-01T21:36:14.946830] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:36:14.947089] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-01T21:36:14.947140] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-01T21:36:14.948164] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-01T21:36:14.948246] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-01T21:36:15.308508] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-01T21:36:15.357456] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:36:15.533147] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T21:36:16.102435] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-01T21:36:16.195845] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T21:36:16.902391] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-01T21:36:17.526292] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-01T21:36:17.602713] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T21:36:17.702427] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-01T21:36:18.113366] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T21:36:18.115088] [INFO ] [REMOTE ] SNN: Full fetch complete (63106 records). [2025-10-01T21:36:18.115224] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-01T21:36:18.508925] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-01T21:36:18.553581] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-01T21:36:18.553726] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-01T21:36:18.554888] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-01T21:36:18.554989] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-01T21:36:18.556535] [DEBUG] [LOCAL ] SNN: Trimmed 63106 records to 44238 (keeping 200 days of data) [2025-10-01T21:36:18.857483] [DEBUG] [LOCAL ] SNN: Primary data saved (44238 records). [2025-10-01T21:36:18.857639] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-01T21:36:18.857777] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNN took 36.4s. Estimated remaining: 58m 57s. Rate: 7.1 symbols/min [2025-10-01T21:36:19.050187] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:19.050419] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-10-01T21:36:19.050475] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-10-01T21:36:19.050615] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-01T21:36:19.050734] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-01T21:36:19.050799] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-10-01T21:36:19.050835] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-01T21:36:19.303554] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-01T21:36:19.401483] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:36:19.513215] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:36:20.102437] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-01T21:36:20.902377] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-01T21:36:21.021568] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-01T21:36:21.065016] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T21:36:21.702351] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-01T21:36:21.800206] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T21:36:22.502422] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-01T21:36:22.733129] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-01T21:36:23.302439] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-01T21:36:23.575442] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T21:36:23.716890] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-01T21:36:23.718768] [INFO ] [REMOTE ] SNOW: Full fetch complete (77650 records). [2025-10-01T21:36:23.719028] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-01T21:36:24.107519] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-01T21:36:24.174956] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-01T21:36:24.175127] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-01T21:36:24.176325] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-01T21:36:24.176417] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-01T21:36:24.178227] [DEBUG] [LOCAL ] SNOW: Trimmed 77650 records to 53591 (keeping 200 days of data) [2025-10-01T21:36:24.510506] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T21:36:24.518169] [INFO ] [REMOTE ] SNV: Full fetch complete (71145 records). [2025-10-01T21:36:24.518324] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-01T21:36:24.892995] [DEBUG] [LOCAL ] SNOW: Primary data saved (53591 records). [2025-10-01T21:36:24.893252] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-01T21:36:24.893702] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 36.6s. Estimated remaining: 58m 48s. Rate: 7.1 symbols/min [2025-10-01T21:36:24.904583] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-01T21:36:25.138162] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-01T21:36:25.142112] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-01T21:36:25.149098] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-01T21:36:25.159552] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-01T21:36:25.228192] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:25.228809] [DEBUG] [LOCAL ] SNV: Trimmed 71145 records to 48860 (keeping 200 days of data) [2025-10-01T21:36:25.371072] [DEBUG] [LOCAL ] SOBO: Loaded 39442 existing records from primary storage. [2025-10-01T21:36:25.371942] [INFO ] [MAIN ] SOBO: Loaded 39442 existing records. [2025-10-01T21:36:25.596785] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:36:25.597583] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-01T21:36:25.597704] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-01T21:36:25.599367] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-01T21:36:25.599754] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-01T21:36:26.149926] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:36:26.150567] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-01T21:36:26.201239] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-01T21:36:26.301224] [DEBUG] [LOCAL ] SNV: Primary data saved (48860 records). [2025-10-01T21:36:26.301392] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-01T21:36:26.301482] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNV took 34.6s. Estimated remaining: 58m 38s. Rate: 7.1 symbols/min [2025-10-01T21:36:26.492353] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:26.502360] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-01T21:36:26.548992] [DEBUG] [LOCAL ] SOC: Loaded 50398 existing records from primary storage. [2025-10-01T21:36:26.549340] [INFO ] [MAIN ] SOC: Loaded 50398 existing records. [2025-10-01T21:36:26.748531] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:36:26.748930] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-01T21:36:26.749096] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-01T21:36:26.750372] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-01T21:36:26.750440] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-01T21:36:26.881358] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-01T21:36:27.204288] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:36:27.302373] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-01T21:36:27.714156] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T21:36:27.883011] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T21:36:28.102415] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-01T21:36:28.902396] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-01T21:36:29.153876] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T21:36:29.362517] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-01T21:36:29.702391] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-01T21:36:30.304896] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T21:36:30.502410] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-01T21:36:30.999383] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T21:36:31.302392] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-01T21:36:32.102390] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-01T21:36:32.184112] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T21:36:32.815465] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T21:36:32.902391] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-01T21:36:33.718806] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-01T21:36:33.728681] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T21:36:34.471258] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T21:36:34.502351] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-01T21:36:35.069146] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T21:36:35.302383] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-01T21:36:36.102387] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-01T21:36:36.475762] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T21:36:36.902361] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-01T21:36:36.983849] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T21:36:37.707487] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-01T21:36:37.719236] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:36:38.502425] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-01T21:36:38.697822] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-01T21:36:39.302391] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-01T21:36:39.485794] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T21:36:39.987804] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T21:36:40.102380] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-01T21:36:40.902358] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-01T21:36:41.178758] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-01T21:36:41.352305] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-01T21:36:41.702389] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-01T21:36:42.502396] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-01T21:36:42.622619] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T21:36:43.211210] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T21:36:43.302382] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-01T21:36:44.006875] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T21:36:44.102383] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-01T21:36:44.519110] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T21:36:44.902401] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-01T21:36:45.555310] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:36:45.702408] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-01T21:36:46.345998] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T21:36:46.502377] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-01T21:36:47.121635] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T21:36:47.302386] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-01T21:36:47.940441] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T21:36:48.102417] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-01T21:36:48.902407] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-01T21:36:49.102627] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T21:36:49.562581] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-01T21:36:49.702400] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-01T21:36:50.433037] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T21:36:50.502400] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-01T21:36:50.713435] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T21:36:50.715015] [INFO ] [REMOTE ] SOBO: Full fetch complete (58453 records). [2025-10-01T21:36:50.715143] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-01T21:36:51.146726] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-01T21:36:51.146830] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-01T21:36:51.147861] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-01T21:36:51.147930] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-01T21:36:51.149503] [DEBUG] [LOCAL ] SOBO: Trimmed 58453 records to 39455 (keeping 200 days of data) [2025-10-01T21:36:51.335594] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-01T21:36:51.411705] [DEBUG] [LOCAL ] SOBO: Primary data saved (39455 records). [2025-10-01T21:36:51.411848] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-01T21:36:51.412051] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SOBO took 26.5s. Estimated remaining: 58m 33s. Rate: 7.1 symbols/min [2025-10-01T21:36:51.970385] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T21:36:52.102374] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-01T21:36:52.897165] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T21:36:52.908861] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-01T21:36:53.702386] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-01T21:36:54.047000] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T21:36:54.126174] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T21:36:54.127904] [INFO ] [REMOTE ] SNX: Full fetch complete (57182 records). [2025-10-01T21:36:54.128082] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-01T21:36:54.508836] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-01T21:36:54.569223] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-01T21:36:54.569394] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-01T21:36:54.570384] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-01T21:36:54.570464] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-01T21:36:54.582772] [DEBUG] [LOCAL ] SNX: Trimmed 57182 records to 40047 (keeping 200 days of data) [2025-10-01T21:36:54.604320] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-01T21:36:54.881347] [DEBUG] [LOCAL ] SNX: Primary data saved (40047 records). [2025-10-01T21:36:54.881483] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-01T21:36:54.881573] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SNX took 40.4s. Estimated remaining: 58m 24s. Rate: 7.1 symbols/min [2025-10-01T21:36:55.302370] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-01T21:36:55.592193] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T21:36:55.593781] [INFO ] [REMOTE ] SO: Full fetch complete (77592 records). [2025-10-01T21:36:55.593929] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-01T21:36:56.020080] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-01T21:36:56.020267] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-01T21:36:56.021567] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-01T21:36:56.021673] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-01T21:36:56.023587] [DEBUG] [LOCAL ] SO: Trimmed 77592 records to 53606 (keeping 200 days of data) [2025-10-01T21:36:56.109197] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-01T21:36:56.137542] [INFO ] [REMOTE ] SOC: Full fetch complete (71597 records). [2025-10-01T21:36:56.142337] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-01T21:36:56.644556] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-01T21:36:56.645245] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-01T21:36:56.646899] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-01T21:36:56.650049] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-01T21:36:56.744801] [DEBUG] [LOCAL ] SOC: Trimmed 71597 records to 50432 (keeping 200 days of data) [2025-10-01T21:36:56.988731] [DEBUG] [LOCAL ] SO: Primary data saved (53606 records). [2025-10-01T21:36:56.991047] [INFO ] [MAIN ] SO: Full history saved. [2025-10-01T21:36:56.991176] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SO took 38.1s. Estimated remaining: 58m 14s. Rate: 7.1 symbols/min [2025-10-01T21:36:57.182181] [DEBUG] [LOCAL ] SOC: Primary data saved (50432 records). [2025-10-01T21:36:57.182363] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-01T21:36:57.182488] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 30.9s. Estimated remaining: 58m 4s. Rate: 7.1 symbols/min [2025-10-01T21:36:57.779246] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:57.930446] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:57.975581] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-01T21:36:57.994729] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-01T21:36:58.010878] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-01T21:36:57.963120] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:58.017018] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-01T21:36:58.016600] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:36:58.017985] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-01T21:36:58.018672] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-01T21:36:58.137571] [DEBUG] [LOCAL ] SOJC: Loaded 5058 existing records from primary storage. [2025-10-01T21:36:58.147230] [DEBUG] [LOCAL ] SOJE: Loaded 9353 existing records from primary storage. [2025-10-01T21:36:58.153067] [INFO ] [MAIN ] SOJC: Loaded 5058 existing records. [2025-10-01T21:36:58.153718] [INFO ] [MAIN ] SOJE: Loaded 9353 existing records. [2025-10-01T21:36:58.180368] [DEBUG] [LOCAL ] SOJD: Loaded 13075 existing records from primary storage. [2025-10-01T21:36:58.312868] [INFO ] [MAIN ] SOJD: Loaded 13075 existing records. [2025-10-01T21:36:58.939930] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:36:58.962672] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:36:59.011675] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-01T21:36:59.016931] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-01T21:36:59.036723] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-01T21:36:59.049748] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-01T21:36:59.090956] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-01T21:36:59.080608] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-01T21:36:59.091096] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-01T21:36:59.095827] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:36:59.141411] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-01T21:36:59.160759] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:36:59.182978] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-01T21:36:59.141334] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-01T21:36:59.204625] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-01T21:36:59.230433] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-01T21:36:59.230618] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-01T21:36:59.536850] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:36:59.595373] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-01T21:36:59.659516] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:36:59.664802] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-01T21:36:59.749252] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:36:59.957879] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-01T21:37:00.069508] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-01T21:37:00.185974] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-01T21:37:00.248169] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:00.264404] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-01T21:37:00.295589] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 3.1s. Estimated remaining: 57m 54s. Rate: 7.1 symbols/min [2025-10-01T21:37:00.296088] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-01T21:37:00.435469] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:00.455385] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-01T21:37:00.503551] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:00.515477] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-01T21:37:00.642787] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:37:00.659554] [DEBUG] [LOCAL ] SOL: Loaded 13394 existing records from primary storage. [2025-10-01T21:37:00.659863] [INFO ] [MAIN ] SOL: Loaded 13394 existing records. [2025-10-01T21:37:00.870974] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:37:00.871245] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-01T21:37:00.871307] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-01T21:37:00.871774] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-01T21:37:00.871837] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-01T21:37:01.254067] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:01.254379] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-01T21:37:01.355968] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T21:37:01.358991] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-01T21:37:01.658314] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T21:37:01.664841] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-01T21:37:01.772528] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T21:37:01.777671] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-01T21:37:01.849726] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T21:37:02.329255] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T21:37:02.502415] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-01T21:37:02.581217] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-01T21:37:02.660320] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T21:37:03.251367] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T21:37:03.302394] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-01T21:37:03.894912] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T21:37:04.102375] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-01T21:37:04.902349] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-01T21:37:05.219268] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T21:37:05.610483] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T21:37:05.702392] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-01T21:37:06.428062] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T21:37:06.502441] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-01T21:37:07.302392] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-01T21:37:07.447541] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T21:37:07.833447] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T21:37:08.102429] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-01T21:37:08.902449] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-01T21:37:09.248734] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T21:37:09.702398] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-01T21:37:09.736091] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T21:37:10.307431] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T21:37:10.502418] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-01T21:37:11.302401] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-01T21:37:11.491963] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T21:37:12.102429] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-01T21:37:12.115344] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T21:37:12.902395] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-01T21:37:13.145265] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T21:37:13.500221] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T21:37:13.702421] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-01T21:37:14.502409] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-01T21:37:14.735582] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T21:37:15.302384] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-01T21:37:15.417720] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T21:37:16.102404] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-01T21:37:16.153115] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-01T21:37:16.472205] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-01T21:37:16.902442] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-01T21:37:17.702368] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-01T21:37:17.753861] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-01T21:37:18.382116] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T21:37:18.502405] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-01T21:37:18.934119] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-01T21:37:19.302413] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-01T21:37:19.956328] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T21:37:20.102483] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-01T21:37:20.902444] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-01T21:37:20.929384] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T21:37:21.684485] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T21:37:21.702356] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-01T21:37:22.500165] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T21:37:22.503107] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-01T21:37:23.302375] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-01T21:37:23.518791] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T21:37:23.689629] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-01T21:37:24.102421] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-01T21:37:24.902398] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-01T21:37:25.148499] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T21:37:25.648537] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T21:37:25.702344] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-01T21:37:26.502493] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-01T21:37:26.518813] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T21:37:27.072588] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-01T21:37:27.073730] [INFO ] [REMOTE ] SOJD: Full fetch complete (20011 records). [2025-10-01T21:37:27.073807] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-01T21:37:27.307513] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-01T21:37:27.491801] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-01T21:37:27.491895] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-01T21:37:27.492407] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-01T21:37:27.492449] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-01T21:37:27.493066] [DEBUG] [LOCAL ] SOJD: Trimmed 20011 records to 13097 (keeping 200 days of data) [2025-10-01T21:37:27.583138] [DEBUG] [LOCAL ] SOJD: Primary data saved (13097 records). [2025-10-01T21:37:27.583297] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-01T21:37:27.583422] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJD took 30.4s. Estimated remaining: 57m 50s. Rate: 7.1 symbols/min [2025-10-01T21:37:27.769603] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:37:27.769866] [DEBUG] [LOCAL ] SOLV: No existing data file found in primary storage. [2025-10-01T21:37:27.769917] [WARN ] [MAIN ] SOLV: No existing data found, performing full refresh instead. [2025-10-01T21:37:27.770032] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-01T21:37:27.770073] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-01T21:37:27.770114] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-10-01T21:37:27.770146] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-01T21:37:28.104464] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-01T21:37:28.148129] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T21:37:28.173627] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:28.802045] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T21:37:28.902424] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-01T21:37:29.702491] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-01T21:37:30.157501] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-01T21:37:30.159255] [INFO ] [REMOTE ] SOJE: Full fetch complete (14402 records). [2025-10-01T21:37:30.159551] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-01T21:37:30.502965] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-01T21:37:30.599986] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:37:30.598182] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-01T21:37:30.608485] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-01T21:37:30.609607] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-01T21:37:30.609699] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-01T21:37:30.610256] [DEBUG] [LOCAL ] SOJE: Trimmed 14402 records to 9364 (keeping 200 days of data) [2025-10-01T21:37:30.670254] [DEBUG] [LOCAL ] SOJE: Primary data saved (9364 records). [2025-10-01T21:37:30.670416] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-01T21:37:30.670509] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJE took 33.5s. Estimated remaining: 57m 40s. Rate: 7.1 symbols/min [2025-10-01T21:37:30.850003] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:37:30.893098] [DEBUG] [LOCAL ] SON: Loaded 43029 existing records from primary storage. [2025-10-01T21:37:30.893471] [INFO ] [MAIN ] SON: Loaded 43029 existing records. [2025-10-01T21:37:31.001344] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-01T21:37:31.018433] [INFO ] [REMOTE ] SOJC: Full fetch complete (7802 records). [2025-10-01T21:37:31.054976] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-01T21:37:31.088633] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:37:31.150712] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-01T21:37:31.166374] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-01T21:37:31.208120] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-01T21:37:31.223514] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-01T21:37:31.309161] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-01T21:37:31.811270] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-01T21:37:31.830706] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-01T21:37:31.846429] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-01T21:37:31.846948] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-01T21:37:31.879334] [DEBUG] [LOCAL ] SOJC: Trimmed 7802 records to 5037 (keeping 200 days of data) [2025-10-01T21:37:31.964670] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:31.975167] [DEBUG] [LOCAL ] SOJC: Primary data saved (5037 records). [2025-10-01T21:37:31.975358] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-01T21:37:31.975476] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOJC took 34.8s. Estimated remaining: 57m 30s. Rate: 7.1 symbols/min [2025-10-01T21:37:32.107608] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-01T21:37:32.152284] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:37:32.227100] [DEBUG] [LOCAL ] SONY: Loaded 53361 existing records from primary storage. [2025-10-01T21:37:32.227680] [INFO ] [MAIN ] SONY: Loaded 53361 existing records. [2025-10-01T21:37:32.417104] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:37:32.417478] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-01T21:37:32.417541] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-01T21:37:32.418803] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-01T21:37:32.418866] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-01T21:37:32.811931] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:32.847136] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T21:37:32.902352] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-01T21:37:33.051322] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-01T21:37:33.702475] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-01T21:37:34.263679] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-01T21:37:34.264894] [INFO ] [REMOTE ] SOL: Full fetch complete (21518 records). [2025-10-01T21:37:34.264980] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-01T21:37:34.512951] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-01T21:37:34.623154] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:37:34.722839] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-01T21:37:34.722933] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-01T21:37:34.723448] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-01T21:37:34.723492] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-01T21:37:34.724240] [DEBUG] [LOCAL ] SOL: Trimmed 21518 records to 13261 (keeping 200 days of data) [2025-10-01T21:37:34.805261] [DEBUG] [LOCAL ] SOL: Primary data saved (13261 records). [2025-10-01T21:37:34.805424] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-01T21:37:34.805537] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOL took 34.5s. Estimated remaining: 57m 20s. Rate: 7.1 symbols/min [2025-10-01T21:37:34.995917] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:37:35.000792] [DEBUG] [LOCAL ] SOR: Loaded 2876 existing records from primary storage. [2025-10-01T21:37:35.001005] [INFO ] [MAIN ] SOR: Loaded 2876 existing records. [2025-10-01T21:37:35.198778] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:37:35.198989] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-01T21:37:35.199092] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-01T21:37:35.199364] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-01T21:37:35.199426] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-01T21:37:35.307540] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-01T21:37:35.588159] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:37:36.102406] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-01T21:37:36.179787] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:37:36.470768] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-01T21:37:36.902370] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-01T21:37:36.970710] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T21:37:37.702448] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-01T21:37:38.304704] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T21:37:38.502410] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-01T21:37:38.600606] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T21:37:39.302432] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-01T21:37:40.062364] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T21:37:40.102359] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-01T21:37:40.902489] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-01T21:37:41.220886] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-01T21:37:41.498572] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-01T21:37:41.702423] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-01T21:37:42.502454] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-01T21:37:42.661484] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T21:37:43.302588] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-01T21:37:43.615006] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-01T21:37:43.631471] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-01T21:37:44.109780] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-01T21:37:44.133230] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T21:37:44.876632] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T21:37:44.902428] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-01T21:37:45.348358] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-01T21:37:45.702481] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-01T21:37:46.502438] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-01T21:37:47.280209] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T21:37:47.302345] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-01T21:37:48.102454] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-01T21:37:48.188607] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T21:37:48.701370] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T21:37:48.795850] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T21:37:48.902407] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-01T21:37:49.702419] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-01T21:37:50.324034] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T21:37:50.502411] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-01T21:37:50.908205] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T21:37:51.003890] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-01T21:37:51.302419] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-01T21:37:52.102401] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-01T21:37:52.902375] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-01T21:37:53.232541] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T21:37:53.281964] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-01T21:37:53.663262] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-01T21:37:53.702419] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-01T21:37:54.502495] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-01T21:37:55.302483] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-01T21:37:55.413094] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T21:37:56.080590] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T21:37:56.102377] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-01T21:37:56.902449] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-01T21:37:57.016433] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T21:37:57.312129] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T21:37:57.702410] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-01T21:37:58.509535] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-01T21:37:58.516174] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:37:59.302450] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-01T21:37:59.821849] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-01T21:38:00.102470] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-01T21:38:00.167033] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T21:38:00.455421] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T21:38:00.459501] [INFO ] [REMOTE ] SOLV: Full fetch complete (63249 records). [2025-10-01T21:38:00.459728] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-01T21:38:00.887244] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-01T21:38:00.887369] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-01T21:38:00.888436] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-01T21:38:00.888503] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-01T21:38:00.889873] [DEBUG] [LOCAL ] SOLV: Trimmed 63249 records to 43988 (keeping 200 days of data) [2025-10-01T21:38:00.940707] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-01T21:38:01.153204] [DEBUG] [LOCAL ] SOLV: Primary data saved (43988 records). [2025-10-01T21:38:01.153340] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-01T21:38:01.153429] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOLV took 33.6s. Estimated remaining: 57m 16s. Rate: 7.1 symbols/min [2025-10-01T21:38:01.330686] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:01.341545] [DEBUG] [LOCAL ] SOS: Loaded 8590 existing records from primary storage. [2025-10-01T21:38:01.341837] [INFO ] [MAIN ] SOS: Loaded 8590 existing records. [2025-10-01T21:38:01.547163] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:38:01.547393] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-01T21:38:01.547443] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-01T21:38:01.547800] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-01T21:38:01.547861] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-01T21:38:01.705115] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-01T21:38:01.954059] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:02.357116] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T21:38:02.426549] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-01T21:38:02.497211] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T21:38:02.505714] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-01T21:38:03.302426] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-01T21:38:03.607303] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T21:38:03.608185] [INFO ] [REMOTE ] SOR: Full fetch complete (4366 records). [2025-10-01T21:38:03.608260] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-01T21:38:04.009290] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-01T21:38:04.009371] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-01T21:38:04.009521] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-01T21:38:04.009562] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-01T21:38:04.009972] [DEBUG] [LOCAL ] SOR: Trimmed 4366 records to 2877 (keeping 200 days of data) [2025-10-01T21:38:04.028333] [DEBUG] [LOCAL ] SOR: Primary data saved (2877 records). [2025-10-01T21:38:04.028407] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-01T21:38:04.028478] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SOR took 29.2s. Estimated remaining: 57m 6s. Rate: 7.1 symbols/min [2025-10-01T21:38:04.111137] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-01T21:38:04.229117] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:04.267550] [DEBUG] [LOCAL ] SPB: Loaded 34054 existing records from primary storage. [2025-10-01T21:38:04.267993] [INFO ] [MAIN ] SPB: Loaded 34054 existing records. [2025-10-01T21:38:04.478403] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:38:04.478660] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-01T21:38:04.478724] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-01T21:38:04.479919] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-01T21:38:04.479982] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-01T21:38:04.890700] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:04.907492] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-01T21:38:04.927421] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-01T21:38:05.216184] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T21:38:05.702388] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-01T21:38:06.166593] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T21:38:06.483619] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T21:38:06.502337] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-01T21:38:07.161452] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-01T21:38:07.302791] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-01T21:38:08.102425] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-01T21:38:08.902343] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-01T21:38:09.010490] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T21:38:09.702363] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-01T21:38:09.832877] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-01T21:38:10.189565] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-01T21:38:10.502386] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-01T21:38:10.775838] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T21:38:10.777265] [INFO ] [REMOTE ] SON: Full fetch complete (62437 records). [2025-10-01T21:38:10.777358] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-01T21:38:11.248902] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-01T21:38:11.248989] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-01T21:38:11.250041] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-01T21:38:11.250109] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-01T21:38:11.251552] [DEBUG] [LOCAL ] SON: Trimmed 62437 records to 43079 (keeping 200 days of data) [2025-10-01T21:38:11.307364] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-01T21:38:11.531142] [DEBUG] [LOCAL ] SON: Primary data saved (43079 records). [2025-10-01T21:38:11.531271] [INFO ] [MAIN ] SON: Full history saved. [2025-10-01T21:38:11.531377] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SON took 40.9s. Estimated remaining: 56m 57s. Rate: 7.1 symbols/min [2025-10-01T21:38:11.716705] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:11.766064] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T21:38:11.767109] [DEBUG] [LOCAL ] SPCE: Loaded 49901 existing records from primary storage. [2025-10-01T21:38:11.769131] [INFO ] [MAIN ] SPCE: Loaded 49901 existing records. [2025-10-01T21:38:11.986027] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-01T21:38:11.985702] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:38:11.987869] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-01T21:38:11.987924] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-01T21:38:11.989226] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-01T21:38:11.989152] [INFO ] [REMOTE ] SONY: Full fetch complete (77226 records). [2025-10-01T21:38:11.989466] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-01T21:38:11.994770] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-01T21:38:12.107609] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-01T21:38:12.794939] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:12.893703] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-01T21:38:12.893804] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-01T21:38:12.894989] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-01T21:38:12.895056] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-01T21:38:12.896955] [DEBUG] [LOCAL ] SONY: Trimmed 77226 records to 53358 (keeping 200 days of data) [2025-10-01T21:38:12.902399] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-01T21:38:13.259027] [DEBUG] [LOCAL ] SONY: Primary data saved (53358 records). [2025-10-01T21:38:13.259175] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-01T21:38:13.259350] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SONY took 41.3s. Estimated remaining: 56m 47s. Rate: 7.1 symbols/min [2025-10-01T21:38:13.480246] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:13.489252] [DEBUG] [LOCAL ] SPE: Loaded 6352 existing records from primary storage. [2025-10-01T21:38:13.489481] [INFO ] [MAIN ] SPE: Loaded 6352 existing records. [2025-10-01T21:38:13.704141] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-01T21:38:13.703990] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:38:13.680318] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-01T21:38:13.725689] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-01T21:38:13.726587] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-01T21:38:13.727458] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T21:38:13.734208] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-01T21:38:13.735320] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-01T21:38:14.145111] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:14.502410] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-01T21:38:15.302355] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-01T21:38:15.383455] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T21:38:15.916343] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-01T21:38:16.102427] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-01T21:38:16.580461] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-01T21:38:16.902383] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-01T21:38:17.483158] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T21:38:17.702414] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-01T21:38:17.983597] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T21:38:18.036705] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-01T21:38:18.502371] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-01T21:38:19.302417] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-01T21:38:19.715901] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-01T21:38:20.102383] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-01T21:38:20.902370] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-01T21:38:20.948819] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T21:38:21.126584] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T21:38:21.702409] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-01T21:38:22.314934] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T21:38:22.499540] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T21:38:22.503145] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-01T21:38:23.302405] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-01T21:38:24.102383] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-01T21:38:24.231561] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T21:38:24.902364] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-01T21:38:25.163964] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-01T21:38:25.702412] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-01T21:38:26.502407] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-01T21:38:27.534714] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-01T21:38:27.537223] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-01T21:38:28.393848] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (4.29 seconds). [2025-10-01T21:38:28.402520] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-01T21:38:28.716550] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T21:38:28.902351] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-01T21:38:29.155817] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (3.45 seconds). [2025-10-01T21:38:29.284262] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-01T21:38:29.348794] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T21:38:29.702382] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-01T21:38:30.307732] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T21:38:30.357533] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-01T21:38:30.502398] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-01T21:38:30.963900] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-01T21:38:31.302380] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-01T21:38:32.102422] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-01T21:38:32.709362] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T21:38:32.902391] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-01T21:38:33.475734] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-01T21:38:33.702394] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-01T21:38:33.791102] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T21:38:33.792324] [INFO ] [REMOTE ] SOS: Full fetch complete (11043 records). [2025-10-01T21:38:33.792438] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-01T21:38:34.219063] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-01T21:38:34.219162] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-01T21:38:34.219480] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-01T21:38:34.219543] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-01T21:38:34.220072] [DEBUG] [LOCAL ] SOS: Trimmed 11043 records to 8693 (keeping 200 days of data) [2025-10-01T21:38:34.278391] [DEBUG] [LOCAL ] SOS: Primary data saved (8693 records). [2025-10-01T21:38:34.278544] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-01T21:38:34.278633] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SOS took 33.1s. Estimated remaining: 56m 42s. Rate: 7.1 symbols/min [2025-10-01T21:38:34.473833] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:34.474010] [DEBUG] [LOCAL ] SPG: No existing data file found in primary storage. [2025-10-01T21:38:34.474051] [WARN ] [MAIN ] SPG: No existing data found, performing full refresh instead. [2025-10-01T21:38:34.474186] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-01T21:38:34.474245] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-01T21:38:34.474290] [DEBUG] [LOCAL ] SPG: No primary data file found to delete. [2025-10-01T21:38:34.474323] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-01T21:38:34.507547] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-01T21:38:34.899777] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:35.302403] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-01T21:38:35.493637] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T21:38:35.806043] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-01T21:38:36.102436] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-01T21:38:36.715955] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-01T21:38:36.902404] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-01T21:38:37.702409] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-01T21:38:37.915604] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T21:38:38.326122] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-01T21:38:38.327073] [INFO ] [REMOTE ] SPE: Full fetch complete (10172 records). [2025-10-01T21:38:38.327145] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-01T21:38:38.510276] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-01T21:38:38.580191] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T21:38:38.775186] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-01T21:38:38.775301] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-01T21:38:38.775759] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-01T21:38:38.775825] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-01T21:38:38.776429] [DEBUG] [LOCAL ] SPE: Trimmed 10172 records to 6350 (keeping 200 days of data) [2025-10-01T21:38:38.818416] [DEBUG] [LOCAL ] SPE: Primary data saved (6350 records). [2025-10-01T21:38:38.818621] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-01T21:38:38.818772] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPE took 25.6s. Estimated remaining: 56m 32s. Rate: 7.1 symbols/min [2025-10-01T21:38:38.998728] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:38.999021] [DEBUG] [LOCAL ] SPGI: No existing data file found in primary storage. [2025-10-01T21:38:38.999059] [WARN ] [MAIN ] SPGI: No existing data found, performing full refresh instead. [2025-10-01T21:38:38.999243] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-01T21:38:38.999299] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-01T21:38:38.999367] [DEBUG] [LOCAL ] SPGI: No primary data file found to delete. [2025-10-01T21:38:38.999406] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-01T21:38:39.307530] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-01T21:38:39.394215] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:40.102426] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-01T21:38:40.902402] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-01T21:38:41.770451] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (3.26 seconds). [2025-10-01T21:38:41.782728] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-01T21:38:42.605278] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-10-01T21:38:42.617805] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-01T21:38:43.161408] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-01T21:38:43.302450] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-01T21:38:43.377275] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-01T21:38:43.497067] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T21:38:44.102366] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-01T21:38:44.247799] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-01T21:38:44.249085] [INFO ] [REMOTE ] SPB: Full fetch complete (47500 records). [2025-10-01T21:38:44.249162] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-01T21:38:44.734265] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-01T21:38:44.765402] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-01T21:38:44.765815] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-01T21:38:44.767421] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-01T21:38:44.767487] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-01T21:38:44.768863] [DEBUG] [LOCAL ] SPB: Trimmed 47500 records to 34038 (keeping 200 days of data) [2025-10-01T21:38:44.935759] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-01T21:38:44.989826] [DEBUG] [LOCAL ] SPB: Primary data saved (34038 records). [2025-10-01T21:38:44.989987] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-01T21:38:44.990096] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPB took 41.0s. Estimated remaining: 56m 23s. Rate: 7.1 symbols/min [2025-10-01T21:38:45.181012] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:45.204136] [DEBUG] [LOCAL ] SPH: Loaded 17642 existing records from primary storage. [2025-10-01T21:38:45.204403] [INFO ] [MAIN ] SPH: Loaded 17642 existing records. [2025-10-01T21:38:45.413714] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:38:45.413995] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-01T21:38:45.414042] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-01T21:38:45.414863] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-01T21:38:45.414938] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-01T21:38:45.705218] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-01T21:38:45.811414] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:45.985613] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T21:38:46.502365] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-01T21:38:46.647444] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T21:38:47.302454] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-01T21:38:47.720484] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-01T21:38:48.108573] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-01T21:38:48.114218] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T21:38:48.815329] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-01T21:38:48.819564] [INFO ] [REMOTE ] SPCE: Full fetch complete (72342 records). [2025-10-01T21:38:48.819717] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-01T21:38:48.907455] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-01T21:38:49.290761] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T21:38:49.290904] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-01T21:38:49.295612] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-01T21:38:49.296946] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-01T21:38:49.297019] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-01T21:38:49.298562] [DEBUG] [LOCAL ] SPCE: Trimmed 72342 records to 49928 (keeping 200 days of data) [2025-10-01T21:38:49.627892] [DEBUG] [LOCAL ] SPCE: Primary data saved (49928 records). [2025-10-01T21:38:49.628080] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-01T21:38:49.628194] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPCE took 38.1s. Estimated remaining: 56m 14s. Rate: 7.1 symbols/min [2025-10-01T21:38:49.707511] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-01T21:38:49.856029] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:38:49.897384] [DEBUG] [LOCAL ] SPHR: Loaded 39994 existing records from primary storage. [2025-10-01T21:38:49.897739] [INFO ] [MAIN ] SPHR: Loaded 39994 existing records. [2025-10-01T21:38:50.095413] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:38:50.095627] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-01T21:38:50.095743] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-01T21:38:50.096759] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-01T21:38:50.096822] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-01T21:38:50.488253] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:38:50.502343] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-01T21:38:51.031762] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-01T21:38:51.091501] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-01T21:38:51.302382] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-01T21:38:52.067289] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T21:38:52.102343] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-01T21:38:52.470562] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-01T21:38:52.902388] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-01T21:38:53.702358] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-01T21:38:53.949042] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T21:38:54.502385] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-01T21:38:54.561475] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T21:38:55.302412] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-01T21:38:55.433247] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T21:38:55.868342] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T21:38:56.102384] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-01T21:38:56.900341] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T21:38:56.913029] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-01T21:38:57.708115] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-01T21:38:57.727791] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T21:38:58.502401] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-01T21:38:58.811834] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T21:38:58.938088] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T21:38:59.302394] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-01T21:39:00.102368] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-01T21:39:00.282915] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T21:39:00.902360] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-01T21:39:01.078497] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T21:39:01.702378] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-01T21:39:01.834160] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T21:39:02.502367] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-01T21:39:02.746310] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-01T21:39:03.146635] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T21:39:03.302378] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-01T21:39:03.893752] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T21:39:04.102446] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-01T21:39:04.649628] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T21:39:04.909482] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-01T21:39:04.911113] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T21:39:05.702417] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-01T21:39:06.375236] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T21:39:06.502436] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-01T21:39:07.302442] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-01T21:39:07.436852] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T21:39:07.950385] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T21:39:08.102398] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-01T21:39:08.542466] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T21:39:08.902415] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-01T21:39:09.702368] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-01T21:39:10.015478] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T21:39:10.502365] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-01T21:39:10.675405] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T21:39:10.858049] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T21:39:11.302435] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-01T21:39:12.029504] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-01T21:39:12.102379] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-01T21:39:12.902360] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-01T21:39:12.997374] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-01T21:39:13.365123] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T21:39:13.366579] [INFO ] [REMOTE ] SPHR: Full fetch complete (57741 records). [2025-10-01T21:39:13.366718] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-01T21:39:13.704596] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-01T21:39:13.790543] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-01T21:39:13.790617] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-01T21:39:13.791525] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-01T21:39:13.791580] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-01T21:39:13.792836] [DEBUG] [LOCAL ] SPHR: Trimmed 57741 records to 40056 (keeping 200 days of data) [2025-10-01T21:39:14.016580] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T21:39:14.055141] [DEBUG] [LOCAL ] SPHR: Primary data saved (40056 records). [2025-10-01T21:39:14.055282] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-01T21:39:14.055371] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPHR took 24.4s. Estimated remaining: 56m 9s. Rate: 7.1 symbols/min [2025-10-01T21:39:14.247163] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:39:14.284330] [DEBUG] [LOCAL ] SPIR: Loaded 37168 existing records from primary storage. [2025-10-01T21:39:14.284631] [INFO ] [MAIN ] SPIR: Loaded 37168 existing records. [2025-10-01T21:39:14.488334] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:39:14.488568] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-01T21:39:14.488615] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-01T21:39:14.489394] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-01T21:39:14.489453] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-01T21:39:14.510631] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-01T21:39:14.923718] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:39:14.977578] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-01T21:39:14.982817] [INFO ] [REMOTE ] SPG: Full fetch complete (71986 records). [2025-10-01T21:39:14.982962] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-01T21:39:15.312192] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-01T21:39:15.422483] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-01T21:39:15.422604] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-01T21:39:15.423930] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-01T21:39:15.424018] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-01T21:39:15.437159] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T21:39:15.442515] [DEBUG] [LOCAL ] SPG: Trimmed 71986 records to 50270 (keeping 200 days of data) [2025-10-01T21:39:15.775982] [DEBUG] [LOCAL ] SPG: Primary data saved (50270 records). [2025-10-01T21:39:15.776158] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-01T21:39:15.776254] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPG took 41.5s. Estimated remaining: 55m 59s. Rate: 7.1 symbols/min [2025-10-01T21:39:15.959384] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:39:15.966501] [DEBUG] [LOCAL ] SPMC: Loaded 5394 existing records from primary storage. [2025-10-01T21:39:15.966702] [INFO ] [MAIN ] SPMC: Loaded 5394 existing records. [2025-10-01T21:39:16.115426] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-01T21:39:16.162586] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:39:16.162992] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-01T21:39:16.163128] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-01T21:39:16.163452] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-01T21:39:16.163511] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-01T21:39:16.486470] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-01T21:39:16.597739] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:39:16.902360] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-01T21:39:17.115519] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T21:39:17.675704] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T21:39:17.702380] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-01T21:39:18.502382] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-01T21:39:18.540455] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T21:39:19.302389] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-01T21:39:19.865629] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T21:39:20.102396] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-01T21:39:20.620933] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-01T21:39:20.622540] [INFO ] [REMOTE ] SPGI: Full fetch complete (66787 records). [2025-10-01T21:39:20.622676] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-01T21:39:20.914847] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-01T21:39:21.054166] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-01T21:39:21.054255] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-01T21:39:21.055226] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-01T21:39:21.055292] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-01T21:39:21.057746] [DEBUG] [LOCAL ] SPGI: Trimmed 66787 records to 45757 (keeping 200 days of data) [2025-10-01T21:39:21.373588] [DEBUG] [LOCAL ] SPGI: Primary data saved (45757 records). [2025-10-01T21:39:21.373786] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-01T21:39:21.373911] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPGI took 42.6s. Estimated remaining: 55m 50s. Rate: 7.1 symbols/min [2025-10-01T21:39:21.612096] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:39:21.615211] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-01T21:39:21.615414] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-01T21:39:21.615640] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-01T21:39:21.616835] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-01T21:39:21.617688] [INFO ] [REMOTE ] SPH: Full fetch complete (28360 records). [2025-10-01T21:39:21.617905] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-01T21:39:21.617154] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-01T21:39:21.618509] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-01T21:39:21.672794] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-01T21:39:21.704732] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-01T21:39:21.934871] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-01T21:39:22.507384] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-01T21:39:22.530949] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-01T21:39:22.535964] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-01T21:39:22.560551] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-01T21:39:22.563817] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-01T21:39:22.567513] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:39:22.569247] [DEBUG] [LOCAL ] SPH: Trimmed 28360 records to 17477 (keeping 200 days of data) [2025-10-01T21:39:22.685561] [DEBUG] [LOCAL ] SPH: Primary data saved (17477 records). [2025-10-01T21:39:22.685760] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-01T21:39:22.685897] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPH took 37.7s. Estimated remaining: 55m 40s. Rate: 7.1 symbols/min [2025-10-01T21:39:22.776136] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T21:39:22.898515] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:39:22.937926] [DEBUG] [LOCAL ] SPNT: Loaded 34802 existing records from primary storage. [2025-10-01T21:39:22.938253] [INFO ] [MAIN ] SPNT: Loaded 34802 existing records. [2025-10-01T21:39:23.130690] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:39:23.130929] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-01T21:39:23.130983] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-01T21:39:23.131992] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-01T21:39:23.132056] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-01T21:39:23.311552] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-01T21:39:23.544172] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:39:24.021208] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T21:39:24.046354] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T21:39:24.102395] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-01T21:39:24.902390] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-01T21:39:25.668264] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T21:39:25.702363] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-01T21:39:25.747017] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T21:39:26.327211] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-01T21:39:26.502385] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-01T21:39:27.302388] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-01T21:39:27.533249] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:39:27.533571] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-01T21:39:27.533689] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:39:27.533750] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-01T21:39:27.533812] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:39:27.533882] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-01T21:39:27.533947] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-01T21:39:27.533985] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-01T21:39:27.534057] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-01T21:39:27.534125] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPME took 6.2s. Estimated remaining: 55m 31s. Rate: 7.1 symbols/min [2025-10-01T21:39:27.717481] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:39:27.717739] [DEBUG] [LOCAL ] SPOT: No existing data file found in primary storage. [2025-10-01T21:39:27.717789] [WARN ] [MAIN ] SPOT: No existing data found, performing full refresh instead. [2025-10-01T21:39:27.717928] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-01T21:39:27.718048] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-01T21:39:27.718112] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-01T21:39:27.718148] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-01T21:39:28.092025] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T21:39:28.122389] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-01T21:39:28.158105] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:39:28.844299] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T21:39:28.902384] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-01T21:39:29.702398] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-01T21:39:30.223500] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T21:39:30.502390] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-01T21:39:31.302394] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-01T21:39:31.551671] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T21:39:31.723793] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-01T21:39:31.774824] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T21:39:32.102395] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-01T21:39:32.902383] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-01T21:39:33.702393] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-01T21:39:34.182661] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-01T21:39:34.184121] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T21:39:34.428869] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T21:39:34.502379] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-01T21:39:35.302376] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-01T21:39:35.872356] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T21:39:35.947925] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T21:39:36.102414] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-01T21:39:36.902390] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-01T21:39:37.672130] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T21:39:37.702393] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-01T21:39:38.021022] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T21:39:38.021908] [INFO ] [REMOTE ] SPMC: Full fetch complete (8185 records). [2025-10-01T21:39:38.021988] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-01T21:39:38.414212] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-01T21:39:38.414297] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-01T21:39:38.414512] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-01T21:39:38.414552] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-01T21:39:38.415042] [DEBUG] [LOCAL ] SPMC: Trimmed 8185 records to 5380 (keeping 200 days of data) [2025-10-01T21:39:38.449503] [DEBUG] [LOCAL ] SPMC: Primary data saved (5380 records). [2025-10-01T21:39:38.449697] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-01T21:39:38.449796] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPMC took 22.7s. Estimated remaining: 55m 23s. Rate: 7.1 symbols/min [2025-10-01T21:39:38.507520] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-01T21:39:38.637470] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:39:38.677955] [DEBUG] [LOCAL ] SPR: Loaded 41107 existing records from primary storage. [2025-10-01T21:39:38.678311] [INFO ] [MAIN ] SPR: Loaded 41107 existing records. [2025-10-01T21:39:38.877327] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:39:38.877760] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-01T21:39:38.877886] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-01T21:39:38.879122] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-01T21:39:38.879187] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-01T21:39:39.288983] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-01T21:39:39.313150] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:39:39.307347] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-01T21:39:39.773376] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T21:39:40.102404] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-01T21:39:40.794775] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-01T21:39:40.902390] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-01T21:39:41.549787] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T21:39:41.702395] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-01T21:39:42.502430] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-01T21:39:43.199299] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-01T21:39:43.233961] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T21:39:43.302396] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-01T21:39:44.000187] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T21:39:44.102387] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-01T21:39:44.730368] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T21:39:44.902390] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-01T21:39:45.702387] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-01T21:39:46.502405] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-01T21:39:47.019235] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-10-01T21:39:47.133777] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-01T21:39:47.302375] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-01T21:39:47.623325] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T21:39:47.982333] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T21:39:48.102383] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-01T21:39:48.640511] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T21:39:48.902380] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-01T21:39:49.702373] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-01T21:39:50.139680] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-01T21:39:50.345533] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T21:39:50.502390] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-01T21:39:50.858161] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T21:39:51.302378] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-01T21:39:51.739108] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T21:39:52.102377] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-01T21:39:52.144218] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-01T21:39:52.145451] [INFO ] [REMOTE ] SPIR: Full fetch complete (52641 records). [2025-10-01T21:39:52.145540] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-01T21:39:52.555014] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-01T21:39:52.555120] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-01T21:39:52.556125] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-01T21:39:52.556198] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-01T21:39:52.557562] [DEBUG] [LOCAL ] SPIR: Trimmed 52641 records to 37093 (keeping 200 days of data) [2025-10-01T21:39:52.781320] [DEBUG] [LOCAL ] SPIR: Primary data saved (37093 records). [2025-10-01T21:39:52.781466] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-01T21:39:52.781553] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPIR took 38.7s. Estimated remaining: 55m 15s. Rate: 7.1 symbols/min [2025-10-01T21:39:52.907565] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-01T21:39:52.981121] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:39:52.991905] [DEBUG] [LOCAL ] SPRU: Loaded 8931 existing records from primary storage. [2025-10-01T21:39:52.992128] [INFO ] [MAIN ] SPRU: Loaded 8931 existing records. [2025-10-01T21:39:53.191587] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:39:53.191937] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-01T21:39:53.191991] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-01T21:39:53.192372] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-01T21:39:53.192436] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-01T21:39:53.535320] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T21:39:53.619397] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:39:53.702351] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-01T21:39:53.986338] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T21:39:54.216980] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-01T21:39:54.502436] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-01T21:39:55.302454] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-01T21:39:56.032475] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T21:39:56.049450] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T21:39:56.102376] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-01T21:39:56.670890] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T21:39:56.902389] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-01T21:39:57.556100] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T21:39:57.702400] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-01T21:39:58.502391] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-01T21:39:59.302404] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-01T21:39:59.603353] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T21:40:00.007386] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T21:40:00.027207] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-01T21:40:00.102404] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-01T21:40:00.907748] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-01T21:40:00.911417] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T21:40:01.702473] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-01T21:40:02.228040] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T21:40:02.502451] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-01T21:40:03.302415] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-01T21:40:03.491131] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T21:40:04.102401] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-01T21:40:04.211347] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-01T21:40:04.346738] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T21:40:04.902390] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-01T21:40:05.050718] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-01T21:40:05.052195] [INFO ] [REMOTE ] SPR: Full fetch complete (60052 records). [2025-10-01T21:40:05.052286] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-01T21:40:05.549248] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T21:40:05.555584] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-01T21:40:05.556051] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-01T21:40:05.557082] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-01T21:40:05.557158] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-01T21:40:05.558683] [DEBUG] [LOCAL ] SPR: Trimmed 60052 records to 41174 (keeping 200 days of data) [2025-10-01T21:40:05.734284] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-01T21:40:05.815918] [DEBUG] [LOCAL ] SPR: Primary data saved (41174 records). [2025-10-01T21:40:05.816052] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-01T21:40:05.816138] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPR took 27.4s. Estimated remaining: 55m 8s. Rate: 7.1 symbols/min [2025-10-01T21:40:06.009625] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:06.034711] [DEBUG] [LOCAL ] SPXC: Loaded 23324 existing records from primary storage. [2025-10-01T21:40:06.035020] [INFO ] [MAIN ] SPXC: Loaded 23324 existing records. [2025-10-01T21:40:06.242220] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:40:06.242435] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-01T21:40:06.242491] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-01T21:40:06.243182] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-01T21:40:06.243258] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-01T21:40:06.509215] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-01T21:40:06.678696] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:40:06.899565] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T21:40:07.302430] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-01T21:40:08.102384] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-01T21:40:08.154902] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T21:40:08.426845] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T21:40:08.902385] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-01T21:40:09.064354] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-01T21:40:09.644590] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-01T21:40:09.645727] [INFO ] [REMOTE ] SPRU: Full fetch complete (11673 records). [2025-10-01T21:40:09.645802] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-01T21:40:09.707591] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-01T21:40:10.053870] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-01T21:40:10.053953] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-01T21:40:10.054295] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-01T21:40:10.054363] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-01T21:40:10.054899] [DEBUG] [LOCAL ] SPRU: Trimmed 11673 records to 9123 (keeping 200 days of data) [2025-10-01T21:40:10.109498] [DEBUG] [LOCAL ] SPRU: Primary data saved (9123 records). [2025-10-01T21:40:10.109635] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-01T21:40:10.109773] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPRU took 17.3s. Estimated remaining: 54m 59s. Rate: 7.1 symbols/min [2025-10-01T21:40:10.294119] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:10.294339] [DEBUG] [LOCAL ] SPXX: No existing data file found in primary storage. [2025-10-01T21:40:10.294384] [WARN ] [MAIN ] SPXX: No existing data found, performing full refresh instead. [2025-10-01T21:40:10.294497] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-01T21:40:10.294540] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-01T21:40:10.294585] [DEBUG] [LOCAL ] SPXX: No primary data file found to delete. [2025-10-01T21:40:10.294685] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-01T21:40:10.512265] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-01T21:40:10.687266] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:40:11.063162] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T21:40:11.302388] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-01T21:40:11.509515] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T21:40:11.510918] [INFO ] [REMOTE ] SPNT: Full fetch complete (49023 records). [2025-10-01T21:40:11.511008] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-01T21:40:12.017516] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-01T21:40:12.017611] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-01T21:40:12.018632] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-01T21:40:12.018726] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-01T21:40:12.019903] [DEBUG] [LOCAL ] SPNT: Trimmed 49023 records to 34829 (keeping 200 days of data) [2025-10-01T21:40:12.115359] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-01T21:40:12.243468] [DEBUG] [LOCAL ] SPNT: Primary data saved (34829 records). [2025-10-01T21:40:12.243617] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-01T21:40:12.243742] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPNT took 49.6s. Estimated remaining: 54m 49s. Rate: 7.1 symbols/min [2025-10-01T21:40:12.449943] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:12.459390] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T21:40:12.508945] [DEBUG] [LOCAL ] SQM: Loaded 48586 existing records from primary storage. [2025-10-01T21:40:12.509320] [INFO ] [MAIN ] SQM: Loaded 48586 existing records. [2025-10-01T21:40:12.741063] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:40:12.741619] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-01T21:40:12.741735] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-01T21:40:12.742883] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-01T21:40:12.742959] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-01T21:40:12.903446] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-01T21:40:12.928372] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T21:40:13.185536] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:40:13.702427] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-01T21:40:14.502372] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-01T21:40:14.662838] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T21:40:15.040527] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-01T21:40:15.107287] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T21:40:15.302388] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-01T21:40:16.102405] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-01T21:40:16.902392] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-01T21:40:16.927736] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-01T21:40:16.929603] [INFO ] [REMOTE ] SPOT: Full fetch complete (73764 records). [2025-10-01T21:40:16.929757] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-01T21:40:17.129859] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T21:40:17.408952] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-01T21:40:17.409042] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-01T21:40:17.410191] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-01T21:40:17.410262] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-01T21:40:17.411959] [DEBUG] [LOCAL ] SPOT: Trimmed 73764 records to 50577 (keeping 200 days of data) [2025-10-01T21:40:17.705014] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-01T21:40:17.747547] [DEBUG] [LOCAL ] SPOT: Primary data saved (50577 records). [2025-10-01T21:40:17.747718] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-01T21:40:17.747827] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPOT took 50.2s. Estimated remaining: 54m 40s. Rate: 7.1 symbols/min [2025-10-01T21:40:17.945156] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:17.979274] [DEBUG] [LOCAL ] SQNS: Loaded 26313 existing records from primary storage. [2025-10-01T21:40:17.979803] [INFO ] [MAIN ] SQNS: Loaded 26313 existing records. [2025-10-01T21:40:18.194071] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:40:18.194431] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-01T21:40:18.194520] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-01T21:40:18.201141] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-01T21:40:18.210963] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-01T21:40:18.217393] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T21:40:18.511345] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-01T21:40:18.610255] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:40:19.302345] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-01T21:40:19.430799] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T21:40:19.432533] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T21:40:20.102361] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-01T21:40:20.419107] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-01T21:40:20.902396] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-01T21:40:21.702406] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-01T21:40:21.757844] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T21:40:21.820279] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T21:40:22.244408] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-01T21:40:22.502404] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-01T21:40:23.302395] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-01T21:40:23.926002] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T21:40:24.102413] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-01T21:40:24.369053] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-01T21:40:24.828892] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T21:40:24.902360] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-01T21:40:25.702405] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-01T21:40:26.430857] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-01T21:40:26.502363] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-01T21:40:26.652258] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T21:40:27.302448] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-01T21:40:27.538611] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T21:40:28.025887] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T21:40:28.102373] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-01T21:40:28.902416] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-01T21:40:29.365345] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T21:40:29.702386] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-01T21:40:29.998765] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T21:40:30.388576] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-01T21:40:30.502392] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-01T21:40:31.229108] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T21:40:31.302397] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-01T21:40:32.102417] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-01T21:40:32.130838] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-01T21:40:32.132403] [INFO ] [REMOTE ] SPXC: Full fetch complete (34106 records). [2025-10-01T21:40:32.132498] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-01T21:40:32.539674] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-01T21:40:32.539774] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-01T21:40:32.540678] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-01T21:40:32.540745] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-01T21:40:32.541733] [DEBUG] [LOCAL ] SPXC: Trimmed 34106 records to 23393 (keeping 200 days of data) [2025-10-01T21:40:32.689581] [DEBUG] [LOCAL ] SPXC: Primary data saved (23393 records). [2025-10-01T21:40:32.689761] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-01T21:40:32.689858] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXC took 26.9s. Estimated remaining: 54m 33s. Rate: 7.1 symbols/min [2025-10-01T21:40:32.885953] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:32.905620] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-01T21:40:32.921026] [DEBUG] [LOCAL ] SR: Loaded 32887 existing records from primary storage. [2025-10-01T21:40:32.921344] [INFO ] [MAIN ] SR: Loaded 32887 existing records. [2025-10-01T21:40:33.055706] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-01T21:40:33.138484] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:40:33.138719] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-01T21:40:33.138774] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-01T21:40:33.139586] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-01T21:40:33.139676] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-01T21:40:33.517665] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:40:33.702387] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-01T21:40:34.502431] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-01T21:40:34.523071] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-01T21:40:34.813761] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T21:40:35.302376] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-01T21:40:35.323003] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-01T21:40:36.102380] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-01T21:40:36.830541] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T21:40:36.902355] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-01T21:40:37.076133] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-01T21:40:37.448485] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T21:40:37.702408] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-01T21:40:38.502411] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-01T21:40:39.060071] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T21:40:39.302400] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-01T21:40:39.318980] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T21:40:40.102365] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-01T21:40:40.306718] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T21:40:40.902407] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-01T21:40:41.598165] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T21:40:41.702402] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-01T21:40:41.756298] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-01T21:40:42.502416] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-01T21:40:43.054807] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-01T21:40:43.055702] [INFO ] [REMOTE ] SPXX: Full fetch complete (12888 records). [2025-10-01T21:40:43.055778] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-01T21:40:43.304461] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-01T21:40:43.465917] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-01T21:40:43.466049] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-01T21:40:43.466457] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-01T21:40:43.466539] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-01T21:40:43.467158] [DEBUG] [LOCAL ] SPXX: Trimmed 12888 records to 9111 (keeping 200 days of data) [2025-10-01T21:40:43.528841] [DEBUG] [LOCAL ] SPXX: Primary data saved (9111 records). [2025-10-01T21:40:43.529006] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-01T21:40:43.529121] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SPXX took 33.4s. Estimated remaining: 54m 25s. Rate: 7.1 symbols/min [2025-10-01T21:40:43.721688] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:43.722048] [DEBUG] [LOCAL ] SRE: No existing data file found in primary storage. [2025-10-01T21:40:43.751944] [WARN ] [MAIN ] SRE: No existing data found, performing full refresh instead. [2025-10-01T21:40:43.752303] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-01T21:40:43.753924] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T21:40:43.752775] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-01T21:40:43.764827] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-10-01T21:40:43.765179] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-01T21:40:44.107526] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-01T21:40:44.181448] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:40:44.902377] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-01T21:40:45.493854] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-01T21:40:45.702382] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-01T21:40:46.502369] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-01T21:40:46.551337] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-01T21:40:46.895561] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T21:40:47.185071] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T21:40:47.302423] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-01T21:40:47.857833] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T21:40:48.102419] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-01T21:40:48.902430] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-01T21:40:49.095311] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T21:40:49.702400] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-01T21:40:49.962272] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T21:40:50.003497] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T21:40:50.502424] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-01T21:40:51.013081] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T21:40:51.302394] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-01T21:40:51.863222] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T21:40:52.102341] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-01T21:40:52.585969] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T21:40:52.902353] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-01T21:40:52.969177] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T21:40:52.970378] [INFO ] [REMOTE ] SQNS: Full fetch complete (32039 records). [2025-10-01T21:40:52.970464] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-01T21:40:53.402009] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-01T21:40:53.402133] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-01T21:40:53.402896] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-01T21:40:53.402988] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-01T21:40:53.404009] [DEBUG] [LOCAL ] SQNS: Trimmed 32039 records to 26380 (keeping 200 days of data) [2025-10-01T21:40:53.561601] [DEBUG] [LOCAL ] SQNS: Primary data saved (26380 records). [2025-10-01T21:40:53.561762] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-01T21:40:53.561866] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 35.8s. Estimated remaining: 54m 16s. Rate: 7.1 symbols/min [2025-10-01T21:40:53.718259] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-01T21:40:53.756144] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:53.769375] [DEBUG] [LOCAL ] SREA: Loaded 10425 existing records from primary storage. [2025-10-01T21:40:53.769689] [INFO ] [MAIN ] SREA: Loaded 10425 existing records. [2025-10-01T21:40:53.972588] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:40:53.972936] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-01T21:40:53.972998] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-01T21:40:53.973418] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-01T21:40:53.973488] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-01T21:40:54.386890] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:40:54.411762] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T21:40:54.502398] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-01T21:40:55.091545] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-01T21:40:55.302444] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-01T21:40:56.102401] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-01T21:40:56.230243] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T21:40:56.290383] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-01T21:40:56.902404] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-01T21:40:57.597452] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T21:40:57.702359] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-01T21:40:57.785705] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-01T21:40:58.502420] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-01T21:40:58.794121] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T21:40:58.795698] [INFO ] [REMOTE ] SQM: Full fetch complete (68908 records). [2025-10-01T21:40:58.795846] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-01T21:40:59.230295] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-01T21:40:59.230378] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-01T21:40:59.231400] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-01T21:40:59.231465] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-01T21:40:59.232987] [DEBUG] [LOCAL ] SQM: Trimmed 68908 records to 48598 (keeping 200 days of data) [2025-10-01T21:40:59.326720] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-01T21:40:59.538314] [DEBUG] [LOCAL ] SQM: Primary data saved (48598 records). [2025-10-01T21:40:59.538452] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-01T21:40:59.538578] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SQM took 47.3s. Estimated remaining: 54m 7s. Rate: 7.1 symbols/min [2025-10-01T21:40:59.727563] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:40:59.772696] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T21:40:59.792896] [DEBUG] [LOCAL ] SRFM: Loaded 36500 existing records from primary storage. [2025-10-01T21:40:59.793208] [INFO ] [MAIN ] SRFM: Loaded 36500 existing records. [2025-10-01T21:40:59.987938] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:40:59.988458] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-01T21:40:59.988511] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-01T21:40:59.990748] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-01T21:40:59.990811] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-01T21:41:00.105784] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-01T21:41:00.185160] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T21:41:00.406394] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:00.902404] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-01T21:41:01.205488] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-01T21:41:01.208845] [INFO ] [REMOTE ] SR: Full fetch complete (46159 records). [2025-10-01T21:41:01.208960] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-01T21:41:01.639345] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-01T21:41:01.639445] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-01T21:41:01.640343] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-01T21:41:01.640422] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-01T21:41:01.642113] [DEBUG] [LOCAL ] SR: Trimmed 46159 records to 32814 (keeping 200 days of data) [2025-10-01T21:41:01.704391] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-01T21:41:01.875440] [DEBUG] [LOCAL ] SR: Primary data saved (32814 records). [2025-10-01T21:41:01.875593] [INFO ] [MAIN ] SR: Full history saved. [2025-10-01T21:41:01.875754] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SR took 29.2s. Estimated remaining: 53m 58s. Rate: 7.1 symbols/min [2025-10-01T21:41:02.093809] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:41:02.111341] [DEBUG] [LOCAL ] SRG: Loaded 15509 existing records from primary storage. [2025-10-01T21:41:02.111593] [INFO ] [MAIN ] SRG: Loaded 15509 existing records. [2025-10-01T21:41:02.321332] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:41:02.322312] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-01T21:41:02.322396] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-01T21:41:02.322967] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-01T21:41:02.323032] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-01T21:41:02.427470] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T21:41:02.503013] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-01T21:41:02.734740] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:02.773702] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-01T21:41:03.302404] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-01T21:41:04.102372] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-01T21:41:04.239978] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T21:41:04.490014] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T21:41:04.565837] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-01T21:41:04.902405] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-01T21:41:05.702398] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-01T21:41:05.876080] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T21:41:06.502390] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-01T21:41:07.179407] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-01T21:41:07.302354] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-01T21:41:07.429955] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T21:41:08.078540] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T21:41:08.102367] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-01T21:41:08.652158] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-01T21:41:08.902447] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-01T21:41:09.702414] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-01T21:41:10.456685] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T21:41:10.502426] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-01T21:41:10.737120] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-01T21:41:11.294091] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T21:41:11.302354] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-01T21:41:11.805397] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-01T21:41:11.806335] [INFO ] [REMOTE ] SREA: Full fetch complete (15823 records). [2025-10-01T21:41:11.806412] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-01T21:41:12.107532] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-01T21:41:12.212260] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-01T21:41:12.212337] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-01T21:41:12.212760] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-01T21:41:12.212826] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-01T21:41:12.213371] [DEBUG] [LOCAL ] SREA: Trimmed 15823 records to 10419 (keeping 200 days of data) [2025-10-01T21:41:12.285547] [DEBUG] [LOCAL ] SREA: Primary data saved (10419 records). [2025-10-01T21:41:12.285717] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-01T21:41:12.285816] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SREA took 18.7s. Estimated remaining: 53m 50s. Rate: 7.1 symbols/min [2025-10-01T21:41:12.511621] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:41:12.538678] [DEBUG] [LOCAL ] SRI: Loaded 27270 existing records from primary storage. [2025-10-01T21:41:12.538943] [INFO ] [MAIN ] SRI: Loaded 27270 existing records. [2025-10-01T21:41:12.739049] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:41:12.739275] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-01T21:41:12.739330] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-01T21:41:12.739951] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-01T21:41:12.740011] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-01T21:41:12.905370] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-01T21:41:13.137572] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:13.702389] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-01T21:41:13.978517] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T21:41:14.471193] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T21:41:14.502398] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-01T21:41:15.011676] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T21:41:15.302385] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-01T21:41:16.102404] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-01T21:41:16.177102] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T21:41:16.301335] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-01T21:41:16.902365] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-01T21:41:17.288816] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T21:41:17.702402] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-01T21:41:17.924224] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T21:41:18.502422] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-01T21:41:18.848454] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T21:41:19.302384] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-01T21:41:19.627720] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T21:41:19.824581] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-01T21:41:20.102402] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-01T21:41:20.902371] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-01T21:41:21.077896] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-01T21:41:21.702353] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-01T21:41:21.845268] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T21:41:21.985304] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T21:41:21.986993] [INFO ] [REMOTE ] SRE: Full fetch complete (77297 records). [2025-10-01T21:41:21.987132] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-01T21:41:22.434197] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-01T21:41:22.434291] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-01T21:41:22.435481] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-01T21:41:22.435578] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-01T21:41:22.437253] [DEBUG] [LOCAL ] SRE: Trimmed 77297 records to 53423 (keeping 200 days of data) [2025-10-01T21:41:22.509139] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-01T21:41:22.810594] [DEBUG] [LOCAL ] SRE: Primary data saved (53423 records). [2025-10-01T21:41:22.810809] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-01T21:41:22.810914] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRE took 39.3s. Estimated remaining: 53m 42s. Rate: 7.1 symbols/min [2025-10-01T21:41:22.998775] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:41:22.998970] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-01T21:41:22.999017] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-01T21:41:22.999130] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-01T21:41:22.999174] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-01T21:41:22.999218] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-01T21:41:22.999252] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-01T21:41:23.303603] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-01T21:41:23.388325] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:23.655082] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T21:41:24.102472] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-01T21:41:24.127030] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T21:41:24.680073] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-01T21:41:24.902430] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-01T21:41:25.517741] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T21:41:25.702404] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-01T21:41:26.502403] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-01T21:41:26.635730] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T21:41:27.003778] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T21:41:27.302425] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-01T21:41:28.102386] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-01T21:41:28.258491] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T21:41:28.403059] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-01T21:41:28.902410] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-01T21:41:29.547370] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-01T21:41:29.548374] [INFO ] [REMOTE ] SRG: Full fetch complete (24719 records). [2025-10-01T21:41:29.548458] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-01T21:41:29.709102] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-01T21:41:29.985348] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-01T21:41:29.985440] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-01T21:41:29.986060] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-01T21:41:29.986126] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-01T21:41:29.987033] [DEBUG] [LOCAL ] SRG: Trimmed 24719 records to 15546 (keeping 200 days of data) [2025-10-01T21:41:30.084504] [DEBUG] [LOCAL ] SRG: Primary data saved (15546 records). [2025-10-01T21:41:30.084674] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-01T21:41:30.084852] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRG took 28.2s. Estimated remaining: 53m 33s. Rate: 7.1 symbols/min [2025-10-01T21:41:30.288280] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:41:30.297178] [DEBUG] [LOCAL ] SRV: Loaded 7419 existing records from primary storage. [2025-10-01T21:41:30.297375] [INFO ] [MAIN ] SRV: Loaded 7419 existing records. [2025-10-01T21:41:30.489787] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:41:30.490026] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-01T21:41:30.490078] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-01T21:41:30.490473] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-01T21:41:30.490567] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-01T21:41:30.511805] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-01T21:41:30.907077] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T21:41:30.935467] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:31.302423] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-01T21:41:31.662786] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-01T21:41:31.937107] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T21:41:32.102400] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-01T21:41:32.466428] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-01T21:41:32.902358] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-01T21:41:33.677088] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T21:41:33.702352] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-01T21:41:34.502423] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-01T21:41:34.671506] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-01T21:41:35.302355] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-01T21:41:35.654535] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-01T21:41:35.771942] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T21:41:36.102399] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-01T21:41:36.881402] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T21:41:36.902405] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-01T21:41:37.702436] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-01T21:41:37.734726] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T21:41:38.223087] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-01T21:41:38.502384] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-01T21:41:39.305816] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-01T21:41:39.681524] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-01T21:41:40.102400] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-01T21:41:40.651253] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-01T21:41:40.902391] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-01T21:41:40.911487] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T21:41:41.270483] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-01T21:41:41.702379] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-01T21:41:42.054631] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-01T21:41:42.502378] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-01T21:41:42.775259] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-01T21:41:42.776144] [INFO ] [REMOTE ] SRL: Full fetch complete (1954 records). [2025-10-01T21:41:42.776229] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-01T21:41:42.987163] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-01T21:41:42.987376] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:41:42.987427] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:41:42.987530] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-01T21:41:42.987598] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-01T21:41:42.987662] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-01T21:41:42.987767] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-01T21:41:42.987852] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRL took 20.2s. Estimated remaining: 53m 25s. Rate: 7.1 symbols/min [2025-10-01T21:41:43.181273] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:41:43.231397] [DEBUG] [LOCAL ] SSB: Loaded 42707 existing records from primary storage. [2025-10-01T21:41:43.231828] [INFO ] [MAIN ] SSB: Loaded 42707 existing records. [2025-10-01T21:41:43.307562] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-01T21:41:43.450442] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:41:43.450718] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-01T21:41:43.450779] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-01T21:41:43.451980] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-01T21:41:43.452049] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-01T21:41:43.854882] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:44.102375] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-01T21:41:44.829376] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-01T21:41:44.902378] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-01T21:41:45.459619] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-01T21:41:45.628267] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T21:41:45.702373] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-01T21:41:46.502381] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-01T21:41:47.289674] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T21:41:47.302336] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-01T21:41:47.374868] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T21:41:48.054166] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T21:41:48.102402] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-01T21:41:48.839877] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T21:41:48.902408] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-01T21:41:49.702386] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-01T21:41:50.459898] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T21:41:50.502409] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-01T21:41:50.541009] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T21:41:51.302389] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-01T21:41:52.038462] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T21:41:52.102423] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-01T21:41:52.564062] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-01T21:41:52.564940] [INFO ] [REMOTE ] SRV: Full fetch complete (11568 records). [2025-10-01T21:41:52.565021] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-01T21:41:52.907508] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-01T21:41:52.983284] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-01T21:41:52.983422] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-01T21:41:52.983819] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-01T21:41:52.983900] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-01T21:41:52.984631] [DEBUG] [LOCAL ] SRV: Trimmed 11568 records to 7385 (keeping 200 days of data) [2025-10-01T21:41:53.034627] [DEBUG] [LOCAL ] SRV: Primary data saved (7385 records). [2025-10-01T21:41:53.034874] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-01T21:41:53.034998] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRV took 22.9s. Estimated remaining: 53m 17s. Rate: 7.1 symbols/min [2025-10-01T21:41:53.232223] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:41:53.256715] [DEBUG] [LOCAL ] SSD: Loaded 22460 existing records from primary storage. [2025-10-01T21:41:53.257236] [INFO ] [MAIN ] SSD: Loaded 22460 existing records. [2025-10-01T21:41:53.487108] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:41:53.487584] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-01T21:41:53.489799] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-01T21:41:53.489908] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-01T21:41:53.499858] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-01T21:41:53.500498] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-01T21:41:53.707493] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-01T21:41:53.894910] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:54.418882] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T21:41:54.502430] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-01T21:41:55.302398] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-01T21:41:55.622483] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T21:41:55.652374] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-01T21:41:55.654010] [INFO ] [REMOTE ] SRFM: Full fetch complete (49523 records). [2025-10-01T21:41:55.654113] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-01T21:41:56.094861] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-01T21:41:56.094943] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-01T21:41:56.095881] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-01T21:41:56.095945] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-01T21:41:56.097062] [DEBUG] [LOCAL ] SRFM: Trimmed 49523 records to 36756 (keeping 200 days of data) [2025-10-01T21:41:56.102391] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-01T21:41:56.326942] [DEBUG] [LOCAL ] SRFM: Primary data saved (36756 records). [2025-10-01T21:41:56.327085] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-01T21:41:56.327170] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRFM took 56.8s. Estimated remaining: 53m 8s. Rate: 7.1 symbols/min [2025-10-01T21:41:56.526781] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:41:56.568089] [DEBUG] [LOCAL ] SSL: Loaded 41129 existing records from primary storage. [2025-10-01T21:41:56.568393] [INFO ] [MAIN ] SSL: Loaded 41129 existing records. [2025-10-01T21:41:56.767543] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:41:56.768052] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-01T21:41:56.768164] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-01T21:41:56.769228] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-01T21:41:56.769292] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-01T21:41:56.906618] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-01T21:41:57.227361] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:41:57.232823] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T21:41:57.390041] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T21:41:57.702398] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-01T21:41:57.813675] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T21:41:58.502419] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-01T21:41:59.010265] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T21:41:59.302423] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-01T21:41:59.741699] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T21:42:00.102379] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-01T21:42:00.902401] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-01T21:42:01.148721] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T21:42:01.215383] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T21:42:01.702439] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-01T21:42:02.054115] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:42:02.502444] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-01T21:42:03.244789] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T21:42:03.302399] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-01T21:42:03.658432] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T21:42:04.102399] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-01T21:42:04.902440] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-01T21:42:04.940939] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T21:42:05.702442] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-01T21:42:05.848106] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T21:42:05.992633] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T21:42:06.502395] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-01T21:42:07.152932] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:42:07.302370] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-01T21:42:08.102361] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-01T21:42:08.163718] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T21:42:08.480283] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T21:42:08.902401] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-01T21:42:09.689115] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T21:42:09.702348] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-01T21:42:09.762682] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T21:42:10.502396] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-01T21:42:11.302367] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-01T21:42:11.524500] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-01T21:42:11.723741] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-01T21:42:12.102395] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-01T21:42:12.905583] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-01T21:42:12.911173] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:42:13.556013] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T21:42:13.557071] [INFO ] [REMOTE ] SRI: Full fetch complete (41288 records). [2025-10-01T21:42:13.557171] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-01T21:42:13.718911] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-01T21:42:13.775377] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T21:42:14.018051] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-01T21:42:14.018147] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-01T21:42:14.019071] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-01T21:42:14.019136] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-01T21:42:14.020285] [DEBUG] [LOCAL ] SRI: Trimmed 41288 records to 27179 (keeping 200 days of data) [2025-10-01T21:42:14.179085] [DEBUG] [LOCAL ] SRI: Primary data saved (27179 records). [2025-10-01T21:42:14.179215] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-01T21:42:14.179333] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SRI took 1m 2s. Estimated remaining: 53m 1s. Rate: 7.1 symbols/min [2025-10-01T21:42:14.362837] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:42:14.375471] [DEBUG] [LOCAL ] SST: Loaded 11924 existing records from primary storage. [2025-10-01T21:42:14.375770] [INFO ] [MAIN ] SST: Loaded 11924 existing records. [2025-10-01T21:42:14.507582] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-01T21:42:14.573206] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:42:14.573951] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-01T21:42:14.574011] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-01T21:42:14.574374] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-01T21:42:14.574435] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-01T21:42:14.861821] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-01T21:42:14.892475] [INFO ] [REMOTE ] SSB: Full fetch complete (61172 records). [2025-10-01T21:42:14.893536] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-01T21:42:15.099977] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:42:15.308315] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-01T21:42:15.407293] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-01T21:42:15.407388] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-01T21:42:15.408526] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-01T21:42:15.408599] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-01T21:42:15.411274] [DEBUG] [LOCAL ] SSB: Trimmed 61172 records to 42655 (keeping 200 days of data) [2025-10-01T21:42:15.686688] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T21:42:15.715004] [DEBUG] [LOCAL ] SSB: Primary data saved (42655 records). [2025-10-01T21:42:15.715139] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-01T21:42:15.715246] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSB took 32.7s. Estimated remaining: 52m 51s. Rate: 7.1 symbols/min [2025-10-01T21:42:16.102409] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-01T21:42:16.716057] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T21:42:16.902392] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-01T21:42:17.315046] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T21:42:17.526153] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T21:42:17.702384] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-01T21:42:18.502363] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-01T21:42:18.867902] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T21:42:19.302378] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-01T21:42:19.745623] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-01T21:42:20.102387] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-01T21:42:20.199014] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T21:42:20.902408] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-01T21:42:21.651787] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-01T21:42:21.702425] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-01T21:42:21.746795] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T21:42:22.502441] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-01T21:42:22.857337] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T21:42:23.299323] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T21:42:23.302630] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-01T21:42:24.102437] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-01T21:42:24.455060] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T21:42:24.902394] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-01T21:42:25.654236] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T21:42:25.694725] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-01T21:42:25.695777] [INFO ] [REMOTE ] SSD: Full fetch complete (32411 records). [2025-10-01T21:42:25.695854] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-01T21:42:25.710146] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-01T21:42:26.126462] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-01T21:42:26.126585] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-01T21:42:26.127294] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-01T21:42:26.127414] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-01T21:42:26.128925] [DEBUG] [LOCAL ] SSD: Trimmed 32411 records to 22456 (keeping 200 days of data) [2025-10-01T21:42:26.279838] [DEBUG] [LOCAL ] SSD: Primary data saved (22456 records). [2025-10-01T21:42:26.279981] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-01T21:42:26.280095] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSD took 33.2s. Estimated remaining: 52m 43s. Rate: 7.1 symbols/min [2025-10-01T21:42:26.502435] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-01T21:42:26.645356] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T21:42:27.302398] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-01T21:42:28.123481] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T21:42:28.133140] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-01T21:42:28.409051] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T21:42:28.902399] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-01T21:42:29.162345] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T21:42:29.163787] [INFO ] [REMOTE ] SSL: Full fetch complete (60106 records). [2025-10-01T21:42:29.163915] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-01T21:42:29.596101] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-01T21:42:29.596184] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-01T21:42:29.597106] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-01T21:42:29.597170] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-01T21:42:29.598423] [DEBUG] [LOCAL ] SSL: Trimmed 60106 records to 41183 (keeping 200 days of data) [2025-10-01T21:42:29.825164] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-01T21:42:29.833455] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-01T21:42:29.858998] [DEBUG] [LOCAL ] SSL: Primary data saved (41183 records). [2025-10-01T21:42:29.859139] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-01T21:42:29.859243] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SSL took 33.5s. Estimated remaining: 52m 34s. Rate: 7.1 symbols/min [2025-10-01T21:42:30.609187] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T21:42:30.612373] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-01T21:42:31.097548] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T21:42:31.302366] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-01T21:42:31.734633] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-01T21:42:31.735629] [INFO ] [REMOTE ] SST: Full fetch complete (18888 records). [2025-10-01T21:42:31.735765] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-01T21:42:32.322438] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-01T21:42:32.322666] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-01T21:42:32.323481] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-01T21:42:32.323549] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-01T21:42:32.324693] [DEBUG] [LOCAL ] SST: Trimmed 18888 records to 11876 (keeping 200 days of data) [2025-10-01T21:42:32.437412] [DEBUG] [LOCAL ] SST: Primary data saved (11876 records). [2025-10-01T21:42:32.437593] [INFO ] [MAIN ] SST: Full history saved. [2025-10-01T21:42:32.437725] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SST took 18.3s. Estimated remaining: 52m 24s. Rate: 7.1 symbols/min [2025-10-01T21:42:33.270177] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:42:33.318435] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:42:33.368745] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:42:33.377708] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:42:33.434205] [DEBUG] [LOCAL ] STC: Loaded 17485 existing records from primary storage. [2025-10-01T21:42:33.443318] [INFO ] [MAIN ] STC: Loaded 17485 existing records. [2025-10-01T21:42:33.443992] [DEBUG] [LOCAL ] SSTK: Loaded 25974 existing records from primary storage. [2025-10-01T21:42:33.468410] [INFO ] [MAIN ] SSTK: Loaded 25974 existing records. [2025-10-01T21:42:33.591284] [DEBUG] [LOCAL ] ST: Loaded 49737 existing records from primary storage. [2025-10-01T21:42:33.618888] [INFO ] [MAIN ] ST: Loaded 49737 existing records. [2025-10-01T21:42:33.858594] [DEBUG] [LOCAL ] STAG: Loaded 50054 existing records from primary storage. [2025-10-01T21:42:33.936911] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:42:33.999078] [INFO ] [MAIN ] STAG: Loaded 50054 existing records. [2025-10-01T21:42:34.033532] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-01T21:42:34.076390] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-01T21:42:34.100990] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:42:34.138266] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-01T21:42:34.143586] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-01T21:42:34.194824] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-01T21:42:34.216883] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-01T21:42:34.334134] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:42:34.341805] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-01T21:42:34.354288] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-01T21:42:34.365170] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-01T21:42:34.447866] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-01T21:42:34.623136] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-01T21:42:34.613228] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:42:34.639485] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-01T21:42:34.628580] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-01T21:42:34.689067] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-01T21:42:34.826333] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-01T21:42:34.878685] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-01T21:42:35.673862] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:42:35.626354] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:42:35.692351] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-01T21:42:35.691987] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-01T21:42:35.955696] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:42:35.966430] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-01T21:42:36.036918] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:42:36.037432] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-01T21:42:36.836690] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T21:42:36.844518] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-01T21:42:36.929410] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T21:42:36.933786] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-01T21:42:37.440613] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T21:42:37.451607] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-01T21:42:37.828351] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T21:42:37.838277] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-01T21:42:37.979585] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T21:42:38.028091] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T21:42:38.502366] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-01T21:42:38.656281] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T21:42:39.302376] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-01T21:42:39.706277] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-01T21:42:39.862477] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-01T21:42:40.102398] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-01T21:42:40.324799] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T21:42:40.902386] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-01T21:42:41.636015] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T21:42:41.702379] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-01T21:42:42.509187] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-01T21:42:42.530850] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T21:42:43.302708] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-01T21:42:43.347725] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T21:42:43.397678] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T21:42:44.102386] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-01T21:42:44.780798] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T21:42:44.902407] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-01T21:42:45.702426] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-01T21:42:46.216515] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-01T21:42:46.501004] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-01T21:42:46.505139] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-01T21:42:46.801436] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-01T21:42:47.302402] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-01T21:42:48.005001] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T21:42:48.083749] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T21:42:48.102344] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-01T21:42:48.902357] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-01T21:42:49.176206] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T21:42:49.702395] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-01T21:42:50.359228] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T21:42:50.502439] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-01T21:42:51.302411] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-01T21:42:51.530601] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T21:42:52.102386] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-01T21:42:52.283079] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-01T21:42:52.361338] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T21:42:52.902473] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-01T21:42:53.702864] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T21:42:53.702940] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-01T21:42:54.503010] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-01T21:42:54.787857] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T21:42:54.814166] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T21:42:55.302380] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-01T21:42:56.102360] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-01T21:42:56.283004] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T21:42:56.607862] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T21:42:56.902357] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-01T21:42:57.073030] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-01T21:42:57.702388] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-01T21:42:57.868426] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T21:42:58.502394] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-01T21:42:59.302398] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-01T21:42:59.482175] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T21:42:59.690990] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T21:42:59.951341] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T21:42:59.952286] [INFO ] [REMOTE ] STC: Full fetch complete (25895 records). [2025-10-01T21:42:59.952404] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-01T21:43:00.109379] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-01T21:43:00.370746] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-01T21:43:00.370845] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-01T21:43:00.371442] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-01T21:43:00.371511] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-01T21:43:00.372393] [DEBUG] [LOCAL ] STC: Trimmed 25895 records to 17459 (keeping 200 days of data) [2025-10-01T21:43:00.489276] [DEBUG] [LOCAL ] STC: Primary data saved (17459 records). [2025-10-01T21:43:00.489506] [INFO ] [MAIN ] STC: Full history saved. [2025-10-01T21:43:00.489606] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 28.1s. Estimated remaining: 52m 19s. Rate: 7.1 symbols/min [2025-10-01T21:43:00.677992] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:00.678207] [DEBUG] [LOCAL ] STE: No existing data file found in primary storage. [2025-10-01T21:43:00.678250] [WARN ] [MAIN ] STE: No existing data found, performing full refresh instead. [2025-10-01T21:43:00.678382] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-01T21:43:00.678436] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-01T21:43:00.678507] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-10-01T21:43:00.678556] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-01T21:43:00.909675] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-01T21:43:01.081853] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:01.702384] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-01T21:43:01.800541] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T21:43:02.502403] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-01T21:43:02.812364] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T21:43:02.894321] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T21:43:03.302385] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-01T21:43:03.918268] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T21:43:04.102404] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-01T21:43:04.555979] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T21:43:04.557491] [INFO ] [REMOTE ] STAG: Full fetch complete (72033 records). [2025-10-01T21:43:04.557587] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-01T21:43:04.907749] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-01T21:43:05.003368] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-01T21:43:05.003463] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-01T21:43:05.004504] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-01T21:43:05.004575] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-01T21:43:05.006271] [DEBUG] [LOCAL ] STAG: Trimmed 72033 records to 50065 (keeping 200 days of data) [2025-10-01T21:43:05.345367] [DEBUG] [LOCAL ] STAG: Primary data saved (50065 records). [2025-10-01T21:43:05.345513] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-01T21:43:05.345615] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. STAG took 32.9s. Estimated remaining: 52m 10s. Rate: 7.1 symbols/min [2025-10-01T21:43:05.542391] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:05.566340] [DEBUG] [LOCAL ] STEL: Loaded 23231 existing records from primary storage. [2025-10-01T21:43:05.566631] [INFO ] [MAIN ] STEL: Loaded 23231 existing records. [2025-10-01T21:43:05.710388] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-01T21:43:05.755084] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T21:43:05.796372] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:43:05.804080] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-01T21:43:05.804956] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-01T21:43:05.806142] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-01T21:43:05.806207] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-01T21:43:06.208224] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:06.502347] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-01T21:43:06.657713] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T21:43:06.899400] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-01T21:43:07.151635] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-01T21:43:07.302391] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-01T21:43:08.102396] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-01T21:43:08.367277] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T21:43:08.902454] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-01T21:43:09.221783] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T21:43:09.223748] [INFO ] [REMOTE ] ST: Full fetch complete (71924 records). [2025-10-01T21:43:09.223857] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-01T21:43:09.689509] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-01T21:43:09.689592] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-01T21:43:09.690707] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-01T21:43:09.690778] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-01T21:43:09.692323] [DEBUG] [LOCAL ] ST: Trimmed 71924 records to 49737 (keeping 200 days of data) [2025-10-01T21:43:09.752157] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-01T21:43:10.017231] [DEBUG] [LOCAL ] ST: Primary data saved (49737 records). [2025-10-01T21:43:10.017372] [INFO ] [MAIN ] ST: Full history saved. [2025-10-01T21:43:10.017463] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. ST took 37.6s. Estimated remaining: 52m 1s. Rate: 7.1 symbols/min [2025-10-01T21:43:10.218723] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:10.258214] [DEBUG] [LOCAL ] STEM: Loaded 39380 existing records from primary storage. [2025-10-01T21:43:10.258508] [INFO ] [MAIN ] STEM: Loaded 39380 existing records. [2025-10-01T21:43:10.491321] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:43:10.492369] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-01T21:43:10.493792] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T21:43:10.493881] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-01T21:43:10.505213] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-01T21:43:10.504967] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-01T21:43:10.505096] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-01T21:43:10.505547] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-01T21:43:10.519729] [INFO ] [REMOTE ] SSTK: Full fetch complete (41903 records). [2025-10-01T21:43:10.519921] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-01T21:43:11.318072] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-01T21:43:11.321831] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:11.341276] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-01T21:43:11.341378] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-01T21:43:11.342453] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-01T21:43:11.342670] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-01T21:43:11.344026] [DEBUG] [LOCAL ] SSTK: Trimmed 41903 records to 25942 (keeping 200 days of data) [2025-10-01T21:43:11.544981] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T21:43:11.551139] [DEBUG] [LOCAL ] SSTK: Primary data saved (25942 records). [2025-10-01T21:43:11.551247] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-01T21:43:11.551459] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. SSTK took 39.1s. Estimated remaining: 51m 51s. Rate: 7.1 symbols/min [2025-10-01T21:43:11.737140] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:11.755818] [DEBUG] [LOCAL ] STEW: Loaded 16033 existing records from primary storage. [2025-10-01T21:43:11.756075] [INFO ] [MAIN ] STEW: Loaded 16033 existing records. [2025-10-01T21:43:11.959830] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:43:11.960058] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-01T21:43:11.960107] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-01T21:43:11.960594] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-01T21:43:11.960689] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-01T21:43:12.107535] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-01T21:43:12.380731] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:12.902355] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-01T21:43:12.975880] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T21:43:13.702460] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-01T21:43:14.056129] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T21:43:14.230484] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T21:43:14.502373] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-01T21:43:14.753591] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T21:43:15.302407] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-01T21:43:15.893356] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T21:43:16.102379] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-01T21:43:16.781584] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-01T21:43:16.887266] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T21:43:16.902390] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-01T21:43:17.702405] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-01T21:43:18.502366] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-01T21:43:18.840895] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-01T21:43:19.154160] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T21:43:19.302388] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-01T21:43:19.322605] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-01T21:43:20.102383] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-01T21:43:20.731426] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T21:43:20.902403] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-01T21:43:21.703166] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-01T21:43:21.709358] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T21:43:22.502390] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-01T21:43:22.791156] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T21:43:22.824205] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T21:43:23.302367] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-01T21:43:23.729212] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T21:43:24.102361] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-01T21:43:24.420041] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-01T21:43:24.902385] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-01T21:43:25.702363] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-01T21:43:25.735478] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T21:43:25.965986] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T21:43:26.502374] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-01T21:43:26.850461] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T21:43:27.302376] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-01T21:43:27.935923] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T21:43:28.102409] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-01T21:43:28.490985] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T21:43:28.902395] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-01T21:43:29.216556] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T21:43:29.702392] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-01T21:43:30.502408] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-01T21:43:30.573553] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T21:43:30.682073] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T21:43:31.302425] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-01T21:43:31.610826] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T21:43:32.102424] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-01T21:43:32.637871] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T21:43:32.902387] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-01T21:43:33.702347] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-01T21:43:33.800758] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T21:43:33.821958] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-01T21:43:34.502375] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-01T21:43:35.043473] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T21:43:35.302375] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-01T21:43:36.008617] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T21:43:36.102383] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-01T21:43:36.418594] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-01T21:43:36.902391] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-01T21:43:36.921993] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T21:43:37.702392] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-01T21:43:38.139319] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T21:43:38.199446] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-01T21:43:38.200411] [INFO ] [REMOTE ] STEW: Full fetch complete (21880 records). [2025-10-01T21:43:38.200485] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-01T21:43:38.507465] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-01T21:43:38.588566] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-01T21:43:38.588679] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-01T21:43:38.589178] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-01T21:43:38.589223] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-01T21:43:38.590018] [DEBUG] [LOCAL ] STEW: Trimmed 21880 records to 16128 (keeping 200 days of data) [2025-10-01T21:43:38.696999] [DEBUG] [LOCAL ] STEW: Primary data saved (16128 records). [2025-10-01T21:43:38.697149] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-01T21:43:38.697262] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEW took 27.1s. Estimated remaining: 51m 46s. Rate: 7.1 symbols/min [2025-10-01T21:43:38.890298] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:38.890495] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-01T21:43:38.890536] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-01T21:43:38.890684] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-01T21:43:38.890739] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-01T21:43:38.890784] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-01T21:43:38.890819] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-01T21:43:39.279882] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:39.302336] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-01T21:43:39.588984] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T21:43:39.613863] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-01T21:43:40.102454] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-01T21:43:40.902430] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-01T21:43:41.491636] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-01T21:43:41.492604] [INFO ] [REMOTE ] STEL: Full fetch complete (32078 records). [2025-10-01T21:43:41.492703] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-01T21:43:41.674381] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T21:43:41.717082] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-01T21:43:41.942491] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-01T21:43:41.942589] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-01T21:43:41.943435] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-01T21:43:41.943505] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-01T21:43:41.944371] [DEBUG] [LOCAL ] STEL: Trimmed 32078 records to 23143 (keeping 200 days of data) [2025-10-01T21:43:42.102183] [DEBUG] [LOCAL ] STEL: Primary data saved (23143 records). [2025-10-01T21:43:42.102353] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-01T21:43:42.102472] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEL took 36.8s. Estimated remaining: 51m 37s. Rate: 7.1 symbols/min [2025-10-01T21:43:42.302220] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T21:43:42.306812] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:42.320221] [DEBUG] [LOCAL ] STK: Loaded 9399 existing records from primary storage. [2025-10-01T21:43:42.320450] [INFO ] [MAIN ] STK: Loaded 9399 existing records. [2025-10-01T21:43:42.511435] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-01T21:43:42.518782] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:43:42.519051] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-01T21:43:42.519882] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-01T21:43:42.520232] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-01T21:43:42.520294] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-01T21:43:42.939171] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-01T21:43:42.943183] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:43.302371] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-01T21:43:44.102393] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-01T21:43:44.314616] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T21:43:44.316517] [INFO ] [REMOTE ] STEM: Full fetch complete (62198 records). [2025-10-01T21:43:44.316629] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-01T21:43:44.767436] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-01T21:43:44.767522] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-01T21:43:44.768578] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-01T21:43:44.768666] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-01T21:43:44.769975] [DEBUG] [LOCAL ] STEM: Trimmed 62198 records to 39350 (keeping 200 days of data) [2025-10-01T21:43:44.903864] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-01T21:43:45.034806] [DEBUG] [LOCAL ] STEM: Primary data saved (39350 records). [2025-10-01T21:43:45.038894] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-01T21:43:45.039061] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STEM took 35.0s. Estimated remaining: 51m 27s. Rate: 7.1 symbols/min [2025-10-01T21:43:45.038806] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-01T21:43:45.104828] [INFO ] [REMOTE ] STE: Full fetch complete (50630 records). [2025-10-01T21:43:45.135080] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-01T21:43:45.359547] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:45.719539] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-01T21:43:45.704954] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-01T21:43:45.721311] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-01T21:43:45.721152] [DEBUG] [LOCAL ] STLA: Loaded 53542 existing records from primary storage. [2025-10-01T21:43:45.723839] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-01T21:43:45.724134] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-01T21:43:45.724809] [INFO ] [MAIN ] STLA: Loaded 53542 existing records. [2025-10-01T21:43:45.799157] [DEBUG] [LOCAL ] STE: Trimmed 50630 records to 35328 (keeping 200 days of data) [2025-10-01T21:43:45.946359] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T21:43:46.045023] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:43:46.046346] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-01T21:43:46.046744] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-01T21:43:46.051401] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-01T21:43:46.052575] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-01T21:43:46.192154] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-01T21:43:46.489465] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:46.542601] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-01T21:43:46.603049] [DEBUG] [LOCAL ] STE: Primary data saved (35328 records). [2025-10-01T21:43:46.603186] [INFO ] [MAIN ] STE: Full history saved. [2025-10-01T21:43:46.603283] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STE took 46.1s. Estimated remaining: 51m 17s. Rate: 7.1 symbols/min [2025-10-01T21:43:46.808595] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:43:46.869422] [DEBUG] [LOCAL ] STM: Loaded 53581 existing records from primary storage. [2025-10-01T21:43:46.869794] [INFO ] [MAIN ] STM: Loaded 53581 existing records. [2025-10-01T21:43:46.959139] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-01T21:43:47.081231] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:43:47.081489] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-01T21:43:47.081555] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-01T21:43:47.082816] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-01T21:43:47.082878] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-01T21:43:47.310281] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-01T21:43:47.537362] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:43:48.102375] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-01T21:43:48.159155] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T21:43:48.902395] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-01T21:43:49.702382] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-01T21:43:49.850297] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T21:43:50.227470] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-01T21:43:50.502437] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-01T21:43:50.805760] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T21:43:51.295882] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T21:43:51.302353] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-01T21:43:52.102407] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-01T21:43:52.902380] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-01T21:43:53.124471] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T21:43:53.702399] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-01T21:43:53.720834] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-01T21:43:54.072956] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-01T21:43:54.502440] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-01T21:43:55.302397] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-01T21:43:56.044951] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-01T21:43:56.102349] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-01T21:43:56.247399] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T21:43:56.321774] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T21:43:56.902405] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-01T21:43:57.702364] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-01T21:43:57.768423] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T21:43:58.203031] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-01T21:43:58.502388] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-01T21:43:59.302390] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-01T21:43:59.312382] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T21:43:59.573343] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-01T21:44:00.102426] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-01T21:44:00.902449] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-01T21:44:01.651563] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T21:44:01.702386] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-01T21:44:01.749833] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-01T21:44:02.335389] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-01T21:44:02.476964] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-01T21:44:02.502577] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-01T21:44:03.302376] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-01T21:44:03.962226] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-01T21:44:04.102365] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-01T21:44:04.461117] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-01T21:44:04.717356] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-01T21:44:04.902402] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-01T21:44:05.445860] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-01T21:44:05.446858] [INFO ] [REMOTE ] STK: Full fetch complete (14134 records). [2025-10-01T21:44:05.446932] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-01T21:44:05.707755] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-01T21:44:05.869458] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-01T21:44:05.869554] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-01T21:44:05.869934] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-01T21:44:05.869998] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-01T21:44:05.870586] [DEBUG] [LOCAL ] STK: Trimmed 14134 records to 9423 (keeping 200 days of data) [2025-10-01T21:44:05.931401] [DEBUG] [LOCAL ] STK: Primary data saved (9423 records). [2025-10-01T21:44:05.931548] [INFO ] [MAIN ] STK: Full history saved. [2025-10-01T21:44:05.931689] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 23.8s. Estimated remaining: 51m 11s. Rate: 7.1 symbols/min [2025-10-01T21:44:06.116613] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:06.139974] [DEBUG] [LOCAL ] STN: Loaded 22898 existing records from primary storage. [2025-10-01T21:44:06.140229] [INFO ] [MAIN ] STN: Loaded 22898 existing records. [2025-10-01T21:44:06.339974] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:44:06.340179] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-01T21:44:06.340231] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-01T21:44:06.341393] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-01T21:44:06.341457] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-01T21:44:06.503393] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-01T21:44:06.644084] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-01T21:44:06.765594] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:07.302438] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-01T21:44:07.831986] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-01T21:44:08.102387] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-01T21:44:08.571490] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T21:44:08.902349] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-01T21:44:09.147021] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T21:44:09.702430] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-01T21:44:10.502358] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-01T21:44:10.766325] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-01T21:44:11.302355] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-01T21:44:11.407817] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T21:44:11.736749] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-01T21:44:12.102379] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-01T21:44:12.902387] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-01T21:44:13.341477] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T21:44:13.702407] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-01T21:44:13.791670] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-01T21:44:14.415034] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-01T21:44:14.469797] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-01T21:44:14.502354] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-01T21:44:15.302426] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-01T21:44:15.388490] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T21:44:15.685402] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-01T21:44:15.686199] [INFO ] [REMOTE ] STG: Full fetch complete (2488 records). [2025-10-01T21:44:15.686274] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-01T21:44:15.882887] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-01T21:44:15.883113] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:44:15.883197] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:44:15.883341] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-01T21:44:15.883434] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-01T21:44:15.883488] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-01T21:44:15.883584] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-01T21:44:15.883732] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STG took 37.2s. Estimated remaining: 51m 3s. Rate: 7.1 symbols/min [2025-10-01T21:44:16.067596] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:16.115978] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-01T21:44:16.122721] [DEBUG] [LOCAL ] STNG: Loaded 43901 existing records from primary storage. [2025-10-01T21:44:16.123365] [INFO ] [MAIN ] STNG: Loaded 43901 existing records. [2025-10-01T21:44:16.320036] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:44:16.320303] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-01T21:44:16.320354] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-01T21:44:16.321454] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-01T21:44:16.321518] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-01T21:44:16.732066] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:16.902377] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-01T21:44:17.401087] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T21:44:17.702420] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-01T21:44:18.502411] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-01T21:44:19.065023] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-01T21:44:19.311292] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-01T21:44:19.333536] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-01T21:44:19.713790] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T21:44:20.102427] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-01T21:44:20.902460] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-01T21:44:21.573996] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-01T21:44:21.653975] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T21:44:21.702486] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-01T21:44:22.502357] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-01T21:44:22.792876] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T21:44:22.966638] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-01T21:44:23.302370] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-01T21:44:23.955005] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T21:44:24.102403] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-01T21:44:24.611568] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T21:44:24.902398] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-01T21:44:25.702356] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-01T21:44:26.087414] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-01T21:44:26.116694] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T21:44:26.502389] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-01T21:44:27.302419] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-01T21:44:27.346036] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T21:44:27.347723] [INFO ] [REMOTE ] STLA: Full fetch complete (77531 records). [2025-10-01T21:44:27.347836] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-01T21:44:27.794830] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-01T21:44:27.794921] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-01T21:44:27.796099] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-01T21:44:27.796174] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-01T21:44:27.797862] [DEBUG] [LOCAL ] STLA: Trimmed 77531 records to 53543 (keeping 200 days of data) [2025-10-01T21:44:27.992886] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-01T21:44:28.022628] [INFO ] [REMOTE ] STM: Full fetch complete (77527 records). [2025-10-01T21:44:28.023384] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-01T21:44:28.107884] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-01T21:44:28.438551] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T21:44:28.569364] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-01T21:44:28.569934] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-01T21:44:28.571297] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-01T21:44:28.571877] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-01T21:44:28.580420] [DEBUG] [LOCAL ] STM: Trimmed 77527 records to 53580 (keeping 200 days of data) [2025-10-01T21:44:28.799324] [DEBUG] [LOCAL ] STLA: Primary data saved (53543 records). [2025-10-01T21:44:28.800268] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-01T21:44:28.800675] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STLA took 43.8s. Estimated remaining: 50m 55s. Rate: 7.1 symbols/min [2025-10-01T21:44:28.905469] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-01T21:44:29.003005] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:29.018269] [DEBUG] [LOCAL ] STRV: Loaded 11413 existing records from primary storage. [2025-10-01T21:44:29.019094] [INFO ] [MAIN ] STRV: Loaded 11413 existing records. [2025-10-01T21:44:29.285552] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:44:29.295841] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-01T21:44:29.322375] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-01T21:44:29.323373] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-01T21:44:29.324419] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-01T21:44:29.687183] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-01T21:44:29.693206] [INFO ] [REMOTE ] STN: Full fetch complete (32436 records). [2025-10-01T21:44:29.709241] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-01T21:44:29.827024] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:29.852745] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-01T21:44:30.143424] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-01T21:44:30.348890] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-01T21:44:30.349507] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-01T21:44:30.350545] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-01T21:44:30.350630] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-01T21:44:30.354064] [DEBUG] [LOCAL ] STN: Trimmed 32436 records to 22870 (keeping 200 days of data) [2025-10-01T21:44:30.480859] [DEBUG] [LOCAL ] STM: Primary data saved (53580 records). [2025-10-01T21:44:30.481297] [INFO ] [MAIN ] STM: Full history saved. [2025-10-01T21:44:30.481749] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STM took 43.9s. Estimated remaining: 50m 45s. Rate: 7.1 symbols/min [2025-10-01T21:44:30.507461] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-01T21:44:30.696509] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:30.698097] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-10-01T21:44:30.698174] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-10-01T21:44:30.698323] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-01T21:44:30.699173] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-01T21:44:30.699796] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-10-01T21:44:30.700327] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-01T21:44:31.044919] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-01T21:44:31.110338] [DEBUG] [LOCAL ] STN: Primary data saved (22870 records). [2025-10-01T21:44:31.120749] [INFO ] [MAIN ] STN: Full history saved. [2025-10-01T21:44:31.120913] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STN took 25.2s. Estimated remaining: 50m 35s. Rate: 7.1 symbols/min [2025-10-01T21:44:31.254221] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:31.307461] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-01T21:44:31.377594] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:31.377839] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-01T21:44:31.377899] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-01T21:44:31.378048] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-01T21:44:31.378104] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-01T21:44:31.378158] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-01T21:44:31.378198] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-01T21:44:31.815761] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:32.102458] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-01T21:44:32.244985] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T21:44:32.828512] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T21:44:32.902402] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-01T21:44:33.104300] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:44:33.104681] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-01T21:44:33.104825] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:44:33.104919] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-01T21:44:33.105012] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:44:33.105115] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-01T21:44:33.105217] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-01T21:44:33.105308] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-01T21:44:33.105374] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-01T21:44:33.105450] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STUB took 2.0s. Estimated remaining: 50m 26s. Rate: 7.1 symbols/min [2025-10-01T21:44:33.303772] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:33.330520] [DEBUG] [LOCAL ] STVN: Loaded 26313 existing records from primary storage. [2025-10-01T21:44:33.330865] [INFO ] [MAIN ] STVN: Loaded 26313 existing records. [2025-10-01T21:44:33.530503] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:44:33.530818] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-01T21:44:33.531007] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-01T21:44:33.533366] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-01T21:44:33.533444] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-01T21:44:33.704134] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-01T21:44:33.981508] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:33.985086] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-01T21:44:34.502382] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-01T21:44:35.302394] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-01T21:44:35.345330] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-01T21:44:35.363033] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T21:44:36.102389] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-01T21:44:36.461415] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T21:44:36.826251] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-01T21:44:36.902383] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-01T21:44:37.661010] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T21:44:37.702415] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-01T21:44:38.248960] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T21:44:38.502435] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-01T21:44:39.302616] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-01T21:44:39.653059] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:44:40.102434] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-01T21:44:40.265383] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-01T21:44:40.902382] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-01T21:44:41.476637] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T21:44:41.667844] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T21:44:41.702351] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-01T21:44:42.502369] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-01T21:44:42.593796] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T21:44:43.302361] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-01T21:44:44.102358] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-01T21:44:44.261763] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T21:44:44.508035] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-01T21:44:44.902417] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-01T21:44:45.702407] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-01T21:44:45.750077] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T21:44:46.070971] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T21:44:46.502402] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-01T21:44:47.302383] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-01T21:44:47.499194] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T21:44:47.916967] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-01T21:44:48.102354] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-01T21:44:48.142770] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T21:44:48.867735] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T21:44:48.902396] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-01T21:44:49.409711] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-01T21:44:49.410575] [INFO ] [REMOTE ] STRV: Full fetch complete (18258 records). [2025-10-01T21:44:49.410669] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-01T21:44:49.707513] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-01T21:44:49.810193] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-01T21:44:49.810276] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-01T21:44:49.810749] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-01T21:44:49.810811] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-01T21:44:49.811405] [DEBUG] [LOCAL ] STRV: Trimmed 18258 records to 11394 (keeping 200 days of data) [2025-10-01T21:44:49.888425] [DEBUG] [LOCAL ] STRV: Primary data saved (11394 records). [2025-10-01T21:44:49.888572] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-01T21:44:49.888682] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STRV took 21.1s. Estimated remaining: 50m 19s. Rate: 7.1 symbols/min [2025-10-01T21:44:50.096521] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:50.155292] [DEBUG] [LOCAL ] STWD: Loaded 51880 existing records from primary storage. [2025-10-01T21:44:50.155618] [INFO ] [MAIN ] STWD: Loaded 51880 existing records. [2025-10-01T21:44:50.354212] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:44:50.354425] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-01T21:44:50.354497] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-01T21:44:50.355731] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-01T21:44:50.355798] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-01T21:44:50.514101] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-01T21:44:50.795093] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:51.272207] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T21:44:51.302416] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-01T21:44:52.102346] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-01T21:44:52.177514] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T21:44:52.233482] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T21:44:52.902414] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-01T21:44:53.142636] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T21:44:53.144089] [INFO ] [REMOTE ] STNG: Full fetch complete (64468 records). [2025-10-01T21:44:53.144202] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-01T21:44:53.601564] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-01T21:44:53.601681] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-01T21:44:53.602785] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-01T21:44:53.602858] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-01T21:44:53.604389] [DEBUG] [LOCAL ] STNG: Trimmed 64468 records to 43841 (keeping 200 days of data) [2025-10-01T21:44:53.702565] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-01T21:44:53.903823] [DEBUG] [LOCAL ] STNG: Primary data saved (43841 records). [2025-10-01T21:44:53.903985] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-01T21:44:53.904114] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STNG took 38.0s. Estimated remaining: 50m 9s. Rate: 7.1 symbols/min [2025-10-01T21:44:54.117285] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:44:54.121036] [DEBUG] [LOCAL ] STXD: Loaded 1287 existing records from primary storage. [2025-10-01T21:44:54.121238] [INFO ] [MAIN ] STXD: Loaded 1287 existing records. [2025-10-01T21:44:54.339298] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:44:54.339529] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-01T21:44:54.339580] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-01T21:44:54.339817] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-01T21:44:54.339879] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-01T21:44:54.507587] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-01T21:44:54.847343] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:44:55.190574] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-01T21:44:55.302378] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-01T21:44:55.994922] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T21:44:56.081351] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-01T21:44:56.102344] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-01T21:44:56.163203] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-01T21:44:56.902434] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-01T21:44:57.331222] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-01T21:44:57.332744] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-01T21:44:57.702385] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-01T21:44:58.060427] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-01T21:44:58.502401] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-01T21:44:59.302386] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-01T21:45:00.114154] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-01T21:45:00.120677] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T21:45:00.902372] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-01T21:45:01.136417] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T21:45:01.458272] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T21:45:01.702423] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-01T21:45:02.502354] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-01T21:45:02.698885] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T21:45:03.023151] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T21:45:03.302373] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-01T21:45:03.317415] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T21:45:03.318774] [INFO ] [REMOTE ] STVN: Full fetch complete (39422 records). [2025-10-01T21:45:03.318853] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-01T21:45:03.735887] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-01T21:45:03.735963] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-01T21:45:03.736736] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-01T21:45:03.736801] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-01T21:45:03.737718] [DEBUG] [LOCAL ] STVN: Trimmed 39422 records to 26254 (keeping 200 days of data) [2025-10-01T21:45:03.909872] [DEBUG] [LOCAL ] STVN: Primary data saved (26254 records). [2025-10-01T21:45:03.910104] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-01T21:45:03.910323] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STVN took 30.8s. Estimated remaining: 50m 1s. Rate: 7.1 symbols/min [2025-10-01T21:45:04.114709] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-01T21:45:04.148353] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:45:04.152482] [DEBUG] [LOCAL ] STXE: Loaded 2181 existing records from primary storage. [2025-10-01T21:45:04.152668] [INFO ] [MAIN ] STXE: Loaded 2181 existing records. [2025-10-01T21:45:04.344519] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:45:04.344805] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-01T21:45:04.344856] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-01T21:45:04.345060] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-01T21:45:04.345122] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-01T21:45:04.730002] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:45:04.902399] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-01T21:45:05.702378] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-01T21:45:06.497219] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T21:45:06.502326] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-01T21:45:06.675695] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-10-01T21:45:06.761244] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T21:45:07.150169] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-01T21:45:07.189835] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (3.08 seconds). [2025-10-01T21:45:07.302371] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-01T21:45:08.102416] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-01T21:45:08.608455] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-01T21:45:08.902368] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-01T21:45:09.248569] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-01T21:45:09.355846] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-01T21:45:09.702442] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-01T21:45:10.502364] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-01T21:45:11.302392] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-01T21:45:11.527483] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T21:45:11.812467] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-01T21:45:12.102399] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-01T21:45:12.196624] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T21:45:12.902432] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-01T21:45:13.702433] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-01T21:45:13.832898] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-01T21:45:13.913395] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T21:45:14.237804] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T21:45:14.502415] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-01T21:45:15.063085] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T21:45:15.302378] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-01T21:45:16.102413] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-01T21:45:16.539509] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-01T21:45:16.902396] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-01T21:45:17.172608] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-01T21:45:17.174186] [INFO ] [REMOTE ] STT: Full fetch complete (74414 records). [2025-10-01T21:45:17.174286] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-01T21:45:17.585610] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-01T21:45:17.702324] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-01T21:45:17.702491] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-01T21:45:17.704121] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-01T21:45:17.705261] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-01T21:45:17.705366] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-01T21:45:17.707459] [DEBUG] [LOCAL ] STT: Trimmed 74414 records to 50958 (keeping 200 days of data) [2025-10-01T21:45:18.049169] [DEBUG] [LOCAL ] STT: Primary data saved (50958 records). [2025-10-01T21:45:18.049316] [INFO ] [MAIN ] STT: Full history saved. [2025-10-01T21:45:18.049393] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STT took 47.6s. Estimated remaining: 49m 54s. Rate: 7.1 symbols/min [2025-10-01T21:45:18.238225] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:45:18.243008] [DEBUG] [LOCAL ] STXG: Loaded 2521 existing records from primary storage. [2025-10-01T21:45:18.243238] [INFO ] [MAIN ] STXG: Loaded 2521 existing records. [2025-10-01T21:45:18.439230] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:45:18.439501] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-01T21:45:18.439560] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-01T21:45:18.439873] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-01T21:45:18.439960] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-01T21:45:18.509213] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-01T21:45:18.840237] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:45:18.908780] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-01T21:45:19.030189] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T21:45:19.302375] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-01T21:45:20.102424] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-01T21:45:20.465956] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-01T21:45:20.900975] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T21:45:20.911229] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-01T21:45:21.319852] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T21:45:21.702389] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-01T21:45:22.239418] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-01T21:45:22.502392] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-01T21:45:22.969318] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-01T21:45:23.302375] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-01T21:45:23.535427] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-01T21:45:23.536310] [INFO ] [REMOTE ] STXD: Full fetch complete (2058 records). [2025-10-01T21:45:23.536395] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-01T21:45:23.988553] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-01T21:45:23.988718] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-01T21:45:23.988848] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-01T21:45:23.988891] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-01T21:45:23.989279] [DEBUG] [LOCAL ] STXD: Trimmed 2058 records to 1289 (keeping 200 days of data) [2025-10-01T21:45:23.999383] [DEBUG] [LOCAL ] STXD: Primary data saved (1289 records). [2025-10-01T21:45:23.999524] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-01T21:45:23.999633] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STXD took 30.1s. Estimated remaining: 49m 45s. Rate: 7.1 symbols/min [2025-10-01T21:45:24.107603] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-01T21:45:24.279384] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:45:24.283916] [DEBUG] [LOCAL ] STXK: Loaded 1495 existing records from primary storage. [2025-10-01T21:45:24.284162] [INFO ] [MAIN ] STXK: Loaded 1495 existing records. [2025-10-01T21:45:24.581702] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:45:24.582895] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-01T21:45:24.583345] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-01T21:45:24.583709] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-01T21:45:24.583787] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-01T21:45:24.757376] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T21:45:24.907601] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-01T21:45:25.082615] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:45:25.421177] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T21:45:25.702409] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-01T21:45:26.169058] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T21:45:26.502384] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-01T21:45:27.302374] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-01T21:45:27.561601] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T21:45:27.564323] [INFO ] [REMOTE ] STWD: Full fetch complete (75091 records). [2025-10-01T21:45:27.564568] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-01T21:45:27.799256] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-01T21:45:28.028760] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-01T21:45:28.029091] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-01T21:45:28.030741] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-01T21:45:28.030808] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-01T21:45:28.032772] [DEBUG] [LOCAL ] STWD: Trimmed 75091 records to 51884 (keeping 200 days of data) [2025-10-01T21:45:28.128393] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-01T21:45:28.393714] [DEBUG] [LOCAL ] STWD: Primary data saved (51884 records). [2025-10-01T21:45:28.393967] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-01T21:45:28.394088] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STWD took 38.5s. Estimated remaining: 49m 36s. Rate: 7.1 symbols/min [2025-10-01T21:45:28.599525] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:45:28.599733] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-01T21:45:28.599785] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-01T21:45:28.599937] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-01T21:45:28.599980] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-01T21:45:28.600023] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-01T21:45:28.600056] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-01T21:45:28.740293] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T21:45:28.907740] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-01T21:45:29.049310] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:45:29.386104] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-01T21:45:29.702463] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-01T21:45:30.286523] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T21:45:30.502390] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-01T21:45:31.007898] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-01T21:45:31.302374] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-01T21:45:31.780413] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-01T21:45:31.781204] [INFO ] [REMOTE ] STXE: Full fetch complete (3692 records). [2025-10-01T21:45:31.781286] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-01T21:45:32.107493] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-01T21:45:32.209665] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-01T21:45:32.209760] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-01T21:45:32.209937] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-01T21:45:32.209985] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-01T21:45:32.210452] [DEBUG] [LOCAL ] STXE: Trimmed 3692 records to 2183 (keeping 200 days of data) [2025-10-01T21:45:32.226459] [DEBUG] [LOCAL ] STXE: Primary data saved (2183 records). [2025-10-01T21:45:32.226567] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-01T21:45:32.226692] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXE took 28.3s. Estimated remaining: 49m 26s. Rate: 7.1 symbols/min [2025-10-01T21:45:32.428167] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:45:32.434054] [DEBUG] [LOCAL ] STXT: Loaded 2534 existing records from primary storage. [2025-10-01T21:45:32.434279] [INFO ] [MAIN ] STXT: Loaded 2534 existing records. [2025-10-01T21:45:32.633048] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-01T21:45:32.659808] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:45:32.660030] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-01T21:45:32.660080] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-01T21:45:32.660392] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-01T21:45:32.660454] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-01T21:45:32.907605] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-01T21:45:33.073318] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:45:33.403964] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T21:45:33.702388] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-01T21:45:34.055124] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-01T21:45:34.502437] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-01T21:45:35.117198] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-01T21:45:35.302365] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-01T21:45:35.823360] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-01T21:45:36.102406] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-01T21:45:36.662670] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-01T21:45:36.902406] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-01T21:45:37.363590] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-01T21:45:37.702352] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-01T21:45:38.134547] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-01T21:45:38.502394] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-01T21:45:38.922930] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-01T21:45:39.302377] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-01T21:45:39.762133] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-01T21:45:40.102396] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-01T21:45:40.542566] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-01T21:45:40.902430] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-01T21:45:41.352714] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T21:45:41.702404] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-01T21:45:42.258064] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-01T21:45:42.502449] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-01T21:45:42.862203] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-01T21:45:42.862960] [INFO ] [REMOTE ] STXG: Full fetch complete (4182 records). [2025-10-01T21:45:42.863031] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-01T21:45:43.303800] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-01T21:45:43.305475] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-01T21:45:43.305536] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-01T21:45:43.305755] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-01T21:45:43.305818] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-01T21:45:43.306204] [DEBUG] [LOCAL ] STXG: Trimmed 4182 records to 2509 (keeping 200 days of data) [2025-10-01T21:45:43.324116] [DEBUG] [LOCAL ] STXG: Primary data saved (2509 records). [2025-10-01T21:45:43.324263] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-01T21:45:43.324356] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXG took 25.3s. Estimated remaining: 49m 18s. Rate: 7.1 symbols/min [2025-10-01T21:45:43.519703] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:45:43.523855] [DEBUG] [LOCAL ] STXV: Loaded 1586 existing records from primary storage. [2025-10-01T21:45:43.524083] [INFO ] [MAIN ] STXV: Loaded 1586 existing records. [2025-10-01T21:45:43.744777] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:45:43.745041] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-01T21:45:43.745110] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-01T21:45:43.745341] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-01T21:45:43.745409] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-01T21:45:43.862755] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-01T21:45:44.109069] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-01T21:45:44.135010] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:45:44.688784] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T21:45:44.902380] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-01T21:45:45.350987] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-01T21:45:45.702441] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-01T21:45:46.049186] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-01T21:45:46.502427] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-01T21:45:46.857872] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-01T21:45:47.302373] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-01T21:45:47.801338] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-01T21:45:48.102391] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-01T21:45:48.550504] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-01T21:45:48.902374] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-01T21:45:49.273069] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-01T21:45:49.702388] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-01T21:45:49.947232] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-01T21:45:50.502397] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-01T21:45:50.785245] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-01T21:45:51.302364] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-01T21:45:51.659283] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-01T21:45:52.102431] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-01T21:45:52.451598] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-01T21:45:52.902387] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-01T21:45:53.152150] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-01T21:45:53.152896] [INFO ] [REMOTE ] STXM: Full fetch complete (1434 records). [2025-10-01T21:45:53.152972] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-01T21:45:53.352238] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-01T21:45:53.352454] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:45:53.352545] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:45:53.352662] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-01T21:45:53.352752] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-01T21:45:53.352794] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-01T21:45:53.352853] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-01T21:45:53.352949] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXM took 25.0s. Estimated remaining: 49m 10s. Rate: 7.1 symbols/min [2025-10-01T21:45:53.551946] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:45:53.552125] [DEBUG] [LOCAL ] STZ: No existing data file found in primary storage. [2025-10-01T21:45:53.552201] [WARN ] [MAIN ] STZ: No existing data found, performing full refresh instead. [2025-10-01T21:45:53.552331] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-01T21:45:53.552375] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-01T21:45:53.552418] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-10-01T21:45:53.552452] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-01T21:45:53.710680] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-01T21:45:53.960848] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:45:54.194857] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-01T21:45:54.502386] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-01T21:45:55.004784] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T21:45:55.302373] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-01T21:45:55.850174] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-01T21:45:56.102424] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-01T21:45:56.427894] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-01T21:45:56.902427] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-01T21:45:57.702423] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-01T21:45:58.204629] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-01T21:45:58.502418] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-01T21:45:58.904477] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-01T21:45:58.922383] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-01T21:45:59.302367] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-01T21:45:59.654106] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-01T21:46:00.102422] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-01T21:46:00.588926] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-01T21:46:00.902426] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-01T21:46:01.356951] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-01T21:46:01.702407] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-01T21:46:02.140195] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T21:46:02.502394] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-01T21:46:02.965521] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-01T21:46:03.302434] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-01T21:46:03.570120] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-01T21:46:03.570840] [INFO ] [REMOTE ] STXK: Full fetch complete (2408 records). [2025-10-01T21:46:03.570920] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-01T21:46:03.973397] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-01T21:46:03.973577] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-01T21:46:03.973754] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-01T21:46:03.973863] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-01T21:46:03.974468] [DEBUG] [LOCAL ] STXK: Trimmed 2408 records to 1483 (keeping 200 days of data) [2025-10-01T21:46:03.986342] [DEBUG] [LOCAL ] STXK: Primary data saved (1483 records). [2025-10-01T21:46:03.986459] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-01T21:46:03.986570] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXK took 40.0s. Estimated remaining: 49m 2s. Rate: 7.1 symbols/min [2025-10-01T21:46:04.107558] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-01T21:46:04.181248] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:46:04.256580] [DEBUG] [LOCAL ] SU: Loaded 53451 existing records from primary storage. [2025-10-01T21:46:04.257002] [INFO ] [MAIN ] SU: Loaded 53451 existing records. [2025-10-01T21:46:04.463161] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:46:04.463408] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-01T21:46:04.463464] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-01T21:46:04.464994] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-01T21:46:04.465061] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-01T21:46:04.769907] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T21:46:04.870042] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:46:04.902369] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-01T21:46:05.516446] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T21:46:05.702365] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-01T21:46:06.246188] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T21:46:06.502393] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-01T21:46:06.964795] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T21:46:07.302395] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-01T21:46:07.776017] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-01T21:46:08.102386] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-01T21:46:08.543402] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T21:46:08.902385] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-01T21:46:09.702388] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-01T21:46:10.502387] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-01T21:46:10.654772] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T21:46:10.829425] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-01T21:46:10.830144] [INFO ] [REMOTE ] STXT: Full fetch complete (3978 records). [2025-10-01T21:46:10.830214] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-01T21:46:11.238410] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-01T21:46:11.238502] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-01T21:46:11.238678] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-01T21:46:11.238740] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-01T21:46:11.239147] [DEBUG] [LOCAL ] STXT: Trimmed 3978 records to 2540 (keeping 200 days of data) [2025-10-01T21:46:11.255755] [DEBUG] [LOCAL ] STXT: Primary data saved (2540 records). [2025-10-01T21:46:11.255852] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-01T21:46:11.255953] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXT took 39.0s. Estimated remaining: 48m 53s. Rate: 7.1 symbols/min [2025-10-01T21:46:11.303794] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-01T21:46:11.450955] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:46:11.510955] [DEBUG] [LOCAL ] SUI: Loaded 41735 existing records from primary storage. [2025-10-01T21:46:11.511279] [INFO ] [MAIN ] SUI: Loaded 41735 existing records. [2025-10-01T21:46:11.709204] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:46:11.709708] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-01T21:46:11.709771] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-01T21:46:11.733524] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-01T21:46:11.733711] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-01T21:46:11.835189] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-01T21:46:12.042163] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T21:46:12.109859] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-01T21:46:12.155179] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:46:12.609043] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-01T21:46:12.902425] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-01T21:46:13.418821] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T21:46:13.702381] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-01T21:46:14.191152] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T21:46:14.502425] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-01T21:46:14.825813] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T21:46:14.826568] [INFO ] [REMOTE ] STXV: Full fetch complete (2610 records). [2025-10-01T21:46:14.826662] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-01T21:46:15.242802] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-01T21:46:15.242888] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-01T21:46:15.243004] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-01T21:46:15.243046] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-01T21:46:15.243480] [DEBUG] [LOCAL ] STXV: Trimmed 2610 records to 1575 (keeping 200 days of data) [2025-10-01T21:46:15.254150] [DEBUG] [LOCAL ] STXV: Primary data saved (1575 records). [2025-10-01T21:46:15.254273] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-01T21:46:15.254396] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. STXV took 31.9s. Estimated remaining: 48m 44s. Rate: 7.1 symbols/min [2025-10-01T21:46:15.307522] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-01T21:46:15.459179] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:46:15.510023] [DEBUG] [LOCAL ] SUN: Loaded 37478 existing records from primary storage. [2025-10-01T21:46:15.510324] [INFO ] [MAIN ] SUN: Loaded 37478 existing records. [2025-10-01T21:46:15.736511] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:46:15.736774] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-01T21:46:15.736833] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-01T21:46:15.737695] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-01T21:46:15.737759] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-01T21:46:16.119635] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-01T21:46:16.167169] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:46:16.902469] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-01T21:46:17.274373] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T21:46:17.638858] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T21:46:17.702381] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-01T21:46:18.309032] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T21:46:18.502403] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-01T21:46:19.302411] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-01T21:46:19.380130] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T21:46:20.102392] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-01T21:46:20.600611] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-01T21:46:20.670135] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T21:46:20.902383] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-01T21:46:21.280225] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T21:46:21.702390] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-01T21:46:22.502380] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-01T21:46:22.725582] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T21:46:23.302369] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-01T21:46:23.382868] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T21:46:24.102379] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-01T21:46:24.185375] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T21:46:24.554988] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T21:46:24.902394] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-01T21:46:25.250297] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T21:46:25.702391] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-01T21:46:26.345502] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T21:46:26.502392] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-01T21:46:27.178055] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T21:46:27.302395] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-01T21:46:27.906475] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T21:46:28.102387] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-01T21:46:28.902343] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-01T21:46:29.450627] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-01T21:46:29.663221] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T21:46:29.702354] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-01T21:46:30.502338] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-01T21:46:30.558370] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T21:46:31.292273] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T21:46:31.302333] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-01T21:46:32.102351] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-01T21:46:32.618416] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-01T21:46:32.814059] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T21:46:32.902400] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-01T21:46:33.430229] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T21:46:33.702411] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-01T21:46:34.502416] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-01T21:46:34.777423] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T21:46:35.302423] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-01T21:46:35.516353] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T21:46:36.102455] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-01T21:46:36.512178] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-01T21:46:36.649219] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-01T21:46:36.902421] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-01T21:46:37.703334] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-01T21:46:37.709249] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T21:46:38.397848] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T21:46:38.502426] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-01T21:46:39.302373] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-01T21:46:39.689123] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-01T21:46:40.018889] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T21:46:40.102384] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-01T21:46:40.902715] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-01T21:46:40.905876] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T21:46:41.573607] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-01T21:46:41.702444] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-01T21:46:42.502436] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-01T21:46:43.132016] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-01T21:46:43.302432] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-01T21:46:43.432586] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-01T21:46:43.434226] [INFO ] [REMOTE ] SUN: Full fetch complete (54848 records). [2025-10-01T21:46:43.434362] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-01T21:46:43.767209] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T21:46:43.919762] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-01T21:46:43.919849] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-01T21:46:43.920814] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-01T21:46:43.920883] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-01T21:46:43.922216] [DEBUG] [LOCAL ] SUN: Trimmed 54848 records to 37534 (keeping 200 days of data) [2025-10-01T21:46:44.105746] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-01T21:46:44.163213] [DEBUG] [LOCAL ] SUN: Primary data saved (37534 records). [2025-10-01T21:46:44.163397] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-01T21:46:44.163517] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SUN took 28.9s. Estimated remaining: 48m 39s. Rate: 7.1 symbols/min [2025-10-01T21:46:44.363854] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:46:44.412215] [DEBUG] [LOCAL ] SUPV: Loaded 47280 existing records from primary storage. [2025-10-01T21:46:44.412550] [INFO ] [MAIN ] SUPV: Loaded 47280 existing records. [2025-10-01T21:46:44.607105] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:46:44.607342] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-01T21:46:44.607391] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-01T21:46:44.608501] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-01T21:46:44.608563] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-01T21:46:44.906522] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-01T21:46:44.977904] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-01T21:46:44.992007] [INFO ] [REMOTE ] STZ: Full fetch complete (75844 records). [2025-10-01T21:46:45.005681] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-01T21:46:45.005577] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:46:45.463601] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-01T21:46:45.463731] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-01T21:46:45.464913] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-01T21:46:45.464980] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-01T21:46:45.466622] [DEBUG] [LOCAL ] STZ: Trimmed 75844 records to 52287 (keeping 200 days of data) [2025-10-01T21:46:45.702595] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-01T21:46:45.829147] [DEBUG] [LOCAL ] STZ: Primary data saved (52287 records). [2025-10-01T21:46:45.829288] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-01T21:46:45.829376] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. STZ took 52.5s. Estimated remaining: 48m 29s. Rate: 7.1 symbols/min [2025-10-01T21:46:45.986048] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T21:46:46.047587] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:46:46.043796] [INFO ] [REMOTE ] SUI: Full fetch complete (60944 records). [2025-10-01T21:46:46.047950] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-01T21:46:46.202351] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-01T21:46:46.457091] [DEBUG] [LOCAL ] SUZ: Loaded 45715 existing records from primary storage. [2025-10-01T21:46:46.468160] [INFO ] [MAIN ] SUZ: Loaded 45715 existing records. [2025-10-01T21:46:46.507512] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-01T21:46:46.672332] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-01T21:46:46.682350] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-01T21:46:46.683521] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-01T21:46:46.683949] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-01T21:46:46.753526] [DEBUG] [LOCAL ] SUI: Trimmed 60944 records to 41743 (keeping 200 days of data) [2025-10-01T21:46:46.778505] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:46:46.779130] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-01T21:46:46.779214] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-01T21:46:46.780671] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-01T21:46:46.780766] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-01T21:46:47.330485] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:46:47.333482] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-01T21:46:47.376236] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:46:47.537394] [DEBUG] [LOCAL ] SUI: Primary data saved (41743 records). [2025-10-01T21:46:47.537529] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-01T21:46:47.537624] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUI took 36.3s. Estimated remaining: 48m 20s. Rate: 7.1 symbols/min [2025-10-01T21:46:47.733691] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:46:47.771508] [DEBUG] [LOCAL ] SVV: Loaded 39703 existing records from primary storage. [2025-10-01T21:46:47.771832] [INFO ] [MAIN ] SVV: Loaded 39703 existing records. [2025-10-01T21:46:47.966070] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:46:47.966294] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-01T21:46:47.966349] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-01T21:46:47.968336] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-01T21:46:47.968402] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-01T21:46:48.107488] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-01T21:46:48.376459] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:46:48.497358] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-01T21:46:48.605501] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-01T21:46:48.902384] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-01T21:46:49.702395] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-01T21:46:49.891776] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T21:46:50.302926] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T21:46:50.502409] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-01T21:46:51.009114] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T21:46:51.302420] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-01T21:46:52.102423] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-01T21:46:52.483239] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T21:46:52.484798] [INFO ] [REMOTE ] SU: Full fetch complete (77402 records). [2025-10-01T21:46:52.484898] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-01T21:46:52.797827] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-01T21:46:52.907458] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-01T21:46:52.969786] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-01T21:46:52.969993] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-01T21:46:52.971234] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-01T21:46:52.971299] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-01T21:46:52.973279] [DEBUG] [LOCAL ] SU: Trimmed 77402 records to 53452 (keeping 200 days of data) [2025-10-01T21:46:53.102553] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T21:46:53.358367] [DEBUG] [LOCAL ] SU: Primary data saved (53452 records). [2025-10-01T21:46:53.358550] [INFO ] [MAIN ] SU: Full history saved. [2025-10-01T21:46:53.358680] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SU took 49.4s. Estimated remaining: 48m 11s. Rate: 7.1 symbols/min [2025-10-01T21:46:53.543077] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:46:53.595704] [DEBUG] [LOCAL ] SW: Loaded 53156 existing records from primary storage. [2025-10-01T21:46:53.596076] [INFO ] [MAIN ] SW: Loaded 53156 existing records. [2025-10-01T21:46:53.707600] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-01T21:46:53.796092] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:46:53.796307] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-01T21:46:53.796356] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-01T21:46:53.798039] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-01T21:46:53.798101] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-01T21:46:54.207462] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:46:54.502399] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-01T21:46:54.624463] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T21:46:55.122377] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T21:46:55.302389] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-01T21:46:56.102387] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-01T21:46:56.241816] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T21:46:56.907461] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-01T21:46:56.924700] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T21:46:57.556563] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T21:46:57.702403] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-01T21:46:58.469884] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T21:46:58.502368] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-01T21:46:59.193944] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T21:46:59.302440] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-01T21:47:00.103555] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-01T21:47:00.109066] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T21:47:00.902400] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-01T21:47:01.190215] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T21:47:01.702384] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-01T21:47:01.853383] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T21:47:02.248158] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T21:47:02.502425] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-01T21:47:03.237242] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T21:47:03.302412] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-01T21:47:04.102393] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-01T21:47:04.390516] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T21:47:04.866503] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T21:47:04.902358] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-01T21:47:05.427873] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T21:47:05.702384] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-01T21:47:06.502391] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-01T21:47:06.559537] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T21:47:07.302421] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-01T21:47:07.347467] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T21:47:07.846960] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T21:47:08.102388] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-01T21:47:08.902371] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-01T21:47:08.990452] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T21:47:09.702361] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-01T21:47:09.736576] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T21:47:10.153585] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T21:47:10.502387] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-01T21:47:11.302363] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-01T21:47:11.638920] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T21:47:12.102370] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-01T21:47:12.507752] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T21:47:12.644676] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T21:47:12.902401] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-01T21:47:13.681158] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-01T21:47:13.702382] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-01T21:47:14.144932] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T21:47:14.146515] [INFO ] [REMOTE ] SUPV: Full fetch complete (68329 records). [2025-10-01T21:47:14.146631] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-01T21:47:14.507454] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-01T21:47:14.587271] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-01T21:47:14.587371] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-01T21:47:14.588632] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-01T21:47:14.588742] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-01T21:47:14.590680] [DEBUG] [LOCAL ] SUPV: Trimmed 68329 records to 47322 (keeping 200 days of data) [2025-10-01T21:47:14.879893] [DEBUG] [LOCAL ] SUPV: Primary data saved (47322 records). [2025-10-01T21:47:14.880035] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-01T21:47:14.880123] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUPV took 30.7s. Estimated remaining: 48m 5s. Rate: 7.1 symbols/min [2025-10-01T21:47:15.071461] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:47:15.122031] [DEBUG] [LOCAL ] SWK: Loaded 52386 existing records from primary storage. [2025-10-01T21:47:15.122348] [INFO ] [MAIN ] SWK: Loaded 52386 existing records. [2025-10-01T21:47:15.315294] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-01T21:47:15.321611] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:47:15.322761] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-01T21:47:15.322850] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-01T21:47:15.332373] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-01T21:47:15.348758] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-01T21:47:15.355828] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-01T21:47:15.762475] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:47:15.825988] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T21:47:16.102403] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-01T21:47:16.902386] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-01T21:47:17.274191] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-01T21:47:17.625859] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T21:47:17.702386] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-01T21:47:17.812422] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-01T21:47:17.818067] [INFO ] [REMOTE ] SUZ: Full fetch complete (66786 records). [2025-10-01T21:47:17.818231] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-01T21:47:18.250046] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-01T21:47:18.250141] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-01T21:47:18.251156] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-01T21:47:18.251220] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-01T21:47:18.252636] [DEBUG] [LOCAL ] SUZ: Trimmed 66786 records to 45628 (keeping 200 days of data) [2025-10-01T21:47:18.515028] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-01T21:47:18.538452] [DEBUG] [LOCAL ] SUZ: Primary data saved (45628 records). [2025-10-01T21:47:18.538610] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-01T21:47:18.538867] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SUZ took 32.7s. Estimated remaining: 47m 55s. Rate: 7.1 symbols/min [2025-10-01T21:47:18.733385] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:47:18.763995] [DEBUG] [LOCAL ] SWX: Loaded 31066 existing records from primary storage. [2025-10-01T21:47:18.764354] [INFO ] [MAIN ] SWX: Loaded 31066 existing records. [2025-10-01T21:47:18.908178] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-01T21:47:18.949948] [INFO ] [REMOTE ] SVV: Full fetch complete (56298 records). [2025-10-01T21:47:18.950793] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-01T21:47:18.973923] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:47:19.037189] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-01T21:47:19.046496] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-01T21:47:19.072219] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-01T21:47:19.078945] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-01T21:47:19.313507] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-01T21:47:19.884149] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-01T21:47:19.890042] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:47:19.890248] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-01T21:47:19.891694] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-01T21:47:19.891765] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-01T21:47:19.893126] [DEBUG] [LOCAL ] SVV: Trimmed 56298 records to 39746 (keeping 200 days of data) [2025-10-01T21:47:20.102503] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-01T21:47:20.133698] [DEBUG] [LOCAL ] SVV: Primary data saved (39746 records). [2025-10-01T21:47:20.133835] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-01T21:47:20.133931] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SVV took 32.6s. Estimated remaining: 47m 46s. Rate: 7.1 symbols/min [2025-10-01T21:47:20.330190] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:47:20.337748] [DEBUG] [LOCAL ] SWZ: Loaded 6014 existing records from primary storage. [2025-10-01T21:47:20.337988] [INFO ] [MAIN ] SWZ: Loaded 6014 existing records. [2025-10-01T21:47:20.550441] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:47:20.550972] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-01T21:47:20.551053] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-01T21:47:20.551412] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-01T21:47:20.551512] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-01T21:47:20.759621] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-01T21:47:20.903787] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-01T21:47:21.027750] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:47:21.258671] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T21:47:21.312048] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T21:47:21.702385] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-01T21:47:22.287388] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-01T21:47:22.502499] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-01T21:47:23.128856] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-01T21:47:23.302369] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-01T21:47:24.102382] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-01T21:47:24.440872] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-01T21:47:24.681223] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-01T21:47:24.902361] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-01T21:47:24.990114] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T21:47:25.702395] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-01T21:47:26.502400] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-01T21:47:26.706843] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T21:47:26.957229] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T21:47:27.065403] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-01T21:47:27.302382] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-01T21:47:27.756078] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-01T21:47:28.102380] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-01T21:47:28.729482] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-01T21:47:28.902393] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-01T21:47:29.692159] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T21:47:29.702381] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-01T21:47:30.502405] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-01T21:47:30.855186] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T21:47:31.302397] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-01T21:47:32.102363] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-01T21:47:32.371832] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T21:47:32.458489] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T21:47:32.597884] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-01T21:47:32.902384] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-01T21:47:33.702408] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-01T21:47:34.450714] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T21:47:34.502376] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-01T21:47:34.682410] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T21:47:35.302409] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-01T21:47:35.671245] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-01T21:47:35.930251] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T21:47:36.102403] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-01T21:47:36.902389] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-01T21:47:37.400555] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T21:47:37.402139] [INFO ] [REMOTE ] SW: Full fetch complete (76791 records). [2025-10-01T21:47:37.402336] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-01T21:47:37.519689] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T21:47:37.707599] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-01T21:47:37.842460] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-01T21:47:37.842558] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-01T21:47:37.843786] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-01T21:47:37.843854] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-01T21:47:37.845482] [DEBUG] [LOCAL ] SW: Trimmed 76791 records to 53162 (keeping 200 days of data) [2025-10-01T21:47:38.170037] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-01T21:47:38.172392] [INFO ] [REMOTE ] SWZ: Full fetch complete (8133 records). [2025-10-01T21:47:38.172837] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-01T21:47:38.506746] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-01T21:47:38.622148] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-01T21:47:38.625006] [DEBUG] [LOCAL ] SW: Primary data saved (53162 records). [2025-10-01T21:47:38.625142] [INFO ] [MAIN ] SW: Full history saved. [2025-10-01T21:47:38.625289] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SW took 45.3s. Estimated remaining: 47m 39s. Rate: 7.1 symbols/min [2025-10-01T21:47:38.622526] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-01T21:47:38.641290] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-01T21:47:38.647962] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-01T21:47:38.678086] [DEBUG] [LOCAL ] SWZ: Trimmed 8133 records to 6050 (keeping 200 days of data) [2025-10-01T21:47:38.867479] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:47:38.874408] [DEBUG] [LOCAL ] SWZ: Primary data saved (6050 records). [2025-10-01T21:47:38.874678] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-01T21:47:38.874794] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWZ took 18.7s. Estimated remaining: 47m 29s. Rate: 7.1 symbols/min [2025-10-01T21:47:39.096274] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:47:39.097667] [DEBUG] [LOCAL ] SXC: Loaded 41407 existing records from primary storage. [2025-10-01T21:47:39.098182] [INFO ] [MAIN ] SXC: Loaded 41407 existing records. [2025-10-01T21:47:39.228414] [DEBUG] [LOCAL ] SXI: Loaded 11488 existing records from primary storage. [2025-10-01T21:47:39.265875] [INFO ] [MAIN ] SXI: Loaded 11488 existing records. [2025-10-01T21:47:39.311048] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-01T21:47:39.374848] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:47:39.419311] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-01T21:47:39.425726] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-01T21:47:39.442627] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-01T21:47:39.442836] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-01T21:47:39.647353] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:47:39.676466] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-01T21:47:39.681975] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-01T21:47:39.703080] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-01T21:47:39.726596] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-01T21:47:40.176946] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:47:40.239750] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-01T21:47:40.324714] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T21:47:40.428938] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:47:40.902355] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-01T21:47:41.086726] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T21:47:41.634890] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T21:47:41.702382] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-01T21:47:41.910530] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:47:42.496741] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T21:47:42.502327] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-01T21:47:43.302380] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-01T21:47:43.312091] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T21:47:44.102418] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-01T21:47:44.669316] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T21:47:44.902375] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-01T21:47:44.968715] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-01T21:47:45.702421] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-01T21:47:46.371964] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-01T21:47:46.430027] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T21:47:46.502411] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-01T21:47:47.302400] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-01T21:47:48.095101] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T21:47:48.102899] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-01T21:47:48.777751] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T21:47:48.902381] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-01T21:47:48.918773] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-01T21:47:49.702398] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-01T21:47:50.502386] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-01T21:47:51.016828] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-01T21:47:51.211189] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T21:47:51.302412] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-01T21:47:51.850256] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T21:47:52.102394] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-01T21:47:52.902418] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-01T21:47:52.932283] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T21:47:53.000116] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:47:53.702359] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-01T21:47:54.192917] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-01T21:47:54.502402] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-01T21:47:54.779366] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T21:47:55.302394] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-01T21:47:55.940880] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T21:47:55.995241] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T21:47:55.996352] [INFO ] [REMOTE ] SWX: Full fetch complete (43868 records). [2025-10-01T21:47:55.996473] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-01T21:47:56.111454] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-01T21:47:56.429588] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-01T21:47:56.429704] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-01T21:47:56.430511] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-01T21:47:56.430569] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-01T21:47:56.433028] [DEBUG] [LOCAL ] SWX: Trimmed 43868 records to 31005 (keeping 200 days of data) [2025-10-01T21:47:56.642244] [DEBUG] [LOCAL ] SWX: Primary data saved (31005 records). [2025-10-01T21:47:56.642394] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-01T21:47:56.642484] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWX took 38.1s. Estimated remaining: 47m 22s. Rate: 7.1 symbols/min [2025-10-01T21:47:56.870509] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:47:56.903184] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-01T21:47:56.905028] [DEBUG] [LOCAL ] SXT: Loaded 29307 existing records from primary storage. [2025-10-01T21:47:56.905348] [INFO ] [MAIN ] SXT: Loaded 29307 existing records. [2025-10-01T21:47:57.109330] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:47:57.119593] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-01T21:47:57.119992] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T21:47:57.120195] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-01T21:47:57.124865] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-01T21:47:57.124959] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-01T21:47:57.519751] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:47:57.702391] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-01T21:47:58.502358] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-01T21:47:58.566980] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T21:47:58.818288] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T21:47:59.308722] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-01T21:47:59.312263] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-01T21:48:00.102393] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-01T21:48:00.902382] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-01T21:48:00.942774] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T21:48:01.312014] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T21:48:01.702428] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-01T21:48:02.252022] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-01T21:48:02.252998] [INFO ] [REMOTE ] SXI: Full fetch complete (14832 records). [2025-10-01T21:48:02.253071] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-01T21:48:02.504932] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-01T21:48:02.698480] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-01T21:48:02.699966] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T21:48:02.708271] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-01T21:48:02.708910] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-01T21:48:02.708990] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-01T21:48:02.709897] [DEBUG] [LOCAL ] SXI: Trimmed 14832 records to 11546 (keeping 200 days of data) [2025-10-01T21:48:02.789218] [DEBUG] [LOCAL ] SXI: Primary data saved (11546 records). [2025-10-01T21:48:02.789373] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-01T21:48:02.789551] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXI took 23.9s. Estimated remaining: 47m 13s. Rate: 7.1 symbols/min [2025-10-01T21:48:03.302388] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-01T21:48:03.666754] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T21:48:04.102380] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-01T21:48:04.902384] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-01T21:48:05.248782] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T21:48:05.496020] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-01T21:48:05.702396] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-01T21:48:06.436496] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T21:48:06.502349] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-01T21:48:07.251567] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T21:48:07.302350] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-01T21:48:08.114669] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-01T21:48:08.120939] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T21:48:08.174252] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T21:48:08.902369] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-01T21:48:09.702406] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-01T21:48:10.117577] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-01T21:48:10.228820] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-01T21:48:10.502414] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-01T21:48:10.934893] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T21:48:11.302389] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-01T21:48:11.898253] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T21:48:12.102386] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-01T21:48:12.361323] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T21:48:12.364637] [INFO ] [REMOTE ] SXC: Full fetch complete (61187 records). [2025-10-01T21:48:12.364803] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-01T21:48:12.819538] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-01T21:48:12.819638] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-01T21:48:12.820904] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-01T21:48:12.820976] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-01T21:48:12.822303] [DEBUG] [LOCAL ] SXC: Trimmed 61187 records to 41433 (keeping 200 days of data) [2025-10-01T21:48:12.929165] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-01T21:48:13.104325] [DEBUG] [LOCAL ] SXC: Primary data saved (41433 records). [2025-10-01T21:48:13.104458] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-01T21:48:13.104552] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXC took 34.5s. Estimated remaining: 47m 5s. Rate: 7.1 symbols/min [2025-10-01T21:48:13.208183] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T21:48:13.210069] [INFO ] [REMOTE ] SWK: Full fetch complete (75340 records). [2025-10-01T21:48:13.210178] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-01T21:48:13.637227] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-01T21:48:13.637322] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-01T21:48:13.638489] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-01T21:48:13.638560] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-01T21:48:13.640243] [DEBUG] [LOCAL ] SWK: Trimmed 75340 records to 52406 (keeping 200 days of data) [2025-10-01T21:48:13.992227] [DEBUG] [LOCAL ] SWK: Primary data saved (52406 records). [2025-10-01T21:48:13.992378] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-01T21:48:13.992484] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SWK took 59.1s. Estimated remaining: 46m 55s. Rate: 7.1 symbols/min [2025-10-01T21:48:14.390098] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T21:48:14.398922] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-01T21:48:15.685784] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T21:48:15.692366] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-01T21:48:17.094981] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T21:48:17.102483] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-01T21:48:17.890302] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-01T21:48:17.891848] [INFO ] [REMOTE ] SXT: Full fetch complete (38362 records). [2025-10-01T21:48:17.891961] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-01T21:48:18.427348] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-01T21:48:18.427443] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-01T21:48:18.428459] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-01T21:48:18.428534] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-01T21:48:18.429904] [DEBUG] [LOCAL ] SXT: Trimmed 38362 records to 29411 (keeping 200 days of data) [2025-10-01T21:48:18.669684] [DEBUG] [LOCAL ] SXT: Primary data saved (29411 records). [2025-10-01T21:48:18.669890] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-01T21:48:18.670050] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SXT took 22.0s. Estimated remaining: 46m 46s. Rate: 7.1 symbols/min [2025-10-01T21:48:19.486557] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:19.693811] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:19.697516] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:19.648421] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:19.763710] [DEBUG] [LOCAL ] SYY: Loaded 53220 existing records from primary storage. [2025-10-01T21:48:19.764329] [INFO ] [MAIN ] SYY: Loaded 53220 existing records. [2025-10-01T21:48:19.957375] [DEBUG] [LOCAL ] SYK: Loaded 46866 existing records from primary storage. [2025-10-01T21:48:20.005898] [INFO ] [MAIN ] SYK: Loaded 46866 existing records. [2025-10-01T21:48:20.014121] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-01T21:48:20.026426] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-01T21:48:20.007303] [DEBUG] [LOCAL ] SYF: Loaded 53442 existing records from primary storage. [2025-10-01T21:48:20.109136] [INFO ] [MAIN ] SYF: Loaded 53442 existing records. [2025-10-01T21:48:20.154723] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:20.287431] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-01T21:48:20.315164] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-01T21:48:20.349997] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-01T21:48:20.409299] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-01T21:48:20.711937] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:20.771137] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:20.766466] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:20.787035] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-01T21:48:20.793708] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-01T21:48:20.798938] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-01T21:48:20.799039] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-01T21:48:20.799467] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-01T21:48:20.805328] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-01T21:48:20.810684] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-01T21:48:20.810579] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-01T21:48:20.858164] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-01T21:48:20.870296] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-01T21:48:20.950198] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-01T21:48:20.970707] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-01T21:48:22.058214] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:22.199365] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-01T21:48:22.449882] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:22.469387] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:22.475001] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-01T21:48:22.475344] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-01T21:48:22.517578] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:22.518800] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-01T21:48:24.083936] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T21:48:24.096479] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-01T21:48:24.139969] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T21:48:24.152870] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-01T21:48:24.186094] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T21:48:24.196592] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-01T21:48:25.170937] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-01T21:48:25.183174] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-01T21:48:25.814741] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T21:48:25.825548] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-01T21:48:25.925570] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T21:48:25.936319] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-01T21:48:26.033491] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T21:48:26.044078] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-01T21:48:27.465433] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T21:48:27.475675] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-01T21:48:27.540621] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:48:27.552374] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-01T21:48:27.584967] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-01T21:48:27.597030] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-01T21:48:27.683321] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T21:48:27.694386] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-01T21:48:29.450181] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-01T21:48:29.462041] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-01T21:48:29.747537] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-01T21:48:29.759611] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-01T21:48:29.851056] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-01T21:48:29.862829] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-01T21:48:29.940583] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-01T21:48:30.502445] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-01T21:48:31.324586] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T21:48:31.335938] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-01T21:48:31.434337] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-01T21:48:31.517707] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T21:48:32.102399] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-01T21:48:32.828187] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T21:48:32.911272] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-01T21:48:32.917575] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-01T21:48:33.446690] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T21:48:33.702473] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-01T21:48:34.502440] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-01T21:48:34.859996] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T21:48:35.302381] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-01T21:48:35.430718] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T21:48:36.102387] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-01T21:48:36.733227] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-01T21:48:36.785195] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T21:48:36.902452] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-01T21:48:37.672389] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T21:48:37.702358] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-01T21:48:38.502544] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-01T21:48:39.012091] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-01T21:48:39.302444] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-01T21:48:39.508981] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T21:48:40.102437] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-01T21:48:40.697033] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-01T21:48:40.902527] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-01T21:48:41.308665] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T21:48:41.367333] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T21:48:41.640464] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T21:48:41.702372] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-01T21:48:42.502426] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-01T21:48:43.302472] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-01T21:48:43.833027] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-01T21:48:44.102463] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-01T21:48:44.297343] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T21:48:44.313990] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-01T21:48:44.316425] [INFO ] [REMOTE ] SYK: Full fetch complete (68829 records). [2025-10-01T21:48:44.316587] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-01T21:48:44.735420] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-01T21:48:44.735546] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-01T21:48:44.737102] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-01T21:48:44.737173] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-01T21:48:44.739734] [DEBUG] [LOCAL ] SYK: Trimmed 68829 records to 46895 (keeping 200 days of data) [2025-10-01T21:48:44.945209] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-01T21:48:45.080709] [DEBUG] [LOCAL ] SYK: Primary data saved (46895 records). [2025-10-01T21:48:45.080923] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-01T21:48:45.082952] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. SYK took 26.4s. Estimated remaining: 46m 41s. Rate: 7.1 symbols/min [2025-10-01T21:48:45.256258] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:45.309040] [DEBUG] [LOCAL ] TAC: Loaded 42538 existing records from primary storage. [2025-10-01T21:48:45.309446] [INFO ] [MAIN ] TAC: Loaded 42538 existing records. [2025-10-01T21:48:45.505845] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:45.506369] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-01T21:48:45.506509] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-01T21:48:45.507827] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-01T21:48:45.507895] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-01T21:48:45.709599] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-01T21:48:45.930867] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:45.971095] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-01T21:48:46.346551] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T21:48:46.502385] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-01T21:48:46.560842] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T21:48:47.302416] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-01T21:48:48.102487] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-01T21:48:48.382409] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T21:48:48.385561] [INFO ] [REMOTE ] SYY: Full fetch complete (76963 records). [2025-10-01T21:48:48.385843] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-01T21:48:48.814199] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-01T21:48:48.814496] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-01T21:48:48.816321] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-01T21:48:48.816437] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-01T21:48:48.819072] [DEBUG] [LOCAL ] SYY: Trimmed 76963 records to 53221 (keeping 200 days of data) [2025-10-01T21:48:48.905355] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-01T21:48:48.961832] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-01T21:48:49.157156] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-01T21:48:49.291831] [DEBUG] [LOCAL ] SYY: Primary data saved (53221 records). [2025-10-01T21:48:49.292058] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-01T21:48:49.292173] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYY took 30.6s. Estimated remaining: 46m 31s. Rate: 7.1 symbols/min [2025-10-01T21:48:49.488580] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:49.541936] [DEBUG] [LOCAL ] TAK: Loaded 49806 existing records from primary storage. [2025-10-01T21:48:49.542271] [INFO ] [MAIN ] TAK: Loaded 49806 existing records. [2025-10-01T21:48:49.707502] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-01T21:48:49.752237] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:49.754184] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-01T21:48:49.754264] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-01T21:48:49.755377] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-01T21:48:49.755479] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-01T21:48:50.156033] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:50.502397] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-01T21:48:50.544058] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T21:48:51.042283] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-01T21:48:51.044284] [INFO ] [REMOTE ] SYF: Full fetch complete (77327 records). [2025-10-01T21:48:51.044419] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-01T21:48:51.307693] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-01T21:48:51.465509] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-01T21:48:51.465633] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-01T21:48:51.467529] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-01T21:48:51.467601] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-01T21:48:51.469800] [DEBUG] [LOCAL ] SYF: Trimmed 77327 records to 53442 (keeping 200 days of data) [2025-10-01T21:48:51.837034] [DEBUG] [LOCAL ] SYF: Primary data saved (53442 records). [2025-10-01T21:48:51.837251] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-01T21:48:51.837367] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. SYF took 33.2s. Estimated remaining: 46m 22s. Rate: 7.1 symbols/min [2025-10-01T21:48:52.045793] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:52.101116] [DEBUG] [LOCAL ] TAL: Loaded 51976 existing records from primary storage. [2025-10-01T21:48:52.101513] [INFO ] [MAIN ] TAL: Loaded 51976 existing records. [2025-10-01T21:48:52.135597] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-01T21:48:52.302623] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:52.303162] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-01T21:48:52.303341] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-01T21:48:52.315974] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-01T21:48:52.321231] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-01T21:48:52.397051] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T21:48:52.758497] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:52.902359] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-01T21:48:53.083019] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T21:48:53.193105] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T21:48:53.702442] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-01T21:48:54.502378] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-01T21:48:54.576245] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T21:48:54.791792] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T21:48:54.793755] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-01T21:48:54.793874] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-01T21:48:55.225969] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-01T21:48:55.226102] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-01T21:48:55.227682] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-01T21:48:55.227755] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-01T21:48:55.229527] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-10-01T21:48:55.320140] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-01T21:48:55.373937] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:48:55.617489] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-01T21:48:55.617667] [INFO ] [MAIN ] T: Full history saved. [2025-10-01T21:48:55.617792] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. T took 36.9s. Estimated remaining: 46m 13s. Rate: 7.1 symbols/min [2025-10-01T21:48:55.802432] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:48:55.851011] [DEBUG] [LOCAL ] TALO: Loaded 50785 existing records from primary storage. [2025-10-01T21:48:55.851394] [INFO ] [MAIN ] TALO: Loaded 50785 existing records. [2025-10-01T21:48:56.038163] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:48:56.038412] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-01T21:48:56.038460] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-01T21:48:56.039467] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-01T21:48:56.039529] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-01T21:48:56.112025] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-01T21:48:56.432176] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:48:56.567372] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T21:48:56.902381] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-01T21:48:57.645938] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T21:48:57.702361] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-01T21:48:58.502416] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-01T21:48:58.549066] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T21:48:59.276873] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T21:48:59.302346] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-01T21:48:59.857092] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T21:49:00.102411] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-01T21:49:00.902413] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-01T21:49:01.035364] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T21:49:01.640806] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T21:49:01.702395] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-01T21:49:02.502389] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-01T21:49:02.550406] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T21:49:03.031013] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T21:49:03.302366] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-01T21:49:03.940734] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T21:49:04.102416] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-01T21:49:04.902350] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-01T21:49:05.019554] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:49:05.576021] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T21:49:05.702397] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-01T21:49:06.502374] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-01T21:49:06.825083] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T21:49:07.302355] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-01T21:49:07.510979] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T21:49:07.731266] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T21:49:08.102403] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-01T21:49:08.902400] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-01T21:49:08.969700] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T21:49:09.702354] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-01T21:49:09.886578] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T21:49:10.502451] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-01T21:49:10.821590] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T21:49:10.990218] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T21:49:11.302480] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-01T21:49:12.092696] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T21:49:12.103054] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-01T21:49:12.902417] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-01T21:49:13.116670] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T21:49:13.702380] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-01T21:49:13.757748] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T21:49:14.346732] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T21:49:14.502390] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-01T21:49:15.302377] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-01T21:49:15.379675] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T21:49:15.778047] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T21:49:16.102391] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-01T21:49:16.902358] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-01T21:49:17.063317] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T21:49:17.541120] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T21:49:17.702413] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-01T21:49:17.806869] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-01T21:49:17.810203] [INFO ] [REMOTE ] TAC: Full fetch complete (63921 records). [2025-10-01T21:49:17.810366] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-01T21:49:18.231870] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-01T21:49:18.232002] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-01T21:49:18.233005] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-01T21:49:18.233069] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-01T21:49:18.234544] [DEBUG] [LOCAL ] TAC: Trimmed 63921 records to 42555 (keeping 200 days of data) [2025-10-01T21:49:18.502402] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-01T21:49:18.519582] [DEBUG] [LOCAL ] TAC: Primary data saved (42555 records). [2025-10-01T21:49:18.519754] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-01T21:49:18.519861] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAC took 33.4s. Estimated remaining: 46m 7s. Rate: 7.1 symbols/min [2025-10-01T21:49:18.702167] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:49:18.752527] [DEBUG] [LOCAL ] TAP: Loaded 52878 existing records from primary storage. [2025-10-01T21:49:18.752878] [INFO ] [MAIN ] TAP: Loaded 52878 existing records. [2025-10-01T21:49:18.938988] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:49:18.939230] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-01T21:49:18.939281] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-01T21:49:18.940399] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-01T21:49:18.940463] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-01T21:49:19.326453] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-01T21:49:19.334168] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:49:19.495502] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-01T21:49:20.102375] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-01T21:49:20.329289] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T21:49:20.902386] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-01T21:49:21.252172] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T21:49:21.543183] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T21:49:21.702365] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-01T21:49:22.512624] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-01T21:49:22.519394] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T21:49:23.207542] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T21:49:23.302371] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-01T21:49:24.030960] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T21:49:24.102353] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-01T21:49:24.902401] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-01T21:49:25.040075] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-01T21:49:25.702432] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-01T21:49:25.950067] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-01T21:49:26.297142] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T21:49:26.502405] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-01T21:49:26.694369] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-01T21:49:26.696362] [INFO ] [REMOTE ] TAK: Full fetch complete (71568 records). [2025-10-01T21:49:26.696471] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-01T21:49:27.122785] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-01T21:49:27.122868] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-01T21:49:27.123930] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-01T21:49:27.124025] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-01T21:49:27.125946] [DEBUG] [LOCAL ] TAK: Trimmed 71568 records to 49821 (keeping 200 days of data) [2025-10-01T21:49:27.304319] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-01T21:49:27.439267] [DEBUG] [LOCAL ] TAK: Primary data saved (49821 records). [2025-10-01T21:49:27.439446] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-01T21:49:27.439723] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAK took 38.1s. Estimated remaining: 45m 58s. Rate: 7.1 symbols/min [2025-10-01T21:49:27.635845] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:49:27.650158] [DEBUG] [LOCAL ] TBB: Loaded 11735 existing records from primary storage. [2025-10-01T21:49:27.650453] [INFO ] [MAIN ] TBB: Loaded 11735 existing records. [2025-10-01T21:49:27.864991] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:49:27.865298] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-01T21:49:27.865349] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-01T21:49:27.865840] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-01T21:49:27.865912] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-01T21:49:28.107219] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-01T21:49:28.294540] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:49:28.324537] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T21:49:28.364419] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T21:49:28.365985] [INFO ] [REMOTE ] TAL: Full fetch complete (75559 records). [2025-10-01T21:49:28.366098] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-01T21:49:28.801266] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-01T21:49:28.801357] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-01T21:49:28.802527] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-01T21:49:28.802596] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-01T21:49:28.804218] [DEBUG] [LOCAL ] TAL: Trimmed 75559 records to 51940 (keeping 200 days of data) [2025-10-01T21:49:28.905851] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-01T21:49:29.142837] [DEBUG] [LOCAL ] TAL: Primary data saved (51940 records). [2025-10-01T21:49:29.142991] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-01T21:49:29.143111] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAL took 37.3s. Estimated remaining: 45m 49s. Rate: 7.1 symbols/min [2025-10-01T21:49:29.328911] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:49:29.332733] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-01T21:49:29.338391] [INFO ] [REMOTE ] TALO: Full fetch complete (73296 records). [2025-10-01T21:49:29.338548] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-01T21:49:29.541020] [DEBUG] [LOCAL ] TBBB: Loaded 35601 existing records from primary storage. [2025-10-01T21:49:29.583594] [INFO ] [MAIN ] TBBB: Loaded 35601 existing records. [2025-10-01T21:49:29.719113] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-01T21:49:30.004068] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-01T21:49:30.004177] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-01T21:49:30.005432] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-01T21:49:30.005519] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-01T21:49:30.003870] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:49:30.005822] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-01T21:49:30.005879] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-01T21:49:30.006706] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-01T21:49:30.006887] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-01T21:49:30.012238] [DEBUG] [LOCAL ] TALO: Trimmed 73296 records to 50794 (keeping 200 days of data) [2025-10-01T21:49:30.511328] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:49:30.512735] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-01T21:49:30.719176] [DEBUG] [LOCAL ] TALO: Primary data saved (50794 records). [2025-10-01T21:49:30.719363] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-01T21:49:30.719554] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TALO took 35.1s. Estimated remaining: 45m 39s. Rate: 7.1 symbols/min [2025-10-01T21:49:30.916959] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:49:30.953347] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T21:49:30.980761] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T21:49:31.003602] [DEBUG] [LOCAL ] TBI: Loaded 22555 existing records from primary storage. [2025-10-01T21:49:31.004012] [INFO ] [MAIN ] TBI: Loaded 22555 existing records. [2025-10-01T21:49:31.277233] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:49:31.277465] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-01T21:49:31.277515] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-01T21:49:31.278218] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-01T21:49:31.278284] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-01T21:49:31.311094] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-01T21:49:31.686859] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:49:31.820516] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T21:49:32.102403] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-01T21:49:32.902361] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-01T21:49:32.994994] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-01T21:49:33.316849] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T21:49:33.702402] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-01T21:49:34.052346] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:49:34.502373] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-01T21:49:34.687539] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T21:49:35.302402] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-01T21:49:35.995495] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T21:49:36.102347] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-01T21:49:36.266273] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-01T21:49:36.902389] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-01T21:49:37.702372] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-01T21:49:37.881527] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T21:49:37.929705] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-01T21:49:38.449211] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T21:49:38.502398] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-01T21:49:39.302404] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-01T21:49:39.967144] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-01T21:49:40.067569] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T21:49:40.102384] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-01T21:49:40.902379] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-01T21:49:41.310474] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T21:49:41.702465] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-01T21:49:41.850718] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-01T21:49:42.502430] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-01T21:49:43.302364] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-01T21:49:43.393894] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T21:49:43.447709] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T21:49:44.102388] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-01T21:49:44.242115] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T21:49:44.902383] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-01T21:49:45.702371] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-01T21:49:45.782359] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-01T21:49:45.970108] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T21:49:46.502358] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-01T21:49:46.928861] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-01T21:49:47.053840] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-01T21:49:47.302407] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-01T21:49:48.102398] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-01T21:49:48.806547] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T21:49:48.902377] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-01T21:49:49.702370] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-01T21:49:49.851345] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-01T21:49:50.119348] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T21:49:50.502372] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-01T21:49:50.572728] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-01T21:49:51.302397] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-01T21:49:52.102353] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-01T21:49:52.314349] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T21:49:52.536057] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T21:49:52.902386] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-01T21:49:53.500055] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T21:49:53.702374] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-01T21:49:53.826296] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-01T21:49:54.502397] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-01T21:49:55.110016] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T21:49:55.309505] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-01T21:49:55.312885] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-01T21:49:56.102430] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-01T21:49:56.621819] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T21:49:56.623765] [INFO ] [REMOTE ] TAP: Full fetch complete (76160 records). [2025-10-01T21:49:56.623924] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-01T21:49:56.859218] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T21:49:56.905996] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-01T21:49:57.076488] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-01T21:49:57.076577] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-01T21:49:57.077801] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-01T21:49:57.077868] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-01T21:49:57.079556] [DEBUG] [LOCAL ] TAP: Trimmed 76160 records to 52899 (keeping 200 days of data) [2025-10-01T21:49:57.418602] [DEBUG] [LOCAL ] TAP: Primary data saved (52899 records). [2025-10-01T21:49:57.418782] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-01T21:49:57.418890] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TAP took 38.9s. Estimated remaining: 45m 33s. Rate: 7.1 symbols/min [2025-10-01T21:49:57.604959] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:49:57.605153] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-01T21:49:57.605193] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-01T21:49:57.605309] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-01T21:49:57.605405] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-01T21:49:57.605473] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-01T21:49:57.605510] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-01T21:49:57.707469] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-01T21:49:58.001814] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:49:58.052590] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T21:49:58.502386] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-01T21:49:58.673826] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T21:49:58.675258] [INFO ] [REMOTE ] TBBB: Full fetch complete (51270 records). [2025-10-01T21:49:58.675364] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-01T21:49:59.082028] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-01T21:49:59.082110] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-01T21:49:59.083014] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-01T21:49:59.083078] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-01T21:49:59.084190] [DEBUG] [LOCAL ] TBBB: Trimmed 51270 records to 35666 (keeping 200 days of data) [2025-10-01T21:49:59.300061] [DEBUG] [LOCAL ] TBBB: Primary data saved (35666 records). [2025-10-01T21:49:59.300267] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-01T21:49:59.300394] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBBB took 30.2s. Estimated remaining: 45m 24s. Rate: 7.1 symbols/min [2025-10-01T21:49:59.305874] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-01T21:49:59.482052] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T21:49:59.508531] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:49:59.513920] [DEBUG] [LOCAL ] TBN: Loaded 3242 existing records from primary storage. [2025-10-01T21:49:59.514108] [INFO ] [MAIN ] TBN: Loaded 3242 existing records. [2025-10-01T21:49:59.716501] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:49:59.716758] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-01T21:49:59.716811] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-01T21:49:59.717092] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-01T21:49:59.717152] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-01T21:49:59.784621] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-01T21:50:00.110323] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-01T21:50:00.117441] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:00.902360] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-01T21:50:00.979447] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T21:50:00.980589] [INFO ] [REMOTE ] TBI: Full fetch complete (31770 records). [2025-10-01T21:50:00.980700] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-01T21:50:01.408054] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-01T21:50:01.408185] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-01T21:50:01.408898] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-01T21:50:01.408962] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-01T21:50:01.409867] [DEBUG] [LOCAL ] TBI: Trimmed 31770 records to 22542 (keeping 200 days of data) [2025-10-01T21:50:01.494825] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-01T21:50:01.557758] [DEBUG] [LOCAL ] TBI: Primary data saved (22542 records). [2025-10-01T21:50:01.557896] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-01T21:50:01.557987] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 30.8s. Estimated remaining: 45m 14s. Rate: 7.1 symbols/min [2025-10-01T21:50:01.715005] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-01T21:50:01.750474] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:01.750625] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-01T21:50:01.750705] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-01T21:50:01.751103] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-01T21:50:01.751165] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-01T21:50:01.751227] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-01T21:50:01.751295] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-01T21:50:02.204962] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:02.502467] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-01T21:50:02.574526] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T21:50:02.724105] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:50:02.724543] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-01T21:50:02.727319] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:50:02.727452] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-01T21:50:02.727572] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:50:02.727716] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-01T21:50:02.727828] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-01T21:50:02.727880] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-01T21:50:02.727934] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-01T21:50:02.728031] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TCAI took 1.2s. Estimated remaining: 45m 5s. Rate: 7.1 symbols/min [2025-10-01T21:50:03.032868] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:03.107019] [DEBUG] [LOCAL ] TD: Loaded 52282 existing records from primary storage. [2025-10-01T21:50:03.107502] [INFO ] [MAIN ] TD: Loaded 52282 existing records. [2025-10-01T21:50:03.326431] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-01T21:50:03.334747] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:50:03.336457] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-01T21:50:03.336535] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-01T21:50:03.338316] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-01T21:50:03.338397] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-01T21:50:03.761703] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:03.764932] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-01T21:50:04.102386] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-01T21:50:04.902414] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-01T21:50:05.431021] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T21:50:05.431916] [INFO ] [REMOTE ] TBB: Full fetch complete (17798 records). [2025-10-01T21:50:05.431990] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-01T21:50:05.703676] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-01T21:50:05.841593] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-01T21:50:05.841826] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-01T21:50:05.842277] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-01T21:50:05.842325] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-01T21:50:05.842984] [DEBUG] [LOCAL ] TBB: Trimmed 17798 records to 11716 (keeping 200 days of data) [2025-10-01T21:50:05.920624] [DEBUG] [LOCAL ] TBB: Primary data saved (11716 records). [2025-10-01T21:50:05.920830] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-01T21:50:05.920917] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBB took 38.5s. Estimated remaining: 44m 56s. Rate: 7.1 symbols/min [2025-10-01T21:50:06.108259] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:06.145068] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T21:50:06.198873] [DEBUG] [LOCAL ] TDC: Loaded 46646 existing records from primary storage. [2025-10-01T21:50:06.199238] [INFO ] [MAIN ] TDC: Loaded 46646 existing records. [2025-10-01T21:50:06.377035] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-01T21:50:06.403002] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:50:06.405070] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-01T21:50:06.405121] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-01T21:50:06.406210] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-01T21:50:06.406272] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-01T21:50:06.507569] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-01T21:50:06.818151] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:06.926326] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T21:50:07.302394] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-01T21:50:07.909214] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T21:50:08.102394] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-01T21:50:08.432039] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-01T21:50:08.902411] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-01T21:50:09.497790] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T21:50:09.702383] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-01T21:50:10.502383] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-01T21:50:10.928384] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T21:50:10.951252] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-01T21:50:11.302389] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-01T21:50:11.627192] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-01T21:50:12.102402] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-01T21:50:12.594449] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-01T21:50:12.902381] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-01T21:50:13.258481] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-01T21:50:13.702388] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-01T21:50:13.962408] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-01T21:50:14.502387] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-01T21:50:15.302381] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-01T21:50:16.102382] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-01T21:50:16.543021] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-01T21:50:16.902386] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-01T21:50:17.345981] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-01T21:50:17.513955] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-01T21:50:17.702380] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-01T21:50:18.293997] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (3.79 seconds). [2025-10-01T21:50:18.502380] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-01T21:50:19.288219] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T21:50:19.302336] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-01T21:50:19.571159] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-01T21:50:20.102358] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-01T21:50:20.307083] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-01T21:50:20.449715] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-01T21:50:20.902383] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-01T21:50:21.702390] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-01T21:50:22.133264] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-01T21:50:22.502370] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-01T21:50:22.741709] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:50:22.764545] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-01T21:50:22.765209] [INFO ] [REMOTE ] TBLU: Full fetch complete (1175 records). [2025-10-01T21:50:22.765344] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-01T21:50:22.969787] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-01T21:50:22.970932] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-01T21:50:22.971007] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-01T21:50:22.971094] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-01T21:50:22.971197] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-01T21:50:22.971269] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-01T21:50:22.971339] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-01T21:50:22.971443] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBLU took 25.6s. Estimated remaining: 44m 48s. Rate: 7.1 symbols/min [2025-10-01T21:50:23.164683] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:23.173908] [DEBUG] [LOCAL ] TDF: Loaded 6441 existing records from primary storage. [2025-10-01T21:50:23.174107] [INFO ] [MAIN ] TDF: Loaded 6441 existing records. [2025-10-01T21:50:23.307551] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-01T21:50:23.371966] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:50:23.372317] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-01T21:50:23.372368] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-01T21:50:23.373229] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-01T21:50:23.373293] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-01T21:50:23.764118] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:24.102392] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-01T21:50:24.643323] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-01T21:50:24.902390] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-01T21:50:25.288051] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T21:50:25.638284] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T21:50:25.702397] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-01T21:50:26.360858] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T21:50:26.361947] [INFO ] [REMOTE ] TBN: Full fetch complete (5374 records). [2025-10-01T21:50:26.362021] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-01T21:50:26.507573] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-01T21:50:26.770995] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-01T21:50:26.771107] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-01T21:50:26.771294] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-01T21:50:26.771338] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-01T21:50:26.771797] [DEBUG] [LOCAL ] TBN: Trimmed 5374 records to 3526 (keeping 200 days of data) [2025-10-01T21:50:26.793830] [DEBUG] [LOCAL ] TBN: Primary data saved (3526 records). [2025-10-01T21:50:26.793961] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-01T21:50:26.794077] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TBN took 27.5s. Estimated remaining: 44m 39s. Rate: 7.1 symbols/min [2025-10-01T21:50:26.979348] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:27.009078] [DEBUG] [LOCAL ] TDG: Loaded 21923 existing records from primary storage. [2025-10-01T21:50:27.009351] [INFO ] [MAIN ] TDG: Loaded 21923 existing records. [2025-10-01T21:50:27.203326] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:50:27.203562] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-01T21:50:27.203611] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-01T21:50:27.204479] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-01T21:50:27.204542] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-01T21:50:27.309741] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-01T21:50:27.600941] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:28.102397] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-01T21:50:28.874943] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T21:50:28.902353] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-01T21:50:29.392270] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-01T21:50:29.525087] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-01T21:50:29.702377] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-01T21:50:30.014517] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T21:50:30.502426] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-01T21:50:31.240170] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T21:50:31.302369] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-01T21:50:31.543958] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T21:50:31.837911] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-01T21:50:32.102422] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-01T21:50:32.902394] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-01T21:50:33.640591] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T21:50:33.702383] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-01T21:50:34.043106] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T21:50:34.502402] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-01T21:50:35.067815] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-01T21:50:35.302401] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-01T21:50:35.330572] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-01T21:50:36.102373] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-01T21:50:36.203371] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T21:50:36.902399] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-01T21:50:37.589321] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T21:50:37.702391] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-01T21:50:38.098566] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-01T21:50:38.346835] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-01T21:50:38.502424] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-01T21:50:39.302400] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-01T21:50:39.314002] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-01T21:50:40.102384] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-01T21:50:40.756694] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T21:50:40.902384] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-01T21:50:41.702431] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-01T21:50:42.502404] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-01T21:50:42.782093] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-01T21:50:43.050396] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (2.95 seconds). [2025-10-01T21:50:43.302390] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-01T21:50:43.639556] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T21:50:43.757471] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T21:50:43.913771] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T21:50:44.102392] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-01T21:50:44.753906] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-01T21:50:44.902398] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-01T21:50:45.702365] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-01T21:50:46.477235] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T21:50:46.502357] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-01T21:50:47.302385] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-01T21:50:47.420664] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-01T21:50:47.422163] [INFO ] [REMOTE ] TDC: Full fetch complete (66929 records). [2025-10-01T21:50:47.422273] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-01T21:50:47.903625] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-01T21:50:47.904121] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-01T21:50:47.905386] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-01T21:50:47.905738] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-01T21:50:47.909317] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-01T21:50:47.924410] [DEBUG] [LOCAL ] TDC: Trimmed 66929 records to 46627 (keeping 200 days of data) [2025-10-01T21:50:48.105227] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-01T21:50:48.227279] [DEBUG] [LOCAL ] TDC: Primary data saved (46627 records). [2025-10-01T21:50:48.227431] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-01T21:50:48.227522] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDC took 42.3s. Estimated remaining: 44m 33s. Rate: 7.1 symbols/min [2025-10-01T21:50:48.447341] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:48.503304] [DEBUG] [LOCAL ] TDOC: Loaded 53344 existing records from primary storage. [2025-10-01T21:50:48.503670] [INFO ] [MAIN ] TDOC: Loaded 53344 existing records. [2025-10-01T21:50:48.704345] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:50:48.704570] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-01T21:50:48.704620] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-01T21:50:48.705744] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-01T21:50:48.705808] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-01T21:50:48.908615] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-01T21:50:49.126429] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:49.702361] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-01T21:50:49.996321] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-01T21:50:50.027340] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T21:50:50.502388] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-01T21:50:51.302402] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-01T21:50:51.492264] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (4.19 seconds). [2025-10-01T21:50:51.678247] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T21:50:52.108781] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-01T21:50:52.115941] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:50:52.359162] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T21:50:52.902451] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-01T21:50:53.702389] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-01T21:50:54.140100] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-01T21:50:54.155724] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T21:50:54.157950] [INFO ] [REMOTE ] TD: Full fetch complete (75786 records). [2025-10-01T21:50:54.158122] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-01T21:50:54.507536] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-01T21:50:54.662578] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-01T21:50:54.662703] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-01T21:50:54.664054] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-01T21:50:54.664128] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-01T21:50:54.665855] [DEBUG] [LOCAL ] TD: Trimmed 75786 records to 52278 (keeping 200 days of data) [2025-10-01T21:50:54.915455] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T21:50:55.031074] [DEBUG] [LOCAL ] TD: Primary data saved (52278 records). [2025-10-01T21:50:55.031224] [INFO ] [MAIN ] TD: Full history saved. [2025-10-01T21:50:55.031307] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TD took 52.3s. Estimated remaining: 44m 24s. Rate: 7.1 symbols/min [2025-10-01T21:50:55.226283] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:55.271271] [DEBUG] [LOCAL ] TDS: Loaded 42781 existing records from primary storage. [2025-10-01T21:50:55.271610] [INFO ] [MAIN ] TDS: Loaded 42781 existing records. [2025-10-01T21:50:55.307555] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-01T21:50:55.486974] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:50:55.487258] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-01T21:50:55.487320] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-01T21:50:55.488348] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-01T21:50:55.488463] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-01T21:50:55.832847] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-01T21:50:55.834357] [INFO ] [REMOTE ] TDF: Full fetch complete (10466 records). [2025-10-01T21:50:55.834807] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-01T21:50:56.045292] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:56.105857] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-01T21:50:56.347856] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-01T21:50:56.347940] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-01T21:50:56.348264] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-01T21:50:56.348375] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-01T21:50:56.349006] [DEBUG] [LOCAL ] TDF: Trimmed 10466 records to 6409 (keeping 200 days of data) [2025-10-01T21:50:56.392790] [DEBUG] [LOCAL ] TDF: Primary data saved (6409 records). [2025-10-01T21:50:56.392935] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-01T21:50:56.393027] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDF took 33.4s. Estimated remaining: 44m 14s. Rate: 7.1 symbols/min [2025-10-01T21:50:56.601676] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:50:56.660150] [DEBUG] [LOCAL ] TDW: Loaded 45366 existing records from primary storage. [2025-10-01T21:50:56.660475] [INFO ] [MAIN ] TDW: Loaded 45366 existing records. [2025-10-01T21:50:56.890018] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:50:56.890322] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-01T21:50:56.890397] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-01T21:50:56.891504] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-01T21:50:56.891610] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-01T21:50:56.906158] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-01T21:50:57.066881] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-01T21:50:57.362161] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:50:57.702350] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-01T21:50:57.890064] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T21:50:58.281772] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T21:50:58.502368] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-01T21:50:59.302405] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-01T21:50:59.372014] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T21:50:59.823179] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T21:51:00.102379] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-01T21:51:00.902424] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-01T21:51:01.193844] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T21:51:01.702376] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-01T21:51:01.931892] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-01T21:51:02.509614] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-01T21:51:02.530271] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T21:51:03.302381] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-01T21:51:03.414965] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-01T21:51:03.416506] [INFO ] [REMOTE ] TDG: Full fetch complete (32155 records). [2025-10-01T21:51:03.416607] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-01T21:51:03.617214] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-01T21:51:03.880419] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-01T21:51:03.880505] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-01T21:51:03.881252] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-01T21:51:03.881318] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-01T21:51:03.882491] [DEBUG] [LOCAL ] TDG: Trimmed 32155 records to 22010 (keeping 200 days of data) [2025-10-01T21:51:04.031208] [DEBUG] [LOCAL ] TDG: Primary data saved (22010 records). [2025-10-01T21:51:04.031336] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-01T21:51:04.031430] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDG took 37.2s. Estimated remaining: 44m 6s. Rate: 7.1 symbols/min [2025-10-01T21:51:04.109960] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-01T21:51:04.217530] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:51:04.241722] [DEBUG] [LOCAL ] TDY: Loaded 22582 existing records from primary storage. [2025-10-01T21:51:04.241983] [INFO ] [MAIN ] TDY: Loaded 22582 existing records. [2025-10-01T21:51:04.447898] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:51:04.448142] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-01T21:51:04.448192] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-01T21:51:04.448837] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-01T21:51:04.448910] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-01T21:51:04.853158] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:51:04.909601] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-01T21:51:04.915722] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T21:51:05.688811] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T21:51:05.702345] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-01T21:51:06.502443] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-01T21:51:06.981891] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T21:51:07.302353] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-01T21:51:07.464702] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T21:51:07.711186] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T21:51:08.102391] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-01T21:51:08.804764] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T21:51:08.902385] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-01T21:51:09.210063] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T21:51:09.702478] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-01T21:51:10.189952] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-01T21:51:10.502483] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-01T21:51:11.271205] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T21:51:11.302425] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-01T21:51:11.970235] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T21:51:12.102363] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-01T21:51:12.439607] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T21:51:12.902404] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-01T21:51:13.466731] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-01T21:51:13.702390] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-01T21:51:14.056543] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-01T21:51:14.502386] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-01T21:51:15.302378] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-01T21:51:15.367598] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T21:51:16.102391] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-01T21:51:16.852321] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-01T21:51:16.902360] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-01T21:51:16.977670] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T21:51:17.605612] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T21:51:17.702401] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-01T21:51:18.502378] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-01T21:51:18.646902] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T21:51:19.015267] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T21:51:19.302394] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-01T21:51:20.102379] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-01T21:51:20.184952] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T21:51:20.524076] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-01T21:51:20.902380] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-01T21:51:21.270162] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-01T21:51:21.702406] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-01T21:51:22.502472] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-01T21:51:22.557812] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T21:51:23.309617] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-01T21:51:23.314384] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T21:51:24.102420] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-01T21:51:24.474172] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-01T21:51:24.902367] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-01T21:51:24.979890] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T21:51:25.124064] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T21:51:25.702356] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-01T21:51:26.460078] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-01T21:51:26.462133] [INFO ] [REMOTE ] TDOC: Full fetch complete (77283 records). [2025-10-01T21:51:26.462328] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-01T21:51:26.507677] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-01T21:51:26.850867] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T21:51:26.988980] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-01T21:51:26.989102] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-01T21:51:26.990573] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-01T21:51:26.990665] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-01T21:51:26.992823] [DEBUG] [LOCAL ] TDOC: Trimmed 77283 records to 53345 (keeping 200 days of data) [2025-10-01T21:51:27.314358] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-01T21:51:27.341302] [DEBUG] [LOCAL ] TDOC: Primary data saved (53345 records). [2025-10-01T21:51:27.341506] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-01T21:51:27.341710] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDOC took 39.1s. Estimated remaining: 43m 60s. Rate: 7.1 symbols/min [2025-10-01T21:51:27.534226] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:51:27.534497] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-01T21:51:27.534537] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-01T21:51:27.534695] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-01T21:51:27.534750] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-01T21:51:27.534795] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-01T21:51:27.534830] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-01T21:51:27.905881] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:51:28.004715] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T21:51:28.005903] [INFO ] [REMOTE ] TDY: Full fetch complete (32235 records). [2025-10-01T21:51:28.005978] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-01T21:51:28.107559] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-01T21:51:28.335040] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:51:28.340057] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-01T21:51:28.340405] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:51:28.372255] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-01T21:51:28.444453] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:51:28.476264] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-01T21:51:28.477225] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-01T21:51:28.476423] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-01T21:51:28.477388] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-01T21:51:28.477513] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-01T21:51:28.482412] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-01T21:51:28.482708] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-01T21:51:28.482821] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-01T21:51:28.481287] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-01T21:51:28.483453] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TE took 1.1s. Estimated remaining: 43m 50s. Rate: 7.1 symbols/min [2025-10-01T21:51:28.543512] [DEBUG] [LOCAL ] TDY: Trimmed 32235 records to 22602 (keeping 200 days of data) [2025-10-01T21:51:28.797256] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:51:28.813588] [DEBUG] [LOCAL ] TEAF: Loaded 7566 existing records from primary storage. [2025-10-01T21:51:28.817343] [INFO ] [MAIN ] TEAF: Loaded 7566 existing records. [2025-10-01T21:51:28.907573] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-01T21:51:29.058246] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:51:29.060213] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-01T21:51:29.060966] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-01T21:51:29.062338] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-01T21:51:29.063083] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-01T21:51:29.130878] [DEBUG] [LOCAL ] TDY: Primary data saved (22602 records). [2025-10-01T21:51:29.146715] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-01T21:51:29.158487] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDY took 25.1s. Estimated remaining: 43m 40s. Rate: 7.1 symbols/min [2025-10-01T21:51:29.524017] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:51:29.677518] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:51:29.702355] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-01T21:51:29.723579] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-10-01T21:51:29.724078] [INFO ] [MAIN ] TECK: Loaded 53436 existing records. [2025-10-01T21:51:29.914108] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:51:29.914406] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-01T21:51:29.914461] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-01T21:51:29.915929] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-01T21:51:29.915995] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-01T21:51:30.314723] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:51:30.369798] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T21:51:30.502381] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-01T21:51:30.588416] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T21:51:31.156263] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T21:51:31.302442] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-01T21:51:32.102417] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-01T21:51:32.269633] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T21:51:32.271633] [INFO ] [REMOTE ] TDS: Full fetch complete (61691 records). [2025-10-01T21:51:32.271773] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-01T21:51:32.699940] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-01T21:51:32.700026] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-01T21:51:32.701150] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-01T21:51:32.701250] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-01T21:51:32.702833] [DEBUG] [LOCAL ] TDS: Trimmed 61691 records to 42745 (keeping 200 days of data) [2025-10-01T21:51:32.925244] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-01T21:51:32.983903] [DEBUG] [LOCAL ] TDS: Primary data saved (42745 records). [2025-10-01T21:51:32.984050] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-01T21:51:32.984166] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TDS took 38.0s. Estimated remaining: 43m 31s. Rate: 7.1 symbols/min [2025-10-01T21:51:33.167843] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:51:33.205726] [DEBUG] [LOCAL ] TEF: Loaded 37336 existing records from primary storage. [2025-10-01T21:51:33.206038] [INFO ] [MAIN ] TEF: Loaded 37336 existing records. [2025-10-01T21:51:33.419562] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:51:33.419788] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-01T21:51:33.419837] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-01T21:51:33.420696] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-01T21:51:33.420757] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-01T21:51:33.703305] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-01T21:51:33.836961] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:51:33.873134] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-01T21:51:34.097952] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T21:51:34.099548] [INFO ] [REMOTE ] TDW: Full fetch complete (67098 records). [2025-10-01T21:51:34.099672] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-01T21:51:34.430185] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-01T21:51:34.506330] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-01T21:51:34.555614] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-01T21:51:34.555826] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-01T21:51:34.557024] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-01T21:51:34.557124] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-01T21:51:34.558603] [DEBUG] [LOCAL ] TDW: Trimmed 67098 records to 45292 (keeping 200 days of data) [2025-10-01T21:51:34.837414] [DEBUG] [LOCAL ] TDW: Primary data saved (45292 records). [2025-10-01T21:51:34.837548] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-01T21:51:34.837669] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TDW took 38.4s. Estimated remaining: 43m 22s. Rate: 7.1 symbols/min [2025-10-01T21:51:35.016834] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:51:35.037804] [DEBUG] [LOCAL ] TEI: Loaded 20995 existing records from primary storage. [2025-10-01T21:51:35.038107] [INFO ] [MAIN ] TEI: Loaded 20995 existing records. [2025-10-01T21:51:35.234033] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:51:35.234289] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-01T21:51:35.234339] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-01T21:51:35.234930] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-01T21:51:35.234994] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-01T21:51:35.312080] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-01T21:51:35.645781] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:51:36.102380] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-01T21:51:36.274972] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-01T21:51:36.362325] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T21:51:36.902372] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-01T21:51:37.217327] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T21:51:37.632163] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T21:51:37.702427] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-01T21:51:38.502390] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-01T21:51:39.302405] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-01T21:51:39.455611] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-01T21:51:39.950012] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T21:51:40.102380] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-01T21:51:40.354439] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T21:51:40.902396] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-01T21:51:41.702369] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-01T21:51:41.997836] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T21:51:42.342567] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T21:51:42.502413] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-01T21:51:43.038118] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-01T21:51:43.158181] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (3.06 seconds). [2025-10-01T21:51:43.302395] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-01T21:51:43.827967] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-01T21:51:44.102396] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-01T21:51:44.902368] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-01T21:51:45.195020] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T21:51:45.380918] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-01T21:51:45.702398] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-01T21:51:46.502389] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-01T21:51:47.248928] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T21:51:47.302450] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-01T21:51:47.484336] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T21:51:48.102370] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-01T21:51:48.174860] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-01T21:51:48.575127] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-01T21:51:48.576092] [INFO ] [REMOTE ] TEAF: Full fetch complete (10056 records). [2025-10-01T21:51:48.576166] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-01T21:51:48.907612] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-01T21:51:48.996333] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-01T21:51:48.996427] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-01T21:51:48.996732] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-01T21:51:48.996795] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-01T21:51:48.997316] [DEBUG] [LOCAL ] TEAF: Trimmed 10056 records to 7618 (keeping 200 days of data) [2025-10-01T21:51:49.046693] [DEBUG] [LOCAL ] TEAF: Primary data saved (7618 records). [2025-10-01T21:51:49.046856] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-01T21:51:49.047017] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEAF took 20.6s. Estimated remaining: 43m 14s. Rate: 7.1 symbols/min [2025-10-01T21:51:49.233525] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:51:49.291455] [DEBUG] [LOCAL ] TEL: Loaded 51113 existing records from primary storage. [2025-10-01T21:51:49.291858] [INFO ] [MAIN ] TEL: Loaded 51113 existing records. [2025-10-01T21:51:49.492536] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:51:49.492928] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-01T21:51:49.493008] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-01T21:51:49.496935] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-01T21:51:49.497026] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-01T21:51:49.708944] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-01T21:51:49.901263] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:51:50.046540] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T21:51:50.502427] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-01T21:51:51.302382] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-01T21:51:51.705872] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-01T21:51:51.944282] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T21:51:52.102426] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-01T21:51:52.902346] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-01T21:51:53.115582] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T21:51:53.539946] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-01T21:51:53.702470] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-01T21:51:54.502355] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-01T21:51:54.609213] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T21:51:55.302400] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-01T21:51:55.368679] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T21:51:56.102378] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-01T21:51:56.390618] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-01T21:51:56.902390] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-01T21:51:57.155796] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T21:51:57.352224] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T21:51:57.702390] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-01T21:51:58.194457] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T21:51:58.502419] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-01T21:51:59.302367] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-01T21:51:59.512853] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T21:51:59.512038] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-01T21:52:00.102426] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-01T21:52:00.902418] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-01T21:52:01.192748] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-01T21:52:01.702402] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-01T21:52:01.743309] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T21:52:02.123782] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-01T21:52:02.502523] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-01T21:52:03.302486] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-01T21:52:03.452934] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T21:52:03.846392] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-01T21:52:04.102405] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-01T21:52:04.780372] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T21:52:04.843955] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T21:52:04.902381] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-01T21:52:05.702389] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-01T21:52:05.812388] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-01T21:52:05.813490] [INFO ] [REMOTE ] TEI: Full fetch complete (30425 records). [2025-10-01T21:52:05.813569] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-01T21:52:06.241927] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-01T21:52:06.242014] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-01T21:52:06.242788] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-01T21:52:06.242856] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-01T21:52:06.243679] [DEBUG] [LOCAL ] TEI: Trimmed 30425 records to 21097 (keeping 200 days of data) [2025-10-01T21:52:06.371154] [DEBUG] [LOCAL ] TEI: Primary data saved (21097 records). [2025-10-01T21:52:06.371283] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-01T21:52:06.371390] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEI took 31.5s. Estimated remaining: 43m 7s. Rate: 7.1 symbols/min [2025-10-01T21:52:06.507516] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-01T21:52:06.582223] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:52:06.614937] [DEBUG] [LOCAL ] TEN: Loaded 30736 existing records from primary storage. [2025-10-01T21:52:06.615224] [INFO ] [MAIN ] TEN: Loaded 30736 existing records. [2025-10-01T21:52:06.820149] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:52:06.820371] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-01T21:52:06.820422] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-01T21:52:06.821221] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-01T21:52:06.821294] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-01T21:52:07.237017] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:52:07.302395] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-01T21:52:07.551264] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T21:52:07.750510] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-01T21:52:07.752102] [INFO ] [REMOTE ] TECK: Full fetch complete (77308 records). [2025-10-01T21:52:07.752210] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-01T21:52:08.107524] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-01T21:52:08.193600] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-01T21:52:08.193714] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-01T21:52:08.194815] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-01T21:52:08.194880] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-01T21:52:08.196494] [DEBUG] [LOCAL ] TECK: Trimmed 77308 records to 53432 (keeping 200 days of data) [2025-10-01T21:52:08.453239] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T21:52:08.583454] [DEBUG] [LOCAL ] TECK: Primary data saved (53432 records). [2025-10-01T21:52:08.583611] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-01T21:52:08.583790] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TECK took 39.4s. Estimated remaining: 42m 57s. Rate: 7.1 symbols/min [2025-10-01T21:52:08.802507] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:52:08.825319] [DEBUG] [LOCAL ] TEO: Loaded 22085 existing records from primary storage. [2025-10-01T21:52:08.825591] [INFO ] [MAIN ] TEO: Loaded 22085 existing records. [2025-10-01T21:52:08.907499] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-01T21:52:09.022436] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:52:09.022691] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-01T21:52:09.022763] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-01T21:52:09.023297] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-01T21:52:09.023396] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-01T21:52:09.434721] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:52:09.702406] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-01T21:52:09.902971] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T21:52:09.963574] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T21:52:10.502389] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-01T21:52:10.794267] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T21:52:11.302388] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-01T21:52:12.102418] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-01T21:52:12.496063] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T21:52:12.700440] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T21:52:12.902377] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-01T21:52:13.702398] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-01T21:52:13.988599] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T21:52:14.204830] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T21:52:14.502402] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-01T21:52:14.707060] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T21:52:15.302384] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-01T21:52:15.517410] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T21:52:15.519032] [INFO ] [REMOTE ] TEF: Full fetch complete (54748 records). [2025-10-01T21:52:15.519131] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-01T21:52:15.954285] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-01T21:52:15.954385] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-01T21:52:15.955494] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-01T21:52:15.955563] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-01T21:52:15.956885] [DEBUG] [LOCAL ] TEF: Trimmed 54748 records to 37342 (keeping 200 days of data) [2025-10-01T21:52:16.123708] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-01T21:52:16.177043] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T21:52:16.208150] [DEBUG] [LOCAL ] TEF: Primary data saved (37342 records). [2025-10-01T21:52:16.208292] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-01T21:52:16.208391] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEF took 43.2s. Estimated remaining: 42m 49s. Rate: 7.1 symbols/min [2025-10-01T21:52:16.398713] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:52:16.456091] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-10-01T21:52:16.456576] [INFO ] [MAIN ] TEVA: Loaded 53632 existing records. [2025-10-01T21:52:16.659089] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:52:16.659326] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-01T21:52:16.659377] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-01T21:52:16.660772] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-01T21:52:16.660837] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-01T21:52:16.907477] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-01T21:52:17.063855] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:52:17.702405] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-01T21:52:17.890314] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T21:52:18.255270] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T21:52:18.366351] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T21:52:18.502407] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-01T21:52:19.302378] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-01T21:52:19.689496] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T21:52:20.102337] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-01T21:52:20.213318] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T21:52:20.902423] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-01T21:52:21.188845] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T21:52:21.702394] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-01T21:52:22.385766] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T21:52:22.502390] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-01T21:52:23.160296] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T21:52:23.302418] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-01T21:52:23.516610] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T21:52:24.102443] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-01T21:52:24.389834] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T21:52:24.391764] [INFO ] [REMOTE ] TEL: Full fetch complete (73404 records). [2025-10-01T21:52:24.391919] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-01T21:52:24.793413] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-01T21:52:24.793525] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-01T21:52:24.795252] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-01T21:52:24.795322] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-01T21:52:24.797313] [DEBUG] [LOCAL ] TEL: Trimmed 73404 records to 51107 (keeping 200 days of data) [2025-10-01T21:52:24.906454] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-01T21:52:25.168414] [DEBUG] [LOCAL ] TEL: Primary data saved (51107 records). [2025-10-01T21:52:25.168588] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-01T21:52:25.168730] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEL took 36.1s. Estimated remaining: 42m 40s. Rate: 7.1 symbols/min [2025-10-01T21:52:25.413596] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:52:25.417965] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T21:52:25.476246] [DEBUG] [LOCAL ] TEX: Loaded 44264 existing records from primary storage. [2025-10-01T21:52:25.476605] [INFO ] [MAIN ] TEX: Loaded 44264 existing records. [2025-10-01T21:52:25.670701] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:52:25.670995] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-01T21:52:25.671057] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-01T21:52:25.672312] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-01T21:52:25.672374] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-01T21:52:25.707573] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-01T21:52:26.068817] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-01T21:52:26.098603] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:52:26.502381] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-01T21:52:27.081039] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T21:52:27.302397] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-01T21:52:27.808209] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T21:52:28.102428] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-01T21:52:28.810965] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T21:52:28.902423] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-01T21:52:29.609146] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T21:52:29.702386] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-01T21:52:29.918587] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-01T21:52:30.502399] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-01T21:52:31.302373] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-01T21:52:31.317891] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T21:52:31.758268] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-01T21:52:32.102398] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-01T21:52:32.742009] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T21:52:32.902348] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-01T21:52:33.371851] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-01T21:52:33.702423] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-01T21:52:34.248578] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-01T21:52:34.503604] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-01T21:52:34.503874] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-01T21:52:34.505819] [INFO ] [REMOTE ] TEO: Full fetch complete (32738 records). [2025-10-01T21:52:34.505932] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-01T21:52:34.914595] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-01T21:52:34.914712] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-01T21:52:34.915486] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-01T21:52:34.915573] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-01T21:52:34.916542] [DEBUG] [LOCAL ] TEO: Trimmed 32738 records to 22070 (keeping 200 days of data) [2025-10-01T21:52:35.048927] [DEBUG] [LOCAL ] TEO: Primary data saved (22070 records). [2025-10-01T21:52:35.049056] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-01T21:52:35.049166] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEO took 26.5s. Estimated remaining: 42m 32s. Rate: 7.1 symbols/min [2025-10-01T21:52:35.252041] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:52:35.309334] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-01T21:52:35.312615] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-01T21:52:35.313060] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-01T21:52:35.515503] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:52:35.515784] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-01T21:52:35.515839] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-01T21:52:35.519179] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-01T21:52:35.519252] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-01T21:52:35.923752] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:52:36.102343] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-01T21:52:36.203048] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T21:52:36.902378] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-01T21:52:37.086096] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T21:52:37.689602] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T21:52:37.702337] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-01T21:52:38.502409] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-01T21:52:38.713019] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-01T21:52:38.871693] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-01T21:52:39.302394] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-01T21:52:40.103565] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T21:52:40.102513] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-01T21:52:40.118378] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T21:52:40.119715] [INFO ] [REMOTE ] TEN: Full fetch complete (44462 records). [2025-10-01T21:52:40.119818] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-01T21:52:40.543386] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-01T21:52:40.543482] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-01T21:52:40.544489] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-01T21:52:40.544563] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-01T21:52:40.545730] [DEBUG] [LOCAL ] TEN: Trimmed 44462 records to 30676 (keeping 200 days of data) [2025-10-01T21:52:40.758570] [DEBUG] [LOCAL ] TEN: Primary data saved (30676 records). [2025-10-01T21:52:40.758730] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-01T21:52:40.758845] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEN took 34.4s. Estimated remaining: 42m 23s. Rate: 7.1 symbols/min [2025-10-01T21:52:40.907514] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-01T21:52:40.965505] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:52:41.003562] [DEBUG] [LOCAL ] TFII: Loaded 33790 existing records from primary storage. [2025-10-01T21:52:41.004018] [INFO ] [MAIN ] TFII: Loaded 33790 existing records. [2025-10-01T21:52:41.202829] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:52:41.203064] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-01T21:52:41.203112] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-01T21:52:41.204012] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-01T21:52:41.204073] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-01T21:52:41.601569] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:52:41.702392] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-01T21:52:42.099278] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-01T21:52:42.502370] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-01T21:52:42.922722] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T21:52:42.998805] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T21:52:43.302395] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-01T21:52:44.102364] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-01T21:52:44.144104] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T21:52:44.457588] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T21:52:44.902391] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-01T21:52:45.702386] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-01T21:52:46.270575] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-01T21:52:46.502362] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-01T21:52:46.583007] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T21:52:47.307090] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-01T21:52:47.311613] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T21:52:48.102388] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-01T21:52:48.491441] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-01T21:52:48.902413] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-01T21:52:49.385084] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-01T21:52:49.702353] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-01T21:52:49.803031] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-01T21:52:50.310502] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-01T21:52:50.502376] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-01T21:52:51.302389] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-01T21:52:51.950568] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-01T21:52:52.078324] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T21:52:52.102340] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-01T21:52:52.902434] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-01T21:52:53.245352] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T21:52:53.518556] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T21:52:53.702389] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-01T21:52:54.502371] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-01T21:52:55.302458] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-01T21:52:55.530356] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T21:52:55.664343] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-01T21:52:56.102365] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-01T21:52:56.149170] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-01T21:52:56.453880] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T21:52:56.902379] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-01T21:52:57.582701] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T21:52:57.702410] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-01T21:52:58.010565] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T21:52:58.502411] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-01T21:52:58.521372] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T21:52:58.523381] [INFO ] [REMOTE ] TEX: Full fetch complete (64665 records). [2025-10-01T21:52:58.523526] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-01T21:52:58.962313] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-01T21:52:58.962476] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-01T21:52:58.963686] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-01T21:52:58.963753] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-01T21:52:58.965203] [DEBUG] [LOCAL ] TEX: Trimmed 64665 records to 44214 (keeping 200 days of data) [2025-10-01T21:52:59.244056] [DEBUG] [LOCAL ] TEX: Primary data saved (44214 records). [2025-10-01T21:52:59.244190] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-01T21:52:59.244296] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 34.1s. Estimated remaining: 42m 16s. Rate: 7.1 symbols/min [2025-10-01T21:52:59.310701] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-01T21:52:59.437626] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:52:59.461334] [DEBUG] [LOCAL ] TFIN: Loaded 23505 existing records from primary storage. [2025-10-01T21:52:59.461623] [INFO ] [MAIN ] TFIN: Loaded 23505 existing records. [2025-10-01T21:52:59.667669] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:52:59.667876] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-01T21:52:59.667924] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-01T21:52:59.668622] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-01T21:52:59.668716] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-01T21:53:00.054531] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:00.102407] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-01T21:53:00.769058] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-01T21:53:00.902372] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-01T21:53:01.011038] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T21:53:01.702422] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-01T21:53:01.982471] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-01T21:53:02.502382] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-01T21:53:02.520714] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-01T21:53:02.522369] [INFO ] [REMOTE ] TEVA: Full fetch complete (77697 records). [2025-10-01T21:53:02.522478] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-01T21:53:02.956733] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-01T21:53:02.956830] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-01T21:53:02.958063] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-01T21:53:02.958134] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-01T21:53:02.959722] [DEBUG] [LOCAL ] TEVA: Trimmed 77697 records to 53632 (keeping 200 days of data) [2025-10-01T21:53:03.301012] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T21:53:03.310008] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-01T21:53:03.335634] [DEBUG] [LOCAL ] TEVA: Primary data saved (53632 records). [2025-10-01T21:53:03.335843] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-01T21:53:03.335985] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEVA took 47.1s. Estimated remaining: 42m 7s. Rate: 7.1 symbols/min [2025-10-01T21:53:03.502227] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T21:53:03.558377] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:03.595843] [DEBUG] [LOCAL ] TFPM: Loaded 37785 existing records from primary storage. [2025-10-01T21:53:03.596216] [INFO ] [MAIN ] TFPM: Loaded 37785 existing records. [2025-10-01T21:53:03.799213] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:53:03.799452] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-01T21:53:03.799503] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-01T21:53:03.801241] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-01T21:53:03.801304] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-01T21:53:04.112083] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-01T21:53:04.204762] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:04.902397] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-01T21:53:05.122963] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T21:53:05.145912] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T21:53:05.702396] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-01T21:53:06.241105] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T21:53:06.502417] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-01T21:53:07.302354] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-01T21:53:07.483457] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T21:53:07.853560] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-01T21:53:08.102397] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-01T21:53:08.194785] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T21:53:08.902372] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-01T21:53:09.234545] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T21:53:09.702384] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-01T21:53:09.973681] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T21:53:10.502376] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-01T21:53:11.003337] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T21:53:11.302366] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-01T21:53:11.461756] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T21:53:12.102391] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-01T21:53:12.644154] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-01T21:53:12.902357] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-01T21:53:13.037179] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-01T21:53:13.692253] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T21:53:13.702333] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-01T21:53:14.502360] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-01T21:53:14.802179] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-01T21:53:15.302353] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-01T21:53:15.575339] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-01T21:53:15.576922] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-10-01T21:53:15.577024] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-01T21:53:15.941927] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-01T21:53:16.106026] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-01T21:53:16.106297] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-01T21:53:16.106429] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-01T21:53:16.107584] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-01T21:53:16.107686] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-01T21:53:16.109689] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-10-01T21:53:16.459470] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-01T21:53:16.459608] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-01T21:53:16.459779] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFC took 41.4s. Estimated remaining: 41m 59s. Rate: 7.1 symbols/min [2025-10-01T21:53:16.646700] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:16.686783] [DEBUG] [LOCAL ] TFX: Loaded 37113 existing records from primary storage. [2025-10-01T21:53:16.687087] [INFO ] [MAIN ] TFX: Loaded 37113 existing records. [2025-10-01T21:53:16.883072] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:53:16.883295] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-01T21:53:16.883349] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-01T21:53:16.884275] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-01T21:53:16.884338] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-01T21:53:16.907471] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-01T21:53:17.292003] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:17.702377] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-01T21:53:18.086051] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T21:53:18.158431] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T21:53:18.502431] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-01T21:53:19.169153] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T21:53:19.302388] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-01T21:53:19.884248] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T21:53:20.102392] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-01T21:53:20.836091] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T21:53:20.902419] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-01T21:53:21.658113] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T21:53:21.702397] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-01T21:53:21.946862] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T21:53:22.320236] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-01T21:53:22.321811] [INFO ] [REMOTE ] TFII: Full fetch complete (47778 records). [2025-10-01T21:53:22.321899] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-01T21:53:22.503064] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-01T21:53:22.744450] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-01T21:53:22.744536] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-01T21:53:22.745513] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-01T21:53:22.745607] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-01T21:53:22.746982] [DEBUG] [LOCAL ] TFII: Trimmed 47778 records to 33721 (keeping 200 days of data) [2025-10-01T21:53:22.965088] [DEBUG] [LOCAL ] TFII: Primary data saved (33721 records). [2025-10-01T21:53:22.965276] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-01T21:53:22.965379] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFII took 42.2s. Estimated remaining: 41m 51s. Rate: 7.1 symbols/min [2025-10-01T21:53:23.154322] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:23.165030] [DEBUG] [LOCAL ] TG: Loaded 10417 existing records from primary storage. [2025-10-01T21:53:23.165241] [INFO ] [MAIN ] TG: Loaded 10417 existing records. [2025-10-01T21:53:23.307458] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-01T21:53:23.365597] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:53:23.365855] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-01T21:53:23.365935] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-01T21:53:23.366262] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-01T21:53:23.366323] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-01T21:53:23.787753] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:24.102558] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-01T21:53:24.107523] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T21:53:24.902377] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-01T21:53:24.953522] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T21:53:24.977062] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T21:53:25.702395] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-01T21:53:26.502401] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-01T21:53:26.649469] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T21:53:27.236186] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T21:53:27.302387] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-01T21:53:27.742010] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T21:53:27.941321] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T21:53:28.102403] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-01T21:53:28.842126] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-01T21:53:28.843424] [INFO ] [REMOTE ] TFIN: Full fetch complete (31213 records). [2025-10-01T21:53:28.843509] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-01T21:53:28.907599] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-01T21:53:29.298191] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-01T21:53:29.298315] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-01T21:53:29.299053] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-01T21:53:29.299139] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-01T21:53:29.300099] [DEBUG] [LOCAL ] TFIN: Trimmed 31213 records to 23462 (keeping 200 days of data) [2025-10-01T21:53:29.445080] [DEBUG] [LOCAL ] TFIN: Primary data saved (23462 records). [2025-10-01T21:53:29.445215] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-01T21:53:29.445301] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFIN took 30.2s. Estimated remaining: 41m 42s. Rate: 7.1 symbols/min [2025-10-01T21:53:29.630436] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:29.630672] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-01T21:53:29.630729] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-01T21:53:29.630852] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-01T21:53:29.630894] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-01T21:53:29.630936] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-01T21:53:29.630969] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-01T21:53:29.711866] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-01T21:53:30.007244] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:30.504503] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-01T21:53:30.514369] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T21:53:30.566963] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T21:53:31.302422] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-01T21:53:32.102356] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-01T21:53:32.196602] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T21:53:32.473478] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-01T21:53:32.474990] [INFO ] [REMOTE ] TFPM: Full fetch complete (51165 records). [2025-10-01T21:53:32.475092] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-01T21:53:32.891480] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-01T21:53:32.891570] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-01T21:53:32.892454] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-01T21:53:32.892517] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-01T21:53:32.893619] [DEBUG] [LOCAL ] TFPM: Trimmed 51165 records to 37949 (keeping 200 days of data) [2025-10-01T21:53:32.950209] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-01T21:53:32.995722] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-01T21:53:33.147940] [DEBUG] [LOCAL ] TFPM: Primary data saved (37949 records). [2025-10-01T21:53:33.148113] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-01T21:53:33.148208] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFPM took 29.8s. Estimated remaining: 41m 33s. Rate: 7.1 symbols/min [2025-10-01T21:53:33.191916] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:53:33.192239] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-01T21:53:33.192333] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:53:33.192406] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-01T21:53:33.192478] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:53:33.192556] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-01T21:53:33.192624] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-01T21:53:33.192725] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-01T21:53:33.192799] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-01T21:53:33.192878] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TGE took 3.7s. Estimated remaining: 41m 23s. Rate: 7.1 symbols/min [2025-10-01T21:53:33.702436] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-01T21:53:34.502437] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-01T21:53:35.099249] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-01T21:53:35.125008] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T21:53:35.302390] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-01T21:53:36.102418] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-01T21:53:36.633430] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-01T21:53:36.698540] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T21:53:36.902419] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-01T21:53:37.649522] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-01T21:53:37.702353] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-01T21:53:38.337126] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T21:53:38.502411] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-01T21:53:39.302421] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-01T21:53:39.997560] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T21:53:40.062835] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-01T21:53:40.102344] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-01T21:53:40.902433] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-01T21:53:40.919133] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T21:53:41.702388] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-01T21:53:42.065693] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T21:53:42.309384] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-01T21:53:42.310264] [INFO ] [REMOTE ] TG: Full fetch complete (15122 records). [2025-10-01T21:53:42.310335] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-01T21:53:42.507446] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-01T21:53:42.699777] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-01T21:53:42.699868] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-01T21:53:42.700251] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-01T21:53:42.700290] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-01T21:53:42.700900] [DEBUG] [LOCAL ] TG: Trimmed 15122 records to 10408 (keeping 200 days of data) [2025-10-01T21:53:42.763232] [DEBUG] [LOCAL ] TG: Primary data saved (10408 records). [2025-10-01T21:53:42.763394] [INFO ] [MAIN ] TG: Full history saved. [2025-10-01T21:53:42.763500] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TG took 19.8s. Estimated remaining: 41m 15s. Rate: 7.1 symbols/min [2025-10-01T21:53:44.028732] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T21:53:44.037840] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-01T21:53:45.168179] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T21:53:45.169462] [INFO ] [REMOTE ] TFX: Full fetch complete (54491 records). [2025-10-01T21:53:45.169541] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-01T21:53:45.585088] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-01T21:53:45.585172] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-01T21:53:45.586123] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-01T21:53:45.586188] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-01T21:53:45.587338] [DEBUG] [LOCAL ] TFX: Trimmed 54491 records to 37085 (keeping 200 days of data) [2025-10-01T21:53:45.834105] [DEBUG] [LOCAL ] TFX: Primary data saved (37085 records). [2025-10-01T21:53:45.834275] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-01T21:53:45.834378] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TFX took 29.4s. Estimated remaining: 41m 5s. Rate: 7.1 symbols/min [2025-10-01T21:53:46.583302] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:46.569274] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:46.641856] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:46.680906] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:53:46.721396] [DEBUG] [LOCAL ] TGS: Loaded 32763 existing records from primary storage. [2025-10-01T21:53:46.732104] [INFO ] [MAIN ] TGS: Loaded 32763 existing records. [2025-10-01T21:53:46.779359] [DEBUG] [LOCAL ] TGLS: Loaded 28070 existing records from primary storage. [2025-10-01T21:53:46.805816] [INFO ] [MAIN ] TGLS: Loaded 28070 existing records. [2025-10-01T21:53:47.020055] [DEBUG] [LOCAL ] TGNA: Loaded 48665 existing records from primary storage. [2025-10-01T21:53:47.080297] [INFO ] [MAIN ] TGNA: Loaded 48665 existing records. [2025-10-01T21:53:47.154406] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-01T21:53:47.189118] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-01T21:53:47.647401] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:53:47.670296] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:53:47.652963] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-01T21:53:47.691958] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-01T21:53:47.692091] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-01T21:53:47.680986] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-01T21:53:47.698993] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-01T21:53:47.736686] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-01T21:53:47.705423] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-01T21:53:47.767873] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-01T21:53:47.895256] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:53:48.022718] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-01T21:53:48.050731] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:53:48.088346] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-01T21:53:48.099114] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-01T21:53:48.109583] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-01T21:53:48.150704] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-01T21:53:48.155336] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-01T21:53:48.155508] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-01T21:53:48.155662] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-01T21:53:49.317972] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:49.355173] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-01T21:53:49.391442] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:49.413773] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-01T21:53:49.551842] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:49.561252] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-01T21:53:49.587512] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:53:49.589564] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-01T21:53:50.309489] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-01T21:53:50.315929] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-01T21:53:50.653378] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T21:53:50.665514] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-01T21:53:51.155372] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-01T21:53:51.166526] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-01T21:53:51.414551] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T21:53:51.426845] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-01T21:53:51.451475] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T21:53:51.459920] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-01T21:53:51.487553] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T21:53:51.493796] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-01T21:53:52.295597] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-01T21:53:52.305114] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-01T21:53:52.576146] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T21:53:52.599802] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T21:53:52.902417] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-01T21:53:53.167035] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T21:53:53.564176] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T21:53:53.702404] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-01T21:53:53.829635] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-01T21:53:54.502410] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-01T21:53:55.302350] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-01T21:53:55.562993] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-01T21:53:55.730708] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-01T21:53:56.102386] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-01T21:53:56.902393] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-01T21:53:57.433145] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-01T21:53:57.513192] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T21:53:57.702352] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-01T21:53:57.912089] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T21:53:58.502388] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-01T21:53:59.302401] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-01T21:53:59.405145] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T21:54:00.102427] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-01T21:54:00.740729] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T21:54:00.850884] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-01T21:54:00.902362] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-01T21:54:01.551954] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T21:54:01.702379] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-01T21:54:01.726623] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T21:54:02.502389] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-01T21:54:03.302401] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-01T21:54:03.543443] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T21:54:03.742634] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T21:54:04.102376] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-01T21:54:04.704740] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T21:54:04.902380] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-01T21:54:05.663884] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T21:54:05.702430] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-01T21:54:06.289579] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T21:54:06.502415] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-01T21:54:07.302359] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-01T21:54:07.806347] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T21:54:07.909744] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-01T21:54:08.102375] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-01T21:54:08.891586] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T21:54:08.902335] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-01T21:54:09.411033] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-01T21:54:09.702381] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-01T21:54:09.721130] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-01T21:54:09.722594] [INFO ] [REMOTE ] TGS: Full fetch complete (47916 records). [2025-10-01T21:54:09.722725] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-01T21:54:10.160004] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-01T21:54:10.160086] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-01T21:54:10.160975] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-01T21:54:10.161038] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-01T21:54:10.162156] [DEBUG] [LOCAL ] TGS: Trimmed 47916 records to 32839 (keeping 200 days of data) [2025-10-01T21:54:10.365983] [DEBUG] [LOCAL ] TGS: Primary data saved (32839 records). [2025-10-01T21:54:10.366130] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-01T21:54:10.366268] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGS took 24.5s. Estimated remaining: 40m 59s. Rate: 7.1 symbols/min [2025-10-01T21:54:10.507456] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-01T21:54:10.561918] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:54:10.609465] [DEBUG] [LOCAL ] THC: Loaded 47711 existing records from primary storage. [2025-10-01T21:54:10.609817] [INFO ] [MAIN ] THC: Loaded 47711 existing records. [2025-10-01T21:54:10.848045] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:54:10.848298] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-01T21:54:10.848351] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-01T21:54:10.849516] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-01T21:54:10.849579] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-01T21:54:11.244888] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:54:11.302358] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-01T21:54:11.342063] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T21:54:11.697931] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T21:54:12.102406] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-01T21:54:12.902385] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-01T21:54:12.985269] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-01T21:54:12.986586] [INFO ] [REMOTE ] TGLS: Full fetch complete (40499 records). [2025-10-01T21:54:12.986706] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-01T21:54:13.426442] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-01T21:54:13.426582] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-01T21:54:13.427583] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-01T21:54:13.427773] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-01T21:54:13.428893] [DEBUG] [LOCAL ] TGLS: Trimmed 40499 records to 27989 (keeping 200 days of data) [2025-10-01T21:54:13.614898] [DEBUG] [LOCAL ] TGLS: Primary data saved (27989 records). [2025-10-01T21:54:13.615082] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-01T21:54:13.615207] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGLS took 27.8s. Estimated remaining: 40m 50s. Rate: 7.1 symbols/min [2025-10-01T21:54:13.706069] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-01T21:54:13.827952] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-01T21:54:13.861459] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:54:13.884087] [DEBUG] [LOCAL ] THG: Loaded 21678 existing records from primary storage. [2025-10-01T21:54:13.884365] [INFO ] [MAIN ] THG: Loaded 21678 existing records. [2025-10-01T21:54:14.085713] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:54:14.085975] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-01T21:54:14.086035] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-01T21:54:14.086713] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-01T21:54:14.086805] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-01T21:54:14.484049] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:54:14.507263] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-01T21:54:14.513021] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T21:54:15.302431] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-01T21:54:15.795217] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-01T21:54:16.102432] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-01T21:54:16.644600] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-01T21:54:16.889584] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T21:54:16.902368] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-01T21:54:16.981618] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-01T21:54:17.702443] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-01T21:54:18.198057] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T21:54:18.502365] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-01T21:54:18.749697] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T21:54:19.302423] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-01T21:54:19.652477] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-01T21:54:19.654568] [INFO ] [REMOTE ] TGNA: Full fetch complete (69996 records). [2025-10-01T21:54:19.654771] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-01T21:54:20.090042] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-01T21:54:20.090262] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-01T21:54:20.092019] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-01T21:54:20.092105] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-01T21:54:20.095450] [DEBUG] [LOCAL ] TGNA: Trimmed 69996 records to 48684 (keeping 200 days of data) [2025-10-01T21:54:20.153617] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-01T21:54:20.412803] [DEBUG] [LOCAL ] TGNA: Primary data saved (48684 records). [2025-10-01T21:54:20.412946] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-01T21:54:20.413116] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 34.6s. Estimated remaining: 40m 41s. Rate: 7.1 symbols/min [2025-10-01T21:54:20.603709] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:54:20.607932] [DEBUG] [LOCAL ] THIR: Loaded 2194 existing records from primary storage. [2025-10-01T21:54:20.608139] [INFO ] [MAIN ] THIR: Loaded 2194 existing records. [2025-10-01T21:54:20.803621] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:54:20.803970] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-01T21:54:20.804047] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-01T21:54:20.804273] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-01T21:54:20.804334] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-01T21:54:20.909834] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-01T21:54:21.232027] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:54:21.422507] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-01T21:54:21.629708] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-01T21:54:21.702379] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-01T21:54:22.044295] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-01T21:54:22.502356] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-01T21:54:22.623297] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T21:54:23.302426] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-01T21:54:24.102379] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-01T21:54:24.469465] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T21:54:24.857267] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-01T21:54:24.902354] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-01T21:54:25.708850] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-01T21:54:25.715604] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T21:54:26.502381] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-01T21:54:26.841363] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-01T21:54:26.909728] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T21:54:27.302375] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-01T21:54:27.344004] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-01T21:54:27.649747] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-01T21:54:28.102409] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-01T21:54:28.902429] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-01T21:54:29.175236] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-01T21:54:29.236716] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T21:54:29.702415] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-01T21:54:30.165298] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-01T21:54:30.502389] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-01T21:54:31.302424] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-01T21:54:32.102443] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-01T21:54:32.293214] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T21:54:32.408237] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-01T21:54:32.902403] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-01T21:54:33.090081] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-01T21:54:33.091684] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-10-01T21:54:33.091781] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-01T21:54:33.549214] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-01T21:54:33.549339] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-01T21:54:33.550508] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-01T21:54:33.550622] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-01T21:54:33.555663] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-10-01T21:54:33.746821] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-01T21:54:33.912714] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-10-01T21:54:33.912857] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-01T21:54:33.916184] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 48.1s. Estimated remaining: 40m 34s. Rate: 7.1 symbols/min [2025-10-01T21:54:34.112891] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:54:34.117316] [DEBUG] [LOCAL ] THLV: Loaded 1546 existing records from primary storage. [2025-10-01T21:54:34.117529] [INFO ] [MAIN ] THLV: Loaded 1546 existing records. [2025-10-01T21:54:34.244805] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-01T21:54:34.330039] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:54:34.330245] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-01T21:54:34.330292] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-01T21:54:34.330583] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-01T21:54:34.330692] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-01T21:54:34.506370] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-01T21:54:34.747894] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:54:34.782229] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T21:54:35.302424] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-01T21:54:35.489172] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T21:54:36.102426] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-01T21:54:36.644870] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-01T21:54:36.675533] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T21:54:36.902460] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-01T21:54:37.702354] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-01T21:54:37.809274] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-01T21:54:38.284134] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-01T21:54:38.502414] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-01T21:54:38.939791] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-01T21:54:39.302377] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-01T21:54:39.736423] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-01T21:54:40.102396] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-01T21:54:40.902392] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-01T21:54:41.702361] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-01T21:54:41.825158] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T21:54:41.943184] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T21:54:42.058555] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-01T21:54:42.502370] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-01T21:54:43.302404] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-01T21:54:43.674748] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-01T21:54:43.675575] [INFO ] [REMOTE ] THIR: Full fetch complete (2733 records). [2025-10-01T21:54:43.675724] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-01T21:54:44.075311] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-01T21:54:44.075496] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-01T21:54:44.075772] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-01T21:54:44.075831] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-01T21:54:44.076223] [DEBUG] [LOCAL ] THIR: Trimmed 2733 records to 2204 (keeping 200 days of data) [2025-10-01T21:54:44.090832] [DEBUG] [LOCAL ] THIR: Primary data saved (2204 records). [2025-10-01T21:54:44.090945] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-01T21:54:44.091071] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THIR took 23.7s. Estimated remaining: 40m 25s. Rate: 7.1 symbols/min [2025-10-01T21:54:44.112839] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-01T21:54:44.279916] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:54:44.334193] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T21:54:44.357759] [DEBUG] [LOCAL ] THO: Loaded 42038 existing records from primary storage. [2025-10-01T21:54:44.358173] [INFO ] [MAIN ] THO: Loaded 42038 existing records. [2025-10-01T21:54:44.564708] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:54:44.564918] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-01T21:54:44.564965] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-01T21:54:44.566143] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-01T21:54:44.566203] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-01T21:54:44.678742] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T21:54:44.918097] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-01T21:54:44.967977] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:54:45.702356] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-01T21:54:45.787425] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T21:54:46.502398] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-01T21:54:46.950028] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-01T21:54:47.078667] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T21:54:47.079878] [INFO ] [REMOTE ] THG: Full fetch complete (31162 records). [2025-10-01T21:54:47.079959] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-01T21:54:47.307545] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-01T21:54:47.501816] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-01T21:54:47.501912] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-01T21:54:47.502695] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-01T21:54:47.502761] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-01T21:54:47.503720] [DEBUG] [LOCAL ] THG: Trimmed 31162 records to 21689 (keeping 200 days of data) [2025-10-01T21:54:47.648874] [DEBUG] [LOCAL ] THG: Primary data saved (21689 records). [2025-10-01T21:54:47.649001] [INFO ] [MAIN ] THG: Full history saved. [2025-10-01T21:54:47.649109] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THG took 34.0s. Estimated remaining: 40m 16s. Rate: 7.1 symbols/min [2025-10-01T21:54:47.843199] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:54:47.870935] [DEBUG] [LOCAL ] THQ: Loaded 24858 existing records from primary storage. [2025-10-01T21:54:47.871217] [INFO ] [MAIN ] THQ: Loaded 24858 existing records. [2025-10-01T21:54:48.069340] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:54:48.069576] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-01T21:54:48.069626] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-01T21:54:48.070348] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-01T21:54:48.070411] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-01T21:54:48.107478] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-01T21:54:48.473032] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:54:48.477452] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-01T21:54:48.877707] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-01T21:54:48.902345] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-01T21:54:49.702395] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-01T21:54:50.504463] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-01T21:54:50.509585] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T21:54:50.752543] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T21:54:50.754661] [INFO ] [REMOTE ] THC: Full fetch complete (69251 records). [2025-10-01T21:54:50.754764] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-01T21:54:51.080980] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T21:54:51.187268] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-01T21:54:51.187367] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-01T21:54:51.188627] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-01T21:54:51.188715] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-01T21:54:51.190287] [DEBUG] [LOCAL ] THC: Trimmed 69251 records to 47674 (keeping 200 days of data) [2025-10-01T21:54:51.308906] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-01T21:54:51.509485] [DEBUG] [LOCAL ] THC: Primary data saved (47674 records). [2025-10-01T21:54:51.509623] [INFO ] [MAIN ] THC: Full history saved. [2025-10-01T21:54:51.509778] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THC took 41.1s. Estimated remaining: 40m 7s. Rate: 7.1 symbols/min [2025-10-01T21:54:51.702639] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:54:51.726787] [DEBUG] [LOCAL ] THR: Loaded 19835 existing records from primary storage. [2025-10-01T21:54:51.727119] [INFO ] [MAIN ] THR: Loaded 19835 existing records. [2025-10-01T21:54:51.932426] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:54:51.932694] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-01T21:54:51.932757] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-01T21:54:51.933334] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-01T21:54:51.933396] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-01T21:54:52.104267] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-01T21:54:52.332777] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:54:52.352144] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T21:54:52.612606] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-01T21:54:52.902388] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-01T21:54:53.702393] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-01T21:54:54.323115] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T21:54:54.502441] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-01T21:54:54.782712] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T21:54:55.073459] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-01T21:54:55.302464] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-01T21:54:55.661033] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-01T21:54:56.102398] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-01T21:54:56.566154] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-01T21:54:56.902399] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-01T21:54:57.702367] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-01T21:54:58.502364] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-01T21:54:58.633005] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T21:54:58.654821] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T21:54:58.974841] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-01T21:54:59.302388] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-01T21:55:00.102391] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-01T21:55:00.401965] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T21:55:00.402625] [INFO ] [REMOTE ] THLV: Full fetch complete (2636 records). [2025-10-01T21:55:00.402724] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-01T21:55:00.735615] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T21:55:00.827370] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-01T21:55:00.827454] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-01T21:55:00.827578] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-01T21:55:00.827621] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-01T21:55:00.828023] [DEBUG] [LOCAL ] THLV: Trimmed 2636 records to 1543 (keeping 200 days of data) [2025-10-01T21:55:00.838628] [DEBUG] [LOCAL ] THLV: Primary data saved (1543 records). [2025-10-01T21:55:00.838730] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-01T21:55:00.838859] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THLV took 26.9s. Estimated remaining: 39m 59s. Rate: 7.1 symbols/min [2025-10-01T21:55:00.907546] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-01T21:55:01.029158] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:01.083285] [DEBUG] [LOCAL ] THS: Loaded 38125 existing records from primary storage. [2025-10-01T21:55:01.083609] [INFO ] [MAIN ] THS: Loaded 38125 existing records. [2025-10-01T21:55:01.293202] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:55:01.293432] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-01T21:55:01.293482] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-01T21:55:01.294315] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-01T21:55:01.294378] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-01T21:55:01.703804] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-01T21:55:01.703631] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:02.101613] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T21:55:02.502355] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-01T21:55:02.741936] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-01T21:55:03.302389] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-01T21:55:03.940292] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T21:55:04.102355] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-01T21:55:04.463217] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T21:55:04.902397] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-01T21:55:05.702466] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-01T21:55:05.775311] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T21:55:06.080178] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T21:55:06.502403] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-01T21:55:06.706706] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T21:55:07.302385] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-01T21:55:07.348928] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T21:55:08.102424] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-01T21:55:08.317365] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T21:55:08.902361] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-01T21:55:09.072744] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T21:55:09.702417] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-01T21:55:09.960956] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T21:55:10.502376] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-01T21:55:11.057908] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T21:55:11.302387] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-01T21:55:11.549572] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T21:55:12.102428] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-01T21:55:12.597014] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T21:55:12.902385] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-01T21:55:13.702403] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-01T21:55:13.780460] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:55:14.015304] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T21:55:14.502396] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-01T21:55:15.308732] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-01T21:55:15.324174] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T21:55:16.081537] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T21:55:16.102336] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-01T21:55:16.136881] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-01T21:55:16.902393] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-01T21:55:17.514270] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T21:55:17.702378] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-01T21:55:17.748350] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-01T21:55:18.502400] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-01T21:55:19.108212] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T21:55:19.302402] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-01T21:55:20.088175] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T21:55:20.102340] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-01T21:55:20.786605] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T21:55:20.902391] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-01T21:55:21.162832] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T21:55:21.164475] [INFO ] [REMOTE ] THO: Full fetch complete (60169 records). [2025-10-01T21:55:21.164586] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-01T21:55:21.631822] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-01T21:55:21.631926] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-01T21:55:21.633122] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-01T21:55:21.633200] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-01T21:55:21.634739] [DEBUG] [LOCAL ] THO: Trimmed 60169 records to 41945 (keeping 200 days of data) [2025-10-01T21:55:21.707485] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-01T21:55:21.914111] [DEBUG] [LOCAL ] THO: Primary data saved (41945 records). [2025-10-01T21:55:21.914243] [INFO ] [MAIN ] THO: Full history saved. [2025-10-01T21:55:21.914357] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THO took 37.8s. Estimated remaining: 39m 52s. Rate: 7.1 symbols/min [2025-10-01T21:55:22.110783] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:22.131617] [DEBUG] [LOCAL ] THW: Loaded 19361 existing records from primary storage. [2025-10-01T21:55:22.131907] [INFO ] [MAIN ] THW: Loaded 19361 existing records. [2025-10-01T21:55:22.336460] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:55:22.336857] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-01T21:55:22.336945] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-01T21:55:22.337751] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-01T21:55:22.337816] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-01T21:55:22.498298] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-01T21:55:22.525703] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-01T21:55:22.785966] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:22.849222] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-01T21:55:23.302393] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-01T21:55:23.931568] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T21:55:24.102358] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-01T21:55:24.440779] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-01T21:55:24.902422] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-01T21:55:25.209079] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-01T21:55:25.702428] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-01T21:55:26.423576] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T21:55:26.502381] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-01T21:55:26.852756] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T21:55:27.302345] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-01T21:55:27.329249] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T21:55:28.102411] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-01T21:55:28.553851] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-01T21:55:28.894345] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-01T21:55:28.895288] [INFO ] [REMOTE ] THR: Full fetch complete (28749 records). [2025-10-01T21:55:28.895364] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-01T21:55:28.907543] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-01T21:55:29.335766] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-01T21:55:29.335854] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-01T21:55:29.336526] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-01T21:55:29.336629] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-01T21:55:29.337583] [DEBUG] [LOCAL ] THR: Trimmed 28749 records to 19834 (keeping 200 days of data) [2025-10-01T21:55:29.459626] [DEBUG] [LOCAL ] THR: Primary data saved (19834 records). [2025-10-01T21:55:29.459800] [INFO ] [MAIN ] THR: Full history saved. [2025-10-01T21:55:29.459931] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THR took 37.9s. Estimated remaining: 39m 43s. Rate: 7.1 symbols/min [2025-10-01T21:55:29.661163] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:29.661364] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-01T21:55:29.661414] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-01T21:55:29.661527] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-01T21:55:29.661570] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-01T21:55:29.661613] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-01T21:55:29.661711] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-01T21:55:29.707507] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-01T21:55:29.785727] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-01T21:55:29.792265] [INFO ] [REMOTE ] THQ: Full fetch complete (35071 records). [2025-10-01T21:55:29.798347] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-01T21:55:30.478398] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:30.517304] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-01T21:55:30.575477] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-01T21:55:30.575605] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-01T21:55:30.576545] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-01T21:55:30.576626] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-01T21:55:30.578215] [DEBUG] [LOCAL ] THQ: Trimmed 35071 records to 24975 (keeping 200 days of data) [2025-10-01T21:55:30.750051] [DEBUG] [LOCAL ] THQ: Primary data saved (24975 records). [2025-10-01T21:55:30.750235] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-01T21:55:30.750350] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THQ took 43.1s. Estimated remaining: 39m 34s. Rate: 7.1 symbols/min [2025-10-01T21:55:30.952710] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:55:30.954574] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:30.954953] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-01T21:55:30.955502] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:55:30.955599] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-01T21:55:30.955698] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:55:30.955770] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-01T21:55:30.955840] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-01T21:55:30.955879] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-01T21:55:30.956019] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-01T21:55:30.956080] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. TIC took 1.5s. Estimated remaining: 39m 24s. Rate: 7.1 symbols/min [2025-10-01T21:55:31.163365] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:31.205517] [DEBUG] [LOCAL ] TISI: Loaded 3714 existing records from primary storage. [2025-10-01T21:55:31.206357] [INFO ] [MAIN ] TISI: Loaded 3714 existing records. [2025-10-01T21:55:31.207759] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T21:55:31.236130] [DEBUG] [LOCAL ] TIMB: Loaded 36151 existing records from primary storage. [2025-10-01T21:55:31.273140] [INFO ] [MAIN ] TIMB: Loaded 36151 existing records. [2025-10-01T21:55:31.316638] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-01T21:55:31.592844] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:55:31.607723] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-01T21:55:31.614246] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-01T21:55:31.635924] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-01T21:55:31.640579] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:55:31.640880] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-01T21:55:31.641066] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-01T21:55:31.646299] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-01T21:55:31.727401] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-01T21:55:31.753363] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-01T21:55:32.124971] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-01T21:55:32.398477] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:32.469815] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:32.481340] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T21:55:32.902388] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-01T21:55:33.104618] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T21:55:33.106099] [INFO ] [REMOTE ] THS: Full fetch complete (54008 records). [2025-10-01T21:55:33.106199] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-01T21:55:33.534899] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-01T21:55:33.534985] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-01T21:55:33.536004] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-01T21:55:33.536074] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-01T21:55:33.537256] [DEBUG] [LOCAL ] THS: Trimmed 54008 records to 38195 (keeping 200 days of data) [2025-10-01T21:55:33.718528] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-01T21:55:33.786188] [DEBUG] [LOCAL ] THS: Primary data saved (38195 records). [2025-10-01T21:55:33.786328] [INFO ] [MAIN ] THS: Full history saved. [2025-10-01T21:55:33.786430] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THS took 32.9s. Estimated remaining: 39m 15s. Rate: 7.1 symbols/min [2025-10-01T21:55:33.983239] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:34.014161] [DEBUG] [LOCAL ] TIXT: Loaded 31376 existing records from primary storage. [2025-10-01T21:55:34.014453] [INFO ] [MAIN ] TIXT: Loaded 31376 existing records. [2025-10-01T21:55:34.240724] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:55:34.241088] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-01T21:55:34.241223] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-01T21:55:34.242117] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-01T21:55:34.242184] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-01T21:55:34.507786] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-01T21:55:34.615911] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T21:55:34.721875] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:34.768892] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T21:55:35.233857] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T21:55:35.302409] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-01T21:55:35.791218] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-01T21:55:36.102418] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-01T21:55:36.575117] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-01T21:55:36.902403] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-01T21:55:37.702410] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-01T21:55:37.900037] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-01T21:55:38.502442] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-01T21:55:39.153364] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T21:55:39.208321] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T21:55:39.302420] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-01T21:55:39.987613] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T21:55:40.102395] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-01T21:55:40.902436] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-01T21:55:41.148158] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T21:55:41.662283] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-01T21:55:41.702339] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-01T21:55:42.502390] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-01T21:55:42.701821] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T21:55:43.229930] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T21:55:43.302388] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-01T21:55:44.102392] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-01T21:55:44.817137] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T21:55:44.902451] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-01T21:55:44.983535] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T21:55:45.702391] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-01T21:55:46.051285] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T21:55:46.347448] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T21:55:46.502392] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-01T21:55:47.302399] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-01T21:55:47.570559] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T21:55:47.921205] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-01T21:55:48.102452] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-01T21:55:48.902428] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-01T21:55:49.596010] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T21:55:49.702423] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-01T21:55:49.951573] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T21:55:50.502388] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-01T21:55:50.883167] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T21:55:51.302420] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-01T21:55:51.556677] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-01T21:55:52.102461] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-01T21:55:52.654271] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-01T21:55:52.655745] [INFO ] [REMOTE ] THW: Full fetch complete (29537 records). [2025-10-01T21:55:52.655898] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-01T21:55:52.916901] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-01T21:55:53.053746] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T21:55:53.130151] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-01T21:55:53.130251] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-01T21:55:53.130960] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-01T21:55:53.131028] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-01T21:55:53.131923] [DEBUG] [LOCAL ] THW: Trimmed 29537 records to 19428 (keeping 200 days of data) [2025-10-01T21:55:53.260616] [DEBUG] [LOCAL ] THW: Primary data saved (19428 records). [2025-10-01T21:55:53.260787] [INFO ] [MAIN ] THW: Full history saved. [2025-10-01T21:55:53.260898] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. THW took 31.3s. Estimated remaining: 39m 8s. Rate: 7.1 symbols/min [2025-10-01T21:55:53.451343] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:53.512364] [DEBUG] [LOCAL ] TJX: Loaded 53669 existing records from primary storage. [2025-10-01T21:55:53.512815] [INFO ] [MAIN ] TJX: Loaded 53669 existing records. [2025-10-01T21:55:53.590790] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-01T21:55:53.707483] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-01T21:55:53.750237] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:55:53.750458] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-01T21:55:53.750507] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-01T21:55:53.752508] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-01T21:55:53.752575] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-01T21:55:54.158893] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:54.502364] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-01T21:55:54.881381] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T21:55:55.020108] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-01T21:55:55.302399] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-01T21:55:55.596052] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-01T21:55:56.102378] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-01T21:55:56.902389] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-01T21:55:57.171346] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-01T21:55:57.172234] [INFO ] [REMOTE ] TISI: Full fetch complete (4898 records). [2025-10-01T21:55:57.172320] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-01T21:55:57.613855] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T21:55:57.646103] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-01T21:55:57.646323] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-01T21:55:57.646539] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-01T21:55:57.647016] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-01T21:55:57.647530] [DEBUG] [LOCAL ] TISI: Trimmed 4898 records to 3733 (keeping 200 days of data) [2025-10-01T21:55:57.669674] [DEBUG] [LOCAL ] TISI: Primary data saved (3733 records). [2025-10-01T21:55:57.669776] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-01T21:55:57.669860] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TISI took 26.7s. Estimated remaining: 38m 59s. Rate: 7.1 symbols/min [2025-10-01T21:55:57.707499] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-01T21:55:57.871765] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:55:57.913781] [DEBUG] [LOCAL ] TK: Loaded 39498 existing records from primary storage. [2025-10-01T21:55:57.914117] [INFO ] [MAIN ] TK: Loaded 39498 existing records. [2025-10-01T21:55:58.112633] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:55:58.112866] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-01T21:55:58.112924] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-01T21:55:58.113837] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-01T21:55:58.113965] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-01T21:55:58.510139] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-01T21:55:58.519355] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:55:59.227286] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T21:55:59.302422] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-01T21:56:00.102397] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-01T21:56:00.488860] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T21:56:00.902407] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-01T21:56:01.038979] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T21:56:01.625171] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-01T21:56:01.702453] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-01T21:56:02.468618] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T21:56:02.502387] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-01T21:56:03.049282] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T21:56:03.302387] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-01T21:56:04.102375] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-01T21:56:04.235052] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-01T21:56:04.415215] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-01T21:56:04.902375] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-01T21:56:05.486053] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-01T21:56:05.702382] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-01T21:56:06.502383] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-01T21:56:06.785122] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-01T21:56:06.852147] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T21:56:07.302384] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-01T21:56:07.757068] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T21:56:08.102379] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-01T21:56:08.855363] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T21:56:08.902363] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-01T21:56:09.702369] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-01T21:56:10.138600] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-01T21:56:10.177894] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-01T21:56:10.502416] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-01T21:56:10.774785] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T21:56:10.776948] [INFO ] [REMOTE ] TIXT: Full fetch complete (45953 records). [2025-10-01T21:56:10.777111] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-01T21:56:11.239882] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-01T21:56:11.240020] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-01T21:56:11.241042] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-01T21:56:11.241146] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-01T21:56:11.242507] [DEBUG] [LOCAL ] TIXT: Trimmed 45953 records to 31569 (keeping 200 days of data) [2025-10-01T21:56:11.327615] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-01T21:56:11.409613] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-01T21:56:11.433963] [INFO ] [REMOTE ] TIMB: Full fetch complete (54301 records). [2025-10-01T21:56:11.435380] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-01T21:56:11.706771] [DEBUG] [LOCAL ] TIXT: Primary data saved (31569 records). [2025-10-01T21:56:11.732158] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-01T21:56:11.758230] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIXT took 38.0s. Estimated remaining: 38m 51s. Rate: 7.1 symbols/min [2025-10-01T21:56:12.105149] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-01T21:56:12.151588] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-01T21:56:12.152892] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:56:12.153098] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-01T21:56:12.154431] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-01T21:56:12.155145] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-01T21:56:12.156883] [DEBUG] [LOCAL ] TIMB: Trimmed 54301 records to 36109 (keeping 200 days of data) [2025-10-01T21:56:12.293904] [DEBUG] [LOCAL ] TKC: Loaded 38850 existing records from primary storage. [2025-10-01T21:56:12.295393] [INFO ] [MAIN ] TKC: Loaded 38850 existing records. [2025-10-01T21:56:12.559937] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:56:12.561352] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-01T21:56:12.561674] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-01T21:56:12.563961] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-01T21:56:12.564369] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-01T21:56:13.064884] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:56:13.066150] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-01T21:56:13.091305] [DEBUG] [LOCAL ] TIMB: Primary data saved (36109 records). [2025-10-01T21:56:13.091468] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-01T21:56:13.091562] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TIMB took 42.3s. Estimated remaining: 38m 42s. Rate: 7.1 symbols/min [2025-10-01T21:56:13.309086] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:56:13.355366] [DEBUG] [LOCAL ] TKO: Loaded 44052 existing records from primary storage. [2025-10-01T21:56:13.355766] [INFO ] [MAIN ] TKO: Loaded 44052 existing records. [2025-10-01T21:56:13.610201] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:56:13.610775] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-01T21:56:13.615200] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-01T21:56:13.618527] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-01T21:56:13.618583] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-01T21:56:13.618872] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-01T21:56:13.722124] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-01T21:56:13.865205] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T21:56:14.087036] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:56:14.104073] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T21:56:14.502442] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-01T21:56:15.302352] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-01T21:56:15.865766] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-01T21:56:15.916904] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T21:56:16.102415] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-01T21:56:16.653417] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-01T21:56:16.902394] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-01T21:56:17.702377] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-01T21:56:17.770449] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T21:56:18.502434] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-01T21:56:18.563339] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T21:56:18.737384] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-01T21:56:19.302411] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-01T21:56:19.737910] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T21:56:20.102406] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-01T21:56:20.902366] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-01T21:56:21.082350] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T21:56:21.702393] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-01T21:56:21.827053] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-01T21:56:22.351406] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T21:56:22.502464] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-01T21:56:22.948327] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T21:56:23.302433] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-01T21:56:24.102443] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-01T21:56:24.517688] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-01T21:56:24.902402] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-01T21:56:25.075666] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-01T21:56:25.624279] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T21:56:25.702447] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-01T21:56:26.089795] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T21:56:26.502414] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-01T21:56:27.106063] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T21:56:27.302411] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-01T21:56:28.024374] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T21:56:28.102410] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-01T21:56:28.604135] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-01T21:56:28.902423] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-01T21:56:29.345719] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-01T21:56:29.709045] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-01T21:56:29.726142] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:56:30.502445] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-01T21:56:30.673102] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T21:56:30.674740] [INFO ] [REMOTE ] TK: Full fetch complete (56549 records). [2025-10-01T21:56:30.674831] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-01T21:56:30.794476] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T21:56:30.823195] [INFO ] [REMOTE ] TJX: Full fetch complete (77677 records). [2025-10-01T21:56:30.860995] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-01T21:56:31.312705] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-01T21:56:31.345285] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-01T21:56:31.361157] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-01T21:56:31.378251] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-01T21:56:31.407281] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-01T21:56:31.493330] [DEBUG] [LOCAL ] TK: Trimmed 56549 records to 39476 (keeping 200 days of data) [2025-10-01T21:56:31.684987] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-01T21:56:31.685793] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-01T21:56:31.687447] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-01T21:56:31.687926] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-01T21:56:31.693135] [DEBUG] [LOCAL ] TJX: Trimmed 77677 records to 53668 (keeping 200 days of data) [2025-10-01T21:56:32.102785] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-01T21:56:32.182963] [DEBUG] [LOCAL ] TK: Primary data saved (39476 records). [2025-10-01T21:56:32.184136] [INFO ] [MAIN ] TK: Full history saved. [2025-10-01T21:56:32.184599] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 34.5s. Estimated remaining: 38m 35s. Rate: 7.1 symbols/min [2025-10-01T21:56:32.388739] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:56:32.398673] [DEBUG] [LOCAL ] TJX: Primary data saved (53668 records). [2025-10-01T21:56:32.398840] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-01T21:56:32.401792] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TJX took 39.1s. Estimated remaining: 38m 25s. Rate: 7.1 symbols/min [2025-10-01T21:56:32.663352] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:56:32.665240] [DEBUG] [LOCAL ] TKR: Loaded 40075 existing records from primary storage. [2025-10-01T21:56:32.666004] [INFO ] [MAIN ] TKR: Loaded 40075 existing records. [2025-10-01T21:56:32.886631] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:56:32.899346] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-01T21:56:32.899435] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-01T21:56:32.900702] [DEBUG] [LOCAL ] TLK: Loaded 39189 existing records from primary storage. [2025-10-01T21:56:32.901096] [INFO ] [MAIN ] TLK: Loaded 39189 existing records. [2025-10-01T21:56:32.935069] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-01T21:56:32.947320] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-01T21:56:33.269995] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:56:33.323447] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-01T21:56:33.337870] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-01T21:56:33.371792] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-01T21:56:33.385508] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-01T21:56:33.742617] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:56:33.743557] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-01T21:56:33.797216] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T21:56:33.856260] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-01T21:56:33.873900] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-01T21:56:34.053898] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:56:34.502399] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-01T21:56:35.077793] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T21:56:35.302469] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-01T21:56:35.422363] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T21:56:35.769282] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T21:56:36.102437] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-01T21:56:36.787217] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-01T21:56:36.902421] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-01T21:56:37.702409] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-01T21:56:37.870111] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T21:56:38.375582] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T21:56:38.502420] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-01T21:56:38.848842] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-01T21:56:39.302420] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-01T21:56:39.869948] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-01T21:56:40.102460] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-01T21:56:40.673706] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T21:56:40.902439] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-01T21:56:41.702434] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-01T21:56:41.760304] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T21:56:42.457863] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T21:56:42.502366] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-01T21:56:43.112566] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T21:56:43.302403] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-01T21:56:44.102381] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-01T21:56:44.135061] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T21:56:44.479540] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T21:56:44.902378] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-01T21:56:45.078474] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T21:56:45.080296] [INFO ] [REMOTE ] TKC: Full fetch complete (52146 records). [2025-10-01T21:56:45.080384] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-01T21:56:45.510607] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-01T21:56:45.510757] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-01T21:56:45.511812] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-01T21:56:45.511901] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-01T21:56:45.513344] [DEBUG] [LOCAL ] TKC: Trimmed 52146 records to 39003 (keeping 200 days of data) [2025-10-01T21:56:45.722769] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-01T21:56:45.757468] [DEBUG] [LOCAL ] TKC: Primary data saved (39003 records). [2025-10-01T21:56:45.757608] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-01T21:56:45.757747] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 34.0s. Estimated remaining: 38m 17s. Rate: 7.1 symbols/min [2025-10-01T21:56:45.951349] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:56:45.969866] [DEBUG] [LOCAL ] TLYS: Loaded 16716 existing records from primary storage. [2025-10-01T21:56:45.970263] [INFO ] [MAIN ] TLYS: Loaded 16716 existing records. [2025-10-01T21:56:46.169178] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:56:46.169731] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-01T21:56:46.169801] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-01T21:56:46.170394] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-01T21:56:46.170467] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-01T21:56:46.503675] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-01T21:56:46.511350] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T21:56:46.606240] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:56:47.184109] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T21:56:47.302386] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-01T21:56:48.033948] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T21:56:48.102434] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-01T21:56:48.226399] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T21:56:48.902400] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-01T21:56:49.420028] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T21:56:49.629873] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T21:56:49.702424] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-01T21:56:50.502392] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-01T21:56:51.025719] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T21:56:51.275421] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T21:56:51.302410] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-01T21:56:52.102405] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-01T21:56:52.500368] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T21:56:52.902411] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-01T21:56:53.548021] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:56:53.702389] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-01T21:56:54.401450] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T21:56:54.502351] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-01T21:56:54.581123] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T21:56:55.302378] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-01T21:56:56.025742] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T21:56:56.102378] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-01T21:56:56.119989] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T21:56:56.902401] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-01T21:56:57.702346] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-01T21:56:57.738252] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T21:56:57.792683] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T21:56:58.502404] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-01T21:56:58.849492] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T21:56:59.302390] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-01T21:56:59.595778] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-01T21:57:00.102384] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-01T21:57:00.902360] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-01T21:57:01.020639] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T21:57:01.702376] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-01T21:57:01.731564] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-01T21:57:01.899087] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T21:57:01.900620] [INFO ] [REMOTE ] TLK: Full fetch complete (57335 records). [2025-10-01T21:57:01.900914] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-01T21:57:02.342475] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-01T21:57:02.342559] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-01T21:57:02.343517] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-01T21:57:02.343581] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-01T21:57:02.344869] [DEBUG] [LOCAL ] TLK: Trimmed 57335 records to 39238 (keeping 200 days of data) [2025-10-01T21:57:02.528930] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-01T21:57:02.602154] [DEBUG] [LOCAL ] TLK: Primary data saved (39238 records). [2025-10-01T21:57:02.602289] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-01T21:57:02.602374] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TLK took 30.2s. Estimated remaining: 38m 10s. Rate: 7.1 symbols/min [2025-10-01T21:57:02.794793] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:02.836121] [DEBUG] [LOCAL ] TM: Loaded 36435 existing records from primary storage. [2025-10-01T21:57:02.836396] [INFO ] [MAIN ] TM: Loaded 36435 existing records. [2025-10-01T21:57:03.035379] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:03.035764] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-01T21:57:03.035889] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-01T21:57:03.037263] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-01T21:57:03.037325] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-01T21:57:03.172125] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T21:57:03.307543] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-01T21:57:03.474899] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:03.705634] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T21:57:03.707085] [INFO ] [REMOTE ] TKR: Full fetch complete (57786 records). [2025-10-01T21:57:03.707175] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-01T21:57:04.112105] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-01T21:57:04.152725] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-01T21:57:04.152821] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-01T21:57:04.153939] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-01T21:57:04.154011] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-01T21:57:04.156590] [DEBUG] [LOCAL ] TKR: Trimmed 57786 records to 40069 (keeping 200 days of data) [2025-10-01T21:57:04.433333] [DEBUG] [LOCAL ] TKR: Primary data saved (40069 records). [2025-10-01T21:57:04.433460] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-01T21:57:04.433556] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 32.2s. Estimated remaining: 38m 1s. Rate: 7.1 symbols/min [2025-10-01T21:57:04.612302] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T21:57:04.635858] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:04.638540] [INFO ] [REMOTE ] TKO: Full fetch complete (64853 records). [2025-10-01T21:57:04.638692] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-01T21:57:04.912237] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-01T21:57:05.010114] [DEBUG] [LOCAL ] TME: Loaded 53194 existing records from primary storage. [2025-10-01T21:57:05.013401] [INFO ] [MAIN ] TME: Loaded 53194 existing records. [2025-10-01T21:57:05.247453] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-01T21:57:05.281097] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-01T21:57:05.298754] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-01T21:57:05.326477] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:05.326769] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-01T21:57:05.327411] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-01T21:57:05.328068] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-01T21:57:05.329553] [DEBUG] [LOCAL ] TKO: Trimmed 64853 records to 44051 (keeping 200 days of data) [2025-10-01T21:57:05.329619] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-01T21:57:05.330186] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-01T21:57:05.566403] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T21:57:05.711207] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-01T21:57:05.870252] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:06.048304] [DEBUG] [LOCAL ] TKO: Primary data saved (44051 records). [2025-10-01T21:57:06.048442] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-01T21:57:06.048578] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TKO took 53.0s. Estimated remaining: 37m 51s. Rate: 7.1 symbols/min [2025-10-01T21:57:06.252390] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:06.299684] [DEBUG] [LOCAL ] TMHC: Loaded 45443 existing records from primary storage. [2025-10-01T21:57:06.300055] [INFO ] [MAIN ] TMHC: Loaded 45443 existing records. [2025-10-01T21:57:06.504775] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-01T21:57:06.504636] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:06.505171] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-01T21:57:06.506237] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-01T21:57:06.507300] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-01T21:57:06.507367] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-01T21:57:06.705809] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T21:57:06.741270] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T21:57:06.953520] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:07.302352] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-01T21:57:08.102418] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-01T21:57:08.322395] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T21:57:08.431740] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-01T21:57:08.902386] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-01T21:57:09.444066] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T21:57:09.702391] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-01T21:57:10.055078] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-01T21:57:10.502353] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-01T21:57:10.666386] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T21:57:11.302389] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-01T21:57:11.845084] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-01T21:57:11.846115] [INFO ] [REMOTE ] TLYS: Full fetch complete (21792 records). [2025-10-01T21:57:11.846284] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-01T21:57:12.111559] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-01T21:57:12.206793] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-01T21:57:12.308852] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-01T21:57:12.308932] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-01T21:57:12.309485] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-01T21:57:12.309547] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-01T21:57:12.310260] [DEBUG] [LOCAL ] TLYS: Trimmed 21792 records to 16584 (keeping 200 days of data) [2025-10-01T21:57:12.412253] [DEBUG] [LOCAL ] TLYS: Primary data saved (16584 records). [2025-10-01T21:57:12.412401] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-01T21:57:12.412489] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLYS took 26.7s. Estimated remaining: 37m 43s. Rate: 7.1 symbols/min [2025-10-01T21:57:12.599252] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:12.659593] [DEBUG] [LOCAL ] TMO: Loaded 52339 existing records from primary storage. [2025-10-01T21:57:12.659953] [INFO ] [MAIN ] TMO: Loaded 52339 existing records. [2025-10-01T21:57:12.849943] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:12.850185] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-01T21:57:12.850240] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-01T21:57:12.851808] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-01T21:57:12.851870] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-01T21:57:12.907703] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-01T21:57:13.234973] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:13.702359] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-01T21:57:13.783107] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T21:57:14.507574] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-01T21:57:14.528109] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T21:57:15.302395] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-01T21:57:15.540760] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T21:57:16.102351] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-01T21:57:16.382758] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T21:57:16.466077] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T21:57:16.902393] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-01T21:57:17.702362] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-01T21:57:17.955822] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T21:57:18.482829] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T21:57:18.502335] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-01T21:57:19.279730] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T21:57:19.302390] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-01T21:57:20.102349] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-01T21:57:20.205251] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T21:57:20.902390] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-01T21:57:21.113253] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T21:57:21.702362] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-01T21:57:22.186528] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-01T21:57:22.447433] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T21:57:22.502392] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-01T21:57:23.139712] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T21:57:23.302438] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-01T21:57:23.746622] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T21:57:24.102411] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-01T21:57:24.902395] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-01T21:57:25.108748] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T21:57:25.702392] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-01T21:57:26.133598] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T21:57:26.502387] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-01T21:57:27.309161] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-01T21:57:27.312163] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-01T21:57:28.102419] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-01T21:57:28.996270] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-01T21:57:29.008357] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-01T21:57:29.056932] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (3.35 seconds). [2025-10-01T21:57:29.248025] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-01T21:57:29.702365] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-01T21:57:29.919987] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T21:57:30.467627] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T21:57:30.502347] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-01T21:57:31.302426] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-01T21:57:31.865103] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-01T21:57:32.102465] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-01T21:57:32.570619] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-01T21:57:32.844667] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T21:57:32.902459] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-01T21:57:33.702374] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-01T21:57:33.805034] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T21:57:34.502361] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-01T21:57:34.844178] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T21:57:35.302365] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-01T21:57:35.381278] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T21:57:36.115702] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-01T21:57:36.118374] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T21:57:36.902382] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-01T21:57:37.702421] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-01T21:57:38.274527] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-01T21:57:38.502390] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-01T21:57:39.321358] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-10-01T21:57:39.333711] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-01T21:57:39.401276] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-01T21:57:39.403061] [INFO ] [REMOTE ] TMHC: Full fetch complete (65975 records). [2025-10-01T21:57:39.403279] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-01T21:57:39.706442] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-01T21:57:39.880325] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-01T21:57:39.883759] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T21:57:39.883821] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-01T21:57:39.886125] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-01T21:57:39.886321] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-01T21:57:39.886714] [INFO ] [REMOTE ] TME: Full fetch complete (76923 records). [2025-10-01T21:57:39.886807] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-01T21:57:39.962717] [DEBUG] [LOCAL ] TMHC: Trimmed 65975 records to 45382 (keeping 200 days of data) [2025-10-01T21:57:40.106376] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-01T21:57:40.432732] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-01T21:57:40.433411] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-01T21:57:40.434884] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-01T21:57:40.435260] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-01T21:57:40.440008] [DEBUG] [LOCAL ] TME: Trimmed 76923 records to 53192 (keeping 200 days of data) [2025-10-01T21:57:40.847772] [DEBUG] [LOCAL ] TMHC: Primary data saved (45382 records). [2025-10-01T21:57:40.848559] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-01T21:57:40.848772] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TMHC took 34.8s. Estimated remaining: 37m 37s. Rate: 7.1 symbols/min [2025-10-01T21:57:41.076185] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:41.137565] [DEBUG] [LOCAL ] TNC: Loaded 14904 existing records from primary storage. [2025-10-01T21:57:41.156616] [INFO ] [MAIN ] TNC: Loaded 14904 existing records. [2025-10-01T21:57:41.286715] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-01T21:57:41.315512] [INFO ] [REMOTE ] TM: Full fetch complete (52849 records). [2025-10-01T21:57:41.321573] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-01T21:57:41.399953] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:41.429343] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-01T21:57:41.436090] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-01T21:57:41.473564] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-01T21:57:41.501044] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-01T21:57:41.582454] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-01T21:57:41.665445] [DEBUG] [LOCAL ] TME: Primary data saved (53192 records). [2025-10-01T21:57:41.755676] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-01T21:57:41.733791] [INFO ] [MAIN ] TME: Full history saved. [2025-10-01T21:57:41.803318] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TME took 37.4s. Estimated remaining: 37m 27s. Rate: 7.1 symbols/min [2025-10-01T21:57:42.337546] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:42.438240] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-01T21:57:42.444468] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-01T21:57:42.454205] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-01T21:57:42.461993] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-01T21:57:42.551867] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:42.552249] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-01T21:57:42.548380] [DEBUG] [LOCAL ] TM: Trimmed 52849 records to 36397 (keeping 200 days of data) [2025-10-01T21:57:42.694428] [DEBUG] [LOCAL ] TNET: Loaded 28638 existing records from primary storage. [2025-10-01T21:57:42.698405] [INFO ] [MAIN ] TNET: Loaded 28638 existing records. [2025-10-01T21:57:42.846104] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-01T21:57:42.891959] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-01T21:57:42.963707] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:42.964146] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-01T21:57:42.964214] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-01T21:57:43.007315] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-01T21:57:43.015909] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-01T21:57:43.184210] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T21:57:43.219155] [INFO ] [REMOTE ] TMO: Full fetch complete (75486 records). [2025-10-01T21:57:43.231789] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-01T21:57:43.727292] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:43.741038] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-01T21:57:43.790499] [DEBUG] [LOCAL ] TM: Primary data saved (36397 records). [2025-10-01T21:57:43.816778] [INFO ] [MAIN ] TM: Full history saved. [2025-10-01T21:57:43.839392] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TM took 41.2s. Estimated remaining: 37m 18s. Rate: 7.1 symbols/min [2025-10-01T21:57:43.873515] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T21:57:44.102725] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-01T21:57:44.156153] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-01T21:57:44.189804] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-01T21:57:44.194883] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:44.196386] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-01T21:57:44.196540] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-01T21:57:44.196685] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-01T21:57:44.196997] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-01T21:57:44.197178] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-01T21:57:44.197257] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-01T21:57:44.197682] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-01T21:57:44.197740] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-01T21:57:44.277204] [DEBUG] [LOCAL ] TMO: Trimmed 75486 records to 52345 (keeping 200 days of data) [2025-10-01T21:57:44.741264] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:44.771887] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T21:57:44.902503] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-01T21:57:45.016779] [DEBUG] [LOCAL ] TMO: Primary data saved (52345 records). [2025-10-01T21:57:45.016935] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-01T21:57:45.017041] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TMO took 32.6s. Estimated remaining: 37m 8s. Rate: 7.1 symbols/min [2025-10-01T21:57:45.206320] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:45.215844] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T21:57:45.255478] [DEBUG] [LOCAL ] TNK: Loaded 35161 existing records from primary storage. [2025-10-01T21:57:45.255791] [INFO ] [MAIN ] TNK: Loaded 35161 existing records. [2025-10-01T21:57:45.449556] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:45.449813] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-01T21:57:45.449869] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-01T21:57:45.450815] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-01T21:57:45.450882] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-01T21:57:45.704453] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-01T21:57:45.867599] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:45.887828] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-01T21:57:46.502364] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-01T21:57:46.786396] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-01T21:57:47.302359] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-01T21:57:47.459587] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T21:57:48.102378] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-01T21:57:48.641715] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T21:57:48.902390] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-01T21:57:49.563017] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-01T21:57:49.702364] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-01T21:57:49.950180] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T21:57:50.502392] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-01T21:57:51.093307] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T21:57:51.302357] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-01T21:57:51.440921] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-01T21:57:51.545450] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T21:57:51.545803] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-01T21:57:51.545894] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T21:57:51.545942] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-01T21:57:51.545978] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T21:57:51.546017] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-01T21:57:51.546073] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-01T21:57:51.546147] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-01T21:57:51.546224] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-01T21:57:51.546296] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNGY took 7.7s. Estimated remaining: 36m 60s. Rate: 7.1 symbols/min [2025-10-01T21:57:51.734358] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:57:51.778204] [DEBUG] [LOCAL ] TNL: Loaded 41767 existing records from primary storage. [2025-10-01T21:57:51.778717] [INFO ] [MAIN ] TNL: Loaded 41767 existing records. [2025-10-01T21:57:51.982128] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:57:51.982338] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-01T21:57:51.982387] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-01T21:57:51.983242] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-01T21:57:51.983305] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-01T21:57:52.103433] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-01T21:57:52.386809] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:57:52.902365] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-01T21:57:53.110399] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-01T21:57:53.702392] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-01T21:57:54.107416] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T21:57:54.502354] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-01T21:57:54.664932] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T21:57:55.302403] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-01T21:57:56.001507] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T21:57:56.102396] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-01T21:57:56.554348] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T21:57:56.902394] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-01T21:57:57.118712] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T21:57:57.702391] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-01T21:57:57.740064] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-01T21:57:58.502388] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-01T21:57:59.157827] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T21:57:59.302382] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-01T21:57:59.994835] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T21:58:00.102395] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-01T21:58:00.546950] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T21:58:00.902388] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-01T21:58:01.626463] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T21:58:01.702363] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-01T21:58:02.038852] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-01T21:58:02.502372] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-01T21:58:03.154055] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T21:58:03.302370] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-01T21:58:03.357769] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T21:58:04.102395] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-01T21:58:04.523735] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-01T21:58:04.683540] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-01T21:58:04.684472] [INFO ] [REMOTE ] TNC: Full fetch complete (22965 records). [2025-10-01T21:58:04.684551] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-01T21:58:04.907542] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-01T21:58:05.107900] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-01T21:58:05.108019] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-01T21:58:05.108558] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-01T21:58:05.108605] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-01T21:58:05.109330] [DEBUG] [LOCAL ] TNC: Trimmed 22965 records to 14841 (keeping 200 days of data) [2025-10-01T21:58:05.204005] [DEBUG] [LOCAL ] TNC: Primary data saved (14841 records). [2025-10-01T21:58:05.204164] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-01T21:58:05.204343] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNC took 24.4s. Estimated remaining: 36m 52s. Rate: 7.1 symbols/min [2025-10-01T21:58:05.405227] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:58:05.459057] [DEBUG] [LOCAL ] TOL: Loaded 50887 existing records from primary storage. [2025-10-01T21:58:05.459415] [INFO ] [MAIN ] TOL: Loaded 50887 existing records. [2025-10-01T21:58:05.664481] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:58:05.664721] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-01T21:58:05.664779] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-01T21:58:05.667048] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-01T21:58:05.667119] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-01T21:58:05.707513] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-01T21:58:06.081126] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:58:06.507748] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-01T21:58:06.520061] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T21:58:07.103532] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T21:58:07.302441] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-01T21:58:08.102402] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-01T21:58:08.373996] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T21:58:08.619724] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T21:58:08.902373] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-01T21:58:09.588713] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T21:58:09.589874] [INFO ] [REMOTE ] TNET: Full fetch complete (41716 records). [2025-10-01T21:58:09.589976] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-01T21:58:09.703606] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-01T21:58:09.941455] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:58:10.069344] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-01T21:58:10.069442] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-01T21:58:10.070314] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-01T21:58:10.070378] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-01T21:58:10.071414] [DEBUG] [LOCAL ] TNET: Trimmed 41716 records to 28523 (keeping 200 days of data) [2025-10-01T21:58:10.256499] [DEBUG] [LOCAL ] TNET: Primary data saved (28523 records). [2025-10-01T21:58:10.256684] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-01T21:58:10.256838] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNET took 28.4s. Estimated remaining: 36m 43s. Rate: 7.1 symbols/min [2025-10-01T21:58:10.460232] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:58:10.510170] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-01T21:58:10.513950] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-10-01T21:58:10.514355] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-10-01T21:58:10.714877] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:58:10.715031] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-01T21:58:10.715082] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-01T21:58:10.716202] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-01T21:58:10.716269] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-01T21:58:11.129844] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:58:11.150702] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T21:58:11.302404] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-01T21:58:12.102374] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-01T21:58:12.350464] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T21:58:12.902425] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-01T21:58:13.293100] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T21:58:13.535889] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T21:58:13.702410] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-01T21:58:14.502359] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-01T21:58:14.625766] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T21:58:15.068726] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T21:58:15.302423] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-01T21:58:16.102385] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-01T21:58:16.248987] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-01T21:58:16.734084] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T21:58:16.902397] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-01T21:58:17.702366] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-01T21:58:17.947317] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:58:18.502384] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-01T21:58:18.714293] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T21:58:18.716630] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T21:58:18.731012] [INFO ] [REMOTE ] TNK: Full fetch complete (51870 records). [2025-10-01T21:58:18.731972] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-01T21:58:19.160135] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-01T21:58:19.160222] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-01T21:58:19.161202] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-01T21:58:19.161291] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-01T21:58:19.162580] [DEBUG] [LOCAL ] TNK: Trimmed 51870 records to 35156 (keeping 200 days of data) [2025-10-01T21:58:19.334827] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-01T21:58:19.393428] [DEBUG] [LOCAL ] TNK: Primary data saved (35156 records). [2025-10-01T21:58:19.393587] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-01T21:58:19.393711] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNK took 34.4s. Estimated remaining: 36m 35s. Rate: 7.1 symbols/min [2025-10-01T21:58:19.590912] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:58:19.615723] [DEBUG] [LOCAL ] TPB: Loaded 25036 existing records from primary storage. [2025-10-01T21:58:19.615999] [INFO ] [MAIN ] TPB: Loaded 25036 existing records. [2025-10-01T21:58:19.812190] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:58:19.812414] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-01T21:58:19.812464] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-01T21:58:19.813121] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-01T21:58:19.813184] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-01T21:58:20.107492] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-01T21:58:20.215198] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:58:20.439045] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T21:58:20.902395] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-01T21:58:21.301004] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T21:58:21.341114] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T21:58:21.702427] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-01T21:58:22.502425] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-01T21:58:22.744394] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T21:58:23.302368] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-01T21:58:23.648551] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T21:58:23.721045] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T21:58:24.102425] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-01T21:58:24.902361] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-01T21:58:24.954440] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T21:58:25.237511] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T21:58:25.702424] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-01T21:58:26.433105] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T21:58:26.502429] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-01T21:58:27.302413] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-01T21:58:27.668517] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-01T21:58:28.102393] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-01T21:58:28.352311] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T21:58:28.904221] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-01T21:58:28.910259] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-01T21:58:29.702400] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-01T21:58:29.860868] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T21:58:30.021823] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-01T21:58:30.502388] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-01T21:58:30.953194] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-01T21:58:31.243043] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T21:58:31.302418] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-01T21:58:31.596491] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T21:58:31.598611] [INFO ] [REMOTE ] TOL: Full fetch complete (73789 records). [2025-10-01T21:58:31.598819] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-01T21:58:32.074178] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-01T21:58:32.074258] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-01T21:58:32.075357] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-01T21:58:32.075422] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-01T21:58:32.076890] [DEBUG] [LOCAL ] TOL: Trimmed 73789 records to 50831 (keeping 200 days of data) [2025-10-01T21:58:32.134409] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-01T21:58:32.417771] [DEBUG] [LOCAL ] TOL: Primary data saved (50831 records). [2025-10-01T21:58:32.417954] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-01T21:58:32.418113] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TOL took 27.2s. Estimated remaining: 36m 27s. Rate: 7.1 symbols/min [2025-10-01T21:58:32.610292] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:58:32.654221] [DEBUG] [LOCAL ] TPC: Loaded 38730 existing records from primary storage. [2025-10-01T21:58:32.654522] [INFO ] [MAIN ] TPC: Loaded 38730 existing records. [2025-10-01T21:58:32.846792] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:58:32.847036] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-01T21:58:32.847088] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-01T21:58:32.848035] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-01T21:58:32.848183] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-01T21:58:32.912514] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-01T21:58:33.269344] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:58:33.702410] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-01T21:58:34.338858] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-01T21:58:34.497472] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T21:58:34.505595] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-01T21:58:34.783465] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-01T21:58:35.302456] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-01T21:58:36.102383] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-01T21:58:36.472494] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-01T21:58:36.696700] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T21:58:36.902389] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-01T21:58:37.085137] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-01T21:58:37.086559] [INFO ] [REMOTE ] TNL: Full fetch complete (58958 records). [2025-10-01T21:58:37.086682] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-01T21:58:37.516142] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-01T21:58:37.516275] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-01T21:58:37.517302] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-01T21:58:37.517369] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-01T21:58:37.518979] [DEBUG] [LOCAL ] TNL: Trimmed 58958 records to 41731 (keeping 200 days of data) [2025-10-01T21:58:37.704707] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-01T21:58:37.791091] [DEBUG] [LOCAL ] TNL: Primary data saved (41731 records). [2025-10-01T21:58:37.791224] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-01T21:58:37.791331] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TNL took 46.2s. Estimated remaining: 36m 18s. Rate: 7.1 symbols/min [2025-10-01T21:58:37.992831] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:58:38.039848] [DEBUG] [LOCAL ] TPH: Loaded 45002 existing records from primary storage. [2025-10-01T21:58:38.040218] [INFO ] [MAIN ] TPH: Loaded 45002 existing records. [2025-10-01T21:58:38.251364] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:58:38.251871] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-01T21:58:38.251935] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-01T21:58:38.253306] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-01T21:58:38.253376] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-01T21:58:38.510468] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-01T21:58:38.710381] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:58:38.735058] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-01T21:58:38.777863] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T21:58:39.302411] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-01T21:58:39.581973] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T21:58:40.102393] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-01T21:58:40.877424] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T21:58:40.902486] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-01T21:58:41.702440] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-01T21:58:41.808737] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-01T21:58:42.165494] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-01T21:58:42.502400] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-01T21:58:42.830902] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T21:58:43.302408] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-01T21:58:43.606367] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T21:58:44.102378] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-01T21:58:44.441555] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-01T21:58:44.902400] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-01T21:58:45.702377] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-01T21:58:45.822720] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T21:58:45.966111] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T21:58:46.502365] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-01T21:58:46.879427] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T21:58:47.302385] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-01T21:58:47.847148] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-01T21:58:48.102383] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-01T21:58:48.597115] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T21:58:48.902389] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-01T21:58:49.702354] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-01T21:58:49.829519] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-01T21:58:50.166333] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T21:58:50.502386] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-01T21:58:51.111449] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T21:58:51.302390] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-01T21:58:51.777591] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-01T21:58:51.779333] [INFO ] [REMOTE ] TOST: Full fetch complete (77699 records). [2025-10-01T21:58:51.779448] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-01T21:58:52.109085] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-01T21:58:52.217717] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-01T21:58:52.217811] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-01T21:58:52.218978] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-01T21:58:52.219045] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-01T21:58:52.220737] [DEBUG] [LOCAL ] TOST: Trimmed 77699 records to 53681 (keeping 200 days of data) [2025-10-01T21:58:52.560428] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-10-01T21:58:52.560593] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-01T21:58:52.560725] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TOST took 42.3s. Estimated remaining: 36m 10s. Rate: 7.1 symbols/min [2025-10-01T21:58:52.750957] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:58:52.765339] [DEBUG] [LOCAL ] TPL: Loaded 12274 existing records from primary storage. [2025-10-01T21:58:52.765592] [INFO ] [MAIN ] TPL: Loaded 12274 existing records. [2025-10-01T21:58:52.906027] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-01T21:58:53.002342] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:58:53.005536] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T21:58:53.005865] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-01T21:58:53.022252] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-01T21:58:53.023093] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-01T21:58:53.023173] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-01T21:58:53.418907] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:58:53.702383] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-01T21:58:53.777107] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T21:58:54.294147] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-01T21:58:54.502376] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-01T21:58:55.302380] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-01T21:58:55.346711] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T21:58:55.535048] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T21:58:56.102352] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-01T21:58:56.459046] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T21:58:56.902353] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-01T21:58:57.149841] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T21:58:57.702379] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-01T21:58:58.418445] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T21:58:58.502376] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-01T21:58:59.226802] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T21:58:59.290412] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-01T21:58:59.291718] [INFO ] [REMOTE ] TPC: Full fetch complete (55140 records). [2025-10-01T21:58:59.291822] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-01T21:58:59.307526] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-01T21:58:59.712675] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-01T21:58:59.712785] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-01T21:58:59.713856] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-01T21:58:59.713931] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-01T21:58:59.715315] [DEBUG] [LOCAL ] TPC: Trimmed 55140 records to 38735 (keeping 200 days of data) [2025-10-01T21:58:59.953217] [DEBUG] [LOCAL ] TPC: Primary data saved (38735 records). [2025-10-01T21:58:59.953363] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-01T21:58:59.953461] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TPC took 27.5s. Estimated remaining: 36m 2s. Rate: 7.1 symbols/min [2025-10-01T21:59:00.112802] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-01T21:59:00.148246] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:00.202394] [DEBUG] [LOCAL ] TPR: Loaded 53468 existing records from primary storage. [2025-10-01T21:59:00.202752] [INFO ] [MAIN ] TPR: Loaded 53468 existing records. [2025-10-01T21:59:00.399204] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:00.399410] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-01T21:59:00.399459] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-01T21:59:00.401428] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-01T21:59:00.401492] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-01T21:59:00.807221] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:00.834492] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T21:59:00.902346] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-01T21:59:01.042352] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T21:59:01.702373] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-01T21:59:02.484417] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T21:59:02.502350] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-01T21:59:02.680312] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T21:59:03.302392] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-01T21:59:04.102407] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-01T21:59:04.172616] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T21:59:04.902358] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-01T21:59:04.973090] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T21:59:04.974262] [INFO ] [REMOTE ] TPB: Full fetch complete (35017 records). [2025-10-01T21:59:04.974335] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-01T21:59:05.417524] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T21:59:05.458545] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-01T21:59:05.458625] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-01T21:59:05.459352] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-01T21:59:05.459404] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-01T21:59:05.460321] [DEBUG] [LOCAL ] TPB: Trimmed 35017 records to 25047 (keeping 200 days of data) [2025-10-01T21:59:05.620854] [DEBUG] [LOCAL ] TPB: Primary data saved (25047 records). [2025-10-01T21:59:05.620987] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-01T21:59:05.621075] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPB took 46.2s. Estimated remaining: 35m 53s. Rate: 7.1 symbols/min [2025-10-01T21:59:05.702422] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-01T21:59:06.400876] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T21:59:06.502399] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-01T21:59:07.302409] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-01T21:59:07.466959] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T21:59:07.603977] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-01T21:59:07.606209] [INFO ] [REMOTE ] TPH: Full fetch complete (64933 records). [2025-10-01T21:59:07.606456] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-01T21:59:08.044801] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-01T21:59:08.044993] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-01T21:59:08.046063] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-01T21:59:08.046129] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-01T21:59:08.047574] [DEBUG] [LOCAL ] TPH: Trimmed 64933 records to 44944 (keeping 200 days of data) [2025-10-01T21:59:08.107005] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-01T21:59:08.287971] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T21:59:08.342590] [DEBUG] [LOCAL ] TPH: Primary data saved (44944 records). [2025-10-01T21:59:08.342761] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-01T21:59:08.342857] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPH took 30.6s. Estimated remaining: 35m 44s. Rate: 7.1 symbols/min [2025-10-01T21:59:08.902414] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-01T21:59:09.852049] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T21:59:09.855965] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-01T21:59:10.074484] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T21:59:10.502372] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-01T21:59:10.976767] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T21:59:11.302406] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-01T21:59:12.305522] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-01T21:59:12.309907] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-01T21:59:12.343882] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T21:59:12.902351] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-01T21:59:13.010623] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-01T21:59:13.702388] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-01T21:59:14.440564] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T21:59:14.502348] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-01T21:59:14.574684] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T21:59:15.302378] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-01T21:59:15.850687] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-01T21:59:15.851518] [INFO ] [REMOTE ] TPL: Full fetch complete (17886 records). [2025-10-01T21:59:15.851591] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-01T21:59:16.262781] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-01T21:59:16.262916] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-01T21:59:16.263718] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-01T21:59:16.263807] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-01T21:59:16.264531] [DEBUG] [LOCAL ] TPL: Trimmed 17886 records to 12298 (keeping 200 days of data) [2025-10-01T21:59:16.351539] [DEBUG] [LOCAL ] TPL: Primary data saved (12298 records). [2025-10-01T21:59:16.351708] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-01T21:59:16.351825] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 23.8s. Estimated remaining: 35m 35s. Rate: 7.1 symbols/min [2025-10-01T21:59:16.425943] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T21:59:16.437460] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-01T21:59:18.054406] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T21:59:18.066752] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-01T21:59:20.027470] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T21:59:20.039954] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-01T21:59:21.965236] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T21:59:21.976707] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-01T21:59:23.877331] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-01T21:59:23.889413] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-01T21:59:25.234230] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-01T21:59:25.235820] [INFO ] [REMOTE ] TPR: Full fetch complete (77426 records). [2025-10-01T21:59:25.235934] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-01T21:59:25.669548] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-01T21:59:25.669633] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-01T21:59:25.670914] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-01T21:59:25.670982] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-01T21:59:25.672514] [DEBUG] [LOCAL ] TPR: Trimmed 77426 records to 53466 (keeping 200 days of data) [2025-10-01T21:59:26.019379] [DEBUG] [LOCAL ] TPR: Primary data saved (53466 records). [2025-10-01T21:59:26.019529] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-01T21:59:26.019633] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 26.1s. Estimated remaining: 35m 27s. Rate: 7.1 symbols/min [2025-10-01T21:59:26.626138] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:26.695066] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:26.787570] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:26.792556] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:26.800464] [DEBUG] [LOCAL ] TPZ: Loaded 4975 existing records from primary storage. [2025-10-01T21:59:26.800806] [INFO ] [MAIN ] TPZ: Loaded 4975 existing records. [2025-10-01T21:59:26.917970] [DEBUG] [LOCAL ] TPYP: Loaded 7918 existing records from primary storage. [2025-10-01T21:59:26.930403] [INFO ] [MAIN ] TPYP: Loaded 7918 existing records. [2025-10-01T21:59:26.966376] [DEBUG] [LOCAL ] TR: Loaded 18422 existing records from primary storage. [2025-10-01T21:59:27.003825] [INFO ] [MAIN ] TR: Loaded 18422 existing records. [2025-10-01T21:59:26.998083] [DEBUG] [LOCAL ] TPVG: Loaded 26983 existing records from primary storage. [2025-10-01T21:59:27.202129] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:27.176809] [INFO ] [MAIN ] TPVG: Loaded 26983 existing records. [2025-10-01T21:59:27.295340] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-01T21:59:27.343531] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-01T21:59:27.443509] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-01T21:59:27.517126] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-01T21:59:27.485608] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:27.615384] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-01T21:59:27.661788] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:27.746674] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-01T21:59:27.746607] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:27.743436] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-01T21:59:27.757316] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-01T21:59:27.757434] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-01T21:59:27.757951] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-01T21:59:27.768371] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-01T21:59:27.773638] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-01T21:59:27.757916] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-01T21:59:27.778871] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-01T21:59:27.896218] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-01T21:59:28.040452] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-01T21:59:28.784029] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:28.898119] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-01T21:59:28.952306] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:29.006983] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-01T21:59:29.177316] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:29.180665] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-01T21:59:29.269177] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:29.269463] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-01T21:59:29.553775] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T21:59:29.556470] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-01T21:59:29.750889] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-01T21:59:29.753265] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-01T21:59:30.027549] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T21:59:30.030979] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-01T21:59:30.305597] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T21:59:30.313587] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-01T21:59:30.384146] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-01T21:59:30.387240] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-01T21:59:30.396053] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T21:59:30.399748] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-01T21:59:30.713730] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T21:59:30.717731] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-01T21:59:30.902468] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-01T21:59:30.905187] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-01T21:59:31.189311] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T21:59:31.191561] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-01T21:59:31.339598] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-01T21:59:31.346027] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-01T21:59:31.575452] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T21:59:31.580990] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-01T21:59:31.615380] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T21:59:31.789195] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T21:59:32.102444] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-01T21:59:32.511223] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-01T21:59:32.587083] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-01T21:59:32.902433] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-01T21:59:33.065950] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T21:59:33.702400] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-01T21:59:33.966076] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-01T21:59:34.247580] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T21:59:34.502387] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-01T21:59:35.302416] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-01T21:59:35.828543] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T21:59:36.095451] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T21:59:36.102328] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-01T21:59:36.662774] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-01T21:59:36.902383] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-01T21:59:37.630583] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T21:59:37.702420] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-01T21:59:38.305832] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T21:59:38.502381] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-01T21:59:39.302390] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-01T21:59:39.642946] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T21:59:39.983702] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T21:59:40.102359] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-01T21:59:40.839979] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T21:59:40.902406] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-01T21:59:41.702415] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-01T21:59:42.263062] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T21:59:42.334230] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-01T21:59:42.502425] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-01T21:59:43.302362] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-01T21:59:43.694930] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T21:59:44.102377] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-01T21:59:44.357798] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T21:59:44.902390] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-01T21:59:45.409284] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T21:59:45.422178] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-01T21:59:45.702403] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-01T21:59:46.067800] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-01T21:59:46.068614] [INFO ] [REMOTE ] TPYP: Full fetch complete (12588 records). [2025-10-01T21:59:46.068719] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-01T21:59:46.479085] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-01T21:59:46.479164] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-01T21:59:46.479498] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-01T21:59:46.479559] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-01T21:59:46.480102] [DEBUG] [LOCAL ] TPYP: Trimmed 12588 records to 7913 (keeping 200 days of data) [2025-10-01T21:59:46.504613] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-01T21:59:46.535316] [DEBUG] [LOCAL ] TPYP: Primary data saved (7913 records). [2025-10-01T21:59:46.535816] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-01T21:59:46.535918] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPYP took 20.5s. Estimated remaining: 35m 20s. Rate: 7.1 symbols/min [2025-10-01T21:59:46.751975] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:46.763750] [DEBUG] [LOCAL ] TRAK: Loaded 9319 existing records from primary storage. [2025-10-01T21:59:46.764034] [INFO ] [MAIN ] TRAK: Loaded 9319 existing records. [2025-10-01T21:59:46.958764] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-01T21:59:46.984532] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:46.984922] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-01T21:59:46.984975] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-01T21:59:46.985579] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-01T21:59:46.985640] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-01T21:59:47.308577] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-01T21:59:47.404428] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:48.102392] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-01T21:59:48.482302] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T21:59:48.600000] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-01T21:59:48.902394] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-01T21:59:49.683311] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T21:59:49.702413] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-01T21:59:50.502380] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-01T21:59:50.722287] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T21:59:51.298430] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T21:59:51.302333] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-01T21:59:52.102360] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-01T21:59:52.110749] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T21:59:52.902353] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-01T21:59:53.132751] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T21:59:53.487923] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T21:59:53.702433] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-01T21:59:54.502419] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-01T21:59:54.899352] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T21:59:55.245339] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-01T21:59:55.246417] [INFO ] [REMOTE ] TR: Full fetch complete (25127 records). [2025-10-01T21:59:55.246493] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-01T21:59:55.307492] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-01T21:59:55.654147] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-01T21:59:55.654274] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-01T21:59:55.654836] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-01T21:59:55.654899] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-01T21:59:55.655665] [DEBUG] [LOCAL ] TR: Trimmed 25127 records to 18492 (keeping 200 days of data) [2025-10-01T21:59:55.779740] [DEBUG] [LOCAL ] TR: Primary data saved (18492 records). [2025-10-01T21:59:55.779923] [INFO ] [MAIN ] TR: Full history saved. [2025-10-01T21:59:55.780087] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TR took 29.8s. Estimated remaining: 35m 11s. Rate: 7.1 symbols/min [2025-10-01T21:59:55.971030] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:55.989312] [DEBUG] [LOCAL ] TRC: Loaded 15798 existing records from primary storage. [2025-10-01T21:59:55.989546] [INFO ] [MAIN ] TRC: Loaded 15798 existing records. [2025-10-01T21:59:56.107592] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-01T21:59:56.208008] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:56.208268] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-01T21:59:56.208345] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-01T21:59:56.208944] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-01T21:59:56.209018] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-01T21:59:56.528160] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-01T21:59:56.557392] [INFO ] [REMOTE ] TPZ: Full fetch complete (9174 records). [2025-10-01T21:59:56.561500] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-01T21:59:56.756551] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:56.907492] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-01T21:59:56.996429] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-01T21:59:57.130761] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-01T21:59:57.130860] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-01T21:59:57.131154] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-01T21:59:57.131241] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-01T21:59:57.132024] [DEBUG] [LOCAL ] TPZ: Trimmed 9174 records to 4914 (keeping 200 days of data) [2025-10-01T21:59:57.167096] [DEBUG] [LOCAL ] TPZ: Primary data saved (4914 records). [2025-10-01T21:59:57.167236] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-01T21:59:57.167327] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TPZ took 31.1s. Estimated remaining: 35m 2s. Rate: 7.1 symbols/min [2025-10-01T21:59:57.352158] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T21:59:57.419279] [DEBUG] [LOCAL ] TREX: Loaded 49961 existing records from primary storage. [2025-10-01T21:59:57.419592] [INFO ] [MAIN ] TREX: Loaded 49961 existing records. [2025-10-01T21:59:57.614812] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T21:59:57.615064] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-01T21:59:57.615114] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-01T21:59:57.616114] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-01T21:59:57.616175] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-01T21:59:57.703734] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-01T21:59:57.810486] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T21:59:58.028980] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T21:59:58.502366] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-01T21:59:59.100809] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T21:59:59.302386] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-01T22:00:00.102367] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-01T22:00:00.190670] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T22:00:00.395208] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T22:00:00.829128] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T22:00:00.902397] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-01T22:00:01.635509] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-01T22:00:01.702435] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-01T22:00:02.502400] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-01T22:00:03.281631] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T22:00:03.302347] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-01T22:00:03.459201] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-01T22:00:03.460400] [INFO ] [REMOTE ] TPVG: Full fetch complete (40468 records). [2025-10-01T22:00:03.460504] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-01T22:00:03.896880] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-01T22:00:03.896967] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-01T22:00:03.897950] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-01T22:00:03.898044] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-01T22:00:03.899285] [DEBUG] [LOCAL ] TPVG: Trimmed 40468 records to 26947 (keeping 200 days of data) [2025-10-01T22:00:04.074660] [DEBUG] [LOCAL ] TPVG: Primary data saved (26947 records). [2025-10-01T22:00:04.074821] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-01T22:00:04.074920] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPVG took 38.1s. Estimated remaining: 34m 53s. Rate: 7.1 symbols/min [2025-10-01T22:00:04.111915] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-01T22:00:04.284736] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:00:04.345975] [DEBUG] [LOCAL ] TRGP: Loaded 50701 existing records from primary storage. [2025-10-01T22:00:04.346418] [INFO ] [MAIN ] TRGP: Loaded 50701 existing records. [2025-10-01T22:00:04.557303] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:00:04.557547] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-01T22:00:04.557601] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-01T22:00:04.559048] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-01T22:00:04.559112] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-01T22:00:04.905599] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-01T22:00:04.983276] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:00:04.992837] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T22:00:05.021965] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T22:00:05.702393] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-01T22:00:05.801409] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T22:00:06.295517] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T22:00:06.502375] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-01T22:00:07.146811] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T22:00:07.302419] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-01T22:00:08.102398] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-01T22:00:08.902429] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-01T22:00:09.006219] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-01T22:00:09.276357] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T22:00:09.488090] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-01T22:00:09.489013] [INFO ] [REMOTE ] TRAK: Full fetch complete (13502 records). [2025-10-01T22:00:09.489103] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-01T22:00:09.708083] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-01T22:00:09.888574] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-01T22:00:09.888700] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-01T22:00:09.889034] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-01T22:00:09.889077] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-01T22:00:09.889672] [DEBUG] [LOCAL ] TRAK: Trimmed 13502 records to 9422 (keeping 200 days of data) [2025-10-01T22:00:09.951228] [DEBUG] [LOCAL ] TRAK: Primary data saved (9422 records). [2025-10-01T22:00:09.951370] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-01T22:00:09.951477] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRAK took 23.4s. Estimated remaining: 34m 45s. Rate: 7.1 symbols/min [2025-10-01T22:00:10.141110] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:00:10.178903] [DEBUG] [LOCAL ] TRN: Loaded 37089 existing records from primary storage. [2025-10-01T22:00:10.179215] [INFO ] [MAIN ] TRN: Loaded 37089 existing records. [2025-10-01T22:00:10.374675] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:00:10.374957] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-01T22:00:10.375022] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-01T22:00:10.376164] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-01T22:00:10.376227] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-01T22:00:10.507496] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-01T22:00:10.771026] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:00:11.302400] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-01T22:00:12.102387] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-01T22:00:12.562829] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-01T22:00:12.802739] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (3.09 seconds). [2025-10-01T22:00:12.902410] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-01T22:00:13.350589] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-01T22:00:13.703600] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-01T22:00:13.708392] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T22:00:14.426213] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T22:00:14.502412] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-01T22:00:14.905269] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T22:00:15.302378] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-01T22:00:16.102357] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-01T22:00:16.184187] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T22:00:16.902368] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-01T22:00:17.000360] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T22:00:17.087117] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T22:00:17.702444] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-01T22:00:18.291192] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T22:00:18.502396] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-01T22:00:18.690397] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-01T22:00:19.302410] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-01T22:00:20.102397] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-01T22:00:20.184107] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T22:00:20.907715] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-01T22:00:20.927951] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T22:00:20.977968] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-01T22:00:21.702424] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-01T22:00:22.502358] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-01T22:00:22.663710] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T22:00:22.825886] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T22:00:23.302443] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-01T22:00:23.975790] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T22:00:24.102356] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-01T22:00:24.356411] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T22:00:24.902452] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-01T22:00:25.556010] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T22:00:25.557930] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T22:00:25.568699] [INFO ] [REMOTE ] TRC: Full fetch complete (22074 records). [2025-10-01T22:00:25.570003] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-01T22:00:25.707620] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-01T22:00:26.069505] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-01T22:00:26.069598] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-01T22:00:26.070116] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-01T22:00:26.070179] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-01T22:00:26.071183] [DEBUG] [LOCAL ] TRC: Trimmed 22074 records to 15736 (keeping 200 days of data) [2025-10-01T22:00:26.168245] [DEBUG] [LOCAL ] TRC: Primary data saved (15736 records). [2025-10-01T22:00:26.168395] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-01T22:00:26.168504] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 30.4s. Estimated remaining: 34m 37s. Rate: 7.1 symbols/min [2025-10-01T22:00:26.361924] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:00:26.406250] [DEBUG] [LOCAL ] TRNO: Loaded 43946 existing records from primary storage. [2025-10-01T22:00:26.406669] [INFO ] [MAIN ] TRNO: Loaded 43946 existing records. [2025-10-01T22:00:26.510918] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-01T22:00:26.607373] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:00:26.607584] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-01T22:00:26.607634] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-01T22:00:26.608630] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-01T22:00:26.608790] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-01T22:00:26.997749] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:00:27.021907] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T22:00:27.302421] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-01T22:00:28.102394] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-01T22:00:28.272529] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T22:00:28.902373] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-01T22:00:29.062574] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T22:00:29.702380] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-01T22:00:30.502432] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-01T22:00:30.722710] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-01T22:00:31.198531] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T22:00:31.302406] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-01T22:00:31.909693] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T22:00:32.102403] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-01T22:00:32.385208] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T22:00:32.387221] [INFO ] [REMOTE ] TREX: Full fetch complete (71061 records). [2025-10-01T22:00:32.387359] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-01T22:00:32.893148] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-01T22:00:32.893239] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-01T22:00:32.894448] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-01T22:00:32.894520] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-01T22:00:32.896041] [DEBUG] [LOCAL ] TREX: Trimmed 71061 records to 49932 (keeping 200 days of data) [2025-10-01T22:00:32.902405] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-01T22:00:33.210200] [DEBUG] [LOCAL ] TREX: Primary data saved (49932 records). [2025-10-01T22:00:33.210344] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-01T22:00:33.210508] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 36.0s. Estimated remaining: 34m 28s. Rate: 7.1 symbols/min [2025-10-01T22:00:33.418116] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:00:33.470255] [DEBUG] [LOCAL ] TROX: Loaded 51863 existing records from primary storage. [2025-10-01T22:00:33.499707] [INFO ] [MAIN ] TROX: Loaded 51863 existing records. [2025-10-01T22:00:33.546676] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (5.44 seconds). [2025-10-01T22:00:33.726261] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:00:33.703517] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-01T22:00:33.726723] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-01T22:00:33.726908] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-01T22:00:33.743353] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-01T22:00:33.753695] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-01T22:00:33.790058] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T22:00:34.227870] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:00:34.307095] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T22:00:34.502389] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-01T22:00:35.302377] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-01T22:00:35.488730] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:00:36.102369] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-01T22:00:36.902366] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-01T22:00:37.279621] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T22:00:37.456784] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-01T22:00:37.702393] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-01T22:00:38.502382] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-01T22:00:38.685693] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (3.38 seconds). [2025-10-01T22:00:38.744058] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-01T22:00:39.308328] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-01T22:00:39.314595] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T22:00:40.057920] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T22:00:40.102359] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-01T22:00:40.863155] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T22:00:40.902350] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-01T22:00:41.533553] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T22:00:41.702447] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-01T22:00:42.236245] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T22:00:42.502400] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-01T22:00:42.764005] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-01T22:00:43.302387] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-01T22:00:43.850894] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-01T22:00:44.102383] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-01T22:00:44.902358] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-01T22:00:44.963233] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T22:00:44.964612] [INFO ] [REMOTE ] TRN: Full fetch complete (52804 records). [2025-10-01T22:00:44.964792] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-01T22:00:45.232637] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-01T22:00:45.471187] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-01T22:00:45.471293] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-01T22:00:45.472227] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-01T22:00:45.472292] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-01T22:00:45.473514] [DEBUG] [LOCAL ] TRN: Trimmed 52804 records to 37021 (keeping 200 days of data) [2025-10-01T22:00:45.707700] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-01T22:00:45.722864] [DEBUG] [LOCAL ] TRN: Primary data saved (37021 records). [2025-10-01T22:00:45.723035] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-01T22:00:45.723167] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRN took 35.8s. Estimated remaining: 34m 20s. Rate: 7.1 symbols/min [2025-10-01T22:00:45.914530] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:00:45.966241] [DEBUG] [LOCAL ] TRP: Loaded 52096 existing records from primary storage. [2025-10-01T22:00:45.966720] [INFO ] [MAIN ] TRP: Loaded 52096 existing records. [2025-10-01T22:00:46.166902] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:00:46.167186] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-01T22:00:46.167240] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-01T22:00:46.168469] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-01T22:00:46.168540] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-01T22:00:46.507486] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-01T22:00:46.614991] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:00:46.653937] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T22:00:47.302369] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-01T22:00:47.387186] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-01T22:00:47.772002] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-01T22:00:47.773796] [INFO ] [REMOTE ] TRGP: Full fetch complete (73479 records). [2025-10-01T22:00:47.773893] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-01T22:00:48.107470] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-01T22:00:48.201232] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-01T22:00:48.201313] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-01T22:00:48.202411] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-01T22:00:48.202481] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-01T22:00:48.204051] [DEBUG] [LOCAL ] TRGP: Trimmed 73479 records to 50698 (keeping 200 days of data) [2025-10-01T22:00:48.546435] [DEBUG] [LOCAL ] TRGP: Primary data saved (50698 records). [2025-10-01T22:00:48.546578] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-01T22:00:48.546699] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRGP took 44.5s. Estimated remaining: 34m 11s. Rate: 7.1 symbols/min [2025-10-01T22:00:48.745193] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:00:48.785259] [DEBUG] [LOCAL ] TRTX: Loaded 37480 existing records from primary storage. [2025-10-01T22:00:48.785591] [INFO ] [MAIN ] TRTX: Loaded 37480 existing records. [2025-10-01T22:00:48.904099] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-01T22:00:49.019783] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:00:49.020537] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-01T22:00:49.020680] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-01T22:00:49.022667] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-01T22:00:49.022736] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-01T22:00:49.379779] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-01T22:00:49.477585] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:00:49.707667] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-01T22:00:49.721064] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T22:00:50.502407] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-01T22:00:50.716353] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T22:00:51.302414] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-01T22:00:51.449506] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T22:00:51.956783] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T22:00:52.102394] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-01T22:00:52.518565] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T22:00:52.902381] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-01T22:00:53.702351] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-01T22:00:53.895917] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-01T22:00:54.173016] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-01T22:00:54.502372] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-01T22:00:55.090243] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T22:00:55.302373] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-01T22:00:56.107025] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-01T22:00:56.109759] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T22:00:56.902388] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-01T22:00:57.114880] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T22:00:57.454438] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-01T22:00:57.702384] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-01T22:00:58.287667] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T22:00:58.502366] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-01T22:00:59.187203] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T22:00:59.302378] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-01T22:01:00.102379] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-01T22:01:00.141038] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-01T22:01:00.662797] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T22:01:00.902454] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-01T22:01:01.702411] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-01T22:01:01.912254] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T22:01:02.405346] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T22:01:02.502415] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-01T22:01:02.574765] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T22:01:02.580201] [INFO ] [REMOTE ] TRNO: Full fetch complete (63782 records). [2025-10-01T22:01:02.580398] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-01T22:01:03.009111] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-01T22:01:03.009212] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-01T22:01:03.010225] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-01T22:01:03.010290] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-01T22:01:03.012535] [DEBUG] [LOCAL ] TRNO: Trimmed 63782 records to 43942 (keeping 200 days of data) [2025-10-01T22:01:03.297783] [DEBUG] [LOCAL ] TRNO: Primary data saved (43942 records). [2025-10-01T22:01:03.297932] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-01T22:01:03.298049] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 37.1s. Estimated remaining: 34m 3s. Rate: 7.1 symbols/min [2025-10-01T22:01:03.303531] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-01T22:01:03.503095] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:03.556794] [DEBUG] [LOCAL ] TRU: Loaded 51214 existing records from primary storage. [2025-10-01T22:01:03.557253] [INFO ] [MAIN ] TRU: Loaded 51214 existing records. [2025-10-01T22:01:03.765511] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:03.765851] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-01T22:01:03.765916] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-01T22:01:03.767947] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-01T22:01:03.768076] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-01T22:01:04.104762] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-01T22:01:04.191336] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:01:04.466085] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T22:01:04.902411] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-01T22:01:05.223830] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T22:01:05.630388] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T22:01:05.702410] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-01T22:01:06.295039] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-01T22:01:06.502377] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-01T22:01:06.854568] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T22:01:07.302414] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-01T22:01:08.102440] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-01T22:01:08.410509] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-01T22:01:08.902450] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-01T22:01:09.109899] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T22:01:09.344696] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T22:01:09.702392] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-01T22:01:10.245277] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T22:01:10.502388] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-01T22:01:11.302366] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-01T22:01:11.617067] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T22:01:12.102361] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-01T22:01:12.171038] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T22:01:12.490694] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T22:01:12.492989] [INFO ] [REMOTE ] TROX: Full fetch complete (73093 records). [2025-10-01T22:01:12.493110] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-01T22:01:12.908020] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-01T22:01:12.957501] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-01T22:01:12.957571] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-01T22:01:12.958704] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-01T22:01:12.958768] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-01T22:01:12.960690] [DEBUG] [LOCAL ] TROX: Trimmed 73093 records to 51877 (keeping 200 days of data) [2025-10-01T22:01:13.284304] [DEBUG] [LOCAL ] TROX: Primary data saved (51877 records). [2025-10-01T22:01:13.284451] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-01T22:01:13.284560] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 40.1s. Estimated remaining: 33m 55s. Rate: 7.1 symbols/min [2025-10-01T22:01:13.489145] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:13.536992] [DEBUG] [LOCAL ] TRV: Loaded 47872 existing records from primary storage. [2025-10-01T22:01:13.537324] [INFO ] [MAIN ] TRV: Loaded 47872 existing records. [2025-10-01T22:01:13.705912] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-01T22:01:13.779233] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:13.775566] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T22:01:13.789780] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-01T22:01:13.790551] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-01T22:01:13.792308] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-01T22:01:13.792382] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-01T22:01:14.198058] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:01:14.410840] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T22:01:14.502346] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-01T22:01:15.302396] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-01T22:01:15.369030] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T22:01:16.102402] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-01T22:01:16.404636] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-01T22:01:16.746607] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T22:01:16.902430] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-01T22:01:17.637116] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T22:01:17.702462] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-01T22:01:18.401156] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T22:01:18.502377] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-01T22:01:19.302434] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-01T22:01:19.388708] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-01T22:01:19.390208] [INFO ] [REMOTE ] TRTX: Full fetch complete (53483 records). [2025-10-01T22:01:19.390306] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-01T22:01:19.856351] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-01T22:01:19.856221] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-01T22:01:19.856544] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-01T22:01:19.867430] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-01T22:01:19.867719] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-01T22:01:19.869367] [DEBUG] [LOCAL ] TRTX: Trimmed 53483 records to 37574 (keeping 200 days of data) [2025-10-01T22:01:20.095409] [DEBUG] [LOCAL ] TRTX: Primary data saved (37574 records). [2025-10-01T22:01:20.095560] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-01T22:01:20.095670] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRTX took 31.5s. Estimated remaining: 33m 46s. Rate: 7.1 symbols/min [2025-10-01T22:01:20.107830] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-01T22:01:20.297844] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:20.349943] [DEBUG] [LOCAL ] TS: Loaded 51673 existing records from primary storage. [2025-10-01T22:01:20.350283] [INFO ] [MAIN ] TS: Loaded 51673 existing records. [2025-10-01T22:01:20.578405] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:20.578695] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-01T22:01:20.578772] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-01T22:01:20.580078] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-01T22:01:20.580167] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-01T22:01:20.907198] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-01T22:01:21.045446] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:01:21.078432] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T22:01:21.566988] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T22:01:21.702436] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-01T22:01:22.158605] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-01T22:01:22.160987] [INFO ] [REMOTE ] TRP: Full fetch complete (75565 records). [2025-10-01T22:01:22.161230] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-01T22:01:22.507691] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-01T22:01:22.665341] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-01T22:01:22.665494] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-01T22:01:22.667638] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-01T22:01:22.667775] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-01T22:01:22.670092] [DEBUG] [LOCAL ] TRP: Trimmed 75565 records to 52101 (keeping 200 days of data) [2025-10-01T22:01:23.022236] [DEBUG] [LOCAL ] TRP: Primary data saved (52101 records). [2025-10-01T22:01:23.022395] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-01T22:01:23.022502] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRP took 37.3s. Estimated remaining: 33m 37s. Rate: 7.1 symbols/min [2025-10-01T22:01:23.225559] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:23.253635] [DEBUG] [LOCAL ] TSE: Loaded 28411 existing records from primary storage. [2025-10-01T22:01:23.254002] [INFO ] [MAIN ] TSE: Loaded 28411 existing records. [2025-10-01T22:01:23.326712] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-01T22:01:23.468502] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:23.469022] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-01T22:01:23.469158] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-01T22:01:23.469997] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-01T22:01:23.470063] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-01T22:01:23.717359] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-01T22:01:23.945898] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:01:24.102382] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-01T22:01:24.352522] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T22:01:24.902444] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-01T22:01:25.531102] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-01T22:01:25.702360] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-01T22:01:26.404613] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-01T22:01:26.502383] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-01T22:01:26.774500] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T22:01:27.302691] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-01T22:01:27.442375] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T22:01:28.102407] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-01T22:01:28.163219] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T22:01:28.460357] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T22:01:28.902386] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-01T22:01:29.702369] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-01T22:01:30.084088] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T22:01:30.166804] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T22:01:30.502421] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-01T22:01:31.212968] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T22:01:31.302398] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-01T22:01:32.102432] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-01T22:01:32.197461] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-01T22:01:32.902397] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-01T22:01:33.135892] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T22:01:33.440326] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T22:01:33.702377] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-01T22:01:34.058369] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T22:01:34.059983] [INFO ] [REMOTE ] TRU: Full fetch complete (73385 records). [2025-10-01T22:01:34.060104] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-01T22:01:34.495605] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-01T22:01:34.495744] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-01T22:01:34.497000] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-01T22:01:34.497071] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-01T22:01:34.498738] [DEBUG] [LOCAL ] TRU: Trimmed 73385 records to 51238 (keeping 200 days of data) [2025-10-01T22:01:34.555801] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-01T22:01:34.846583] [DEBUG] [LOCAL ] TRU: Primary data saved (51238 records). [2025-10-01T22:01:34.846830] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-01T22:01:34.846967] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 31.5s. Estimated remaining: 33m 29s. Rate: 7.1 symbols/min [2025-10-01T22:01:35.057703] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:35.065394] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T22:01:35.078607] [DEBUG] [LOCAL ] TSI: Loaded 7508 existing records from primary storage. [2025-10-01T22:01:35.078838] [INFO ] [MAIN ] TSI: Loaded 7508 existing records. [2025-10-01T22:01:35.276680] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:35.276933] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-01T22:01:35.277005] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-01T22:01:35.277352] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-01T22:01:35.277424] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-01T22:01:35.303675] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-01T22:01:35.755860] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:01:36.102417] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-01T22:01:36.337603] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T22:01:36.888839] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T22:01:36.902332] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-01T22:01:37.460287] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T22:01:37.702414] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-01T22:01:38.502374] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-01T22:01:38.717914] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T22:01:38.937249] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T22:01:39.229505] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T22:01:39.302421] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-01T22:01:40.102421] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-01T22:01:40.726373] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T22:01:40.902415] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-01T22:01:41.515942] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T22:01:41.702404] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-01T22:01:42.502357] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-01T22:01:42.954550] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T22:01:42.952832] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T22:01:43.127757] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T22:01:43.302385] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-01T22:01:44.102395] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-01T22:01:44.902363] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-01T22:01:45.076416] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T22:01:45.687348] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T22:01:45.702351] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-01T22:01:45.872793] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-01T22:01:46.502374] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-01T22:01:47.021141] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-01T22:01:47.098693] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T22:01:47.302392] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-01T22:01:47.955726] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T22:01:48.102391] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-01T22:01:48.902445] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-01T22:01:49.613162] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T22:01:49.702386] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-01T22:01:49.727731] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T22:01:50.502354] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-01T22:01:50.607456] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-01T22:01:50.796159] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:01:50.800869] [INFO ] [REMOTE ] TRV: Full fetch complete (69789 records). [2025-10-01T22:01:50.801001] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-01T22:01:51.264114] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-01T22:01:51.264200] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-01T22:01:51.265477] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-01T22:01:51.265569] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-01T22:01:51.267143] [DEBUG] [LOCAL ] TRV: Trimmed 69789 records to 47782 (keeping 200 days of data) [2025-10-01T22:01:51.339834] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-01T22:01:51.608715] [DEBUG] [LOCAL ] TRV: Primary data saved (47782 records). [2025-10-01T22:01:51.608862] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-01T22:01:51.608967] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 38.3s. Estimated remaining: 33m 22s. Rate: 7.1 symbols/min [2025-10-01T22:01:51.819545] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:51.862060] [DEBUG] [LOCAL ] TSLX: Loaded 35140 existing records from primary storage. [2025-10-01T22:01:51.862398] [INFO ] [MAIN ] TSLX: Loaded 35140 existing records. [2025-10-01T22:01:51.989180] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T22:01:52.077668] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:52.077893] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-01T22:01:52.077944] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-01T22:01:52.078850] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-01T22:01:52.078914] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-01T22:01:52.111127] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-01T22:01:52.498169] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:01:52.826411] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T22:01:52.827946] [INFO ] [REMOTE ] TSE: Full fetch complete (41273 records). [2025-10-01T22:01:52.828062] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-01T22:01:52.907518] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-01T22:01:53.254002] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-01T22:01:53.254104] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-01T22:01:53.255057] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-01T22:01:53.255186] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-01T22:01:53.256909] [DEBUG] [LOCAL ] TSE: Trimmed 41273 records to 28310 (keeping 200 days of data) [2025-10-01T22:01:53.433474] [DEBUG] [LOCAL ] TSE: Primary data saved (28310 records). [2025-10-01T22:01:53.433615] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-01T22:01:53.433746] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TSE took 30.4s. Estimated remaining: 33m 12s. Rate: 7.1 symbols/min [2025-10-01T22:01:53.622408] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:53.687070] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-01T22:01:53.687402] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-01T22:01:53.709745] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-01T22:01:53.890988] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:53.891214] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-01T22:01:53.891266] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-01T22:01:53.893162] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-01T22:01:53.893229] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-01T22:01:54.335039] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:01:54.502378] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-01T22:01:54.574355] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T22:01:54.909620] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-01T22:01:55.302343] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-01T22:01:55.571124] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T22:01:56.102376] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-01T22:01:56.122703] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T22:01:56.902378] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-01T22:01:57.440946] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T22:01:57.702341] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-01T22:01:58.278838] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-01T22:01:58.280488] [INFO ] [REMOTE ] TS: Full fetch complete (74495 records). [2025-10-01T22:01:58.280601] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-01T22:01:58.508305] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-01T22:01:58.732910] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-01T22:01:58.732999] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-01T22:01:58.734177] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-01T22:01:58.734246] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-01T22:01:58.735840] [DEBUG] [LOCAL ] TS: Trimmed 74495 records to 51685 (keeping 200 days of data) [2025-10-01T22:01:59.003444] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T22:01:59.120000] [DEBUG] [LOCAL ] TS: Primary data saved (51685 records). [2025-10-01T22:01:59.120192] [INFO ] [MAIN ] TS: Full history saved. [2025-10-01T22:01:59.120325] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TS took 39.0s. Estimated remaining: 33m 4s. Rate: 7.1 symbols/min [2025-10-01T22:01:59.252810] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T22:01:59.302356] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-01T22:01:59.325013] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:01:59.383476] [DEBUG] [LOCAL ] TSN: Loaded 52902 existing records from primary storage. [2025-10-01T22:01:59.383864] [INFO ] [MAIN ] TSN: Loaded 52902 existing records. [2025-10-01T22:01:59.589242] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:01:59.589510] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-01T22:01:59.589581] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-01T22:01:59.590901] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-01T22:01:59.590966] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-01T22:01:59.991151] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:00.102454] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-01T22:02:00.816546] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T22:02:00.902414] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-01T22:02:01.702400] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-01T22:02:01.948492] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T22:02:02.414226] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T22:02:02.502381] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-01T22:02:03.302400] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-01T22:02:03.620294] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-01T22:02:04.102447] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-01T22:02:04.274400] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T22:02:04.837172] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-01T22:02:04.902419] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-01T22:02:05.702389] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-01T22:02:06.502420] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-01T22:02:06.624971] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-01T22:02:06.789099] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-01T22:02:06.936801] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-01T22:02:06.937667] [INFO ] [REMOTE ] TSI: Full fetch complete (13264 records). [2025-10-01T22:02:06.937747] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-01T22:02:07.302395] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-01T22:02:07.366636] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T22:02:07.404151] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-01T22:02:07.411948] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-01T22:02:07.412613] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-01T22:02:07.412795] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-01T22:02:07.413582] [DEBUG] [LOCAL ] TSI: Trimmed 13264 records to 7354 (keeping 200 days of data) [2025-10-01T22:02:07.458308] [DEBUG] [LOCAL ] TSI: Primary data saved (7354 records). [2025-10-01T22:02:07.458446] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-01T22:02:07.458554] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSI took 32.6s. Estimated remaining: 32m 55s. Rate: 7.1 symbols/min [2025-10-01T22:02:07.650876] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:02:07.665351] [DEBUG] [LOCAL ] TSQ: Loaded 11991 existing records from primary storage. [2025-10-01T22:02:07.665602] [INFO ] [MAIN ] TSQ: Loaded 11991 existing records. [2025-10-01T22:02:07.865871] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:02:07.866110] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-01T22:02:07.866163] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-01T22:02:07.866704] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-01T22:02:07.866766] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-01T22:02:08.107589] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-01T22:02:08.262496] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:08.902439] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-01T22:02:09.223072] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-01T22:02:09.480262] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-01T22:02:09.575553] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-01T22:02:09.702397] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-01T22:02:10.502430] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-01T22:02:11.302443] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-01T22:02:12.102375] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-01T22:02:12.295271] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-01T22:02:12.340718] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T22:02:12.726167] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T22:02:12.902357] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-01T22:02:12.974245] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T22:02:13.702414] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-01T22:02:14.502405] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-01T22:02:15.240786] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-01T22:02:15.302366] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-01T22:02:15.683297] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-01T22:02:15.744031] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-01T22:02:16.102438] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-01T22:02:16.150843] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T22:02:16.902433] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-01T22:02:17.552795] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T22:02:17.702400] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-01T22:02:18.502405] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-01T22:02:19.040089] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-01T22:02:19.222529] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T22:02:19.302437] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-01T22:02:19.490524] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T22:02:20.102414] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-01T22:02:20.902420] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-01T22:02:21.702391] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-01T22:02:22.054683] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T22:02:22.096601] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T22:02:22.144253] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-01T22:02:22.502427] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-01T22:02:22.731431] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-01T22:02:23.302386] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-01T22:02:23.979164] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-01T22:02:24.102443] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-01T22:02:24.902392] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-01T22:02:24.916977] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T22:02:25.082326] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-01T22:02:25.702527] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-01T22:02:26.479173] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T22:02:26.502334] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-01T22:02:26.978913] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-01T22:02:26.993342] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-01T22:02:26.994811] [INFO ] [REMOTE ] TSQ: Full fetch complete (16577 records). [2025-10-01T22:02:26.994913] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-01T22:02:27.307598] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-01T22:02:27.425257] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-01T22:02:27.425345] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-01T22:02:27.425783] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-01T22:02:27.425846] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-01T22:02:27.426834] [DEBUG] [LOCAL ] TSQ: Trimmed 16577 records to 12024 (keeping 200 days of data) [2025-10-01T22:02:27.506185] [DEBUG] [LOCAL ] TSQ: Primary data saved (12024 records). [2025-10-01T22:02:27.506361] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-01T22:02:27.506484] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSQ took 20.0s. Estimated remaining: 32m 48s. Rate: 7.1 symbols/min [2025-10-01T22:02:27.701701] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:02:27.752426] [DEBUG] [LOCAL ] TT: Loaded 47747 existing records from primary storage. [2025-10-01T22:02:27.752818] [INFO ] [MAIN ] TT: Loaded 47747 existing records. [2025-10-01T22:02:27.953120] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:02:27.953365] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-01T22:02:27.953414] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-01T22:02:27.954611] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-01T22:02:27.954725] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-01T22:02:28.107543] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-01T22:02:28.349833] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T22:02:28.375265] [INFO ] [REMOTE ] TSLX: Full fetch complete (49396 records). [2025-10-01T22:02:28.375115] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:28.375557] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-01T22:02:28.812987] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-01T22:02:28.813081] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-01T22:02:28.814078] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-01T22:02:28.814145] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-01T22:02:28.815345] [DEBUG] [LOCAL ] TSLX: Trimmed 49396 records to 35196 (keeping 200 days of data) [2025-10-01T22:02:28.910719] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-01T22:02:29.053776] [DEBUG] [LOCAL ] TSLX: Primary data saved (35196 records). [2025-10-01T22:02:29.053936] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-01T22:02:29.054053] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSLX took 37.4s. Estimated remaining: 32m 39s. Rate: 7.1 symbols/min [2025-10-01T22:02:29.244676] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:02:29.244957] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-01T22:02:29.245014] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-01T22:02:29.245136] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-01T22:02:29.245180] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-01T22:02:29.245223] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-01T22:02:29.245261] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-01T22:02:29.661801] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:29.702345] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-01T22:02:29.751036] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T22:02:29.920383] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:02:29.920836] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-01T22:02:29.920928] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:02:29.920982] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-01T22:02:29.921054] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:02:29.921129] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-01T22:02:29.921222] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-01T22:02:29.921263] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-01T22:02:29.921323] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-01T22:02:29.921414] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TTAM took 0.9s. Estimated remaining: 32m 29s. Rate: 7.1 symbols/min [2025-10-01T22:02:30.123505] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:02:30.173283] [DEBUG] [LOCAL ] TTC: Loaded 42167 existing records from primary storage. [2025-10-01T22:02:30.173715] [INFO ] [MAIN ] TTC: Loaded 42167 existing records. [2025-10-01T22:02:30.372676] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:02:30.372905] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-01T22:02:30.372952] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-01T22:02:30.374066] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-01T22:02:30.374137] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-01T22:02:30.505791] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-01T22:02:30.811870] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:30.846238] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-01T22:02:31.314426] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-01T22:02:31.321623] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T22:02:32.102504] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-01T22:02:32.246035] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-01T22:02:32.247842] [INFO ] [REMOTE ] TSN: Full fetch complete (76305 records). [2025-10-01T22:02:32.248037] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-01T22:02:32.762130] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-01T22:02:32.762239] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-01T22:02:32.763492] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-01T22:02:32.763559] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-01T22:02:32.765218] [DEBUG] [LOCAL ] TSN: Trimmed 76305 records to 52908 (keeping 200 days of data) [2025-10-01T22:02:32.902694] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-01T22:02:33.043851] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T22:02:33.174005] [DEBUG] [LOCAL ] TSN: Primary data saved (52908 records). [2025-10-01T22:02:33.174169] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-01T22:02:33.174303] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSN took 34.1s. Estimated remaining: 32m 20s. Rate: 7.1 symbols/min [2025-10-01T22:02:33.398039] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:02:33.453348] [DEBUG] [LOCAL ] TTE: Loaded 51628 existing records from primary storage. [2025-10-01T22:02:33.453740] [INFO ] [MAIN ] TTE: Loaded 51628 existing records. [2025-10-01T22:02:33.705285] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-01T22:02:33.705132] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:02:33.706604] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-01T22:02:33.706706] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-01T22:02:33.707906] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-01T22:02:33.707972] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-01T22:02:34.116348] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:34.502377] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-01T22:02:34.684632] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T22:02:35.302396] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-01T22:02:36.102376] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-01T22:02:36.266003] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T22:02:36.708101] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-01T22:02:36.902599] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-01T22:02:37.113601] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T22:02:37.702378] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-01T22:02:37.960505] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T22:02:38.474904] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T22:02:38.502363] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-01T22:02:39.302405] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-01T22:02:40.102383] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-01T22:02:40.360925] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-01T22:02:40.456299] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-01T22:02:40.648714] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T22:02:40.902385] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-01T22:02:41.702375] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-01T22:02:41.934399] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T22:02:42.502355] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-01T22:02:42.621483] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T22:02:43.013113] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T22:02:43.302377] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-01T22:02:44.102380] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-01T22:02:44.902427] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-01T22:02:45.317280] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T22:02:45.362426] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T22:02:45.409083] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-01T22:02:45.702385] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-01T22:02:46.502370] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-01T22:02:46.559250] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T22:02:47.302417] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-01T22:02:47.737010] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T22:02:47.933044] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-01T22:02:47.934579] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-01T22:02:47.934702] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-01T22:02:48.109046] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-01T22:02:48.374762] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-01T22:02:48.374858] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-01T22:02:48.376021] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-01T22:02:48.376091] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-01T22:02:48.377782] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-10-01T22:02:48.742707] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-01T22:02:48.743156] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-01T22:02:48.744835] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TSM took 55.3s. Estimated remaining: 32m 13s. Rate: 7.1 symbols/min [2025-10-01T22:02:48.905003] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-01T22:02:48.945353] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:02:48.982583] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T22:02:49.035631] [DEBUG] [LOCAL ] TTI: Loaded 45500 existing records from primary storage. [2025-10-01T22:02:49.036008] [INFO ] [MAIN ] TTI: Loaded 45500 existing records. [2025-10-01T22:02:49.234699] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:02:49.234943] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-01T22:02:49.234992] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-01T22:02:49.236076] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-01T22:02:49.236141] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-01T22:02:49.687890] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:49.702354] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-01T22:02:49.774235] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T22:02:50.502409] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-01T22:02:50.733090] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T22:02:51.263700] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T22:02:51.302356] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-01T22:02:51.604954] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-01T22:02:52.102382] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-01T22:02:52.670987] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T22:02:52.902380] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-01T22:02:53.661068] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T22:02:53.702358] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-01T22:02:54.470843] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T22:02:54.502371] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-01T22:02:55.228088] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T22:02:55.302410] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-01T22:02:56.102358] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-01T22:02:56.205362] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-01T22:02:56.206869] [INFO ] [REMOTE ] TTC: Full fetch complete (62174 records). [2025-10-01T22:02:56.206971] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-01T22:02:56.564684] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-01T22:02:56.736367] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-01T22:02:56.736478] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-01T22:02:56.737515] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-01T22:02:56.737586] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-01T22:02:56.739015] [DEBUG] [LOCAL ] TTC: Trimmed 62174 records to 42098 (keeping 200 days of data) [2025-10-01T22:02:56.924447] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-01T22:02:57.014383] [DEBUG] [LOCAL ] TTC: Primary data saved (42098 records). [2025-10-01T22:02:57.014544] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-01T22:02:57.014763] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTC took 27.1s. Estimated remaining: 32m 4s. Rate: 7.1 symbols/min [2025-10-01T22:02:57.209229] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:02:57.261718] [DEBUG] [LOCAL ] TU: Loaded 49845 existing records from primary storage. [2025-10-01T22:02:57.262059] [INFO ] [MAIN ] TU: Loaded 49845 existing records. [2025-10-01T22:02:57.468585] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:02:57.468871] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-01T22:02:57.469119] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-01T22:02:57.471077] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-01T22:02:57.471145] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-01T22:02:57.707843] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-01T22:02:57.834930] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T22:02:57.924964] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:02:58.502372] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-01T22:02:58.695721] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T22:02:59.302350] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-01T22:02:59.354353] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T22:03:00.112336] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-01T22:03:00.136891] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T22:03:00.902359] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-01T22:03:01.205103] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-01T22:03:01.507873] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T22:03:01.702389] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-01T22:03:02.502387] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-01T22:03:02.616034] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T22:03:03.302505] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-01T22:03:03.451728] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T22:03:04.102392] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-01T22:03:04.258410] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-01T22:03:04.902373] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-01T22:03:05.187306] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T22:03:05.702419] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-01T22:03:05.925801] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T22:03:06.222232] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T22:03:06.502379] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-01T22:03:07.302352] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-01T22:03:07.486610] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T22:03:08.102406] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-01T22:03:08.264968] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T22:03:08.902377] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-01T22:03:08.930732] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T22:03:09.118801] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T22:03:09.120451] [INFO ] [REMOTE ] TT: Full fetch complete (69849 records). [2025-10-01T22:03:09.120594] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-01T22:03:09.575817] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-01T22:03:09.575917] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-01T22:03:09.577306] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-01T22:03:09.577389] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-01T22:03:09.578998] [DEBUG] [LOCAL ] TT: Trimmed 69849 records to 47697 (keeping 200 days of data) [2025-10-01T22:03:09.702545] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-01T22:03:09.928459] [DEBUG] [LOCAL ] TT: Primary data saved (47697 records). [2025-10-01T22:03:09.928789] [INFO ] [MAIN ] TT: Full history saved. [2025-10-01T22:03:09.929302] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TT took 42.4s. Estimated remaining: 31m 56s. Rate: 7.1 symbols/min [2025-10-01T22:03:10.148494] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:10.195623] [DEBUG] [LOCAL ] TUYA: Loaded 46223 existing records from primary storage. [2025-10-01T22:03:10.196062] [INFO ] [MAIN ] TUYA: Loaded 46223 existing records. [2025-10-01T22:03:10.414565] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:10.415068] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-01T22:03:10.415393] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-01T22:03:10.426807] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-01T22:03:10.446990] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-01T22:03:10.515046] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T22:03:10.513047] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-01T22:03:10.874345] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:11.302365] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-01T22:03:11.414733] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T22:03:11.707556] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-01T22:03:11.709444] [INFO ] [REMOTE ] TTE: Full fetch complete (75035 records). [2025-10-01T22:03:11.709574] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-01T22:03:12.113771] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-01T22:03:12.184849] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-01T22:03:12.184942] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-01T22:03:12.186177] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-01T22:03:12.186245] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-01T22:03:12.187831] [DEBUG] [LOCAL ] TTE: Trimmed 75035 records to 51637 (keeping 200 days of data) [2025-10-01T22:03:12.529485] [DEBUG] [LOCAL ] TTE: Primary data saved (51637 records). [2025-10-01T22:03:12.529638] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-01T22:03:12.529782] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTE took 39.4s. Estimated remaining: 31m 47s. Rate: 7.1 symbols/min [2025-10-01T22:03:12.742377] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:12.788509] [DEBUG] [LOCAL ] TV: Loaded 42730 existing records from primary storage. [2025-10-01T22:03:12.788898] [INFO ] [MAIN ] TV: Loaded 42730 existing records. [2025-10-01T22:03:12.905834] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-01T22:03:13.026916] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:13.027284] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-01T22:03:13.027503] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-01T22:03:13.039771] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-01T22:03:13.039870] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-01T22:03:13.179619] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-01T22:03:13.485287] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:13.582496] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T22:03:13.702367] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-01T22:03:14.194996] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T22:03:14.502366] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-01T22:03:15.280361] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-01T22:03:15.302350] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-01T22:03:15.998897] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T22:03:16.102408] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-01T22:03:16.902401] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-01T22:03:16.968022] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T22:03:17.702379] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-01T22:03:17.924386] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T22:03:18.502750] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-01T22:03:18.506507] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T22:03:19.160803] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T22:03:19.302422] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-01T22:03:19.946473] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T22:03:20.102460] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-01T22:03:20.902389] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-01T22:03:21.114777] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T22:03:21.702368] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-01T22:03:21.891028] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T22:03:21.908220] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T22:03:21.910118] [INFO ] [REMOTE ] TTI: Full fetch complete (65237 records). [2025-10-01T22:03:21.910241] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-01T22:03:22.344811] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-01T22:03:22.344911] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-01T22:03:22.346074] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-01T22:03:22.346143] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-01T22:03:22.347710] [DEBUG] [LOCAL ] TTI: Trimmed 65237 records to 45626 (keeping 200 days of data) [2025-10-01T22:03:22.513499] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-01T22:03:22.622139] [DEBUG] [LOCAL ] TTI: Primary data saved (45626 records). [2025-10-01T22:03:22.622287] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-01T22:03:22.622405] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTI took 33.9s. Estimated remaining: 31m 39s. Rate: 7.1 symbols/min [2025-10-01T22:03:22.820904] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:22.826228] [DEBUG] [LOCAL ] TVC: Loaded 3392 existing records from primary storage. [2025-10-01T22:03:22.826387] [INFO ] [MAIN ] TVC: Loaded 3392 existing records. [2025-10-01T22:03:23.045050] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:23.045332] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-01T22:03:23.045385] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-01T22:03:23.045703] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-01T22:03:23.045765] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-01T22:03:23.307804] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-01T22:03:23.530818] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:23.549994] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T22:03:24.102406] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-01T22:03:24.171376] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T22:03:24.902482] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-01T22:03:25.083846] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T22:03:25.539341] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T22:03:25.702394] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-01T22:03:26.511796] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-01T22:03:26.531632] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-01T22:03:27.302428] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-01T22:03:27.357744] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-01T22:03:27.417912] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T22:03:28.102371] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-01T22:03:28.704427] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T22:03:28.907469] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-01T22:03:28.935560] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T22:03:29.702514] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-01T22:03:30.154836] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T22:03:30.502433] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-01T22:03:30.923109] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-01T22:03:30.925002] [INFO ] [REMOTE ] TU: Full fetch complete (72874 records). [2025-10-01T22:03:30.925140] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-01T22:03:31.309242] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-01T22:03:31.356533] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-01T22:03:31.356773] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-01T22:03:31.358984] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-01T22:03:31.359082] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-01T22:03:31.364825] [DEBUG] [LOCAL ] TU: Trimmed 72874 records to 49853 (keeping 200 days of data) [2025-10-01T22:03:31.704310] [DEBUG] [LOCAL ] TU: Primary data saved (49853 records). [2025-10-01T22:03:31.704504] [INFO ] [MAIN ] TU: Full history saved. [2025-10-01T22:03:31.704700] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TU took 34.7s. Estimated remaining: 31m 30s. Rate: 7.1 symbols/min [2025-10-01T22:03:31.892320] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:31.898274] [DEBUG] [LOCAL ] TVE: Loaded 2810 existing records from primary storage. [2025-10-01T22:03:31.898473] [INFO ] [MAIN ] TVE: Loaded 2810 existing records. [2025-10-01T22:03:32.103779] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-01T22:03:32.103600] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:32.105817] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-01T22:03:32.106005] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-01T22:03:32.106365] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-01T22:03:32.106533] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-01T22:03:32.311749] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T22:03:32.555845] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:32.756291] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-01T22:03:32.837111] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T22:03:32.902407] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-01T22:03:33.256481] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-01T22:03:33.702392] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-01T22:03:34.502391] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-01T22:03:34.861178] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T22:03:35.166415] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T22:03:35.302404] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-01T22:03:36.102387] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-01T22:03:36.209254] [DEBUG] [REMOTE ] TVE: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-01T22:03:36.209698] [WARN ] [REMOTE ] TVE: No data returned for month 2025-01 [2025-10-01T22:03:36.209858] [FATAL] [REMOTE ] TVE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:03:36.209960] [FATAL] [MAIN ] TVE: Failed to fetch primary data. [2025-10-01T22:03:36.210031] [WARN ] [MAIN ] TVE: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:03:36.210129] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-01T22:03:36.210219] [DEBUG] [LOCAL ] TVE: No primary data file found to delete. [2025-10-01T22:03:36.210264] [INFO ] [LOCAL ] TVE: Starting deletion of derivative data. [2025-10-01T22:03:36.211066] [DEBUG] [LOCAL ] TVE: Deleted derivative data file. [2025-10-01T22:03:36.211178] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TVE took 4.5s. Estimated remaining: 31m 21s. Rate: 7.1 symbols/min [2025-10-01T22:03:36.416576] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:36.445274] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T22:03:36.484176] [DEBUG] [LOCAL ] TWI: Loaded 34200 existing records from primary storage. [2025-10-01T22:03:36.484454] [INFO ] [MAIN ] TWI: Loaded 34200 existing records. [2025-10-01T22:03:36.686843] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:36.687080] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-01T22:03:36.687151] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-01T22:03:36.688015] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-01T22:03:36.688079] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-01T22:03:36.913263] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-01T22:03:37.115942] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:37.702381] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-01T22:03:38.502419] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-01T22:03:38.670905] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T22:03:39.093938] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T22:03:39.156886] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-01T22:03:39.302387] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-01T22:03:40.102383] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-01T22:03:40.902382] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-01T22:03:40.940754] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-01T22:03:40.972492] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-01T22:03:41.702437] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-01T22:03:41.972517] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T22:03:41.974727] [INFO ] [REMOTE ] TV: Full fetch complete (62081 records). [2025-10-01T22:03:41.974965] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-01T22:03:42.139859] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-01T22:03:42.473103] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-01T22:03:42.473195] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-01T22:03:42.474203] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-01T22:03:42.474270] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-01T22:03:42.475736] [DEBUG] [LOCAL ] TV: Trimmed 62081 records to 42694 (keeping 200 days of data) [2025-10-01T22:03:42.534280] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-01T22:03:42.752187] [DEBUG] [LOCAL ] TV: Primary data saved (42694 records). [2025-10-01T22:03:42.752361] [INFO ] [MAIN ] TV: Full history saved. [2025-10-01T22:03:42.752458] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TV took 30.2s. Estimated remaining: 31m 13s. Rate: 7.1 symbols/min [2025-10-01T22:03:42.945010] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:43.000491] [DEBUG] [LOCAL ] TWLO: Loaded 52710 existing records from primary storage. [2025-10-01T22:03:43.000897] [INFO ] [MAIN ] TWLO: Loaded 52710 existing records. [2025-10-01T22:03:43.181853] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T22:03:43.229729] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:43.229960] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-01T22:03:43.230014] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-01T22:03:43.231274] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-01T22:03:43.231337] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-01T22:03:43.307696] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-01T22:03:43.628361] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:43.783519] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-01T22:03:44.102386] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-01T22:03:44.514169] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T22:03:44.902398] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-01T22:03:45.702392] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-01T22:03:46.502388] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-01T22:03:46.836507] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-01T22:03:46.837365] [INFO ] [REMOTE ] TVC: Full fetch complete (5577 records). [2025-10-01T22:03:46.837439] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-01T22:03:47.310425] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-01T22:03:47.315973] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-01T22:03:47.304681] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-01T22:03:47.316127] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-01T22:03:47.334071] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-01T22:03:47.336120] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-01T22:03:47.337776] [DEBUG] [LOCAL ] TVC: Trimmed 5577 records to 3341 (keeping 200 days of data) [2025-10-01T22:03:47.387962] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T22:03:47.402741] [DEBUG] [LOCAL ] TVC: Primary data saved (3341 records). [2025-10-01T22:03:47.402899] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-01T22:03:47.403021] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVC took 24.8s. Estimated remaining: 31m 4s. Rate: 7.1 symbols/min [2025-10-01T22:03:47.602182] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:47.607100] [DEBUG] [LOCAL ] TWN: Loaded 3147 existing records from primary storage. [2025-10-01T22:03:47.607282] [INFO ] [MAIN ] TWN: Loaded 3147 existing records. [2025-10-01T22:03:47.809336] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:47.809564] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-01T22:03:47.809613] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-01T22:03:47.809964] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-01T22:03:47.810210] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-01T22:03:48.107564] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-01T22:03:48.206091] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:48.504944] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-01T22:03:48.506771] [INFO ] [REMOTE ] TUYA: Full fetch complete (65723 records). [2025-10-01T22:03:48.506999] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-01T22:03:48.912583] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-01T22:03:48.967844] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-01T22:03:48.967942] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-01T22:03:48.969197] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-01T22:03:48.969271] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-01T22:03:48.971325] [DEBUG] [LOCAL ] TUYA: Trimmed 65723 records to 46181 (keeping 200 days of data) [2025-10-01T22:03:49.250435] [DEBUG] [LOCAL ] TUYA: Primary data saved (46181 records). [2025-10-01T22:03:49.250597] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-01T22:03:49.250713] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TUYA took 39.3s. Estimated remaining: 30m 55s. Rate: 7.1 symbols/min [2025-10-01T22:03:49.451046] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:03:49.502624] [DEBUG] [LOCAL ] TWO: Loaded 48314 existing records from primary storage. [2025-10-01T22:03:49.502976] [INFO ] [MAIN ] TWO: Loaded 48314 existing records. [2025-10-01T22:03:49.696998] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:03:49.697257] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-01T22:03:49.697317] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-01T22:03:49.698381] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-01T22:03:49.698444] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-01T22:03:49.733007] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-01T22:03:50.106462] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:03:50.253407] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-01T22:03:50.414962] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T22:03:50.441029] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-01T22:03:50.502371] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-01T22:03:51.302387] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-01T22:03:52.102402] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-01T22:03:52.508750] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-01T22:03:52.740915] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T22:03:52.800937] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T22:03:52.902388] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-01T22:03:53.332577] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-01T22:03:53.702412] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-01T22:03:54.373953] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-01T22:03:54.502428] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-01T22:03:55.302388] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-01T22:03:56.102374] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-01T22:03:56.453696] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-01T22:03:56.708627] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-01T22:03:56.789161] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T22:03:56.902393] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-01T22:03:57.702402] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-01T22:03:58.305029] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T22:03:58.511160] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-01T22:03:58.518918] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T22:03:59.302387] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-01T22:03:59.732554] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-01T22:04:00.102399] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-01T22:04:00.521698] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-01T22:04:00.902395] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-01T22:04:01.699026] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T22:04:01.707763] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-01T22:04:02.070914] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-01T22:04:02.502414] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-01T22:04:02.542328] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T22:04:03.007761] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-01T22:04:03.302438] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-01T22:04:03.900039] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T22:04:04.102418] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-01T22:04:04.496682] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-01T22:04:04.497418] [INFO ] [REMOTE ] TWN: Full fetch complete (5389 records). [2025-10-01T22:04:04.497493] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-01T22:04:04.905115] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-01T22:04:04.905365] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-01T22:04:04.904724] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-01T22:04:04.906780] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-01T22:04:04.906878] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-01T22:04:04.908095] [DEBUG] [LOCAL ] TWN: Trimmed 5389 records to 3170 (keeping 200 days of data) [2025-10-01T22:04:04.932611] [DEBUG] [LOCAL ] TWN: Primary data saved (3170 records). [2025-10-01T22:04:04.932867] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-01T22:04:04.933005] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWN took 17.5s. Estimated remaining: 30m 47s. Rate: 7.1 symbols/min [2025-10-01T22:04:05.151920] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:05.152165] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-01T22:04:05.152211] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-01T22:04:05.152361] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-01T22:04:05.152406] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-01T22:04:05.152449] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-01T22:04:05.152486] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-01T22:04:05.514055] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:05.702434] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-01T22:04:05.936943] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:04:05.937416] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-01T22:04:05.937535] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:04:05.937589] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-01T22:04:05.937672] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:04:05.937749] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-01T22:04:05.937821] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-01T22:04:05.937858] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-01T22:04:05.937899] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-01T22:04:05.937951] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWOD took 1.0s. Estimated remaining: 30m 38s. Rate: 7.1 symbols/min [2025-10-01T22:04:06.122143] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:06.148768] [DEBUG] [LOCAL ] TX: Loaded 23324 existing records from primary storage. [2025-10-01T22:04:06.149313] [INFO ] [MAIN ] TX: Loaded 23324 existing records. [2025-10-01T22:04:06.385622] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:04:06.388428] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-01T22:04:06.396916] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-01T22:04:06.397011] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-01T22:04:06.397936] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-01T22:04:06.398017] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-01T22:04:06.507603] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-01T22:04:06.802333] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:07.302394] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-01T22:04:07.967575] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T22:04:08.102375] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-01T22:04:08.902411] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-01T22:04:09.391942] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-01T22:04:09.438132] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T22:04:09.702433] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-01T22:04:09.829845] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T22:04:10.502433] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-01T22:04:11.302424] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-01T22:04:11.648881] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-01T22:04:11.937015] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T22:04:12.102372] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-01T22:04:12.483578] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T22:04:12.902433] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-01T22:04:13.439918] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T22:04:13.702418] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-01T22:04:14.502428] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-01T22:04:14.823461] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T22:04:15.066344] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T22:04:15.302407] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-01T22:04:15.960135] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T22:04:16.102455] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-01T22:04:16.902399] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-01T22:04:17.526409] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-01T22:04:17.610315] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T22:04:17.707492] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-01T22:04:17.725495] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T22:04:18.026600] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T22:04:18.027923] [INFO ] [REMOTE ] TWI: Full fetch complete (52830 records). [2025-10-01T22:04:18.028040] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-01T22:04:18.447087] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-01T22:04:18.447177] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-01T22:04:18.448232] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-01T22:04:18.448299] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-01T22:04:18.449466] [DEBUG] [LOCAL ] TWI: Trimmed 52830 records to 34181 (keeping 200 days of data) [2025-10-01T22:04:18.507167] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-01T22:04:18.672706] [DEBUG] [LOCAL ] TWI: Primary data saved (34181 records). [2025-10-01T22:04:18.672888] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-01T22:04:18.673016] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWI took 42.5s. Estimated remaining: 30m 30s. Rate: 7.1 symbols/min [2025-10-01T22:04:18.865319] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:18.914367] [DEBUG] [LOCAL ] TXNM: Loaded 43548 existing records from primary storage. [2025-10-01T22:04:18.914701] [INFO ] [MAIN ] TXNM: Loaded 43548 existing records. [2025-10-01T22:04:19.111771] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:04:19.111972] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-01T22:04:19.112020] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-01T22:04:19.113346] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-01T22:04:19.113408] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-01T22:04:19.304761] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-01T22:04:19.520126] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:20.102369] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-01T22:04:20.292091] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T22:04:20.458120] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T22:04:20.902388] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-01T22:04:21.702411] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-01T22:04:21.840968] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T22:04:22.418521] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-01T22:04:22.502387] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-01T22:04:22.797904] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-01T22:04:23.302400] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-01T22:04:24.102376] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-01T22:04:24.140639] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-01T22:04:24.142245] [INFO ] [REMOTE ] TWLO: Full fetch complete (76447 records). [2025-10-01T22:04:24.142360] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-01T22:04:24.574065] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-01T22:04:24.643184] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-01T22:04:24.643278] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-01T22:04:24.644482] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-01T22:04:24.644555] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-01T22:04:24.646202] [DEBUG] [LOCAL ] TWLO: Trimmed 76447 records to 52713 (keeping 200 days of data) [2025-10-01T22:04:24.903858] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-01T22:04:24.998326] [DEBUG] [LOCAL ] TWLO: Primary data saved (52713 records). [2025-10-01T22:04:24.998506] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-01T22:04:24.998666] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWLO took 42.2s. Estimated remaining: 30m 21s. Rate: 7.1 symbols/min [2025-10-01T22:04:25.191842] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:25.212977] [DEBUG] [LOCAL ] TXO: Loaded 18916 existing records from primary storage. [2025-10-01T22:04:25.213289] [INFO ] [MAIN ] TXO: Loaded 18916 existing records. [2025-10-01T22:04:25.410709] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:04:25.411051] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-01T22:04:25.411247] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-01T22:04:25.411944] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-01T22:04:25.412011] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-01T22:04:25.704216] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-01T22:04:25.844420] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:25.870471] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T22:04:26.502414] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-01T22:04:26.710380] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-01T22:04:27.013063] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T22:04:27.302386] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-01T22:04:27.371205] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-01T22:04:28.102384] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-01T22:04:28.807351] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T22:04:28.902349] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-01T22:04:28.992490] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T22:04:29.702403] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-01T22:04:30.298125] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-01T22:04:30.502401] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-01T22:04:31.302372] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-01T22:04:31.494002] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T22:04:31.549529] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T22:04:32.102391] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-01T22:04:32.471598] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T22:04:32.902382] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-01T22:04:33.702378] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-01T22:04:33.841208] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T22:04:34.502391] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-01T22:04:34.586017] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T22:04:34.897913] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T22:04:35.302389] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-01T22:04:35.405090] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-01T22:04:36.022961] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T22:04:36.102384] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-01T22:04:36.688953] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T22:04:36.902389] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-01T22:04:37.702371] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-01T22:04:38.007001] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T22:04:38.502391] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-01T22:04:38.547892] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T22:04:38.648035] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (0.15 seconds). [2025-10-01T22:04:38.649606] [INFO ] [REMOTE ] TWO: Full fetch complete (69041 records). [2025-10-01T22:04:38.649832] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-01T22:04:39.087172] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-01T22:04:39.087270] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-01T22:04:39.088433] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-01T22:04:39.088505] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-01T22:04:39.090045] [DEBUG] [LOCAL ] TWO: Trimmed 69041 records to 48359 (keeping 200 days of data) [2025-10-01T22:04:39.303240] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-01T22:04:39.396196] [DEBUG] [LOCAL ] TWO: Primary data saved (48359 records). [2025-10-01T22:04:39.396341] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-01T22:04:39.396457] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TWO took 50.1s. Estimated remaining: 30m 13s. Rate: 7.1 symbols/min [2025-10-01T22:04:40.081765] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-01T22:04:40.082920] [INFO ] [REMOTE ] TX: Full fetch complete (35939 records). [2025-10-01T22:04:40.083003] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-01T22:04:40.107518] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-01T22:04:40.493590] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-01T22:04:40.493791] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-01T22:04:40.494568] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-01T22:04:40.494631] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-01T22:04:40.495544] [DEBUG] [LOCAL ] TX: Trimmed 35939 records to 23378 (keeping 200 days of data) [2025-10-01T22:04:40.642848] [DEBUG] [LOCAL ] TX: Primary data saved (23378 records). [2025-10-01T22:04:40.642987] [INFO ] [MAIN ] TX: Full history saved. [2025-10-01T22:04:40.643088] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TX took 34.7s. Estimated remaining: 30m 4s. Rate: 7.1 symbols/min [2025-10-01T22:04:40.902383] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-01T22:04:41.826258] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T22:04:41.837817] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-01T22:04:42.147207] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T22:04:42.502399] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-01T22:04:43.142549] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T22:04:43.202789] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-01T22:04:43.302383] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-01T22:04:44.102396] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-01T22:04:45.011130] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T22:04:45.021501] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-01T22:04:45.236613] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T22:04:45.702373] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-01T22:04:46.567555] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T22:04:46.577487] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-01T22:04:46.743979] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-01T22:04:47.302377] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-01T22:04:47.811710] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-01T22:04:47.861279] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-01T22:04:47.862246] [INFO ] [REMOTE ] TXO: Full fetch complete (26281 records). [2025-10-01T22:04:47.862317] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-01T22:04:48.115163] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-01T22:04:48.267086] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-01T22:04:48.267178] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-01T22:04:48.267852] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-01T22:04:48.267915] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-01T22:04:48.268720] [DEBUG] [LOCAL ] TXO: Trimmed 26281 records to 18939 (keeping 200 days of data) [2025-10-01T22:04:48.385821] [DEBUG] [LOCAL ] TXO: Primary data saved (18939 records). [2025-10-01T22:04:48.385964] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-01T22:04:48.386046] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXO took 23.4s. Estimated remaining: 29m 55s. Rate: 7.1 symbols/min [2025-10-01T22:04:49.150827] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T22:04:49.152195] [INFO ] [REMOTE ] TXNM: Full fetch complete (62675 records). [2025-10-01T22:04:49.152283] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-01T22:04:49.584506] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-01T22:04:49.584600] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-01T22:04:49.585763] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-01T22:04:49.585831] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-01T22:04:49.587246] [DEBUG] [LOCAL ] TXNM: Trimmed 62675 records to 43433 (keeping 200 days of data) [2025-10-01T22:04:49.870806] [DEBUG] [LOCAL ] TXNM: Primary data saved (43433 records). [2025-10-01T22:04:49.870933] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-01T22:04:49.871023] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXNM took 31.2s. Estimated remaining: 29m 46s. Rate: 7.1 symbols/min [2025-10-01T22:04:50.592761] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:50.691988] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:50.696483] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:50.690303] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:04:50.708358] [DEBUG] [LOCAL ] TY: Loaded 7560 existing records from primary storage. [2025-10-01T22:04:50.712459] [INFO ] [MAIN ] TY: Loaded 7560 existing records. [2025-10-01T22:04:50.768330] [DEBUG] [LOCAL ] TYG: Loaded 14191 existing records from primary storage. [2025-10-01T22:04:50.779511] [INFO ] [MAIN ] TYG: Loaded 14191 existing records. [2025-10-01T22:04:50.862769] [DEBUG] [LOCAL ] TYL: Loaded 22196 existing records from primary storage. [2025-10-01T22:04:50.990936] [INFO ] [MAIN ] TYL: Loaded 22196 existing records. [2025-10-01T22:04:51.280260] [DEBUG] [LOCAL ] TXT: Loaded 49719 existing records from primary storage. [2025-10-01T22:04:51.243778] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:04:51.305999] [INFO ] [MAIN ] TXT: Loaded 49719 existing records. [2025-10-01T22:04:51.332100] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-01T22:04:51.320239] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:04:51.383099] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-01T22:04:51.399394] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-01T22:04:51.418952] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-01T22:04:51.419059] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-01T22:04:51.459922] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-01T22:04:51.419151] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-01T22:04:51.472119] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-01T22:04:51.481128] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:04:51.539500] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-01T22:04:51.571325] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-01T22:04:51.601821] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-01T22:04:51.632566] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-01T22:04:51.959335] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:04:52.060282] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-01T22:04:52.129416] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-01T22:04:52.203403] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-01T22:04:52.269792] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-01T22:04:53.020917] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:53.077702] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:53.126859] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-01T22:04:53.131148] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:53.093286] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-01T22:04:53.137364] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-01T22:04:53.321248] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:04:53.321596] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-01T22:04:54.033789] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T22:04:54.043922] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-01T22:04:54.045383] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T22:04:54.048201] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-01T22:04:54.195946] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T22:04:54.200553] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-01T22:04:54.591491] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T22:04:54.593976] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-01T22:04:54.853998] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-01T22:04:55.029288] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-01T22:04:55.085796] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-01T22:04:55.302374] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-01T22:04:55.408671] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-01T22:04:56.102360] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-01T22:04:56.261899] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T22:04:56.657558] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-01T22:04:56.902381] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-01T22:04:57.702388] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-01T22:04:58.502359] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-01T22:04:58.611890] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T22:04:58.845699] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T22:04:59.302387] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-01T22:04:59.481964] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T22:05:00.102409] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-01T22:05:00.902357] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-01T22:05:00.915885] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-01T22:05:01.084813] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T22:05:01.702493] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-01T22:05:01.747219] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-01T22:05:02.502444] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-01T22:05:02.796797] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T22:05:02.936596] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-01T22:05:03.302421] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-01T22:05:04.073223] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T22:05:04.102354] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-01T22:05:04.902410] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-01T22:05:05.649733] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-01T22:05:05.702399] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-01T22:05:05.862904] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T22:05:06.502390] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-01T22:05:06.636080] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-01T22:05:07.302417] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-01T22:05:07.328301] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T22:05:08.102381] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-01T22:05:08.202855] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-01T22:05:08.899109] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T22:05:08.902330] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-01T22:05:09.355067] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-01T22:05:09.355883] [INFO ] [REMOTE ] TY: Full fetch complete (11636 records). [2025-10-01T22:05:09.355959] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-01T22:05:09.707490] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-01T22:05:09.777659] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-01T22:05:09.777751] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-01T22:05:09.778085] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-01T22:05:09.778149] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-01T22:05:09.778718] [DEBUG] [LOCAL ] TY: Trimmed 11636 records to 7549 (keeping 200 days of data) [2025-10-01T22:05:09.829029] [DEBUG] [LOCAL ] TY: Primary data saved (7549 records). [2025-10-01T22:05:09.829190] [INFO ] [MAIN ] TY: Full history saved. [2025-10-01T22:05:09.829339] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 20.0s. Estimated remaining: 29m 39s. Rate: 7.1 symbols/min [2025-10-01T22:05:10.020747] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:05:10.076147] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-01T22:05:10.076525] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-01T22:05:10.272878] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:05:10.273095] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-01T22:05:10.273146] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-01T22:05:10.275543] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-01T22:05:10.275615] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-01T22:05:10.507500] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-01T22:05:10.689556] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:05:11.302352] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-01T22:05:11.504172] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T22:05:11.947554] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T22:05:12.102410] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-01T22:05:12.902408] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-01T22:05:13.112698] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-01T22:05:13.717674] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-01T22:05:13.751051] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-01T22:05:14.394579] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T22:05:14.502412] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-01T22:05:14.902246] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T22:05:15.302379] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-01T22:05:15.477995] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-01T22:05:16.102396] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-01T22:05:16.902379] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-01T22:05:17.195018] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T22:05:17.548964] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T22:05:17.686887] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-01T22:05:17.702343] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-01T22:05:18.502414] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-01T22:05:19.302369] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-01T22:05:19.348091] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-01T22:05:19.697876] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T22:05:20.102399] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-01T22:05:20.902355] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-01T22:05:21.306109] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T22:05:21.454230] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-01T22:05:21.455354] [INFO ] [REMOTE ] TYG: Full fetch complete (22552 records). [2025-10-01T22:05:21.455455] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-01T22:05:21.702555] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-01T22:05:21.929354] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-01T22:05:21.946074] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-01T22:05:21.946555] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-01T22:05:21.947164] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-01T22:05:21.947261] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-01T22:05:21.948366] [DEBUG] [LOCAL ] TYG: Trimmed 22552 records to 14151 (keeping 200 days of data) [2025-10-01T22:05:22.048702] [DEBUG] [LOCAL ] TYG: Primary data saved (14151 records). [2025-10-01T22:05:22.049050] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-01T22:05:22.049364] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYG took 32.2s. Estimated remaining: 29m 31s. Rate: 7.1 symbols/min [2025-10-01T22:05:22.255183] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:05:22.305433] [DEBUG] [LOCAL ] UA: Loaded 50459 existing records from primary storage. [2025-10-01T22:05:22.305866] [INFO ] [MAIN ] UA: Loaded 50459 existing records. [2025-10-01T22:05:22.504171] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-01T22:05:22.512030] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:05:22.514115] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-01T22:05:22.514224] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-01T22:05:22.515273] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-01T22:05:22.515348] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-01T22:05:22.853279] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-01T22:05:22.945235] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:05:23.302404] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-01T22:05:24.018929] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T22:05:24.020673] [INFO ] [REMOTE ] TYL: Full fetch complete (31357 records). [2025-10-01T22:05:24.020793] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-01T22:05:24.110440] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-01T22:05:24.539856] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-01T22:05:24.558172] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-01T22:05:24.566443] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-01T22:05:24.566744] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-01T22:05:24.570091] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-01T22:05:24.582881] [DEBUG] [LOCAL ] TYL: Trimmed 31357 records to 22149 (keeping 200 days of data) [2025-10-01T22:05:24.728514] [DEBUG] [LOCAL ] TYL: Primary data saved (22149 records). [2025-10-01T22:05:24.728689] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-01T22:05:24.728804] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYL took 34.9s. Estimated remaining: 29m 22s. Rate: 7.1 symbols/min [2025-10-01T22:05:24.913625] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-01T22:05:24.918864] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:05:24.972471] [DEBUG] [LOCAL ] UAA: Loaded 53507 existing records from primary storage. [2025-10-01T22:05:24.972877] [INFO ] [MAIN ] UAA: Loaded 53507 existing records. [2025-10-01T22:05:25.165627] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:05:25.165932] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-01T22:05:25.165997] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-01T22:05:25.167105] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-01T22:05:25.167168] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-01T22:05:25.572558] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:05:25.702395] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-01T22:05:25.776711] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T22:05:26.239569] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-01T22:05:26.502377] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-01T22:05:27.302382] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-01T22:05:27.573163] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T22:05:28.102365] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-01T22:05:28.287126] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-01T22:05:28.902392] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-01T22:05:29.470104] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-01T22:05:29.702359] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-01T22:05:29.818688] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T22:05:29.899132] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T22:05:29.900767] [INFO ] [REMOTE ] TXT: Full fetch complete (72268 records). [2025-10-01T22:05:29.900951] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-01T22:05:30.352596] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-01T22:05:30.352731] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-01T22:05:30.353972] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-01T22:05:30.354045] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-01T22:05:30.355612] [DEBUG] [LOCAL ] TXT: Trimmed 72268 records to 49738 (keeping 200 days of data) [2025-10-01T22:05:30.539225] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-01T22:05:30.679266] [DEBUG] [LOCAL ] TXT: Primary data saved (49738 records). [2025-10-01T22:05:30.679445] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-01T22:05:30.679602] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 40.8s. Estimated remaining: 29m 13s. Rate: 7.1 symbols/min [2025-10-01T22:05:30.880958] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:05:30.887905] [DEBUG] [LOCAL ] UAN: Loaded 5387 existing records from primary storage. [2025-10-01T22:05:30.888584] [INFO ] [MAIN ] UAN: Loaded 5387 existing records. [2025-10-01T22:05:31.099041] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:05:31.099340] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-01T22:05:31.099562] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-01T22:05:31.100033] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-01T22:05:31.100191] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-01T22:05:31.311043] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-01T22:05:31.342741] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T22:05:31.579734] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:05:32.102350] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-01T22:05:32.171183] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T22:05:32.902387] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-01T22:05:33.361324] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T22:05:33.632123] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-01T22:05:33.702379] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-01T22:05:34.444448] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T22:05:34.512256] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-01T22:05:34.518700] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T22:05:35.302392] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-01T22:05:36.102339] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-01T22:05:36.307196] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T22:05:36.602429] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-01T22:05:36.902382] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-01T22:05:37.660283] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-01T22:05:37.702369] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-01T22:05:38.507488] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-01T22:05:38.527221] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T22:05:39.133796] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T22:05:39.302383] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-01T22:05:39.541535] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T22:05:39.781174] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-01T22:05:40.102384] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-01T22:05:40.902386] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-01T22:05:41.702390] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-01T22:05:41.795416] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-01T22:05:42.425113] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-01T22:05:42.502378] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-01T22:05:43.236635] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T22:05:43.302360] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-01T22:05:43.558061] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T22:05:44.060830] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-01T22:05:44.102349] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-01T22:05:44.902383] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-01T22:05:45.702383] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-01T22:05:45.775250] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T22:05:46.316140] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T22:05:46.502386] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-01T22:05:47.195226] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-01T22:05:47.302372] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-01T22:05:47.930163] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-01T22:05:48.102384] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-01T22:05:48.322633] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-01T22:05:48.902400] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-01T22:05:49.702397] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-01T22:05:50.001488] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-01T22:05:50.354918] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T22:05:50.502370] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-01T22:05:50.540543] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T22:05:51.302405] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-01T22:05:52.102403] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-01T22:05:52.447948] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-01T22:05:52.448757] [INFO ] [REMOTE ] UAN: Full fetch complete (8109 records). [2025-10-01T22:05:52.448830] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-01T22:05:52.875605] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-01T22:05:52.875783] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-01T22:05:52.876081] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-01T22:05:52.876158] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-01T22:05:52.876800] [DEBUG] [LOCAL ] UAN: Trimmed 8109 records to 5392 (keeping 200 days of data) [2025-10-01T22:05:52.902399] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-01T22:05:52.912407] [DEBUG] [LOCAL ] UAN: Primary data saved (5392 records). [2025-10-01T22:05:52.913445] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-01T22:05:52.913600] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAN took 22.2s. Estimated remaining: 29m 6s. Rate: 7.1 symbols/min [2025-10-01T22:05:53.032101] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-01T22:05:53.167081] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:05:53.219379] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-01T22:05:53.219862] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-01T22:05:53.471960] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:05:53.472236] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-01T22:05:53.472305] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-01T22:05:53.473636] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-01T22:05:53.473734] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-01T22:05:53.644389] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-01T22:05:53.707480] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-01T22:05:53.970686] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:05:54.502416] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-01T22:05:54.730666] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-01T22:05:55.302355] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-01T22:05:55.430234] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T22:05:56.102383] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-01T22:05:56.780045] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-01T22:05:56.902417] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-01T22:05:57.239763] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-01T22:05:57.702395] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-01T22:05:58.491352] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-01T22:05:58.502694] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-01T22:05:59.303604] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-01T22:05:59.325776] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T22:05:59.409616] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-01T22:06:00.038963] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-01T22:06:00.041885] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-01T22:06:00.042069] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-01T22:06:00.107503] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-01T22:06:00.499306] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-01T22:06:00.499426] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-01T22:06:00.500556] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-01T22:06:00.500637] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-01T22:06:00.503830] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 53507 (keeping 200 days of data) [2025-10-01T22:06:00.834475] [DEBUG] [LOCAL ] UAA: Primary data saved (53507 records). [2025-10-01T22:06:00.834635] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-01T22:06:00.834769] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UAA took 36.1s. Estimated remaining: 28m 57s. Rate: 7.1 symbols/min [2025-10-01T22:06:00.907531] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-01T22:06:01.063618] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:01.133967] [DEBUG] [LOCAL ] UBS: Loaded 52407 existing records from primary storage. [2025-10-01T22:06:01.134312] [INFO ] [MAIN ] UBS: Loaded 52407 existing records. [2025-10-01T22:06:01.233726] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T22:06:01.262700] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-01T22:06:01.262940] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-01T22:06:01.481987] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:01.482845] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-01T22:06:01.482933] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-01T22:06:01.501341] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-01T22:06:01.527551] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-01T22:06:02.201866] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-01T22:06:02.202330] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-01T22:06:02.209237] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-01T22:06:02.209335] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-01T22:06:02.263210] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-10-01T22:06:02.309559] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:02.309844] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-01T22:06:02.311787] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-01T22:06:02.315784] [INFO ] [REMOTE ] UA: Full fetch complete (73027 records). [2025-10-01T22:06:02.316026] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-01T22:06:03.056722] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-01T22:06:03.070513] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-01T22:06:03.072438] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-01T22:06:03.072737] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-01T22:06:03.175707] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-10-01T22:06:03.191888] [DEBUG] [LOCAL ] UA: Trimmed 73027 records to 50468 (keeping 200 days of data) [2025-10-01T22:06:03.196210] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-01T22:06:03.205581] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-01T22:06:03.205733] [INFO ] [MAIN ] U: Full history saved. [2025-10-01T22:06:03.205827] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. U took 53.4s. Estimated remaining: 28m 48s. Rate: 7.1 symbols/min [2025-10-01T22:06:03.570060] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:03.701403] [DEBUG] [LOCAL ] UCB: Loaded 37859 existing records from primary storage. [2025-10-01T22:06:03.718595] [INFO ] [MAIN ] UCB: Loaded 37859 existing records. [2025-10-01T22:06:03.934767] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:03.935744] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-01T22:06:03.936870] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-01T22:06:03.939627] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-01T22:06:03.940366] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-01T22:06:04.066391] [DEBUG] [LOCAL ] UA: Primary data saved (50468 records). [2025-10-01T22:06:04.116187] [INFO ] [MAIN ] UA: Full history saved. [2025-10-01T22:06:04.179979] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UA took 42.1s. Estimated remaining: 28m 39s. Rate: 7.1 symbols/min [2025-10-01T22:06:04.520975] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:04.542671] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-01T22:06:04.601034] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-01T22:06:04.599800] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:04.602298] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-01T22:06:04.656954] [DEBUG] [LOCAL ] UDR: Loaded 51821 existing records from primary storage. [2025-10-01T22:06:04.657277] [INFO ] [MAIN ] UDR: Loaded 51821 existing records. [2025-10-01T22:06:04.852676] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:04.852924] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-01T22:06:04.852974] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-01T22:06:04.854712] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-01T22:06:04.854775] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-01T22:06:05.258522] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:05.258915] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-01T22:06:05.617226] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-01T22:06:05.702392] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-01T22:06:06.070668] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T22:06:06.303632] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T22:06:06.502404] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-01T22:06:06.925989] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-01T22:06:07.302422] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-01T22:06:08.102393] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-01T22:06:08.193278] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T22:06:08.390786] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-01T22:06:08.902358] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-01T22:06:08.941280] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T22:06:09.264701] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T22:06:09.702431] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-01T22:06:10.502394] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-01T22:06:10.952840] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T22:06:11.302395] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-01T22:06:11.575583] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-01T22:06:11.834535] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T22:06:12.102459] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-01T22:06:12.902384] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-01T22:06:12.972914] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T22:06:13.665560] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T22:06:13.702394] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-01T22:06:14.502388] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-01T22:06:15.171960] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-01T22:06:15.302374] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-01T22:06:15.555160] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T22:06:16.102403] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-01T22:06:16.115712] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T22:06:16.902443] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-01T22:06:17.358710] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-01T22:06:17.702371] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-01T22:06:17.959957] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T22:06:18.033706] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-01T22:06:18.502384] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-01T22:06:19.302387] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-01T22:06:19.558453] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T22:06:19.921909] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T22:06:20.102414] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-01T22:06:20.902385] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-01T22:06:21.626269] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-01T22:06:21.685437] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-01T22:06:21.702348] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-01T22:06:22.502400] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-01T22:06:22.561632] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T22:06:23.155662] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T22:06:23.302379] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-01T22:06:23.945555] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T22:06:24.102454] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-01T22:06:24.902382] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-01T22:06:25.127018] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-01T22:06:25.702400] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-01T22:06:26.319321] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T22:06:26.502369] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-01T22:06:26.629122] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-01T22:06:26.768979] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T22:06:26.809276] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-01T22:06:26.810534] [INFO ] [REMOTE ] UCB: Full fetch complete (54660 records). [2025-10-01T22:06:26.810624] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-01T22:06:27.246054] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-01T22:06:27.246180] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-01T22:06:27.247470] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-01T22:06:27.247552] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-01T22:06:27.248846] [DEBUG] [LOCAL ] UCB: Trimmed 54660 records to 37802 (keeping 200 days of data) [2025-10-01T22:06:27.309814] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-01T22:06:27.500038] [DEBUG] [LOCAL ] UCB: Primary data saved (37802 records). [2025-10-01T22:06:27.500185] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-01T22:06:27.500304] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UCB took 24.3s. Estimated remaining: 28m 32s. Rate: 7.1 symbols/min [2025-10-01T22:06:27.689245] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:27.731591] [DEBUG] [LOCAL ] UE: Loaded 42788 existing records from primary storage. [2025-10-01T22:06:27.731982] [INFO ] [MAIN ] UE: Loaded 42788 existing records. [2025-10-01T22:06:27.926487] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:27.926767] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-01T22:06:27.926820] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-01T22:06:27.928741] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-01T22:06:27.928806] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-01T22:06:28.116228] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-01T22:06:28.336786] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:28.902431] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-01T22:06:29.702406] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-01T22:06:29.786851] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-01T22:06:29.876670] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T22:06:30.502378] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-01T22:06:31.036426] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-01T22:06:31.076460] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-01T22:06:31.307519] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-01T22:06:31.328188] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T22:06:32.102404] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-01T22:06:32.852995] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T22:06:32.902371] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-01T22:06:33.702418] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-01T22:06:33.972396] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-01T22:06:33.974782] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-01T22:06:33.975068] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-01T22:06:34.437397] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-01T22:06:34.437511] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-01T22:06:34.439131] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-01T22:06:34.460025] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-01T22:06:34.461530] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T22:06:34.471621] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-10-01T22:06:34.529211] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-01T22:06:34.819925] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-01T22:06:34.820083] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-01T22:06:34.820192] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UBER took 41.9s. Estimated remaining: 28m 24s. Rate: 7.1 symbols/min [2025-10-01T22:06:35.013711] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:35.023813] [DEBUG] [LOCAL ] UFI: Loaded 8082 existing records from primary storage. [2025-10-01T22:06:35.024011] [INFO ] [MAIN ] UFI: Loaded 8082 existing records. [2025-10-01T22:06:35.232107] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:35.232348] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-01T22:06:35.232407] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-01T22:06:35.232790] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-01T22:06:35.232854] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-01T22:06:35.305588] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-01T22:06:35.644569] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:35.678247] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-01T22:06:35.682149] [INFO ] [REMOTE ] UDR: Full fetch complete (74581 records). [2025-10-01T22:06:35.681971] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-01T22:06:35.682318] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-01T22:06:36.118305] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-01T22:06:36.163805] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-01T22:06:36.163991] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-01T22:06:36.165405] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-01T22:06:36.165500] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-01T22:06:36.167550] [DEBUG] [LOCAL ] UDR: Trimmed 74581 records to 51828 (keeping 200 days of data) [2025-10-01T22:06:36.201232] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T22:06:36.533916] [DEBUG] [LOCAL ] UDR: Primary data saved (51828 records). [2025-10-01T22:06:36.534078] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-01T22:06:36.534192] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UDR took 32.3s. Estimated remaining: 28m 14s. Rate: 7.1 symbols/min [2025-10-01T22:06:36.725134] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:36.775601] [DEBUG] [LOCAL ] UGI: Loaded 50512 existing records from primary storage. [2025-10-01T22:06:36.775988] [INFO ] [MAIN ] UGI: Loaded 50512 existing records. [2025-10-01T22:06:36.907435] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-01T22:06:36.966091] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:36.966321] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-01T22:06:36.966431] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-01T22:06:36.967917] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-01T22:06:36.968113] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-01T22:06:37.366096] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:37.702376] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-01T22:06:37.946911] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T22:06:38.502358] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-01T22:06:38.578297] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T22:06:38.620842] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T22:06:39.302381] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-01T22:06:39.804704] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-01T22:06:39.806811] [INFO ] [REMOTE ] UBS: Full fetch complete (75665 records). [2025-10-01T22:06:39.806921] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-01T22:06:40.106205] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-01T22:06:40.150463] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T22:06:40.259076] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-01T22:06:40.259170] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-01T22:06:40.260316] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-01T22:06:40.260381] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-01T22:06:40.262085] [DEBUG] [LOCAL ] UBS: Trimmed 75665 records to 52398 (keeping 200 days of data) [2025-10-01T22:06:40.595432] [DEBUG] [LOCAL ] UBS: Primary data saved (52398 records). [2025-10-01T22:06:40.595599] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-01T22:06:40.595768] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UBS took 39.8s. Estimated remaining: 28m 6s. Rate: 7.1 symbols/min [2025-10-01T22:06:40.797714] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:40.836944] [DEBUG] [LOCAL ] UGP: Loaded 42899 existing records from primary storage. [2025-10-01T22:06:40.837334] [INFO ] [MAIN ] UGP: Loaded 42899 existing records. [2025-10-01T22:06:40.910922] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-01T22:06:41.040875] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:41.041110] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-01T22:06:41.041158] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-01T22:06:41.042113] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-01T22:06:41.042178] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-01T22:06:41.454987] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:41.598514] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T22:06:41.702377] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-01T22:06:42.502381] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-01T22:06:42.701828] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T22:06:43.141591] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T22:06:43.302366] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-01T22:06:43.366149] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-01T22:06:44.102427] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-01T22:06:44.761418] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T22:06:44.783411] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T22:06:44.902408] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-01T22:06:45.702403] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-01T22:06:46.506555] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-01T22:06:46.518748] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-01T22:06:47.302411] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-01T22:06:47.477545] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T22:06:47.587068] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T22:06:48.102389] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-01T22:06:48.902618] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-01T22:06:48.996665] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-01T22:06:49.672792] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T22:06:49.710748] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-01T22:06:49.730184] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T22:06:50.502382] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-01T22:06:51.138274] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T22:06:51.302434] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-01T22:06:52.000710] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T22:06:52.084276] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T22:06:52.102347] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-01T22:06:52.387471] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:06:52.388890] [INFO ] [REMOTE ] UE: Full fetch complete (61355 records). [2025-10-01T22:06:52.388977] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-01T22:06:52.804015] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-01T22:06:52.804114] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-01T22:06:52.805278] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-01T22:06:52.805346] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-01T22:06:52.806689] [DEBUG] [LOCAL ] UE: Trimmed 61355 records to 42710 (keeping 200 days of data) [2025-10-01T22:06:52.903620] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-01T22:06:53.088620] [DEBUG] [LOCAL ] UE: Primary data saved (42710 records). [2025-10-01T22:06:53.088787] [INFO ] [MAIN ] UE: Full history saved. [2025-10-01T22:06:53.088888] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UE took 25.6s. Estimated remaining: 27m 57s. Rate: 7.1 symbols/min [2025-10-01T22:06:53.273190] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:06:53.290803] [DEBUG] [LOCAL ] UHAL: Loaded 16541 existing records from primary storage. [2025-10-01T22:06:53.291087] [INFO ] [MAIN ] UHAL: Loaded 16541 existing records. [2025-10-01T22:06:53.481072] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:06:53.481287] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-01T22:06:53.481339] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-01T22:06:53.481936] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-01T22:06:53.482000] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-01T22:06:53.709382] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-01T22:06:53.936470] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:06:54.418774] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-01T22:06:54.497508] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-01T22:06:54.507622] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-01T22:06:55.302392] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-01T22:06:56.102396] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-01T22:06:56.373417] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-01T22:06:56.753247] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-01T22:06:56.902365] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-01T22:06:57.095736] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-01T22:06:57.702427] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-01T22:06:57.744942] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T22:06:58.502362] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-01T22:06:58.740150] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-01T22:06:59.302421] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-01T22:06:59.932769] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T22:06:59.965266] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T22:07:00.102392] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-01T22:07:00.560481] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-01T22:07:00.902403] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-01T22:07:01.702378] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-01T22:07:01.893622] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T22:07:02.502380] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-01T22:07:03.153082] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T22:07:03.302374] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-01T22:07:03.519066] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-01T22:07:04.076614] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T22:07:04.102462] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-01T22:07:04.902436] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-01T22:07:05.702356] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-01T22:07:05.772021] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T22:07:05.941808] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-01T22:07:06.502396] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-01T22:07:07.058394] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-01T22:07:07.059284] [INFO ] [REMOTE ] UFI: Full fetch complete (12390 records). [2025-10-01T22:07:07.059397] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-01T22:07:07.308223] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-01T22:07:07.486746] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-01T22:07:07.486876] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-01T22:07:07.487234] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-01T22:07:07.487313] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-01T22:07:07.488097] [DEBUG] [LOCAL ] UFI: Trimmed 12390 records to 8076 (keeping 200 days of data) [2025-10-01T22:07:07.556483] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T22:07:07.579865] [DEBUG] [LOCAL ] UFI: Primary data saved (8076 records). [2025-10-01T22:07:07.580337] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-01T22:07:07.580427] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UFI took 32.8s. Estimated remaining: 27m 50s. Rate: 7.1 symbols/min [2025-10-01T22:07:07.774573] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:07.820485] [DEBUG] [LOCAL ] UHS: Loaded 40923 existing records from primary storage. [2025-10-01T22:07:07.820826] [INFO ] [MAIN ] UHS: Loaded 40923 existing records. [2025-10-01T22:07:08.028815] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:08.029052] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-01T22:07:08.029105] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-01T22:07:08.030392] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-01T22:07:08.030459] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-01T22:07:08.107568] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-01T22:07:08.457348] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:07:08.549847] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T22:07:08.902381] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-01T22:07:09.702352] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-01T22:07:09.910152] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T22:07:10.424330] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T22:07:10.452741] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T22:07:10.502414] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-01T22:07:11.302384] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-01T22:07:12.069378] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T22:07:12.102413] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-01T22:07:12.902407] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-01T22:07:13.137143] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T22:07:13.139398] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T22:07:13.702408] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-01T22:07:14.502363] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-01T22:07:14.640090] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T22:07:14.902771] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T22:07:15.302378] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-01T22:07:16.102382] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-01T22:07:16.137366] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T22:07:16.822714] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T22:07:16.823598] [INFO ] [REMOTE ] UHAL: Full fetch complete (23152 records). [2025-10-01T22:07:16.823695] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-01T22:07:16.904601] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-01T22:07:17.121896] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-01T22:07:17.259714] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-01T22:07:17.259806] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-01T22:07:17.260328] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-01T22:07:17.260373] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-01T22:07:17.261348] [DEBUG] [LOCAL ] UHAL: Trimmed 23152 records to 16573 (keeping 200 days of data) [2025-10-01T22:07:17.360012] [DEBUG] [LOCAL ] UHAL: Primary data saved (16573 records). [2025-10-01T22:07:17.360160] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-01T22:07:17.360277] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UHAL took 24.3s. Estimated remaining: 27m 41s. Rate: 7.1 symbols/min [2025-10-01T22:07:17.535776] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:17.548590] [DEBUG] [LOCAL ] UHT: Loaded 9964 existing records from primary storage. [2025-10-01T22:07:17.548839] [INFO ] [MAIN ] UHT: Loaded 9964 existing records. [2025-10-01T22:07:17.705557] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-01T22:07:17.735907] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:17.736206] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-01T22:07:17.736258] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-01T22:07:17.736699] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-01T22:07:17.736762] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-01T22:07:18.134308] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:07:18.502372] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-01T22:07:18.693622] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-01T22:07:19.020695] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-01T22:07:19.022747] [INFO ] [REMOTE ] UGI: Full fetch complete (73364 records). [2025-10-01T22:07:19.022859] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-01T22:07:19.307480] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-01T22:07:19.434373] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T22:07:19.493837] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-01T22:07:19.493923] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-01T22:07:19.495150] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-01T22:07:19.495232] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-01T22:07:19.496840] [DEBUG] [LOCAL ] UGI: Trimmed 73364 records to 50508 (keeping 200 days of data) [2025-10-01T22:07:19.826504] [DEBUG] [LOCAL ] UGI: Primary data saved (50508 records). [2025-10-01T22:07:19.826667] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-01T22:07:19.826804] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGI took 43.3s. Estimated remaining: 27m 32s. Rate: 7.1 symbols/min [2025-10-01T22:07:20.016686] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:20.032317] [DEBUG] [LOCAL ] UI: Loaded 13038 existing records from primary storage. [2025-10-01T22:07:20.032706] [INFO ] [MAIN ] UI: Loaded 13038 existing records. [2025-10-01T22:07:20.107523] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-01T22:07:20.240843] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:20.241092] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-01T22:07:20.241141] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-01T22:07:20.241707] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-01T22:07:20.241783] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-01T22:07:20.643010] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:07:20.902366] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-01T22:07:20.932945] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T22:07:21.044899] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-01T22:07:21.702381] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-01T22:07:22.502457] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-01T22:07:22.828868] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T22:07:23.123801] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T22:07:23.255770] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-01T22:07:23.302345] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-01T22:07:24.102364] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-01T22:07:24.430498] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T22:07:24.432032] [INFO ] [REMOTE ] UGP: Full fetch complete (62166 records). [2025-10-01T22:07:24.432153] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-01T22:07:24.888011] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-01T22:07:24.888200] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-01T22:07:24.896160] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-01T22:07:24.896424] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-01T22:07:24.897320] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-01T22:07:24.900629] [DEBUG] [LOCAL ] UGP: Trimmed 62166 records to 42915 (keeping 200 days of data) [2025-10-01T22:07:24.902346] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-01T22:07:25.160392] [DEBUG] [LOCAL ] UGP: Primary data saved (42915 records). [2025-10-01T22:07:25.160524] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-01T22:07:25.160691] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UGP took 44.6s. Estimated remaining: 27m 23s. Rate: 7.1 symbols/min [2025-10-01T22:07:25.346015] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:25.381969] [DEBUG] [LOCAL ] UIS: Loaded 36971 existing records from primary storage. [2025-10-01T22:07:25.382300] [INFO ] [MAIN ] UIS: Loaded 36971 existing records. [2025-10-01T22:07:25.596336] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:25.596589] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-01T22:07:25.596666] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-01T22:07:25.597416] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-01T22:07:25.597477] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-01T22:07:25.707769] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-01T22:07:25.921683] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-01T22:07:26.008690] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:07:26.492407] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T22:07:26.502339] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-01T22:07:27.302358] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-01T22:07:27.463383] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T22:07:27.990250] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T22:07:28.102396] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-01T22:07:28.894290] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-01T22:07:28.902333] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-01T22:07:29.691532] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T22:07:29.702330] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-01T22:07:30.502363] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-01T22:07:30.553952] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-01T22:07:31.302386] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-01T22:07:31.378827] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-01T22:07:32.102386] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-01T22:07:32.720288] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T22:07:32.902356] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-01T22:07:33.702369] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-01T22:07:33.783859] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-01T22:07:33.835180] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T22:07:34.393140] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-01T22:07:34.502385] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-01T22:07:35.302383] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-01T22:07:35.700928] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T22:07:36.102356] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-01T22:07:36.147216] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T22:07:36.762496] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T22:07:36.902378] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-01T22:07:37.702407] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-01T22:07:38.211469] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-01T22:07:38.360995] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-01T22:07:38.502381] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-01T22:07:39.302357] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-01T22:07:39.461058] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T22:07:40.102376] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-01T22:07:40.574138] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-01T22:07:40.902374] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-01T22:07:41.519567] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T22:07:41.702382] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-01T22:07:42.502386] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-01T22:07:42.557308] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T22:07:42.604798] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T22:07:43.302382] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-01T22:07:44.052986] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T22:07:44.102348] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-01T22:07:44.540487] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T22:07:44.902381] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-01T22:07:45.510372] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T22:07:45.661495] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T22:07:45.702346] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-01T22:07:46.389407] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T22:07:46.390298] [INFO ] [REMOTE ] UI: Full fetch complete (18536 records). [2025-10-01T22:07:46.390375] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-01T22:07:46.507464] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-01T22:07:46.798076] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-01T22:07:46.798169] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-01T22:07:46.798619] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-01T22:07:46.798700] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-01T22:07:46.799489] [DEBUG] [LOCAL ] UI: Trimmed 18536 records to 13056 (keeping 200 days of data) [2025-10-01T22:07:46.883858] [DEBUG] [LOCAL ] UI: Primary data saved (13056 records). [2025-10-01T22:07:46.884011] [INFO ] [MAIN ] UI: Full history saved. [2025-10-01T22:07:46.884102] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UI took 27.1s. Estimated remaining: 27m 16s. Rate: 7.1 symbols/min [2025-10-01T22:07:47.081810] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:47.136269] [DEBUG] [LOCAL ] UL: Loaded 53057 existing records from primary storage. [2025-10-01T22:07:47.136618] [INFO ] [MAIN ] UL: Loaded 53057 existing records. [2025-10-01T22:07:47.309544] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-01T22:07:47.344915] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:47.345841] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-01T22:07:47.345923] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-01T22:07:47.347435] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-01T22:07:47.347499] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-01T22:07:47.760172] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:07:48.102379] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-01T22:07:48.170998] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-01T22:07:48.893718] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T22:07:48.902339] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-01T22:07:49.702368] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-01T22:07:49.790479] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T22:07:49.979955] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T22:07:49.981297] [INFO ] [REMOTE ] UHS: Full fetch complete (58300 records). [2025-10-01T22:07:49.981430] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-01T22:07:50.397342] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-01T22:07:50.397424] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-01T22:07:50.398485] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-01T22:07:50.398550] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-01T22:07:50.399784] [DEBUG] [LOCAL ] UHS: Trimmed 58300 records to 40867 (keeping 200 days of data) [2025-10-01T22:07:50.521880] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-01T22:07:50.670088] [DEBUG] [LOCAL ] UHS: Primary data saved (40867 records). [2025-10-01T22:07:50.670217] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-01T22:07:50.670311] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHS took 43.1s. Estimated remaining: 27m 7s. Rate: 7.1 symbols/min [2025-10-01T22:07:50.861110] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:50.897750] [DEBUG] [LOCAL ] ULS: Loaded 39433 existing records from primary storage. [2025-10-01T22:07:50.898088] [INFO ] [MAIN ] ULS: Loaded 39433 existing records. [2025-10-01T22:07:51.103766] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:51.104140] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-01T22:07:51.104250] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-01T22:07:51.105160] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-01T22:07:51.105229] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-01T22:07:51.287760] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T22:07:51.323478] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-01T22:07:51.553832] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:07:51.977952] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T22:07:51.978890] [INFO ] [REMOTE ] UHT: Full fetch complete (15095 records). [2025-10-01T22:07:51.978997] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-01T22:07:52.107458] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-01T22:07:52.380610] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-01T22:07:52.380723] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-01T22:07:52.381080] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-01T22:07:52.381122] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-01T22:07:52.381795] [DEBUG] [LOCAL ] UHT: Trimmed 15095 records to 9936 (keeping 200 days of data) [2025-10-01T22:07:52.449630] [DEBUG] [LOCAL ] UHT: Primary data saved (9936 records). [2025-10-01T22:07:52.449807] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-01T22:07:52.449911] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UHT took 35.1s. Estimated remaining: 26m 58s. Rate: 7.1 symbols/min [2025-10-01T22:07:52.648494] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:52.684908] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-01T22:07:52.744426] [DEBUG] [LOCAL ] UMC: Loaded 52711 existing records from primary storage. [2025-10-01T22:07:52.744804] [INFO ] [MAIN ] UMC: Loaded 52711 existing records. [2025-10-01T22:07:52.910356] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-01T22:07:52.955579] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:52.955825] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-01T22:07:52.955878] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-01T22:07:52.957181] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-01T22:07:52.957246] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-01T22:07:53.346524] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:07:53.547539] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T22:07:53.702432] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-01T22:07:54.508676] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-01T22:07:54.517141] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T22:07:54.771173] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T22:07:55.302400] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-01T22:07:56.102436] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-01T22:07:56.420526] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T22:07:56.466736] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-01T22:07:56.902403] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-01T22:07:57.702374] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-01T22:07:57.907575] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T22:07:58.502368] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-01T22:07:58.675057] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T22:07:58.676367] [INFO ] [REMOTE ] UIS: Full fetch complete (51766 records). [2025-10-01T22:07:58.676458] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-01T22:07:58.901770] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-01T22:07:59.142797] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-01T22:07:59.142957] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-01T22:07:59.144010] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-01T22:07:59.144089] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-01T22:07:59.145298] [DEBUG] [LOCAL ] UIS: Trimmed 51766 records to 36978 (keeping 200 days of data) [2025-10-01T22:07:59.305628] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-01T22:07:59.359695] [DEBUG] [LOCAL ] UIS: Primary data saved (36978 records). [2025-10-01T22:07:59.359821] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-01T22:07:59.359923] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 34.2s. Estimated remaining: 26m 50s. Rate: 7.1 symbols/min [2025-10-01T22:07:59.538767] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:07:59.573898] [DEBUG] [LOCAL ] UMH: Loaded 33624 existing records from primary storage. [2025-10-01T22:07:59.574255] [INFO ] [MAIN ] UMH: Loaded 33624 existing records. [2025-10-01T22:07:59.762025] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:07:59.762259] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-01T22:07:59.762318] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-01T22:07:59.763136] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-01T22:07:59.763197] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-01T22:08:00.106997] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-01T22:08:00.165731] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:08:00.378096] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T22:08:00.406886] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T22:08:00.902394] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-01T22:08:01.702361] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-01T22:08:01.943558] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T22:08:02.328104] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T22:08:02.502426] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-01T22:08:02.820339] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T22:08:03.302381] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-01T22:08:04.102392] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-01T22:08:04.516125] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T22:08:04.795180] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-01T22:08:04.902350] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-01T22:08:05.278152] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T22:08:05.702378] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-01T22:08:06.481564] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T22:08:06.502339] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-01T22:08:06.923005] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T22:08:07.302395] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-01T22:08:08.007630] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-01T22:08:08.102364] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-01T22:08:08.902361] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-01T22:08:09.287013] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-01T22:08:09.521833] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-01T22:08:09.702384] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-01T22:08:10.337323] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T22:08:10.502432] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-01T22:08:11.282712] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T22:08:11.302342] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-01T22:08:12.074702] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T22:08:12.102353] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-01T22:08:12.902369] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-01T22:08:12.932299] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T22:08:13.702371] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-01T22:08:13.896544] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:08:14.227702] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-01T22:08:14.502397] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-01T22:08:15.302391] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-01T22:08:15.439021] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T22:08:15.825148] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T22:08:16.102386] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-01T22:08:16.902423] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-01T22:08:17.147670] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-01T22:08:17.210848] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-01T22:08:17.702391] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-01T22:08:18.427103] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T22:08:18.502387] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-01T22:08:19.098952] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T22:08:19.302392] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-01T22:08:20.102381] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-01T22:08:20.251817] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T22:08:20.693540] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T22:08:20.902385] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-01T22:08:21.702354] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-01T22:08:21.969076] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T22:08:22.341528] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-01T22:08:22.502390] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-01T22:08:23.302384] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-01T22:08:23.491628] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:08:24.102374] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-01T22:08:24.331489] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T22:08:24.334670] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T22:08:24.345759] [INFO ] [REMOTE ] ULS: Full fetch complete (54474 records). [2025-10-01T22:08:24.346498] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-01T22:08:24.760538] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-01T22:08:24.760631] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-01T22:08:24.761755] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-01T22:08:24.761866] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-01T22:08:24.763338] [DEBUG] [LOCAL ] ULS: Trimmed 54474 records to 39473 (keeping 200 days of data) [2025-10-01T22:08:24.949981] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-01T22:08:25.025455] [DEBUG] [LOCAL ] ULS: Primary data saved (39473 records). [2025-10-01T22:08:25.025605] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-01T22:08:25.025718] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. ULS took 34.4s. Estimated remaining: 26m 43s. Rate: 7.1 symbols/min [2025-10-01T22:08:25.170685] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T22:08:25.213812] [INFO ] [REMOTE ] UMH: Full fetch complete (46665 records). [2025-10-01T22:08:25.216534] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:08:25.216671] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-01T22:08:25.351391] [DEBUG] [LOCAL ] UNF: Loaded 12028 existing records from primary storage. [2025-10-01T22:08:25.377040] [INFO ] [MAIN ] UNF: Loaded 12028 existing records. [2025-10-01T22:08:25.705054] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-01T22:08:25.754349] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:08:25.787842] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-01T22:08:25.801138] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-01T22:08:25.825299] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-01T22:08:25.831811] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-01T22:08:25.849064] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-01T22:08:25.907572] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-01T22:08:25.923466] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-01T22:08:25.934858] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-01T22:08:25.986164] [DEBUG] [LOCAL ] UMH: Trimmed 46665 records to 33609 (keeping 200 days of data) [2025-10-01T22:08:26.367435] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:08:26.460008] [DEBUG] [LOCAL ] UMH: Primary data saved (33609 records). [2025-10-01T22:08:26.460168] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-01T22:08:26.460302] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. UMH took 27.1s. Estimated remaining: 26m 33s. Rate: 7.1 symbols/min [2025-10-01T22:08:26.508421] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-01T22:08:26.660033] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:08:26.712514] [DEBUG] [LOCAL ] UNFI: Loaded 41874 existing records from primary storage. [2025-10-01T22:08:26.712913] [INFO ] [MAIN ] UNFI: Loaded 41874 existing records. [2025-10-01T22:08:26.910367] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:08:26.910660] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-01T22:08:26.910728] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-01T22:08:26.911791] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-01T22:08:26.911852] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-01T22:08:27.074015] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-01T22:08:27.278937] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-01T22:08:27.302712] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-01T22:08:27.327028] [INFO ] [REMOTE ] UMC: Full fetch complete (76586 records). [2025-10-01T22:08:27.366901] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-01T22:08:27.373583] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:08:27.416688] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T22:08:27.806861] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-01T22:08:27.806947] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-01T22:08:27.808191] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-01T22:08:27.808261] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-01T22:08:27.809714] [DEBUG] [LOCAL ] UMC: Trimmed 76586 records to 52704 (keeping 200 days of data) [2025-10-01T22:08:28.116024] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-01T22:08:28.143459] [DEBUG] [LOCAL ] UMC: Primary data saved (52704 records). [2025-10-01T22:08:28.143623] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-01T22:08:28.143787] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMC took 35.7s. Estimated remaining: 26m 24s. Rate: 7.1 symbols/min [2025-10-01T22:08:28.329707] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:08:28.387369] [DEBUG] [LOCAL ] UNH: Loaded 53795 existing records from primary storage. [2025-10-01T22:08:28.387771] [INFO ] [MAIN ] UNH: Loaded 53795 existing records. [2025-10-01T22:08:28.583576] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:08:28.583868] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-01T22:08:28.583917] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-01T22:08:28.585583] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-01T22:08:28.585670] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-01T22:08:28.924034] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-01T22:08:29.041572] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:08:29.061771] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T22:08:29.346706] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T22:08:29.702382] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-01T22:08:30.221789] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-01T22:08:30.502388] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-01T22:08:31.302392] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-01T22:08:31.862922] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-01T22:08:32.091494] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-01T22:08:32.102482] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-01T22:08:32.886773] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T22:08:32.886449] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-01T22:08:32.902331] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-01T22:08:33.702396] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-01T22:08:34.225696] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-01T22:08:34.227269] [INFO ] [REMOTE ] UL: Full fetch complete (76884 records). [2025-10-01T22:08:34.227399] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-01T22:08:34.514312] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-01T22:08:34.663487] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-01T22:08:34.663721] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-01T22:08:34.665050] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-01T22:08:34.665123] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-01T22:08:34.666770] [DEBUG] [LOCAL ] UL: Trimmed 76884 records to 53068 (keeping 200 days of data) [2025-10-01T22:08:35.033190] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-01T22:08:35.052657] [DEBUG] [LOCAL ] UL: Primary data saved (53068 records). [2025-10-01T22:08:35.052782] [INFO ] [MAIN ] UL: Full history saved. [2025-10-01T22:08:35.052910] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UL took 48.2s. Estimated remaining: 26m 16s. Rate: 7.1 symbols/min [2025-10-01T22:08:35.247942] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:08:35.298794] [DEBUG] [LOCAL ] UNM: Loaded 48524 existing records from primary storage. [2025-10-01T22:08:35.299111] [INFO ] [MAIN ] UNM: Loaded 48524 existing records. [2025-10-01T22:08:35.311004] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-01T22:08:35.499071] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:08:35.499310] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-01T22:08:35.499360] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-01T22:08:35.500611] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-01T22:08:35.500698] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-01T22:08:35.889369] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:08:36.102400] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-01T22:08:36.135762] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-01T22:08:36.748697] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-01T22:08:36.902384] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-01T22:08:37.606480] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T22:08:37.702392] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-01T22:08:37.974754] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-01T22:08:38.502382] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-01T22:08:39.239987] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T22:08:39.302380] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-01T22:08:39.334137] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T22:08:40.102383] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-01T22:08:40.795186] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-01T22:08:40.902360] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-01T22:08:41.409803] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-01T22:08:41.702352] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-01T22:08:41.939919] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T22:08:42.502374] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-01T22:08:43.104832] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T22:08:43.291372] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T22:08:43.302323] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-01T22:08:43.778967] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T22:08:44.102379] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-01T22:08:44.902379] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-01T22:08:45.031137] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.13 seconds). [2025-10-01T22:08:45.032039] [INFO ] [REMOTE ] UNF: Full fetch complete (17305 records). [2025-10-01T22:08:45.032113] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-01T22:08:45.439134] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-01T22:08:45.439289] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-01T22:08:45.439717] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-01T22:08:45.439794] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-01T22:08:45.440609] [DEBUG] [LOCAL ] UNF: Trimmed 17305 records to 12062 (keeping 200 days of data) [2025-10-01T22:08:45.522168] [DEBUG] [LOCAL ] UNF: Primary data saved (12062 records). [2025-10-01T22:08:45.522305] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-01T22:08:45.522404] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 20.5s. Estimated remaining: 26m 8s. Rate: 7.1 symbols/min [2025-10-01T22:08:45.666997] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T22:08:45.722529] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-01T22:08:45.752925] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:08:45.762386] [DEBUG] [LOCAL ] UNMA: Loaded 3536 existing records from primary storage. [2025-10-01T22:08:45.762597] [INFO ] [MAIN ] UNMA: Loaded 3536 existing records. [2025-10-01T22:08:45.959256] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:08:45.959499] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-01T22:08:45.959584] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-01T22:08:45.959872] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-01T22:08:45.959932] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-01T22:08:46.348150] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:08:46.502414] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-01T22:08:46.960619] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-01T22:08:47.302411] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-01T22:08:48.085689] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-01T22:08:48.103060] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-01T22:08:48.638963] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-01T22:08:48.751164] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T22:08:48.902441] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-01T22:08:49.225598] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-01T22:08:49.702429] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-01T22:08:50.502387] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-01T22:08:51.174605] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-01T22:08:51.302367] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-01T22:08:51.446772] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T22:08:51.869353] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T22:08:52.102377] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-01T22:08:52.902390] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-01T22:08:53.462372] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-01T22:08:53.521519] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T22:08:53.702425] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-01T22:08:54.262611] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-01T22:08:54.502371] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-01T22:08:55.302428] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-01T22:08:55.898067] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T22:08:56.102361] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-01T22:08:56.239254] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-01T22:08:56.759486] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-01T22:08:56.902382] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-01T22:08:57.472133] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T22:08:57.702408] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-01T22:08:58.502412] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-01T22:08:59.183343] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T22:08:59.302385] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-01T22:09:00.102390] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-01T22:09:00.456916] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-01T22:09:00.457758] [INFO ] [REMOTE ] UNMA: Full fetch complete (5812 records). [2025-10-01T22:09:00.457830] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-01T22:09:00.867694] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-01T22:09:00.867777] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-01T22:09:00.867962] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-01T22:09:00.868038] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-01T22:09:00.868437] [DEBUG] [LOCAL ] UNMA: Trimmed 5812 records to 3513 (keeping 200 days of data) [2025-10-01T22:09:00.890316] [DEBUG] [LOCAL ] UNMA: Primary data saved (3513 records). [2025-10-01T22:09:00.890393] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-01T22:09:00.890467] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNMA took 15.4s. Estimated remaining: 25m 60s. Rate: 7.1 symbols/min [2025-10-01T22:09:00.906704] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-01T22:09:01.085412] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:01.143726] [DEBUG] [LOCAL ] UNP: Loaded 53267 existing records from primary storage. [2025-10-01T22:09:01.144066] [INFO ] [MAIN ] UNP: Loaded 53267 existing records. [2025-10-01T22:09:01.350149] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:01.351142] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-01T22:09:01.351281] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-01T22:09:01.363512] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-01T22:09:01.382123] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-01T22:09:01.408026] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-01T22:09:01.500706] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-01T22:09:01.707586] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-01T22:09:01.889934] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:01.916001] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-01T22:09:02.502387] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-01T22:09:02.784359] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T22:09:02.785845] [INFO ] [REMOTE ] UNFI: Full fetch complete (59149 records). [2025-10-01T22:09:02.785955] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-01T22:09:03.218592] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-01T22:09:03.218832] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-01T22:09:03.220010] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-01T22:09:03.220107] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-01T22:09:03.221618] [DEBUG] [LOCAL ] UNFI: Trimmed 59149 records to 41973 (keeping 200 days of data) [2025-10-01T22:09:03.309863] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-01T22:09:03.371018] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T22:09:03.521783] [DEBUG] [LOCAL ] UNFI: Primary data saved (41973 records). [2025-10-01T22:09:03.521913] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-01T22:09:03.521994] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNFI took 37.1s. Estimated remaining: 25m 51s. Rate: 7.1 symbols/min [2025-10-01T22:09:03.709065] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:03.755526] [DEBUG] [LOCAL ] UP: Loaded 43136 existing records from primary storage. [2025-10-01T22:09:03.755851] [INFO ] [MAIN ] UP: Loaded 43136 existing records. [2025-10-01T22:09:03.962777] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:03.963015] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-01T22:09:03.963066] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-01T22:09:03.963994] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-01T22:09:03.964056] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-01T22:09:04.107544] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-01T22:09:04.382664] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:04.902388] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-01T22:09:05.702356] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-01T22:09:05.830304] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T22:09:06.117668] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-01T22:09:06.502430] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-01T22:09:06.750564] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T22:09:06.824352] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T22:09:07.302404] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-01T22:09:08.102432] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-01T22:09:08.918494] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-01T22:09:08.921328] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T22:09:09.090536] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-01T22:09:09.702374] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-01T22:09:10.041301] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T22:09:10.473356] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T22:09:10.502388] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-01T22:09:11.302391] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-01T22:09:12.102374] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-01T22:09:12.258638] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T22:09:12.390588] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-01T22:09:12.902366] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-01T22:09:13.145205] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T22:09:13.271979] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-01T22:09:13.702412] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-01T22:09:14.502408] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-01T22:09:15.283701] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T22:09:15.302335] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-01T22:09:15.835160] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-01T22:09:16.102354] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-01T22:09:16.146039] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T22:09:16.902371] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-01T22:09:17.400747] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-01T22:09:17.451540] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T22:09:17.683846] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-01T22:09:17.702354] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-01T22:09:18.469478] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T22:09:18.502339] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-01T22:09:19.302368] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-01T22:09:19.748024] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-01T22:09:20.102377] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-01T22:09:20.392988] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:09:20.394452] [INFO ] [REMOTE ] UNM: Full fetch complete (69998 records). [2025-10-01T22:09:20.394541] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-01T22:09:20.835096] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-01T22:09:20.835213] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-01T22:09:20.836416] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-01T22:09:20.836481] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-01T22:09:20.838161] [DEBUG] [LOCAL ] UNM: Trimmed 69998 records to 48469 (keeping 200 days of data) [2025-10-01T22:09:20.906986] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-01T22:09:21.145525] [DEBUG] [LOCAL ] UNM: Primary data saved (48469 records). [2025-10-01T22:09:21.145680] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-01T22:09:21.145782] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNM took 46.1s. Estimated remaining: 25m 43s. Rate: 7.1 symbols/min [2025-10-01T22:09:21.332960] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:21.387760] [DEBUG] [LOCAL ] UPS: Loaded 53712 existing records from primary storage. [2025-10-01T22:09:21.388182] [INFO ] [MAIN ] UPS: Loaded 53712 existing records. [2025-10-01T22:09:21.590376] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:21.590751] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-01T22:09:21.590824] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-01T22:09:21.601759] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-01T22:09:21.619522] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-01T22:09:21.702520] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-01T22:09:21.696179] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-01T22:09:22.041872] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:22.050895] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-01T22:09:22.052605] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-10-01T22:09:22.052746] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-01T22:09:22.495777] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-01T22:09:22.510382] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-01T22:09:22.504960] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-01T22:09:22.522070] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-01T22:09:22.522833] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-01T22:09:22.524969] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-01T22:09:22.536109] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 53795 (keeping 200 days of data) [2025-10-01T22:09:22.890194] [DEBUG] [LOCAL ] UNH: Primary data saved (53795 records). [2025-10-01T22:09:22.890355] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-01T22:09:22.891713] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNH took 54.7s. Estimated remaining: 25m 34s. Rate: 7.1 symbols/min [2025-10-01T22:09:23.075497] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:23.117946] [DEBUG] [LOCAL ] URI: Loaded 35767 existing records from primary storage. [2025-10-01T22:09:23.118264] [INFO ] [MAIN ] URI: Loaded 35767 existing records. [2025-10-01T22:09:23.307718] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-01T22:09:23.312761] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:23.313609] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-01T22:09:23.313688] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-01T22:09:23.314601] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-01T22:09:23.314698] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-01T22:09:23.712940] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:24.102359] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-01T22:09:24.383976] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T22:09:24.870431] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T22:09:24.902355] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-01T22:09:25.702351] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-01T22:09:26.226752] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-01T22:09:26.502375] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-01T22:09:26.636860] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T22:09:27.302365] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-01T22:09:27.369801] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T22:09:27.989186] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T22:09:28.102399] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-01T22:09:28.902352] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-01T22:09:28.955110] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T22:09:29.629581] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T22:09:29.702379] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-01T22:09:30.502373] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-01T22:09:30.572510] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:09:30.717067] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T22:09:31.302412] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-01T22:09:31.588178] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:09:31.589787] [INFO ] [REMOTE ] UNP: Full fetch complete (76922 records). [2025-10-01T22:09:31.589900] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-01T22:09:32.012145] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-01T22:09:32.012240] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-01T22:09:32.013495] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-01T22:09:32.013564] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-01T22:09:32.015207] [DEBUG] [LOCAL ] UNP: Trimmed 76922 records to 53271 (keeping 200 days of data) [2025-10-01T22:09:32.107551] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-01T22:09:32.367317] [DEBUG] [LOCAL ] UNP: Primary data saved (53271 records). [2025-10-01T22:09:32.367479] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-01T22:09:32.367591] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 31.5s. Estimated remaining: 25m 26s. Rate: 7.1 symbols/min [2025-10-01T22:09:32.557100] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:32.594266] [DEBUG] [LOCAL ] USA: Loaded 35964 existing records from primary storage. [2025-10-01T22:09:32.594678] [INFO ] [MAIN ] USA: Loaded 35964 existing records. [2025-10-01T22:09:32.823229] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-01T22:09:32.849180] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:32.849885] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-01T22:09:32.849953] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-01T22:09:32.850906] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-01T22:09:32.850977] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-01T22:09:32.910381] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-01T22:09:33.252062] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:33.702375] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-01T22:09:34.195730] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T22:09:34.285005] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-01T22:09:34.502381] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-01T22:09:35.265428] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-01T22:09:35.266905] [INFO ] [REMOTE ] UP: Full fetch complete (62330 records). [2025-10-01T22:09:35.267002] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-01T22:09:35.307487] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-01T22:09:35.699449] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-01T22:09:35.699542] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-01T22:09:35.700718] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-01T22:09:35.700794] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-01T22:09:35.702270] [DEBUG] [LOCAL ] UP: Trimmed 62330 records to 43152 (keeping 200 days of data) [2025-10-01T22:09:35.964425] [DEBUG] [LOCAL ] UP: Primary data saved (43152 records). [2025-10-01T22:09:35.964571] [INFO ] [MAIN ] UP: Full history saved. [2025-10-01T22:09:35.964769] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UP took 32.4s. Estimated remaining: 25m 17s. Rate: 7.1 symbols/min [2025-10-01T22:09:36.117196] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-01T22:09:36.151050] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:36.194512] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T22:09:36.221143] [DEBUG] [LOCAL ] USAC: Loaded 22418 existing records from primary storage. [2025-10-01T22:09:36.221406] [INFO ] [MAIN ] USAC: Loaded 22418 existing records. [2025-10-01T22:09:36.414748] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:36.415005] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-01T22:09:36.415079] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-01T22:09:36.415780] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-01T22:09:36.415844] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-01T22:09:36.826662] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:36.902413] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-01T22:09:37.494024] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-01T22:09:37.548740] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T22:09:37.702398] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-01T22:09:38.502377] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-01T22:09:38.748935] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-01T22:09:38.814053] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T22:09:39.302365] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-01T22:09:40.102347] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-01T22:09:40.646474] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-01T22:09:40.902350] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-01T22:09:40.966594] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T22:09:41.236707] [DEBUG] [REMOTE ] UPS: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-01T22:09:41.237241] [WARN ] [REMOTE ] UPS: No data returned for month 2025-04 [2025-10-01T22:09:41.237336] [FATAL] [REMOTE ] UPS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:09:41.237442] [FATAL] [MAIN ] UPS: Failed to fetch primary data. [2025-10-01T22:09:41.237509] [WARN ] [MAIN ] UPS: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:09:41.237584] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-01T22:09:41.237678] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-10-01T22:09:41.237737] [INFO ] [LOCAL ] UPS: Starting deletion of derivative data. [2025-10-01T22:09:41.238378] [DEBUG] [LOCAL ] UPS: Deleted derivative data file. [2025-10-01T22:09:41.238469] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UPS took 20.1s. Estimated remaining: 25m 8s. Rate: 7.1 symbols/min [2025-10-01T22:09:41.390484] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-01T22:09:41.456314] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:41.508515] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-01T22:09:41.508896] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-01T22:09:41.709364] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-01T22:09:41.716255] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:41.717374] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-01T22:09:41.717463] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-01T22:09:41.719292] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-01T22:09:41.719363] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-01T22:09:42.114525] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:42.502387] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-01T22:09:43.020196] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T22:09:43.302374] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-01T22:09:44.099893] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T22:09:44.110365] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-01T22:09:44.875081] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T22:09:44.902377] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-01T22:09:45.441469] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-01T22:09:45.702367] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-01T22:09:46.256298] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T22:09:46.502423] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-01T22:09:47.302357] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-01T22:09:47.462505] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T22:09:47.721001] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T22:09:48.102388] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-01T22:09:48.512557] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-01T22:09:48.902382] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-01T22:09:49.593132] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T22:09:49.702404] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-01T22:09:50.400978] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T22:09:50.502359] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-01T22:09:50.596447] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T22:09:51.302414] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-01T22:09:51.785721] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T22:09:52.102388] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-01T22:09:52.695062] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T22:09:52.902352] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-01T22:09:53.360335] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-01T22:09:53.702433] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-01T22:09:54.194892] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T22:09:54.502386] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-01T22:09:54.564745] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-01T22:09:55.302413] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-01T22:09:55.598247] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:09:55.600060] [INFO ] [REMOTE ] URI: Full fetch complete (53429 records). [2025-10-01T22:09:55.600231] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-01T22:09:56.063951] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-01T22:09:56.064132] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-01T22:09:56.065968] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-01T22:09:56.066127] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-01T22:09:56.068076] [DEBUG] [LOCAL ] URI: Trimmed 53429 records to 35649 (keeping 200 days of data) [2025-10-01T22:09:56.155522] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-01T22:09:56.426840] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T22:09:56.491209] [DEBUG] [LOCAL ] URI: Primary data saved (35649 records). [2025-10-01T22:09:56.491398] [INFO ] [MAIN ] URI: Full history saved. [2025-10-01T22:09:56.491511] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. URI took 33.6s. Estimated remaining: 24m 60s. Rate: 7.1 symbols/min [2025-10-01T22:09:56.753156] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:09:56.834477] [DEBUG] [LOCAL ] USFD: Loaded 51183 existing records from primary storage. [2025-10-01T22:09:56.834990] [INFO ] [MAIN ] USFD: Loaded 51183 existing records. [2025-10-01T22:09:56.907577] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-01T22:09:57.086091] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:09:57.086342] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-01T22:09:57.086400] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-01T22:09:57.087537] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-01T22:09:57.087670] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-01T22:09:57.534801] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:09:57.664188] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-01T22:09:57.702367] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-01T22:09:58.172463] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T22:09:58.502422] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-01T22:09:59.189020] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-01T22:09:59.302383] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-01T22:10:00.071388] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T22:10:00.102355] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-01T22:10:00.902387] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-01T22:10:01.145880] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T22:10:01.702356] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-01T22:10:01.793548] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T22:10:02.046968] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T22:10:02.502408] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-01T22:10:03.135559] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T22:10:03.302373] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-01T22:10:03.553698] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-01T22:10:04.102396] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-01T22:10:04.902367] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-01T22:10:05.151052] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T22:10:05.198824] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T22:10:05.702412] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-01T22:10:06.028431] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T22:10:06.029843] [INFO ] [REMOTE ] USA: Full fetch complete (52088 records). [2025-10-01T22:10:06.029929] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-01T22:10:06.445316] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-01T22:10:06.445397] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-01T22:10:06.446319] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-01T22:10:06.446383] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-01T22:10:06.447486] [DEBUG] [LOCAL ] USA: Trimmed 52088 records to 35974 (keeping 200 days of data) [2025-10-01T22:10:06.506181] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-01T22:10:06.653311] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-01T22:10:06.685171] [DEBUG] [LOCAL ] USA: Primary data saved (35974 records). [2025-10-01T22:10:06.685287] [INFO ] [MAIN ] USA: Full history saved. [2025-10-01T22:10:06.685375] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USA took 34.3s. Estimated remaining: 24m 52s. Rate: 7.1 symbols/min [2025-10-01T22:10:06.869558] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:10:06.888849] [DEBUG] [LOCAL ] USNA: Loaded 17910 existing records from primary storage. [2025-10-01T22:10:06.889119] [INFO ] [MAIN ] USNA: Loaded 17910 existing records. [2025-10-01T22:10:07.083512] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:10:07.083779] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-01T22:10:07.083833] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-01T22:10:07.084393] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-01T22:10:07.084455] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-01T22:10:07.309083] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-01T22:10:07.478165] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:10:08.091476] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-01T22:10:08.092494] [INFO ] [REMOTE ] USAC: Full fetch complete (35485 records). [2025-10-01T22:10:08.092570] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-01T22:10:08.107532] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-01T22:10:08.439453] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-01T22:10:08.588903] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-01T22:10:08.588989] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-01T22:10:08.589827] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-01T22:10:08.589900] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-01T22:10:08.590831] [DEBUG] [LOCAL ] USAC: Trimmed 35485 records to 22250 (keeping 200 days of data) [2025-10-01T22:10:08.729919] [DEBUG] [LOCAL ] USAC: Primary data saved (22250 records). [2025-10-01T22:10:08.730055] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-01T22:10:08.730155] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USAC took 32.8s. Estimated remaining: 24m 43s. Rate: 7.1 symbols/min [2025-10-01T22:10:08.902441] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-01T22:10:08.921501] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:10:08.940453] [DEBUG] [LOCAL ] USPH: Loaded 16572 existing records from primary storage. [2025-10-01T22:10:08.940736] [INFO ] [MAIN ] USPH: Loaded 16572 existing records. [2025-10-01T22:10:09.163777] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:10:09.164066] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-01T22:10:09.164150] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-01T22:10:09.164721] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-01T22:10:09.164784] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-01T22:10:09.568901] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:10:09.578718] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-01T22:10:09.702361] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-01T22:10:10.183090] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-01T22:10:10.481868] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T22:10:10.502343] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-01T22:10:11.302369] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-01T22:10:11.614937] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T22:10:12.102407] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-01T22:10:12.246361] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-01T22:10:12.902429] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-01T22:10:13.702363] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-01T22:10:13.778988] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T22:10:13.977202] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T22:10:14.502421] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-01T22:10:15.276227] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-01T22:10:15.302395] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-01T22:10:15.356208] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T22:10:16.102360] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-01T22:10:16.902346] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-01T22:10:17.109697] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-01T22:10:17.305021] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T22:10:17.702378] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-01T22:10:18.502362] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-01T22:10:18.547815] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T22:10:19.302386] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-01T22:10:19.384709] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-01T22:10:20.102373] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-01T22:10:20.223102] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T22:10:20.375001] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T22:10:20.902418] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-01T22:10:21.702369] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-01T22:10:21.956317] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-01T22:10:22.349358] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T22:10:22.502389] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-01T22:10:22.696323] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T22:10:23.302390] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-01T22:10:23.480102] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-01T22:10:24.102389] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-01T22:10:24.902431] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-01T22:10:25.081164] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T22:10:25.159905] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T22:10:25.326196] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T22:10:25.702419] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-01T22:10:26.426335] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T22:10:26.502381] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-01T22:10:27.302428] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-01T22:10:27.467060] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T22:10:27.690347] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-01T22:10:28.102402] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-01T22:10:28.459156] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-01T22:10:28.461377] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-01T22:10:28.461562] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-01T22:10:28.906754] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-01T22:10:28.927568] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-01T22:10:28.927674] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-01T22:10:28.928986] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-01T22:10:28.929154] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-01T22:10:28.930776] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-10-01T22:10:29.197400] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:10:29.202623] [INFO ] [REMOTE ] USFD: Full fetch complete (73976 records). [2025-10-01T22:10:29.206005] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-01T22:10:29.705341] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-01T22:10:29.728635] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-01T22:10:29.729046] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-01T22:10:29.731792] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-01T22:10:29.732232] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-01T22:10:29.736293] [DEBUG] [LOCAL ] USFD: Trimmed 73976 records to 51195 (keeping 200 days of data) [2025-10-01T22:10:29.742416] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-01T22:10:29.742683] [INFO ] [MAIN ] USB: Full history saved. [2025-10-01T22:10:29.742794] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 48.5s. Estimated remaining: 24m 35s. Rate: 7.1 symbols/min [2025-10-01T22:10:30.061018] [DEBUG] [LOCAL ] USFD: Primary data saved (51195 records). [2025-10-01T22:10:30.061167] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-01T22:10:30.061283] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USFD took 33.6s. Estimated remaining: 24m 26s. Rate: 7.1 symbols/min [2025-10-01T22:10:30.502443] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-01T22:10:30.759811] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-01T22:10:31.186490] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T22:10:31.187443] [INFO ] [REMOTE ] USNA: Full fetch complete (26591 records). [2025-10-01T22:10:31.187522] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-01T22:10:31.307525] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-01T22:10:31.594660] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-01T22:10:31.594766] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-01T22:10:31.595455] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-01T22:10:31.595521] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-01T22:10:31.596354] [DEBUG] [LOCAL ] USNA: Trimmed 26591 records to 17841 (keeping 200 days of data) [2025-10-01T22:10:31.706195] [DEBUG] [LOCAL ] USNA: Primary data saved (17841 records). [2025-10-01T22:10:31.706345] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-01T22:10:31.706430] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USNA took 25.0s. Estimated remaining: 24m 17s. Rate: 7.1 symbols/min [2025-10-01T22:10:32.178377] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T22:10:32.182554] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-01T22:10:33.202378] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T22:10:33.207554] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-01T22:10:34.028637] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-01T22:10:34.034223] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-01T22:10:35.067002] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T22:10:35.071264] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-01T22:10:36.154022] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T22:10:36.158469] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-01T22:10:36.852522] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-01T22:10:36.853594] [INFO ] [REMOTE ] USPH: Full fetch complete (22690 records). [2025-10-01T22:10:36.853730] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-01T22:10:37.283502] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-01T22:10:37.283578] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-01T22:10:37.284157] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-01T22:10:37.284228] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-01T22:10:37.284945] [DEBUG] [LOCAL ] USPH: Trimmed 22690 records to 16687 (keeping 200 days of data) [2025-10-01T22:10:37.391371] [DEBUG] [LOCAL ] USPH: Primary data saved (16687 records). [2025-10-01T22:10:37.391563] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-01T22:10:37.391713] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USPH took 28.7s. Estimated remaining: 24m 8s. Rate: 7.1 symbols/min [2025-10-01T22:10:38.050197] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:10:38.114776] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:10:38.204722] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:10:38.209891] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:10:38.237091] [DEBUG] [LOCAL ] UTL: Loaded 11256 existing records from primary storage. [2025-10-01T22:10:38.237433] [INFO ] [MAIN ] UTL: Loaded 11256 existing records. [2025-10-01T22:10:38.407732] [DEBUG] [LOCAL ] UTI: Loaded 40477 existing records from primary storage. [2025-10-01T22:10:38.408629] [INFO ] [MAIN ] UTI: Loaded 40477 existing records. [2025-10-01T22:10:38.434727] [DEBUG] [LOCAL ] UTZ: Loaded 44723 existing records from primary storage. [2025-10-01T22:10:38.445729] [DEBUG] [LOCAL ] UTF: Loaded 29075 existing records from primary storage. [2025-10-01T22:10:38.479600] [INFO ] [MAIN ] UTZ: Loaded 44723 existing records. [2025-10-01T22:10:38.531577] [INFO ] [MAIN ] UTF: Loaded 29075 existing records. [2025-10-01T22:10:38.611007] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:10:38.690460] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-01T22:10:38.782717] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-01T22:10:38.873122] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-01T22:10:38.925716] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-01T22:10:39.046346] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:10:39.139784] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-01T22:10:39.099988] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:10:39.151696] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-01T22:10:39.160236] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-01T22:10:39.165453] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-01T22:10:39.180930] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-01T22:10:39.198700] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-01T22:10:39.269788] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:10:39.300900] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-01T22:10:39.290182] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-01T22:10:39.317243] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-01T22:10:39.322469] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-01T22:10:39.467936] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-01T22:10:39.498265] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-01T22:10:40.413750] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:10:40.586107] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-01T22:10:40.715010] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:10:40.750045] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-01T22:10:40.798298] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:10:40.839088] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:10:40.840382] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-01T22:10:40.839535] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-01T22:10:41.563534] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T22:10:41.566246] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-01T22:10:41.987239] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T22:10:41.995189] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-01T22:10:42.150708] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T22:10:42.157171] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-01T22:10:42.164774] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T22:10:42.168094] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-01T22:10:42.279734] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T22:10:42.502382] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-01T22:10:42.650993] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-01T22:10:43.007149] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-01T22:10:43.302370] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-01T22:10:43.567286] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T22:10:44.102378] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-01T22:10:44.141492] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T22:10:44.442048] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T22:10:44.902390] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-01T22:10:44.938632] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T22:10:45.702385] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-01T22:10:46.416829] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T22:10:46.502390] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-01T22:10:47.201609] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-01T22:10:47.302388] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-01T22:10:47.662839] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-01T22:10:48.102422] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-01T22:10:48.591354] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T22:10:48.902395] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-01T22:10:49.490116] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-01T22:10:49.694472] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-01T22:10:49.702351] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-01T22:10:50.421152] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T22:10:50.502451] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-01T22:10:51.296126] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T22:10:51.302335] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-01T22:10:52.102430] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-01T22:10:52.902418] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-01T22:10:52.980590] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T22:10:53.503078] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-01T22:10:53.702381] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-01T22:10:54.502425] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-01T22:10:54.569687] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T22:10:54.760073] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-01T22:10:55.302364] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-01T22:10:55.460797] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-01T22:10:56.102419] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-01T22:10:56.885386] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T22:10:56.902342] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-01T22:10:57.105460] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-01T22:10:57.702385] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-01T22:10:58.147636] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-01T22:10:58.256449] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-01T22:10:58.502389] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-01T22:10:59.302391] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-01T22:11:00.030684] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T22:11:00.102378] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-01T22:11:00.483578] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T22:11:00.902389] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-01T22:11:01.112011] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-01T22:11:01.112958] [INFO ] [REMOTE ] UTL: Full fetch complete (15422 records). [2025-10-01T22:11:01.113033] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-01T22:11:01.564443] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-01T22:11:01.564619] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-01T22:11:01.565140] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-01T22:11:01.565205] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-01T22:11:01.566035] [DEBUG] [LOCAL ] UTL: Trimmed 15422 records to 11321 (keeping 200 days of data) [2025-10-01T22:11:01.643777] [DEBUG] [LOCAL ] UTL: Primary data saved (11321 records). [2025-10-01T22:11:01.643972] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-01T22:11:01.644125] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 24.2s. Estimated remaining: 24m 1s. Rate: 7.1 symbols/min [2025-10-01T22:11:01.715857] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-01T22:11:01.851565] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T22:11:01.892746] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:01.915381] [DEBUG] [LOCAL ] UVE: Loaded 21795 existing records from primary storage. [2025-10-01T22:11:01.915681] [INFO ] [MAIN ] UVE: Loaded 21795 existing records. [2025-10-01T22:11:02.116996] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:02.117235] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-01T22:11:02.117284] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-01T22:11:02.118033] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-01T22:11:02.118096] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-01T22:11:02.509507] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-01T22:11:02.516619] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:03.119952] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T22:11:03.302383] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-01T22:11:03.559808] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T22:11:03.565470] [INFO ] [REMOTE ] UTI: Full fetch complete (58284 records). [2025-10-01T22:11:03.565620] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-01T22:11:03.995059] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-01T22:11:03.995156] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-01T22:11:03.996338] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-01T22:11:03.996444] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-01T22:11:03.998879] [DEBUG] [LOCAL ] UTI: Trimmed 58284 records to 40440 (keeping 200 days of data) [2025-10-01T22:11:04.104834] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-01T22:11:04.256210] [DEBUG] [LOCAL ] UTI: Primary data saved (40440 records). [2025-10-01T22:11:04.256345] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-01T22:11:04.256446] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTI took 26.9s. Estimated remaining: 23m 52s. Rate: 7.1 symbols/min [2025-10-01T22:11:04.467045] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:04.492109] [DEBUG] [LOCAL ] UVV: Loaded 22456 existing records from primary storage. [2025-10-01T22:11:04.492366] [INFO ] [MAIN ] UVV: Loaded 22456 existing records. [2025-10-01T22:11:04.702603] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:04.702848] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-01T22:11:04.702906] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-01T22:11:04.703538] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-01T22:11:04.703601] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-01T22:11:04.902867] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-01T22:11:05.112112] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:05.140966] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T22:11:05.389271] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T22:11:05.702364] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-01T22:11:06.011539] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T22:11:06.502385] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-01T22:11:07.199302] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-01T22:11:07.302369] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-01T22:11:07.518665] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-01T22:11:08.102383] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-01T22:11:08.340556] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-01T22:11:08.341860] [INFO ] [REMOTE ] UTF: Full fetch complete (41983 records). [2025-10-01T22:11:08.341935] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-01T22:11:08.791837] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-01T22:11:08.791929] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-01T22:11:08.792918] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-01T22:11:08.792996] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-01T22:11:08.794072] [DEBUG] [LOCAL ] UTF: Trimmed 41983 records to 29257 (keeping 200 days of data) [2025-10-01T22:11:08.902578] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-01T22:11:08.924502] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-01T22:11:09.010719] [DEBUG] [LOCAL ] UTF: Primary data saved (29257 records). [2025-10-01T22:11:09.010862] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-01T22:11:09.010951] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTF took 31.6s. Estimated remaining: 23m 43s. Rate: 7.1 symbols/min [2025-10-01T22:11:09.198743] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:09.252987] [DEBUG] [LOCAL ] UWMC: Loaded 52765 existing records from primary storage. [2025-10-01T22:11:09.253438] [INFO ] [MAIN ] UWMC: Loaded 52765 existing records. [2025-10-01T22:11:09.455162] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:09.455402] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-01T22:11:09.455450] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-01T22:11:09.459597] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-01T22:11:09.459698] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-01T22:11:09.707525] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-01T22:11:09.867217] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:10.502367] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-01T22:11:10.594125] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T22:11:10.617901] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T22:11:11.302397] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-01T22:11:12.102365] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-01T22:11:12.193596] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-01T22:11:12.290524] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-01T22:11:12.902398] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-01T22:11:13.702350] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-01T22:11:13.763910] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T22:11:14.009398] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T22:11:14.502381] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-01T22:11:15.261821] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-01T22:11:15.302418] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-01T22:11:15.773189] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T22:11:16.102382] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-01T22:11:16.318524] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-01T22:11:16.902404] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-01T22:11:17.593239] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T22:11:17.702386] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-01T22:11:17.903691] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-01T22:11:18.502396] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-01T22:11:18.656528] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-01T22:11:19.302412] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-01T22:11:19.644705] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T22:11:20.102399] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-01T22:11:20.626162] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T22:11:20.902388] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-01T22:11:21.647298] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-01T22:11:21.702408] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-01T22:11:22.175165] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T22:11:22.502426] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-01T22:11:22.812555] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T22:11:23.302417] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-01T22:11:23.888266] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T22:11:24.102405] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-01T22:11:24.349421] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-01T22:11:24.350855] [INFO ] [REMOTE ] UTZ: Full fetch complete (64226 records). [2025-10-01T22:11:24.350957] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-01T22:11:24.784878] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-01T22:11:24.784972] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-01T22:11:24.786087] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-01T22:11:24.786152] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-01T22:11:24.787516] [DEBUG] [LOCAL ] UTZ: Trimmed 64226 records to 44744 (keeping 200 days of data) [2025-10-01T22:11:24.920904] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-01T22:11:25.081430] [DEBUG] [LOCAL ] UTZ: Primary data saved (44744 records). [2025-10-01T22:11:25.081586] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-01T22:11:25.081703] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTZ took 47.7s. Estimated remaining: 23m 36s. Rate: 7.1 symbols/min [2025-10-01T22:11:25.281152] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:25.289443] [DEBUG] [LOCAL ] UZD: Loaded 6448 existing records from primary storage. [2025-10-01T22:11:25.289689] [INFO ] [MAIN ] UZD: Loaded 6448 existing records. [2025-10-01T22:11:25.495444] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:25.495825] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-01T22:11:25.495882] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-01T22:11:25.496196] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-01T22:11:25.496257] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-01T22:11:25.708386] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-01T22:11:25.922742] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:25.956704] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T22:11:25.983019] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T22:11:26.502384] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-01T22:11:26.996278] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T22:11:27.302395] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-01T22:11:28.085911] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-01T22:11:28.102351] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-01T22:11:28.330694] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T22:11:28.877442] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T22:11:28.902352] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-01T22:11:29.538506] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T22:11:29.702404] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-01T22:11:30.502382] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-01T22:11:30.786012] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-01T22:11:31.302393] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-01T22:11:31.895704] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T22:11:32.102356] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-01T22:11:32.284567] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T22:11:32.902281] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-01T22:11:32.902343] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-01T22:11:33.529974] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-01T22:11:33.531300] [INFO ] [REMOTE ] UVE: Full fetch complete (29717 records). [2025-10-01T22:11:33.531383] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-01T22:11:33.703858] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-01T22:11:33.943613] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-01T22:11:33.943726] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-01T22:11:33.944344] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-01T22:11:33.944385] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-01T22:11:33.945169] [DEBUG] [LOCAL ] UVE: Trimmed 29717 records to 21782 (keeping 200 days of data) [2025-10-01T22:11:34.083147] [DEBUG] [LOCAL ] UVE: Primary data saved (21782 records). [2025-10-01T22:11:34.083283] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-01T22:11:34.083378] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 32.4s. Estimated remaining: 23m 27s. Rate: 7.1 symbols/min [2025-10-01T22:11:34.282196] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:34.292700] [DEBUG] [LOCAL ] UZE: Loaded 7436 existing records from primary storage. [2025-10-01T22:11:34.292981] [INFO ] [MAIN ] UZE: Loaded 7436 existing records. [2025-10-01T22:11:34.509472] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:34.509998] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-01T22:11:34.509581] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-01T22:11:34.511835] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-01T22:11:34.512272] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-01T22:11:34.512343] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-01T22:11:34.661901] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T22:11:34.952077] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:35.302375] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-01T22:11:35.706144] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T22:11:36.069909] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-01T22:11:36.102397] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-01T22:11:36.837706] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-01T22:11:36.902394] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-01T22:11:37.468189] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T22:11:37.702383] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-01T22:11:38.412893] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-01T22:11:38.502377] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-01T22:11:39.229871] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T22:11:39.302376] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-01T22:11:40.030554] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-01T22:11:40.102362] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-01T22:11:40.631912] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-01T22:11:40.902443] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-01T22:11:41.707515] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-01T22:11:41.715518] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T22:11:42.315567] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-01T22:11:42.502424] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-01T22:11:43.103108] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-01T22:11:43.302387] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-01T22:11:44.102384] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-01T22:11:44.473112] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-01T22:11:44.474141] [INFO ] [REMOTE ] UVV: Full fetch complete (29909 records). [2025-10-01T22:11:44.474220] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-01T22:11:44.892577] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-01T22:11:44.892741] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-01T22:11:44.893372] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-01T22:11:44.893420] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-01T22:11:44.894321] [DEBUG] [LOCAL ] UVV: Trimmed 29909 records to 22514 (keeping 200 days of data) [2025-10-01T22:11:44.947547] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-01T22:11:45.040178] [DEBUG] [LOCAL ] UVV: Primary data saved (22514 records). [2025-10-01T22:11:45.040433] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-01T22:11:45.040583] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 40.8s. Estimated remaining: 23m 19s. Rate: 7.1 symbols/min [2025-10-01T22:11:45.243601] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:45.281610] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-01T22:11:45.285303] [DEBUG] [LOCAL ] UZF: Loaded 6467 existing records from primary storage. [2025-10-01T22:11:45.297259] [INFO ] [MAIN ] UZF: Loaded 6467 existing records. [2025-10-01T22:11:45.498865] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-01T22:11:45.505052] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:45.507927] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-01T22:11:45.507986] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-01T22:11:45.508307] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-01T22:11:45.508367] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-01T22:11:45.709340] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-01T22:11:45.942730] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:46.502394] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-01T22:11:47.302375] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-01T22:11:47.447841] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T22:11:47.514205] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-01T22:11:47.931381] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T22:11:48.102403] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-01T22:11:48.721008] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T22:11:48.902415] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-01T22:11:49.702412] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-01T22:11:49.726304] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-01T22:11:50.502431] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-01T22:11:51.199099] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T22:11:51.302357] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-01T22:11:51.562829] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T22:11:51.706382] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-01T22:11:51.707174] [INFO ] [REMOTE ] UZE: Full fetch complete (10100 records). [2025-10-01T22:11:51.707247] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-01T22:11:52.109724] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-01T22:11:52.109434] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-01T22:11:52.109858] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-01T22:11:52.110891] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-01T22:11:52.110954] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-01T22:11:52.111592] [DEBUG] [LOCAL ] UZE: Trimmed 10100 records to 7443 (keeping 200 days of data) [2025-10-01T22:11:52.161186] [DEBUG] [LOCAL ] UZE: Primary data saved (7443 records). [2025-10-01T22:11:52.161334] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-01T22:11:52.161430] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UZE took 18.1s. Estimated remaining: 23m 10s. Rate: 7.1 symbols/min [2025-10-01T22:11:52.344131] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:52.401916] [DEBUG] [LOCAL ] V: Loaded 53755 existing records from primary storage. [2025-10-01T22:11:52.402288] [INFO ] [MAIN ] V: Loaded 53755 existing records. [2025-10-01T22:11:52.612139] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:52.612410] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-01T22:11:52.612479] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-01T22:11:52.614011] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-01T22:11:52.614077] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-01T22:11:52.907509] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-01T22:11:53.023012] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:53.613163] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T22:11:53.698947] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T22:11:53.702376] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-01T22:11:54.502426] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-01T22:11:55.302359] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-01T22:11:55.555167] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-01T22:11:55.807622] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-01T22:11:55.808416] [INFO ] [REMOTE ] UZD: Full fetch complete (9510 records). [2025-10-01T22:11:55.808498] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-01T22:11:56.107634] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-01T22:11:56.226850] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-01T22:11:56.226994] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-01T22:11:56.227270] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-01T22:11:56.227357] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-01T22:11:56.228200] [DEBUG] [LOCAL ] UZD: Trimmed 9510 records to 6411 (keeping 200 days of data) [2025-10-01T22:11:56.270010] [DEBUG] [LOCAL ] UZD: Primary data saved (6411 records). [2025-10-01T22:11:56.270287] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-01T22:11:56.270435] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZD took 31.2s. Estimated remaining: 23m 1s. Rate: 7.1 symbols/min [2025-10-01T22:11:56.461672] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:56.493467] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-01T22:11:56.535415] [DEBUG] [LOCAL ] VAC: Loaded 34398 existing records from primary storage. [2025-10-01T22:11:56.535757] [INFO ] [MAIN ] VAC: Loaded 34398 existing records. [2025-10-01T22:11:56.734506] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:56.734763] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-01T22:11:56.734821] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-01T22:11:56.735758] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-01T22:11:56.735825] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-01T22:11:56.907460] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-01T22:11:57.156351] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:57.563325] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-01T22:11:57.566484] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-01T22:11:57.570426] [INFO ] [REMOTE ] UWMC: Full fetch complete (75611 records). [2025-10-01T22:11:57.570526] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-01T22:11:57.707508] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-01T22:11:58.008771] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-01T22:11:58.008879] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-01T22:11:58.010001] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-01T22:11:58.010067] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-01T22:11:58.011558] [DEBUG] [LOCAL ] UWMC: Trimmed 75611 records to 52775 (keeping 200 days of data) [2025-10-01T22:11:58.334403] [DEBUG] [LOCAL ] UWMC: Primary data saved (52775 records). [2025-10-01T22:11:58.334569] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-01T22:11:58.334707] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 49.3s. Estimated remaining: 22m 52s. Rate: 7.1 symbols/min [2025-10-01T22:11:58.507124] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-01T22:11:58.533901] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:11:58.581429] [DEBUG] [LOCAL ] VAL: Loaded 50312 existing records from primary storage. [2025-10-01T22:11:58.581786] [INFO ] [MAIN ] VAL: Loaded 50312 existing records. [2025-10-01T22:11:58.779767] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:11:58.780006] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-01T22:11:58.780057] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-01T22:11:58.781256] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-01T22:11:58.781320] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-01T22:11:59.166789] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:11:59.302387] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-01T22:11:59.790427] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T22:11:59.846512] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-01T22:12:00.102428] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-01T22:12:00.738052] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-01T22:12:00.902393] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-01T22:12:01.147133] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T22:12:01.702404] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-01T22:12:02.307188] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T22:12:02.502389] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-01T22:12:03.302403] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-01T22:12:03.343489] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T22:12:03.604569] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T22:12:04.102408] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-01T22:12:04.491120] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-01T22:12:04.831223] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-01T22:12:04.902370] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-01T22:12:05.702384] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-01T22:12:06.502369] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-01T22:12:06.603236] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T22:12:07.275739] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T22:12:07.302360] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-01T22:12:07.707818] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-01T22:12:08.102384] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-01T22:12:08.872626] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-01T22:12:08.902360] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-01T22:12:09.709895] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-01T22:12:09.715631] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-01T22:12:10.078737] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T22:12:10.502406] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-01T22:12:11.302400] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-01T22:12:11.890279] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T22:12:12.102366] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-01T22:12:12.148697] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-01T22:12:12.308183] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T22:12:12.590149] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T22:12:12.902438] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-01T22:12:13.702455] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-01T22:12:14.502444] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-01T22:12:14.622091] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T22:12:14.648924] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T22:12:15.302375] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-01T22:12:16.102414] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-01T22:12:16.534253] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T22:12:16.577308] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T22:12:16.902437] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-01T22:12:17.702460] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-01T22:12:17.843504] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T22:12:18.502382] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-01T22:12:18.934860] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-01T22:12:19.075313] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T22:12:19.110222] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T22:12:19.302418] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-01T22:12:20.102383] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-01T22:12:20.449946] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-01T22:12:20.902382] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-01T22:12:21.702374] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-01T22:12:21.845907] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-01T22:12:22.502428] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-01T22:12:22.855218] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-01T22:12:22.856016] [INFO ] [REMOTE ] UZF: Full fetch complete (8873 records). [2025-10-01T22:12:22.856087] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-01T22:12:23.303806] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T22:12:23.304066] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-01T22:12:23.306949] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-01T22:12:23.312377] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-01T22:12:23.313856] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-01T22:12:23.314092] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-01T22:12:23.315790] [DEBUG] [LOCAL ] UZF: Trimmed 8873 records to 6456 (keeping 200 days of data) [2025-10-01T22:12:23.392492] [DEBUG] [LOCAL ] UZF: Primary data saved (6456 records). [2025-10-01T22:12:23.393268] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-01T22:12:23.394633] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-01T22:12:23.394901] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 38.4s. Estimated remaining: 22m 45s. Rate: 7.1 symbols/min [2025-10-01T22:12:23.616336] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:12:23.681393] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-10-01T22:12:23.681803] [INFO ] [MAIN ] VALE: Loaded 53694 existing records. [2025-10-01T22:12:23.884558] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:12:23.884886] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-01T22:12:23.884953] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-01T22:12:23.886281] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-01T22:12:23.886357] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-01T22:12:24.112578] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-01T22:12:24.301416] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:12:24.902356] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-01T22:12:25.103449] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-01T22:12:25.702405] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-01T22:12:26.066671] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T22:12:26.417394] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-01T22:12:26.502403] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-01T22:12:26.775688] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T22:12:27.313634] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-01T22:12:27.336890] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T22:12:27.635277] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T22:12:27.636592] [INFO ] [REMOTE ] VAC: Full fetch complete (48216 records). [2025-10-01T22:12:27.636763] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-01T22:12:28.107886] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-01T22:12:28.107488] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-01T22:12:28.108089] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-01T22:12:28.110214] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-01T22:12:28.110415] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-01T22:12:28.114961] [DEBUG] [LOCAL ] VAC: Trimmed 48216 records to 34393 (keeping 200 days of data) [2025-10-01T22:12:28.350103] [DEBUG] [LOCAL ] VAC: Primary data saved (34393 records). [2025-10-01T22:12:28.350268] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-01T22:12:28.350427] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAC took 32.1s. Estimated remaining: 22m 36s. Rate: 7.1 symbols/min [2025-10-01T22:12:28.565887] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:12:28.577637] [DEBUG] [LOCAL ] VATE: Loaded 5321 existing records from primary storage. [2025-10-01T22:12:28.577895] [INFO ] [MAIN ] VATE: Loaded 5321 existing records. [2025-10-01T22:12:28.773353] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:12:28.773619] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-01T22:12:28.773706] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-01T22:12:28.774530] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-01T22:12:28.774592] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-01T22:12:28.907545] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-01T22:12:29.154329] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:12:29.507104] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T22:12:29.702443] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-01T22:12:30.018103] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T22:12:30.020002] [INFO ] [REMOTE ] V: Full fetch complete (77822 records). [2025-10-01T22:12:30.020105] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-01T22:12:30.488149] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-01T22:12:30.488289] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-01T22:12:30.489457] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-01T22:12:30.489524] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-01T22:12:30.491110] [DEBUG] [LOCAL ] V: Trimmed 77822 records to 53755 (keeping 200 days of data) [2025-10-01T22:12:30.550347] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-01T22:12:30.848753] [DEBUG] [LOCAL ] V: Primary data saved (53755 records). [2025-10-01T22:12:30.848927] [INFO ] [MAIN ] V: Full history saved. [2025-10-01T22:12:30.849035] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. V took 38.7s. Estimated remaining: 22m 28s. Rate: 7.1 symbols/min [2025-10-01T22:12:31.038506] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:12:31.048922] [DEBUG] [LOCAL ] VBF: Loaded 6945 existing records from primary storage. [2025-10-01T22:12:31.049119] [INFO ] [MAIN ] VBF: Loaded 6945 existing records. [2025-10-01T22:12:31.284936] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:12:31.286097] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-01T22:12:31.289713] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-01T22:12:31.289847] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-01T22:12:31.294276] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-01T22:12:31.304634] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-01T22:12:31.304805] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-01T22:12:31.305798] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-01T22:12:31.708015] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:12:31.832858] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T22:12:32.102368] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-01T22:12:32.253742] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (0.15 seconds). [2025-10-01T22:12:32.255287] [INFO ] [REMOTE ] VAL: Full fetch complete (73251 records). [2025-10-01T22:12:32.255416] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-01T22:12:32.686269] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-01T22:12:32.686362] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-01T22:12:32.687694] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-01T22:12:32.687765] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-01T22:12:32.689471] [DEBUG] [LOCAL ] VAL: Trimmed 73251 records to 50306 (keeping 200 days of data) [2025-10-01T22:12:32.906699] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-01T22:12:33.007053] [DEBUG] [LOCAL ] VAL: Primary data saved (50306 records). [2025-10-01T22:12:33.007210] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-01T22:12:33.007330] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAL took 34.7s. Estimated remaining: 22m 19s. Rate: 7.1 symbols/min [2025-10-01T22:12:33.196673] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:12:33.215631] [DEBUG] [LOCAL ] VCV: Loaded 13695 existing records from primary storage. [2025-10-01T22:12:33.215937] [INFO ] [MAIN ] VCV: Loaded 13695 existing records. [2025-10-01T22:12:33.416599] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:12:33.416855] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-01T22:12:33.416949] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-01T22:12:33.417421] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-01T22:12:33.417483] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-01T22:12:33.570047] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T22:12:33.707458] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-01T22:12:33.849635] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:12:34.502534] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-01T22:12:34.863183] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T22:12:35.302403] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-01T22:12:36.002025] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-01T22:12:36.107491] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-01T22:12:36.127351] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T22:12:36.902402] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-01T22:12:37.172324] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-01T22:12:37.676037] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T22:12:37.702386] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-01T22:12:38.272760] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-01T22:12:38.502392] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-01T22:12:39.238927] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-01T22:12:39.302345] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-01T22:12:39.797802] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-01T22:12:40.102373] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-01T22:12:40.750980] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-01T22:12:40.902393] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-01T22:12:41.700844] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-01T22:12:41.704573] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-01T22:12:42.502386] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-01T22:12:42.519421] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T22:12:42.993812] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-01T22:12:43.302370] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-01T22:12:43.730098] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T22:12:44.102392] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-01T22:12:44.714587] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T22:12:44.902410] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-01T22:12:45.702409] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-01T22:12:46.063605] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-01T22:12:46.064479] [INFO ] [REMOTE ] VATE: Full fetch complete (10509 records). [2025-10-01T22:12:46.064554] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-01T22:12:46.466529] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-01T22:12:46.466706] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-01T22:12:46.466995] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-01T22:12:46.467039] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-01T22:12:46.467962] [DEBUG] [LOCAL ] VATE: Trimmed 10509 records to 5334 (keeping 200 days of data) [2025-10-01T22:12:46.499286] [DEBUG] [LOCAL ] VATE: Primary data saved (5334 records). [2025-10-01T22:12:46.499428] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-01T22:12:46.499518] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VATE took 18.1s. Estimated remaining: 22m 11s. Rate: 7.1 symbols/min [2025-10-01T22:12:46.504910] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-01T22:12:46.701587] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:12:46.761596] [DEBUG] [LOCAL ] VEEV: Loaded 47070 existing records from primary storage. [2025-10-01T22:12:46.762020] [INFO ] [MAIN ] VEEV: Loaded 47070 existing records. [2025-10-01T22:12:46.979891] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:12:46.980219] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-01T22:12:46.980332] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-01T22:12:46.991410] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-01T22:12:47.010598] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-01T22:12:47.068204] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-01T22:12:47.203529] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T22:12:47.307484] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-01T22:12:47.454879] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:12:47.959932] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-01T22:12:48.102405] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-01T22:12:48.874799] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-01T22:12:48.902347] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-01T22:12:49.624049] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T22:12:49.702400] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-01T22:12:50.502404] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-01T22:12:51.284421] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T22:12:51.302347] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-01T22:12:51.523088] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T22:12:51.833078] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-01T22:12:52.102383] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-01T22:12:52.902398] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-01T22:12:53.702398] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-01T22:12:53.833337] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T22:12:54.478897] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-01T22:12:54.502343] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-01T22:12:54.729825] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-01T22:12:55.302394] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-01T22:12:55.468324] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T22:12:56.102425] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-01T22:12:56.856104] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-01T22:12:56.907479] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-01T22:12:56.924624] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-01T22:12:57.702385] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-01T22:12:57.721807] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T22:12:58.502390] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-01T22:12:59.302365] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-01T22:12:59.400426] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-01T22:12:59.687103] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-01T22:13:00.102394] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-01T22:13:00.495174] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-01T22:13:00.496147] [INFO ] [REMOTE ] VBF: Full fetch complete (10447 records). [2025-10-01T22:13:00.496228] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-01T22:13:00.902242] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-01T22:13:00.902325] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-01T22:13:00.902609] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-01T22:13:00.902725] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-01T22:13:00.903980] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-01T22:13:00.904611] [DEBUG] [LOCAL ] VBF: Trimmed 10447 records to 6911 (keeping 200 days of data) [2025-10-01T22:13:00.949963] [DEBUG] [LOCAL ] VBF: Primary data saved (6911 records). [2025-10-01T22:13:00.950467] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-01T22:13:00.950680] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VBF took 30.1s. Estimated remaining: 22m 2s. Rate: 7.1 symbols/min [2025-10-01T22:13:01.138822] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:01.155340] [DEBUG] [LOCAL ] VEL: Loaded 12826 existing records from primary storage. [2025-10-01T22:13:01.155708] [INFO ] [MAIN ] VEL: Loaded 12826 existing records. [2025-10-01T22:13:01.392856] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-01T22:13:01.398671] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:13:01.409368] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-01T22:13:01.409608] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-01T22:13:01.410183] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-01T22:13:01.410257] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-01T22:13:01.707884] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-01T22:13:01.751472] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-01T22:13:01.832878] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:13:02.502388] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-01T22:13:03.159261] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T22:13:03.302351] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-01T22:13:03.352729] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T22:13:04.102363] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-01T22:13:04.308111] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-01T22:13:04.902377] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-01T22:13:05.702392] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-01T22:13:05.873073] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-01T22:13:06.285916] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-01T22:13:06.509211] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-01T22:13:06.515429] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-01T22:13:07.124421] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-01T22:13:07.125407] [INFO ] [REMOTE ] VCV: Full fetch complete (19552 records). [2025-10-01T22:13:07.125484] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-01T22:13:07.310802] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-01T22:13:07.567145] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-01T22:13:07.567226] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-01T22:13:07.567702] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-01T22:13:07.567763] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-01T22:13:07.568592] [DEBUG] [LOCAL ] VCV: Trimmed 19552 records to 13723 (keeping 200 days of data) [2025-10-01T22:13:07.658417] [DEBUG] [LOCAL ] VCV: Primary data saved (13723 records). [2025-10-01T22:13:07.658566] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-01T22:13:07.658675] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VCV took 34.7s. Estimated remaining: 21m 54s. Rate: 7.1 symbols/min [2025-10-01T22:13:07.845702] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:07.891216] [DEBUG] [LOCAL ] VET: Loaded 43932 existing records from primary storage. [2025-10-01T22:13:07.891532] [INFO ] [MAIN ] VET: Loaded 43932 existing records. [2025-10-01T22:13:08.086406] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:13:08.086631] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-01T22:13:08.086712] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-01T22:13:08.087638] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-01T22:13:08.087737] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-01T22:13:08.108945] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-01T22:13:08.473731] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:13:08.902416] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-01T22:13:09.111839] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-01T22:13:09.702443] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-01T22:13:10.163588] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-01T22:13:10.435236] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-01T22:13:10.502394] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-01T22:13:10.612289] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T22:13:11.302432] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-01T22:13:11.317610] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T22:13:12.102415] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-01T22:13:12.902367] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-01T22:13:13.133722] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T22:13:13.155958] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T22:13:13.702387] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-01T22:13:14.502380] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-01T22:13:14.545596] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-01T22:13:14.818166] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-01T22:13:15.302410] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-01T22:13:16.102414] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-01T22:13:16.225579] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-01T22:13:16.264040] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T22:13:16.902402] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-01T22:13:17.534099] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-01T22:13:17.573426] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-01T22:13:17.575335] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-10-01T22:13:17.575447] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-01T22:13:17.707535] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-01T22:13:18.010917] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-01T22:13:18.011018] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-01T22:13:18.012302] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-01T22:13:18.012409] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-01T22:13:18.014239] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 53694 (keeping 200 days of data) [2025-10-01T22:13:18.362988] [DEBUG] [LOCAL ] VALE: Primary data saved (53694 records). [2025-10-01T22:13:18.363133] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-01T22:13:18.363241] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VALE took 55.0s. Estimated remaining: 21m 46s. Rate: 7.1 symbols/min [2025-10-01T22:13:18.513919] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-01T22:13:18.550451] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:18.612430] [DEBUG] [LOCAL ] VFC: Loaded 53611 existing records from primary storage. [2025-10-01T22:13:18.612797] [INFO ] [MAIN ] VFC: Loaded 53611 existing records. [2025-10-01T22:13:18.808075] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:13:18.808372] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-01T22:13:18.808443] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-01T22:13:18.809886] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-01T22:13:18.809951] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-01T22:13:19.185509] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:13:19.302366] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-01T22:13:19.358259] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T22:13:19.991822] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-01T22:13:20.102376] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-01T22:13:20.140619] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-01T22:13:20.902373] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-01T22:13:21.555269] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T22:13:21.702423] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-01T22:13:22.442757] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-01T22:13:22.502423] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-01T22:13:23.302359] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-01T22:13:23.382060] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-01T22:13:24.056999] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T22:13:24.102338] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-01T22:13:24.902401] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-01T22:13:25.091685] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-01T22:13:25.703983] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-01T22:13:25.704999] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T22:13:25.864028] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T22:13:26.502369] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-01T22:13:27.302342] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-01T22:13:27.356521] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-01T22:13:27.392447] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T22:13:28.102379] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-01T22:13:28.902356] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-01T22:13:29.158769] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T22:13:29.259764] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T22:13:29.261340] [INFO ] [REMOTE ] VEEV: Full fetch complete (68231 records). [2025-10-01T22:13:29.261472] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-01T22:13:29.698189] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-01T22:13:29.698282] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-01T22:13:29.699470] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-01T22:13:29.699539] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-01T22:13:29.701125] [DEBUG] [LOCAL ] VEEV: Trimmed 68231 records to 47055 (keeping 200 days of data) [2025-10-01T22:13:29.702373] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-01T22:13:30.008614] [DEBUG] [LOCAL ] VEEV: Primary data saved (47055 records). [2025-10-01T22:13:30.008790] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-01T22:13:30.008923] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEEV took 43.5s. Estimated remaining: 21m 37s. Rate: 7.1 symbols/min [2025-10-01T22:13:30.190002] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:30.190192] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-01T22:13:30.190231] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-01T22:13:30.190345] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-01T22:13:30.190386] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-01T22:13:30.190427] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-01T22:13:30.190459] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-01T22:13:30.308244] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-01T22:13:30.309902] [INFO ] [REMOTE ] VEL: Full fetch complete (17039 records). [2025-10-01T22:13:30.315475] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-01T22:13:30.517777] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-01T22:13:30.986936] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:13:31.050133] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-01T22:13:31.078587] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-01T22:13:31.078896] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-01T22:13:31.079341] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-01T22:13:31.079804] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-01T22:13:31.081130] [DEBUG] [LOCAL ] VEL: Trimmed 17039 records to 12787 (keeping 200 days of data) [2025-10-01T22:13:31.159940] [DEBUG] [LOCAL ] VEL: Primary data saved (12787 records). [2025-10-01T22:13:31.160084] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-01T22:13:31.160167] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VEL took 30.2s. Estimated remaining: 21m 28s. Rate: 7.1 symbols/min [2025-10-01T22:13:31.308205] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-01T22:13:31.345341] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:31.351613] [DEBUG] [LOCAL ] VGI: Loaded 5138 existing records from primary storage. [2025-10-01T22:13:31.351838] [INFO ] [MAIN ] VGI: Loaded 5138 existing records. [2025-10-01T22:13:31.566966] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:13:31.567257] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-01T22:13:31.567341] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-01T22:13:31.567722] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-01T22:13:31.567785] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-01T22:13:31.607781] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:13:31.665491] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-01T22:13:31.692754] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:13:31.692853] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-01T22:13:31.693763] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:13:31.699476] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-01T22:13:31.704965] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-01T22:13:31.710167] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-01T22:13:31.735938] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-01T22:13:31.736057] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VG took 1.7s. Estimated remaining: 21m 19s. Rate: 7.1 symbols/min [2025-10-01T22:13:32.108969] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-01T22:13:32.149945] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:32.252996] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:13:32.264895] [DEBUG] [LOCAL ] VGM: Loaded 18249 existing records from primary storage. [2025-10-01T22:13:32.265238] [INFO ] [MAIN ] VGM: Loaded 18249 existing records. [2025-10-01T22:13:32.482587] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:13:32.482887] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-01T22:13:32.482942] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-01T22:13:32.483388] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-01T22:13:32.483447] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-01T22:13:32.913504] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-01T22:13:32.919927] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:13:32.954190] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-01T22:13:33.508468] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-01T22:13:33.546398] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-01T22:13:33.702370] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-01T22:13:34.333856] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-01T22:13:34.502384] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-01T22:13:35.302400] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-01T22:13:36.081683] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T22:13:36.102361] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-01T22:13:36.320852] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-01T22:13:36.678111] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T22:13:36.902384] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-01T22:13:37.338920] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-01T22:13:37.702393] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-01T22:13:38.502386] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-01T22:13:39.254897] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-01T22:13:39.302363] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-01T22:13:39.725869] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-01T22:13:40.102357] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-01T22:13:40.308198] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T22:13:40.902392] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-01T22:13:41.555620] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T22:13:41.702383] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-01T22:13:41.895095] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:13:42.502437] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-01T22:13:42.685394] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-01T22:13:43.086278] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-01T22:13:43.302388] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-01T22:13:44.026812] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T22:13:44.102378] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-01T22:13:44.902388] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-01T22:13:45.373254] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-01T22:13:45.552742] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T22:13:45.702375] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-01T22:13:46.442742] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-01T22:13:46.502371] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-01T22:13:47.240788] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T22:13:47.302375] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-01T22:13:48.102400] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-01T22:13:48.126069] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-01T22:13:48.902418] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-01T22:13:49.702355] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-01T22:13:50.044324] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-01T22:13:50.045113] [INFO ] [REMOTE ] VGI: Full fetch complete (7786 records). [2025-10-01T22:13:50.045186] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-01T22:13:50.418225] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-01T22:13:50.512823] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-01T22:13:50.518636] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-01T22:13:50.520475] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-01T22:13:50.520797] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-01T22:13:50.521015] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-01T22:13:50.544576] [DEBUG] [LOCAL ] VGI: Trimmed 7786 records to 5152 (keeping 200 days of data) [2025-10-01T22:13:50.546724] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T22:13:50.588164] [DEBUG] [LOCAL ] VGI: Primary data saved (5152 records). [2025-10-01T22:13:50.588289] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-01T22:13:50.588416] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VGI took 19.4s. Estimated remaining: 21m 12s. Rate: 7.1 symbols/min [2025-10-01T22:13:50.771246] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:50.775703] [DEBUG] [LOCAL ] VHI: Loaded 2768 existing records from primary storage. [2025-10-01T22:13:50.775863] [INFO ] [MAIN ] VHI: Loaded 2768 existing records. [2025-10-01T22:13:50.978884] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:13:50.979132] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-01T22:13:50.979184] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-01T22:13:50.979516] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-01T22:13:50.979578] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-01T22:13:51.307516] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-01T22:13:51.380411] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:13:51.584877] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T22:13:52.102394] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-01T22:13:52.712565] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-01T22:13:52.902404] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-01T22:13:52.961684] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T22:13:53.702368] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-01T22:13:54.502353] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-01T22:13:54.833426] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T22:13:54.857795] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T22:13:55.126129] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T22:13:55.302386] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-01T22:13:56.102386] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-01T22:13:56.337747] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-01T22:13:56.782288] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-01T22:13:56.902406] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-01T22:13:57.702398] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-01T22:13:57.768873] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:13:58.502391] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-01T22:13:58.764814] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T22:13:58.766237] [INFO ] [REMOTE ] VET: Full fetch complete (64489 records). [2025-10-01T22:13:58.766329] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-01T22:13:59.108958] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-01T22:13:59.223557] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-01T22:13:59.223680] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-01T22:13:59.224743] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-01T22:13:59.224810] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-01T22:13:59.226207] [DEBUG] [LOCAL ] VET: Trimmed 64489 records to 43905 (keeping 200 days of data) [2025-10-01T22:13:59.315440] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-01T22:13:59.500288] [DEBUG] [LOCAL ] VET: Primary data saved (43905 records). [2025-10-01T22:13:59.500444] [INFO ] [MAIN ] VET: Full history saved. [2025-10-01T22:13:59.500556] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VET took 51.8s. Estimated remaining: 21m 3s. Rate: 7.1 symbols/min [2025-10-01T22:13:59.693463] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:13:59.693733] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-01T22:13:59.693789] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-01T22:13:59.693901] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-01T22:13:59.693951] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-01T22:13:59.693998] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-01T22:13:59.694033] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-01T22:13:59.999965] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-01T22:14:00.112350] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-01T22:14:00.118688] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:00.476124] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-01T22:14:00.477841] [INFO ] [REMOTE ] VFC: Full fetch complete (77586 records). [2025-10-01T22:14:00.477957] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-01T22:14:00.903684] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-01T22:14:00.903310] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-01T22:14:00.903809] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-01T22:14:00.905922] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-01T22:14:00.906093] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-01T22:14:00.907732] [DEBUG] [LOCAL ] VFC: Trimmed 77586 records to 53610 (keeping 200 days of data) [2025-10-01T22:14:01.269399] [DEBUG] [LOCAL ] VFC: Primary data saved (53610 records). [2025-10-01T22:14:01.269560] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-01T22:14:01.269716] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VFC took 42.9s. Estimated remaining: 20m 54s. Rate: 7.1 symbols/min [2025-10-01T22:14:01.463225] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:01.479827] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-01T22:14:01.524874] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-10-01T22:14:01.525222] [INFO ] [MAIN ] VICI: Loaded 53647 existing records. [2025-10-01T22:14:01.703166] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-01T22:14:01.735606] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:01.735866] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-01T22:14:01.735918] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-01T22:14:01.737453] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-01T22:14:01.737518] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-01T22:14:02.137090] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:02.181759] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:14:02.182069] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-01T22:14:02.182181] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:14:02.182330] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-01T22:14:02.182418] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:14:02.182517] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-01T22:14:02.182602] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-01T22:14:02.182669] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-01T22:14:02.182753] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-01T22:14:02.182809] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VIA took 2.7s. Estimated remaining: 20m 45s. Rate: 7.1 symbols/min [2025-10-01T22:14:02.381573] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:02.438440] [DEBUG] [LOCAL ] VIK: Loaded 52483 existing records from primary storage. [2025-10-01T22:14:02.438814] [INFO ] [MAIN ] VIK: Loaded 52483 existing records. [2025-10-01T22:14:02.507498] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-01T22:14:02.670381] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:02.670612] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-01T22:14:02.670694] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-01T22:14:02.672019] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-01T22:14:02.672084] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-01T22:14:03.082893] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:03.302435] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-01T22:14:03.854750] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-01T22:14:03.897896] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T22:14:04.102399] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-01T22:14:04.811896] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T22:14:04.812996] [INFO ] [REMOTE ] VGM: Full fetch complete (26265 records). [2025-10-01T22:14:04.813069] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-01T22:14:04.907510] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-01T22:14:05.241525] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-01T22:14:05.241615] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-01T22:14:05.242254] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-01T22:14:05.242314] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-01T22:14:05.243279] [DEBUG] [LOCAL ] VGM: Trimmed 26265 records to 18325 (keeping 200 days of data) [2025-10-01T22:14:05.363547] [DEBUG] [LOCAL ] VGM: Primary data saved (18325 records). [2025-10-01T22:14:05.363726] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-01T22:14:05.363824] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VGM took 33.6s. Estimated remaining: 20m 36s. Rate: 7.1 symbols/min [2025-10-01T22:14:05.560612] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:05.622366] [DEBUG] [LOCAL ] VIPS: Loaded 51330 existing records from primary storage. [2025-10-01T22:14:05.622808] [INFO ] [MAIN ] VIPS: Loaded 51330 existing records. [2025-10-01T22:14:05.704451] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-01T22:14:05.830823] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:05.831063] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-01T22:14:05.831120] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-01T22:14:05.832430] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-01T22:14:05.832493] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-01T22:14:06.218020] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:06.386890] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-01T22:14:06.502355] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-01T22:14:06.764808] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-01T22:14:07.125013] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T22:14:07.302386] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-01T22:14:08.102391] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-01T22:14:08.902415] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-01T22:14:08.997254] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T22:14:09.702394] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-01T22:14:10.030201] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-01T22:14:10.198430] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-01T22:14:10.502401] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-01T22:14:10.787046] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-01T22:14:11.302435] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-01T22:14:11.772566] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-01T22:14:12.102401] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-01T22:14:12.422126] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T22:14:12.902411] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-01T22:14:13.702370] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-01T22:14:13.775419] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T22:14:14.493470] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T22:14:14.504199] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-01T22:14:15.302408] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-01T22:14:15.439911] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-01T22:14:15.637622] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-01T22:14:15.638354] [INFO ] [REMOTE ] VHI: Full fetch complete (4479 records). [2025-10-01T22:14:15.638427] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-01T22:14:16.056703] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-01T22:14:16.056808] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-01T22:14:16.057011] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-01T22:14:16.057084] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-01T22:14:16.057490] [DEBUG] [LOCAL ] VHI: Trimmed 4479 records to 2766 (keeping 200 days of data) [2025-10-01T22:14:16.077314] [DEBUG] [LOCAL ] VHI: Primary data saved (2766 records). [2025-10-01T22:14:16.077399] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-01T22:14:16.077529] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VHI took 25.5s. Estimated remaining: 20m 28s. Rate: 7.1 symbols/min [2025-10-01T22:14:16.107470] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-01T22:14:16.284346] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:16.315963] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T22:14:16.374165] [DEBUG] [LOCAL ] VIRT: Loaded 46656 existing records from primary storage. [2025-10-01T22:14:16.374491] [INFO ] [MAIN ] VIRT: Loaded 46656 existing records. [2025-10-01T22:14:16.571275] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:16.571508] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-01T22:14:16.571559] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-01T22:14:16.573366] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-01T22:14:16.573443] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-01T22:14:16.907521] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-01T22:14:16.982148] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:17.702414] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-01T22:14:18.293200] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-01T22:14:18.331959] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T22:14:18.502403] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-01T22:14:19.206841] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T22:14:19.302419] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-01T22:14:20.102366] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-01T22:14:20.496033] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-01T22:14:20.902371] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-01T22:14:21.016698] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T22:14:21.707708] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-01T22:14:21.738810] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T22:14:22.502374] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-01T22:14:22.685206] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T22:14:23.130545] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T22:14:23.302394] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-01T22:14:23.999813] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T22:14:24.102386] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-01T22:14:24.902408] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-01T22:14:25.290621] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T22:14:25.702366] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-01T22:14:25.919703] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-01T22:14:26.502356] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-01T22:14:26.769434] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T22:14:27.303131] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-01T22:14:27.303047] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-01T22:14:28.015530] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-01T22:14:28.102380] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-01T22:14:28.902358] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-01T22:14:29.001809] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T22:14:29.446785] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T22:14:29.702382] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-01T22:14:29.766092] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T22:14:30.502396] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-01T22:14:31.302392] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-01T22:14:31.467174] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T22:14:31.629940] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-01T22:14:31.631538] [INFO ] [REMOTE ] VICI: Full fetch complete (77657 records). [2025-10-01T22:14:31.631697] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-01T22:14:32.098533] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-01T22:14:32.098626] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-01T22:14:32.099806] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-01T22:14:32.099875] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-01T22:14:32.101781] [DEBUG] [LOCAL ] VICI: Trimmed 77657 records to 53647 (keeping 200 days of data) [2025-10-01T22:14:32.102513] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-01T22:14:32.387488] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T22:14:32.526714] [DEBUG] [LOCAL ] VICI: Primary data saved (53647 records). [2025-10-01T22:14:32.526875] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-01T22:14:32.527021] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VICI took 31.3s. Estimated remaining: 20m 20s. Rate: 7.1 symbols/min [2025-10-01T22:14:32.713191] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:32.758218] [DEBUG] [LOCAL ] VIST: Loaded 45959 existing records from primary storage. [2025-10-01T22:14:32.758532] [INFO ] [MAIN ] VIST: Loaded 45959 existing records. [2025-10-01T22:14:32.915970] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-01T22:14:32.961683] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:32.961851] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-01T22:14:32.961896] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-01T22:14:32.962998] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-01T22:14:32.963066] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-01T22:14:33.365402] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:33.702390] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-01T22:14:33.893291] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:14:34.502436] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-01T22:14:34.675884] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T22:14:34.906070] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-01T22:14:35.302446] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-01T22:14:35.914322] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T22:14:36.102387] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-01T22:14:36.902356] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-01T22:14:37.006831] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-01T22:14:37.702399] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-01T22:14:37.809359] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T22:14:38.507533] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-01T22:14:38.524175] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-01T22:14:39.026933] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T22:14:39.302408] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-01T22:14:40.102354] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-01T22:14:40.317591] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T22:14:40.322799] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T22:14:40.333835] [INFO ] [REMOTE ] VIPS: Full fetch complete (74635 records). [2025-10-01T22:14:40.334321] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-01T22:14:40.767077] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-01T22:14:40.767161] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-01T22:14:40.768353] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-01T22:14:40.768420] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-01T22:14:40.770004] [DEBUG] [LOCAL ] VIPS: Trimmed 74635 records to 51338 (keeping 200 days of data) [2025-10-01T22:14:40.944747] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-01T22:14:41.089966] [DEBUG] [LOCAL ] VIPS: Primary data saved (51338 records). [2025-10-01T22:14:41.090105] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-01T22:14:41.090203] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIPS took 35.7s. Estimated remaining: 20m 12s. Rate: 7.1 symbols/min [2025-10-01T22:14:41.278526] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:41.328984] [DEBUG] [LOCAL ] VIV: Loaded 45002 existing records from primary storage. [2025-10-01T22:14:41.329318] [INFO ] [MAIN ] VIV: Loaded 45002 existing records. [2025-10-01T22:14:41.572779] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T22:14:41.663630] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:41.664411] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-01T22:14:41.664487] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-01T22:14:41.665767] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-01T22:14:41.665830] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-01T22:14:41.707509] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-01T22:14:42.060205] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:42.502351] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-01T22:14:42.537339] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T22:14:43.302360] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-01T22:14:43.483200] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T22:14:44.102386] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-01T22:14:44.255754] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-01T22:14:44.714392] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-01T22:14:44.902388] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-01T22:14:45.390913] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T22:14:45.702384] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-01T22:14:46.376903] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-01T22:14:46.502383] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-01T22:14:46.568670] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:14:47.302386] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-01T22:14:47.623595] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T22:14:47.625080] [INFO ] [REMOTE ] VIRT: Full fetch complete (67026 records). [2025-10-01T22:14:47.625171] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-01T22:14:47.789879] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-01T22:14:47.824252] [INFO ] [REMOTE ] VIK: Full fetch complete (75868 records). [2025-10-01T22:14:47.844712] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-01T22:14:48.106992] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-01T22:14:48.279821] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-01T22:14:48.300273] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-01T22:14:48.336482] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-01T22:14:48.350402] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-01T22:14:48.425013] [DEBUG] [LOCAL ] VIRT: Trimmed 67026 records to 46652 (keeping 200 days of data) [2025-10-01T22:14:48.643421] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-01T22:14:48.651714] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-01T22:14:48.657370] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-01T22:14:48.660543] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-01T22:14:48.718131] [DEBUG] [LOCAL ] VIK: Trimmed 75868 records to 52494 (keeping 200 days of data) [2025-10-01T22:14:48.913903] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-01T22:14:49.006071] [DEBUG] [LOCAL ] VIRT: Primary data saved (46652 records). [2025-10-01T22:14:49.015198] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-01T22:14:49.015734] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIRT took 32.9s. Estimated remaining: 20m 3s. Rate: 7.1 symbols/min [2025-10-01T22:14:49.349117] [DEBUG] [LOCAL ] VIK: Primary data saved (52494 records). [2025-10-01T22:14:49.349806] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-01T22:14:49.362297] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIK took 47.2s. Estimated remaining: 19m 54s. Rate: 7.1 symbols/min [2025-10-01T22:14:49.372246] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:49.575551] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:14:49.583587] [DEBUG] [LOCAL ] VKQ: Loaded 17592 existing records from primary storage. [2025-10-01T22:14:49.583894] [INFO ] [MAIN ] VKQ: Loaded 17592 existing records. [2025-10-01T22:14:49.829440] [DEBUG] [LOCAL ] VLN: Loaded 28918 existing records from primary storage. [2025-10-01T22:14:49.828382] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:49.829932] [INFO ] [MAIN ] VLN: Loaded 28918 existing records. [2025-10-01T22:14:49.847519] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-01T22:14:49.864858] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-01T22:14:49.901906] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-01T22:14:49.926163] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-01T22:14:50.160379] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:14:50.171803] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-01T22:14:50.174090] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-01T22:14:50.173707] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-01T22:14:50.200306] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-01T22:14:50.211855] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-01T22:14:50.217576] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-01T22:14:50.840826] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:50.863740] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-01T22:14:50.952215] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:14:50.979511] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-01T22:14:51.302382] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-01T22:14:51.915976] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T22:14:52.103340] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-01T22:14:52.106726] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-01T22:14:52.809861] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-01T22:14:52.902373] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-01T22:14:53.415728] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T22:14:53.702412] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-01T22:14:53.793626] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-01T22:14:54.502391] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-01T22:14:55.302401] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-01T22:14:55.364519] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T22:14:55.563754] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T22:14:56.102382] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-01T22:14:56.728252] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T22:14:56.902377] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-01T22:14:57.644411] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-01T22:14:57.702396] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-01T22:14:58.429587] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T22:14:58.502358] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-01T22:14:59.302356] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-01T22:14:59.415173] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-01T22:15:00.102366] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-01T22:15:00.142765] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-01T22:15:00.477462] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-01T22:15:00.849373] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-01T22:15:00.902366] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-01T22:15:01.702433] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-01T22:15:01.985229] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T22:15:02.502449] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-01T22:15:03.302418] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-01T22:15:03.371027] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T22:15:03.536355] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T22:15:04.102388] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-01T22:15:04.413208] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T22:15:04.902384] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-01T22:15:05.192682] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T22:15:05.194224] [INFO ] [REMOTE ] VIST: Full fetch complete (66847 records). [2025-10-01T22:15:05.194329] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-01T22:15:05.643805] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-01T22:15:05.643898] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-01T22:15:05.645175] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-01T22:15:05.645247] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-01T22:15:05.646871] [DEBUG] [LOCAL ] VIST: Trimmed 66847 records to 45965 (keeping 200 days of data) [2025-10-01T22:15:05.709265] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-01T22:15:05.894972] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T22:15:05.956109] [DEBUG] [LOCAL ] VIST: Primary data saved (45965 records). [2025-10-01T22:15:05.956237] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-01T22:15:05.956324] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIST took 33.4s. Estimated remaining: 19m 46s. Rate: 7.1 symbols/min [2025-10-01T22:15:06.217029] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:15:06.285059] [DEBUG] [LOCAL ] VLO: Loaded 53077 existing records from primary storage. [2025-10-01T22:15:06.285454] [INFO ] [MAIN ] VLO: Loaded 53077 existing records. [2025-10-01T22:15:06.501218] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:15:06.501560] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-01T22:15:06.501636] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-01T22:15:06.502373] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-01T22:15:06.503435] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-01T22:15:06.503534] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-01T22:15:06.923704] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:15:06.938794] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-01T22:15:07.302383] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-01T22:15:08.102399] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-01T22:15:08.293061] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:15:08.498265] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-01T22:15:08.856700] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-01T22:15:08.902385] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-01T22:15:09.702396] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-01T22:15:10.080220] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T22:15:10.502430] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-01T22:15:11.302390] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-01T22:15:11.628867] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-01T22:15:11.963497] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T22:15:12.017844] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-01T22:15:12.102389] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-01T22:15:12.902363] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-01T22:15:13.132041] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-01T22:15:13.702391] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-01T22:15:14.488718] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T22:15:14.502371] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-01T22:15:14.781799] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-01T22:15:15.302374] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-01T22:15:15.707105] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-01T22:15:15.997618] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-01T22:15:15.998727] [INFO ] [REMOTE ] VKQ: Full fetch complete (24669 records). [2025-10-01T22:15:15.998827] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-01T22:15:16.107503] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-01T22:15:16.425435] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-01T22:15:16.425531] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-01T22:15:16.426149] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-01T22:15:16.426217] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-01T22:15:16.427169] [DEBUG] [LOCAL ] VKQ: Trimmed 24669 records to 17622 (keeping 200 days of data) [2025-10-01T22:15:16.552511] [DEBUG] [LOCAL ] VKQ: Primary data saved (17622 records). [2025-10-01T22:15:16.552758] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-01T22:15:16.552917] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VKQ took 27.5s. Estimated remaining: 19m 38s. Rate: 7.1 symbols/min [2025-10-01T22:15:16.802739] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:15:16.844105] [DEBUG] [LOCAL ] VLRS: Loaded 40400 existing records from primary storage. [2025-10-01T22:15:16.844441] [INFO ] [MAIN ] VLRS: Loaded 40400 existing records. [2025-10-01T22:15:16.913882] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-01T22:15:17.087714] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:15:17.088060] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-01T22:15:17.088156] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-01T22:15:17.089139] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-01T22:15:17.089224] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-01T22:15:17.546715] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:15:17.702366] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-01T22:15:17.983271] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-01T22:15:18.502351] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-01T22:15:18.719401] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T22:15:18.720922] [INFO ] [REMOTE ] VLN: Full fetch complete (43153 records). [2025-10-01T22:15:18.721182] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-01T22:15:18.906490] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-01T22:15:19.209194] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-01T22:15:19.209294] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-01T22:15:19.210173] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-01T22:15:19.210239] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-01T22:15:19.211745] [DEBUG] [LOCAL ] VLN: Trimmed 43153 records to 29086 (keeping 200 days of data) [2025-10-01T22:15:19.311633] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-01T22:15:19.401204] [DEBUG] [LOCAL ] VLN: Primary data saved (29086 records). [2025-10-01T22:15:19.401345] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-01T22:15:19.401426] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VLN took 30.0s. Estimated remaining: 19m 29s. Rate: 7.1 symbols/min [2025-10-01T22:15:19.593942] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:15:19.602720] [DEBUG] [LOCAL ] VLT: Loaded 4554 existing records from primary storage. [2025-10-01T22:15:19.602965] [INFO ] [MAIN ] VLT: Loaded 4554 existing records. [2025-10-01T22:15:19.822016] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:15:19.822545] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-01T22:15:19.822616] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-01T22:15:19.823048] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-01T22:15:19.823114] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-01T22:15:20.109529] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-01T22:15:20.247825] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:15:20.279468] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T22:15:20.909702] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-01T22:15:20.939443] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T22:15:21.581285] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T22:15:21.702423] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-01T22:15:22.303051] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T22:15:22.502367] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-01T22:15:22.894125] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-01T22:15:23.302412] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-01T22:15:24.021153] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-01T22:15:24.102385] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-01T22:15:24.902375] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-01T22:15:25.135538] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T22:15:25.137430] [INFO ] [REMOTE ] VIV: Full fetch complete (64732 records). [2025-10-01T22:15:25.137583] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-01T22:15:25.565633] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-01T22:15:25.628358] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-01T22:15:25.628828] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-01T22:15:25.630430] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-01T22:15:25.630497] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-01T22:15:25.634415] [DEBUG] [LOCAL ] VIV: Trimmed 64732 records to 44969 (keeping 200 days of data) [2025-10-01T22:15:25.704016] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-01T22:15:25.958726] [DEBUG] [LOCAL ] VIV: Primary data saved (44969 records). [2025-10-01T22:15:25.958869] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-01T22:15:25.958969] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VIV took 44.9s. Estimated remaining: 19m 20s. Rate: 7.1 symbols/min [2025-10-01T22:15:26.162480] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:15:26.213308] [DEBUG] [LOCAL ] VLTO: Loaded 45995 existing records from primary storage. [2025-10-01T22:15:26.213757] [INFO ] [MAIN ] VLTO: Loaded 45995 existing records. [2025-10-01T22:15:26.434586] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:15:26.435132] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-01T22:15:26.435202] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-01T22:15:26.458287] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-01T22:15:26.458446] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-01T22:15:26.506740] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-01T22:15:26.508880] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T22:15:26.891885] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:15:27.078594] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-01T22:15:27.302442] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-01T22:15:27.892868] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-01T22:15:27.933977] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-01T22:15:28.102416] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-01T22:15:28.789324] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-01T22:15:28.902389] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-01T22:15:29.702437] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-01T22:15:30.502393] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-01T22:15:30.769782] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T22:15:30.919843] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-01T22:15:31.250419] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-01T22:15:31.302393] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-01T22:15:32.102396] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-01T22:15:32.512608] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-01T22:15:32.902398] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-01T22:15:33.208506] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T22:15:33.266512] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-01T22:15:33.702386] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-01T22:15:34.298786] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-01T22:15:34.502402] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-01T22:15:35.302391] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-01T22:15:35.723131] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-01T22:15:36.102387] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-01T22:15:36.154093] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T22:15:36.902387] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-01T22:15:37.702379] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-01T22:15:37.930068] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T22:15:38.290531] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-01T22:15:38.502390] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-01T22:15:39.300731] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T22:15:39.308876] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-01T22:15:39.899357] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T22:15:40.102359] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-01T22:15:40.143280] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T22:15:40.693282] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-01T22:15:40.694080] [INFO ] [REMOTE ] VLT: Full fetch complete (7510 records). [2025-10-01T22:15:40.694163] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-01T22:15:40.907992] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-01T22:15:41.102590] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-01T22:15:41.102694] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-01T22:15:41.102926] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-01T22:15:41.102969] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-01T22:15:41.103376] [DEBUG] [LOCAL ] VLT: Trimmed 7510 records to 4542 (keeping 200 days of data) [2025-10-01T22:15:41.132436] [DEBUG] [LOCAL ] VLT: Primary data saved (4542 records). [2025-10-01T22:15:41.132577] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-01T22:15:41.132689] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLT took 21.7s. Estimated remaining: 19m 12s. Rate: 7.1 symbols/min [2025-10-01T22:15:41.332804] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:15:41.382787] [DEBUG] [LOCAL ] VMC: Loaded 43331 existing records from primary storage. [2025-10-01T22:15:41.383170] [INFO ] [MAIN ] VMC: Loaded 43331 existing records. [2025-10-01T22:15:41.585800] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:15:41.586006] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-01T22:15:41.586056] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-01T22:15:41.586982] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-01T22:15:41.587043] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-01T22:15:41.706576] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-01T22:15:42.002923] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:15:42.502366] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-01T22:15:42.618354] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-01T22:15:43.302356] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-01T22:15:43.426869] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T22:15:43.829818] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T22:15:43.930105] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-01T22:15:44.102387] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-01T22:15:44.536241] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-01T22:15:44.538041] [INFO ] [REMOTE ] VLO: Full fetch complete (76920 records). [2025-10-01T22:15:44.538165] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-01T22:15:44.907465] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-01T22:15:45.003839] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-01T22:15:45.003932] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-01T22:15:45.005673] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-01T22:15:45.005766] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-01T22:15:45.007805] [DEBUG] [LOCAL ] VLO: Trimmed 76920 records to 53073 (keeping 200 days of data) [2025-10-01T22:15:45.375990] [DEBUG] [LOCAL ] VLO: Primary data saved (53073 records). [2025-10-01T22:15:45.376201] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-01T22:15:45.378877] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 39.4s. Estimated remaining: 19m 4s. Rate: 7.1 symbols/min [2025-10-01T22:15:45.575053] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:15:45.594899] [DEBUG] [LOCAL ] VMI: Loaded 15382 existing records from primary storage. [2025-10-01T22:15:45.595139] [INFO ] [MAIN ] VMI: Loaded 15382 existing records. [2025-10-01T22:15:45.702979] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-01T22:15:45.789508] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:15:45.789771] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-01T22:15:45.789826] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-01T22:15:45.790952] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-01T22:15:45.791034] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-01T22:15:46.183512] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:15:46.502402] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-01T22:15:46.689771] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T22:15:46.896371] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-01T22:15:47.302401] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-01T22:15:48.102376] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-01T22:15:48.214043] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T22:15:48.235367] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T22:15:48.902402] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-01T22:15:49.699884] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T22:15:49.709256] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-01T22:15:49.805734] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T22:15:50.502392] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-01T22:15:51.245850] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-01T22:15:51.302392] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-01T22:15:51.744177] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T22:15:52.102432] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-01T22:15:52.902387] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-01T22:15:53.041773] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-01T22:15:53.062257] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T22:15:53.702389] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-01T22:15:54.502436] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-01T22:15:54.559487] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T22:15:55.302380] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-01T22:15:55.422402] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T22:15:55.898811] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T22:15:56.102380] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-01T22:15:56.904758] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-01T22:15:56.910474] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T22:15:57.627683] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T22:15:57.702414] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-01T22:15:58.380705] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T22:15:58.476768] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T22:15:58.502408] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-01T22:15:59.302384] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-01T22:16:00.035907] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T22:16:00.102424] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-01T22:16:00.389765] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T22:16:00.902418] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-01T22:16:01.422718] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-01T22:16:01.702388] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-01T22:16:02.013633] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-01T22:16:02.015134] [INFO ] [REMOTE ] VLTO: Full fetch complete (66917 records). [2025-10-01T22:16:02.015241] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-01T22:16:02.474247] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-01T22:16:02.474416] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-01T22:16:02.475782] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-01T22:16:02.475941] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-01T22:16:02.477781] [DEBUG] [LOCAL ] VLTO: Trimmed 66917 records to 46023 (keeping 200 days of data) [2025-10-01T22:16:02.539938] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-01T22:16:02.623477] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T22:16:02.864057] [DEBUG] [LOCAL ] VLTO: Primary data saved (46023 records). [2025-10-01T22:16:02.864221] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-01T22:16:02.864346] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLTO took 36.9s. Estimated remaining: 18m 56s. Rate: 7.1 symbols/min [2025-10-01T22:16:03.302412] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-01T22:16:03.612711] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T22:16:03.614732] [INFO ] [REMOTE ] VLRS: Full fetch complete (58502 records). [2025-10-01T22:16:03.614918] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-01T22:16:04.057106] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-01T22:16:04.057210] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-01T22:16:04.058379] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-01T22:16:04.058452] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-01T22:16:04.059853] [DEBUG] [LOCAL ] VLRS: Trimmed 58502 records to 40366 (keeping 200 days of data) [2025-10-01T22:16:04.110478] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-01T22:16:04.310803] [DEBUG] [LOCAL ] VLRS: Primary data saved (40366 records). [2025-10-01T22:16:04.311008] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-01T22:16:04.311121] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLRS took 47.8s. Estimated remaining: 18m 47s. Rate: 7.1 symbols/min [2025-10-01T22:16:04.409715] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T22:16:04.902421] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-01T22:16:05.765882] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T22:16:05.776965] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-01T22:16:05.865789] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-01T22:16:06.502393] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-01T22:16:07.256131] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-01T22:16:07.302394] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-01T22:16:07.349488] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-01T22:16:08.102446] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-01T22:16:08.533679] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T22:16:08.835417] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T22:16:08.902395] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-01T22:16:09.702375] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-01T22:16:09.873908] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.17 seconds). [2025-10-01T22:16:09.886262] [INFO ] [REMOTE ] VMC: Full fetch complete (62544 records). [2025-10-01T22:16:09.886820] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-01T22:16:09.887044] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-01T22:16:10.331257] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-01T22:16:10.331355] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-01T22:16:10.332487] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-01T22:16:10.332560] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-01T22:16:10.334016] [DEBUG] [LOCAL ] VMC: Trimmed 62544 records to 43268 (keeping 200 days of data) [2025-10-01T22:16:10.534302] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-01T22:16:10.636014] [DEBUG] [LOCAL ] VMC: Primary data saved (43268 records). [2025-10-01T22:16:10.636152] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-01T22:16:10.636251] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMC took 29.5s. Estimated remaining: 18m 38s. Rate: 7.1 symbols/min [2025-10-01T22:16:11.150573] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T22:16:11.302410] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-01T22:16:11.515759] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-01T22:16:11.517043] [INFO ] [REMOTE ] VMI: Full fetch complete (21191 records). [2025-10-01T22:16:11.517136] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-01T22:16:11.964827] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-01T22:16:11.964948] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-01T22:16:11.965494] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-01T22:16:11.965554] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-01T22:16:11.966409] [DEBUG] [LOCAL ] VMI: Trimmed 21191 records to 15418 (keeping 200 days of data) [2025-10-01T22:16:12.077820] [DEBUG] [LOCAL ] VMI: Primary data saved (15418 records). [2025-10-01T22:16:12.077989] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-01T22:16:12.078150] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMI took 26.7s. Estimated remaining: 18m 29s. Rate: 7.1 symbols/min [2025-10-01T22:16:12.828742] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:12.819183] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:12.886753] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:12.925343] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:12.936517] [DEBUG] [LOCAL ] VNCE: Loaded 7820 existing records from primary storage. [2025-10-01T22:16:12.936798] [INFO ] [MAIN ] VNCE: Loaded 7820 existing records. [2025-10-01T22:16:13.096868] [DEBUG] [LOCAL ] VMO: Loaded 21036 existing records from primary storage. [2025-10-01T22:16:13.113334] [INFO ] [MAIN ] VMO: Loaded 21036 existing records. [2025-10-01T22:16:13.253099] [DEBUG] [LOCAL ] VNO: Loaded 48866 existing records from primary storage. [2025-10-01T22:16:13.313040] [INFO ] [MAIN ] VNO: Loaded 48866 existing records. [2025-10-01T22:16:13.314228] [DEBUG] [LOCAL ] VNT: Loaded 43548 existing records from primary storage. [2025-10-01T22:16:13.312692] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:13.363017] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-01T22:16:13.378717] [INFO ] [MAIN ] VNT: Loaded 43548 existing records. [2025-10-01T22:16:13.394207] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-01T22:16:13.510750] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-01T22:16:13.556691] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-01T22:16:13.787804] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:13.821617] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:13.832129] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-01T22:16:13.864390] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-01T22:16:13.897415] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-01T22:16:13.939154] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-01T22:16:13.970723] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-01T22:16:13.964013] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-01T22:16:14.011302] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:14.053721] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-01T22:16:14.053812] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-01T22:16:14.060231] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-01T22:16:14.060127] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-01T22:16:14.099397] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-01T22:16:14.194028] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-01T22:16:15.393952] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:15.527023] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-01T22:16:15.565753] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:15.605969] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-01T22:16:15.629256] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:15.640096] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-01T22:16:15.704244] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:15.704708] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-01T22:16:16.757619] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T22:16:16.762219] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-01T22:16:16.846919] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T22:16:16.852199] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-01T22:16:17.250529] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-01T22:16:17.259239] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-01T22:16:17.315433] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T22:16:17.644796] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-01T22:16:17.702363] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-01T22:16:18.001390] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-01T22:16:18.502350] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-01T22:16:18.660018] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T22:16:18.827241] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T22:16:19.302402] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-01T22:16:19.326630] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T22:16:20.102448] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-01T22:16:20.903101] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-01T22:16:20.906275] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-01T22:16:21.476142] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-01T22:16:21.521250] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-01T22:16:21.702387] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-01T22:16:22.502438] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-01T22:16:23.093736] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-01T22:16:23.268725] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T22:16:23.302366] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-01T22:16:24.102423] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-01T22:16:24.733002] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T22:16:24.902403] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-01T22:16:25.368230] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T22:16:25.702421] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-01T22:16:25.993882] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-01T22:16:26.124925] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-01T22:16:26.502410] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-01T22:16:27.302487] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-01T22:16:27.770149] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-01T22:16:28.102408] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-01T22:16:28.902402] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-01T22:16:29.180434] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T22:16:29.702381] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-01T22:16:29.844868] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-01T22:16:29.893871] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T22:16:30.502399] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-01T22:16:30.520815] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-01T22:16:31.302398] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-01T22:16:31.651102] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-01T22:16:32.102424] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-01T22:16:32.695976] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T22:16:32.902346] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-01T22:16:33.078771] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T22:16:33.306541] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-01T22:16:33.702426] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-01T22:16:34.502385] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-01T22:16:35.309814] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-01T22:16:35.330754] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T22:16:35.894730] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T22:16:36.102422] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-01T22:16:36.365941] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-01T22:16:36.902385] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-01T22:16:37.550108] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T22:16:37.702374] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-01T22:16:37.897246] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-01T22:16:38.502385] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-01T22:16:39.302354] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-01T22:16:39.524820] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T22:16:39.619810] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T22:16:40.102398] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-01T22:16:40.783170] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T22:16:40.902381] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-01T22:16:41.186601] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T22:16:41.188045] [INFO ] [REMOTE ] VNCE: Full fetch complete (15940 records). [2025-10-01T22:16:41.188203] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-01T22:16:41.604804] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-01T22:16:41.606242] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-01T22:16:41.608799] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-01T22:16:41.608932] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T22:16:41.609066] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-01T22:16:41.610791] [INFO ] [REMOTE ] VMO: Full fetch complete (31393 records). [2025-10-01T22:16:41.611055] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-01T22:16:41.611361] [DEBUG] [LOCAL ] VNCE: Trimmed 15940 records to 8032 (keeping 200 days of data) [2025-10-01T22:16:41.706928] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-01T22:16:41.780526] [DEBUG] [LOCAL ] VNCE: Primary data saved (8032 records). [2025-10-01T22:16:41.812256] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-01T22:16:41.825605] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 29.7s. Estimated remaining: 18m 22s. Rate: 7.1 symbols/min [2025-10-01T22:16:42.253685] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:42.294490] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-01T22:16:42.294578] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-01T22:16:42.295342] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-01T22:16:42.295475] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-01T22:16:42.298854] [DEBUG] [LOCAL ] VMO: Trimmed 31393 records to 21043 (keeping 200 days of data) [2025-10-01T22:16:42.354935] [DEBUG] [LOCAL ] VOC: Loaded 8915 existing records from primary storage. [2025-10-01T22:16:42.364269] [INFO ] [MAIN ] VOC: Loaded 8915 existing records. [2025-10-01T22:16:42.508047] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-01T22:16:42.653173] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:42.654996] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-01T22:16:42.657038] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-01T22:16:42.660510] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-01T22:16:42.662634] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-01T22:16:42.899718] [DEBUG] [LOCAL ] VMO: Primary data saved (21043 records). [2025-10-01T22:16:42.930061] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-01T22:16:42.955750] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VMO took 30.9s. Estimated remaining: 18m 13s. Rate: 7.1 symbols/min [2025-10-01T22:16:43.287712] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:43.294951] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:43.302333] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-01T22:16:43.339042] [DEBUG] [LOCAL ] VOYA: Loaded 42561 existing records from primary storage. [2025-10-01T22:16:43.339399] [INFO ] [MAIN ] VOYA: Loaded 42561 existing records. [2025-10-01T22:16:43.536972] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:43.537346] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-01T22:16:43.537502] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-01T22:16:43.552548] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-01T22:16:43.562898] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-01T22:16:43.652599] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-01T22:16:44.003218] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:44.079204] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-01T22:16:44.102335] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-01T22:16:44.167895] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T22:16:44.702920] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T22:16:44.902383] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-01T22:16:45.684803] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T22:16:45.702341] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-01T22:16:46.018890] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T22:16:46.020355] [INFO ] [REMOTE ] VNO: Full fetch complete (70455 records). [2025-10-01T22:16:46.020446] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-01T22:16:46.462756] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-01T22:16:46.462879] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-01T22:16:46.464316] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-01T22:16:46.464390] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-01T22:16:46.465882] [DEBUG] [LOCAL ] VNO: Trimmed 70455 records to 48848 (keeping 200 days of data) [2025-10-01T22:16:46.519637] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-01T22:16:46.780830] [DEBUG] [LOCAL ] VNO: Primary data saved (48848 records). [2025-10-01T22:16:46.781013] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-01T22:16:46.784298] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNO took 34.7s. Estimated remaining: 18m 4s. Rate: 7.1 symbols/min [2025-10-01T22:16:46.979966] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:46.980231] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-01T22:16:46.980278] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-01T22:16:46.980399] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-01T22:16:46.980476] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-01T22:16:46.980593] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-01T22:16:46.980697] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-01T22:16:47.307481] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-01T22:16:47.373448] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:48.102351] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-01T22:16:48.183343] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T22:16:48.902358] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-01T22:16:49.011261] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-01T22:16:49.045869] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T22:16:49.323462] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T22:16:49.702386] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-01T22:16:49.927875] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:16:49.928245] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-01T22:16:49.928340] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:16:49.928417] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-01T22:16:49.928484] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:16:49.928563] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-01T22:16:49.928629] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-01T22:16:49.928709] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-01T22:16:49.928782] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-01T22:16:49.928854] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VOYG took 3.1s. Estimated remaining: 17m 56s. Rate: 7.1 symbols/min [2025-10-01T22:16:50.114824] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:50.133953] [DEBUG] [LOCAL ] VPG: Loaded 17041 existing records from primary storage. [2025-10-01T22:16:50.134210] [INFO ] [MAIN ] VPG: Loaded 17041 existing records. [2025-10-01T22:16:50.325501] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:50.325732] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-01T22:16:50.325789] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-01T22:16:50.326377] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-01T22:16:50.326445] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-01T22:16:50.506599] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-01T22:16:50.748208] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:50.865189] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-01T22:16:50.866732] [INFO ] [REMOTE ] VNT: Full fetch complete (63406 records). [2025-10-01T22:16:50.866828] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-01T22:16:51.295387] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-01T22:16:51.295485] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-01T22:16:51.296600] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-01T22:16:51.296711] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-01T22:16:51.298228] [DEBUG] [LOCAL ] VNT: Trimmed 63406 records to 43549 (keeping 200 days of data) [2025-10-01T22:16:51.353163] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-01T22:16:51.574897] [DEBUG] [LOCAL ] VNT: Primary data saved (43549 records). [2025-10-01T22:16:51.575048] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-01T22:16:51.575157] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VNT took 39.5s. Estimated remaining: 17m 47s. Rate: 7.1 symbols/min [2025-10-01T22:16:51.758324] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:16:51.765631] [DEBUG] [LOCAL ] VPV: Loaded 5428 existing records from primary storage. [2025-10-01T22:16:51.765867] [INFO ] [MAIN ] VPV: Loaded 5428 existing records. [2025-10-01T22:16:51.960333] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:16:51.960503] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-01T22:16:51.960553] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-01T22:16:51.960880] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-01T22:16:51.960943] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-01T22:16:52.112124] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-01T22:16:52.378124] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:16:52.379611] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-01T22:16:52.902417] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-01T22:16:53.312722] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T22:16:53.702370] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-01T22:16:53.730217] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-01T22:16:54.502440] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-01T22:16:54.944343] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-01T22:16:55.302410] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-01T22:16:55.325711] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-01T22:16:56.102407] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-01T22:16:56.814087] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-01T22:16:56.902385] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-01T22:16:56.972106] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T22:16:57.702445] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-01T22:16:57.718831] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-01T22:16:58.502386] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-01T22:16:59.302391] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-01T22:16:59.361754] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T22:16:59.437184] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-01T22:16:59.768520] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-01T22:17:00.102427] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-01T22:17:00.902425] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-01T22:17:01.644201] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-01T22:17:01.678531] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-01T22:17:01.702336] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-01T22:17:02.502394] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-01T22:17:03.149879] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T22:17:03.302383] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-01T22:17:03.495776] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-01T22:17:03.919553] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-01T22:17:04.102376] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-01T22:17:04.902365] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-01T22:17:05.303316] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-01T22:17:05.510305] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-01T22:17:05.702443] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-01T22:17:06.502383] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-01T22:17:06.843910] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T22:17:07.302425] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-01T22:17:08.077114] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-01T22:17:08.102358] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-01T22:17:08.165039] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T22:17:08.902414] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-01T22:17:09.027384] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-01T22:17:09.702396] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-01T22:17:09.933910] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-01T22:17:10.338853] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-01T22:17:10.502432] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-01T22:17:11.281258] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-01T22:17:11.302399] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-01T22:17:12.102397] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-01T22:17:12.824348] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T22:17:12.872115] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-01T22:17:12.902339] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-01T22:17:13.627875] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-01T22:17:13.702422] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-01T22:17:14.502399] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-01T22:17:14.572001] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:17:15.090012] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-01T22:17:15.302455] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-01T22:17:16.107934] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-01T22:17:16.111556] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-01T22:17:16.404137] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:17:16.405448] [INFO ] [REMOTE ] VOYA: Full fetch complete (61932 records). [2025-10-01T22:17:16.405540] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-01T22:17:16.846813] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-01T22:17:16.846900] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-01T22:17:16.848046] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-01T22:17:16.848116] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-01T22:17:16.849526] [DEBUG] [LOCAL ] VOYA: Trimmed 61932 records to 42502 (keeping 200 days of data) [2025-10-01T22:17:16.906138] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-01T22:17:17.125255] [DEBUG] [LOCAL ] VOYA: Primary data saved (42502 records). [2025-10-01T22:17:17.125607] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-01T22:17:17.125974] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VOYA took 34.2s. Estimated remaining: 17m 39s. Rate: 7.1 symbols/min [2025-10-01T22:17:17.313900] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:17:17.348900] [DEBUG] [LOCAL ] VRE: Loaded 34907 existing records from primary storage. [2025-10-01T22:17:17.349221] [INFO ] [MAIN ] VRE: Loaded 34907 existing records. [2025-10-01T22:17:17.556812] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:17:17.557093] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-01T22:17:17.557196] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-01T22:17:17.558816] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-01T22:17:17.558892] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-01T22:17:17.714156] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-01T22:17:17.881451] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-01T22:17:17.984099] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:17:18.430066] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-01T22:17:18.430990] [INFO ] [REMOTE ] VPG: Full fetch complete (22870 records). [2025-10-01T22:17:18.431104] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-01T22:17:18.507452] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-01T22:17:18.823255] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-01T22:17:18.823334] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-01T22:17:18.823831] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-01T22:17:18.823894] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-01T22:17:18.824493] [DEBUG] [LOCAL ] VPG: Trimmed 22870 records to 17071 (keeping 200 days of data) [2025-10-01T22:17:18.928318] [DEBUG] [LOCAL ] VPG: Primary data saved (17071 records). [2025-10-01T22:17:18.928463] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-01T22:17:18.928674] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VPG took 29.0s. Estimated remaining: 17m 30s. Rate: 7.1 symbols/min [2025-10-01T22:17:19.116091] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:17:19.181423] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-01T22:17:19.181844] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-01T22:17:19.306474] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-01T22:17:19.320325] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T22:17:19.395896] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:17:19.396085] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-01T22:17:19.396138] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-01T22:17:19.397620] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-01T22:17:19.397726] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-01T22:17:19.778275] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:17:20.102394] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-01T22:17:20.759487] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-01T22:17:20.771991] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-01T22:17:20.902405] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-01T22:17:21.702363] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-01T22:17:21.816385] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T22:17:22.502431] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-01T22:17:23.302363] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-01T22:17:23.458813] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-01T22:17:23.748160] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-01T22:17:23.749458] [INFO ] [REMOTE ] VPV: Full fetch complete (9365 records). [2025-10-01T22:17:23.749547] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-01T22:17:24.104716] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-01T22:17:24.168740] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-01T22:17:24.168878] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-01T22:17:24.169194] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-01T22:17:24.169273] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-01T22:17:24.170023] [DEBUG] [LOCAL ] VPV: Trimmed 9365 records to 5397 (keeping 200 days of data) [2025-10-01T22:17:24.236252] [DEBUG] [LOCAL ] VPV: Primary data saved (5397 records). [2025-10-01T22:17:24.236992] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-01T22:17:24.238318] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-01T22:17:24.238467] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPV took 32.7s. Estimated remaining: 17m 22s. Rate: 7.1 symbols/min [2025-10-01T22:17:24.435802] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:17:24.450224] [DEBUG] [LOCAL ] VRTS: Loaded 9286 existing records from primary storage. [2025-10-01T22:17:24.450468] [INFO ] [MAIN ] VRTS: Loaded 9286 existing records. [2025-10-01T22:17:24.662887] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:17:24.663094] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-01T22:17:24.663143] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-01T22:17:24.663550] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-01T22:17:24.663676] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-01T22:17:24.906491] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-01T22:17:24.995366] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-01T22:17:25.088257] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:17:25.702428] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-01T22:17:26.100303] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-01T22:17:26.101205] [INFO ] [REMOTE ] VOC: Full fetch complete (13088 records). [2025-10-01T22:17:26.101279] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-01T22:17:26.329671] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T22:17:26.527463] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-01T22:17:26.580545] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-01T22:17:26.580631] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-01T22:17:26.581039] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-01T22:17:26.581091] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-01T22:17:26.581605] [DEBUG] [LOCAL ] VOC: Trimmed 13088 records to 8913 (keeping 200 days of data) [2025-10-01T22:17:26.642607] [DEBUG] [LOCAL ] VOC: Primary data saved (8913 records). [2025-10-01T22:17:26.642774] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-01T22:17:26.642867] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VOC took 44.8s. Estimated remaining: 17m 13s. Rate: 7.1 symbols/min [2025-10-01T22:17:26.858939] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:17:26.912776] [DEBUG] [LOCAL ] VSCO: Loaded 52767 existing records from primary storage. [2025-10-01T22:17:26.913180] [INFO ] [MAIN ] VSCO: Loaded 52767 existing records. [2025-10-01T22:17:27.109934] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:17:27.110223] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-01T22:17:27.110280] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-01T22:17:27.111819] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-01T22:17:27.111881] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-01T22:17:27.306857] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-01T22:17:27.512204] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:17:28.102448] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-01T22:17:28.695005] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-01T22:17:28.852577] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T22:17:28.902402] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-01T22:17:29.702410] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-01T22:17:29.797689] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T22:17:30.402603] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T22:17:30.502379] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-01T22:17:31.302354] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-01T22:17:31.836712] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-01T22:17:32.102395] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-01T22:17:32.121033] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-01T22:17:32.165003] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-01T22:17:32.902383] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-01T22:17:33.335716] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-01T22:17:33.540690] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T22:17:33.702401] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-01T22:17:34.224324] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T22:17:34.502397] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-01T22:17:35.302386] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-01T22:17:35.878162] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-01T22:17:36.087865] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-01T22:17:36.102394] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-01T22:17:36.857832] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-01T22:17:36.902405] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-01T22:17:37.702391] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-01T22:17:38.502413] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-01T22:17:38.635534] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T22:17:39.046041] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-01T22:17:39.102550] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T22:17:39.302389] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-01T22:17:40.102351] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-01T22:17:40.323012] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T22:17:40.902415] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-01T22:17:41.641976] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T22:17:41.702352] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-01T22:17:41.774822] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T22:17:42.502379] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-01T22:17:42.549452] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-01T22:17:42.775414] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-01T22:17:42.776772] [INFO ] [REMOTE ] VRE: Full fetch complete (48151 records). [2025-10-01T22:17:42.776880] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-01T22:17:43.195155] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-01T22:17:43.195254] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-01T22:17:43.196294] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-01T22:17:43.196358] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-01T22:17:43.197478] [DEBUG] [LOCAL ] VRE: Trimmed 48151 records to 34992 (keeping 200 days of data) [2025-10-01T22:17:43.302778] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-01T22:17:43.431196] [DEBUG] [LOCAL ] VRE: Primary data saved (34992 records). [2025-10-01T22:17:43.431362] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-01T22:17:43.431468] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRE took 26.3s. Estimated remaining: 17m 5s. Rate: 7.1 symbols/min [2025-10-01T22:17:43.634326] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:17:43.681449] [DEBUG] [LOCAL ] VSH: Loaded 48382 existing records from primary storage. [2025-10-01T22:17:43.681830] [INFO ] [MAIN ] VSH: Loaded 48382 existing records. [2025-10-01T22:17:43.886169] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:17:43.886408] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-01T22:17:43.886463] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-01T22:17:43.887530] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-01T22:17:43.887593] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-01T22:17:44.110559] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-01T22:17:44.198470] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T22:17:44.308631] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:17:44.902383] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-01T22:17:45.702378] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-01T22:17:46.502463] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-01T22:17:46.679605] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-01T22:17:46.745694] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-01T22:17:46.977834] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T22:17:47.302406] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-01T22:17:47.442136] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-01T22:17:47.443475] [INFO ] [REMOTE ] VRTS: Full fetch complete (11452 records). [2025-10-01T22:17:47.443546] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-01T22:17:47.879219] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-01T22:17:47.891226] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-01T22:17:47.891872] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-01T22:17:47.892396] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-01T22:17:47.892686] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-01T22:17:47.894137] [DEBUG] [LOCAL ] VRTS: Trimmed 11452 records to 9308 (keeping 200 days of data) [2025-10-01T22:17:47.956852] [DEBUG] [LOCAL ] VRTS: Primary data saved (9308 records). [2025-10-01T22:17:47.957010] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-01T22:17:47.957118] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRTS took 23.7s. Estimated remaining: 16m 56s. Rate: 7.1 symbols/min [2025-10-01T22:17:48.111175] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-01T22:17:48.141625] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:17:48.206081] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-10-01T22:17:48.206468] [INFO ] [MAIN ] VST: Loaded 53718 existing records. [2025-10-01T22:17:48.393335] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:17:48.393606] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-01T22:17:48.393698] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-01T22:17:48.395176] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-01T22:17:48.395243] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-01T22:17:48.768207] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:17:48.902424] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-01T22:17:49.702384] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-01T22:17:49.837817] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-01T22:17:50.502474] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-01T22:17:51.302404] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-01T22:17:51.394483] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-01T22:17:51.597207] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T22:17:52.102424] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-01T22:17:52.855859] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T22:17:52.899755] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-01T22:17:52.910306] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-01T22:17:53.630082] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-01T22:17:53.702420] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-01T22:17:54.502354] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-01T22:17:54.536931] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-01T22:17:55.302497] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-01T22:17:56.081038] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-01T22:17:56.109597] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-01T22:17:56.132883] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-01T22:17:56.902442] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-01T22:17:57.702428] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-01T22:17:57.881586] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-01T22:17:58.502383] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-01T22:17:58.674297] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-01T22:17:58.959618] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T22:17:59.016764] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-01T22:17:59.302430] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-01T22:18:00.102497] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-01T22:18:00.902494] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-01T22:18:01.155119] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-10-01T22:18:01.199448] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-01T22:18:01.702405] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-01T22:18:02.502478] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-01T22:18:02.835239] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-01T22:18:02.891117] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-01T22:18:02.998875] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-01T22:18:03.302402] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-01T22:18:03.762617] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-01T22:18:04.102432] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-01T22:18:04.396537] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:18:04.399057] [INFO ] [REMOTE ] VSCO: Full fetch complete (76173 records). [2025-10-01T22:18:04.399196] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-01T22:18:04.857699] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-01T22:18:04.857861] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-01T22:18:04.859472] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-01T22:18:04.859565] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-01T22:18:04.861476] [DEBUG] [LOCAL ] VSCO: Trimmed 76173 records to 52765 (keeping 200 days of data) [2025-10-01T22:18:04.932419] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-01T22:18:05.009439] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-01T22:18:05.286935] [DEBUG] [LOCAL ] VSCO: Primary data saved (52765 records). [2025-10-01T22:18:05.287131] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-01T22:18:05.287267] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VSCO took 38.6s. Estimated remaining: 16m 48s. Rate: 7.1 symbols/min [2025-10-01T22:18:05.510665] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:18:05.557503] [DEBUG] [LOCAL ] VSTS: Loaded 49011 existing records from primary storage. [2025-10-01T22:18:05.557935] [INFO ] [MAIN ] VSTS: Loaded 49011 existing records. [2025-10-01T22:18:05.707549] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-01T22:18:05.750091] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:18:05.750326] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-01T22:18:05.750375] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-01T22:18:05.751473] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-01T22:18:05.751549] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-01T22:18:06.125274] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:18:06.502379] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-01T22:18:07.302417] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-01T22:18:07.369433] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-01T22:18:07.456924] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T22:18:08.102408] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-01T22:18:08.181801] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T22:18:08.902401] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-01T22:18:09.715108] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-01T22:18:09.721637] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T22:18:09.822581] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-01T22:18:10.502416] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-01T22:18:11.312686] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-01T22:18:11.336623] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-01T22:18:11.376278] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T22:18:12.104881] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-01T22:18:12.108051] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T22:18:12.764687] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-01T22:18:12.902420] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-01T22:18:13.334138] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-01T22:18:13.335702] [INFO ] [REMOTE ] VSH: Full fetch complete (70997 records). [2025-10-01T22:18:13.335806] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-01T22:18:13.707526] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-01T22:18:13.812897] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-01T22:18:13.812994] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-01T22:18:13.814254] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-01T22:18:13.814325] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-01T22:18:13.818742] [DEBUG] [LOCAL ] VSH: Trimmed 70997 records to 48344 (keeping 200 days of data) [2025-10-01T22:18:14.131121] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-01T22:18:14.135253] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-01T22:18:14.137467] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-01T22:18:14.251793] [DEBUG] [LOCAL ] VSH: Primary data saved (48344 records). [2025-10-01T22:18:14.264846] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-01T22:18:14.270820] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSH took 30.8s. Estimated remaining: 16m 40s. Rate: 7.1 symbols/min [2025-10-01T22:18:14.522611] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-01T22:18:14.714451] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:18:14.842122] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-01T22:18:14.842219] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-01T22:18:14.843619] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-01T22:18:14.843719] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-01T22:18:14.845492] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-10-01T22:18:14.876491] [DEBUG] [LOCAL ] VTEX: Loaded 43294 existing records from primary storage. [2025-10-01T22:18:14.943291] [INFO ] [MAIN ] VTEX: Loaded 43294 existing records. [2025-10-01T22:18:15.197934] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:18:15.199793] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-01T22:18:15.199873] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-01T22:18:15.202056] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-01T22:18:15.202766] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-01T22:18:15.637722] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:18:15.639410] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-01T22:18:15.888460] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-01T22:18:15.888619] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-01T22:18:15.891198] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VRT took 57.0s. Estimated remaining: 16m 31s. Rate: 7.1 symbols/min [2025-10-01T22:18:16.087848] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:18:16.139209] [DEBUG] [LOCAL ] VTLE: Loaded 48502 existing records from primary storage. [2025-10-01T22:18:16.139867] [INFO ] [MAIN ] VTLE: Loaded 48502 existing records. [2025-10-01T22:18:16.352473] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:18:16.353155] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-01T22:18:16.353426] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-01T22:18:16.375625] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-01T22:18:16.382070] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-01T22:18:16.443439] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-01T22:18:16.500431] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-01T22:18:16.544196] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-01T22:18:16.848095] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:18:16.902356] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-01T22:18:17.140204] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-01T22:18:17.702425] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-01T22:18:18.502363] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-01T22:18:18.565824] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T22:18:18.823492] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-01T22:18:19.302371] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-01T22:18:19.339483] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T22:18:19.852036] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-01T22:18:20.102416] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-01T22:18:20.902533] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-01T22:18:20.944369] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T22:18:21.702382] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-01T22:18:22.432370] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T22:18:22.509847] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-01T22:18:22.516294] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-01T22:18:22.951622] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-01T22:18:23.302381] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-01T22:18:23.940495] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T22:18:24.014076] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T22:18:24.102388] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-01T22:18:24.902392] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-01T22:18:25.338678] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T22:18:25.702355] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-01T22:18:26.502384] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-01T22:18:26.587971] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T22:18:26.805854] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:18:26.807636] [INFO ] [REMOTE ] VST: Full fetch complete (77807 records). [2025-10-01T22:18:26.807802] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-01T22:18:27.267034] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-01T22:18:27.267227] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-01T22:18:27.268841] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-01T22:18:27.268941] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-01T22:18:27.298008] [DEBUG] [LOCAL ] VST: Trimmed 77807 records to 53718 (keeping 200 days of data) [2025-10-01T22:18:27.299408] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T22:18:27.308990] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-01T22:18:27.683234] [DEBUG] [LOCAL ] VST: Primary data saved (53718 records). [2025-10-01T22:18:27.683380] [INFO ] [MAIN ] VST: Full history saved. [2025-10-01T22:18:27.686422] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VST took 39.7s. Estimated remaining: 16m 23s. Rate: 7.1 symbols/min [2025-10-01T22:18:27.882766] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:18:27.903696] [DEBUG] [LOCAL ] VTMX: Loaded 17513 existing records from primary storage. [2025-10-01T22:18:27.903982] [INFO ] [MAIN ] VTMX: Loaded 17513 existing records. [2025-10-01T22:18:28.105277] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:18:28.105576] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-01T22:18:28.105630] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-01T22:18:28.105380] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-01T22:18:28.106858] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-01T22:18:28.106924] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-01T22:18:28.526516] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:18:28.694264] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T22:18:28.902433] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-01T22:18:29.702361] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-01T22:18:29.966067] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T22:18:30.457539] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T22:18:30.502353] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-01T22:18:30.801121] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-01T22:18:31.302390] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-01T22:18:32.107528] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-01T22:18:32.127017] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-01T22:18:32.902376] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-01T22:18:32.996602] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T22:18:33.682172] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T22:18:33.702346] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-01T22:18:34.507502] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-01T22:18:34.526061] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T22:18:35.302422] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-01T22:18:35.374627] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-01T22:18:36.102417] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-01T22:18:36.242950] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T22:18:36.303809] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T22:18:36.902440] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-01T22:18:37.499745] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T22:18:37.702390] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-01T22:18:38.502407] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-01T22:18:38.576927] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-01T22:18:38.981540] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-01T22:18:39.227143] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T22:18:39.302393] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-01T22:18:39.594606] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:18:39.597020] [INFO ] [REMOTE ] VSTS: Full fetch complete (69779 records). [2025-10-01T22:18:39.597234] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-01T22:18:40.023830] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-01T22:18:40.023969] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-01T22:18:40.025285] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-01T22:18:40.025355] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-01T22:18:40.026967] [DEBUG] [LOCAL ] VSTS: Trimmed 69779 records to 49026 (keeping 200 days of data) [2025-10-01T22:18:40.110402] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-01T22:18:40.319086] [DEBUG] [LOCAL ] VSTS: Primary data saved (49026 records). [2025-10-01T22:18:40.319237] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-01T22:18:40.319360] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VSTS took 35.0s. Estimated remaining: 16m 14s. Rate: 7.1 symbols/min [2025-10-01T22:18:40.501331] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:18:40.510376] [DEBUG] [LOCAL ] VTN: Loaded 7051 existing records from primary storage. [2025-10-01T22:18:40.510577] [INFO ] [MAIN ] VTN: Loaded 7051 existing records. [2025-10-01T22:18:40.701610] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:18:40.701913] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-01T22:18:40.701971] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-01T22:18:40.702337] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-01T22:18:40.702450] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-01T22:18:40.912301] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-01T22:18:41.120527] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:18:41.133890] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T22:18:41.135363] [INFO ] [REMOTE ] VTEX: Full fetch complete (60618 records). [2025-10-01T22:18:41.135467] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-01T22:18:41.556915] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-01T22:18:41.557024] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-01T22:18:41.558279] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-01T22:18:41.558346] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-01T22:18:41.559857] [DEBUG] [LOCAL ] VTEX: Trimmed 60618 records to 43194 (keeping 200 days of data) [2025-10-01T22:18:41.731075] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-01T22:18:41.845698] [DEBUG] [LOCAL ] VTEX: Primary data saved (43194 records). [2025-10-01T22:18:41.845846] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-01T22:18:41.845952] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 27.6s. Estimated remaining: 16m 6s. Rate: 7.1 symbols/min [2025-10-01T22:18:42.051385] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:18:42.072134] [DEBUG] [LOCAL ] VTOL: Loaded 19562 existing records from primary storage. [2025-10-01T22:18:42.072435] [INFO ] [MAIN ] VTOL: Loaded 19562 existing records. [2025-10-01T22:18:42.217248] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-01T22:18:42.290463] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:18:42.290761] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-01T22:18:42.290826] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-01T22:18:42.291348] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-01T22:18:42.291410] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-01T22:18:42.507864] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-01T22:18:42.698373] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:18:42.708567] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T22:18:43.302385] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-01T22:18:44.102393] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-01T22:18:44.280187] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-01T22:18:44.332540] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T22:18:44.902408] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-01T22:18:45.075345] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T22:18:45.487970] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-01T22:18:45.702433] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-01T22:18:46.502392] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-01T22:18:46.625805] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-01T22:18:47.302383] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-01T22:18:48.102423] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-01T22:18:48.226253] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-01T22:18:48.372803] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-01T22:18:48.873230] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T22:18:48.902424] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-01T22:18:49.702433] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-01T22:18:50.094167] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-01T22:18:50.502376] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-01T22:18:50.810096] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T22:18:51.238780] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T22:18:51.302456] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-01T22:18:52.102367] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-01T22:18:52.400808] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-01T22:18:52.401014] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:18:52.408487] [INFO ] [REMOTE ] VTLE: Full fetch complete (68863 records). [2025-10-01T22:18:52.408630] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-01T22:18:52.841830] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-01T22:18:52.841941] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-01T22:18:52.843064] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-01T22:18:52.843130] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-01T22:18:52.844559] [DEBUG] [LOCAL ] VTLE: Trimmed 68863 records to 48471 (keeping 200 days of data) [2025-10-01T22:18:52.909685] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-01T22:18:53.153331] [DEBUG] [LOCAL ] VTLE: Primary data saved (48471 records). [2025-10-01T22:18:53.153499] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-01T22:18:53.153597] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTLE took 37.3s. Estimated remaining: 15m 57s. Rate: 7.1 symbols/min [2025-10-01T22:18:53.347477] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:18:53.398317] [DEBUG] [LOCAL ] VTR: Loaded 52816 existing records from primary storage. [2025-10-01T22:18:53.398666] [INFO ] [MAIN ] VTR: Loaded 52816 existing records. [2025-10-01T22:18:53.633115] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:18:53.633424] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-01T22:18:53.633482] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-01T22:18:53.634764] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-01T22:18:53.634827] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-01T22:18:53.707544] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-01T22:18:54.038925] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:18:54.053555] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T22:18:54.487144] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T22:18:54.502341] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-01T22:18:55.302367] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-01T22:18:55.567832] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-01T22:18:56.102427] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-01T22:18:56.111415] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T22:18:56.902349] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-01T22:18:57.229345] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T22:18:57.648856] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-01T22:18:57.702361] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-01T22:18:58.343028] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-01T22:18:58.502390] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-01T22:18:59.121152] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-01T22:18:59.302430] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-01T22:19:00.102394] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-01T22:19:00.902437] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-01T22:19:01.194399] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T22:19:01.251465] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T22:19:01.627245] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-01T22:19:01.702375] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-01T22:19:02.437534] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-01T22:19:02.502375] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-01T22:19:03.089885] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-01T22:19:03.302415] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-01T22:19:04.102390] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-01T22:19:04.693275] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T22:19:04.711843] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T22:19:04.902386] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-01T22:19:05.702380] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-01T22:19:06.038877] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-01T22:19:06.434687] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T22:19:06.502413] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-01T22:19:07.068617] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-01T22:19:07.069399] [INFO ] [REMOTE ] VTN: Full fetch complete (11405 records). [2025-10-01T22:19:07.069481] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-01T22:19:07.307559] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-01T22:19:07.469084] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-01T22:19:07.469176] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-01T22:19:07.469452] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-01T22:19:07.469496] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-01T22:19:07.469977] [DEBUG] [LOCAL ] VTN: Trimmed 11405 records to 7038 (keeping 200 days of data) [2025-10-01T22:19:07.515209] [DEBUG] [LOCAL ] VTN: Primary data saved (7038 records). [2025-10-01T22:19:07.515378] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-01T22:19:07.515471] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTN took 27.2s. Estimated remaining: 15m 49s. Rate: 7.1 symbols/min [2025-10-01T22:19:07.699998] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:19:07.732093] [DEBUG] [LOCAL ] VTS: Loaded 30509 existing records from primary storage. [2025-10-01T22:19:07.732417] [INFO ] [MAIN ] VTS: Loaded 30509 existing records. [2025-10-01T22:19:07.926822] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:19:07.927079] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-01T22:19:07.927128] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-01T22:19:07.927885] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-01T22:19:07.927947] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-01T22:19:08.107494] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-01T22:19:08.340314] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:19:08.902374] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-01T22:19:09.146393] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-01T22:19:09.267854] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-01T22:19:09.702355] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-01T22:19:09.743494] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-01T22:19:09.924125] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-01T22:19:09.925076] [INFO ] [REMOTE ] VTOL: Full fetch complete (25957 records). [2025-10-01T22:19:09.925154] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-01T22:19:10.342700] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-01T22:19:10.342789] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-01T22:19:10.343387] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-01T22:19:10.343431] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-01T22:19:10.344185] [DEBUG] [LOCAL ] VTOL: Trimmed 25957 records to 19565 (keeping 200 days of data) [2025-10-01T22:19:10.465408] [DEBUG] [LOCAL ] VTOL: Primary data saved (19565 records). [2025-10-01T22:19:10.465562] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-01T22:19:10.465673] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTOL took 28.6s. Estimated remaining: 15m 40s. Rate: 7.1 symbols/min [2025-10-01T22:19:10.507567] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-01T22:19:10.663007] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:19:10.696326] [DEBUG] [LOCAL ] VVR: Loaded 31144 existing records from primary storage. [2025-10-01T22:19:10.696670] [INFO ] [MAIN ] VVR: Loaded 31144 existing records. [2025-10-01T22:19:10.917150] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:19:10.917399] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-01T22:19:10.917451] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-01T22:19:10.918518] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-01T22:19:10.918580] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-01T22:19:11.308558] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-01T22:19:11.336284] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:19:11.436962] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-01T22:19:12.102443] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-01T22:19:12.902417] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-01T22:19:13.187554] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T22:19:13.257995] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-01T22:19:13.702396] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-01T22:19:14.263435] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T22:19:14.502392] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-01T22:19:15.265125] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T22:19:15.302384] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-01T22:19:15.591019] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T22:19:16.102399] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-01T22:19:16.372970] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T22:19:16.902416] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-01T22:19:17.702366] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-01T22:19:18.005634] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-01T22:19:18.266670] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-01T22:19:18.357061] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T22:19:18.358184] [INFO ] [REMOTE ] VTMX: Full fetch complete (25890 records). [2025-10-01T22:19:18.358283] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-01T22:19:18.507627] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-01T22:19:18.790085] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-01T22:19:18.790203] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-01T22:19:18.790787] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-01T22:19:18.790849] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-01T22:19:18.791719] [DEBUG] [LOCAL ] VTMX: Trimmed 25890 records to 17524 (keeping 200 days of data) [2025-10-01T22:19:18.909938] [DEBUG] [LOCAL ] VTMX: Primary data saved (17524 records). [2025-10-01T22:19:18.910090] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-01T22:19:18.910209] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTMX took 51.2s. Estimated remaining: 15m 32s. Rate: 7.1 symbols/min [2025-10-01T22:19:19.102988] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:19:19.150257] [DEBUG] [LOCAL ] VVV: Loaded 50177 existing records from primary storage. [2025-10-01T22:19:19.150579] [INFO ] [MAIN ] VVV: Loaded 50177 existing records. [2025-10-01T22:19:19.310786] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-01T22:19:19.356710] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:19:19.356942] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-01T22:19:19.356997] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-01T22:19:19.358215] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-01T22:19:19.358280] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-01T22:19:19.753087] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:19:19.962257] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-01T22:19:20.102366] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-01T22:19:20.412086] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-01T22:19:20.902384] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-01T22:19:21.702366] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-01T22:19:21.880884] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-01T22:19:22.146868] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-01T22:19:22.502386] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-01T22:19:23.169342] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T22:19:23.302414] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-01T22:19:23.821162] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-01T22:19:24.102397] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-01T22:19:24.847230] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T22:19:24.902393] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-01T22:19:25.448996] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-01T22:19:25.702400] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-01T22:19:26.434116] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T22:19:26.502377] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-01T22:19:26.997431] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T22:19:27.302383] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-01T22:19:28.102410] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-01T22:19:28.193444] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T22:19:28.252908] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-01T22:19:28.902373] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-01T22:19:29.702352] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-01T22:19:29.828583] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T22:19:30.018865] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-01T22:19:30.502416] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-01T22:19:31.127968] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T22:19:31.302377] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-01T22:19:32.102367] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-01T22:19:32.164041] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T22:19:32.315040] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T22:19:32.901521] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T22:19:32.909182] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-01T22:19:33.702367] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-01T22:19:33.845169] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-01T22:19:33.846748] [INFO ] [REMOTE ] VTR: Full fetch complete (76341 records). [2025-10-01T22:19:33.846852] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-01T22:19:34.308103] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-01T22:19:34.308310] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-01T22:19:34.309683] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-01T22:19:34.309753] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-01T22:19:34.311385] [DEBUG] [LOCAL ] VTR: Trimmed 76341 records to 52809 (keeping 200 days of data) [2025-10-01T22:19:34.506741] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-01T22:19:34.660600] [DEBUG] [LOCAL ] VTR: Primary data saved (52809 records). [2025-10-01T22:19:34.660773] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-01T22:19:34.660916] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTR took 41.5s. Estimated remaining: 15m 24s. Rate: 7.1 symbols/min [2025-10-01T22:19:34.865195] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:19:34.898213] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-01T22:19:34.929269] [DEBUG] [LOCAL ] VVX: Loaded 23117 existing records from primary storage. [2025-10-01T22:19:34.929592] [INFO ] [MAIN ] VVX: Loaded 23117 existing records. [2025-10-01T22:19:35.127507] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:19:35.127764] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-01T22:19:35.127821] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-01T22:19:35.128400] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-01T22:19:35.128471] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-01T22:19:35.306508] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-01T22:19:35.554978] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:19:35.572128] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-01T22:19:36.102376] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-01T22:19:36.902399] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-01T22:19:37.019791] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T22:19:37.220349] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-01T22:19:37.702370] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-01T22:19:37.985919] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-01T22:19:37.987410] [INFO ] [REMOTE ] VTS: Full fetch complete (41433 records). [2025-10-01T22:19:37.987495] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-01T22:19:38.445547] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-01T22:19:38.445639] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-01T22:19:38.446746] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-01T22:19:38.446815] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-01T22:19:38.447885] [DEBUG] [LOCAL ] VTS: Trimmed 41433 records to 30516 (keeping 200 days of data) [2025-10-01T22:19:38.504041] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-01T22:19:38.652098] [DEBUG] [LOCAL ] VTS: Primary data saved (30516 records). [2025-10-01T22:19:38.652243] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-01T22:19:38.652334] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTS took 31.1s. Estimated remaining: 15m 15s. Rate: 7.1 symbols/min [2025-10-01T22:19:38.855625] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:19:38.872112] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T22:19:38.922663] [DEBUG] [LOCAL ] VYX: Loaded 48784 existing records from primary storage. [2025-10-01T22:19:38.923014] [INFO ] [MAIN ] VYX: Loaded 48784 existing records. [2025-10-01T22:19:39.133399] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:19:39.133638] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-01T22:19:39.133737] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-01T22:19:39.134986] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-01T22:19:39.135090] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-01T22:19:39.310920] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-01T22:19:39.554590] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:19:39.939719] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T22:19:40.102392] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-01T22:19:40.410336] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-01T22:19:40.902392] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-01T22:19:41.702350] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-01T22:19:41.786305] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T22:19:42.214189] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T22:19:42.502390] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-01T22:19:42.894517] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-01T22:19:43.302387] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-01T22:19:44.102418] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-01T22:19:44.176145] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T22:19:44.276997] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-01T22:19:44.902394] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-01T22:19:45.670562] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T22:19:45.702340] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-01T22:19:45.931142] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T22:19:46.502435] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-01T22:19:47.272265] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-01T22:19:47.302344] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-01T22:19:47.784965] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T22:19:48.102386] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-01T22:19:48.687862] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-01T22:19:48.902435] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-01T22:19:49.103895] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T22:19:49.672351] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T22:19:49.702371] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-01T22:19:50.502406] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-01T22:19:50.784950] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T22:19:50.786577] [INFO ] [REMOTE ] VVV: Full fetch complete (72376 records). [2025-10-01T22:19:50.786711] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-01T22:19:51.233856] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-01T22:19:51.234011] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-01T22:19:51.235186] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-01T22:19:51.235252] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-01T22:19:51.236810] [DEBUG] [LOCAL ] VVV: Trimmed 72376 records to 50187 (keeping 200 days of data) [2025-10-01T22:19:51.326174] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-01T22:19:51.504533] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T22:19:51.602353] [DEBUG] [LOCAL ] VVV: Primary data saved (50187 records). [2025-10-01T22:19:51.602524] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-01T22:19:51.602659] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVV took 32.7s. Estimated remaining: 15m 7s. Rate: 7.1 symbols/min [2025-10-01T22:19:51.792207] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:19:51.847579] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-01T22:19:51.847964] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-01T22:19:52.043214] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:19:52.043420] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-01T22:19:52.043470] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-01T22:19:52.044484] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-01T22:19:52.044545] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-01T22:19:52.104906] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-01T22:19:52.381445] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-01T22:19:52.477030] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:19:52.902395] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-01T22:19:53.175337] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-01T22:19:53.176619] [INFO ] [REMOTE ] VVR: Full fetch complete (46204 records). [2025-10-01T22:19:53.176770] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-01T22:19:53.601798] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-01T22:19:53.601940] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-01T22:19:53.603169] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-01T22:19:53.603241] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-01T22:19:53.604438] [DEBUG] [LOCAL ] VVR: Trimmed 46204 records to 31186 (keeping 200 days of data) [2025-10-01T22:19:53.702895] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-01T22:19:53.799835] [DEBUG] [LOCAL ] VVR: Primary data saved (31186 records). [2025-10-01T22:19:53.799979] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-01T22:19:53.800084] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVR took 43.3s. Estimated remaining: 14m 58s. Rate: 7.1 symbols/min [2025-10-01T22:19:53.990159] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:19:54.036754] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-01T22:19:54.059219] [DEBUG] [LOCAL ] W: Loaded 53485 existing records from primary storage. [2025-10-01T22:19:54.059586] [INFO ] [MAIN ] W: Loaded 53485 existing records. [2025-10-01T22:19:54.262902] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:19:54.263524] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-01T22:19:54.263599] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-01T22:19:54.265666] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-01T22:19:54.265741] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-01T22:19:54.507523] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-01T22:19:54.678790] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:19:55.302417] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-01T22:19:56.033348] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-01T22:19:56.102142] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T22:19:56.108856] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-01T22:19:56.902366] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-01T22:19:57.083896] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-01T22:19:57.702398] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-01T22:19:57.769890] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T22:19:57.890100] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-01T22:19:58.502433] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-01T22:19:59.302366] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-01T22:19:59.409735] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-01T22:19:59.931440] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T22:20:00.082002] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-01T22:20:00.083169] [INFO ] [REMOTE ] VVX: Full fetch complete (33528 records). [2025-10-01T22:20:00.083288] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-01T22:20:00.107530] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-01T22:20:00.538267] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-01T22:20:00.538371] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-01T22:20:00.539124] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-01T22:20:00.539190] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-01T22:20:00.540009] [DEBUG] [LOCAL ] VVX: Trimmed 33528 records to 23138 (keeping 200 days of data) [2025-10-01T22:20:00.683530] [DEBUG] [LOCAL ] VVX: Primary data saved (23138 records). [2025-10-01T22:20:00.683689] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-01T22:20:00.683786] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 26.0s. Estimated remaining: 14m 50s. Rate: 7.1 symbols/min [2025-10-01T22:20:00.882561] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:00.902389] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-01T22:20:00.936940] [DEBUG] [LOCAL ] WAB: Loaded 44146 existing records from primary storage. [2025-10-01T22:20:00.937246] [INFO ] [MAIN ] WAB: Loaded 44146 existing records. [2025-10-01T22:20:01.147401] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:20:01.148462] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-01T22:20:01.148525] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-01T22:20:01.150214] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-01T22:20:01.150292] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-01T22:20:01.584217] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:01.702381] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-01T22:20:02.502377] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-01T22:20:02.540098] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T22:20:02.719830] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-01T22:20:03.302398] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-01T22:20:03.644236] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-01T22:20:04.100750] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-01T22:20:04.104181] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-01T22:20:04.902436] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-01T22:20:05.037779] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T22:20:05.702417] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-01T22:20:06.245495] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-01T22:20:06.502414] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-01T22:20:06.567833] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-01T22:20:07.302359] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-01T22:20:07.369827] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T22:20:08.102416] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-01T22:20:08.805732] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-01T22:20:08.890964] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T22:20:08.902601] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-01T22:20:09.423048] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T22:20:09.702378] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-01T22:20:10.502404] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-01T22:20:11.058293] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-01T22:20:11.070395] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-01T22:20:11.302421] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-01T22:20:12.114949] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-01T22:20:12.122398] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-01T22:20:12.436398] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-01T22:20:12.438070] [INFO ] [REMOTE ] VYX: Full fetch complete (70260 records). [2025-10-01T22:20:12.438222] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-01T22:20:12.888362] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-01T22:20:12.888455] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-01T22:20:12.889706] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-01T22:20:12.889772] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-01T22:20:12.891550] [DEBUG] [LOCAL ] VYX: Trimmed 70260 records to 48753 (keeping 200 days of data) [2025-10-01T22:20:12.945238] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-01T22:20:13.207351] [DEBUG] [LOCAL ] VYX: Primary data saved (48753 records). [2025-10-01T22:20:13.207522] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-01T22:20:13.207618] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 34.6s. Estimated remaining: 14m 41s. Rate: 7.1 symbols/min [2025-10-01T22:20:13.406352] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:13.454365] [DEBUG] [LOCAL ] WAL: Loaded 45236 existing records from primary storage. [2025-10-01T22:20:13.454745] [INFO ] [MAIN ] WAL: Loaded 45236 existing records. [2025-10-01T22:20:13.661418] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:20:13.661797] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-01T22:20:13.661964] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-01T22:20:13.675128] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-01T22:20:13.680403] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-01T22:20:13.732467] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-01T22:20:13.780369] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-01T22:20:14.142322] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:14.502435] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-01T22:20:15.302363] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-01T22:20:15.407978] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-01T22:20:15.580998] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T22:20:15.822983] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T22:20:16.102431] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-01T22:20:16.800901] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T22:20:16.902399] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-01T22:20:17.702369] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-01T22:20:18.368240] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-01T22:20:18.507477] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-01T22:20:18.525201] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T22:20:19.302435] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-01T22:20:19.659700] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-01T22:20:19.909701] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T22:20:20.102391] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-01T22:20:20.902407] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-01T22:20:21.434543] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-01T22:20:21.702368] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-01T22:20:22.219787] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-01T22:20:22.502405] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-01T22:20:22.678666] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T22:20:23.302386] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-01T22:20:24.103815] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-01T22:20:24.102422] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-01T22:20:24.418443] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-01T22:20:24.902382] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-01T22:20:24.984765] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T22:20:25.432207] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-01T22:20:25.481417] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-01T22:20:25.702382] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-01T22:20:25.990553] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:20:25.992267] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-01T22:20:25.992397] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-01T22:20:26.425252] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-01T22:20:26.425347] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-01T22:20:26.426576] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-01T22:20:26.426683] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-01T22:20:26.428420] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-10-01T22:20:26.524340] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-01T22:20:26.787065] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-01T22:20:26.787220] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-01T22:20:26.787335] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VZ took 35.2s. Estimated remaining: 14m 33s. Rate: 7.1 symbols/min [2025-10-01T22:20:26.985633] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:27.024364] [DEBUG] [LOCAL ] WAT: Loaded 35132 existing records from primary storage. [2025-10-01T22:20:27.024732] [INFO ] [MAIN ] WAT: Loaded 35132 existing records. [2025-10-01T22:20:27.232672] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:20:27.232918] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-01T22:20:27.232967] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-01T22:20:27.233975] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-01T22:20:27.234037] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-01T22:20:27.307492] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-01T22:20:27.657061] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:28.102364] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-01T22:20:28.226380] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T22:20:28.612911] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T22:20:28.902422] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-01T22:20:29.500441] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T22:20:29.702365] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-01T22:20:30.311378] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-01T22:20:30.313157] [INFO ] [REMOTE ] W: Full fetch complete (77424 records). [2025-10-01T22:20:30.313264] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-01T22:20:30.507679] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-01T22:20:30.749590] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-01T22:20:30.749707] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-01T22:20:30.750878] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-01T22:20:30.750947] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-01T22:20:30.752521] [DEBUG] [LOCAL ] W: Trimmed 77424 records to 53481 (keeping 200 days of data) [2025-10-01T22:20:31.101326] [DEBUG] [LOCAL ] W: Primary data saved (53481 records). [2025-10-01T22:20:31.101542] [INFO ] [MAIN ] W: Full history saved. [2025-10-01T22:20:31.101689] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 37.3s. Estimated remaining: 14m 24s. Rate: 7.1 symbols/min [2025-10-01T22:20:31.292387] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:31.292638] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-01T22:20:31.292879] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-01T22:20:31.293018] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-01T22:20:31.293274] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-01T22:20:31.293528] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-01T22:20:31.293740] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-01T22:20:31.316805] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-01T22:20:31.393254] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-01T22:20:31.745483] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:32.114624] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-01T22:20:32.138572] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T22:20:32.768493] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:20:32.768887] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-01T22:20:32.768978] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:20:32.769061] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-01T22:20:32.769128] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:20:32.769202] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-01T22:20:32.769267] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-01T22:20:32.769305] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-01T22:20:32.769347] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-01T22:20:32.769395] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WBI took 1.7s. Estimated remaining: 14m 16s. Rate: 7.1 symbols/min [2025-10-01T22:20:32.907776] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T22:20:32.906352] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-01T22:20:32.993366] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:33.045045] [DEBUG] [LOCAL ] WBS: Loaded 48701 existing records from primary storage. [2025-10-01T22:20:33.045387] [INFO ] [MAIN ] WBS: Loaded 48701 existing records. [2025-10-01T22:20:33.246884] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:20:33.247095] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-01T22:20:33.247144] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-01T22:20:33.248325] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-01T22:20:33.248415] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-01T22:20:33.660582] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:33.702375] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-01T22:20:34.502367] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-01T22:20:34.603630] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T22:20:34.812564] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-01T22:20:35.302376] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-01T22:20:35.877631] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T22:20:36.102382] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-01T22:20:36.611560] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-01T22:20:36.902382] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-01T22:20:37.172395] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T22:20:37.702366] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-01T22:20:38.195422] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-01T22:20:38.448069] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T22:20:38.502430] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-01T22:20:38.791316] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:20:38.792960] [INFO ] [REMOTE ] WAB: Full fetch complete (64353 records). [2025-10-01T22:20:38.793108] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-01T22:20:39.229791] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-01T22:20:39.229891] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-01T22:20:39.231138] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-01T22:20:39.231206] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-01T22:20:39.232726] [DEBUG] [LOCAL ] WAB: Trimmed 64353 records to 44059 (keeping 200 days of data) [2025-10-01T22:20:39.304355] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-01T22:20:39.533926] [DEBUG] [LOCAL ] WAB: Primary data saved (44059 records). [2025-10-01T22:20:39.534093] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-01T22:20:39.534231] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAB took 38.9s. Estimated remaining: 14m 7s. Rate: 7.1 symbols/min [2025-10-01T22:20:39.729130] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:39.741361] [DEBUG] [LOCAL ] WBX: Loaded 11669 existing records from primary storage. [2025-10-01T22:20:39.741601] [INFO ] [MAIN ] WBX: Loaded 11669 existing records. [2025-10-01T22:20:39.967943] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:20:39.968204] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-01T22:20:39.968254] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-01T22:20:39.968704] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-01T22:20:39.968769] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-01T22:20:40.107501] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-01T22:20:40.360777] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:40.902355] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-01T22:20:41.017487] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-01T22:20:41.665529] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-01T22:20:41.702358] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-01T22:20:42.431200] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T22:20:42.502364] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-01T22:20:42.532420] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T22:20:43.302419] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-01T22:20:43.798367] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-01T22:20:44.102419] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-01T22:20:44.769480] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-01T22:20:44.902384] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-01T22:20:45.702380] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-01T22:20:45.782512] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-01T22:20:46.114374] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-01T22:20:46.502365] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-01T22:20:46.670814] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T22:20:47.302387] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-01T22:20:48.064522] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T22:20:48.102366] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-01T22:20:48.138615] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T22:20:48.546843] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-01T22:20:48.548456] [INFO ] [REMOTE ] WAL: Full fetch complete (66647 records). [2025-10-01T22:20:48.548569] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-01T22:20:48.907525] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-01T22:20:49.000516] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-01T22:20:49.000609] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-01T22:20:49.001725] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-01T22:20:49.001792] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-01T22:20:49.003425] [DEBUG] [LOCAL ] WAL: Trimmed 66647 records to 45226 (keeping 200 days of data) [2025-10-01T22:20:49.307830] [DEBUG] [LOCAL ] WAL: Primary data saved (45226 records). [2025-10-01T22:20:49.308066] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-01T22:20:49.308169] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAL took 36.1s. Estimated remaining: 13m 59s. Rate: 7.1 symbols/min [2025-10-01T22:20:49.503821] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:49.543826] [DEBUG] [LOCAL ] WCC: Loaded 39644 existing records from primary storage. [2025-10-01T22:20:49.544388] [INFO ] [MAIN ] WCC: Loaded 39644 existing records. [2025-10-01T22:20:49.707539] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-01T22:20:49.751590] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:20:49.752234] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-01T22:20:49.752285] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-01T22:20:49.753417] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-01T22:20:49.753481] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-01T22:20:50.177990] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:50.482483] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-01T22:20:50.502351] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-01T22:20:50.649514] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T22:20:51.302396] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-01T22:20:51.520491] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-01T22:20:52.102427] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-01T22:20:52.794766] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T22:20:52.902420] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-01T22:20:53.546601] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-01T22:20:53.702400] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-01T22:20:54.412220] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-01T22:20:54.446377] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-01T22:20:54.502406] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-01T22:20:54.790905] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:20:54.792304] [INFO ] [REMOTE ] WAT: Full fetch complete (50084 records). [2025-10-01T22:20:54.792387] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-01T22:20:55.227551] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-01T22:20:55.227675] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-01T22:20:55.228939] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-01T22:20:55.229008] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-01T22:20:55.230243] [DEBUG] [LOCAL ] WAT: Trimmed 50084 records to 35254 (keeping 200 days of data) [2025-10-01T22:20:55.324465] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-01T22:20:55.463890] [DEBUG] [LOCAL ] WAT: Primary data saved (35254 records). [2025-10-01T22:20:55.464069] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-01T22:20:55.464164] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WAT took 28.7s. Estimated remaining: 13m 50s. Rate: 7.1 symbols/min [2025-10-01T22:20:55.656221] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:20:55.707730] [DEBUG] [LOCAL ] WCN: Loaded 47935 existing records from primary storage. [2025-10-01T22:20:55.708308] [INFO ] [MAIN ] WCN: Loaded 47935 existing records. [2025-10-01T22:20:55.936071] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:20:55.936395] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-01T22:20:55.936465] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-01T22:20:55.937748] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-01T22:20:55.937822] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-01T22:20:56.109680] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-01T22:20:56.360623] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:20:56.759588] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-01T22:20:56.902367] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-01T22:20:57.589040] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-01T22:20:57.625318] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-01T22:20:57.702394] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-01T22:20:58.502387] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-01T22:20:59.140624] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-01T22:20:59.286779] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T22:20:59.302354] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-01T22:21:00.102442] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-01T22:21:00.767394] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-01T22:21:00.902388] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-01T22:21:01.050865] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T22:21:01.702431] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-01T22:21:02.102863] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-01T22:21:02.103770] [INFO ] [REMOTE ] WBX: Full fetch complete (24883 records). [2025-10-01T22:21:02.103855] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-01T22:21:02.502798] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-01T22:21:02.553219] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-01T22:21:02.553394] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-01T22:21:02.554106] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-01T22:21:02.554343] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-01T22:21:02.555879] [DEBUG] [LOCAL ] WBX: Trimmed 24883 records to 11587 (keeping 200 days of data) [2025-10-01T22:21:02.635080] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-01T22:21:02.661270] [DEBUG] [LOCAL ] WBX: Primary data saved (11587 records). [2025-10-01T22:21:02.661409] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-01T22:21:02.661527] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBX took 23.1s. Estimated remaining: 13m 42s. Rate: 7.1 symbols/min [2025-10-01T22:21:02.850007] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:21:02.873377] [DEBUG] [LOCAL ] WD: Loaded 23200 existing records from primary storage. [2025-10-01T22:21:02.873638] [INFO ] [MAIN ] WD: Loaded 23200 existing records. [2025-10-01T22:21:03.063278] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:21:03.063488] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-01T22:21:03.063536] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-01T22:21:03.064353] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-01T22:21:03.064415] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-01T22:21:03.307479] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-01T22:21:03.486124] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:21:04.102425] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-01T22:21:04.266159] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T22:21:04.766792] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-01T22:21:04.902382] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-01T22:21:04.994157] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T22:21:05.702399] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-01T22:21:06.502391] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-01T22:21:06.791522] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-01T22:21:06.827468] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T22:21:07.302402] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-01T22:21:07.812128] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T22:21:08.102402] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-01T22:21:08.902548] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-01T22:21:08.949908] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T22:21:09.221356] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-01T22:21:09.702393] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-01T22:21:10.453879] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-01T22:21:10.502384] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-01T22:21:10.977129] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-01T22:21:11.302408] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-01T22:21:12.100965] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-01T22:21:12.110002] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-01T22:21:12.902411] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-01T22:21:13.051457] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T22:21:13.251970] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-01T22:21:13.702376] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-01T22:21:14.502446] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-01T22:21:14.603678] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T22:21:14.653491] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-01T22:21:15.302420] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-01T22:21:15.960240] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T22:21:16.102398] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-01T22:21:16.789152] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T22:21:16.902430] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-01T22:21:17.702386] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-01T22:21:17.864353] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T22:21:18.185831] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-01T22:21:18.502386] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-01T22:21:19.302382] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-01T22:21:19.539272] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-01T22:21:19.595351] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T22:21:20.102400] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-01T22:21:20.564371] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-01T22:21:20.902396] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-01T22:21:21.321841] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-01T22:21:21.702403] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-01T22:21:22.423424] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T22:21:22.502429] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-01T22:21:22.632301] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-01T22:21:22.869182] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-01T22:21:22.871154] [INFO ] [REMOTE ] WBS: Full fetch complete (69613 records). [2025-10-01T22:21:22.871280] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-01T22:21:23.308438] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-01T22:21:23.335031] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-01T22:21:23.335102] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-01T22:21:23.336328] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-01T22:21:23.336479] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-01T22:21:23.339424] [DEBUG] [LOCAL ] WBS: Trimmed 69613 records to 48701 (keeping 200 days of data) [2025-10-01T22:21:23.702339] [DEBUG] [LOCAL ] WBS: Primary data saved (48701 records). [2025-10-01T22:21:23.702493] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-01T22:21:23.702605] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBS took 50.9s. Estimated remaining: 13m 34s. Rate: 7.1 symbols/min [2025-10-01T22:21:23.886119] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:21:23.906120] [DEBUG] [LOCAL ] WDH: Loaded 17502 existing records from primary storage. [2025-10-01T22:21:23.906440] [INFO ] [MAIN ] WDH: Loaded 17502 existing records. [2025-10-01T22:21:24.106954] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-01T22:21:24.111142] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:21:24.112611] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-01T22:21:24.112877] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-01T22:21:24.114011] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-01T22:21:24.114083] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-01T22:21:24.517700] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:21:24.902427] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-01T22:21:25.106232] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-01T22:21:25.250217] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-01T22:21:25.702374] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-01T22:21:26.058322] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-01T22:21:26.160429] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-01T22:21:26.502395] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-01T22:21:27.302391] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-01T22:21:27.556317] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-01T22:21:28.017910] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T22:21:28.102418] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-01T22:21:28.902384] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-01T22:21:29.668820] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T22:21:29.702366] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-01T22:21:29.878587] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T22:21:30.502383] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-01T22:21:30.696149] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.19 seconds). [2025-10-01T22:21:30.697218] [INFO ] [REMOTE ] WD: Full fetch complete (33163 records). [2025-10-01T22:21:30.697292] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-01T22:21:30.817501] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T22:21:30.824935] [INFO ] [REMOTE ] WCN: Full fetch complete (69472 records). [2025-10-01T22:21:30.840491] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-01T22:21:31.344169] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-01T22:21:31.382926] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-01T22:21:31.422776] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-01T22:21:31.429531] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-01T22:21:31.460683] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-01T22:21:31.518088] [DEBUG] [LOCAL ] WD: Trimmed 33163 records to 23190 (keeping 200 days of data) [2025-10-01T22:21:31.719040] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-01T22:21:31.730858] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-01T22:21:31.740196] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-01T22:21:31.749240] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-01T22:21:31.753305] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-01T22:21:31.758233] [INFO ] [REMOTE ] WCC: Full fetch complete (57930 records). [2025-10-01T22:21:31.774764] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-01T22:21:31.784900] [DEBUG] [LOCAL ] WCN: Trimmed 69472 records to 47968 (keeping 200 days of data) [2025-10-01T22:21:31.822046] [DEBUG] [LOCAL ] WD: Primary data saved (23190 records). [2025-10-01T22:21:31.944206] [INFO ] [MAIN ] WD: Full history saved. [2025-10-01T22:21:31.969495] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WD took 29.3s. Estimated remaining: 13m 25s. Rate: 7.1 symbols/min [2025-10-01T22:21:32.106199] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-01T22:21:32.443901] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:21:32.632972] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-01T22:21:32.633588] [DEBUG] [LOCAL ] WDI: Loaded 21089 existing records from primary storage. [2025-10-01T22:21:32.634877] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-01T22:21:32.635073] [INFO ] [MAIN ] WDI: Loaded 21089 existing records. [2025-10-01T22:21:32.636594] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-01T22:21:32.642837] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-01T22:21:32.718132] [DEBUG] [LOCAL ] WCC: Trimmed 57930 records to 39634 (keeping 200 days of data) [2025-10-01T22:21:33.011282] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:21:33.092551] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-01T22:21:33.121923] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-01T22:21:33.126493] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-01T22:21:33.126974] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-01T22:21:33.156619] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-01T22:21:33.252410] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-01T22:21:33.717148] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:21:33.718734] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-01T22:21:33.756221] [DEBUG] [LOCAL ] WCC: Primary data saved (39634 records). [2025-10-01T22:21:33.756987] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-01T22:21:33.757402] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WCC took 44.4s. Estimated remaining: 13m 16s. Rate: 7.1 symbols/min [2025-10-01T22:21:33.814662] [DEBUG] [LOCAL ] WCN: Primary data saved (47968 records). [2025-10-01T22:21:33.814813] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-01T22:21:33.814947] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WCN took 38.4s. Estimated remaining: 13m 8s. Rate: 7.1 symbols/min [2025-10-01T22:21:34.298443] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T22:21:34.502399] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-01T22:21:34.808416] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-01T22:21:35.302420] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-01T22:21:35.339398] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-01T22:21:36.085622] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-01T22:21:36.102354] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-01T22:21:36.902470] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-01T22:21:37.092583] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-01T22:21:37.674782] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-01T22:21:37.702347] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-01T22:21:38.502383] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-01T22:21:38.752576] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T22:21:39.302358] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-01T22:21:39.384893] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-01T22:21:40.102434] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-01T22:21:40.460763] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-01T22:21:40.905049] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-01T22:21:40.907184] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-01T22:21:41.702371] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-01T22:21:42.064341] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-01T22:21:42.482834] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-01T22:21:42.502341] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-01T22:21:43.302416] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-01T22:21:43.891461] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-01T22:21:44.102360] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-01T22:21:44.429221] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T22:21:44.902386] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-01T22:21:44.969059] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T22:21:44.970142] [INFO ] [REMOTE ] WDH: Full fetch complete (23236 records). [2025-10-01T22:21:44.970218] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-01T22:21:45.398592] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-01T22:21:45.398698] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-01T22:21:45.399234] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-01T22:21:45.399303] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-01T22:21:45.400101] [DEBUG] [LOCAL ] WDH: Trimmed 23236 records to 17463 (keeping 200 days of data) [2025-10-01T22:21:45.503191] [DEBUG] [LOCAL ] WDH: Primary data saved (17463 records). [2025-10-01T22:21:45.503344] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-01T22:21:45.503434] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WDH took 21.8s. Estimated remaining: 12m 59s. Rate: 7.1 symbols/min [2025-10-01T22:21:45.944405] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-01T22:21:45.949462] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-01T22:21:46.971488] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T22:21:46.976574] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-01T22:21:47.951589] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T22:21:47.956544] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-01T22:21:48.526546] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-01T22:21:48.527695] [INFO ] [REMOTE ] WDI: Full fetch complete (30844 records). [2025-10-01T22:21:48.527772] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-01T22:21:48.948047] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-01T22:21:48.948140] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-01T22:21:48.948858] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-01T22:21:48.948921] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-01T22:21:48.949689] [DEBUG] [LOCAL ] WDI: Trimmed 30844 records to 21082 (keeping 200 days of data) [2025-10-01T22:21:49.097472] [DEBUG] [LOCAL ] WDI: Primary data saved (21082 records). [2025-10-01T22:21:49.097601] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-01T22:21:49.097708] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 17.1s. Estimated remaining: 12m 51s. Rate: 7.1 symbols/min [2025-10-01T22:21:49.880662] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:21:49.966535] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:21:49.970188] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:21:49.989871] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:21:49.999428] [DEBUG] [LOCAL ] WEA: Loaded 7280 existing records from primary storage. [2025-10-01T22:21:49.999749] [INFO ] [MAIN ] WEA: Loaded 7280 existing records. [2025-10-01T22:21:50.265345] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:21:50.265879] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-01T22:21:50.265948] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-01T22:21:50.266289] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-01T22:21:50.266352] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-01T22:21:50.285313] [DEBUG] [LOCAL ] WEAV: Loaded 41876 existing records from primary storage. [2025-10-01T22:21:50.356144] [INFO ] [MAIN ] WEAV: Loaded 41876 existing records. [2025-10-01T22:21:50.395989] [DEBUG] [LOCAL ] WDS: Loaded 43377 existing records from primary storage. [2025-10-01T22:21:50.443925] [INFO ] [MAIN ] WDS: Loaded 43377 existing records. [2025-10-01T22:21:50.460504] [DEBUG] [LOCAL ] WEC: Loaded 52179 existing records from primary storage. [2025-10-01T22:21:50.529383] [INFO ] [MAIN ] WEC: Loaded 52179 existing records. [2025-10-01T22:21:51.090715] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:21:51.077008] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:21:51.122187] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-01T22:21:51.111749] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-01T22:21:51.137803] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-01T22:21:51.163968] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-01T22:21:51.219639] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-01T22:21:51.220507] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-01T22:21:51.225861] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-01T22:21:51.234447] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:21:51.251217] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-01T22:21:51.256556] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-01T22:21:51.324413] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-01T22:21:51.394624] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-01T22:21:51.418585] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-01T22:21:51.447226] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:21:51.551095] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-01T22:21:52.412988] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T22:21:52.453201] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:21:52.508564] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-01T22:21:52.508300] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-01T22:21:52.625105] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:21:52.617599] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:21:52.625830] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-01T22:21:52.626290] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-01T22:21:53.279220] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-01T22:21:53.281394] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-01T22:21:53.870088] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-01T22:21:53.871819] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-01T22:21:53.983369] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T22:21:53.993259] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-01T22:21:54.150318] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T22:21:54.477329] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-01T22:21:54.477110] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T22:21:54.502377] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-01T22:21:55.302431] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-01T22:21:55.582227] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-01T22:21:55.947709] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-01T22:21:56.102400] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-01T22:21:56.213555] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T22:21:56.902400] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-01T22:21:57.682088] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T22:21:57.702351] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-01T22:21:58.440462] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T22:21:58.502392] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-01T22:21:59.227774] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T22:21:59.302388] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-01T22:21:59.886576] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-01T22:22:00.102424] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-01T22:22:00.902400] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-01T22:22:01.219035] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-01T22:22:01.694193] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T22:22:01.704399] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-01T22:22:02.485832] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-01T22:22:02.502381] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-01T22:22:02.570060] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-01T22:22:03.302421] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-01T22:22:04.042007] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T22:22:04.102370] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-01T22:22:04.312857] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T22:22:04.902417] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-01T22:22:05.619765] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T22:22:05.702346] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-01T22:22:05.765875] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-01T22:22:06.503612] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-01T22:22:07.088302] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T22:22:07.302388] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-01T22:22:07.830325] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-01T22:22:07.862807] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-01T22:22:08.102399] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-01T22:22:08.832762] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T22:22:08.902416] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-01T22:22:09.702390] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-01T22:22:10.081877] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-01T22:22:10.082832] [INFO ] [REMOTE ] WEA: Full fetch complete (9756 records). [2025-10-01T22:22:10.082907] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-01T22:22:10.502361] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-01T22:22:10.517321] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-01T22:22:10.528018] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-01T22:22:10.530129] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-01T22:22:10.539399] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-01T22:22:10.540332] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-01T22:22:10.541438] [DEBUG] [LOCAL ] WEA: Trimmed 9756 records to 7284 (keeping 200 days of data) [2025-10-01T22:22:10.597463] [DEBUG] [LOCAL ] WEA: Primary data saved (7284 records). [2025-10-01T22:22:10.597696] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-01T22:22:10.597890] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 21.5s. Estimated remaining: 12m 43s. Rate: 7.1 symbols/min [2025-10-01T22:22:10.787037] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:22:10.846737] [DEBUG] [LOCAL ] WELL: Loaded 52361 existing records from primary storage. [2025-10-01T22:22:10.847086] [INFO ] [MAIN ] WELL: Loaded 52361 existing records. [2025-10-01T22:22:11.041038] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:22:11.041277] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-01T22:22:11.041328] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-01T22:22:11.042499] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-01T22:22:11.042561] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-01T22:22:11.307566] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-01T22:22:11.429155] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:22:12.102351] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-01T22:22:12.356707] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-01T22:22:12.902371] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-01T22:22:13.098281] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:22:13.281363] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-01T22:22:13.702434] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-01T22:22:14.502460] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-01T22:22:14.747466] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T22:22:15.302395] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-01T22:22:15.565499] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T22:22:15.817096] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T22:22:16.102413] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-01T22:22:16.902416] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-01T22:22:17.055753] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T22:22:17.666393] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-01T22:22:17.702409] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-01T22:22:18.502534] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-01T22:22:18.541064] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-01T22:22:18.674474] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-01T22:22:18.676009] [INFO ] [REMOTE ] WEAV: Full fetch complete (61580 records). [2025-10-01T22:22:18.676173] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-01T22:22:19.110339] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-01T22:22:19.110428] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-01T22:22:19.111622] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-01T22:22:19.111728] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-01T22:22:19.113207] [DEBUG] [LOCAL ] WEAV: Trimmed 61580 records to 41883 (keeping 200 days of data) [2025-10-01T22:22:19.316708] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-01T22:22:19.365694] [DEBUG] [LOCAL ] WEAV: Primary data saved (41883 records). [2025-10-01T22:22:19.365832] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-01T22:22:19.365923] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 30.3s. Estimated remaining: 12m 34s. Rate: 7.1 symbols/min [2025-10-01T22:22:19.551788] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:22:19.598276] [DEBUG] [LOCAL ] WES: Loaded 48038 existing records from primary storage. [2025-10-01T22:22:19.598629] [INFO ] [MAIN ] WES: Loaded 48038 existing records. [2025-10-01T22:22:19.806611] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:22:19.806900] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-01T22:22:19.806997] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-01T22:22:19.808187] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-01T22:22:19.808261] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-01T22:22:20.111803] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-01T22:22:20.212989] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:22:20.557433] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-01T22:22:20.747235] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T22:22:20.902397] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-01T22:22:21.686506] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-01T22:22:21.702359] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-01T22:22:22.502389] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-01T22:22:22.689281] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-01T22:22:22.794916] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-01T22:22:22.796764] [INFO ] [REMOTE ] WDS: Full fetch complete (64570 records). [2025-10-01T22:22:22.796917] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-01T22:22:23.195351] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-01T22:22:23.195457] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-01T22:22:23.197354] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-01T22:22:23.197421] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-01T22:22:23.199114] [DEBUG] [LOCAL ] WDS: Trimmed 64570 records to 43297 (keeping 200 days of data) [2025-10-01T22:22:23.305913] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-01T22:22:23.490605] [DEBUG] [LOCAL ] WDS: Primary data saved (43297 records). [2025-10-01T22:22:23.490847] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-01T22:22:23.490997] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 34.4s. Estimated remaining: 12m 25s. Rate: 7.1 symbols/min [2025-10-01T22:22:23.687008] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:22:23.738639] [DEBUG] [LOCAL ] WEX: Loaded 34688 existing records from primary storage. [2025-10-01T22:22:23.739380] [INFO ] [MAIN ] WEX: Loaded 34688 existing records. [2025-10-01T22:22:23.942824] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:22:23.943167] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-01T22:22:23.943220] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-01T22:22:23.944128] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-01T22:22:23.944191] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-01T22:22:24.131368] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-01T22:22:24.329058] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:22:24.388429] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-01T22:22:24.902406] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-01T22:22:25.230487] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T22:22:25.621045] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-01T22:22:25.702403] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-01T22:22:26.239308] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-01T22:22:26.502392] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-01T22:22:27.087667] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T22:22:27.302390] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-01T22:22:27.553130] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T22:22:28.102390] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-01T22:22:28.902886] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T22:22:28.903035] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-01T22:22:29.591195] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T22:22:29.702395] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-01T22:22:30.502373] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-01T22:22:30.788807] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T22:22:31.302375] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-01T22:22:31.523928] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T22:22:32.102368] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-01T22:22:32.167151] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-01T22:22:32.902410] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-01T22:22:33.224358] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-01T22:22:33.416982] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-01T22:22:33.702424] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-01T22:22:34.143590] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T22:22:34.502596] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T22:22:34.502670] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-01T22:22:35.302435] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-01T22:22:36.005359] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T22:22:36.102430] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-01T22:22:36.777816] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T22:22:36.902402] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-01T22:22:37.702433] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-01T22:22:38.017809] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-01T22:22:38.244984] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-01T22:22:38.502410] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-01T22:22:38.734988] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-01T22:22:38.736710] [INFO ] [REMOTE ] WEC: Full fetch complete (75523 records). [2025-10-01T22:22:38.736896] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-01T22:22:39.203438] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-01T22:22:39.203553] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-01T22:22:39.204779] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-01T22:22:39.204876] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-01T22:22:39.227532] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-01T22:22:39.234866] [DEBUG] [LOCAL ] WEC: Trimmed 75523 records to 52186 (keeping 200 days of data) [2025-10-01T22:22:39.307547] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-01T22:22:39.607921] [DEBUG] [LOCAL ] WEC: Primary data saved (52186 records). [2025-10-01T22:22:39.608187] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-01T22:22:39.608354] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 50.5s. Estimated remaining: 12m 17s. Rate: 7.1 symbols/min [2025-10-01T22:22:39.797668] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:22:39.810758] [DEBUG] [LOCAL ] WF: Loaded 10714 existing records from primary storage. [2025-10-01T22:22:39.810996] [INFO ] [MAIN ] WF: Loaded 10714 existing records. [2025-10-01T22:22:40.020911] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:22:40.021125] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-01T22:22:40.021178] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-01T22:22:40.021867] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-01T22:22:40.021942] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-01T22:22:40.107625] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-01T22:22:40.428884] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:22:40.902373] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-01T22:22:41.190367] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T22:22:41.702435] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-01T22:22:41.859053] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T22:22:42.413452] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T22:22:42.502386] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-01T22:22:42.634439] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-01T22:22:43.302429] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-01T22:22:43.671206] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-01T22:22:43.827330] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-01T22:22:44.102385] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-01T22:22:44.902417] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-01T22:22:45.702362] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-01T22:22:45.757781] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T22:22:45.850023] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-01T22:22:45.952403] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-01T22:22:45.954120] [INFO ] [REMOTE ] WELL: Full fetch complete (75742 records). [2025-10-01T22:22:45.954224] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-01T22:22:46.390714] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-01T22:22:46.390834] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-01T22:22:46.392005] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-01T22:22:46.392074] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-01T22:22:46.393682] [DEBUG] [LOCAL ] WELL: Trimmed 75742 records to 52362 (keeping 200 days of data) [2025-10-01T22:22:46.504383] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-01T22:22:46.757772] [DEBUG] [LOCAL ] WELL: Primary data saved (52362 records). [2025-10-01T22:22:46.757919] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-01T22:22:46.758009] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 36.2s. Estimated remaining: 12m 9s. Rate: 7.1 symbols/min [2025-10-01T22:22:46.948306] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:22:47.003006] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-01T22:22:47.003357] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-01T22:22:47.201829] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:22:47.202126] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-01T22:22:47.202189] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-01T22:22:47.203623] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-01T22:22:47.203718] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-01T22:22:47.305230] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-01T22:22:47.460321] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-01T22:22:47.619921] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:22:47.893266] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-01T22:22:48.102430] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-01T22:22:48.902385] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-01T22:22:48.952029] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-01T22:22:49.702440] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-01T22:22:50.502434] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-01T22:22:50.560158] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T22:22:50.600205] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-01T22:22:50.799069] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:22:50.800397] [INFO ] [REMOTE ] WEX: Full fetch complete (50665 records). [2025-10-01T22:22:50.800495] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-01T22:22:51.241216] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-01T22:22:51.241323] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-01T22:22:51.242468] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-01T22:22:51.242540] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-01T22:22:51.243822] [DEBUG] [LOCAL ] WEX: Trimmed 50665 records to 34563 (keeping 200 days of data) [2025-10-01T22:22:51.303469] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-01T22:22:51.481092] [DEBUG] [LOCAL ] WEX: Primary data saved (34563 records). [2025-10-01T22:22:51.481236] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-01T22:22:51.481338] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WEX took 28.0s. Estimated remaining: 12m 0s. Rate: 7.1 symbols/min [2025-10-01T22:22:51.676447] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:22:51.701912] [DEBUG] [LOCAL ] WFG: Loaded 24753 existing records from primary storage. [2025-10-01T22:22:51.702217] [INFO ] [MAIN ] WFG: Loaded 24753 existing records. [2025-10-01T22:22:51.920518] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:22:51.920792] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-01T22:22:51.920846] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-01T22:22:51.921598] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-01T22:22:51.921694] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-01T22:22:52.107552] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-01T22:22:52.373931] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:22:52.902428] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-01T22:22:53.702486] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-01T22:23:05.771344] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (12.87 seconds). [2025-10-01T22:23:05.776450] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-01T22:23:05.839483] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (13.73 seconds). [2025-10-01T22:23:05.842471] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-01T22:23:06.523234] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (12.82 seconds). [2025-10-01T22:23:06.535867] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-01T22:23:06.584963] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (15.28 seconds). [2025-10-01T22:23:06.596613] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-01T22:23:07.018927] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-01T22:23:07.022476] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-01T22:23:07.572908] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T22:23:07.579045] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-01T22:23:08.016851] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-01T22:23:08.021199] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-01T22:23:08.251831] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T22:23:08.265708] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-01T22:23:08.695149] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-01T22:23:08.699083] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-01T22:23:08.819705] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-01T22:23:08.843401] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T22:23:08.842561] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-01T22:23:08.850018] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-01T22:23:09.401319] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-01T22:23:09.407279] [INFO ] [REMOTE ] WES: Full fetch complete (69940 records). [2025-10-01T22:23:09.407481] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-01T22:23:09.532377] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T22:23:09.551132] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-01T22:23:09.849553] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-01T22:23:09.849762] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-01T22:23:09.850860] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-01T22:23:09.850926] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-01T22:23:09.852365] [DEBUG] [LOCAL ] WES: Trimmed 69940 records to 48098 (keeping 200 days of data) [2025-10-01T22:23:10.123323] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-01T22:23:10.125292] [INFO ] [REMOTE ] WF: Full fetch complete (16310 records). [2025-10-01T22:23:10.125683] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-01T22:23:10.197801] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-01T22:23:10.230871] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-01T22:23:10.604361] [DEBUG] [LOCAL ] WES: Primary data saved (48098 records). [2025-10-01T22:23:10.630821] [INFO ] [MAIN ] WES: Full history saved. [2025-10-01T22:23:10.659578] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WES took 51.3s. Estimated remaining: 11m 52s. Rate: 7.1 symbols/min [2025-10-01T22:23:10.718838] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-01T22:23:10.766159] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-01T22:23:10.808443] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-01T22:23:10.825411] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-01T22:23:10.916488] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:10.917513] [DEBUG] [LOCAL ] WF: Trimmed 16310 records to 10731 (keeping 200 days of data) [2025-10-01T22:23:11.001542] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-01T22:23:11.015985] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-01T22:23:11.045208] [DEBUG] [LOCAL ] WF: Primary data saved (10731 records). [2025-10-01T22:23:11.046144] [INFO ] [MAIN ] WF: Full history saved. [2025-10-01T22:23:11.056832] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WF took 31.4s. Estimated remaining: 11m 43s. Rate: 7.1 symbols/min [2025-10-01T22:23:11.116624] [DEBUG] [LOCAL ] WGO: Loaded 39011 existing records from primary storage. [2025-10-01T22:23:11.125884] [INFO ] [MAIN ] WGO: Loaded 39011 existing records. [2025-10-01T22:23:11.399610] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:11.496766] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:11.497322] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-01T22:23:11.497399] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-01T22:23:11.504070] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-01T22:23:11.515840] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-01T22:23:11.517921] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-01T22:23:11.588835] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-01T22:23:11.771605] [DEBUG] [LOCAL ] WH: Loaded 45500 existing records from primary storage. [2025-10-01T22:23:11.840225] [INFO ] [MAIN ] WH: Loaded 45500 existing records. [2025-10-01T22:23:12.138634] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:12.153305] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-01T22:23:12.186828] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:12.187036] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-01T22:23:12.187103] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-01T22:23:12.188309] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-01T22:23:12.188375] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-01T22:23:12.591128] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:12.591545] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-01T22:23:12.767187] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-01T22:23:12.772817] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-01T22:23:13.149802] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-01T22:23:13.162699] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-01T22:23:13.417953] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-01T22:23:13.426428] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-01T22:23:13.845339] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T22:23:13.854204] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-01T22:23:13.966808] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-01T22:23:13.972566] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-01T22:23:14.602960] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-01T22:23:14.614520] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-01T22:23:15.049386] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-01T22:23:15.057072] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-01T22:23:15.104404] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-01T22:23:15.117385] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-01T22:23:15.428987] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-01T22:23:15.438001] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-01T22:23:15.779182] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T22:23:15.787211] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-01T22:23:15.957063] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-01T22:23:16.102385] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-01T22:23:17.001310] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T22:23:17.011391] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-01T22:23:17.054194] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T22:23:17.288010] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T22:23:17.462116] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-01T22:23:17.702386] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-01T22:23:18.360607] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-01T22:23:18.362098] [INFO ] [REMOTE ] WFG: Full fetch complete (35849 records). [2025-10-01T22:23:18.362212] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-01T22:23:18.506319] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-01T22:23:18.791129] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-01T22:23:18.791305] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-01T22:23:18.792178] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-01T22:23:18.792262] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-01T22:23:18.821284] [DEBUG] [LOCAL ] WFG: Trimmed 35849 records to 24756 (keeping 200 days of data) [2025-10-01T22:23:18.823079] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T22:23:19.009267] [DEBUG] [LOCAL ] WFG: Primary data saved (24756 records). [2025-10-01T22:23:19.009406] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-01T22:23:19.009517] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFG took 27.5s. Estimated remaining: 11m 35s. Rate: 7.1 symbols/min [2025-10-01T22:23:19.200942] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:19.245884] [DEBUG] [LOCAL ] WHD: Loaded 40334 existing records from primary storage. [2025-10-01T22:23:19.246226] [INFO ] [MAIN ] WHD: Loaded 40334 existing records. [2025-10-01T22:23:19.314607] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-01T22:23:19.458611] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:19.458869] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-01T22:23:19.458918] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-01T22:23:19.459868] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-01T22:23:19.459931] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-01T22:23:19.870927] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:20.102400] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-01T22:23:20.747135] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-01T22:23:20.912793] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-01T22:23:20.918271] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-01T22:23:21.702371] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-01T22:23:21.777559] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-01T22:23:22.502395] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-01T22:23:23.110167] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-01T22:23:23.178139] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T22:23:23.302390] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-01T22:23:24.102362] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-01T22:23:24.202724] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T22:23:24.889086] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-01T22:23:24.902364] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-01T22:23:25.575358] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T22:23:25.702384] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-01T22:23:26.502356] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-01T22:23:27.015612] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-01T22:23:27.157197] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T22:23:27.302380] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-01T22:23:27.811305] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-01T22:23:28.102386] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-01T22:23:28.732060] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-01T22:23:28.902388] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-01T22:23:29.523235] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T22:23:29.702488] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-01T22:23:30.500638] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T22:23:30.509419] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-01T22:23:30.993989] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-01T22:23:31.302431] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-01T22:23:31.389837] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T22:23:32.102421] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-01T22:23:32.388280] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:23:32.389959] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-10-01T22:23:32.390121] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-01T22:23:32.834284] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-01T22:23:32.834493] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-01T22:23:32.835893] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-01T22:23:32.836038] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-01T22:23:32.838076] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 53748 (keeping 200 days of data) [2025-10-01T22:23:32.906266] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-01T22:23:32.984850] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-01T22:23:33.272358] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-01T22:23:33.272528] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-01T22:23:33.272670] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFC took 46.5s. Estimated remaining: 11m 27s. Rate: 7.1 symbols/min [2025-10-01T22:23:33.472853] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:33.479602] [DEBUG] [LOCAL ] WHG: Loaded 3306 existing records from primary storage. [2025-10-01T22:23:33.479864] [INFO ] [MAIN ] WHG: Loaded 3306 existing records. [2025-10-01T22:23:33.676788] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:33.677011] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-01T22:23:33.677093] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-01T22:23:33.677441] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-01T22:23:33.677521] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-01T22:23:33.707596] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-01T22:23:34.099530] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:34.502437] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-01T22:23:34.570577] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-01T22:23:35.024430] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-01T22:23:35.302430] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-01T22:23:35.383483] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T22:23:36.102383] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-01T22:23:36.826575] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T22:23:36.867248] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T22:23:36.902403] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-01T22:23:37.602012] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T22:23:37.702425] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-01T22:23:38.502416] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-01T22:23:39.138694] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-01T22:23:39.171481] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T22:23:39.302426] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-01T22:23:39.821415] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-01T22:23:40.102398] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-01T22:23:40.674758] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-01T22:23:40.902436] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-01T22:23:41.327719] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-01T22:23:41.702418] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-01T22:23:42.182998] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-01T22:23:42.502446] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-01T22:23:42.892696] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-01T22:23:43.302423] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-01T22:23:43.598366] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:23:43.599930] [INFO ] [REMOTE ] WH: Full fetch complete (64985 records). [2025-10-01T22:23:43.600026] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-01T22:23:44.035106] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-01T22:23:44.035279] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-01T22:23:44.036557] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-01T22:23:44.036634] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-01T22:23:44.038223] [DEBUG] [LOCAL ] WH: Trimmed 64985 records to 45457 (keeping 200 days of data) [2025-10-01T22:23:44.106236] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-01T22:23:44.350736] [DEBUG] [LOCAL ] WH: Primary data saved (45457 records). [2025-10-01T22:23:44.350879] [INFO ] [MAIN ] WH: Full history saved. [2025-10-01T22:23:44.351041] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WH took 33.3s. Estimated remaining: 11m 18s. Rate: 7.1 symbols/min [2025-10-01T22:23:44.537937] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:44.586685] [DEBUG] [LOCAL ] WHR: Loaded 48172 existing records from primary storage. [2025-10-01T22:23:44.587016] [INFO ] [MAIN ] WHR: Loaded 48172 existing records. [2025-10-01T22:23:44.799169] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:44.799430] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-01T22:23:44.799493] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-01T22:23:44.802587] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-01T22:23:44.802681] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-01T22:23:44.907708] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-01T22:23:45.228437] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:45.388328] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-01T22:23:45.702401] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-01T22:23:45.941902] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-01T22:23:45.943223] [INFO ] [REMOTE ] WGO: Full fetch complete (57580 records). [2025-10-01T22:23:45.943320] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-01T22:23:46.251124] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-01T22:23:46.391132] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-01T22:23:46.391218] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-01T22:23:46.392379] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-01T22:23:46.392469] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-01T22:23:46.393774] [DEBUG] [LOCAL ] WGO: Trimmed 57580 records to 38946 (keeping 200 days of data) [2025-10-01T22:23:46.502591] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-01T22:23:46.648993] [DEBUG] [LOCAL ] WGO: Primary data saved (38946 records). [2025-10-01T22:23:46.649158] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-01T22:23:46.649250] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WGO took 35.9s. Estimated remaining: 11m 9s. Rate: 7.1 symbols/min [2025-10-01T22:23:46.868884] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:46.875510] [DEBUG] [LOCAL ] WIA: Loaded 4823 existing records from primary storage. [2025-10-01T22:23:46.875740] [INFO ] [MAIN ] WIA: Loaded 4823 existing records. [2025-10-01T22:23:46.996956] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-01T22:23:47.086979] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:47.087271] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-01T22:23:47.087323] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-01T22:23:47.087583] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-01T22:23:47.087677] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-01T22:23:47.304875] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-01T22:23:47.532826] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:47.703238] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-01T22:23:47.704019] [INFO ] [REMOTE ] WHG: Full fetch complete (4631 records). [2025-10-01T22:23:47.704106] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-01T22:23:48.107300] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-01T22:23:48.125720] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-01T22:23:48.125846] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-01T22:23:48.126050] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-01T22:23:48.126116] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-01T22:23:48.126509] [DEBUG] [LOCAL ] WHG: Trimmed 4631 records to 3304 (keeping 200 days of data) [2025-10-01T22:23:48.151617] [DEBUG] [LOCAL ] WHG: Primary data saved (3304 records). [2025-10-01T22:23:48.151771] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-01T22:23:48.151876] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 14.9s. Estimated remaining: 11m 1s. Rate: 7.1 symbols/min [2025-10-01T22:23:48.339633] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:48.353294] [DEBUG] [LOCAL ] WINN: Loaded 11622 existing records from primary storage. [2025-10-01T22:23:48.353620] [INFO ] [MAIN ] WINN: Loaded 11622 existing records. [2025-10-01T22:23:48.548269] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:48.548529] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-01T22:23:48.548578] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-01T22:23:48.548970] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-01T22:23:48.549216] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-01T22:23:48.907523] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-01T22:23:48.939200] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:49.616919] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-01T22:23:49.702375] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-01T22:23:50.302808] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-01T22:23:50.502454] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-01T22:23:50.633745] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T22:23:51.302422] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-01T22:23:51.709715] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-01T22:23:52.102406] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-01T22:23:52.164293] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-01T22:23:52.799311] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T22:23:52.902404] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-01T22:23:53.046419] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-01T22:23:53.047826] [INFO ] [REMOTE ] WHD: Full fetch complete (57381 records). [2025-10-01T22:23:53.047938] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-01T22:23:53.487851] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-01T22:23:53.487934] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-01T22:23:53.493702] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-01T22:23:53.493951] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-01T22:23:53.500794] [DEBUG] [LOCAL ] WHD: Trimmed 57381 records to 40276 (keeping 200 days of data) [2025-10-01T22:23:53.720132] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-01T22:23:53.763466] [DEBUG] [LOCAL ] WHD: Primary data saved (40276 records). [2025-10-01T22:23:53.763632] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-01T22:23:53.763781] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 34.8s. Estimated remaining: 10m 52s. Rate: 7.1 symbols/min [2025-10-01T22:23:53.958322] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:23:54.010304] [DEBUG] [LOCAL ] WIT: Loaded 52344 existing records from primary storage. [2025-10-01T22:23:54.010692] [INFO ] [MAIN ] WIT: Loaded 52344 existing records. [2025-10-01T22:23:54.219078] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:23:54.219316] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-01T22:23:54.219368] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-01T22:23:54.220510] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-01T22:23:54.220574] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-01T22:23:54.507583] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-01T22:23:54.634595] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:23:55.169936] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T22:23:55.302408] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-01T22:23:55.319028] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T22:23:55.927024] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-01T22:23:56.102453] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-01T22:23:56.902399] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-01T22:23:57.590823] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T22:23:57.702397] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-01T22:23:57.744831] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-01T22:23:58.310125] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-01T22:23:58.502450] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-01T22:23:59.207363] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-01T22:23:59.302382] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-01T22:24:00.102393] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-01T22:24:00.192778] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T22:24:00.902431] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-01T22:24:01.702355] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-01T22:24:01.874228] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T22:24:02.460567] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-01T22:24:02.487974] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-01T22:24:02.502402] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-01T22:24:02.859268] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-01T22:24:03.302389] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-01T22:24:04.102394] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-01T22:24:04.698466] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-01T22:24:04.902353] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-01T22:24:05.010097] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-01T22:24:05.697318] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-01T22:24:05.702332] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-01T22:24:06.502400] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-01T22:24:06.535338] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-01T22:24:07.302437] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-01T22:24:08.015548] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-01T22:24:08.062689] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T22:24:08.102390] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-01T22:24:08.902378] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-01T22:24:08.969267] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:24:09.702400] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-01T22:24:10.192917] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-01T22:24:10.193759] [INFO ] [REMOTE ] WINN: Full fetch complete (17583 records). [2025-10-01T22:24:10.193834] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-01T22:24:10.502917] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-01T22:24:10.623171] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-01T22:24:10.623373] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-01T22:24:10.623888] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-01T22:24:10.623991] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-01T22:24:10.625246] [DEBUG] [LOCAL ] WINN: Trimmed 17583 records to 11626 (keeping 200 days of data) [2025-10-01T22:24:10.712381] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-01T22:24:10.747257] [DEBUG] [LOCAL ] WINN: Primary data saved (11626 records). [2025-10-01T22:24:10.747445] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-01T22:24:10.747609] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WINN took 22.6s. Estimated remaining: 10m 44s. Rate: 7.1 symbols/min [2025-10-01T22:24:10.955937] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:24:10.956136] [DEBUG] [LOCAL ] WIW: No existing data file found in primary storage. [2025-10-01T22:24:10.956180] [WARN ] [MAIN ] WIW: No existing data found, performing full refresh instead. [2025-10-01T22:24:10.956300] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-01T22:24:10.956406] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-01T22:24:10.956473] [DEBUG] [LOCAL ] WIW: No primary data file found to delete. [2025-10-01T22:24:10.956510] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-01T22:24:11.165903] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-01T22:24:11.307688] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-01T22:24:11.392223] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:24:12.102404] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-01T22:24:12.691948] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-01T22:24:12.902372] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-01T22:24:13.065502] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T22:24:13.702416] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-01T22:24:14.502415] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-01T22:24:14.677182] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-01T22:24:14.745286] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-01T22:24:15.302389] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-01T22:24:15.971999] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-01T22:24:16.102396] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-01T22:24:16.902373] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-01T22:24:16.943295] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T22:24:17.146086] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T22:24:17.702387] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-01T22:24:18.502360] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-01T22:24:18.961701] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-01T22:24:19.121502] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-01T22:24:19.125812] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-01T22:24:19.302382] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-01T22:24:20.019746] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-01T22:24:20.102381] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-01T22:24:20.902409] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-01T22:24:21.702368] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-01T22:24:21.837075] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-01T22:24:21.910765] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-01T22:24:22.502410] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-01T22:24:23.119710] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-01T22:24:23.302396] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-01T22:24:23.431042] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-01T22:24:24.102438] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-01T22:24:24.897484] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-01T22:24:24.907439] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-01T22:24:25.169899] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T22:24:25.702428] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-01T22:24:25.957037] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-01T22:24:25.999061] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:24:26.000745] [INFO ] [REMOTE ] WHR: Full fetch complete (68500 records). [2025-10-01T22:24:26.000894] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-01T22:24:26.427823] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-01T22:24:26.427913] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-01T22:24:26.429115] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-01T22:24:26.429188] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-01T22:24:26.430765] [DEBUG] [LOCAL ] WHR: Trimmed 68500 records to 48132 (keeping 200 days of data) [2025-10-01T22:24:26.527239] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-01T22:24:26.754070] [DEBUG] [LOCAL ] WHR: Primary data saved (48132 records). [2025-10-01T22:24:26.754216] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-01T22:24:26.754340] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WHR took 42.4s. Estimated remaining: 10m 36s. Rate: 7.1 symbols/min [2025-10-01T22:24:26.954869] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:24:26.978416] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-01T22:24:26.980059] [INFO ] [REMOTE ] WIA: Full fetch complete (7276 records). [2025-10-01T22:24:26.980194] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-01T22:24:27.114580] [DEBUG] [LOCAL ] WK: Loaded 37053 existing records from primary storage. [2025-10-01T22:24:27.126704] [INFO ] [MAIN ] WK: Loaded 37053 existing records. [2025-10-01T22:24:27.325999] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-01T22:24:27.590639] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:24:27.615325] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-01T22:24:27.620591] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-01T22:24:27.659454] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-01T22:24:27.673107] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-01T22:24:27.673298] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-01T22:24:27.673412] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-01T22:24:27.673896] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-01T22:24:27.674202] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-01T22:24:27.712972] [DEBUG] [LOCAL ] WIA: Trimmed 7276 records to 4807 (keeping 200 days of data) [2025-10-01T22:24:27.859682] [DEBUG] [LOCAL ] WIA: Primary data saved (4807 records). [2025-10-01T22:24:27.880176] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-01T22:24:27.900450] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WIA took 41.3s. Estimated remaining: 10m 27s. Rate: 7.1 symbols/min [2025-10-01T22:24:28.122783] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-01T22:24:28.313677] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:24:28.346852] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:24:28.383457] [DEBUG] [LOCAL ] WKC: Loaded 34884 existing records from primary storage. [2025-10-01T22:24:28.383778] [INFO ] [MAIN ] WKC: Loaded 34884 existing records. [2025-10-01T22:24:28.585285] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:24:28.585608] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-01T22:24:28.585700] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-01T22:24:28.586568] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-01T22:24:28.586632] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-01T22:24:28.762863] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T22:24:28.910512] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-01T22:24:29.035264] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:24:29.702369] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-01T22:24:29.902477] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T22:24:29.976493] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T22:24:30.417574] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-01T22:24:30.502364] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-01T22:24:31.302389] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-01T22:24:31.523663] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-01T22:24:32.102426] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-01T22:24:32.794017] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-01T22:24:32.902380] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-01T22:24:33.702400] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-01T22:24:34.050397] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-01T22:24:34.215875] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-01T22:24:34.502382] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-01T22:24:35.281982] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T22:24:35.302356] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-01T22:24:35.952371] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-01T22:24:36.102399] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-01T22:24:36.414042] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-01T22:24:36.416061] [INFO ] [REMOTE ] WIT: Full fetch complete (75655 records). [2025-10-01T22:24:36.416177] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-01T22:24:36.895992] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-01T22:24:36.896079] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-01T22:24:36.897188] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-01T22:24:36.897253] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-01T22:24:36.898866] [DEBUG] [LOCAL ] WIT: Trimmed 75655 records to 52357 (keeping 200 days of data) [2025-10-01T22:24:36.950704] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-01T22:24:37.232591] [DEBUG] [LOCAL ] WIT: Primary data saved (52357 records). [2025-10-01T22:24:37.232765] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-01T22:24:37.232862] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIT took 43.5s. Estimated remaining: 10m 19s. Rate: 7.1 symbols/min [2025-10-01T22:24:37.424602] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T22:24:37.459113] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:24:37.503523] [DEBUG] [LOCAL ] WLK: Loaded 45491 existing records from primary storage. [2025-10-01T22:24:37.503866] [INFO ] [MAIN ] WLK: Loaded 45491 existing records. [2025-10-01T22:24:37.698309] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:24:37.698676] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-01T22:24:37.698748] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-01T22:24:37.699940] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-01T22:24:37.700002] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-01T22:24:37.711329] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-01T22:24:38.109822] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:24:38.155239] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-01T22:24:38.502385] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-01T22:24:39.200925] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-01T22:24:39.302385] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-01T22:24:40.062837] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T22:24:40.102378] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-01T22:24:40.729110] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T22:24:40.902465] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-01T22:24:41.588724] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-01T22:24:41.702413] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-01T22:24:42.048433] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-01T22:24:42.502416] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-01T22:24:43.145491] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-01T22:24:43.213395] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-01T22:24:43.302404] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-01T22:24:44.102352] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-01T22:24:44.758527] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-01T22:24:44.902418] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-01T22:24:45.645581] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-01T22:24:45.702402] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-01T22:24:46.362113] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-01T22:24:46.502382] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-01T22:24:47.137484] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-01T22:24:47.302395] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-01T22:24:47.913939] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-01T22:24:47.957055] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-01T22:24:47.958127] [INFO ] [REMOTE ] WIW: Full fetch complete (29915 records). [2025-10-01T22:24:47.958229] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-01T22:24:48.116368] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-01T22:24:48.384528] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-01T22:24:48.384637] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-01T22:24:48.385411] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-01T22:24:48.385464] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-01T22:24:48.386286] [DEBUG] [LOCAL ] WIW: Trimmed 29915 records to 20296 (keeping 200 days of data) [2025-10-01T22:24:48.517824] [DEBUG] [LOCAL ] WIW: Primary data saved (20296 records). [2025-10-01T22:24:48.517956] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-01T22:24:48.518063] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIW took 37.8s. Estimated remaining: 10m 10s. Rate: 7.1 symbols/min [2025-10-01T22:24:48.755781] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:24:48.764583] [DEBUG] [LOCAL ] WLKP: Loaded 6810 existing records from primary storage. [2025-10-01T22:24:48.764829] [INFO ] [MAIN ] WLKP: Loaded 6810 existing records. [2025-10-01T22:24:48.907533] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-01T22:24:48.989573] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:24:48.990547] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-01T22:24:48.990612] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-01T22:24:48.991609] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-01T22:24:48.991740] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-01T22:24:49.416710] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:24:49.437382] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T22:24:49.702406] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-01T22:24:50.502388] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-01T22:24:50.626125] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-01T22:24:51.157433] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T22:24:51.302412] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-01T22:24:51.887724] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-01T22:24:52.102415] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-01T22:24:52.761468] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-01T22:24:52.902418] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-01T22:24:53.679363] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-01T22:24:53.702357] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-01T22:24:53.758551] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-01T22:24:54.502396] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-01T22:24:55.302389] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-01T22:24:55.465053] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T22:24:55.812559] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-01T22:24:55.841465] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-01T22:24:56.102434] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-01T22:24:56.902391] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-01T22:24:57.474280] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T22:24:57.682585] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-01T22:24:57.702376] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-01T22:24:58.502404] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-01T22:24:58.720595] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T22:24:58.722432] [INFO ] [REMOTE ] WK: Full fetch complete (52611 records). [2025-10-01T22:24:58.722536] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-01T22:24:59.142139] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-01T22:24:59.142222] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-01T22:24:59.143158] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-01T22:24:59.143221] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-01T22:24:59.144505] [DEBUG] [LOCAL ] WK: Trimmed 52611 records to 37163 (keeping 200 days of data) [2025-10-01T22:24:59.313120] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-01T22:24:59.377061] [DEBUG] [LOCAL ] WK: Primary data saved (37163 records). [2025-10-01T22:24:59.377201] [INFO ] [MAIN ] WK: Full history saved. [2025-10-01T22:24:59.377287] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 32.6s. Estimated remaining: 10m 2s. Rate: 7.1 symbols/min [2025-10-01T22:24:59.558667] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:24:59.558885] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-01T22:24:59.558941] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-01T22:24:59.559055] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-01T22:24:59.559097] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-01T22:24:59.559140] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-01T22:24:59.559173] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-01T22:24:59.939681] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:24:59.943992] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-01T22:25:00.102412] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-01T22:25:00.257833] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-01T22:25:00.902456] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-01T22:25:00.976114] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:25:01.287996] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-01T22:25:01.702398] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-01T22:25:01.991410] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:25:01.993468] [INFO ] [REMOTE ] WKC: Full fetch complete (50974 records). [2025-10-01T22:25:01.993615] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-01T22:25:02.442954] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-01T22:25:02.443044] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-01T22:25:02.443997] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-01T22:25:02.444067] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-01T22:25:02.445717] [DEBUG] [LOCAL ] WKC: Trimmed 50974 records to 34861 (keeping 200 days of data) [2025-10-01T22:25:02.512251] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-01T22:25:02.693808] [DEBUG] [LOCAL ] WKC: Primary data saved (34861 records). [2025-10-01T22:25:02.693979] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-01T22:25:02.694074] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 34.8s. Estimated remaining: 9m 53s. Rate: 7.1 symbols/min [2025-10-01T22:25:02.899787] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:02.941489] [DEBUG] [LOCAL ] WLY: Loaded 29706 existing records from primary storage. [2025-10-01T22:25:02.941989] [INFO ] [MAIN ] WLY: Loaded 29706 existing records. [2025-10-01T22:25:03.163196] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:03.163529] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-01T22:25:03.163586] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-01T22:25:03.164379] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-01T22:25:03.164455] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-01T22:25:03.307506] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-01T22:25:03.481278] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-01T22:25:03.604600] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:04.102417] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-01T22:25:04.902393] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-01T22:25:05.194113] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T22:25:05.438672] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-01T22:25:05.460546] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-01T22:25:05.702382] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-01T22:25:06.502426] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-01T22:25:07.302348] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-01T22:25:07.445454] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T22:25:07.581095] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-01T22:25:07.697456] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-01T22:25:08.102394] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-01T22:25:08.902405] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-01T22:25:08.985074] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-01T22:25:09.702904] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-01T22:25:09.702527] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-01T22:25:10.502434] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-01T22:25:10.860774] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T22:25:10.861304] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-01T22:25:11.302413] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-01T22:25:12.102444] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-01T22:25:12.435390] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T22:25:12.455670] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-01T22:25:12.902388] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-01T22:25:13.640627] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-01T22:25:13.702386] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-01T22:25:14.366178] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-01T22:25:14.502437] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-01T22:25:15.302403] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-01T22:25:15.938301] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T22:25:16.093005] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-01T22:25:16.102353] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-01T22:25:16.894810] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T22:25:16.902332] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-01T22:25:17.398455] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-01T22:25:17.399348] [INFO ] [REMOTE ] WLKP: Full fetch complete (10361 records). [2025-10-01T22:25:17.399452] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-01T22:25:17.707583] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-01T22:25:17.820380] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-01T22:25:17.820471] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-01T22:25:17.820840] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-01T22:25:17.820907] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-01T22:25:17.821454] [DEBUG] [LOCAL ] WLKP: Trimmed 10361 records to 6828 (keeping 200 days of data) [2025-10-01T22:25:17.868543] [DEBUG] [LOCAL ] WLKP: Primary data saved (6828 records). [2025-10-01T22:25:17.868728] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-01T22:25:17.868853] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 29.4s. Estimated remaining: 9m 45s. Rate: 7.1 symbols/min [2025-10-01T22:25:18.065434] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:18.130263] [DEBUG] [LOCAL ] WM: Loaded 50915 existing records from primary storage. [2025-10-01T22:25:18.130666] [INFO ] [MAIN ] WM: Loaded 50915 existing records. [2025-10-01T22:25:18.326072] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:18.326341] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-01T22:25:18.326404] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-01T22:25:18.327886] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-01T22:25:18.327975] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-01T22:25:18.503071] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-01T22:25:18.728679] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:18.946679] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-01T22:25:19.122256] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-01T22:25:19.302399] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-01T22:25:20.102382] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-01T22:25:20.902384] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-01T22:25:21.347267] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-01T22:25:21.570223] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-01T22:25:21.590532] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-01T22:25:21.702412] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-01T22:25:22.148979] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-01T22:25:22.502385] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-01T22:25:22.782938] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-01T22:25:23.302429] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-01T22:25:24.102439] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-01T22:25:24.761173] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-01T22:25:24.902391] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-01T22:25:25.183741] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T22:25:25.185291] [INFO ] [REMOTE ] WLK: Full fetch complete (63006 records). [2025-10-01T22:25:25.185440] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-01T22:25:25.620037] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-01T22:25:25.620142] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-01T22:25:25.621205] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-01T22:25:25.621295] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-01T22:25:25.624748] [DEBUG] [LOCAL ] WLK: Trimmed 63006 records to 45534 (keeping 200 days of data) [2025-10-01T22:25:25.705024] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-01T22:25:25.944711] [DEBUG] [LOCAL ] WLK: Primary data saved (45534 records). [2025-10-01T22:25:25.944850] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-01T22:25:25.944956] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 48.7s. Estimated remaining: 9m 36s. Rate: 7.1 symbols/min [2025-10-01T22:25:26.152897] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-01T22:25:26.173944] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:26.243079] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-10-01T22:25:26.243432] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-10-01T22:25:26.452583] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:26.452778] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-01T22:25:26.452829] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-01T22:25:26.454268] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-01T22:25:26.454334] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-01T22:25:26.511465] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-01T22:25:26.937238] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:26.947611] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-01T22:25:27.302432] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-01T22:25:28.102389] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-01T22:25:28.409723] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-01T22:25:28.456193] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-01T22:25:28.683294] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-01T22:25:28.902414] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-01T22:25:29.702416] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-01T22:25:30.425528] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T22:25:30.502353] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-01T22:25:30.551987] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-01T22:25:31.302402] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-01T22:25:32.102415] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-01T22:25:32.391258] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:25:32.392030] [INFO ] [REMOTE ] WLTG: Full fetch complete (1676 records). [2025-10-01T22:25:32.392103] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-01T22:25:32.614606] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T22:25:32.615003] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-01T22:25:32.615169] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-01T22:25:32.615310] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-01T22:25:32.615532] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-01T22:25:32.615592] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-01T22:25:32.615639] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-01T22:25:32.615801] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLTG took 33.2s. Estimated remaining: 9m 28s. Rate: 7.1 symbols/min [2025-10-01T22:25:32.756286] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-01T22:25:32.866909] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:32.885321] [DEBUG] [LOCAL ] WMK: Loaded 14524 existing records from primary storage. [2025-10-01T22:25:32.885585] [INFO ] [MAIN ] WMK: Loaded 14524 existing records. [2025-10-01T22:25:32.907707] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-01T22:25:33.109264] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:33.109712] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-01T22:25:33.109794] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-01T22:25:33.110478] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-01T22:25:33.110542] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-01T22:25:33.316262] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-01T22:25:33.572379] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:33.702390] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-01T22:25:34.500366] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-01T22:25:34.502678] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-01T22:25:35.054250] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-01T22:25:35.302401] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-01T22:25:35.585445] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T22:25:35.587412] [INFO ] [REMOTE ] WLY: Full fetch complete (42820 records). [2025-10-01T22:25:35.587617] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-01T22:25:36.037189] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-01T22:25:36.037284] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-01T22:25:36.038216] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-01T22:25:36.038283] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-01T22:25:36.039506] [DEBUG] [LOCAL ] WLY: Trimmed 42820 records to 29680 (keeping 200 days of data) [2025-10-01T22:25:36.105578] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-01T22:25:36.236177] [DEBUG] [LOCAL ] WLY: Primary data saved (29680 records). [2025-10-01T22:25:36.236338] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-01T22:25:36.236469] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 33.5s. Estimated remaining: 9m 19s. Rate: 7.1 symbols/min [2025-10-01T22:25:36.449122] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:36.486101] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-01T22:25:36.540566] [DEBUG] [LOCAL ] WMS: Loaded 39528 existing records from primary storage. [2025-10-01T22:25:36.541014] [INFO ] [MAIN ] WMS: Loaded 39528 existing records. [2025-10-01T22:25:36.752782] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:36.753097] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-01T22:25:36.753159] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-01T22:25:36.754351] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-01T22:25:36.754415] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-01T22:25:36.904614] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-01T22:25:37.109038] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-01T22:25:37.189366] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:37.702425] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-01T22:25:38.502432] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-01T22:25:38.993884] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-01T22:25:39.067837] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-01T22:25:39.266634] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T22:25:39.302374] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-01T22:25:40.102388] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-01T22:25:40.799118] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-01T22:25:40.902389] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-01T22:25:41.238810] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T22:25:41.702448] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-01T22:25:42.502426] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-01T22:25:42.896480] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-01T22:25:43.302356] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-01T22:25:43.421917] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T22:25:43.564964] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T22:25:44.102417] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-01T22:25:44.866135] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-01T22:25:44.902373] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-01T22:25:45.702404] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-01T22:25:45.968052] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-01T22:25:46.007893] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-01T22:25:46.502429] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-01T22:25:47.302454] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-01T22:25:47.492068] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-01T22:25:47.836940] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-01T22:25:48.102459] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-01T22:25:48.902369] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-01T22:25:48.961213] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-01T22:25:49.009393] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-01T22:25:49.702420] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-01T22:25:50.502357] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-01T22:25:50.540154] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T22:25:51.153522] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-01T22:25:51.204837] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T22:25:51.302388] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-01T22:25:52.102404] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-01T22:25:52.902434] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-01T22:25:52.959337] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-01T22:25:53.327724] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-01T22:25:53.614215] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-01T22:25:53.702408] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-01T22:25:54.502446] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-01T22:25:54.666040] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.16 seconds). [2025-10-01T22:25:54.668066] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-01T22:25:54.668239] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-01T22:25:54.865453] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-01T22:25:55.152998] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-01T22:25:55.153105] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-01T22:25:55.154501] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-01T22:25:55.154618] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-01T22:25:55.156555] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53671 (keeping 200 days of data) [2025-10-01T22:25:55.349735] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-01T22:25:55.527570] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-10-01T22:25:55.528432] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-01T22:25:55.528706] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMB took 29.6s. Estimated remaining: 9m 11s. Rate: 7.1 symbols/min [2025-10-01T22:25:55.730518] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:55.786825] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-01T22:25:55.787237] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-01T22:25:55.988373] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:55.988615] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-01T22:25:55.988697] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-01T22:25:55.989859] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-01T22:25:55.989921] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-01T22:25:56.082335] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-01T22:25:56.104257] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-01T22:25:56.110553] [INFO ] [REMOTE ] WMK: Full fetch complete (19594 records). [2025-10-01T22:25:56.110969] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-01T22:25:56.670448] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:56.843113] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-01T22:25:56.843230] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-01T22:25:56.843901] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-01T22:25:56.844027] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-01T22:25:56.845110] [DEBUG] [LOCAL ] WMK: Trimmed 19594 records to 14515 (keeping 200 days of data) [2025-10-01T22:25:56.912524] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-01T22:25:56.979125] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:25:57.002926] [DEBUG] [LOCAL ] WMK: Primary data saved (14515 records). [2025-10-01T22:25:57.003071] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-01T22:25:57.003181] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMK took 24.4s. Estimated remaining: 9m 2s. Rate: 7.1 symbols/min [2025-10-01T22:25:57.220769] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:57.264097] [DEBUG] [LOCAL ] WNC: Loaded 39463 existing records from primary storage. [2025-10-01T22:25:57.264408] [INFO ] [MAIN ] WNC: Loaded 39463 existing records. [2025-10-01T22:25:57.466377] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:57.466598] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-01T22:25:57.466676] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-01T22:25:57.468254] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-01T22:25:57.468332] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-01T22:25:57.707550] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-01T22:25:57.895871] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:57.956454] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-01T22:25:57.958117] [INFO ] [REMOTE ] WM: Full fetch complete (73764 records). [2025-10-01T22:25:57.958225] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-01T22:25:58.396530] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-01T22:25:58.396619] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-01T22:25:58.397886] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-01T22:25:58.397953] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-01T22:25:58.399450] [DEBUG] [LOCAL ] WM: Trimmed 73764 records to 50913 (keeping 200 days of data) [2025-10-01T22:25:58.502839] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-01T22:25:58.757277] [DEBUG] [LOCAL ] WM: Primary data saved (50913 records). [2025-10-01T22:25:58.757424] [INFO ] [MAIN ] WM: Full history saved. [2025-10-01T22:25:58.757561] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WM took 40.9s. Estimated remaining: 8m 54s. Rate: 7.1 symbols/min [2025-10-01T22:25:58.949679] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:25:58.990458] [DEBUG] [LOCAL ] WNS: Loaded 40001 existing records from primary storage. [2025-10-01T22:25:58.990808] [INFO ] [MAIN ] WNS: Loaded 40001 existing records. [2025-10-01T22:25:59.196670] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:25:59.197019] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-01T22:25:59.197079] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-01T22:25:59.198020] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-01T22:25:59.198103] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-01T22:25:59.306765] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-01T22:25:59.656003] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:25:59.728504] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-10-01T22:25:59.741967] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-01T22:26:00.102425] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-01T22:26:00.746105] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-01T22:26:00.902390] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-01T22:26:01.702505] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-01T22:26:02.179593] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-01T22:26:02.413242] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T22:26:02.502448] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-01T22:26:03.297188] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T22:26:03.306140] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-01T22:26:03.787004] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-01T22:26:04.102387] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-01T22:26:04.902435] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-01T22:26:05.479205] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-01T22:26:05.535191] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-01T22:26:05.702400] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-01T22:26:06.426043] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-01T22:26:06.502428] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-01T22:26:06.994814] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-01T22:26:07.302383] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-01T22:26:07.885294] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-01T22:26:08.102419] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-01T22:26:08.902382] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-01T22:26:08.939812] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T22:26:09.702388] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-01T22:26:10.439675] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-01T22:26:10.480193] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-01T22:26:10.502342] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-01T22:26:11.203927] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T22:26:11.302415] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-01T22:26:12.103450] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-01T22:26:12.111100] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T22:26:12.902388] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-01T22:26:13.326483] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-01T22:26:13.702363] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-01T22:26:13.797771] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-01T22:26:13.884543] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-01T22:26:14.002346] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:26:14.004235] [INFO ] [REMOTE ] WMS: Full fetch complete (57261 records). [2025-10-01T22:26:14.004428] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-01T22:26:14.456876] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-01T22:26:14.456979] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-01T22:26:14.458131] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-01T22:26:14.458201] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-01T22:26:14.459526] [DEBUG] [LOCAL ] WMS: Trimmed 57261 records to 39561 (keeping 200 days of data) [2025-10-01T22:26:14.520857] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-01T22:26:14.737550] [DEBUG] [LOCAL ] WMS: Primary data saved (39561 records). [2025-10-01T22:26:14.737801] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-01T22:26:14.738003] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMS took 38.5s. Estimated remaining: 8m 46s. Rate: 7.1 symbols/min [2025-10-01T22:26:14.933606] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:26:14.991903] [DEBUG] [LOCAL ] WOLF: Loaded 53184 existing records from primary storage. [2025-10-01T22:26:14.992326] [INFO ] [MAIN ] WOLF: Loaded 53184 existing records. [2025-10-01T22:26:15.191775] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:26:15.192047] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-01T22:26:15.192107] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-01T22:26:15.193276] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-01T22:26:15.193360] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-01T22:26:15.309712] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-01T22:26:15.608619] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:26:16.102435] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-01T22:26:16.875611] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T22:26:16.902362] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-01T22:26:16.941933] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-01T22:26:17.702434] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-01T22:26:18.228876] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-01T22:26:18.430309] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-01T22:26:18.502431] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-01T22:26:19.302399] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-01T22:26:19.781389] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-01T22:26:19.830143] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-01T22:26:20.102427] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-01T22:26:20.902397] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-01T22:26:21.616693] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-01T22:26:21.702401] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-01T22:26:21.765309] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T22:26:22.373628] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T22:26:22.502422] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-01T22:26:23.302409] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-01T22:26:23.746665] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-01T22:26:23.929182] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T22:26:24.102439] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-01T22:26:24.435722] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-01T22:26:24.902384] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-01T22:26:25.702421] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-01T22:26:26.430577] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T22:26:26.502377] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-01T22:26:27.126904] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-01T22:26:27.302393] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-01T22:26:27.908956] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-01T22:26:28.102353] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-01T22:26:28.902369] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-01T22:26:29.748874] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T22:26:29.750722] [INFO ] [REMOTE ] WNS: Full fetch complete (54926 records). [2025-10-01T22:26:29.750897] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-01T22:26:29.996380] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (5.89 seconds). [2025-10-01T22:26:30.104721] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-01T22:26:30.250944] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-01T22:26:30.251124] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-01T22:26:30.252263] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-01T22:26:30.252350] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-01T22:26:30.288701] [DEBUG] [LOCAL ] WNS: Trimmed 54926 records to 39903 (keeping 200 days of data) [2025-10-01T22:26:30.290015] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-01T22:26:30.518292] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-01T22:26:30.558621] [DEBUG] [LOCAL ] WNS: Primary data saved (39903 records). [2025-10-01T22:26:30.558798] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-01T22:26:30.558911] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNS took 31.8s. Estimated remaining: 8m 37s. Rate: 7.1 symbols/min [2025-10-01T22:26:30.770730] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:26:30.799682] [DEBUG] [LOCAL ] WOR: Loaded 24907 existing records from primary storage. [2025-10-01T22:26:30.800026] [INFO ] [MAIN ] WOR: Loaded 24907 existing records. [2025-10-01T22:26:31.006760] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:26:31.007079] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-01T22:26:31.007143] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-01T22:26:31.007811] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-01T22:26:31.007883] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-01T22:26:31.156683] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-10-01T22:26:31.307540] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-01T22:26:31.468391] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:26:31.668013] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-01T22:26:31.669390] [INFO ] [REMOTE ] WNC: Full fetch complete (57534 records). [2025-10-01T22:26:31.669479] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-01T22:26:32.099705] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-01T22:26:32.099859] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-01T22:26:32.101141] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-01T22:26:32.101328] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-01T22:26:32.102376] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-01T22:26:32.104076] [DEBUG] [LOCAL ] WNC: Trimmed 57534 records to 39363 (keeping 200 days of data) [2025-10-01T22:26:32.359233] [DEBUG] [LOCAL ] WNC: Primary data saved (39363 records). [2025-10-01T22:26:32.359573] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-01T22:26:32.359749] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNC took 35.4s. Estimated remaining: 8m 29s. Rate: 7.1 symbols/min [2025-10-01T22:26:32.485458] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-01T22:26:32.596311] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:26:32.628353] [DEBUG] [LOCAL ] WOW: Loaded 30470 existing records from primary storage. [2025-10-01T22:26:32.628636] [INFO ] [MAIN ] WOW: Loaded 30470 existing records. [2025-10-01T22:26:32.828776] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:26:32.829024] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-01T22:26:32.829084] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-01T22:26:32.829927] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-01T22:26:32.829989] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-01T22:26:32.912618] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-01T22:26:33.243673] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:26:33.258945] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-01T22:26:33.301191] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-10-01T22:26:33.702440] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-01T22:26:34.502429] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-01T22:26:35.302441] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-01T22:26:35.453084] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-01T22:26:35.740412] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-01T22:26:35.872470] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-01T22:26:35.904804] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-01T22:26:36.102454] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-01T22:26:36.902443] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-01T22:26:37.702370] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-01T22:26:37.741559] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T22:26:37.991457] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:26:37.993147] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-01T22:26:37.993288] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-01T22:26:38.446954] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-01T22:26:38.447130] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-01T22:26:38.448562] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-01T22:26:38.448679] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-01T22:26:38.482258] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-01T22:26:38.493149] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-10-01T22:26:38.553422] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-01T22:26:38.854970] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-01T22:26:38.855118] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-01T22:26:38.855233] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WMT took 43.3s. Estimated remaining: 8m 20s. Rate: 7.1 symbols/min [2025-10-01T22:26:39.050027] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:26:39.096342] [DEBUG] [LOCAL ] WPC: Loaded 48369 existing records from primary storage. [2025-10-01T22:26:39.096698] [INFO ] [MAIN ] WPC: Loaded 48369 existing records. [2025-10-01T22:26:39.292721] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:26:39.292955] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-01T22:26:39.293071] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-01T22:26:39.294330] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-01T22:26:39.294391] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-01T22:26:39.307797] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-01T22:26:39.696695] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:26:39.834468] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-01T22:26:40.102428] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-01T22:26:40.902380] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-01T22:26:41.702349] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-01T22:26:41.816831] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-01T22:26:41.905022] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-01T22:26:42.191956] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T22:26:42.459277] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-01T22:26:42.502358] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-01T22:26:43.302386] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-01T22:26:44.102433] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-01T22:26:44.291244] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T22:26:44.640747] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-01T22:26:44.902448] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-01T22:26:45.702404] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-01T22:26:46.277903] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-01T22:26:46.502362] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-01T22:26:46.533760] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-01T22:26:46.569010] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T22:26:46.879802] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-01T22:26:47.302423] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-01T22:26:48.102386] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-01T22:26:48.902360] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-01T22:26:49.097879] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T22:26:49.250480] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-01T22:26:49.702402] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-01T22:26:49.998899] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:26:50.000481] [INFO ] [REMOTE ] WOLF: Full fetch complete (77252 records). [2025-10-01T22:26:50.000598] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-01T22:26:50.439677] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T22:26:50.472871] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-01T22:26:50.473005] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-01T22:26:50.474630] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-01T22:26:50.474734] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-01T22:26:50.476510] [DEBUG] [LOCAL ] WOLF: Trimmed 77252 records to 53184 (keeping 200 days of data) [2025-10-01T22:26:50.524075] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-01T22:26:50.805878] [DEBUG] [LOCAL ] WOLF: Primary data saved (53184 records). [2025-10-01T22:26:50.806030] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-01T22:26:50.806114] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 36.1s. Estimated remaining: 8m 12s. Rate: 7.1 symbols/min [2025-10-01T22:26:50.993008] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:26:51.050408] [DEBUG] [LOCAL ] WPM: Loaded 52725 existing records from primary storage. [2025-10-01T22:26:51.050812] [INFO ] [MAIN ] WPM: Loaded 52725 existing records. [2025-10-01T22:26:51.256264] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:26:51.256501] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-01T22:26:51.256551] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-01T22:26:51.258114] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-01T22:26:51.258178] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-01T22:26:51.306974] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-01T22:26:51.670815] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:26:51.709563] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T22:26:52.102404] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-01T22:26:52.233313] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-01T22:26:52.902410] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-01T22:26:53.598144] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T22:26:53.702412] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-01T22:26:54.162122] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-01T22:26:54.502419] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-01T22:26:54.941172] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-01T22:26:55.302407] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-01T22:26:55.518199] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-01T22:26:56.102382] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-01T22:26:56.711498] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-01T22:26:56.906009] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-01T22:26:56.912684] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-01T22:26:57.702407] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-01T22:26:57.966830] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-01T22:26:57.967950] [INFO ] [REMOTE ] WOR: Full fetch complete (36591 records). [2025-10-01T22:26:57.968061] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-01T22:26:58.385893] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-01T22:26:58.385976] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-01T22:26:58.386749] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-01T22:26:58.386814] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-01T22:26:58.387871] [DEBUG] [LOCAL ] WOR: Trimmed 36591 records to 24902 (keeping 200 days of data) [2025-10-01T22:26:58.502681] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-01T22:26:58.554368] [DEBUG] [LOCAL ] WOR: Primary data saved (24902 records). [2025-10-01T22:26:58.554513] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-01T22:26:58.554607] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOR took 28.0s. Estimated remaining: 8m 3s. Rate: 7.1 symbols/min [2025-10-01T22:26:58.739888] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:26:58.772599] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-01T22:26:58.812161] [DEBUG] [LOCAL ] WPP: Loaded 33932 existing records from primary storage. [2025-10-01T22:26:58.812457] [INFO ] [MAIN ] WPP: Loaded 33932 existing records. [2025-10-01T22:26:59.016236] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:26:59.016483] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-01T22:26:59.016535] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-01T22:26:59.017277] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-01T22:26:59.017350] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-01T22:26:59.307458] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-01T22:26:59.413760] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:26:59.806283] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-01T22:27:00.102392] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-01T22:27:00.759931] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-01T22:27:00.902393] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-01T22:27:01.015982] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-01T22:27:01.702403] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-01T22:27:02.502360] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-01T22:27:02.686937] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-01T22:27:02.865833] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-01T22:27:03.302370] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-01T22:27:03.903104] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-01T22:27:04.102402] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-01T22:27:04.902358] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-01T22:27:05.265079] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T22:27:05.702371] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-01T22:27:06.265496] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (2.96 seconds). [2025-10-01T22:27:06.502390] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-01T22:27:06.769533] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T22:27:07.127973] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-01T22:27:07.302383] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-01T22:27:08.098805] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-01T22:27:08.109957] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-01T22:27:08.902419] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-01T22:27:09.023895] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T22:27:09.586161] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-01T22:27:09.702375] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-01T22:27:10.502382] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-01T22:27:10.605995] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-01T22:27:11.070095] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-01T22:27:11.302393] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-01T22:27:11.423943] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-01T22:27:11.425075] [INFO ] [REMOTE ] WOW: Full fetch complete (42144 records). [2025-10-01T22:27:11.425188] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-01T22:27:11.841824] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-01T22:27:11.841912] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-01T22:27:11.842909] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-01T22:27:11.842976] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-01T22:27:11.843974] [DEBUG] [LOCAL ] WOW: Trimmed 42144 records to 30384 (keeping 200 days of data) [2025-10-01T22:27:12.017059] [DEBUG] [LOCAL ] WOW: Primary data saved (30384 records). [2025-10-01T22:27:12.017205] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-01T22:27:12.017325] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOW took 39.6s. Estimated remaining: 7m 55s. Rate: 7.1 symbols/min [2025-10-01T22:27:12.107562] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-01T22:27:12.202714] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:27:12.250966] [DEBUG] [LOCAL ] WRB: Loaded 50558 existing records from primary storage. [2025-10-01T22:27:12.251348] [INFO ] [MAIN ] WRB: Loaded 50558 existing records. [2025-10-01T22:27:12.461023] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:27:12.461444] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-01T22:27:12.461514] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-01T22:27:12.463181] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-01T22:27:12.463243] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-01T22:27:12.877800] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-01T22:27:12.903122] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-01T22:27:12.929613] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:27:13.708159] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-01T22:27:13.721039] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-01T22:27:14.127543] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-01T22:27:14.502423] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-01T22:27:15.302360] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-01T22:27:15.405261] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-01T22:27:15.442703] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-01T22:27:15.444329] [INFO ] [REMOTE ] WPC: Full fetch complete (70765 records). [2025-10-01T22:27:15.444501] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-01T22:27:15.885426] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-01T22:27:15.885666] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-01T22:27:15.886950] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-01T22:27:15.887038] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-01T22:27:15.888742] [DEBUG] [LOCAL ] WPC: Trimmed 70765 records to 48374 (keeping 200 days of data) [2025-10-01T22:27:16.122077] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-01T22:27:16.238553] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-01T22:27:16.264244] [DEBUG] [LOCAL ] WPC: Primary data saved (48374 records). [2025-10-01T22:27:16.264878] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-01T22:27:16.264993] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPC took 37.4s. Estimated remaining: 7m 46s. Rate: 7.1 symbols/min [2025-10-01T22:27:16.460357] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:27:16.519164] [DEBUG] [LOCAL ] WRBY: Loaded 50792 existing records from primary storage. [2025-10-01T22:27:16.519510] [INFO ] [MAIN ] WRBY: Loaded 50792 existing records. [2025-10-01T22:27:16.723385] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:27:16.723700] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-01T22:27:16.723760] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-01T22:27:16.725441] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-01T22:27:16.725505] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-01T22:27:16.912469] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-01T22:27:17.132350] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:27:17.702395] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-01T22:27:17.927401] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-01T22:27:18.502366] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-01T22:27:18.658202] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-01T22:27:19.302382] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-01T22:27:19.362278] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T22:27:20.107505] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-01T22:27:20.126283] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T22:27:20.890417] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-01T22:27:20.902352] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-01T22:27:21.424979] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T22:27:21.702407] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-01T22:27:22.502376] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-01T22:27:23.302389] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-01T22:27:23.457997] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T22:27:23.576211] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-01T22:27:23.638488] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-01T22:27:24.102398] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-01T22:27:24.804146] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T22:27:24.902421] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-01T22:27:25.702376] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-01T22:27:25.768500] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-01T22:27:26.502422] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-01T22:27:26.659872] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-01T22:27:27.266239] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-01T22:27:27.302354] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-01T22:27:28.102393] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-01T22:27:28.252375] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T22:27:28.902386] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-01T22:27:29.182157] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-01T22:27:29.702381] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-01T22:27:29.834443] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T22:27:29.905874] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T22:27:29.910112] [INFO ] [REMOTE ] WPP: Full fetch complete (45560 records). [2025-10-01T22:27:29.910300] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-01T22:27:30.336703] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-01T22:27:30.336828] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-01T22:27:30.337890] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-01T22:27:30.337956] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-01T22:27:30.339232] [DEBUG] [LOCAL ] WPP: Trimmed 45560 records to 33916 (keeping 200 days of data) [2025-10-01T22:27:30.525468] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-01T22:27:30.592321] [DEBUG] [LOCAL ] WPP: Primary data saved (33916 records). [2025-10-01T22:27:30.592532] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-01T22:27:30.592689] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPP took 32.0s. Estimated remaining: 7m 38s. Rate: 7.1 symbols/min [2025-10-01T22:27:31.199245] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-01T22:27:31.302391] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-01T22:27:32.020694] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-01T22:27:32.023410] [INFO ] [REMOTE ] WPM: Full fetch complete (75909 records). [2025-10-01T22:27:32.023535] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-01T22:27:32.108954] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-01T22:27:32.464566] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-01T22:27:32.464713] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-01T22:27:32.466039] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-01T22:27:32.466112] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-01T22:27:32.467744] [DEBUG] [LOCAL ] WPM: Trimmed 75909 records to 52726 (keeping 200 days of data) [2025-10-01T22:27:32.855589] [DEBUG] [LOCAL ] WPM: Primary data saved (52726 records). [2025-10-01T22:27:32.855783] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-01T22:27:32.855926] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPM took 42.0s. Estimated remaining: 7m 29s. Rate: 7.1 symbols/min [2025-10-01T22:27:32.992902] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-01T22:27:33.004498] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-01T22:27:33.968905] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-01T22:27:33.980573] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-01T22:27:34.876789] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-01T22:27:34.888614] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-01T22:27:35.703970] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-01T22:27:35.714966] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-01T22:27:36.625042] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-01T22:27:36.636386] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-01T22:27:37.424118] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-01T22:27:37.437735] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-01T22:27:37.499105] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T22:27:37.702378] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-01T22:27:37.782974] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-01T22:27:37.784691] [INFO ] [REMOTE ] WRB: Full fetch complete (73322 records). [2025-10-01T22:27:37.784805] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-01T22:27:38.247860] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-01T22:27:38.248206] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-01T22:27:38.249558] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-01T22:27:38.249631] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-01T22:27:38.251203] [DEBUG] [LOCAL ] WRB: Trimmed 73322 records to 50568 (keeping 200 days of data) [2025-10-01T22:27:38.614261] [DEBUG] [LOCAL ] WRB: Primary data saved (50568 records). [2025-10-01T22:27:38.614441] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-01T22:27:38.614605] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 26.6s. Estimated remaining: 7m 21s. Rate: 7.1 symbols/min [2025-10-01T22:27:39.198879] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-01T22:27:39.210392] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-01T22:27:41.040692] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-01T22:27:41.051860] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-01T22:27:42.357155] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-01T22:27:42.359154] [INFO ] [REMOTE ] WRBY: Full fetch complete (73426 records). [2025-10-01T22:27:42.359277] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-01T22:27:42.795394] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-01T22:27:42.795494] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-01T22:27:42.796774] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-01T22:27:42.796844] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-01T22:27:42.799093] [DEBUG] [LOCAL ] WRBY: Trimmed 73426 records to 50766 (keeping 200 days of data) [2025-10-01T22:27:43.120136] [DEBUG] [LOCAL ] WRBY: Primary data saved (50766 records). [2025-10-01T22:27:43.120302] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-01T22:27:43.120396] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 26.9s. Estimated remaining: 7m 12s. Rate: 7.1 symbols/min [2025-10-01T22:27:43.726442] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:27:43.902575] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:27:43.934338] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:27:43.988976] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:27:44.008782] [DEBUG] [LOCAL ] WS: Loaded 24022 existing records from primary storage. [2025-10-01T22:27:44.009258] [INFO ] [MAIN ] WS: Loaded 24022 existing records. [2025-10-01T22:27:44.175489] [DEBUG] [LOCAL ] WSR: Loaded 23021 existing records from primary storage. [2025-10-01T22:27:44.176513] [DEBUG] [LOCAL ] WSO: Loaded 24617 existing records from primary storage. [2025-10-01T22:27:44.195669] [INFO ] [MAIN ] WSR: Loaded 23021 existing records. [2025-10-01T22:27:44.246440] [INFO ] [MAIN ] WSO: Loaded 24617 existing records. [2025-10-01T22:27:44.537977] [DEBUG] [LOCAL ] WSM: Loaded 49690 existing records from primary storage. [2025-10-01T22:27:44.531301] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:27:44.567313] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-01T22:27:44.581289] [INFO ] [MAIN ] WSM: Loaded 49690 existing records. [2025-10-01T22:27:44.597374] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-01T22:27:44.747894] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-01T22:27:44.816012] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:27:44.857034] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-01T22:27:44.873624] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:27:44.856781] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-01T22:27:44.889692] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-01T22:27:44.889599] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-01T22:27:44.926758] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-01T22:27:44.916040] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-01T22:27:44.959710] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-01T22:27:45.061530] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-01T22:27:45.174757] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-01T22:27:45.194354] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:27:45.216294] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-01T22:27:45.417111] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-01T22:27:45.546723] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-01T22:27:45.621782] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-01T22:27:46.221271] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:27:46.243423] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-01T22:27:46.585725] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:27:46.662285] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:27:46.668421] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-01T22:27:46.673858] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-01T22:27:46.754468] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:27:46.754933] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-01T22:27:47.721443] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-01T22:27:47.727939] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-01T22:27:47.852363] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-01T22:27:47.856838] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-01T22:27:48.092977] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-01T22:27:48.098535] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-01T22:27:48.591228] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T22:27:48.605558] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-01T22:27:48.635807] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-01T22:27:48.641789] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-01T22:27:48.981128] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T22:27:48.985881] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-01T22:27:49.209450] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-01T22:27:49.215417] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-01T22:27:49.803898] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T22:27:49.809952] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-01T22:27:50.158308] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-01T22:27:50.169181] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-01T22:27:50.204622] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T22:27:50.278869] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T22:27:50.502383] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-01T22:27:51.102755] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-01T22:27:51.302444] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-01T22:27:51.591041] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-01T22:27:51.680418] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-01T22:27:52.102481] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-01T22:27:52.441274] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-01T22:27:52.902421] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-01T22:27:53.604507] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-01T22:27:53.702390] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-01T22:27:54.032392] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-01T22:27:54.502398] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-01T22:27:55.302367] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-01T22:27:55.584034] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-01T22:27:55.642495] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-01T22:27:56.102389] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-01T22:27:56.455695] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T22:27:56.902352] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-01T22:27:57.068029] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-01T22:27:57.702371] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-01T22:27:58.502388] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-01T22:27:58.796108] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-01T22:27:58.881188] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T22:27:59.302404] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-01T22:27:59.370996] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-01T22:28:00.102409] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-01T22:28:00.157737] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-01T22:28:00.902388] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-01T22:28:01.702382] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-01T22:28:01.947630] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T22:28:02.278711] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-01T22:28:02.302570] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-01T22:28:02.502378] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-01T22:28:03.302378] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-01T22:28:03.602152] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:28:03.603461] [INFO ] [REMOTE ] WS: Full fetch complete (36642 records). [2025-10-01T22:28:03.603567] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-01T22:28:04.038601] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-01T22:28:04.038727] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-01T22:28:04.039593] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-01T22:28:04.039668] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-01T22:28:04.040732] [DEBUG] [LOCAL ] WS: Trimmed 36642 records to 24026 (keeping 200 days of data) [2025-10-01T22:28:04.106788] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-01T22:28:04.203671] [DEBUG] [LOCAL ] WS: Primary data saved (24026 records). [2025-10-01T22:28:04.203818] [INFO ] [MAIN ] WS: Full history saved. [2025-10-01T22:28:04.203928] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WS took 21.1s. Estimated remaining: 7m 4s. Rate: 7.1 symbols/min [2025-10-01T22:28:04.401134] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:04.433457] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-01T22:28:04.484346] [DEBUG] [LOCAL ] WST: Loaded 37284 existing records from primary storage. [2025-10-01T22:28:04.484717] [INFO ] [MAIN ] WST: Loaded 37284 existing records. [2025-10-01T22:28:04.698374] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:28:04.698627] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-01T22:28:04.698724] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-01T22:28:04.699916] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-01T22:28:04.700002] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-01T22:28:04.908160] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-01T22:28:05.165451] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:05.279967] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-01T22:28:05.702385] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-01T22:28:06.502380] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-01T22:28:06.678677] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-01T22:28:07.128026] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T22:28:07.302377] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-01T22:28:07.595359] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-01T22:28:08.102371] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-01T22:28:08.415039] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-01T22:28:08.902346] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-01T22:28:09.538997] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-01T22:28:09.702399] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-01T22:28:10.076403] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T22:28:10.451712] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T22:28:10.502350] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-01T22:28:10.803612] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:28:10.805838] [INFO ] [REMOTE ] WSM: Full fetch complete (71981 records). [2025-10-01T22:28:10.805954] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-01T22:28:11.251774] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-01T22:28:11.251875] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-01T22:28:11.253041] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-01T22:28:11.253109] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-01T22:28:11.254598] [DEBUG] [LOCAL ] WSM: Trimmed 71981 records to 49645 (keeping 200 days of data) [2025-10-01T22:28:11.314729] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-01T22:28:11.588632] [DEBUG] [LOCAL ] WSM: Primary data saved (49645 records). [2025-10-01T22:28:11.588815] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-01T22:28:11.590857] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSM took 28.5s. Estimated remaining: 6m 55s. Rate: 7.1 symbols/min [2025-10-01T22:28:11.786251] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:11.839394] [DEBUG] [LOCAL ] WT: Loaded 47662 existing records from primary storage. [2025-10-01T22:28:11.839805] [INFO ] [MAIN ] WT: Loaded 47662 existing records. [2025-10-01T22:28:12.039912] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:28:12.040163] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-01T22:28:12.040221] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-01T22:28:12.041310] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-01T22:28:12.041390] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-01T22:28:12.109181] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-01T22:28:12.440361] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:12.734328] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-01T22:28:12.902347] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-01T22:28:13.305005] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-01T22:28:13.702408] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-01T22:28:14.502350] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-01T22:28:14.541072] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-01T22:28:15.018533] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-01T22:28:15.204215] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-01T22:28:15.302400] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-01T22:28:15.596961] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:28:15.598369] [INFO ] [REMOTE ] WSO: Full fetch complete (34515 records). [2025-10-01T22:28:15.598478] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-01T22:28:16.043427] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-01T22:28:16.043510] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-01T22:28:16.044340] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-01T22:28:16.044407] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-01T22:28:16.045605] [DEBUG] [LOCAL ] WSO: Trimmed 34515 records to 24720 (keeping 200 days of data) [2025-10-01T22:28:16.110951] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-01T22:28:16.219818] [DEBUG] [LOCAL ] WSO: Primary data saved (24720 records). [2025-10-01T22:28:16.219953] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-01T22:28:16.220056] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSO took 33.0s. Estimated remaining: 6m 47s. Rate: 7.1 symbols/min [2025-10-01T22:28:16.461143] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:16.509913] [DEBUG] [LOCAL ] WTI: Loaded 43900 existing records from primary storage. [2025-10-01T22:28:16.510264] [INFO ] [MAIN ] WTI: Loaded 43900 existing records. [2025-10-01T22:28:16.718579] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:28:16.718825] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-01T22:28:16.718874] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-01T22:28:16.719723] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-01T22:28:16.719786] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-01T22:28:16.921636] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-01T22:28:17.188564] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:17.702476] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-01T22:28:17.993931] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T22:28:18.502433] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-01T22:28:18.716793] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-01T22:28:19.302357] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-01T22:28:19.526033] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-01T22:28:19.549214] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-01T22:28:20.102415] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-01T22:28:20.515775] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-01T22:28:20.894908] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-01T22:28:20.903667] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-01T22:28:21.702401] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-01T22:28:22.502375] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-01T22:28:22.536594] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-01T22:28:23.302367] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-01T22:28:23.386219] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-01T22:28:24.102374] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-01T22:28:24.224042] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T22:28:24.479747] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-01T22:28:24.480756] [INFO ] [REMOTE ] WSR: Full fetch complete (32794 records). [2025-10-01T22:28:24.480833] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-01T22:28:24.925904] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-01T22:28:24.956144] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T22:28:24.964847] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-01T22:28:24.965209] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-01T22:28:24.966467] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-01T22:28:24.966564] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-01T22:28:24.967975] [DEBUG] [LOCAL ] WSR: Trimmed 32794 records to 23003 (keeping 200 days of data) [2025-10-01T22:28:25.119624] [DEBUG] [LOCAL ] WSR: Primary data saved (23003 records). [2025-10-01T22:28:25.119776] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-01T22:28:25.119875] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSR took 42.0s. Estimated remaining: 6m 38s. Rate: 7.1 symbols/min [2025-10-01T22:28:25.306560] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:25.306768] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-01T22:28:25.306815] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-01T22:28:25.306960] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-01T22:28:25.307003] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-01T22:28:25.307047] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-01T22:28:25.307082] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-01T22:28:25.703023] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:25.703094] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-01T22:28:26.502421] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-01T22:28:26.642550] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T22:28:26.888445] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-01T22:28:27.302427] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-01T22:28:28.102395] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-01T22:28:28.235421] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-01T22:28:28.502523] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-01T22:28:28.902510] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-01T22:28:29.004706] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T22:28:29.702406] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-01T22:28:30.402408] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-01T22:28:30.502434] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-01T22:28:30.942770] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-01T22:28:31.309145] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-01T22:28:31.337000] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-01T22:28:32.102406] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-01T22:28:32.519350] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-01T22:28:32.902359] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-01T22:28:33.083018] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-01T22:28:33.307593] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-01T22:28:33.702461] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-01T22:28:34.502431] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-01T22:28:35.159329] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-01T22:28:35.184404] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-01T22:28:35.302459] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-01T22:28:35.705449] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-01T22:28:36.102381] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-01T22:28:36.574751] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-01T22:28:36.902411] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-01T22:28:37.285974] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-01T22:28:37.702426] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-01T22:28:38.502415] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-01T22:28:39.302352] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-01T22:28:39.480013] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-01T22:28:40.102366] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-01T22:28:40.422311] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-01T22:28:40.902430] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-01T22:28:40.997926] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T22:28:41.332549] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-01T22:28:41.498959] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-01T22:28:41.702391] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-01T22:28:42.502397] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-01T22:28:43.041943] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-01T22:28:43.302452] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-01T22:28:43.419186] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-01T22:28:44.102413] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-01T22:28:44.859586] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T22:28:44.902442] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-01T22:28:45.001475] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-01T22:28:45.549021] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-01T22:28:45.702453] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-01T22:28:46.502420] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-01T22:28:46.801460] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:28:46.803169] [INFO ] [REMOTE ] WST: Full fetch complete (53906 records). [2025-10-01T22:28:46.803283] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-01T22:28:47.279899] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-01T22:28:47.280069] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-01T22:28:47.281236] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-01T22:28:47.289490] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-01T22:28:47.304348] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-01T22:28:47.307964] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-01T22:28:47.317859] [DEBUG] [LOCAL ] WST: Trimmed 53906 records to 37243 (keeping 200 days of data) [2025-10-01T22:28:47.589918] [DEBUG] [LOCAL ] WST: Primary data saved (37243 records). [2025-10-01T22:28:47.590337] [INFO ] [MAIN ] WST: Full history saved. [2025-10-01T22:28:47.590502] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 43.4s. Estimated remaining: 6m 30s. Rate: 7.1 symbols/min [2025-10-01T22:28:47.707600] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-01T22:28:47.753239] [INFO ] [REMOTE ] WT: Full fetch complete (69186 records). [2025-10-01T22:28:47.767744] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-01T22:28:47.791261] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:48.111201] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-01T22:28:48.200253] [DEBUG] [LOCAL ] WTRG: Loaded 50892 existing records from primary storage. [2025-10-01T22:28:48.233406] [INFO ] [MAIN ] WTRG: Loaded 50892 existing records. [2025-10-01T22:28:48.337185] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-01T22:28:48.365724] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-01T22:28:48.391045] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-01T22:28:48.404128] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-01T22:28:48.468913] [DEBUG] [LOCAL ] WT: Trimmed 69186 records to 47693 (keeping 200 days of data) [2025-10-01T22:28:48.493428] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:28:48.493695] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-01T22:28:48.493756] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-01T22:28:48.496331] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-01T22:28:48.496395] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-01T22:28:48.697312] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-01T22:28:48.703868] [INFO ] [REMOTE ] WTM: Full fetch complete (2381 records). [2025-10-01T22:28:48.705265] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-01T22:28:48.903062] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-01T22:28:49.106373] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-01T22:28:49.125560] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-01T22:28:49.126345] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-01T22:28:49.139470] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-01T22:28:49.139616] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-01T22:28:49.151835] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-01T22:28:49.151981] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-01T22:28:49.152425] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WTM took 24.0s. Estimated remaining: 6m 22s. Rate: 7.1 symbols/min [2025-10-01T22:28:49.332977] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:49.450012] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:49.530594] [DEBUG] [LOCAL ] WTS: Loaded 18197 existing records from primary storage. [2025-10-01T22:28:49.573379] [INFO ] [MAIN ] WTS: Loaded 18197 existing records. [2025-10-01T22:28:49.706056] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-01T22:28:49.807712] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:28:49.808726] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-01T22:28:49.808819] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-01T22:28:49.809678] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-01T22:28:49.810027] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-01T22:28:50.259861] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:50.313485] [DEBUG] [LOCAL ] WT: Primary data saved (47693 records). [2025-10-01T22:28:50.313625] [INFO ] [MAIN ] WT: Full history saved. [2025-10-01T22:28:50.313742] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WT took 38.7s. Estimated remaining: 6m 13s. Rate: 7.1 symbols/min [2025-10-01T22:28:50.512622] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:50.508179] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-01T22:28:50.558858] [DEBUG] [LOCAL ] WTTR: Loaded 44935 existing records from primary storage. [2025-10-01T22:28:50.559182] [INFO ] [MAIN ] WTTR: Loaded 44935 existing records. [2025-10-01T22:28:50.775886] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-01T22:28:50.809874] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:28:50.810402] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-01T22:28:50.810586] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-01T22:28:50.811829] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-01T22:28:50.811898] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-01T22:28:51.254590] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:51.302378] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-01T22:28:51.364101] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-01T22:28:51.425832] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-01T22:28:52.102383] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-01T22:28:52.431746] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-01T22:28:52.433336] [INFO ] [REMOTE ] WTI: Full fetch complete (64172 records). [2025-10-01T22:28:52.433522] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-01T22:28:52.904850] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-01T22:28:52.904456] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-01T22:28:52.905062] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-01T22:28:52.907825] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-01T22:28:52.908006] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-01T22:28:52.910855] [DEBUG] [LOCAL ] WTI: Trimmed 64172 records to 43964 (keeping 200 days of data) [2025-10-01T22:28:53.176868] [DEBUG] [LOCAL ] WTI: Primary data saved (43964 records). [2025-10-01T22:28:53.177016] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-01T22:28:53.177122] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTI took 37.0s. Estimated remaining: 6m 4s. Rate: 7.1 symbols/min [2025-10-01T22:28:53.376514] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:28:53.431365] [DEBUG] [LOCAL ] WU: Loaded 53452 existing records from primary storage. [2025-10-01T22:28:53.431774] [INFO ] [MAIN ] WU: Loaded 53452 existing records. [2025-10-01T22:28:53.663404] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:28:53.663843] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-01T22:28:53.664018] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-01T22:28:53.665707] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-01T22:28:53.665931] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-01T22:28:53.710938] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-01T22:28:53.779935] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T22:28:54.133264] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-01T22:28:54.139787] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:28:54.502429] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-01T22:28:55.302363] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-01T22:28:55.535603] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-01T22:28:55.595569] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-01T22:28:56.102398] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-01T22:28:56.902356] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-01T22:28:57.100691] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-01T22:28:57.422155] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-01T22:28:57.702394] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-01T22:28:58.004195] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-01T22:28:58.502378] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-01T22:28:59.302384] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-01T22:28:59.517029] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-01T22:29:00.102393] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-01T22:29:00.227306] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-01T22:29:00.902384] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-01T22:29:00.962798] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-01T22:29:01.111182] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-01T22:29:01.702394] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-01T22:29:02.123275] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T22:29:02.502384] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-01T22:29:03.302367] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-01T22:29:03.419661] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-01T22:29:03.590074] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-01T22:29:04.102457] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-01T22:29:04.902408] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-01T22:29:05.093444] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-01T22:29:05.103897] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-01T22:29:05.702433] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-01T22:29:06.502414] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-01T22:29:06.682521] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-01T22:29:06.884898] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-01T22:29:07.302401] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-01T22:29:08.102424] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-01T22:29:08.385345] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-01T22:29:08.868782] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T22:29:08.902425] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-01T22:29:09.170906] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-01T22:29:09.702389] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-01T22:29:10.108982] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-01T22:29:10.128072] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-01T22:29:10.502419] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-01T22:29:10.709953] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-01T22:29:10.711458] [INFO ] [REMOTE ] WTS: Full fetch complete (26132 records). [2025-10-01T22:29:10.711546] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-01T22:29:11.127012] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-01T22:29:11.127096] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-01T22:29:11.127674] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-01T22:29:11.127738] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-01T22:29:11.128463] [DEBUG] [LOCAL ] WTS: Trimmed 26132 records to 18134 (keeping 200 days of data) [2025-10-01T22:29:11.249176] [DEBUG] [LOCAL ] WTS: Primary data saved (18134 records). [2025-10-01T22:29:11.249333] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-01T22:29:11.249457] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 22.1s. Estimated remaining: 5m 56s. Rate: 7.1 symbols/min [2025-10-01T22:29:11.308330] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-01T22:29:11.466722] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:11.520265] [DEBUG] [LOCAL ] WWW: Loaded 49112 existing records from primary storage. [2025-10-01T22:29:11.520697] [INFO ] [MAIN ] WWW: Loaded 49112 existing records. [2025-10-01T22:29:11.722100] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:29:11.722350] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-01T22:29:11.722405] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-01T22:29:11.725059] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-01T22:29:11.725140] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-01T22:29:12.106713] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-01T22:29:12.132597] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:29:12.902365] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-01T22:29:13.159419] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T22:29:13.714019] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-01T22:29:13.717118] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-01T22:29:14.227479] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T22:29:14.502403] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-01T22:29:15.302373] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-01T22:29:15.425198] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-01T22:29:16.102357] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-01T22:29:16.365842] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-01T22:29:16.902469] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-01T22:29:16.949792] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-01T22:29:17.702397] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-01T22:29:17.870981] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T22:29:18.502388] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-01T22:29:18.682560] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-01T22:29:19.022101] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-01T22:29:19.302363] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-01T22:29:20.102395] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-01T22:29:20.360298] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T22:29:20.902367] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-01T22:29:20.951813] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T22:29:21.703017] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-01T22:29:21.706315] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-01T22:29:22.502388] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-01T22:29:22.752541] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-01T22:29:23.306351] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-01T22:29:23.306635] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-01T22:29:23.338271] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-01T22:29:24.102401] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-01T22:29:24.234254] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (0.13 seconds). [2025-10-01T22:29:24.236116] [INFO ] [REMOTE ] WTRG: Full fetch complete (73384 records). [2025-10-01T22:29:24.236253] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-01T22:29:24.695110] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-01T22:29:24.695203] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-01T22:29:24.696397] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-01T22:29:24.696466] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-01T22:29:24.698074] [DEBUG] [LOCAL ] WTRG: Trimmed 73384 records to 50905 (keeping 200 days of data) [2025-10-01T22:29:24.923082] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-01T22:29:25.061910] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-01T22:29:25.090543] [DEBUG] [LOCAL ] WTRG: Primary data saved (50905 records). [2025-10-01T22:29:25.090725] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-01T22:29:25.090869] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTRG took 37.5s. Estimated remaining: 5m 48s. Rate: 7.1 symbols/min [2025-10-01T22:29:25.277400] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:25.329501] [DEBUG] [LOCAL ] WY: Loaded 53122 existing records from primary storage. [2025-10-01T22:29:25.329875] [INFO ] [MAIN ] WY: Loaded 53122 existing records. [2025-10-01T22:29:25.526492] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:29:25.526754] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-01T22:29:25.526807] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-01T22:29:25.528076] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-01T22:29:25.528138] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-01T22:29:25.709158] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-01T22:29:25.938129] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:29:25.955401] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T22:29:25.957137] [INFO ] [REMOTE ] WTTR: Full fetch complete (65630 records). [2025-10-01T22:29:25.957339] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-01T22:29:26.423288] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-01T22:29:26.423424] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-01T22:29:26.424498] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-01T22:29:26.424579] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-01T22:29:26.426205] [DEBUG] [LOCAL ] WTTR: Trimmed 65630 records to 44935 (keeping 200 days of data) [2025-10-01T22:29:26.515608] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-01T22:29:26.701721] [DEBUG] [LOCAL ] WTTR: Primary data saved (44935 records). [2025-10-01T22:29:26.701853] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-01T22:29:26.701975] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTTR took 36.4s. Estimated remaining: 5m 39s. Rate: 7.1 symbols/min [2025-10-01T22:29:26.898234] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:26.935326] [DEBUG] [LOCAL ] XFLT: Loaded 29795 existing records from primary storage. [2025-10-01T22:29:26.935609] [INFO ] [MAIN ] XFLT: Loaded 29795 existing records. [2025-10-01T22:29:27.137111] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:29:27.137350] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-01T22:29:27.137413] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-01T22:29:27.138258] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-01T22:29:27.138320] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-01T22:29:27.307543] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-01T22:29:27.545789] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:29:27.660200] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T22:29:28.102388] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-01T22:29:28.210773] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-01T22:29:28.902394] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-01T22:29:29.175509] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-01T22:29:29.702363] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-01T22:29:29.760039] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-01T22:29:30.011141] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-01T22:29:30.502394] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-01T22:29:31.302421] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-01T22:29:31.461238] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-01T22:29:31.728420] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-01T22:29:31.870808] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-01T22:29:32.102401] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-01T22:29:32.332768] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-01T22:29:32.334443] [INFO ] [REMOTE ] WU: Full fetch complete (77347 records). [2025-10-01T22:29:32.334591] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-01T22:29:32.781613] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-01T22:29:32.781743] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-01T22:29:32.783051] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-01T22:29:32.783121] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-01T22:29:32.785610] [DEBUG] [LOCAL ] WU: Trimmed 77347 records to 53453 (keeping 200 days of data) [2025-10-01T22:29:32.902536] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-01T22:29:33.135242] [DEBUG] [LOCAL ] WU: Primary data saved (53453 records). [2025-10-01T22:29:33.135401] [INFO ] [MAIN ] WU: Full history saved. [2025-10-01T22:29:33.135538] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 40.0s. Estimated remaining: 5m 31s. Rate: 7.1 symbols/min [2025-10-01T22:29:33.324242] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:33.371264] [DEBUG] [LOCAL ] XHR: Loaded 43760 existing records from primary storage. [2025-10-01T22:29:33.371597] [INFO ] [MAIN ] XHR: Loaded 43760 existing records. [2025-10-01T22:29:33.566400] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:29:33.567498] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-01T22:29:33.567560] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-01T22:29:33.569588] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-01T22:29:33.569689] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-01T22:29:33.707537] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-01T22:29:33.982875] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:29:34.053409] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-01T22:29:34.502408] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-01T22:29:35.302413] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-01T22:29:35.467261] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T22:29:35.975901] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T22:29:36.102406] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-01T22:29:36.632345] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-01T22:29:36.902402] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-01T22:29:37.690032] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-01T22:29:37.705141] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-01T22:29:38.261023] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-01T22:29:38.502454] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-01T22:29:39.302435] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-01T22:29:39.356242] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-01T22:29:39.618715] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-01T22:29:40.102416] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-01T22:29:40.902387] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-01T22:29:41.235244] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-01T22:29:41.324743] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-01T22:29:41.702395] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-01T22:29:42.502389] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-01T22:29:42.728111] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-01T22:29:43.302396] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-01T22:29:43.547802] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-01T22:29:43.616818] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-01T22:29:44.102414] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-01T22:29:44.902372] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-01T22:29:44.964768] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-01T22:29:45.493782] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-01T22:29:45.702435] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-01T22:29:46.502388] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-01T22:29:46.544244] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T22:29:46.954800] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-01T22:29:47.302399] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-01T22:29:48.102365] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-01T22:29:48.145713] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-01T22:29:48.730146] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T22:29:48.902388] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-01T22:29:49.702379] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-01T22:29:49.781362] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-01T22:29:50.206202] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-01T22:29:50.502414] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-01T22:29:51.183444] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-01T22:29:51.302419] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-01T22:29:51.821821] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-01T22:29:52.068373] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T22:29:52.102364] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-01T22:29:52.902431] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-01T22:29:53.208747] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-01T22:29:53.211040] [INFO ] [REMOTE ] WWW: Full fetch complete (70171 records). [2025-10-01T22:29:53.211210] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-01T22:29:53.657099] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-01T22:29:53.657244] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-01T22:29:53.659131] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-01T22:29:53.659238] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-01T22:29:53.691308] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-01T22:29:53.688793] [DEBUG] [LOCAL ] WWW: Trimmed 70171 records to 49139 (keeping 200 days of data) [2025-10-01T22:29:53.702368] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-01T22:29:54.070088] [DEBUG] [LOCAL ] WWW: Primary data saved (49139 records). [2025-10-01T22:29:54.070310] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-01T22:29:54.070458] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WWW took 42.8s. Estimated remaining: 5m 22s. Rate: 7.1 symbols/min [2025-10-01T22:29:54.253362] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:54.253914] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-01T22:29:54.254049] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-01T22:29:54.254293] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-01T22:29:54.254367] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-01T22:29:54.254450] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-01T22:29:54.254510] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-01T22:29:54.511431] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-01T22:29:54.660485] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:29:54.698309] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T22:29:55.302419] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-01T22:29:55.579276] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T22:29:55.581753] [INFO ] [REMOTE ] WY: Full fetch complete (76855 records). [2025-10-01T22:29:55.581927] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-01T22:29:55.892420] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-01T22:29:56.035731] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-01T22:29:56.035841] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-01T22:29:56.037740] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-01T22:29:56.037809] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-01T22:29:56.039774] [DEBUG] [LOCAL ] WY: Trimmed 76855 records to 53131 (keeping 200 days of data) [2025-10-01T22:29:56.110291] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-01T22:29:56.357147] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:29:56.375511] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-01T22:29:56.376718] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:29:56.376837] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-01T22:29:56.377468] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:29:56.378883] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-01T22:29:56.381388] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-01T22:29:56.382012] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-01T22:29:56.383539] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-01T22:29:56.385947] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XIFR took 2.3s. Estimated remaining: 5m 14s. Rate: 7.1 symbols/min [2025-10-01T22:29:56.626976] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:56.633083] [DEBUG] [LOCAL ] WY: Primary data saved (53131 records). [2025-10-01T22:29:56.633692] [INFO ] [MAIN ] WY: Full history saved. [2025-10-01T22:29:56.633859] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. WY took 31.5s. Estimated remaining: 5m 5s. Rate: 7.1 symbols/min [2025-10-01T22:29:56.822499] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:56.883491] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-01T22:29:56.885264] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-01T22:29:56.885801] [DEBUG] [LOCAL ] XPER: Loaded 29705 existing records from primary storage. [2025-10-01T22:29:56.907995] [INFO ] [MAIN ] XPER: Loaded 29705 existing records. [2025-10-01T22:29:56.907578] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-01T22:29:57.274970] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:29:57.299009] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-01T22:29:57.299127] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-01T22:29:57.298802] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:29:57.299383] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-01T22:29:57.299451] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-01T22:29:57.300291] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-01T22:29:57.300354] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-01T22:29:57.311914] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-01T22:29:57.353062] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-01T22:29:57.713126] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-01T22:29:58.206600] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:29:58.243561] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:29:58.510875] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-01T22:29:58.528335] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T22:29:58.736100] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-01T22:29:58.737610] [INFO ] [REMOTE ] XFLT: Full fetch complete (44160 records). [2025-10-01T22:29:58.737747] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-01T22:29:59.185933] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-01T22:29:59.186028] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-01T22:29:59.186996] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-01T22:29:59.187061] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-01T22:29:59.188211] [DEBUG] [LOCAL ] XFLT: Trimmed 44160 records to 29830 (keeping 200 days of data) [2025-10-01T22:29:59.303812] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-01T22:29:59.389397] [DEBUG] [LOCAL ] XFLT: Primary data saved (29830 records). [2025-10-01T22:29:59.389577] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-01T22:29:59.389729] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XFLT took 32.7s. Estimated remaining: 4m 57s. Rate: 7.1 symbols/min [2025-10-01T22:29:59.595503] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:29:59.662779] [DEBUG] [LOCAL ] XPEV: Loaded 53637 existing records from primary storage. [2025-10-01T22:29:59.663173] [INFO ] [MAIN ] XPEV: Loaded 53637 existing records. [2025-10-01T22:29:59.855774] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:29:59.856115] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-01T22:29:59.856192] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-01T22:29:59.857344] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-01T22:29:59.857412] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-01T22:30:00.117697] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-01T22:30:00.189293] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-01T22:30:00.290942] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:30:00.902377] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-01T22:30:00.991217] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T22:30:01.702436] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-01T22:30:02.502425] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-01T22:30:02.708019] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-01T22:30:03.302348] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-01T22:30:03.333142] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T22:30:03.448124] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-01T22:30:04.084858] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-01T22:30:04.102344] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-01T22:30:04.902409] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-01T22:30:04.972767] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-01T22:30:05.702423] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-01T22:30:05.749478] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-01T22:30:06.502492] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-01T22:30:06.773014] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-01T22:30:07.156331] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-01T22:30:07.302493] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-01T22:30:08.102499] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-01T22:30:08.830574] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-01T22:30:08.902337] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-01T22:30:09.056852] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-01T22:30:09.189531] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:30:09.191052] [INFO ] [REMOTE ] XHR: Full fetch complete (61556 records). [2025-10-01T22:30:09.191145] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-01T22:30:09.595722] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-01T22:30:09.595947] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-01T22:30:09.597700] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-01T22:30:09.608158] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-01T22:30:09.628307] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-01T22:30:09.628613] [DEBUG] [LOCAL ] XHR: Trimmed 61556 records to 43695 (keeping 200 days of data) [2025-10-01T22:30:09.709258] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-01T22:30:09.925766] [DEBUG] [LOCAL ] XHR: Primary data saved (43695 records). [2025-10-01T22:30:09.925949] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-01T22:30:09.926077] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XHR took 36.8s. Estimated remaining: 4m 48s. Rate: 7.1 symbols/min [2025-10-01T22:30:10.097476] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:30:10.147472] [DEBUG] [LOCAL ] XPO: Loaded 47829 existing records from primary storage. [2025-10-01T22:30:10.147953] [INFO ] [MAIN ] XPO: Loaded 47829 existing records. [2025-10-01T22:30:10.333596] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:30:10.333923] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-01T22:30:10.333978] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-01T22:30:10.335194] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-01T22:30:10.335257] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-01T22:30:10.510168] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-01T22:30:10.708415] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:30:11.302479] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-01T22:30:12.041896] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-01T22:30:12.075526] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-01T22:30:12.102358] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-01T22:30:12.902350] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-01T22:30:13.267970] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-01T22:30:13.366849] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-01T22:30:13.702429] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-01T22:30:14.367807] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-01T22:30:14.502395] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-01T22:30:15.302509] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-01T22:30:15.928809] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-01T22:30:16.102428] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-01T22:30:16.902527] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-01T22:30:17.012240] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-01T22:30:17.058267] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-01T22:30:17.702389] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-01T22:30:18.043574] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-01T22:30:18.502411] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-01T22:30:18.550998] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-01T22:30:19.309824] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-01T22:30:19.329929] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-01T22:30:20.102482] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-01T22:30:20.745212] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-01T22:30:20.902433] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-01T22:30:21.002687] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-01T22:30:21.702412] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-01T22:30:21.855687] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-01T22:30:22.351595] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-01T22:30:22.502496] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-01T22:30:23.302433] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-01T22:30:24.102458] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-01T22:30:24.226694] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-01T22:30:24.280314] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T22:30:24.864343] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-01T22:30:24.902344] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-01T22:30:25.702369] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-01T22:30:25.836791] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T22:30:26.502391] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-01T22:30:26.702844] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T22:30:26.704879] [INFO ] [REMOTE ] XPER: Full fetch complete (43236 records). [2025-10-01T22:30:26.704994] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-01T22:30:27.135216] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-01T22:30:27.135449] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-01T22:30:27.136632] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-01T22:30:27.136761] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-01T22:30:27.138371] [DEBUG] [LOCAL ] XPER: Trimmed 43236 records to 29760 (keeping 200 days of data) [2025-10-01T22:30:27.320972] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-01T22:30:27.319078] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-01T22:30:27.382086] [DEBUG] [LOCAL ] XPER: Primary data saved (29760 records). [2025-10-01T22:30:27.382298] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-01T22:30:27.382426] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 30.7s. Estimated remaining: 4m 40s. Rate: 7.1 symbols/min [2025-10-01T22:30:27.595739] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:30:27.632395] [DEBUG] [LOCAL ] XPOF: Loaded 38259 existing records from primary storage. [2025-10-01T22:30:27.632771] [INFO ] [MAIN ] XPOF: Loaded 38259 existing records. [2025-10-01T22:30:27.846277] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:30:27.846680] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-01T22:30:27.846743] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-01T22:30:27.847697] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-01T22:30:27.847761] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-01T22:30:28.107737] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-01T22:30:28.236793] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:30:28.802704] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-01T22:30:28.902433] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-01T22:30:29.099955] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-01T22:30:29.702431] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-01T22:30:30.214363] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-01T22:30:30.341859] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-01T22:30:30.502400] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-01T22:30:30.986714] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-01T22:30:31.302427] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-01T22:30:32.102437] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-01T22:30:32.902499] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-01T22:30:33.031171] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-01T22:30:33.718894] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-01T22:30:33.737499] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-01T22:30:33.776721] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-01T22:30:33.917250] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-01T22:30:34.502425] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-01T22:30:35.307548] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-01T22:30:35.328436] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T22:30:35.648895] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-01T22:30:35.650621] [INFO ] [REMOTE ] XPEV: Full fetch complete (77678 records). [2025-10-01T22:30:35.650814] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-01T22:30:36.105571] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-01T22:30:36.106015] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-01T22:30:36.106332] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-01T22:30:36.108433] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-01T22:30:36.108634] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-01T22:30:36.110780] [DEBUG] [LOCAL ] XPEV: Trimmed 77678 records to 53636 (keeping 200 days of data) [2025-10-01T22:30:36.442279] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-01T22:30:36.467892] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-01T22:30:36.470290] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-01T22:30:36.471344] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-01T22:30:36.843814] [DEBUG] [LOCAL ] XPEV: Primary data saved (53636 records). [2025-10-01T22:30:36.856311] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-01T22:30:36.856531] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPEV took 37.5s. Estimated remaining: 4m 31s. Rate: 7.1 symbols/min [2025-10-01T22:30:36.907446] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-01T22:30:37.084632] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-01T22:30:37.093355] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-01T22:30:37.098137] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-01T22:30:37.098233] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-01T22:30:37.177766] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:30:37.157845] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-10-01T22:30:37.329470] [DEBUG] [LOCAL ] XPRO: Loaded 45857 existing records from primary storage. [2025-10-01T22:30:37.330786] [INFO ] [MAIN ] XPRO: Loaded 45857 existing records. [2025-10-01T22:30:37.650133] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:30:37.684811] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-01T22:30:37.691477] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-01T22:30:37.693404] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-01T22:30:37.696142] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-01T22:30:37.710101] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-01T22:30:38.245570] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:30:38.257729] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-01T22:30:38.257827] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-01T22:30:38.257901] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XOM took 41.9s. Estimated remaining: 4m 23s. Rate: 7.1 symbols/min [2025-10-01T22:30:38.443163] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:30:38.475112] [DEBUG] [LOCAL ] XYF: Loaded 28441 existing records from primary storage. [2025-10-01T22:30:38.475423] [INFO ] [MAIN ] XYF: Loaded 28441 existing records. [2025-10-01T22:30:38.509322] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-01T22:30:38.679800] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:30:38.680271] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-01T22:30:38.680456] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-01T22:30:38.681274] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-01T22:30:38.681338] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-01T22:30:38.980114] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-01T22:30:39.126805] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:30:39.161044] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T22:30:39.302416] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-01T22:30:40.102383] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-01T22:30:40.153483] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-01T22:30:40.778506] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-01T22:30:40.872012] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-01T22:30:40.902392] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-01T22:30:41.600377] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-01T22:30:41.702384] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-01T22:30:42.502422] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-01T22:30:43.302391] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-01T22:30:43.346504] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-01T22:30:43.588734] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:30:43.590248] [INFO ] [REMOTE ] XPO: Full fetch complete (69863 records). [2025-10-01T22:30:43.590387] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-01T22:30:44.030373] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-01T22:30:44.030492] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-01T22:30:44.031893] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-01T22:30:44.031974] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-01T22:30:44.060117] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-01T22:30:44.069631] [DEBUG] [LOCAL ] XPO: Trimmed 69863 records to 47817 (keeping 200 days of data) [2025-10-01T22:30:44.123064] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-01T22:30:44.380081] [DEBUG] [LOCAL ] XPO: Primary data saved (47817 records). [2025-10-01T22:30:44.380232] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-01T22:30:44.380334] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPO took 34.5s. Estimated remaining: 4m 14s. Rate: 7.1 symbols/min [2025-10-01T22:30:44.577867] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:30:44.633118] [DEBUG] [LOCAL ] XYL: Loaded 47982 existing records from primary storage. [2025-10-01T22:30:44.633566] [INFO ] [MAIN ] XYL: Loaded 47982 existing records. [2025-10-01T22:30:44.833564] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:30:44.833817] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-01T22:30:44.833869] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-01T22:30:44.835272] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-01T22:30:44.835337] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-01T22:30:44.907762] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-01T22:30:45.229918] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:30:45.656556] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-01T22:30:45.702363] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-01T22:30:46.311593] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-01T22:30:46.502377] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-01T22:30:47.105207] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-01T22:30:47.307302] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-01T22:30:47.312763] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-01T22:30:47.884118] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-01T22:30:48.102421] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-01T22:30:48.902380] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-01T22:30:49.705714] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-01T22:30:49.712492] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T22:30:50.070005] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-01T22:30:50.502406] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-01T22:30:51.302363] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-01T22:30:51.450360] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-01T22:30:52.102362] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-01T22:30:52.173255] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-01T22:30:52.486986] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-01T22:30:52.902384] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-01T22:30:53.587922] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-01T22:30:53.702394] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-01T22:30:54.507525] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-01T22:30:54.521494] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-01T22:30:54.887888] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-01T22:30:55.302383] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-01T22:30:56.102402] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-01T22:30:56.230439] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-01T22:30:56.661800] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T22:30:56.902393] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-01T22:30:57.461965] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-01T22:30:57.702391] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-01T22:30:58.353455] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-01T22:30:58.502440] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-01T22:30:59.234260] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-01T22:30:59.302386] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-01T22:31:00.102375] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-01T22:31:00.191464] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T22:31:00.902338] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-01T22:31:00.981885] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-01T22:31:00.983157] [INFO ] [REMOTE ] XPOF: Full fetch complete (52190 records). [2025-10-01T22:31:00.983291] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-01T22:31:01.338333] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-01T22:31:01.519067] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-01T22:31:01.519164] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-01T22:31:01.520269] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-01T22:31:01.520340] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-01T22:31:01.521574] [DEBUG] [LOCAL ] XPOF: Trimmed 52190 records to 38055 (keeping 200 days of data) [2025-10-01T22:31:01.703517] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-01T22:31:01.764127] [DEBUG] [LOCAL ] XPOF: Primary data saved (38055 records). [2025-10-01T22:31:01.764274] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-01T22:31:01.764374] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPOF took 34.4s. Estimated remaining: 4m 6s. Rate: 7.1 symbols/min [2025-10-01T22:31:01.961559] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:01.961795] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-01T22:31:01.961849] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-01T22:31:01.961960] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-01T22:31:01.962004] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-01T22:31:01.962048] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-01T22:31:01.962082] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-01T22:31:02.392722] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:02.502381] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-01T22:31:02.716680] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-01T22:31:02.726777] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-01T22:31:02.728293] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-01T22:31:02.728418] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:31:02.728499] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-01T22:31:02.728587] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:31:02.728718] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-01T22:31:02.728804] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-01T22:31:02.728852] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-01T22:31:02.728909] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-01T22:31:02.728979] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 1.0s. Estimated remaining: 3m 57s. Rate: 7.1 symbols/min [2025-10-01T22:31:02.921226] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:02.965805] [DEBUG] [LOCAL ] YALA: Loaded 37240 existing records from primary storage. [2025-10-01T22:31:02.966101] [INFO ] [MAIN ] YALA: Loaded 37240 existing records. [2025-10-01T22:31:03.166250] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:03.166467] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-01T22:31:03.166525] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-01T22:31:03.167433] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-01T22:31:03.167497] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-01T22:31:03.305774] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-01T22:31:03.546335] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-01T22:31:03.644353] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:04.102423] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-01T22:31:04.902382] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-01T22:31:05.223382] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-01T22:31:05.574205] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T22:31:05.702411] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-01T22:31:06.058274] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-01T22:31:06.060135] [INFO ] [REMOTE ] XPRO: Full fetch complete (66469 records). [2025-10-01T22:31:06.060285] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-01T22:31:06.513223] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-01T22:31:06.509767] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-01T22:31:06.514624] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-01T22:31:06.515916] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-01T22:31:06.516094] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-01T22:31:06.517898] [DEBUG] [LOCAL ] XPRO: Trimmed 66469 records to 45876 (keeping 200 days of data) [2025-10-01T22:31:06.809205] [DEBUG] [LOCAL ] XPRO: Primary data saved (45876 records). [2025-10-01T22:31:06.809511] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-01T22:31:06.809869] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XPRO took 30.0s. Estimated remaining: 3m 49s. Rate: 7.1 symbols/min [2025-10-01T22:31:07.009594] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:07.064840] [DEBUG] [LOCAL ] YELP: Loaded 45270 existing records from primary storage. [2025-10-01T22:31:07.065292] [INFO ] [MAIN ] YELP: Loaded 45270 existing records. [2025-10-01T22:31:07.271474] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:07.271715] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-01T22:31:07.271772] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-01T22:31:07.273408] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-01T22:31:07.273483] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-01T22:31:07.306430] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-01T22:31:07.696942] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:07.717240] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-01T22:31:07.757389] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-01T22:31:08.102390] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-01T22:31:08.157390] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-01T22:31:08.902425] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-01T22:31:09.702373] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-01T22:31:09.800633] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-01T22:31:09.880689] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-01T22:31:10.502403] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-01T22:31:11.312188] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-01T22:31:11.317934] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-01T22:31:11.814267] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-01T22:31:12.023684] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-01T22:31:12.024805] [INFO ] [REMOTE ] XYF: Full fetch complete (31910 records). [2025-10-01T22:31:12.024882] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-01T22:31:12.107487] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-01T22:31:12.451991] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-01T22:31:12.452083] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-01T22:31:12.452760] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-01T22:31:12.452822] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-01T22:31:12.453891] [DEBUG] [LOCAL ] XYF: Trimmed 31910 records to 28441 (keeping 200 days of data) [2025-10-01T22:31:12.643223] [DEBUG] [LOCAL ] XYF: Primary data saved (28441 records). [2025-10-01T22:31:12.643356] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-01T22:31:12.643499] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. XYF took 34.4s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-01T22:31:12.875519] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:12.909039] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-01T22:31:12.932086] [DEBUG] [LOCAL ] YETI: Loaded 52484 existing records from primary storage. [2025-10-01T22:31:12.932417] [INFO ] [MAIN ] YETI: Loaded 52484 existing records. [2025-10-01T22:31:13.126577] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:13.126920] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-01T22:31:13.127004] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-01T22:31:13.128289] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-01T22:31:13.128351] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-01T22:31:13.540331] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:13.560113] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-01T22:31:13.702468] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-01T22:31:14.359480] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-01T22:31:14.502370] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-01T22:31:15.129346] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-01T22:31:15.302399] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-01T22:31:16.102367] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-01T22:31:16.202628] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T22:31:16.602784] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-01T22:31:16.902428] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-01T22:31:17.170586] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-01T22:31:17.702392] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-01T22:31:18.202605] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-01T22:31:18.502399] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-01T22:31:19.302429] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-01T22:31:19.460189] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-01T22:31:20.102404] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-01T22:31:20.188414] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-01T22:31:20.762349] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T22:31:20.902386] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-01T22:31:21.702364] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-01T22:31:21.740464] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-01T22:31:22.502412] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-01T22:31:22.737823] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-01T22:31:23.133836] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T22:31:23.302423] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-01T22:31:24.102410] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-01T22:31:24.172761] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-01T22:31:24.866795] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-01T22:31:24.902411] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-01T22:31:25.633367] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-01T22:31:25.702393] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-01T22:31:26.508682] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-01T22:31:26.514990] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T22:31:26.697804] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-01T22:31:27.287638] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T22:31:27.302324] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-01T22:31:27.442230] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.14 seconds). [2025-10-01T22:31:27.443798] [INFO ] [REMOTE ] XYL: Full fetch complete (69797 records). [2025-10-01T22:31:27.443918] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-01T22:31:27.914636] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-01T22:31:27.914763] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-01T22:31:27.915981] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-01T22:31:27.916058] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-01T22:31:27.917589] [DEBUG] [LOCAL ] XYL: Trimmed 69797 records to 47951 (keeping 200 days of data) [2025-10-01T22:31:28.125014] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-01T22:31:28.268709] [DEBUG] [LOCAL ] XYL: Primary data saved (47951 records). [2025-10-01T22:31:28.268875] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-01T22:31:28.268985] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XYL took 43.9s. Estimated remaining: 3m 32s. Rate: 7.1 symbols/min [2025-10-01T22:31:28.462344] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:28.504357] [DEBUG] [LOCAL ] YEXT: Loaded 43136 existing records from primary storage. [2025-10-01T22:31:28.504722] [INFO ] [MAIN ] YEXT: Loaded 43136 existing records. [2025-10-01T22:31:28.703262] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:28.703504] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-01T22:31:28.703556] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-01T22:31:28.704406] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-01T22:31:28.704470] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-01T22:31:28.910040] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-01T22:31:29.096764] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:29.369933] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-01T22:31:29.702398] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-01T22:31:29.829777] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-01T22:31:29.831002] [INFO ] [REMOTE ] YALA: Full fetch complete (46512 records). [2025-10-01T22:31:29.831103] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-01T22:31:30.283261] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-01T22:31:30.283348] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-01T22:31:30.284342] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-01T22:31:30.284416] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-01T22:31:30.285635] [DEBUG] [LOCAL ] YALA: Trimmed 46512 records to 37194 (keeping 200 days of data) [2025-10-01T22:31:30.504992] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-01T22:31:30.509498] [DEBUG] [LOCAL ] YALA: Primary data saved (37194 records). [2025-10-01T22:31:30.509608] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-01T22:31:30.509841] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YALA took 27.8s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-01T22:31:30.720152] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:30.774429] [DEBUG] [LOCAL ] YMM: Loaded 52647 existing records from primary storage. [2025-10-01T22:31:30.774843] [INFO ] [MAIN ] YMM: Loaded 52647 existing records. [2025-10-01T22:31:30.972951] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:30.973249] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-01T22:31:30.973310] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-01T22:31:30.974399] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-01T22:31:30.974463] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-01T22:31:31.306973] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-01T22:31:31.418410] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:31.448970] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-01T22:31:32.107536] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-01T22:31:32.127107] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-01T22:31:32.645501] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-01T22:31:32.902436] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-01T22:31:33.702364] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-01T22:31:34.090473] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-01T22:31:34.225341] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-01T22:31:34.502407] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-01T22:31:34.954995] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-01T22:31:35.302396] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-01T22:31:36.102422] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-01T22:31:36.327746] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T22:31:36.774453] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T22:31:36.902408] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-01T22:31:37.494897] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-01T22:31:37.702449] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-01T22:31:38.514988] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-01T22:31:38.521744] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-01T22:31:39.307531] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-01T22:31:39.326042] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-01T22:31:40.102437] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-01T22:31:40.442573] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-01T22:31:40.775144] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T22:31:40.902392] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-01T22:31:41.644519] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-01T22:31:41.702369] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-01T22:31:42.502394] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-01T22:31:42.811627] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-01T22:31:42.888910] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-01T22:31:43.127434] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-01T22:31:43.302397] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-01T22:31:44.102398] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-01T22:31:44.625079] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-01T22:31:44.902411] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-01T22:31:45.702381] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-01T22:31:45.933685] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-01T22:31:46.502387] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-01T22:31:46.706195] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T22:31:46.800831] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-01T22:31:46.803697] [INFO ] [REMOTE ] YELP: Full fetch complete (64342 records). [2025-10-01T22:31:46.803825] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-01T22:31:47.198355] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-01T22:31:47.315077] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-01T22:31:47.319134] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-01T22:31:47.320004] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-01T22:31:47.321243] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-01T22:31:47.321327] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-01T22:31:47.325116] [DEBUG] [LOCAL ] YELP: Trimmed 64342 records to 45285 (keeping 200 days of data) [2025-10-01T22:31:47.634626] [DEBUG] [LOCAL ] YELP: Primary data saved (45285 records). [2025-10-01T22:31:47.634805] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-01T22:31:47.634923] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YELP took 40.8s. Estimated remaining: 3m 15s. Rate: 7.1 symbols/min [2025-10-01T22:31:47.857870] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:47.918714] [DEBUG] [LOCAL ] YOU: Loaded 49684 existing records from primary storage. [2025-10-01T22:31:47.919070] [INFO ] [MAIN ] YOU: Loaded 49684 existing records. [2025-10-01T22:31:48.107547] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-01T22:31:48.156849] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:48.157172] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-01T22:31:48.157270] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-01T22:31:48.158681] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-01T22:31:48.158763] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-01T22:31:48.584502] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:48.902387] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-01T22:31:49.086595] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T22:31:49.205789] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-01T22:31:49.702390] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-01T22:31:49.992784] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-01T22:31:49.995067] [INFO ] [REMOTE ] YETI: Full fetch complete (75478 records). [2025-10-01T22:31:49.995196] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-01T22:31:50.443550] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-01T22:31:50.443850] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-01T22:31:50.445213] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-01T22:31:50.445292] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-01T22:31:50.447634] [DEBUG] [LOCAL ] YETI: Trimmed 75478 records to 52495 (keeping 200 days of data) [2025-10-01T22:31:50.510344] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-01T22:31:50.737600] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T22:31:50.838150] [DEBUG] [LOCAL ] YETI: Primary data saved (52495 records). [2025-10-01T22:31:50.838299] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-01T22:31:50.838390] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 38.2s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-01T22:31:51.037200] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:51.092148] [DEBUG] [LOCAL ] YPF: Loaded 50489 existing records from primary storage. [2025-10-01T22:31:51.092542] [INFO ] [MAIN ] YPF: Loaded 50489 existing records. [2025-10-01T22:31:51.295025] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:51.295282] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-01T22:31:51.295377] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-01T22:31:51.296677] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-01T22:31:51.296747] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-01T22:31:51.308852] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-01T22:31:51.696207] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:52.102395] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-01T22:31:52.142042] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-01T22:31:52.902367] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-01T22:31:53.076396] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-01T22:31:53.702390] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-01T22:31:54.013875] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T22:31:54.088750] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-01T22:31:54.502389] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-01T22:31:55.302370] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-01T22:31:55.480814] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-01T22:31:55.564007] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-01T22:31:55.568116] [INFO ] [REMOTE ] YEXT: Full fetch complete (63275 records). [2025-10-01T22:31:55.568288] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-01T22:31:56.004781] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-01T22:31:56.004899] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-01T22:31:56.006378] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-01T22:31:56.006450] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-01T22:31:56.007971] [DEBUG] [LOCAL ] YEXT: Trimmed 63275 records to 43075 (keeping 200 days of data) [2025-10-01T22:31:56.102690] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-01T22:31:56.273311] [DEBUG] [LOCAL ] YEXT: Primary data saved (43075 records). [2025-10-01T22:31:56.273457] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-01T22:31:56.273547] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YEXT took 28.0s. Estimated remaining: 2m 58s. Rate: 7.1 symbols/min [2025-10-01T22:31:56.467273] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:31:56.485034] [DEBUG] [LOCAL ] YRD: Loaded 12580 existing records from primary storage. [2025-10-01T22:31:56.485303] [INFO ] [MAIN ] YRD: Loaded 12580 existing records. [2025-10-01T22:31:56.691193] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:31:56.691422] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-01T22:31:56.691470] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-01T22:31:56.691927] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-01T22:31:56.691990] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-01T22:31:56.907591] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-01T22:31:57.118469] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:31:57.153065] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-01T22:31:57.702388] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-01T22:31:57.799822] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-01T22:31:58.502411] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-01T22:31:58.843316] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-01T22:31:59.160301] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-01T22:31:59.302382] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-01T22:32:00.102448] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-01T22:32:00.390752] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-01T22:32:00.832218] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-01T22:32:00.902406] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-01T22:32:01.169065] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-01T22:32:01.702439] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-01T22:32:02.502400] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-01T22:32:02.724192] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T22:32:03.302370] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-01T22:32:03.506221] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-01T22:32:04.102380] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-01T22:32:04.344076] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-01T22:32:04.902388] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-01T22:32:05.114515] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-01T22:32:05.431899] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-01T22:32:05.702390] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-01T22:32:06.020548] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-01T22:32:06.502415] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-01T22:32:06.827115] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-01T22:32:06.828861] [INFO ] [REMOTE ] YMM: Full fetch complete (76391 records). [2025-10-01T22:32:06.828976] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-01T22:32:07.303833] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-01T22:32:07.309510] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-01T22:32:07.309626] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-01T22:32:07.311040] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-01T22:32:07.311214] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-01T22:32:07.313299] [DEBUG] [LOCAL ] YMM: Trimmed 76391 records to 52637 (keeping 200 days of data) [2025-10-01T22:32:07.562120] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T22:32:07.689064] [DEBUG] [LOCAL ] YMM: Primary data saved (52637 records). [2025-10-01T22:32:07.689250] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-01T22:32:07.689382] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 37.2s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-01T22:32:07.875290] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:32:07.903412] [DEBUG] [LOCAL ] YSG: Loaded 25331 existing records from primary storage. [2025-10-01T22:32:07.903744] [INFO ] [MAIN ] YSG: Loaded 25331 existing records. [2025-10-01T22:32:08.099800] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:32:08.100061] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-01T22:32:08.100119] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-01T22:32:08.101345] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-01T22:32:08.101414] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-01T22:32:08.107559] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-01T22:32:08.501254] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:32:08.826074] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-01T22:32:08.902364] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-01T22:32:09.704483] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-01T22:32:09.708115] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-01T22:32:09.951761] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-01T22:32:10.502435] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-01T22:32:11.302365] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-01T22:32:11.534347] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-01T22:32:12.102449] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-01T22:32:12.414766] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-01T22:32:12.902380] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-01T22:32:12.929551] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-01T22:32:12.964617] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-01T22:32:13.702437] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-01T22:32:14.131718] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-01T22:32:14.502411] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-01T22:32:15.302401] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-01T22:32:15.316202] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-01T22:32:15.395897] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-01T22:32:16.102414] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-01T22:32:16.902412] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-01T22:32:16.931100] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-01T22:32:17.118752] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-01T22:32:17.702412] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-01T22:32:17.798755] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-01T22:32:18.502392] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-01T22:32:19.125177] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-01T22:32:19.303912] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-01T22:32:19.306556] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-01T22:32:20.102403] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-01T22:32:20.902436] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-01T22:32:20.952426] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-01T22:32:20.979072] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-01T22:32:21.702438] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-01T22:32:21.728074] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-01T22:32:22.502441] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-01T22:32:22.781273] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-01T22:32:23.258482] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-01T22:32:23.302346] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-01T22:32:23.813616] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-01T22:32:23.815223] [INFO ] [REMOTE ] YOU: Full fetch complete (72115 records). [2025-10-01T22:32:23.815355] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-01T22:32:24.107617] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-01T22:32:24.282595] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-01T22:32:24.282713] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-01T22:32:24.283985] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-01T22:32:24.284055] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-01T22:32:24.285575] [DEBUG] [LOCAL ] YOU: Trimmed 72115 records to 49688 (keeping 200 days of data) [2025-10-01T22:32:24.619601] [DEBUG] [LOCAL ] YOU: Primary data saved (49688 records). [2025-10-01T22:32:24.619798] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-01T22:32:24.619963] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 37.0s. Estimated remaining: 2m 41s. Rate: 7.1 symbols/min [2025-10-01T22:32:24.743439] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-01T22:32:24.788727] [INFO ] [REMOTE ] YRD: Full fetch complete (19003 records). [2025-10-01T22:32:24.802778] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-01T22:32:24.829404] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:32:24.905738] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-01T22:32:25.300744] [DEBUG] [LOCAL ] YUM: Loaded 51176 existing records from primary storage. [2025-10-01T22:32:25.301255] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-01T22:32:25.301397] [INFO ] [MAIN ] YUM: Loaded 51176 existing records. [2025-10-01T22:32:25.301470] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-01T22:32:25.349977] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-01T22:32:25.373601] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-01T22:32:25.416762] [DEBUG] [LOCAL ] YRD: Trimmed 19003 records to 12607 (keeping 200 days of data) [2025-10-01T22:32:25.578162] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:32:25.580022] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-01T22:32:25.580427] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-01T22:32:25.582718] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-01T22:32:25.583980] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-01T22:32:25.708351] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-01T22:32:25.925173] [DEBUG] [LOCAL ] YRD: Primary data saved (12607 records). [2025-10-01T22:32:25.946729] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-01T22:32:25.952525] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YRD took 29.7s. Estimated remaining: 2m 33s. Rate: 7.1 symbols/min [2025-10-01T22:32:26.055678] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-01T22:32:26.206585] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:32:26.257088] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:32:26.314206] [DEBUG] [LOCAL ] YUMC: Loaded 52682 existing records from primary storage. [2025-10-01T22:32:26.314567] [INFO ] [MAIN ] YUMC: Loaded 52682 existing records. [2025-10-01T22:32:26.510927] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:32:26.511036] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-01T22:32:26.512010] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-01T22:32:26.512067] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-01T22:32:26.513317] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-01T22:32:26.513380] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-01T22:32:26.942102] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:32:27.302352] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-01T22:32:27.367592] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-01T22:32:27.595522] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-01T22:32:28.102380] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-01T22:32:28.902436] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-01T22:32:29.140476] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T22:32:29.562993] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-01T22:32:29.702426] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-01T22:32:30.502387] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-01T22:32:30.642926] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-01T22:32:31.103946] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-01T22:32:31.302410] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-01T22:32:31.985549] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-01T22:32:31.987261] [INFO ] [REMOTE ] YPF: Full fetch complete (73506 records). [2025-10-01T22:32:31.987378] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-01T22:32:32.107507] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-01T22:32:32.449037] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-01T22:32:32.449227] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-01T22:32:32.450658] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-01T22:32:32.450729] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-01T22:32:32.452630] [DEBUG] [LOCAL ] YPF: Trimmed 73506 records to 50501 (keeping 200 days of data) [2025-10-01T22:32:32.676166] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-01T22:32:32.811019] [DEBUG] [LOCAL ] YPF: Primary data saved (50501 records). [2025-10-01T22:32:32.811184] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-01T22:32:32.811288] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YPF took 42.0s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-01T22:32:32.907579] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-01T22:32:33.012618] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:32:33.063797] [DEBUG] [LOCAL ] ZBH: Loaded 51129 existing records from primary storage. [2025-10-01T22:32:33.064129] [INFO ] [MAIN ] ZBH: Loaded 51129 existing records. [2025-10-01T22:32:33.267566] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:32:33.267811] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-01T22:32:33.267869] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-01T22:32:33.269307] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-01T22:32:33.269376] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-01T22:32:33.688464] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:32:33.702362] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-01T22:32:33.893405] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-01T22:32:34.502420] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-01T22:32:34.756901] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-01T22:32:34.804885] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-01T22:32:35.302425] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-01T22:32:35.982089] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-01T22:32:35.983493] [INFO ] [REMOTE ] YSG: Full fetch complete (32475 records). [2025-10-01T22:32:35.998456] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-01T22:32:36.031977] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T22:32:36.107478] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-01T22:32:36.494892] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-01T22:32:36.494975] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-01T22:32:36.495740] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-01T22:32:36.495803] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-01T22:32:36.496715] [DEBUG] [LOCAL ] YSG: Trimmed 32475 records to 25415 (keeping 200 days of data) [2025-10-01T22:32:36.652500] [DEBUG] [LOCAL ] YSG: Primary data saved (25415 records). [2025-10-01T22:32:36.652673] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-01T22:32:36.652794] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 29.0s. Estimated remaining: 2m 16s. Rate: 7.1 symbols/min [2025-10-01T22:32:36.839118] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:32:36.858235] [DEBUG] [LOCAL ] ZEPP: Loaded 17569 existing records from primary storage. [2025-10-01T22:32:36.858561] [INFO ] [MAIN ] ZEPP: Loaded 17569 existing records. [2025-10-01T22:32:36.909194] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-01T22:32:37.073253] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:32:37.073518] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-01T22:32:37.073592] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-01T22:32:37.074199] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-01T22:32:37.074263] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-01T22:32:37.490573] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:32:37.702387] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-01T22:32:37.868980] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-01T22:32:38.318866] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-01T22:32:38.502380] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-01T22:32:39.161879] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-01T22:32:39.302391] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-01T22:32:40.102491] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-01T22:32:40.149313] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-01T22:32:40.783367] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-01T22:32:40.902387] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-01T22:32:41.702383] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-01T22:32:41.897232] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T22:32:42.502389] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-01T22:32:42.730763] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-01T22:32:43.302390] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-01T22:32:43.407784] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-01T22:32:44.051271] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-01T22:32:44.102387] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-01T22:32:44.902371] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-01T22:32:45.031261] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-01T22:32:45.702437] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-01T22:32:46.016206] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-01T22:32:46.502462] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-01T22:32:46.852303] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-01T22:32:46.997662] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-01T22:32:47.302386] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-01T22:32:47.419454] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-01T22:32:47.771850] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-01T22:32:48.102379] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-01T22:32:48.902379] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-01T22:32:49.702376] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-01T22:32:49.777884] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-01T22:32:50.502437] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-01T22:32:50.651513] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-01T22:32:51.119894] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-01T22:32:51.302381] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-01T22:32:51.707379] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-01T22:32:52.102398] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-01T22:32:52.381348] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-01T22:32:52.902390] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-01T22:32:53.702356] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-01T22:32:53.874687] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-01T22:32:54.502395] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-01T22:32:54.785664] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-01T22:32:55.166938] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-01T22:32:55.302367] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-01T22:32:55.558633] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-01T22:32:56.102398] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-01T22:32:56.636985] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-01T22:32:56.902399] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-01T22:32:57.119551] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-01T22:32:57.327001] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-01T22:32:57.702421] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-01T22:32:58.485678] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-01T22:32:58.502340] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-01T22:32:58.954529] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-01T22:32:58.956889] [INFO ] [REMOTE ] YUM: Full fetch complete (74446 records). [2025-10-01T22:32:58.957120] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-01T22:32:59.307483] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-01T22:32:59.401851] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-01T22:32:59.401987] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-01T22:32:59.403780] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-01T22:32:59.403898] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-01T22:32:59.406267] [DEBUG] [LOCAL ] YUM: Trimmed 74446 records to 51188 (keeping 200 days of data) [2025-10-01T22:32:59.798723] [DEBUG] [LOCAL ] YUM: Primary data saved (51188 records). [2025-10-01T22:32:59.798912] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-01T22:32:59.799116] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 35.2s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-01T22:33:00.005611] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-01T22:33:00.011513] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:00.074175] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-10-01T22:33:00.074520] [INFO ] [MAIN ] ZETA: Loaded 53595 existing records. [2025-10-01T22:33:00.109016] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-01T22:33:00.295429] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:00.295709] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-01T22:33:00.295809] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-01T22:33:00.297507] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-01T22:33:00.297570] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-01T22:33:00.714206] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:00.902413] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-01T22:33:01.702442] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-01T22:33:02.047107] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-01T22:33:02.502440] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-01T22:33:03.172389] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-01T22:33:03.302372] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-01T22:33:03.493362] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-01T22:33:04.102394] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-01T22:33:04.258546] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-01T22:33:04.902387] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-01T22:33:05.499288] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-01T22:33:05.702347] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-01T22:33:05.859961] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-01T22:33:05.941048] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-01T22:33:06.502382] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-01T22:33:06.811757] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-01T22:33:06.817023] [INFO ] [REMOTE ] ZBH: Full fetch complete (73885 records). [2025-10-01T22:33:06.817155] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-01T22:33:07.266674] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-01T22:33:07.266800] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-01T22:33:07.268113] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-01T22:33:07.268209] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-01T22:33:07.288255] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-01T22:33:07.295883] [DEBUG] [LOCAL ] ZBH: Trimmed 73885 records to 51086 (keeping 200 days of data) [2025-10-01T22:33:07.357964] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-01T22:33:07.656261] [DEBUG] [LOCAL ] ZBH: Primary data saved (51086 records). [2025-10-01T22:33:07.656427] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-01T22:33:07.656665] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. ZBH took 34.8s. Estimated remaining: 1m 59s. Rate: 7.1 symbols/min [2025-10-01T22:33:08.102388] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-01T22:33:08.902404] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-01T22:33:09.393982] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-01T22:33:09.395956] [INFO ] [REMOTE ] YUMC: Full fetch complete (76178 records). [2025-10-01T22:33:09.396063] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-01T22:33:09.761496] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-01T22:33:09.810317] [INFO ] [REMOTE ] ZEPP: Full fetch complete (19054 records). [2025-10-01T22:33:09.838606] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-01T22:33:09.864811] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-01T22:33:09.878171] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-01T22:33:09.927662] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-01T22:33:09.985453] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-01T22:33:10.024378] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-01T22:33:10.081859] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-01T22:33:10.081404] [DEBUG] [LOCAL ] YUMC: Trimmed 76178 records to 52663 (keeping 200 days of data) [2025-10-01T22:33:10.441337] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-01T22:33:10.441854] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-01T22:33:10.444950] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-01T22:33:10.447998] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-01T22:33:10.452047] [DEBUG] [LOCAL ] ZEPP: Trimmed 19054 records to 17655 (keeping 200 days of data) [2025-10-01T22:33:10.704558] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17655 records). [2025-10-01T22:33:10.705731] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-01T22:33:10.706169] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. ZEPP took 34.1s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-01T22:33:10.799119] [DEBUG] [LOCAL ] YUMC: Primary data saved (52663 records). [2025-10-01T22:33:10.799269] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-01T22:33:10.799383] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. YUMC took 44.8s. Estimated remaining: 1m 42s. Rate: 7.1 symbols/min [2025-10-01T22:33:12.340555] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-01T22:33:12.353038] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-01T22:33:14.386255] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-01T22:33:14.398027] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-01T22:33:16.162102] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-01T22:33:16.174134] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-01T22:33:18.386756] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-01T22:33:18.397697] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-01T22:33:20.634210] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-01T22:33:20.646572] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-01T22:33:23.157380] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-01T22:33:23.169794] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-01T22:33:25.739034] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-01T22:33:25.751477] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-01T22:33:27.600926] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-01T22:33:27.602849] [INFO ] [REMOTE ] ZETA: Full fetch complete (77678 records). [2025-10-01T22:33:27.602976] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-01T22:33:28.058588] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-01T22:33:28.058701] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-01T22:33:28.059967] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-01T22:33:28.060032] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-01T22:33:28.061842] [DEBUG] [LOCAL ] ZETA: Trimmed 77678 records to 53597 (keeping 200 days of data) [2025-10-01T22:33:28.431106] [DEBUG] [LOCAL ] ZETA: Primary data saved (53597 records). [2025-10-01T22:33:28.431257] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-01T22:33:28.431359] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 28.6s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-01T22:33:29.046220] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:29.219060] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:29.245092] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:29.274405] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:29.322319] [DEBUG] [LOCAL ] ZH: Loaded 26655 existing records from primary storage. [2025-10-01T22:33:29.323083] [INFO ] [MAIN ] ZH: Loaded 26655 existing records. [2025-10-01T22:33:29.333022] [DEBUG] [LOCAL ] ZGN: Loaded 40703 existing records from primary storage. [2025-10-01T22:33:29.357458] [INFO ] [MAIN ] ZGN: Loaded 40703 existing records. [2025-10-01T22:33:29.537466] [DEBUG] [LOCAL ] ZIP: Loaded 44095 existing records from primary storage. [2025-10-01T22:33:29.607252] [INFO ] [MAIN ] ZIP: Loaded 44095 existing records. [2025-10-01T22:33:29.735953] [DEBUG] [LOCAL ] ZIM: Loaded 53516 existing records from primary storage. [2025-10-01T22:33:29.824515] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:29.862570] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-01T22:33:29.820684] [INFO ] [MAIN ] ZIM: Loaded 53516 existing records. [2025-10-01T22:33:29.914207] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:29.902053] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-01T22:33:29.978514] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-01T22:33:29.996423] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-01T22:33:30.007260] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-01T22:33:30.109581] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-01T22:33:30.260725] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-01T22:33:30.301720] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:30.323289] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-01T22:33:30.323429] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-01T22:33:30.332567] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-01T22:33:30.394947] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:30.416334] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-01T22:33:30.428429] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-01T22:33:30.459533] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-01T22:33:30.492156] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-01T22:33:30.585081] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-01T22:33:30.691024] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-01T22:33:31.375897] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:31.500720] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-01T22:33:31.846808] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:31.902935] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-01T22:33:31.978512] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:32.000037] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-01T22:33:32.063563] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:32.063922] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-01T22:33:32.746202] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-01T22:33:32.751533] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-01T22:33:33.066146] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-01T22:33:33.073217] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-01T22:33:33.435972] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-01T22:33:33.444979] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-01T22:33:33.804714] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-01T22:33:33.809883] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-01T22:33:33.913118] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-01T22:33:33.919829] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-01T22:33:34.228481] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-01T22:33:34.239748] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-01T22:33:34.619618] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T22:33:34.628265] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-01T22:33:34.946836] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-01T22:33:34.956313] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-01T22:33:34.977758] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-01T22:33:34.985869] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-01T22:33:35.888639] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-01T22:33:35.896519] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-01T22:33:36.090568] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-01T22:33:36.099289] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-01T22:33:36.510921] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-01T22:33:36.526474] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-01T22:33:36.560855] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-01T22:33:36.572176] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-01T22:33:37.086242] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-01T22:33:37.094341] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-01T22:33:37.212845] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-01T22:33:37.222448] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-01T22:33:37.939081] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-01T22:33:37.950773] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-01T22:33:38.105864] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-01T22:33:38.118426] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-01T22:33:38.613108] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-01T22:33:38.625526] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-01T22:33:38.834884] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-01T22:33:38.845222] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-01T22:33:39.249926] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-01T22:33:39.255760] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-01T22:33:39.613174] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-01T22:33:39.626340] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-01T22:33:40.416958] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-01T22:33:40.426637] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-01T22:33:40.488067] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-01T22:33:40.495256] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-01T22:33:40.610790] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-01T22:33:40.622301] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-01T22:33:41.124134] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-01T22:33:41.133282] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-01T22:33:41.853349] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-01T22:33:41.855081] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-01T22:33:41.870361] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-01T22:33:41.871941] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-01T22:33:42.700373] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-01T22:33:42.710817] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-01T22:33:42.919902] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-01T22:33:42.932330] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-01T22:33:43.177672] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-01T22:33:43.185310] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-01T22:33:43.214622] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-01T22:33:43.302400] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-01T22:33:44.038705] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-01T22:33:44.039720] [INFO ] [REMOTE ] ZH: Full fetch complete (40119 records). [2025-10-01T22:33:44.039801] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-01T22:33:44.451778] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-01T22:33:44.451863] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-01T22:33:44.452701] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-01T22:33:44.452762] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-01T22:33:44.453697] [DEBUG] [LOCAL ] ZH: Trimmed 40119 records to 26456 (keeping 200 days of data) [2025-10-01T22:33:44.572541] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-01T22:33:44.584399] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-01T22:33:44.649606] [DEBUG] [LOCAL ] ZH: Primary data saved (26456 records). [2025-10-01T22:33:44.649801] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-01T22:33:44.649903] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 16.2s. Estimated remaining: 1m 25s. Rate: 7.1 symbols/min [2025-10-01T22:33:44.849146] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-01T22:33:44.883825] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:44.906970] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-01T22:33:44.925346] [DEBUG] [LOCAL ] ZK: Loaded 39656 existing records from primary storage. [2025-10-01T22:33:44.925685] [INFO ] [MAIN ] ZK: Loaded 39656 existing records. [2025-10-01T22:33:45.129251] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:45.129529] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-01T22:33:45.129580] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-01T22:33:45.130611] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-01T22:33:45.130715] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-01T22:33:45.536762] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:45.571505] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-01T22:33:45.702396] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-01T22:33:46.191578] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-01T22:33:46.502442] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-01T22:33:46.626003] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-01T22:33:47.302386] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-01T22:33:47.529346] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-01T22:33:47.531143] [INFO ] [REMOTE ] ZIP: Full fetch complete (59608 records). [2025-10-01T22:33:47.531250] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-01T22:33:47.763067] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-01T22:33:48.071841] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-01T22:33:48.071929] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-01T22:33:48.072948] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-01T22:33:48.073013] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-01T22:33:48.074362] [DEBUG] [LOCAL ] ZIP: Trimmed 59608 records to 44097 (keeping 200 days of data) [2025-10-01T22:33:48.125728] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-01T22:33:48.299370] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-01T22:33:48.330435] [INFO ] [REMOTE ] ZGN: Full fetch complete (58192 records). [2025-10-01T22:33:48.338264] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-01T22:33:48.457154] [DEBUG] [LOCAL ] ZIP: Primary data saved (44097 records). [2025-10-01T22:33:48.460444] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-01T22:33:48.466123] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZIP took 20.0s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-01T22:33:48.843828] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:48.904761] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-01T22:33:48.962388] [DEBUG] [LOCAL ] ZKH: Loaded 7937 existing records from primary storage. [2025-10-01T22:33:48.964804] [INFO ] [MAIN ] ZKH: Loaded 7937 existing records. [2025-10-01T22:33:49.050771] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-01T22:33:49.075810] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-01T22:33:49.083698] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-01T22:33:49.090719] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-01T22:33:49.147689] [DEBUG] [LOCAL ] ZGN: Trimmed 58192 records to 40685 (keeping 200 days of data) [2025-10-01T22:33:49.258681] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:49.297268] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-01T22:33:49.298088] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-01T22:33:49.308728] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-01T22:33:49.309364] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-01T22:33:49.619669] [DEBUG] [LOCAL ] ZGN: Primary data saved (40685 records). [2025-10-01T22:33:49.619938] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-01T22:33:49.639395] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZGN took 21.2s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-01T22:33:50.052498] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:50.073908] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-01T22:33:50.133183] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-01T22:33:50.162144] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:50.211536] [DEBUG] [LOCAL ] ZTO: Loaded 49965 existing records from primary storage. [2025-10-01T22:33:50.211918] [INFO ] [MAIN ] ZTO: Loaded 49965 existing records. [2025-10-01T22:33:50.404174] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:50.404394] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-01T22:33:50.404444] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-01T22:33:50.405698] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-01T22:33:50.405761] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-01T22:33:50.511080] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-01T22:33:50.798332] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:51.225538] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-01T22:33:51.302371] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-01T22:33:51.675499] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-10-01T22:33:51.708735] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-01T22:33:51.819510] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-01T22:33:52.102427] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-01T22:33:52.907901] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-01T22:33:52.911454] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-01T22:33:53.011320] [DEBUG] [REMOTE ] ZIM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-01T22:33:53.011683] [WARN ] [REMOTE ] ZIM: No data returned for month 2025-07 [2025-10-01T22:33:53.011783] [FATAL] [REMOTE ] ZIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-01T22:33:53.011865] [FATAL] [MAIN ] ZIM: Failed to fetch primary data. [2025-10-01T22:33:53.011929] [WARN ] [MAIN ] ZIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-01T22:33:53.012001] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-01T22:33:53.012066] [DEBUG] [LOCAL ] ZIM: No primary data file found to delete. [2025-10-01T22:33:53.012102] [INFO ] [LOCAL ] ZIM: Starting deletion of derivative data. [2025-10-01T22:33:53.012544] [DEBUG] [LOCAL ] ZIM: Deleted derivative data file. [2025-10-01T22:33:53.012634] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 24.5s. Estimated remaining: 59.3s. Rate: 7.1 symbols/min [2025-10-01T22:33:53.204987] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:33:53.228329] [DEBUG] [LOCAL ] ZTR: Loaded 16662 existing records from primary storage. [2025-10-01T22:33:53.228584] [INFO ] [MAIN ] ZTR: Loaded 16662 existing records. [2025-10-01T22:33:53.435122] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:33:53.435357] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-01T22:33:53.435406] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-01T22:33:53.436036] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-01T22:33:53.436097] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-01T22:33:53.707534] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-01T22:33:53.831786] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:33:54.502432] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-01T22:33:55.302361] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-01T22:33:55.398709] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-01T22:33:55.833916] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-01T22:33:56.102399] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-01T22:33:56.902353] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-01T22:33:56.993733] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-01T22:33:57.635328] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-01T22:33:57.702409] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-01T22:33:57.822174] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-01T22:33:58.502406] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-01T22:33:59.126105] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-01T22:33:59.308863] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-01T22:33:59.314540] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-01T22:34:00.102382] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-01T22:34:00.802455] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-01T22:34:00.902357] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-01T22:34:01.057353] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-01T22:34:01.702441] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-01T22:34:02.298537] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-01T22:34:02.502394] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-01T22:34:02.629231] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-01T22:34:03.302387] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-01T22:34:03.874688] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T22:34:04.102413] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-01T22:34:04.902359] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-01T22:34:05.164250] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-01T22:34:05.270162] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-01T22:34:05.702412] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-01T22:34:06.020813] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-01T22:34:06.502377] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-01T22:34:06.641186] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-01T22:34:07.302395] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-01T22:34:07.942535] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-01T22:34:08.102419] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-01T22:34:08.769608] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-01T22:34:08.902439] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-01T22:34:09.129541] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-01T22:34:09.702386] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-01T22:34:10.507677] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-01T22:34:10.513894] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-01T22:34:10.539748] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-01T22:34:11.302366] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-01T22:34:11.620361] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-01T22:34:12.021756] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-01T22:34:12.102393] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-01T22:34:12.902375] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-01T22:34:13.708101] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-01T22:34:13.738563] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-01T22:34:13.750474] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-01T22:34:14.502432] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-01T22:34:15.106612] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-01T22:34:15.302393] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-01T22:34:15.387639] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-01T22:34:16.102349] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-01T22:34:16.902371] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-01T22:34:17.113270] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-01T22:34:17.116170] [INFO ] [REMOTE ] ZK: Full fetch complete (57052 records). [2025-10-01T22:34:17.116347] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-01T22:34:17.355335] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-01T22:34:17.648928] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-01T22:34:17.649129] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-01T22:34:17.650556] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-01T22:34:17.650668] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-01T22:34:17.652325] [DEBUG] [LOCAL ] ZK: Trimmed 57052 records to 39609 (keeping 200 days of data) [2025-10-01T22:34:17.718220] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-01T22:34:17.773030] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-01T22:34:17.930819] [DEBUG] [LOCAL ] ZK: Primary data saved (39609 records). [2025-10-01T22:34:17.930963] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-01T22:34:17.931047] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZK took 33.3s. Estimated remaining: 50.9s. Rate: 7.1 symbols/min [2025-10-01T22:34:18.124086] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:34:18.162596] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-01T22:34:18.163506] [INFO ] [REMOTE ] ZKH: Full fetch complete (11843 records). [2025-10-01T22:34:18.163602] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-01T22:34:18.307434] [DEBUG] [LOCAL ] ZTS: Loaded 52994 existing records from primary storage. [2025-10-01T22:34:18.338330] [INFO ] [MAIN ] ZTS: Loaded 52994 existing records. [2025-10-01T22:34:18.512735] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-01T22:34:18.752261] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:34:18.766825] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-01T22:34:18.776244] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-01T22:34:18.794159] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-01T22:34:18.794261] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-01T22:34:18.794608] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-01T22:34:18.794692] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-01T22:34:18.795286] [DEBUG] [LOCAL ] ZKH: Trimmed 11843 records to 7814 (keeping 200 days of data) [2025-10-01T22:34:18.795372] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-01T22:34:18.795727] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-01T22:34:19.022146] [DEBUG] [LOCAL ] ZKH: Primary data saved (7814 records). [2025-10-01T22:34:19.027004] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-01T22:34:19.027125] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZKH took 30.6s. Estimated remaining: 42.4s. Rate: 7.1 symbols/min [2025-10-01T22:34:19.311852] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-01T22:34:19.420457] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:34:19.447949] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:34:19.488182] [DEBUG] [LOCAL ] ZVIA: Loaded 35429 existing records from primary storage. [2025-10-01T22:34:19.488518] [INFO ] [MAIN ] ZVIA: Loaded 35429 existing records. [2025-10-01T22:34:19.684296] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:34:19.684529] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-01T22:34:19.684578] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-01T22:34:19.685288] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-01T22:34:19.685351] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-01T22:34:20.079041] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:34:20.102372] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-01T22:34:20.293074] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-01T22:34:20.484378] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-01T22:34:20.902454] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-01T22:34:21.702402] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-01T22:34:21.945289] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-01T22:34:22.502411] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-01T22:34:22.675438] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-01T22:34:23.258111] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-01T22:34:23.302395] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-01T22:34:24.102392] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-01T22:34:24.441701] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-01T22:34:24.838675] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-01T22:34:24.902406] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-01T22:34:25.204906] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-01T22:34:25.206405] [INFO ] [REMOTE ] ZTO: Full fetch complete (73047 records). [2025-10-01T22:34:25.206518] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-01T22:34:25.657892] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-01T22:34:25.658010] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-01T22:34:25.659239] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-01T22:34:25.659308] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-01T22:34:25.660887] [DEBUG] [LOCAL ] ZTO: Trimmed 73047 records to 49877 (keeping 200 days of data) [2025-10-01T22:34:25.716918] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-01T22:34:25.987908] [DEBUG] [LOCAL ] ZTO: Primary data saved (49877 records). [2025-10-01T22:34:25.988045] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-01T22:34:25.988164] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTO took 36.3s. Estimated remaining: 33.9s. Rate: 7.1 symbols/min [2025-10-01T22:34:26.169293] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-23 to 2025-10-01. [2025-10-01T22:34:26.210018] [DEBUG] [LOCAL ] ZWS: Loaded 42322 existing records from primary storage. [2025-10-01T22:34:26.210337] [INFO ] [MAIN ] ZWS: Loaded 42322 existing records. [2025-10-01T22:34:26.418901] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-14, but need from 2024-12-12 for 200 day retention. Performing full refresh. [2025-10-01T22:34:26.419109] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-01T22:34:26.419159] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-01T22:34:26.420138] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-01T22:34:26.420201] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-01T22:34:26.509056] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-01T22:34:26.834279] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-12 to 2025-10-01 (requires 11 months of data pull). [2025-10-01T22:34:26.869339] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-01T22:34:27.266934] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-01T22:34:27.302394] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-01T22:34:27.321841] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-01T22:34:28.102386] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-01T22:34:28.902360] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-01T22:34:29.033070] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-01T22:34:29.637885] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-01T22:34:29.702375] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-01T22:34:29.883690] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-01T22:34:30.502434] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-01T22:34:30.665633] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-01T22:34:31.302450] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-01T22:34:32.102408] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-01T22:34:32.324535] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-01T22:34:32.742588] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-01T22:34:32.743883] [INFO ] [REMOTE ] ZTR: Full fetch complete (26902 records). [2025-10-01T22:34:32.744027] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-01T22:34:32.908638] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-01T22:34:33.133828] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-01T22:34:33.218729] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-01T22:34:33.218830] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-01T22:34:33.219460] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-01T22:34:33.219537] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-01T22:34:33.220498] [DEBUG] [LOCAL ] ZTR: Trimmed 26902 records to 16679 (keeping 200 days of data) [2025-10-01T22:34:33.331272] [DEBUG] [LOCAL ] ZTR: Primary data saved (16679 records). [2025-10-01T22:34:33.331423] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-01T22:34:33.331532] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTR took 40.3s. Estimated remaining: 25.4s. Rate: 7.1 symbols/min [2025-10-01T22:34:33.702396] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-01T22:34:34.502412] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-01T22:34:35.214231] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-01T22:34:35.302432] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-01T22:34:35.526384] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-01T22:34:35.869404] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-01T22:34:36.102389] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-01T22:34:36.775080] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-01T22:34:36.902392] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-01T22:34:37.529992] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-01T22:34:37.702388] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-01T22:34:38.502408] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-01T22:34:38.695450] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-01T22:34:39.302380] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-01T22:34:39.641324] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-01T22:34:40.018110] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-01T22:34:40.102377] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-01T22:34:40.726375] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-01T22:34:40.902397] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-01T22:34:41.530984] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-01T22:34:41.702398] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-01T22:34:42.390540] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-01T22:34:42.502372] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-01T22:34:42.572139] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-01T22:34:42.573551] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52637 records). [2025-10-01T22:34:42.573663] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-01T22:34:43.003579] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-01T22:34:43.003775] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-01T22:34:43.004957] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-01T22:34:43.005075] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-01T22:34:43.006791] [DEBUG] [LOCAL ] ZVIA: Trimmed 52637 records to 35420 (keeping 200 days of data) [2025-10-01T22:34:43.227113] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35420 records). [2025-10-01T22:34:43.227260] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-01T22:34:43.227361] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZVIA took 24.2s. Estimated remaining: 17.0s. Rate: 7.1 symbols/min [2025-10-01T22:34:43.302397] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-01T22:34:43.861794] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-01T22:34:44.102437] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-01T22:34:44.901612] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-01T22:34:44.912974] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-01T22:34:46.117157] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-01T22:34:46.127550] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-01T22:34:46.858498] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-01T22:34:46.871748] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-01T22:34:47.416244] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-01T22:34:47.427506] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-01T22:34:48.181159] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-01T22:34:48.191342] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-01T22:34:48.498161] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-01T22:34:48.499694] [INFO ] [REMOTE ] ZWS: Full fetch complete (62011 records). [2025-10-01T22:34:48.499808] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-01T22:34:48.986832] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-01T22:34:48.987163] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-01T22:34:48.988316] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-01T22:34:48.988428] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-01T22:34:48.990717] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-01T22:34:49.003724] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-01T22:34:49.003928] [DEBUG] [LOCAL ] ZWS: Trimmed 62011 records to 42295 (keeping 200 days of data) [2025-10-01T22:34:49.281056] [DEBUG] [LOCAL ] ZWS: Primary data saved (42295 records). [2025-10-01T22:34:49.281210] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-01T22:34:49.281323] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZWS took 23.3s. Estimated remaining: 8.5s. Rate: 7.1 symbols/min [2025-10-01T22:34:49.875849] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-01T22:34:49.887551] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-01T22:34:50.163220] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-01T22:34:50.164877] [INFO ] [REMOTE ] ZTS: Full fetch complete (76700 records). [2025-10-01T22:34:50.165006] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-01T22:34:50.587874] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-01T22:34:50.587964] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-01T22:34:50.589278] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-01T22:34:50.589347] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-01T22:34:50.590933] [DEBUG] [LOCAL ] ZTS: Trimmed 76700 records to 52994 (keeping 200 days of data) [2025-10-01T22:34:50.950773] [DEBUG] [LOCAL ] ZTS: Primary data saved (52994 records). [2025-10-01T22:34:50.950913] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-01T22:34:50.952488] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZTS took 33.0s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-01T22:34:50.955971] [INFO ] [MAIN ] Parallel update completed in 5h 34m 48s [2025-10-01T22:34:50.956057] [WARN ] [MAIN ] Failed symbols (784): AAMI, AAM, AAUC, ABCB, ABBV, ABM, ACA, ACEL, AD, ACV... [2025-10-01T22:34:50.956129] [INFO ] [MAIN ] Update success rate: 66.9% (1587/2371 symbols) [2025-10-01T22:34:51.549538] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1587/2371 @ 66.93%)' [2025-10-01T22:34:51.550158] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-01T22:34:51.550231] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-01T22:34:51.550271] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-01T22:34:51.550363] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-01T22:34:51.550405] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-01T22:34:53.065110] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-01T22:34:53.065267] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-01T22:34:53.065522] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-01T22:34:53.066229] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-01T22:34:53.066291] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-01T22:34:53.066327] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-01T22:34:53.066389] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-01T22:34:53.066425] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-01T22:34:53.066458] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-01T22:34:53.066878] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-01T22:34:53.066984] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-01T22:34:53.067189] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-01T22:34:53.067259] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-01T22:34:53.067322] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-01T22:34:53.067424] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-01T22:34:53.087456] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-01T22:34:53.106253] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-01T22:34:53.106416] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-01T22:34:53.106454] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-01T22:34:53.106484] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-01T22:34:53.106539] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-01T22:34:53.106572] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-01T22:34:53.106608] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-01T22:34:53.107806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-01T22:34:53.108287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-01T22:34:53.108677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-01T22:34:53.109062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-01T22:34:53.109380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-01T22:34:53.109756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-01T22:34:53.110063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-01T22:34:53.110351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-01T22:34:53.110686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-01T22:34:53.111016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-01T22:34:53.111666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-01T22:34:53.112100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-01T22:34:53.112425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-01T22:34:53.112806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-01T22:34:53.113187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-01T22:34:53.113499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-01T22:34:53.113776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-01T22:34:53.114132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-01T22:34:53.114544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-01T22:34:53.114838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-01T22:34:53.115081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-01T22:34:53.115390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-01T22:34:53.115765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-01T22:34:53.116119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-01T22:34:53.116488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-01T22:34:53.116785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-01T22:34:53.117111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-01T22:34:53.117426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-01T22:34:53.117839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-01T22:34:53.118235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-01T22:34:53.118596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-01T22:34:53.118892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-01T22:34:53.119142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-01T22:34:53.119422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-01T22:34:53.119684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-01T22:34:53.119991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-01T22:34:53.120302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-01T22:34:53.120594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-01T22:34:53.120933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-01T22:34:53.121229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-01T22:34:53.121571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-01T22:34:53.121966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-01T22:34:53.122214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-01T22:34:53.122539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-01T22:34:53.122837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-01T22:34:53.123094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-01T22:34:53.123408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-01T22:34:53.123831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-01T22:34:53.124196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-01T22:34:53.124548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-01T22:34:53.124882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-01T22:34:53.125135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-01T22:34:53.125414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-01T22:34:53.125673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-01T22:34:53.125981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-01T22:34:53.126414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-01T22:34:53.126785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-01T22:34:53.127087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-01T22:34:53.127347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-01T22:34:53.127709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-01T22:34:53.128020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-01T22:34:53.128374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-01T22:34:53.128622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-01T22:34:53.129000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-01T22:34:53.129390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-01T22:34:53.129903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-01T22:34:53.130182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-01T22:34:53.130419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-01T22:34:53.130813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-01T22:34:53.131090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-01T22:34:53.131369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-01T22:34:53.131882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-01T22:34:53.132267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-01T22:34:53.132592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-01T22:34:53.132945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-01T22:34:53.133301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-01T22:34:53.133557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-01T22:34:53.133807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-01T22:34:53.134032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-01T22:34:53.134270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-01T22:34:53.134569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-01T22:34:53.134973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-01T22:34:53.135276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-01T22:34:53.135494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-01T22:34:53.135824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-01T22:34:53.136063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-01T22:34:53.136382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-01T22:34:53.136668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-01T22:34:53.136917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-01T22:34:53.137214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-01T22:34:53.137409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-01T22:34:53.137878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-01T22:34:53.138195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-01T22:34:53.138495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-01T22:34:53.138834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-01T22:34:53.139078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-01T22:34:53.139316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-01T22:34:53.139609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-01T22:34:53.139980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-01T22:34:53.140217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-01T22:34:53.140576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-01T22:34:53.141111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-01T22:34:53.141895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-01T22:34:53.142247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-01T22:34:53.142460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-01T22:34:53.142785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-01T22:34:53.143059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-01T22:34:53.143396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-01T22:34:53.143694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-01T22:34:53.143966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-01T22:34:53.144241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-01T22:34:53.144535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-01T22:34:53.144862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-01T22:34:53.145090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-01T22:34:53.145400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-01T22:34:53.146043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-01T22:34:53.146302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-01T22:34:53.146541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-01T22:34:53.146805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-01T22:34:53.147077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-01T22:34:53.147302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-01T22:34:53.147540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-01T22:34:53.147855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-01T22:34:53.148114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-01T22:34:53.148379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-01T22:34:53.148630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-01T22:34:53.148944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-01T22:34:53.149325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-01T22:34:53.149545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-01T22:34:53.149776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-01T22:34:53.150027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-01T22:34:53.150384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-01T22:34:53.150759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-01T22:34:53.151059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-01T22:34:53.151381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-01T22:34:53.151749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-01T22:34:53.152086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-01T22:34:53.152467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-01T22:34:53.152877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-01T22:34:53.153203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-01T22:34:53.153493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-01T22:34:53.153919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-01T22:34:53.154302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-01T22:34:53.154609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-01T22:34:53.154972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-01T22:34:53.155213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-01T22:34:53.155451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-01T22:34:53.155710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-01T22:34:53.155966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-01T22:34:53.156201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-01T22:34:53.156508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-01T22:34:53.156804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-01T22:34:53.156998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-01T22:34:53.157322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-01T22:34:53.157590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-01T22:34:53.157874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-01T22:34:53.158125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-01T22:34:53.158682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-01T22:34:53.159097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-01T22:34:53.159411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-01T22:34:53.159767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-01T22:34:53.160024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-01T22:34:53.160217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-01T22:34:53.160492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-01T22:34:53.160767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-01T22:34:53.161006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-01T22:34:53.161329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-01T22:34:53.161575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-01T22:34:53.161990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-01T22:34:53.162310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-01T22:34:53.162580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-01T22:34:53.162861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-01T22:34:53.163158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-01T22:34:53.163574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-01T22:34:53.163859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-01T22:34:53.164093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-01T22:34:53.164344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-01T22:34:53.164702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-01T22:34:53.164952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-01T22:34:53.165263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-01T22:34:53.165517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-01T22:34:53.165831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-01T22:34:53.166127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-01T22:34:53.166359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-01T22:34:53.166573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-01T22:34:53.166888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-01T22:34:53.167164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-01T22:34:53.167426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-01T22:34:53.167754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-01T22:34:53.168105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-01T22:34:53.168380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-01T22:34:53.168615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-01T22:34:53.168983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-01T22:34:53.169208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-01T22:34:53.169521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-01T22:34:53.170292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-01T22:34:53.170550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-01T22:34:53.170898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-01T22:34:53.171119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-01T22:34:53.171346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-01T22:34:53.171638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-01T22:34:53.171903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-01T22:34:53.172168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-01T22:34:53.172358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-01T22:34:53.172692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-01T22:34:53.173004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-01T22:34:53.173264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-01T22:34:53.173530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-01T22:34:53.173818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-01T22:34:53.174077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-01T22:34:53.174360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-01T22:34:53.174602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-01T22:34:53.174830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-01T22:34:53.175084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-01T22:34:53.175507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-01T22:34:53.175699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-01T22:34:53.175884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-01T22:34:53.176166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-01T22:34:53.176345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-01T22:34:53.176583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-01T22:34:53.176940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-01T22:34:53.177147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-01T22:34:53.177350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-01T22:34:53.177855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-01T22:34:53.178146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-01T22:34:53.178391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-01T22:34:53.178678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-01T22:34:53.179003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-01T22:34:53.179231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-01T22:34:53.179486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-01T22:34:53.179723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-01T22:34:53.179960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-01T22:34:53.180166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-01T22:34:53.180412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-01T22:34:53.180733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-01T22:34:53.180962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-01T22:34:53.181221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-01T22:34:53.181471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-01T22:34:53.181731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-01T22:34:53.181945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-01T22:34:53.182228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-01T22:34:53.182478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-01T22:34:53.182684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-01T22:34:53.182974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-01T22:34:53.183260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-01T22:34:53.183594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-01T22:34:53.183825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-01T22:34:53.184111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-01T22:34:53.184390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-01T22:34:53.184705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-01T22:34:53.185223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-01T22:34:53.185394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-01T22:34:53.185831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-01T22:34:53.186126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-01T22:34:53.186380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-01T22:34:53.186610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-01T22:34:53.186859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-01T22:34:53.187114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-01T22:34:53.187284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-01T22:34:53.187500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-01T22:34:53.187756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-01T22:34:53.187954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-01T22:34:53.188187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-01T22:34:53.188475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-01T22:34:53.188767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-01T22:34:53.189034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-01T22:34:53.189261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-01T22:34:53.189540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-01T22:34:53.189784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-01T22:34:53.190013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-01T22:34:53.190326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-10-01T22:34:53.190630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-01T22:34:53.190923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-01T22:34:53.191136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-01T22:34:53.191351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-01T22:34:53.191548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-01T22:34:53.191896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-01T22:34:53.192097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-01T22:34:53.192346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-01T22:34:53.192619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-01T22:34:53.192977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-01T22:34:53.193226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-01T22:34:53.193482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-01T22:34:53.193788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-01T22:34:53.194125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-01T22:34:53.194407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-01T22:34:53.194694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-01T22:34:53.194916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-01T22:34:53.195132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-01T22:34:53.196049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-01T22:34:53.196322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-01T22:34:53.196529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-01T22:34:53.196814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-01T22:34:53.197085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-01T22:34:53.197311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-01T22:34:53.197573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-01T22:34:53.197820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-01T22:34:53.198006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-01T22:34:53.198304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-01T22:34:53.198555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-01T22:34:53.198774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-01T22:34:53.198981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-01T22:34:53.199291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-01T22:34:53.199514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-01T22:34:53.199823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-01T22:34:53.200063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-01T22:34:53.200253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-01T22:34:53.200493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-01T22:34:53.200791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-01T22:34:53.201044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-01T22:34:53.201299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-01T22:34:53.201528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-01T22:34:53.201740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-01T22:34:53.201949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-01T22:34:53.202178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-01T22:34:53.202468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-01T22:34:53.202712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-01T22:34:53.202931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-01T22:34:53.203456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-01T22:34:53.203707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-01T22:34:53.203923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-01T22:34:53.204113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-01T22:34:53.204372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-01T22:34:53.204856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-01T22:34:53.205025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-01T22:34:53.205231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-01T22:34:53.205458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-01T22:34:53.205686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-01T22:34:53.205992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-01T22:34:53.206241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-01T22:34:53.206481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-01T22:34:53.206695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-01T22:34:53.206946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-01T22:34:53.207183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-01T22:34:53.207396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-01T22:34:53.207632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-01T22:34:53.207910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-01T22:34:53.208133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-01T22:34:53.208454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-01T22:34:53.208805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-01T22:34:53.209031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-01T22:34:53.209229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-01T22:34:53.209449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-01T22:34:53.209721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-01T22:34:53.209940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-01T22:34:53.210199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-01T22:34:53.210412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-01T22:34:53.210688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-10-01T22:34:53.210921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-01T22:34:53.211173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-01T22:34:53.211377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-01T22:34:53.211602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-01T22:34:53.211921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-01T22:34:53.212151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-01T22:34:53.212362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-01T22:34:53.212549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-01T22:34:53.213073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-01T22:34:53.213329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-01T22:34:53.213525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-01T22:34:53.213860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-10-01T22:34:53.214112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-01T22:34:53.214329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-01T22:34:53.214619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-01T22:34:53.214833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-01T22:34:53.215069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-01T22:34:53.215349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-01T22:34:53.215851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-01T22:34:53.216094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-01T22:34:53.216315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-01T22:34:53.216533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-01T22:34:53.216873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-01T22:34:53.217086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-01T22:34:53.217373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-01T22:34:53.217560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-01T22:34:53.217798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-01T22:34:53.218112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-01T22:34:53.218317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-01T22:34:53.218506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-01T22:34:53.218736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-01T22:34:53.218918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-01T22:34:53.219109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-01T22:34:53.219329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-01T22:34:53.219532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-01T22:34:53.220077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-01T22:34:53.220273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-01T22:34:53.220475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-01T22:34:53.220707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-01T22:34:53.220924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-01T22:34:53.221106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-01T22:34:53.221393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-01T22:34:53.221574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-01T22:34:53.221756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-01T22:34:53.221980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-01T22:34:53.222198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-01T22:34:53.222491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-01T22:34:53.222771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-01T22:34:53.222940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-10-01T22:34:53.223098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-01T22:34:53.223300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-01T22:34:53.223520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-01T22:34:53.223757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-01T22:34:53.223963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-01T22:34:53.224280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-01T22:34:53.224523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-01T22:34:53.224908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-01T22:34:53.225123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-01T22:34:53.225322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-01T22:34:53.225563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-01T22:34:53.225805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-01T22:34:53.225985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-01T22:34:53.226166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-01T22:34:53.226492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-01T22:34:53.226685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-01T22:34:53.226883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-01T22:34:53.227196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-01T22:34:53.227453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-01T22:34:53.227702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-01T22:34:53.227892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-01T22:34:53.228180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-01T22:34:53.228478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-01T22:34:53.228767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-01T22:34:53.228943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-01T22:34:53.229139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-01T22:34:53.229325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-01T22:34:53.229520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-01T22:34:53.229774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-01T22:34:53.230018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-01T22:34:53.230317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-01T22:34:53.230584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-01T22:34:53.230876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-01T22:34:53.231035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-01T22:34:53.231219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-01T22:34:53.231463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-01T22:34:53.231857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-01T22:34:53.232052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-01T22:34:53.232240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-01T22:34:53.232411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-01T22:34:53.232616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-01T22:34:53.232937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-01T22:34:53.233104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-01T22:34:53.233318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-01T22:34:53.233561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-01T22:34:53.234082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-01T22:34:53.234315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-01T22:34:53.234499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-01T22:34:53.234716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-01T22:34:53.234907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-01T22:34:53.235146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-01T22:34:53.235415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-01T22:34:53.235638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-01T22:34:53.235891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-01T22:34:53.236100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-01T22:34:53.236316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-01T22:34:53.236527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-01T22:34:53.236744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-01T22:34:53.236943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-01T22:34:53.237151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-01T22:34:53.237344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-01T22:34:53.237886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-01T22:34:53.238109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-01T22:34:53.238363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-01T22:34:53.238636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-01T22:34:53.238865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-01T22:34:53.239101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-01T22:34:53.239308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-01T22:34:53.239548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-01T22:34:53.239810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-01T22:34:53.240139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-01T22:34:53.240371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-01T22:34:53.240613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-01T22:34:53.241188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-01T22:34:53.241341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-01T22:34:53.241517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-01T22:34:53.241724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-01T22:34:53.241914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-01T22:34:53.242168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-01T22:34:53.242411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-01T22:34:53.242744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-01T22:34:53.242968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-01T22:34:53.243155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-01T22:34:53.243375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-01T22:34:53.243574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-01T22:34:53.243838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-01T22:34:53.244050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-01T22:34:53.244268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-01T22:34:53.244552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-01T22:34:53.245069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-01T22:34:53.245327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-01T22:34:53.245508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-01T22:34:53.245763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-01T22:34:53.245993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-01T22:34:53.246261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-01T22:34:53.246480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-01T22:34:53.246746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-01T22:34:53.247023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-01T22:34:53.247206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-01T22:34:53.247441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-01T22:34:53.247633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-01T22:34:53.247946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-01T22:34:53.248249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-01T22:34:53.248478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-01T22:34:53.248918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-01T22:34:53.249171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-01T22:34:53.249370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-01T22:34:53.249630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-01T22:34:53.249887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-01T22:34:53.250176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-01T22:34:53.250338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-01T22:34:53.250537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-01T22:34:53.250711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-01T22:34:53.250972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-01T22:34:53.251157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-01T22:34:53.251406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-01T22:34:53.251583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-01T22:34:53.251785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-01T22:34:53.251995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-01T22:34:53.252220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-01T22:34:53.252395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-01T22:34:53.252563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-01T22:34:53.252898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-01T22:34:53.253054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-01T22:34:53.253310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-01T22:34:53.253535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-01T22:34:53.253781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-01T22:34:53.253970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-01T22:34:53.254182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-01T22:34:53.254391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-01T22:34:53.254569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-01T22:34:53.254802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-01T22:34:53.255049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-01T22:34:53.255259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-01T22:34:53.255415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-01T22:34:53.255692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-01T22:34:53.256276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-01T22:34:53.256546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-01T22:34:53.256738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-01T22:34:53.256946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-01T22:34:53.257143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-01T22:34:53.257365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-01T22:34:53.257601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-01T22:34:53.257893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-01T22:34:53.258107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-01T22:34:53.258264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-01T22:34:53.258476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-01T22:34:53.258689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-01T22:34:53.258865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-01T22:34:53.259107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-01T22:34:53.259366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-01T22:34:53.259564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-01T22:34:53.259778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-01T22:34:53.259943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-01T22:34:53.260170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-01T22:34:53.260383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-01T22:34:53.260594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-01T22:34:53.260911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-01T22:34:53.261149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-01T22:34:53.261348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-01T22:34:53.261537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-01T22:34:53.261757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-01T22:34:53.261914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-01T22:34:53.262191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-01T22:34:53.262444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-01T22:34:53.262629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-01T22:34:53.262849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-01T22:34:53.263058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-01T22:34:53.263235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-01T22:34:53.263450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-01T22:34:53.263691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-01T22:34:53.263869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-01T22:34:53.264039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-01T22:34:53.264218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-01T22:34:53.264378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-01T22:34:53.264628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-01T22:34:53.264864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-01T22:34:53.265082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-01T22:34:53.265265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-01T22:34:53.265503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-01T22:34:53.265792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-01T22:34:53.266040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-01T22:34:53.266312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-01T22:34:53.266512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-10-01T22:34:53.266711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-01T22:34:53.267038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-01T22:34:53.267221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-01T22:34:53.267692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-01T22:34:53.267916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-01T22:34:53.268124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-01T22:34:53.268322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-01T22:34:53.268520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-01T22:34:53.268841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-01T22:34:53.269023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-01T22:34:53.269188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-01T22:34:53.269425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-01T22:34:53.269632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-01T22:34:53.269842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-01T22:34:53.270039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-01T22:34:53.270260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-01T22:34:53.270462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-01T22:34:53.270696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-01T22:34:53.270882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-01T22:34:53.271058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-01T22:34:53.271268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-01T22:34:53.271474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-01T22:34:53.271688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-01T22:34:53.271864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-01T22:34:53.272059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-01T22:34:53.272226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-01T22:34:53.272417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-01T22:34:53.272602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-01T22:34:53.273117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-01T22:34:53.273328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-01T22:34:53.273607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-01T22:34:53.274082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-01T22:34:53.274311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-01T22:34:53.274541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-01T22:34:53.274752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-01T22:34:53.275048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-01T22:34:53.275202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-01T22:34:53.275484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-01T22:34:53.275765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-01T22:34:53.276007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-01T22:34:53.276372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-01T22:34:53.276586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-01T22:34:53.276869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-01T22:34:53.277038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-01T22:34:53.277240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-01T22:34:53.277516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-01T22:34:53.277753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-01T22:34:53.277946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-01T22:34:53.278201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-01T22:34:53.278430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-10-01T22:34:53.278640] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-01T22:34:53.278835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-01T22:34:53.278984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-01T22:34:53.279236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-10-01T22:34:53.279397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-01T22:34:53.279585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-01T22:34:53.279889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-01T22:34:53.280068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-01T22:34:53.280238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-01T22:34:53.280469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-01T22:34:53.280633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-01T22:34:53.280869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-01T22:34:53.281084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-01T22:34:53.281242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-01T22:34:53.281426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-01T22:34:53.281628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-01T22:34:53.281853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-01T22:34:53.282065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-01T22:34:53.282356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-01T22:34:53.282551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-01T22:34:53.282835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-01T22:34:53.283078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-01T22:34:53.283237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-01T22:34:53.283453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-01T22:34:53.283624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-01T22:34:53.283826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-01T22:34:53.284033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-01T22:34:53.284200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-01T22:34:53.284363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-01T22:34:53.284528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-01T22:34:53.284755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-01T22:34:53.284987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-01T22:34:53.285215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-01T22:34:53.285585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-01T22:34:53.285896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-01T22:34:53.286073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-01T22:34:53.286248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-01T22:34:53.286536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-01T22:34:53.286936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-01T22:34:53.287107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-01T22:34:53.287258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-01T22:34:53.287560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-01T22:34:53.287839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-01T22:34:53.288018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-01T22:34:53.288286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-01T22:34:53.288486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-01T22:34:53.288754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-01T22:34:53.288941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-01T22:34:53.289119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-01T22:34:53.289353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-01T22:34:53.289539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-01T22:34:53.289740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-01T22:34:53.289939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-01T22:34:53.290129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-01T22:34:53.290287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-01T22:34:53.290461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-01T22:34:53.290623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-01T22:34:53.290849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-01T22:34:53.291070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-01T22:34:53.291224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-01T22:34:53.291507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-01T22:34:53.291769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-01T22:34:53.291990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-01T22:34:53.292199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-01T22:34:53.292343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-01T22:34:53.292535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-01T22:34:53.293049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-01T22:34:53.293215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-01T22:34:53.294120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-01T22:34:53.294330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-01T22:34:53.294516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-01T22:34:53.294795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-01T22:34:53.295016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-01T22:34:53.295229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-01T22:34:53.295387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-01T22:34:53.295636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-01T22:34:53.296012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-01T22:34:53.296218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-01T22:34:53.296414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-01T22:34:53.296570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-01T22:34:53.296753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-01T22:34:53.296946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-01T22:34:53.297258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-01T22:34:53.297447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-01T22:34:53.297675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-01T22:34:53.297938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-01T22:34:53.298267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-01T22:34:53.298495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-01T22:34:53.298737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-01T22:34:53.299005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-01T22:34:53.299171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-01T22:34:53.299366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-01T22:34:53.299512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-01T22:34:53.299775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-01T22:34:53.299965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-01T22:34:53.300140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-01T22:34:53.300352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-01T22:34:53.300538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-01T22:34:53.300762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-01T22:34:53.301233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-01T22:34:53.301520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-01T22:34:53.301710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-01T22:34:53.301912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-01T22:34:53.302114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-01T22:34:53.302316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-01T22:34:53.302485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-01T22:34:53.302739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-01T22:34:53.302916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-01T22:34:53.303090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-01T22:34:53.303271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-01T22:34:53.303449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-01T22:34:53.303618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-01T22:34:53.303934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-01T22:34:53.304127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-01T22:34:53.304308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-01T22:34:53.304555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-01T22:34:53.305009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-01T22:34:53.305237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-01T22:34:53.305405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-01T22:34:53.305563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-01T22:34:53.305789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-01T22:34:53.305964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-01T22:34:53.306140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-01T22:34:53.306345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-01T22:34:53.306546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-01T22:34:53.306777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-01T22:34:53.306963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-01T22:34:53.307199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-01T22:34:53.307397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-01T22:34:53.307720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-01T22:34:53.307892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-01T22:34:53.308080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-01T22:34:53.308290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-01T22:34:53.308448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-01T22:34:53.308615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-01T22:34:53.308821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-01T22:34:53.308985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-01T22:34:53.309181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-01T22:34:53.309410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-01T22:34:53.309597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-01T22:34:53.309854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-01T22:34:53.310032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-01T22:34:53.310284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-01T22:34:53.310511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-01T22:34:53.310737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-01T22:34:53.310978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-01T22:34:53.311165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-01T22:34:53.311331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-01T22:34:53.311746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-01T22:34:53.311989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-01T22:34:53.312185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-01T22:34:53.312392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-01T22:34:53.312675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-01T22:34:53.312850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-01T22:34:53.313064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-01T22:34:53.313241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-01T22:34:53.313443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-01T22:34:53.313732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-01T22:34:53.313967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-01T22:34:53.314200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-01T22:34:53.314434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-01T22:34:53.314595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-01T22:34:53.314838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-01T22:34:53.315114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-01T22:34:53.315310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-01T22:34:53.315514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-01T22:34:53.315997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-01T22:34:53.316269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-01T22:34:53.316481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-01T22:34:53.316820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-01T22:34:53.317015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-01T22:34:53.317217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-01T22:34:53.317405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-01T22:34:53.317568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-01T22:34:53.317811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-01T22:34:53.317992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-01T22:34:53.318268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-01T22:34:53.318483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-01T22:34:53.318700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-01T22:34:53.318914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-01T22:34:53.319168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-01T22:34:53.319353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-01T22:34:53.319509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-01T22:34:53.319832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-01T22:34:53.320037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-01T22:34:53.320276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-01T22:34:53.320463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-01T22:34:53.320673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-01T22:34:53.320851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-01T22:34:53.321015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-01T22:34:53.321324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-01T22:34:53.321580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-01T22:34:53.321788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-01T22:34:53.322015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-01T22:34:53.322197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-01T22:34:53.322413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-01T22:34:53.322593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-01T22:34:53.322838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-01T22:34:53.323039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-01T22:34:53.323213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-01T22:34:53.323782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-01T22:34:53.323923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-01T22:34:53.324089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-01T22:34:53.324272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-01T22:34:53.324453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-01T22:34:53.324687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-01T22:34:53.324905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-01T22:34:53.325088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-01T22:34:53.325277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-01T22:34:53.325440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-01T22:34:53.325669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-01T22:34:53.325847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-01T22:34:53.326046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-01T22:34:53.326267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-01T22:34:53.326484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-01T22:34:53.326702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-01T22:34:53.326882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-01T22:34:53.327047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-01T22:34:53.327209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-01T22:34:53.327381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-01T22:34:53.327578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-01T22:34:53.327902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-01T22:34:53.328044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-01T22:34:53.328259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-01T22:34:53.328469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-01T22:34:53.328611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-01T22:34:53.328849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-01T22:34:53.329020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-01T22:34:53.329203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-01T22:34:53.329392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-01T22:34:53.329559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-01T22:34:53.329789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-01T22:34:53.329928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-01T22:34:53.330105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-01T22:34:53.330349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-01T22:34:53.330553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-01T22:34:53.330759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-01T22:34:53.331000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-01T22:34:53.331185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-01T22:34:53.331398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-01T22:34:53.331566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-01T22:34:53.331850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-01T22:34:53.332052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-01T22:34:53.332272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-01T22:34:53.332407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-01T22:34:53.332762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-01T22:34:53.332941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-01T22:34:53.333153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-01T22:34:53.333336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-01T22:34:53.333507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-01T22:34:53.334097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-01T22:34:53.334282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-01T22:34:53.334450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-01T22:34:53.334683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-01T22:34:53.334888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-01T22:34:53.335102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-01T22:34:53.335274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-01T22:34:53.335489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-01T22:34:53.335737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-01T22:34:53.335880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-01T22:34:53.336057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-01T22:34:53.336248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-01T22:34:53.336389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-01T22:34:53.336590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-01T22:34:53.336799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-01T22:34:53.336968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-01T22:34:53.337168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-01T22:34:53.337351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-01T22:34:53.337509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-01T22:34:53.337725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-01T22:34:53.337906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-01T22:34:53.338324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-01T22:34:53.338483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-01T22:34:53.338636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-01T22:34:53.338822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-01T22:34:53.338974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-01T22:34:53.339191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-01T22:34:53.339362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-01T22:34:53.339569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-01T22:34:53.339890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-01T22:34:53.340107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-01T22:34:53.340307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-01T22:34:53.340478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-01T22:34:53.340680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-01T22:34:53.340901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-01T22:34:53.341056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-01T22:34:53.341242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-01T22:34:53.341411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-01T22:34:53.341725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-01T22:34:53.341926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-01T22:34:53.342058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-01T22:34:53.342228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-01T22:34:53.342400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-01T22:34:53.342552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-01T22:34:53.342752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-01T22:34:53.343003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-01T22:34:53.343164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-01T22:34:53.343353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-01T22:34:53.343515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-01T22:34:53.343743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-01T22:34:53.343993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-01T22:34:53.344210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-01T22:34:53.344536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-01T22:34:53.344802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-01T22:34:53.345018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-01T22:34:53.345267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-01T22:34:53.345808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-01T22:34:53.345996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-01T22:34:53.346170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-01T22:34:53.346380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-01T22:34:53.346773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-01T22:34:53.346943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-01T22:34:53.347128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-01T22:34:53.347273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-01T22:34:53.347437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-01T22:34:53.347617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-01T22:34:53.347865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-01T22:34:53.348102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-01T22:34:53.348248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-01T22:34:53.348439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-01T22:34:53.348725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-01T22:34:53.348913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-01T22:34:53.349099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-01T22:34:53.349513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-01T22:34:53.349747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-01T22:34:53.349887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-01T22:34:53.350092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-01T22:34:53.350263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-01T22:34:53.350425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-01T22:34:53.350629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-01T22:34:53.350827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-01T22:34:53.350986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-01T22:34:53.351131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-01T22:34:53.351273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-01T22:34:53.351492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-01T22:34:53.351750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-01T22:34:53.351905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-01T22:34:53.352063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-01T22:34:53.352226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-01T22:34:53.352441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-01T22:34:53.352605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-01T22:34:53.352874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-01T22:34:53.353077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-01T22:34:53.353280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-01T22:34:53.353452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-01T22:34:53.353689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-01T22:34:53.353864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-01T22:34:53.354072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-01T22:34:53.354248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-01T22:34:53.354444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-01T22:34:53.354614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-01T22:34:53.354807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-01T22:34:53.355004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-01T22:34:53.355197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-01T22:34:53.355356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-01T22:34:53.355544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-01T22:34:53.355715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-01T22:34:53.355876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-01T22:34:53.356054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-01T22:34:53.356235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-01T22:34:53.356419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-01T22:34:53.356580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-01T22:34:53.356770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-01T22:34:53.356934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-01T22:34:53.357103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-01T22:34:53.357261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-01T22:34:53.357584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-01T22:34:53.357770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-01T22:34:53.357936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-01T22:34:53.358139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-01T22:34:53.358312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-01T22:34:53.358490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-01T22:34:53.358681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-01T22:34:53.358846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-01T22:34:53.359002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-01T22:34:53.359197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-01T22:34:53.359415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-01T22:34:53.359580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-01T22:34:53.359844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-01T22:34:53.360020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-01T22:34:53.360177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-01T22:34:53.360425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-01T22:34:53.360605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-01T22:34:53.360876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-01T22:34:53.361044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-01T22:34:53.361211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-01T22:34:53.361365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-01T22:34:53.361541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-01T22:34:53.361751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-01T22:34:53.361956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-01T22:34:53.362142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-01T22:34:53.362331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-01T22:34:53.362505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-01T22:34:53.362743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-01T22:34:53.362899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-01T22:34:53.363057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-01T22:34:53.363207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-01T22:34:53.363388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-01T22:34:53.363564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-01T22:34:53.363737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-01T22:34:53.363888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-01T22:34:53.364029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-01T22:34:53.364217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-01T22:34:53.364486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-01T22:34:53.364738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-01T22:34:53.365098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-01T22:34:53.365242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-01T22:34:53.365410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-01T22:34:53.365748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-01T22:34:53.365925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-01T22:34:53.366133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-01T22:34:53.366293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-01T22:34:53.366490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-01T22:34:53.366708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-01T22:34:53.366880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-01T22:34:53.367051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-01T22:34:53.367224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-01T22:34:53.367430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-01T22:34:53.367590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-01T22:34:53.367795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-01T22:34:53.367981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-01T22:34:53.368162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-01T22:34:53.368319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-01T22:34:53.368505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-01T22:34:53.368791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-01T22:34:53.368947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-01T22:34:53.369185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-01T22:34:53.369330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-01T22:34:53.369482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-01T22:34:53.369697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-01T22:34:53.369947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-01T22:34:53.370148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-01T22:34:53.370449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-01T22:34:53.370613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-01T22:34:53.370829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-01T22:34:53.371015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-01T22:34:53.371167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-01T22:34:53.371333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-01T22:34:53.371637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-01T22:34:53.371811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-01T22:34:53.371966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-01T22:34:53.372152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-01T22:34:53.372306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-01T22:34:53.372458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-01T22:34:53.372624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-01T22:34:53.372832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-01T22:34:53.373145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-01T22:34:53.373315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-01T22:34:53.373490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-01T22:34:53.373631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-01T22:34:53.373837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-01T22:34:53.373977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-01T22:34:53.374198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-01T22:34:53.374426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-01T22:34:53.374738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-01T22:34:53.374887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-01T22:34:53.375052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-01T22:34:53.375287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-01T22:34:53.375460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-01T22:34:53.375630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-01T22:34:53.375836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-01T22:34:53.376236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-01T22:34:53.376390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-01T22:34:53.376593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-01T22:34:53.376894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-01T22:34:53.377052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-01T22:34:53.377255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-01T22:34:53.377428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-01T22:34:53.377578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-01T22:34:53.377785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-01T22:34:53.377951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-01T22:34:53.378146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-01T22:34:53.378321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-01T22:34:53.378534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-01T22:34:53.378711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-01T22:34:53.378870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-01T22:34:53.379056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-01T22:34:53.379241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-01T22:34:53.379416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-01T22:34:53.379567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-01T22:34:53.379772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-01T22:34:53.379921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-01T22:34:53.380106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-01T22:34:53.380531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-01T22:34:53.380778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-01T22:34:53.380948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-01T22:34:53.381087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-01T22:34:53.381209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-01T22:34:53.381458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-01T22:34:53.381627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-01T22:34:53.381803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-01T22:34:53.381980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-01T22:34:53.382172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-01T22:34:53.382399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-01T22:34:53.382570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-01T22:34:53.382818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-01T22:34:53.382993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-01T22:34:53.383179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-01T22:34:53.383371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-01T22:34:53.383531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-01T22:34:53.383764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-01T22:34:53.384000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-01T22:34:53.384163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-01T22:34:53.384310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-01T22:34:53.384556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-01T22:34:53.384761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-01T22:34:53.384915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-01T22:34:53.385079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-01T22:34:53.385246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-01T22:34:53.385450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-01T22:34:53.385634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-01T22:34:53.385913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-01T22:34:53.386117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-01T22:34:53.386300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-01T22:34:53.386458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-01T22:34:53.386629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-01T22:34:53.386837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-01T22:34:53.386980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-01T22:34:53.387153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-01T22:34:53.387374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-01T22:34:53.387635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-01T22:34:53.387820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-01T22:34:53.387963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-01T22:34:53.388124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-01T22:34:53.388293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-01T22:34:53.388437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-01T22:34:53.388614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-01T22:34:53.388956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-01T22:34:53.389112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-01T22:34:53.389281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-01T22:34:53.389437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-01T22:34:53.389603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-01T22:34:53.389894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-01T22:34:53.390052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-01T22:34:53.390288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-01T22:34:53.390456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-01T22:34:53.390596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-01T22:34:53.390851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-01T22:34:53.390997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-01T22:34:53.391137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-01T22:34:53.391310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-01T22:34:53.391501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-01T22:34:53.391669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-01T22:34:53.391869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-01T22:34:53.392028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-01T22:34:53.392194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-01T22:34:53.392343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-01T22:34:53.392543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-01T22:34:53.392757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-01T22:34:53.392998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-10-01T22:34:53.393128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-01T22:34:53.393261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-01T22:34:53.393437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-01T22:34:53.393597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-01T22:34:53.393763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-01T22:34:53.394008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-01T22:34:53.394196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-01T22:34:53.394427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-01T22:34:53.394585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-01T22:34:53.394928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-01T22:34:53.395098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-01T22:34:53.395339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-01T22:34:53.395500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-01T22:34:53.395709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-01T22:34:53.395873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-01T22:34:53.396030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-01T22:34:53.396204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-01T22:34:53.396343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-01T22:34:53.396540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-01T22:34:53.396730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-01T22:34:53.396877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-01T22:34:53.397022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-01T22:34:53.397195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-01T22:34:53.397414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-01T22:34:53.397567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-01T22:34:53.397797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-01T22:34:53.397971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-01T22:34:53.398156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-01T22:34:53.398363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-01T22:34:53.398533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-01T22:34:53.398753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-01T22:34:53.398931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-01T22:34:53.399095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-01T22:34:53.399225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-01T22:34:53.399385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-01T22:34:53.399535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-01T22:34:53.399707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-01T22:34:53.399849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-01T22:34:53.400155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-01T22:34:53.400305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-01T22:34:53.400479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-01T22:34:53.400722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-01T22:34:53.400874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-01T22:34:53.401062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-01T22:34:53.401242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-01T22:34:53.401419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-01T22:34:53.401600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-01T22:34:53.401854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-01T22:34:53.402036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-01T22:34:53.402216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-01T22:34:53.402434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-01T22:34:53.402667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-01T22:34:53.402824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-01T22:34:53.402999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-01T22:34:53.403193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-01T22:34:53.403359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-01T22:34:53.403556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-01T22:34:53.403723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-01T22:34:53.403887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-01T22:34:53.404042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-01T22:34:53.404205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-01T22:34:53.404352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-01T22:34:53.404498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-01T22:34:53.404706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-01T22:34:53.404864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-01T22:34:53.405058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-01T22:34:53.405208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-01T22:34:53.405331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-01T22:34:53.405509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-01T22:34:53.405733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-01T22:34:53.405874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-01T22:34:53.406020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-01T22:34:53.406181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-01T22:34:53.406310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-01T22:34:53.406445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-01T22:34:53.406821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-01T22:34:53.406969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-01T22:34:53.407115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-01T22:34:53.407317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-01T22:34:53.407474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-01T22:34:53.407620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-01T22:34:53.407829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-01T22:34:53.407994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-01T22:34:53.408177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-01T22:34:53.408343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-01T22:34:53.408511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-01T22:34:53.408677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-01T22:34:53.408815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-01T22:34:53.408973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-01T22:34:53.409150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-01T22:34:53.409350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-01T22:34:53.409507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-01T22:34:53.409830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-01T22:34:53.409979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-01T22:34:53.410126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-01T22:34:53.410307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-01T22:34:53.410472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-01T22:34:53.410635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-01T22:34:53.410796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-01T22:34:53.410944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-01T22:34:53.411122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-01T22:34:53.411271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-01T22:34:53.411416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-01T22:34:53.411607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-01T22:34:53.411804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-01T22:34:53.411981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-01T22:34:53.412182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-01T22:34:53.412331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-01T22:34:53.412559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-01T22:34:53.412735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-01T22:34:53.412937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-01T22:34:53.413084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-01T22:34:53.413273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-01T22:34:53.413436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-10-01T22:34:53.413632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-01T22:34:53.414024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-01T22:34:53.414142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-01T22:34:53.414338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-01T22:34:53.414458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-01T22:34:53.414577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-01T22:34:53.414806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-01T22:34:53.414971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-01T22:34:53.415187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-01T22:34:53.415352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-01T22:34:53.415507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-01T22:34:53.415720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-01T22:34:53.415869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-01T22:34:53.416029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-01T22:34:53.416170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-01T22:34:53.416344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-01T22:34:53.416529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-01T22:34:53.416805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-01T22:34:53.416967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-01T22:34:53.417142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-01T22:34:53.417423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-01T22:34:53.417621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-01T22:34:53.417848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-01T22:34:53.418038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-01T22:34:53.418272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-01T22:34:53.418413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-01T22:34:53.418605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-01T22:34:53.418755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-01T22:34:53.418984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-01T22:34:53.419172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-01T22:34:53.419336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-01T22:34:53.419482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-01T22:34:53.419624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-01T22:34:53.419910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-01T22:34:53.420055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-01T22:34:53.420314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-01T22:34:53.420473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-01T22:34:53.420625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-01T22:34:53.420841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-01T22:34:53.421030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-01T22:34:53.421164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-01T22:34:53.421364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-01T22:34:53.421622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-01T22:34:53.421968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-01T22:34:53.422170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-01T22:34:53.422334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-01T22:34:53.422509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-01T22:34:53.422723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-01T22:34:53.422897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-01T22:34:53.423048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-01T22:34:53.423260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-01T22:34:53.423405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-01T22:34:53.423571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-01T22:34:53.423775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-01T22:34:53.423940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-01T22:34:53.424126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-01T22:34:53.424302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-01T22:34:53.424445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-01T22:34:53.424591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-01T22:34:53.424808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-01T22:34:53.425059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-01T22:34:53.425204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-01T22:34:53.425351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-01T22:34:53.425507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-01T22:34:53.425699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-01T22:34:53.425855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-01T22:34:53.426018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-01T22:34:53.426215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-01T22:34:53.426546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-01T22:34:53.426773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-01T22:34:53.426937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-01T22:34:53.427136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-01T22:34:53.427287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-01T22:34:53.427438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-01T22:34:53.427633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-01T22:34:53.427824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-01T22:34:53.427984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-01T22:34:53.428203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-01T22:34:53.428373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-01T22:34:53.428541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-01T22:34:53.428732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-01T22:34:53.428931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-01T22:34:53.429114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-01T22:34:53.429270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-01T22:34:53.429434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-01T22:34:53.429592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-01T22:34:53.429842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-01T22:34:53.430011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-01T22:34:53.430147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-01T22:34:53.430292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-01T22:34:53.430448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-01T22:34:53.430599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-01T22:34:53.430790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-01T22:34:53.430938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-01T22:34:53.431129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-01T22:34:53.431304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-01T22:34:53.431467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-01T22:34:53.431602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-01T22:34:53.431769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-01T22:34:53.431929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-01T22:34:53.432098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-01T22:34:53.432291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-01T22:34:53.432704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-01T22:34:53.432884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-01T22:34:53.433051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-01T22:34:53.433234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-01T22:34:53.433369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-01T22:34:53.433578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-01T22:34:53.433765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-01T22:34:53.433907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-01T22:34:53.434057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-01T22:34:53.434180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-01T22:34:53.434359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-01T22:34:53.434496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-01T22:34:53.434674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-01T22:34:53.434841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-01T22:34:53.434992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-01T22:34:53.435224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-01T22:34:53.435444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-01T22:34:53.435623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-01T22:34:53.435779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-01T22:34:53.435885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-01T22:34:53.436044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-01T22:34:53.436248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-01T22:34:53.436491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-01T22:34:53.436679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-01T22:34:53.436854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-01T22:34:53.437012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-01T22:34:53.437211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-01T22:34:53.437390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-01T22:34:53.437575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-01T22:34:53.437838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-01T22:34:53.438025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-01T22:34:53.438201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-01T22:34:53.438375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-01T22:34:53.438547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-01T22:34:53.438728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-01T22:34:53.438880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-01T22:34:53.439046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-01T22:34:53.439233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-01T22:34:53.439509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-01T22:34:53.439693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-01T22:34:53.439884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-01T22:34:53.440038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-01T22:34:53.440176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-01T22:34:53.440312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-01T22:34:53.440492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-01T22:34:53.440699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-01T22:34:53.441086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-01T22:34:53.441184] [INFO ] [LOCAL ] Deleted 1444 derivative data files. [2025-10-01T22:34:53.441221] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-01T22:34:53.442858] [INFO ] [LOCAL ] Found 1587 symbols with primary data. [2025-10-01T22:34:53.443194] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1587 symbols [2025-10-01T22:34:53.443853] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:53.444201] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:53.444839] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:53.517089] [DEBUG] [LOCAL ] AAP: Loaded 51944 existing records from primary storage. [2025-10-01T22:34:53.517341] [INFO ] [MAIN ] AAP: Loaded 51944 primary data records. [2025-10-01T22:34:53.661790] [DEBUG] [LOCAL ] AA: Loaded 53615 existing records from primary storage. [2025-10-01T22:34:53.683823] [INFO ] [MAIN ] AA: Loaded 53615 primary data records. [2025-10-01T22:34:53.851379] [DEBUG] [LOCAL ] A: Loaded 50727 existing records from primary storage. [2025-10-01T22:34:53.941867] [INFO ] [MAIN ] A: Loaded 50727 primary data records. [2025-10-01T22:34:54.733300] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:54.734947] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51944 primary records. [2025-10-01T22:34:54.735047] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-01T22:34:54.757246] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-01T22:34:54.758170] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-01T22:34:54.765859] [INFO ] [MAIN ] Derivative Progress: 1/1587 symbols completed. AAP took 1.3s. Estimated remaining: 34m 58s. Rate: 45.4 symbols/min [2025-10-01T22:34:54.778284] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:54.779742] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:54.781054] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53615 primary records. [2025-10-01T22:34:54.781238] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-01T22:34:54.827818] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:54.829052] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50727 primary records. [2025-10-01T22:34:54.827933] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-01T22:34:54.829348] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-01T22:34:54.829193] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-01T22:34:54.831929] [INFO ] [MAIN ] Derivative Progress: 2/1587 symbols completed. AA took 1.4s. Estimated remaining: 18m 21s. Rate: 86.4 symbols/min [2025-10-01T22:34:54.832626] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:54.859112] [DEBUG] [LOCAL ] AAT: Loaded 30404 existing records from primary storage. [2025-10-01T22:34:54.859593] [INFO ] [MAIN ] AAT: Loaded 30404 primary data records. [2025-10-01T22:34:54.950619] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-01T22:34:54.988971] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-01T22:34:55.017019] [INFO ] [MAIN ] Derivative Progress: 3/1587 symbols completed. A took 1.6s. Estimated remaining: 13m 51s. Rate: 114.4 symbols/min [2025-10-01T22:34:55.081497] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:55.055472] [DEBUG] [LOCAL ] AB: Loaded 27393 existing records from primary storage. [2025-10-01T22:34:55.221228] [INFO ] [MAIN ] AB: Loaded 27393 primary data records. [2025-10-01T22:34:55.623034] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-10-01T22:34:55.623572] [INFO ] [MAIN ] ABEV: Loaded 53278 primary data records. [2025-10-01T22:34:55.624251] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:55.648474] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30404 primary records. [2025-10-01T22:34:55.664877] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-01T22:34:55.858402] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-10-01T22:34:55.858666] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-01T22:34:55.860920] [INFO ] [MAIN ] Derivative Progress: 4/1587 symbols completed. AAT took 1.1s. Estimated remaining: 15m 57s. Rate: 99.3 symbols/min [2025-10-01T22:34:56.007724] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:56.041745] [DEBUG] [MAIN ] AB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:56.043369] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 27393 primary records. [2025-10-01T22:34:56.043929] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-01T22:34:56.067451] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-01T22:34:56.074987] [DEBUG] [LOCAL ] ABG: Loaded 18569 existing records from primary storage. [2025-10-01T22:34:56.075253] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-01T22:34:56.075559] [INFO ] [MAIN ] ABG: Loaded 18569 primary data records. [2025-10-01T22:34:56.078016] [INFO ] [MAIN ] Derivative Progress: 5/1587 symbols completed. AB took 1.2s. Estimated remaining: 13m 54s. Rate: 113.8 symbols/min [2025-10-01T22:34:56.083676] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:56.242778] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:56.272296] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53278 primary records. [2025-10-01T22:34:56.305154] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-01T22:34:56.472956] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-01T22:34:56.473689] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-01T22:34:56.475763] [INFO ] [MAIN ] Derivative Progress: 6/1587 symbols completed. ABEV took 1.4s. Estimated remaining: 13m 19s. Rate: 118.7 symbols/min [2025-10-01T22:34:56.476480] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:56.497220] [DEBUG] [LOCAL ] ABR: Loaded 51995 existing records from primary storage. [2025-10-01T22:34:56.498000] [INFO ] [MAIN ] ABR: Loaded 51995 primary data records. [2025-10-01T22:34:56.732026] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:56.733074] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18569 primary records. [2025-10-01T22:34:56.853781] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-01T22:34:56.886870] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-10-01T22:34:56.887537] [INFO ] [MAIN ] ABT: Loaded 53620 primary data records. [2025-10-01T22:34:57.009592] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-01T22:34:57.014344] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-01T22:34:57.022195] [INFO ] [MAIN ] Derivative Progress: 7/1587 symbols completed. ABG took 1.0s. Estimated remaining: 13m 28s. Rate: 117.3 symbols/min [2025-10-01T22:34:57.043281] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:57.257552] [DEBUG] [MAIN ] ABR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:57.259164] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 51995 primary records. [2025-10-01T22:34:57.260271] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-01T22:34:57.280704] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-01T22:34:57.281229] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-01T22:34:57.283213] [INFO ] [MAIN ] Derivative Progress: 8/1587 symbols completed. ABR took 1.2s. Estimated remaining: 12m 38s. Rate: 125.0 symbols/min [2025-10-01T22:34:57.283613] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:57.297228] [DEBUG] [LOCAL ] ACCO: Loaded 37359 existing records from primary storage. [2025-10-01T22:34:57.297679] [INFO ] [MAIN ] ACCO: Loaded 37359 primary data records. [2025-10-01T22:34:57.479847] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:57.499512] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53620 primary records. [2025-10-01T22:34:57.538768] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-01T22:34:57.692997] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-01T22:34:57.694636] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-01T22:34:57.744604] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-10-01T22:34:57.791309] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-01T22:34:57.816025] [INFO ] [MAIN ] Derivative Progress: 9/1587 symbols completed. ABT took 1.3s. Estimated remaining: 12m 47s. Rate: 123.5 symbols/min [2025-10-01T22:34:57.821682] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:58.096712] [DEBUG] [MAIN ] ACCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:58.097962] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 37359 primary records. [2025-10-01T22:34:58.098136] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-01T22:34:58.137686] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-10-01T22:34:58.138150] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-01T22:34:58.140606] [INFO ] [MAIN ] Derivative Progress: 10/1587 symbols completed. ACCO took 1.1s. Estimated remaining: 12m 21s. Rate: 127.7 symbols/min [2025-10-01T22:34:58.141245] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:58.159525] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:58.175161] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-10-01T22:34:58.175272] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-01T22:34:58.188448] [DEBUG] [LOCAL ] ACI: Loaded 53259 existing records from primary storage. [2025-10-01T22:34:58.192787] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-10-01T22:34:58.192948] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-01T22:34:58.192890] [INFO ] [MAIN ] ACI: Loaded 53259 primary data records. [2025-10-01T22:34:58.195348] [INFO ] [MAIN ] Derivative Progress: 11/1587 symbols completed. ACHR took 0.9s. Estimated remaining: 11m 21s. Rate: 138.9 symbols/min [2025-10-01T22:34:58.200666] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:58.566877] [DEBUG] [LOCAL ] ACM: Loaded 43000 existing records from primary storage. [2025-10-01T22:34:58.567180] [INFO ] [MAIN ] ACM: Loaded 43000 primary data records. [2025-10-01T22:34:58.716006] [DEBUG] [LOCAL ] ACN: Loaded 53426 existing records from primary storage. [2025-10-01T22:34:58.735907] [INFO ] [MAIN ] ACN: Loaded 53426 primary data records. [2025-10-01T22:34:59.172511] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:59.313715] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53259 primary records. [2025-10-01T22:34:59.315701] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-01T22:34:59.334595] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-01T22:34:59.334760] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-01T22:34:59.337082] [INFO ] [MAIN ] Derivative Progress: 12/1587 symbols completed. ACI took 1.5s. Estimated remaining: 12m 54s. Rate: 122.2 symbols/min [2025-10-01T22:34:59.337639] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:59.360702] [DEBUG] [MAIN ] ACM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:59.361514] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43000 primary records. [2025-10-01T22:34:59.361921] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-01T22:34:59.380170] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-10-01T22:34:59.388100] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-01T22:34:59.391280] [INFO ] [MAIN ] Derivative Progress: 13/1587 symbols completed. ACM took 1.3s. Estimated remaining: 12m 0s. Rate: 131.1 symbols/min [2025-10-01T22:34:59.406906] [DEBUG] [MAIN ] ACN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:59.416213] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53426 primary records. [2025-10-01T22:34:59.417257] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-01T22:34:59.418535] [DEBUG] [LOCAL ] ACP: Loaded 30980 existing records from primary storage. [2025-10-01T22:34:59.418826] [INFO ] [MAIN ] ACP: Loaded 30980 primary data records. [2025-10-01T22:34:59.592846] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-10-01T22:34:59.602265] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-01T22:34:59.613770] [INFO ] [MAIN ] Derivative Progress: 14/1587 symbols completed. ACN took 1.4s. Estimated remaining: 11m 33s. Rate: 136.1 symbols/min [2025-10-01T22:34:59.778004] [DEBUG] [MAIN ] ACP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:34:59.778799] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 30980 primary records. [2025-10-01T22:34:59.778863] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-01T22:34:59.794209] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-10-01T22:34:59.794280] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-01T22:34:59.796559] [INFO ] [MAIN ] Derivative Progress: 15/1587 symbols completed. ACP took 0.5s. Estimated remaining: 11m 6s. Rate: 141.7 symbols/min [2025-10-01T22:34:59.797311] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:59.797222] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:59.797127] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:34:59.807201] [DEBUG] [LOCAL ] ACR: Loaded 5949 existing records from primary storage. [2025-10-01T22:34:59.807323] [INFO ] [MAIN ] ACR: Loaded 5949 primary data records. [2025-10-01T22:35:00.164145] [DEBUG] [LOCAL ] ACRE: Loaded 33578 existing records from primary storage. [2025-10-01T22:35:00.164337] [INFO ] [MAIN ] ACRE: Loaded 33578 primary data records. [2025-10-01T22:35:00.297812] [DEBUG] [LOCAL ] ACVA: Loaded 49250 existing records from primary storage. [2025-10-01T22:35:00.308520] [INFO ] [MAIN ] ACVA: Loaded 49250 primary data records. [2025-10-01T22:35:00.943662] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:00.945124] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 5949 primary records. [2025-10-01T22:35:00.945387] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-01T22:35:00.964045] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-01T22:35:00.964512] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-01T22:35:00.966585] [INFO ] [MAIN ] Derivative Progress: 16/1587 symbols completed. ACR took 1.2s. Estimated remaining: 12m 19s. Rate: 127.6 symbols/min [2025-10-01T22:35:00.967916] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:00.983255] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:00.984534] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33578 primary records. [2025-10-01T22:35:00.984730] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-01T22:35:01.004753] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-10-01T22:35:01.005253] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-01T22:35:01.007360] [INFO ] [MAIN ] Derivative Progress: 17/1587 symbols completed. ACRE took 1.2s. Estimated remaining: 11m 39s. Rate: 134.8 symbols/min [2025-10-01T22:35:01.015525] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:01.021614] [DEBUG] [MAIN ] ACVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:01.022463] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49250 primary records. [2025-10-01T22:35:01.022685] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-01T22:35:01.053002] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-10-01T22:35:01.053137] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-01T22:35:01.056042] [INFO ] [MAIN ] Derivative Progress: 18/1587 symbols completed. ACVA took 1.3s. Estimated remaining: 11m 4s. Rate: 141.9 symbols/min [2025-10-01T22:35:01.056353] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:01.079360] [DEBUG] [LOCAL ] ADC: Loaded 46164 existing records from primary storage. [2025-10-01T22:35:01.087859] [INFO ] [MAIN ] ADC: Loaded 46164 primary data records. [2025-10-01T22:35:01.274396] [DEBUG] [LOCAL ] ADCT: Loaded 34581 existing records from primary storage. [2025-10-01T22:35:01.326285] [INFO ] [MAIN ] ADCT: Loaded 34581 primary data records. [2025-10-01T22:35:01.594287] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-01T22:35:01.610870] [INFO ] [MAIN ] ADM: Loaded 53394 primary data records. [2025-10-01T22:35:02.200351] [DEBUG] [MAIN ] ADC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:02.215970] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46164 primary records. [2025-10-01T22:35:02.216256] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-01T22:35:02.236284] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-10-01T22:35:02.237406] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-01T22:35:02.240486] [INFO ] [MAIN ] Derivative Progress: 19/1587 symbols completed. ADC took 1.3s. Estimated remaining: 12m 6s. Rate: 129.6 symbols/min [2025-10-01T22:35:02.241311] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:02.270300] [DEBUG] [MAIN ] ADCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:02.271432] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 34581 primary records. [2025-10-01T22:35:02.271612] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-01T22:35:02.320701] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:02.324113] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53394 primary records. [2025-10-01T22:35:02.323213] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-10-01T22:35:02.324305] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-01T22:35:02.324396] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-01T22:35:02.326383] [INFO ] [MAIN ] Derivative Progress: 20/1587 symbols completed. ADCT took 1.3s. Estimated remaining: 11m 36s. Rate: 135.1 symbols/min [2025-10-01T22:35:02.326559] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:02.362112] [DEBUG] [LOCAL ] ADNT: Loaded 47202 existing records from primary storage. [2025-10-01T22:35:02.363107] [INFO ] [MAIN ] ADNT: Loaded 47202 primary data records. [2025-10-01T22:35:02.377513] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-01T22:35:02.383557] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-01T22:35:02.386792] [INFO ] [MAIN ] Derivative Progress: 21/1587 symbols completed. ADM took 1.3s. Estimated remaining: 11m 7s. Rate: 140.9 symbols/min [2025-10-01T22:35:02.387160] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:02.668583] [DEBUG] [LOCAL ] ADX: Loaded 27468 existing records from primary storage. [2025-10-01T22:35:02.657014] [DEBUG] [LOCAL ] ADT: Loaded 53455 existing records from primary storage. [2025-10-01T22:35:02.713609] [INFO ] [MAIN ] ADX: Loaded 27468 primary data records. [2025-10-01T22:35:02.834481] [INFO ] [MAIN ] ADT: Loaded 53455 primary data records. [2025-10-01T22:35:03.554837] [DEBUG] [MAIN ] ADNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:03.555907] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47202 primary records. [2025-10-01T22:35:03.557170] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-01T22:35:03.575103] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-10-01T22:35:03.575531] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-01T22:35:03.577984] [INFO ] [MAIN ] Derivative Progress: 22/1587 symbols completed. ADNT took 1.3s. Estimated remaining: 12m 1s. Rate: 130.2 symbols/min [2025-10-01T22:35:03.578277] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:03.606079] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:03.612167] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53455 primary records. [2025-10-01T22:35:03.612284] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-01T22:35:03.611370] [DEBUG] [MAIN ] ADX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:03.613322] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27468 primary records. [2025-10-01T22:35:03.613694] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-01T22:35:03.643219] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-01T22:35:03.643931] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-01T22:35:03.646316] [INFO ] [MAIN ] Derivative Progress: 23/1587 symbols completed. ADX took 1.3s. Estimated remaining: 11m 34s. Rate: 135.2 symbols/min [2025-10-01T22:35:03.646813] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:03.650193] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-01T22:35:03.650408] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-01T22:35:03.652462] [INFO ] [MAIN ] Derivative Progress: 24/1587 symbols completed. ADT took 1.3s. Estimated remaining: 11m 5s. Rate: 141.0 symbols/min [2025-10-01T22:35:03.664003] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:03.672938] [DEBUG] [LOCAL ] AEFC: Loaded 8514 existing records from primary storage. [2025-10-01T22:35:03.673151] [INFO ] [MAIN ] AEFC: Loaded 8514 primary data records. [2025-10-01T22:35:03.804832] [DEBUG] [LOCAL ] AEE: Loaded 50091 existing records from primary storage. [2025-10-01T22:35:03.810839] [INFO ] [MAIN ] AEE: Loaded 50091 primary data records. [2025-10-01T22:35:04.212198] [DEBUG] [LOCAL ] AEG: Loaded 49557 existing records from primary storage. [2025-10-01T22:35:04.359519] [INFO ] [MAIN ] AEG: Loaded 49557 primary data records. [2025-10-01T22:35:04.775799] [DEBUG] [MAIN ] AEFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:04.777431] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8514 primary records. [2025-10-01T22:35:04.777846] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-01T22:35:04.815481] [DEBUG] [MAIN ] AEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:04.816737] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-01T22:35:04.816990] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-01T22:35:04.820209] [INFO ] [MAIN ] Derivative Progress: 25/1587 symbols completed. AEFC took 1.2s. Estimated remaining: 11m 51s. Rate: 131.8 symbols/min [2025-10-01T22:35:04.817831] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50091 primary records. [2025-10-01T22:35:04.821060] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-01T22:35:04.820773] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:04.842209] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-01T22:35:04.850344] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-01T22:35:04.852397] [INFO ] [MAIN ] Derivative Progress: 26/1587 symbols completed. AEE took 1.3s. Estimated remaining: 11m 25s. Rate: 136.7 symbols/min [2025-10-01T22:35:04.852682] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:04.858772] [DEBUG] [MAIN ] AEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:04.859839] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49557 primary records. [2025-10-01T22:35:04.860100] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-01T22:35:04.877742] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-10-01T22:35:04.877893] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-01T22:35:04.880260] [INFO ] [MAIN ] Derivative Progress: 27/1587 symbols completed. AEG took 1.2s. Estimated remaining: 11m 1s. Rate: 141.6 symbols/min [2025-10-01T22:35:04.880527] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:04.947664] [DEBUG] [LOCAL ] AEM: Loaded 53463 existing records from primary storage. [2025-10-01T22:35:04.948580] [INFO ] [MAIN ] AEM: Loaded 53463 primary data records. [2025-10-01T22:35:05.004851] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-10-01T22:35:05.063126] [INFO ] [MAIN ] AEO: Loaded 53557 primary data records. [2025-10-01T22:35:05.196397] [DEBUG] [LOCAL ] AER: Loaded 48362 existing records from primary storage. [2025-10-01T22:35:05.246209] [INFO ] [MAIN ] AER: Loaded 48362 primary data records. [2025-10-01T22:35:06.009310] [DEBUG] [MAIN ] AEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:06.012276] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53463 primary records. [2025-10-01T22:35:06.012419] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-01T22:35:06.045075] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-01T22:35:06.043290] [DEBUG] [MAIN ] AEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:06.045292] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-01T22:35:06.046240] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53557 primary records. [2025-10-01T22:35:06.048440] [INFO ] [MAIN ] Derivative Progress: 28/1587 symbols completed. AEM took 1.2s. Estimated remaining: 11m 42s. Rate: 133.3 symbols/min [2025-10-01T22:35:06.048819] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-01T22:35:06.081622] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:06.082671] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48362 primary records. [2025-10-01T22:35:06.082742] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-01T22:35:06.083045] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-01T22:35:06.083276] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-01T22:35:06.085484] [INFO ] [MAIN ] Derivative Progress: 29/1587 symbols completed. AEO took 1.2s. Estimated remaining: 11m 19s. Rate: 137.6 symbols/min [2025-10-01T22:35:06.105982] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-01T22:35:06.106144] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-01T22:35:06.108208] [INFO ] [MAIN ] Derivative Progress: 30/1587 symbols completed. AER took 1.2s. Estimated remaining: 10m 57s. Rate: 142.1 symbols/min [2025-10-01T22:35:06.108672] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:06.108776] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:06.109088] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:06.123822] [DEBUG] [LOCAL ] AFB: Loaded 11341 existing records from primary storage. [2025-10-01T22:35:06.124055] [INFO ] [MAIN ] AFB: Loaded 11341 primary data records. [2025-10-01T22:35:06.492030] [DEBUG] [LOCAL ] AESI: Loaded 49476 existing records from primary storage. [2025-10-01T22:35:06.507085] [INFO ] [MAIN ] AESI: Loaded 49476 primary data records. [2025-10-01T22:35:06.604102] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-10-01T22:35:06.629580] [INFO ] [MAIN ] AES: Loaded 53670 primary data records. [2025-10-01T22:35:07.300443] [DEBUG] [MAIN ] AFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:07.302543] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11341 primary records. [2025-10-01T22:35:07.303040] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-01T22:35:07.330014] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-01T22:35:07.338270] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-01T22:35:07.345989] [INFO ] [MAIN ] Derivative Progress: 31/1587 symbols completed. AFB took 1.2s. Estimated remaining: 11m 38s. Rate: 133.8 symbols/min [2025-10-01T22:35:07.346426] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:07.347269] [DEBUG] [MAIN ] AESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:07.348697] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49476 primary records. [2025-10-01T22:35:07.349179] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-01T22:35:07.369712] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-01T22:35:07.370034] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-01T22:35:07.372134] [INFO ] [MAIN ] Derivative Progress: 32/1587 symbols completed. AESI took 1.3s. Estimated remaining: 11m 17s. Rate: 137.8 symbols/min [2025-10-01T22:35:07.385204] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:07.385074] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:07.386557] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53670 primary records. [2025-10-01T22:35:07.386839] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-01T22:35:07.404740] [DEBUG] [LOCAL ] AFGC: Loaded 2555 existing records from primary storage. [2025-10-01T22:35:07.406292] [INFO ] [MAIN ] AFGC: Loaded 2555 primary data records. [2025-10-01T22:35:07.499496] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-01T22:35:07.513992] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-01T22:35:07.523814] [INFO ] [MAIN ] Derivative Progress: 33/1587 symbols completed. AES took 1.4s. Estimated remaining: 11m 3s. Rate: 140.6 symbols/min [2025-10-01T22:35:07.533949] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:07.560540] [DEBUG] [LOCAL ] AFG: Loaded 32410 existing records from primary storage. [2025-10-01T22:35:07.561048] [INFO ] [MAIN ] AFG: Loaded 32410 primary data records. [2025-10-01T22:35:07.662370] [DEBUG] [LOCAL ] AFGE: Loaded 2457 existing records from primary storage. [2025-10-01T22:35:07.697504] [INFO ] [MAIN ] AFGE: Loaded 2457 primary data records. [2025-10-01T22:35:08.493273] [DEBUG] [MAIN ] AFGC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:35:08.494213] [INFO ] [MAIN ] AFGC: Generated 1793 derivative records from 2555 primary records. [2025-10-01T22:35:08.494322] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-01T22:35:08.512814] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1793 records). [2025-10-01T22:35:08.513263] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-01T22:35:08.515517] [INFO ] [MAIN ] Derivative Progress: 34/1587 symbols completed. AFGC took 1.1s. Estimated remaining: 11m 28s. Rate: 135.3 symbols/min [2025-10-01T22:35:08.530158] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:08.529701] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:08.531002] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32410 primary records. [2025-10-01T22:35:08.531827] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-01T22:35:08.564197] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-01T22:35:08.569726] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-01T22:35:08.569620] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:08.572910] [INFO ] [MAIN ] Derivative Progress: 35/1587 symbols completed. AFG took 1.2s. Estimated remaining: 11m 11s. Rate: 138.8 symbols/min [2025-10-01T22:35:08.570516] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2457 primary records. [2025-10-01T22:35:08.573131] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:08.573875] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-01T22:35:08.590885] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-10-01T22:35:08.591037] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-01T22:35:08.593369] [INFO ] [MAIN ] Derivative Progress: 36/1587 symbols completed. AFGE took 1.1s. Estimated remaining: 10m 53s. Rate: 142.6 symbols/min [2025-10-01T22:35:08.593561] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:08.653457] [DEBUG] [LOCAL ] AFL: Loaded 53146 existing records from primary storage. [2025-10-01T22:35:08.653896] [INFO ] [MAIN ] AFL: Loaded 53146 primary data records. [2025-10-01T22:35:08.822779] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-01T22:35:08.850606] [DEBUG] [LOCAL ] AGCO: Loaded 42377 existing records from primary storage. [2025-10-01T22:35:08.843837] [INFO ] [MAIN ] AG: Loaded 53643 primary data records. [2025-10-01T22:35:08.869737] [INFO ] [MAIN ] AGCO: Loaded 42377 primary data records. [2025-10-01T22:35:09.791553] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:09.792461] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53146 primary records. [2025-10-01T22:35:09.792854] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-01T22:35:09.812835] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-01T22:35:09.813098] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-01T22:35:09.815244] [INFO ] [MAIN ] Derivative Progress: 37/1587 symbols completed. AFL took 1.3s. Estimated remaining: 11m 26s. Rate: 135.6 symbols/min [2025-10-01T22:35:09.815529] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:09.842058] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:09.850988] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42377 primary records. [2025-10-01T22:35:09.851158] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-01T22:35:09.857480] [DEBUG] [MAIN ] AG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:09.865819] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53643 primary records. [2025-10-01T22:35:09.865942] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-01T22:35:09.881521] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-01T22:35:09.889043] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-01T22:35:09.892185] [INFO ] [MAIN ] Derivative Progress: 38/1587 symbols completed. AGCO took 1.3s. Estimated remaining: 11m 11s. Rate: 138.6 symbols/min [2025-10-01T22:35:09.892849] [DEBUG] [LOCAL ] AGD: Loaded 18028 existing records from primary storage. [2025-10-01T22:35:09.895765] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:09.897454] [INFO ] [MAIN ] AGD: Loaded 18028 primary data records. [2025-10-01T22:35:09.954909] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-01T22:35:09.991769] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-01T22:35:10.000508] [INFO ] [MAIN ] Derivative Progress: 39/1587 symbols completed. AG took 1.4s. Estimated remaining: 10m 57s. Rate: 141.3 symbols/min [2025-10-01T22:35:10.022710] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:10.278410] [DEBUG] [LOCAL ] AGI: Loaded 53416 existing records from primary storage. [2025-10-01T22:35:10.292582] [INFO ] [MAIN ] AGI: Loaded 53416 primary data records. [2025-10-01T22:35:10.428186] [DEBUG] [LOCAL ] AGL: Loaded 52447 existing records from primary storage. [2025-10-01T22:35:10.435121] [INFO ] [MAIN ] AGL: Loaded 52447 primary data records. [2025-10-01T22:35:10.835023] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:10.861008] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 18028 primary records. [2025-10-01T22:35:10.862132] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-01T22:35:11.008810] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-01T22:35:11.010696] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-01T22:35:11.013285] [INFO ] [MAIN ] Derivative Progress: 40/1587 symbols completed. AGD took 1.2s. Estimated remaining: 11m 20s. Rate: 136.6 symbols/min [2025-10-01T22:35:11.013749] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:11.029535] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:11.030521] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53416 primary records. [2025-10-01T22:35:11.030627] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-01T22:35:11.053638] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-01T22:35:11.058592] [DEBUG] [LOCAL ] AGM: Loaded 10179 existing records from primary storage. [2025-10-01T22:35:11.059151] [INFO ] [MAIN ] AGM: Loaded 10179 primary data records. [2025-10-01T22:35:11.059251] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-01T22:35:11.073716] [INFO ] [MAIN ] Derivative Progress: 41/1587 symbols completed. AGI took 1.2s. Estimated remaining: 11m 5s. Rate: 139.5 symbols/min [2025-10-01T22:35:11.097070] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:11.192831] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:11.209691] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52447 primary records. [2025-10-01T22:35:11.273570] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-01T22:35:11.472098] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-01T22:35:11.472228] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-01T22:35:11.474350] [INFO ] [MAIN ] Derivative Progress: 42/1587 symbols completed. AGL took 1.5s. Estimated remaining: 11m 3s. Rate: 139.8 symbols/min [2025-10-01T22:35:11.475352] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:11.487887] [DEBUG] [LOCAL ] AGO: Loaded 27914 existing records from primary storage. [2025-10-01T22:35:11.488579] [INFO ] [MAIN ] AGO: Loaded 27914 primary data records. [2025-10-01T22:35:11.720357] [DEBUG] [LOCAL ] AGX: Loaded 33195 existing records from primary storage. [2025-10-01T22:35:11.720690] [INFO ] [MAIN ] AGX: Loaded 33195 primary data records. [2025-10-01T22:35:11.890578] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:11.905784] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10179 primary records. [2025-10-01T22:35:11.958447] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-01T22:35:12.009951] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-01T22:35:12.015836] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-01T22:35:12.023101] [INFO ] [MAIN ] Derivative Progress: 43/1587 symbols completed. AGM took 1.0s. Estimated remaining: 11m 7s. Rate: 138.9 symbols/min [2025-10-01T22:35:12.258248] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:12.259315] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 27914 primary records. [2025-10-01T22:35:12.259620] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-01T22:35:12.285439] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-10-01T22:35:12.285826] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-01T22:35:12.289704] [INFO ] [MAIN ] Derivative Progress: 44/1587 symbols completed. AGO took 1.2s. Estimated remaining: 11m 1s. Rate: 140.1 symbols/min [2025-10-01T22:35:12.305176] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:12.305839] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33195 primary records. [2025-10-01T22:35:12.305903] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-01T22:35:12.322751] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-01T22:35:12.322882] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-01T22:35:12.325186] [INFO ] [MAIN ] Derivative Progress: 45/1587 symbols completed. AGX took 0.8s. Estimated remaining: 10m 47s. Rate: 143.0 symbols/min [2025-10-01T22:35:12.325781] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:12.325971] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:12.325847] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:12.337709] [DEBUG] [LOCAL ] AHT: Loaded 6134 existing records from primary storage. [2025-10-01T22:35:12.337972] [INFO ] [MAIN ] AHT: Loaded 6134 primary data records. [2025-10-01T22:35:12.714183] [DEBUG] [LOCAL ] AHH: Loaded 41122 existing records from primary storage. [2025-10-01T22:35:12.714496] [INFO ] [MAIN ] AHH: Loaded 41122 primary data records. [2025-10-01T22:35:12.827746] [DEBUG] [LOCAL ] AHR: Loaded 49165 existing records from primary storage. [2025-10-01T22:35:12.843868] [INFO ] [MAIN ] AHR: Loaded 49165 primary data records. [2025-10-01T22:35:13.406050] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:13.408399] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6134 primary records. [2025-10-01T22:35:13.409459] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-01T22:35:13.431077] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-01T22:35:13.431394] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-01T22:35:13.433850] [INFO ] [MAIN ] Derivative Progress: 46/1587 symbols completed. AHT took 1.1s. Estimated remaining: 11m 10s. Rate: 138.1 symbols/min [2025-10-01T22:35:13.434310] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:13.457454] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:13.458722] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41122 primary records. [2025-10-01T22:35:13.467034] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-01T22:35:13.473701] [DEBUG] [MAIN ] AHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:13.482504] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49165 primary records. [2025-10-01T22:35:13.482707] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-01T22:35:13.504695] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-01T22:35:13.509411] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-10-01T22:35:13.509568] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-01T22:35:13.509727] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-01T22:35:13.511969] [INFO ] [MAIN ] Derivative Progress: 47/1587 symbols completed. AHH took 1.2s. Estimated remaining: 10m 58s. Rate: 140.5 symbols/min [2025-10-01T22:35:13.514567] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:13.514683] [INFO ] [MAIN ] Derivative Progress: 48/1587 symbols completed. AHR took 1.2s. Estimated remaining: 10m 44s. Rate: 143.5 symbols/min [2025-10-01T22:35:13.515055] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:13.573142] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-10-01T22:35:13.573433] [INFO ] [MAIN ] AI: Loaded 53750 primary data records. [2025-10-01T22:35:13.646264] [DEBUG] [LOCAL ] AIN: Loaded 24554 existing records from primary storage. [2025-10-01T22:35:13.672687] [INFO ] [MAIN ] AIN: Loaded 24554 primary data records. [2025-10-01T22:35:13.978530] [DEBUG] [LOCAL ] AIG: Loaded 53472 existing records from primary storage. [2025-10-01T22:35:14.130972] [INFO ] [MAIN ] AIG: Loaded 53472 primary data records. [2025-10-01T22:35:14.701828] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:14.702994] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53750 primary records. [2025-10-01T22:35:14.712203] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-01T22:35:14.718991] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:14.720169] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24554 primary records. [2025-10-01T22:35:14.731773] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-01T22:35:14.736624] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-01T22:35:14.737713] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-01T22:35:14.740054] [INFO ] [MAIN ] Derivative Progress: 49/1587 symbols completed. AI took 1.3s. Estimated remaining: 11m 8s. Rate: 138.0 symbols/min [2025-10-01T22:35:14.747890] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:14.757587] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-01T22:35:14.758861] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-01T22:35:14.761492] [INFO ] [MAIN ] Derivative Progress: 50/1587 symbols completed. AIN took 1.2s. Estimated remaining: 10m 55s. Rate: 140.7 symbols/min [2025-10-01T22:35:14.761851] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:14.779261] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:14.780126] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53472 primary records. [2025-10-01T22:35:14.780367] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-01T22:35:14.797599] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-01T22:35:14.797832] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-01T22:35:14.800796] [INFO ] [MAIN ] Derivative Progress: 51/1587 symbols completed. AIG took 1.3s. Estimated remaining: 10m 43s. Rate: 143.3 symbols/min [2025-10-01T22:35:14.809367] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:14.830223] [DEBUG] [LOCAL ] AIR: Loaded 28191 existing records from primary storage. [2025-10-01T22:35:14.830398] [INFO ] [MAIN ] AIR: Loaded 28191 primary data records. [2025-10-01T22:35:14.915726] [DEBUG] [LOCAL ] AIT: Loaded 27516 existing records from primary storage. [2025-10-01T22:35:14.940168] [INFO ] [MAIN ] AIT: Loaded 27516 primary data records. [2025-10-01T22:35:15.165008] [DEBUG] [LOCAL ] AIV: Loaded 40387 existing records from primary storage. [2025-10-01T22:35:15.209742] [INFO ] [MAIN ] AIV: Loaded 40387 primary data records. [2025-10-01T22:35:15.946873] [DEBUG] [MAIN ] AIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:15.948380] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 28191 primary records. [2025-10-01T22:35:15.948583] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-01T22:35:15.969425] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-10-01T22:35:15.969703] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-01T22:35:15.972009] [INFO ] [MAIN ] Derivative Progress: 52/1587 symbols completed. AIR took 1.2s. Estimated remaining: 11m 5s. Rate: 138.5 symbols/min [2025-10-01T22:35:15.972472] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:15.993122] [DEBUG] [MAIN ] AIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:15.994209] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 27516 primary records. [2025-10-01T22:35:15.995190] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-01T22:35:16.028981] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:16.031474] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40387 primary records. [2025-10-01T22:35:16.042114] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-01T22:35:16.057826] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-01T22:35:16.062759] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-01T22:35:16.073620] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-01T22:35:16.073509] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-01T22:35:16.080175] [DEBUG] [LOCAL ] AIZ: Loaded 29857 existing records from primary storage. [2025-10-01T22:35:16.076370] [INFO ] [MAIN ] Derivative Progress: 53/1587 symbols completed. AIV took 1.3s. Estimated remaining: 10m 55s. Rate: 140.5 symbols/min [2025-10-01T22:35:16.080364] [INFO ] [MAIN ] AIZ: Loaded 29857 primary data records. [2025-10-01T22:35:16.080550] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:16.094354] [INFO ] [MAIN ] Derivative Progress: 54/1587 symbols completed. AIT took 1.3s. Estimated remaining: 10m 43s. Rate: 143.0 symbols/min [2025-10-01T22:35:16.112523] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:16.205489] [DEBUG] [LOCAL ] AIZN: Loaded 4025 existing records from primary storage. [2025-10-01T22:35:16.223060] [INFO ] [MAIN ] AIZN: Loaded 4025 primary data records. [2025-10-01T22:35:16.818265] [DEBUG] [LOCAL ] AJG: Loaded 46880 existing records from primary storage. [2025-10-01T22:35:16.836786] [INFO ] [MAIN ] AJG: Loaded 46880 primary data records. [2025-10-01T22:35:17.206381] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:17.208121] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29857 primary records. [2025-10-01T22:35:17.208687] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-01T22:35:17.236582] [DEBUG] [MAIN ] AIZN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:17.238905] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 4025 primary records. [2025-10-01T22:35:17.240891] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-01T22:35:17.243192] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-01T22:35:17.243306] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-01T22:35:17.245745] [INFO ] [MAIN ] Derivative Progress: 55/1587 symbols completed. AIZ took 1.3s. Estimated remaining: 11m 3s. Rate: 138.6 symbols/min [2025-10-01T22:35:17.247288] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:17.264585] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-10-01T22:35:17.265062] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-01T22:35:17.267350] [INFO ] [MAIN ] Derivative Progress: 56/1587 symbols completed. AIZN took 1.2s. Estimated remaining: 10m 51s. Rate: 141.0 symbols/min [2025-10-01T22:35:17.267683] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:17.286342] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:17.287270] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46880 primary records. [2025-10-01T22:35:17.287445] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-01T22:35:17.305177] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-01T22:35:17.305382] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-01T22:35:17.308044] [INFO ] [MAIN ] Derivative Progress: 57/1587 symbols completed. AJG took 1.2s. Estimated remaining: 10m 41s. Rate: 143.3 symbols/min [2025-10-01T22:35:17.308272] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:17.362702] [DEBUG] [LOCAL ] AL: Loaded 44286 existing records from primary storage. [2025-10-01T22:35:17.362979] [INFO ] [MAIN ] AL: Loaded 44286 primary data records. [2025-10-01T22:35:17.376763] [DEBUG] [LOCAL ] AKR: Loaded 45714 existing records from primary storage. [2025-10-01T22:35:17.405569] [INFO ] [MAIN ] AKR: Loaded 45714 primary data records. [2025-10-01T22:35:17.738391] [DEBUG] [LOCAL ] ALB: Loaded 53234 existing records from primary storage. [2025-10-01T22:35:17.890595] [INFO ] [MAIN ] ALB: Loaded 53234 primary data records. [2025-10-01T22:35:18.463427] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:18.465866] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44286 primary records. [2025-10-01T22:35:18.467163] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-01T22:35:18.503425] [DEBUG] [MAIN ] AKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:18.505128] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45714 primary records. [2025-10-01T22:35:18.505439] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-01T22:35:18.523880] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-01T22:35:18.529079] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-01T22:35:18.532062] [INFO ] [MAIN ] Derivative Progress: 58/1587 symbols completed. AL took 1.3s. Estimated remaining: 11m 1s. Rate: 138.7 symbols/min [2025-10-01T22:35:18.540905] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-01T22:35:18.541190] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-01T22:35:18.544138] [INFO ] [MAIN ] Derivative Progress: 59/1587 symbols completed. AKR took 1.3s. Estimated remaining: 10m 50s. Rate: 141.0 symbols/min [2025-10-01T22:35:18.558123] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:18.558865] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53234 primary records. [2025-10-01T22:35:18.558985] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-01T22:35:18.575712] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-01T22:35:18.575839] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-01T22:35:18.579676] [INFO ] [MAIN ] Derivative Progress: 60/1587 symbols completed. ALB took 1.3s. Estimated remaining: 10m 40s. Rate: 143.2 symbols/min [2025-10-01T22:35:18.580175] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:18.580308] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:18.580798] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:18.648194] [DEBUG] [LOCAL ] ALEX: Loaded 31083 existing records from primary storage. [2025-10-01T22:35:18.657128] [INFO ] [MAIN ] ALEX: Loaded 31083 primary data records. [2025-10-01T22:35:18.741916] [DEBUG] [LOCAL ] ALC: Loaded 50825 existing records from primary storage. [2025-10-01T22:35:18.719725] [DEBUG] [LOCAL ] ALE: Loaded 30653 existing records from primary storage. [2025-10-01T22:35:18.757426] [INFO ] [MAIN ] ALC: Loaded 50825 primary data records. [2025-10-01T22:35:18.771251] [INFO ] [MAIN ] ALE: Loaded 30653 primary data records. [2025-10-01T22:35:19.743142] [DEBUG] [MAIN ] ALEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:19.744196] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31083 primary records. [2025-10-01T22:35:19.744378] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-01T22:35:19.769095] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:19.789009] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50825 primary records. [2025-10-01T22:35:19.792405] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-01T22:35:19.791383] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:19.791061] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-01T22:35:19.793499] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 30653 primary records. [2025-10-01T22:35:19.792635] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-01T22:35:19.794031] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-01T22:35:19.796340] [INFO ] [MAIN ] Derivative Progress: 61/1587 symbols completed. ALEX took 1.2s. Estimated remaining: 10m 59s. Rate: 138.9 symbols/min [2025-10-01T22:35:19.797000] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:19.833089] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-01T22:35:19.829970] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-01T22:35:19.833399] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-01T22:35:19.833227] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-01T22:35:19.836123] [INFO ] [MAIN ] Derivative Progress: 62/1587 symbols completed. ALE took 1.3s. Estimated remaining: 10m 49s. Rate: 140.9 symbols/min [2025-10-01T22:35:19.841396] [INFO ] [MAIN ] Derivative Progress: 63/1587 symbols completed. ALC took 1.3s. Estimated remaining: 10m 39s. Rate: 143.2 symbols/min [2025-10-01T22:35:19.841216] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:19.841950] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:19.848728] [DEBUG] [LOCAL ] ALG: Loaded 10239 existing records from primary storage. [2025-10-01T22:35:19.848936] [INFO ] [MAIN ] ALG: Loaded 10239 primary data records. [2025-10-01T22:35:20.262147] [DEBUG] [LOCAL ] ALIT: Loaded 52766 existing records from primary storage. [2025-10-01T22:35:20.263937] [DEBUG] [LOCAL ] ALK: Loaded 53054 existing records from primary storage. [2025-10-01T22:35:20.264101] [INFO ] [MAIN ] ALIT: Loaded 52766 primary data records. [2025-10-01T22:35:20.264861] [INFO ] [MAIN ] ALK: Loaded 53054 primary data records. [2025-10-01T22:35:20.999273] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:21.001842] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10239 primary records. [2025-10-01T22:35:21.002257] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-01T22:35:21.020894] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-01T22:35:21.021291] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-01T22:35:21.023816] [INFO ] [MAIN ] Derivative Progress: 64/1587 symbols completed. ALG took 1.2s. Estimated remaining: 10m 56s. Rate: 139.2 symbols/min [2025-10-01T22:35:21.024373] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:21.043375] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:21.044272] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53054 primary records. [2025-10-01T22:35:21.044383] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-01T22:35:21.079630] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:21.079342] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-01T22:35:21.079803] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-01T22:35:21.081899] [INFO ] [MAIN ] Derivative Progress: 65/1587 symbols completed. ALK took 1.2s. Estimated remaining: 10m 47s. Rate: 141.1 symbols/min [2025-10-01T22:35:21.082123] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:21.082996] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52766 primary records. [2025-10-01T22:35:21.083346] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-01T22:35:21.101236] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-01T22:35:21.101357] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-01T22:35:21.104317] [INFO ] [MAIN ] Derivative Progress: 66/1587 symbols completed. ALIT took 1.3s. Estimated remaining: 10m 37s. Rate: 143.2 symbols/min [2025-10-01T22:35:21.115767] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:21.140804] [DEBUG] [LOCAL ] ALL: Loaded 50049 existing records from primary storage. [2025-10-01T22:35:21.140977] [INFO ] [MAIN ] ALL: Loaded 50049 primary data records. [2025-10-01T22:35:21.372158] [DEBUG] [LOCAL ] ALLE: Loaded 44729 existing records from primary storage. [2025-10-01T22:35:21.412550] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-10-01T22:35:21.459066] [INFO ] [MAIN ] ALLY: Loaded 53217 primary data records. [2025-10-01T22:35:21.458862] [INFO ] [MAIN ] ALLE: Loaded 44729 primary data records. [2025-10-01T22:35:22.247755] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:22.249532] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 50049 primary records. [2025-10-01T22:35:22.250048] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-01T22:35:22.271771] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-01T22:35:22.272442] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-01T22:35:22.274892] [INFO ] [MAIN ] Derivative Progress: 67/1587 symbols completed. ALL took 1.3s. Estimated remaining: 10m 54s. Rate: 139.4 symbols/min [2025-10-01T22:35:22.275366] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:22.327773] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:22.327258] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:22.328982] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53217 primary records. [2025-10-01T22:35:22.329794] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44729 primary records. [2025-10-01T22:35:22.330059] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-01T22:35:22.330123] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-01T22:35:22.379344] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-01T22:35:22.379508] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-01T22:35:22.378123] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-01T22:35:22.379678] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-01T22:35:22.383032] [INFO ] [MAIN ] Derivative Progress: 68/1587 symbols completed. ALLY took 1.3s. Estimated remaining: 10m 46s. Rate: 141.0 symbols/min [2025-10-01T22:35:22.386409] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:22.386631] [INFO ] [MAIN ] Derivative Progress: 69/1587 symbols completed. ALLE took 1.3s. Estimated remaining: 10m 37s. Rate: 143.0 symbols/min [2025-10-01T22:35:22.387065] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:22.413884] [DEBUG] [LOCAL ] ALUR: Loaded 10774 existing records from primary storage. [2025-10-01T22:35:22.414213] [INFO ] [MAIN ] ALUR: Loaded 10774 primary data records. [2025-10-01T22:35:22.541903] [DEBUG] [LOCAL ] ALSN: Loaded 43288 existing records from primary storage. [2025-10-01T22:35:22.574405] [INFO ] [MAIN ] ALSN: Loaded 43288 primary data records. [2025-10-01T22:35:22.585832] [DEBUG] [LOCAL ] ALTG: Loaded 23483 existing records from primary storage. [2025-10-01T22:35:22.648700] [INFO ] [MAIN ] ALTG: Loaded 23483 primary data records. [2025-10-01T22:35:23.793902] [DEBUG] [MAIN ] ALUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:23.796850] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 10774 primary records. [2025-10-01T22:35:23.797093] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-01T22:35:23.828001] [DEBUG] [MAIN ] ALSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:23.830038] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-01T22:35:23.830408] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-01T22:35:23.832629] [INFO ] [MAIN ] Derivative Progress: 70/1587 symbols completed. ALUR took 1.4s. Estimated remaining: 10m 59s. Rate: 138.2 symbols/min [2025-10-01T22:35:23.833829] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:23.833593] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43288 primary records. [2025-10-01T22:35:23.834462] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-01T22:35:23.854702] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-01T22:35:23.855606] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-01T22:35:23.858716] [INFO ] [MAIN ] Derivative Progress: 71/1587 symbols completed. ALSN took 1.6s. Estimated remaining: 10m 49s. Rate: 140.1 symbols/min [2025-10-01T22:35:23.859188] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:23.872773] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:23.873598] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23483 primary records. [2025-10-01T22:35:23.873854] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-01T22:35:23.894251] [DEBUG] [LOCAL ] ALX: Loaded 6227 existing records from primary storage. [2025-10-01T22:35:23.895179] [INFO ] [MAIN ] ALX: Loaded 6227 primary data records. [2025-10-01T22:35:23.986142] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-01T22:35:24.010689] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-01T22:35:24.032619] [INFO ] [MAIN ] Derivative Progress: 72/1587 symbols completed. ALTG took 1.6s. Estimated remaining: 10m 44s. Rate: 141.2 symbols/min [2025-10-01T22:35:24.046852] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:24.053866] [DEBUG] [LOCAL ] ALV: Loaded 42369 existing records from primary storage. [2025-10-01T22:35:24.064776] [INFO ] [MAIN ] ALV: Loaded 42369 primary data records. [2025-10-01T22:35:24.641835] [DEBUG] [LOCAL ] AM: Loaded 52063 existing records from primary storage. [2025-10-01T22:35:24.643294] [INFO ] [MAIN ] AM: Loaded 52063 primary data records. [2025-10-01T22:35:24.697054] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:24.731621] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 6227 primary records. [2025-10-01T22:35:24.751638] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-01T22:35:24.868786] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-01T22:35:24.886266] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-01T22:35:24.859811] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:24.894325] [INFO ] [MAIN ] Derivative Progress: 73/1587 symbols completed. ALX took 1.0s. Estimated remaining: 10m 52s. Rate: 139.3 symbols/min [2025-10-01T22:35:25.010905] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42369 primary records. [2025-10-01T22:35:25.057859] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-01T22:35:25.076785] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-01T22:35:25.077014] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-01T22:35:25.079837] [INFO ] [MAIN ] Derivative Progress: 74/1587 symbols completed. ALV took 1.2s. Estimated remaining: 10m 47s. Rate: 140.3 symbols/min [2025-10-01T22:35:25.100378] [DEBUG] [MAIN ] AM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:25.101072] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52063 primary records. [2025-10-01T22:35:25.101137] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-01T22:35:25.117447] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-01T22:35:25.117538] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-01T22:35:25.119578] [INFO ] [MAIN ] Derivative Progress: 75/1587 symbols completed. AM took 1.1s. Estimated remaining: 10m 39s. Rate: 142.1 symbols/min [2025-10-01T22:35:25.120247] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:25.120154] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:25.120309] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:25.188899] [DEBUG] [LOCAL ] AMBC: Loaded 36580 existing records from primary storage. [2025-10-01T22:35:25.189259] [INFO ] [MAIN ] AMBC: Loaded 36580 primary data records. [2025-10-01T22:35:25.308501] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-01T22:35:25.329081] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-10-01T22:35:25.329930] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-10-01T22:35:25.342464] [INFO ] [MAIN ] AMC: Loaded 53760 primary data records. [2025-10-01T22:35:26.282496] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:26.283888] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36580 primary records. [2025-10-01T22:35:26.284364] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-01T22:35:26.309468] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-01T22:35:26.330566] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:26.322685] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-01T22:35:26.337735] [INFO ] [MAIN ] Derivative Progress: 76/1587 symbols completed. AMBC took 1.2s. Estimated remaining: 10m 54s. Rate: 138.6 symbols/min [2025-10-01T22:35:26.338794] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-10-01T22:35:26.339619] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:26.339296] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:26.339168] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-01T22:35:26.340788] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53760 primary records. [2025-10-01T22:35:26.341610] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-01T22:35:26.373619] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-01T22:35:26.374565] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-01T22:35:26.378139] [INFO ] [MAIN ] Derivative Progress: 77/1587 symbols completed. AMC took 1.3s. Estimated remaining: 10m 46s. Rate: 140.3 symbols/min [2025-10-01T22:35:26.378347] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:26.383291] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-01T22:35:26.383408] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-01T22:35:26.386483] [INFO ] [MAIN ] Derivative Progress: 78/1587 symbols completed. AMCR took 1.3s. Estimated remaining: 10m 37s. Rate: 142.1 symbols/min [2025-10-01T22:35:26.386848] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:26.409500] [DEBUG] [LOCAL ] AMG: Loaded 20419 existing records from primary storage. [2025-10-01T22:35:26.420996] [INFO ] [MAIN ] AMG: Loaded 20419 primary data records. [2025-10-01T22:35:26.575757] [DEBUG] [LOCAL ] AME: Loaded 48490 existing records from primary storage. [2025-10-01T22:35:26.576016] [INFO ] [MAIN ] AME: Loaded 48490 primary data records. [2025-10-01T22:35:26.778817] [DEBUG] [LOCAL ] AMH: Loaded 51715 existing records from primary storage. [2025-10-01T22:35:26.915711] [INFO ] [MAIN ] AMH: Loaded 51715 primary data records. [2025-10-01T22:35:27.552444] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:27.553350] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20419 primary records. [2025-10-01T22:35:27.553861] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-01T22:35:27.573098] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-10-01T22:35:27.574497] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-01T22:35:27.577465] [INFO ] [MAIN ] Derivative Progress: 79/1587 symbols completed. AMG took 1.2s. Estimated remaining: 10m 52s. Rate: 138.9 symbols/min [2025-10-01T22:35:27.578471] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:27.594341] [DEBUG] [MAIN ] AME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:27.595218] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48490 primary records. [2025-10-01T22:35:27.595440] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-01T22:35:27.613478] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-01T22:35:27.614800] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-01T22:35:27.618187] [INFO ] [MAIN ] Derivative Progress: 80/1587 symbols completed. AME took 1.3s. Estimated remaining: 10m 44s. Rate: 140.5 symbols/min [2025-10-01T22:35:27.619053] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:27.633251] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:27.634227] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51715 primary records. [2025-10-01T22:35:27.634350] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-01T22:35:27.662035] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-01T22:35:27.662183] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-01T22:35:27.665392] [INFO ] [MAIN ] Derivative Progress: 81/1587 symbols completed. AMH took 1.3s. Estimated remaining: 10m 36s. Rate: 142.0 symbols/min [2025-10-01T22:35:27.666237] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:27.688748] [DEBUG] [LOCAL ] AMN: Loaded 41777 existing records from primary storage. [2025-10-01T22:35:27.689031] [INFO ] [MAIN ] AMN: Loaded 41777 primary data records. [2025-10-01T22:35:27.819425] [DEBUG] [LOCAL ] AMP: Loaded 32225 existing records from primary storage. [2025-10-01T22:35:27.823632] [INFO ] [MAIN ] AMP: Loaded 32225 primary data records. [2025-10-01T22:35:28.253881] [DEBUG] [LOCAL ] AMPX: Loaded 52297 existing records from primary storage. [2025-10-01T22:35:28.397961] [INFO ] [MAIN ] AMPX: Loaded 52297 primary data records. [2025-10-01T22:35:28.772293] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:28.773278] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41777 primary records. [2025-10-01T22:35:28.773470] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-01T22:35:28.794068] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-01T22:35:28.794460] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-01T22:35:28.809391] [INFO ] [MAIN ] Derivative Progress: 82/1587 symbols completed. AMN took 1.2s. Estimated remaining: 10m 49s. Rate: 139.1 symbols/min [2025-10-01T22:35:28.809806] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:28.810851] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32225 primary records. [2025-10-01T22:35:28.810986] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:28.811122] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-01T22:35:28.834033] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-10-01T22:35:28.834164] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-01T22:35:28.836364] [INFO ] [MAIN ] Derivative Progress: 83/1587 symbols completed. AMP took 1.2s. Estimated remaining: 10m 41s. Rate: 140.7 symbols/min [2025-10-01T22:35:28.844262] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:28.850212] [DEBUG] [MAIN ] AMPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:28.851165] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52297 primary records. [2025-10-01T22:35:28.851570] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-01T22:35:28.878210] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-01T22:35:28.879087] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-01T22:35:28.891836] [INFO ] [MAIN ] Derivative Progress: 84/1587 symbols completed. AMPX took 1.2s. Estimated remaining: 10m 34s. Rate: 142.2 symbols/min [2025-10-01T22:35:28.900637] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:28.901812] [DEBUG] [LOCAL ] AMPY: Loaded 37804 existing records from primary storage. [2025-10-01T22:35:28.901982] [INFO ] [MAIN ] AMPY: Loaded 37804 primary data records. [2025-10-01T22:35:29.018839] [DEBUG] [LOCAL ] AMR: Loaded 28962 existing records from primary storage. [2025-10-01T22:35:29.038562] [INFO ] [MAIN ] AMR: Loaded 28962 primary data records. [2025-10-01T22:35:29.284941] [DEBUG] [LOCAL ] AMRC: Loaded 38146 existing records from primary storage. [2025-10-01T22:35:29.295622] [INFO ] [MAIN ] AMRC: Loaded 38146 primary data records. [2025-10-01T22:35:30.052018] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:30.054563] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28962 primary records. [2025-10-01T22:35:30.054858] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-01T22:35:30.053735] [DEBUG] [MAIN ] AMPY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:30.056384] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 37804 primary records. [2025-10-01T22:35:30.056609] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-01T22:35:30.092673] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-01T22:35:30.087824] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-01T22:35:30.092937] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-01T22:35:30.096091] [INFO ] [MAIN ] Derivative Progress: 85/1587 symbols completed. AMR took 1.3s. Estimated remaining: 10m 48s. Rate: 139.1 symbols/min [2025-10-01T22:35:30.092867] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-01T22:35:30.096607] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:30.098895] [INFO ] [MAIN ] Derivative Progress: 86/1587 symbols completed. AMPY took 1.3s. Estimated remaining: 10m 40s. Rate: 140.8 symbols/min [2025-10-01T22:35:30.100335] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:30.116986] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:30.117809] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38146 primary records. [2025-10-01T22:35:30.117915] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-01T22:35:30.141371] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-01T22:35:30.141601] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-01T22:35:30.144311] [INFO ] [MAIN ] Derivative Progress: 87/1587 symbols completed. AMRC took 1.2s. Estimated remaining: 10m 33s. Rate: 142.2 symbols/min [2025-10-01T22:35:30.144626] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:30.156239] [DEBUG] [LOCAL ] AMTB: Loaded 20347 existing records from primary storage. [2025-10-01T22:35:30.156501] [INFO ] [MAIN ] AMTB: Loaded 20347 primary data records. [2025-10-01T22:35:30.177586] [DEBUG] [LOCAL ] AMTD: Loaded 3610 existing records from primary storage. [2025-10-01T22:35:30.195826] [INFO ] [MAIN ] AMTD: Loaded 3610 primary data records. [2025-10-01T22:35:30.493060] [DEBUG] [LOCAL ] AMT: Loaded 52425 existing records from primary storage. [2025-10-01T22:35:30.546415] [INFO ] [MAIN ] AMT: Loaded 52425 primary data records. [2025-10-01T22:35:31.278778] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:31.280608] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3610 primary records. [2025-10-01T22:35:31.279787] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:31.281515] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20347 primary records. [2025-10-01T22:35:31.282019] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-01T22:35:31.281958] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-01T22:35:31.312613] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-01T22:35:31.314669] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-01T22:35:31.317834] [INFO ] [MAIN ] Derivative Progress: 88/1587 symbols completed. AMTB took 1.2s. Estimated remaining: 10m 45s. Rate: 139.4 symbols/min [2025-10-01T22:35:31.319572] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-01T22:35:31.332997] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:31.332716] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-01T22:35:31.333720] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52425 primary records. [2025-10-01T22:35:31.336287] [INFO ] [MAIN ] Derivative Progress: 89/1587 symbols completed. AMTD took 1.2s. Estimated remaining: 10m 38s. Rate: 140.9 symbols/min [2025-10-01T22:35:31.333820] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-01T22:35:31.352854] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-01T22:35:31.352926] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-01T22:35:31.355579] [INFO ] [MAIN ] Derivative Progress: 90/1587 symbols completed. AMT took 1.3s. Estimated remaining: 10m 31s. Rate: 142.4 symbols/min [2025-10-01T22:35:31.355982] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:31.356203] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:31.356092] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:31.369466] [DEBUG] [LOCAL ] AMWL: Loaded 8847 existing records from primary storage. [2025-10-01T22:35:31.369683] [INFO ] [MAIN ] AMWL: Loaded 8847 primary data records. [2025-10-01T22:35:31.825203] [DEBUG] [LOCAL ] AMTM: Loaded 50643 existing records from primary storage. [2025-10-01T22:35:31.825453] [INFO ] [MAIN ] AMTM: Loaded 50643 primary data records. [2025-10-01T22:35:31.826833] [DEBUG] [LOCAL ] AMX: Loaded 49131 existing records from primary storage. [2025-10-01T22:35:31.833855] [INFO ] [MAIN ] AMX: Loaded 49131 primary data records. [2025-10-01T22:35:32.530567] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:32.531881] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8847 primary records. [2025-10-01T22:35:32.533313] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-01T22:35:32.548855] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-01T22:35:32.550197] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-01T22:35:32.552750] [INFO ] [MAIN ] Derivative Progress: 91/1587 symbols completed. AMWL took 1.2s. Estimated remaining: 10m 43s. Rate: 139.6 symbols/min [2025-10-01T22:35:32.553022] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:32.574795] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:32.575706] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49131 primary records. [2025-10-01T22:35:32.575914] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-01T22:35:32.597171] [DEBUG] [MAIN ] AMTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:32.602532] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50643 primary records. [2025-10-01T22:35:32.607389] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-01T22:35:32.607284] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-01T22:35:32.607673] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-01T22:35:32.610682] [INFO ] [MAIN ] Derivative Progress: 92/1587 symbols completed. AMX took 1.3s. Estimated remaining: 10m 36s. Rate: 140.9 symbols/min [2025-10-01T22:35:32.610975] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:32.631101] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-01T22:35:32.631325] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-01T22:35:32.634238] [INFO ] [MAIN ] Derivative Progress: 93/1587 symbols completed. AMTM took 1.3s. Estimated remaining: 10m 30s. Rate: 142.4 symbols/min [2025-10-01T22:35:32.648931] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:32.693187] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-01T22:35:32.693501] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-01T22:35:32.718554] [DEBUG] [LOCAL ] ANRO: Loaded 18746 existing records from primary storage. [2025-10-01T22:35:32.754190] [INFO ] [MAIN ] ANRO: Loaded 18746 primary data records. [2025-10-01T22:35:32.812132] [DEBUG] [LOCAL ] ANF: Loaded 52129 existing records from primary storage. [2025-10-01T22:35:32.864870] [INFO ] [MAIN ] ANF: Loaded 52129 primary data records. [2025-10-01T22:35:33.814577] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:33.816010] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-01T22:35:33.816416] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-01T22:35:33.868205] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:33.860418] [DEBUG] [MAIN ] ANRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:33.870080] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 18746 primary records. [2025-10-01T22:35:33.871212] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52129 primary records. [2025-10-01T22:35:33.870226] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-01T22:35:33.870316] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-01T22:35:33.871496] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-01T22:35:33.871623] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-01T22:35:33.873726] [INFO ] [MAIN ] Derivative Progress: 94/1587 symbols completed. ANET took 1.3s. Estimated remaining: 10m 42s. Rate: 139.5 symbols/min [2025-10-01T22:35:33.874748] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:33.904861] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-01T22:35:33.905584] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-01T22:35:33.908755] [INFO ] [MAIN ] Derivative Progress: 95/1587 symbols completed. ANF took 1.3s. Estimated remaining: 10m 36s. Rate: 140.9 symbols/min [2025-10-01T22:35:33.909300] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:33.920596] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-01T22:35:33.920784] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-01T22:35:33.923473] [INFO ] [MAIN ] Derivative Progress: 96/1587 symbols completed. ANRO took 1.3s. Estimated remaining: 10m 29s. Rate: 142.3 symbols/min [2025-10-01T22:35:33.924032] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:33.933589] [DEBUG] [LOCAL ] ANVS: Loaded 23194 existing records from primary storage. [2025-10-01T22:35:33.933768] [INFO ] [MAIN ] ANVS: Loaded 23194 primary data records. [2025-10-01T22:35:34.097823] [DEBUG] [LOCAL ] AOMR: Loaded 16542 existing records from primary storage. [2025-10-01T22:35:34.123900] [INFO ] [MAIN ] AOMR: Loaded 16542 primary data records. [2025-10-01T22:35:34.130199] [DEBUG] [LOCAL ] AOD: Loaded 30194 existing records from primary storage. [2025-10-01T22:35:34.173757] [INFO ] [MAIN ] AOD: Loaded 30194 primary data records. [2025-10-01T22:35:35.021339] [DEBUG] [MAIN ] ANVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:35.022025] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23194 primary records. [2025-10-01T22:35:35.022170] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-01T22:35:35.045578] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-01T22:35:35.048362] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-01T22:35:35.051195] [INFO ] [MAIN ] Derivative Progress: 97/1587 symbols completed. ANVS took 1.2s. Estimated remaining: 10m 39s. Rate: 139.9 symbols/min [2025-10-01T22:35:35.052478] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:35.068636] [DEBUG] [MAIN ] AOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:35.069695] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30194 primary records. [2025-10-01T22:35:35.077220] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-01T22:35:35.091327] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:35.097401] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16542 primary records. [2025-10-01T22:35:35.097627] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-01T22:35:35.109435] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-01T22:35:35.113270] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-01T22:35:35.118144] [INFO ] [MAIN ] Derivative Progress: 98/1587 symbols completed. AOD took 1.2s. Estimated remaining: 10m 33s. Rate: 141.1 symbols/min [2025-10-01T22:35:35.120509] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-01T22:35:35.120846] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-01T22:35:35.120717] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:35.124255] [INFO ] [MAIN ] Derivative Progress: 99/1587 symbols completed. AOMR took 1.2s. Estimated remaining: 10m 26s. Rate: 142.5 symbols/min [2025-10-01T22:35:35.124810] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:35.144094] [DEBUG] [LOCAL ] AP: Loaded 7180 existing records from primary storage. [2025-10-01T22:35:35.144301] [INFO ] [MAIN ] AP: Loaded 7180 primary data records. [2025-10-01T22:35:35.281239] [DEBUG] [LOCAL ] AON: Loaded 45428 existing records from primary storage. [2025-10-01T22:35:35.302741] [INFO ] [MAIN ] AON: Loaded 45428 primary data records. [2025-10-01T22:35:35.502850] [DEBUG] [LOCAL ] AOS: Loaded 48840 existing records from primary storage. [2025-10-01T22:35:35.607382] [INFO ] [MAIN ] AOS: Loaded 48840 primary data records. [2025-10-01T22:35:36.255671] [DEBUG] [MAIN ] AP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:36.268669] [DEBUG] [MAIN ] AON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:36.269723] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 7180 primary records. [2025-10-01T22:35:36.270705] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45428 primary records. [2025-10-01T22:35:36.269953] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-01T22:35:36.271596] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-01T22:35:36.301932] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-10-01T22:35:36.303410] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-01T22:35:36.306704] [INFO ] [MAIN ] Derivative Progress: 100/1587 symbols completed. AP took 1.2s. Estimated remaining: 10m 37s. Rate: 140.0 symbols/min [2025-10-01T22:35:36.307086] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:36.324201] [DEBUG] [MAIN ] AOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:36.325039] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-01T22:35:36.325965] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48840 primary records. [2025-10-01T22:35:36.326169] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-01T22:35:36.326251] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-01T22:35:36.329279] [INFO ] [MAIN ] Derivative Progress: 101/1587 symbols completed. AON took 1.3s. Estimated remaining: 10m 31s. Rate: 141.3 symbols/min [2025-10-01T22:35:36.330318] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:36.347143] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-10-01T22:35:36.347416] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-01T22:35:36.350271] [INFO ] [MAIN ] Derivative Progress: 102/1587 symbols completed. AOS took 1.2s. Estimated remaining: 10m 25s. Rate: 142.6 symbols/min [2025-10-01T22:35:36.350524] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:36.409737] [DEBUG] [LOCAL ] APD: Loaded 45389 existing records from primary storage. [2025-10-01T22:35:36.409961] [INFO ] [MAIN ] APD: Loaded 45389 primary data records. [2025-10-01T22:35:36.535929] [DEBUG] [LOCAL ] APLE: Loaded 51925 existing records from primary storage. [2025-10-01T22:35:36.565913] [INFO ] [MAIN ] APLE: Loaded 51925 primary data records. [2025-10-01T22:35:36.608899] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-01T22:35:36.634100] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-01T22:35:37.538032] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:37.539127] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45389 primary records. [2025-10-01T22:35:37.539265] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-01T22:35:37.573478] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-01T22:35:37.575127] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-01T22:35:37.571074] [DEBUG] [MAIN ] APLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:37.575991] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 51925 primary records. [2025-10-01T22:35:37.578084] [INFO ] [MAIN ] Derivative Progress: 103/1587 symbols completed. APD took 1.3s. Estimated remaining: 10m 36s. Rate: 140.0 symbols/min [2025-10-01T22:35:37.578219] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-01T22:35:37.608001] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-10-01T22:35:37.608143] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-01T22:35:37.610782] [INFO ] [MAIN ] Derivative Progress: 104/1587 symbols completed. APLE took 1.3s. Estimated remaining: 10m 30s. Rate: 141.3 symbols/min [2025-10-01T22:35:37.607939] [DEBUG] [MAIN ] APH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:37.611897] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-10-01T22:35:37.612026] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-01T22:35:37.628616] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-01T22:35:37.628710] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-01T22:35:37.631692] [INFO ] [MAIN ] Derivative Progress: 105/1587 symbols completed. APH took 1.3s. Estimated remaining: 10m 24s. Rate: 142.6 symbols/min [2025-10-01T22:35:37.632315] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:37.632719] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:37.632463] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:37.641139] [DEBUG] [LOCAL ] AQNB: Loaded 4164 existing records from primary storage. [2025-10-01T22:35:37.641350] [INFO ] [MAIN ] AQNB: Loaded 4164 primary data records. [2025-10-01T22:35:38.045375] [DEBUG] [LOCAL ] AQN: Loaded 51909 existing records from primary storage. [2025-10-01T22:35:38.045587] [INFO ] [MAIN ] AQN: Loaded 51909 primary data records. [2025-10-01T22:35:38.052215] [DEBUG] [LOCAL ] AR: Loaded 53583 existing records from primary storage. [2025-10-01T22:35:38.052345] [INFO ] [MAIN ] AR: Loaded 53583 primary data records. [2025-10-01T22:35:38.575028] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:38.614502] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 4164 primary records. [2025-10-01T22:35:38.654564] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-01T22:35:38.806638] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-01T22:35:38.807072] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-01T22:35:38.809991] [INFO ] [MAIN ] Derivative Progress: 106/1587 symbols completed. AQNB took 1.2s. Estimated remaining: 10m 34s. Rate: 140.2 symbols/min [2025-10-01T22:35:38.810325] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:38.850621] [DEBUG] [MAIN ] AQN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:38.857170] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51909 primary records. [2025-10-01T22:35:38.856183] [DEBUG] [MAIN ] AR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:38.857356] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-01T22:35:38.868485] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53583 primary records. [2025-10-01T22:35:38.869560] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-01T22:35:38.904086] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-10-01T22:35:38.918199] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-01T22:35:38.904216] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-10-01T22:35:38.922078] [DEBUG] [LOCAL ] ARCO: Loaded 44450 existing records from primary storage. [2025-10-01T22:35:38.922314] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-01T22:35:38.922442] [INFO ] [MAIN ] ARCO: Loaded 44450 primary data records. [2025-10-01T22:35:38.920679] [INFO ] [MAIN ] Derivative Progress: 107/1587 symbols completed. AQN took 1.3s. Estimated remaining: 10m 29s. Rate: 141.2 symbols/min [2025-10-01T22:35:38.925917] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:38.926145] [INFO ] [MAIN ] Derivative Progress: 108/1587 symbols completed. AR took 1.3s. Estimated remaining: 10m 23s. Rate: 142.5 symbols/min [2025-10-01T22:35:38.926393] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:39.161682] [DEBUG] [LOCAL ] ARDT: Loaded 27653 existing records from primary storage. [2025-10-01T22:35:39.164248] [DEBUG] [LOCAL ] ARDC: Loaded 14775 existing records from primary storage. [2025-10-01T22:35:39.292484] [INFO ] [MAIN ] ARDT: Loaded 27653 primary data records. [2025-10-01T22:35:39.292406] [INFO ] [MAIN ] ARDC: Loaded 14775 primary data records. [2025-10-01T22:35:40.003436] [DEBUG] [MAIN ] ARCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:40.005296] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44450 primary records. [2025-10-01T22:35:40.006714] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-01T22:35:40.025270] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-10-01T22:35:40.025991] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-01T22:35:40.028151] [INFO ] [MAIN ] Derivative Progress: 109/1587 symbols completed. ARCO took 1.2s. Estimated remaining: 10m 32s. Rate: 140.4 symbols/min [2025-10-01T22:35:40.028762] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:40.066899] [DEBUG] [MAIN ] ARDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:40.068287] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14775 primary records. [2025-10-01T22:35:40.068483] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-01T22:35:40.067396] [DEBUG] [MAIN ] ARDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:40.070139] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27653 primary records. [2025-10-01T22:35:40.070382] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-01T22:35:40.094347] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-10-01T22:35:40.098148] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-01T22:35:40.100557] [INFO ] [MAIN ] Derivative Progress: 110/1587 symbols completed. ARDC took 1.2s. Estimated remaining: 10m 26s. Rate: 141.5 symbols/min [2025-10-01T22:35:40.101182] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:40.106804] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-01T22:35:40.107324] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-01T22:35:40.123636] [INFO ] [MAIN ] Derivative Progress: 111/1587 symbols completed. ARDT took 1.2s. Estimated remaining: 10m 21s. Rate: 142.7 symbols/min [2025-10-01T22:35:40.124046] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:40.150856] [DEBUG] [LOCAL ] ARE: Loaded 50634 existing records from primary storage. [2025-10-01T22:35:40.151183] [INFO ] [MAIN ] ARE: Loaded 50634 primary data records. [2025-10-01T22:35:40.377869] [DEBUG] [LOCAL ] ARI: Loaded 43522 existing records from primary storage. [2025-10-01T22:35:40.424731] [INFO ] [MAIN ] ARI: Loaded 43522 primary data records. [2025-10-01T22:35:40.424458] [DEBUG] [LOCAL ] ARIS: Loaded 42157 existing records from primary storage. [2025-10-01T22:35:40.425103] [INFO ] [MAIN ] ARIS: Loaded 42157 primary data records. [2025-10-01T22:35:41.295244] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:41.297447] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50634 primary records. [2025-10-01T22:35:41.297841] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-01T22:35:41.317988] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-01T22:35:41.318737] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-01T22:35:41.320838] [INFO ] [MAIN ] Derivative Progress: 112/1587 symbols completed. ARE took 1.3s. Estimated remaining: 10m 31s. Rate: 140.4 symbols/min [2025-10-01T22:35:41.321462] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:41.340564] [DEBUG] [MAIN ] ARI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:41.343441] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43522 primary records. [2025-10-01T22:35:41.344256] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-01T22:35:41.367423] [DEBUG] [MAIN ] ARIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:41.371374] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42157 primary records. [2025-10-01T22:35:41.371594] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-01T22:35:41.377159] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-10-01T22:35:41.377351] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-01T22:35:41.398125] [INFO ] [MAIN ] Derivative Progress: 113/1587 symbols completed. ARI took 1.3s. Estimated remaining: 10m 26s. Rate: 141.4 symbols/min [2025-10-01T22:35:41.402137] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:41.407752] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-10-01T22:35:41.407946] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-01T22:35:41.410631] [INFO ] [MAIN ] Derivative Progress: 114/1587 symbols completed. ARIS took 1.3s. Estimated remaining: 10m 20s. Rate: 142.6 symbols/min [2025-10-01T22:35:41.410860] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:41.428282] [DEBUG] [LOCAL ] ARLO: Loaded 43792 existing records from primary storage. [2025-10-01T22:35:41.428581] [INFO ] [MAIN ] ARLO: Loaded 43792 primary data records. [2025-10-01T22:35:41.817789] [DEBUG] [LOCAL ] ARMK: Loaded 50366 existing records from primary storage. [2025-10-01T22:35:41.820029] [DEBUG] [LOCAL ] AROC: Loaded 48961 existing records from primary storage. [2025-10-01T22:35:41.818729] [INFO ] [MAIN ] ARMK: Loaded 50366 primary data records. [2025-10-01T22:35:41.820781] [INFO ] [MAIN ] AROC: Loaded 48961 primary data records. [2025-10-01T22:35:42.539536] [DEBUG] [MAIN ] ARLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:42.542354] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43792 primary records. [2025-10-01T22:35:42.542739] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-01T22:35:42.561675] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-01T22:35:42.562086] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-01T22:35:42.566139] [INFO ] [MAIN ] Derivative Progress: 115/1587 symbols completed. ARLO took 1.2s. Estimated remaining: 10m 29s. Rate: 140.5 symbols/min [2025-10-01T22:35:42.567242] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:42.605005] [DEBUG] [MAIN ] AROC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:42.606042] [DEBUG] [MAIN ] ARMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:42.607090] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50366 primary records. [2025-10-01T22:35:42.607885] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-01T22:35:42.607834] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48961 primary records. [2025-10-01T22:35:42.609003] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-01T22:35:42.647609] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-10-01T22:35:42.648531] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-01T22:35:42.651383] [INFO ] [MAIN ] Derivative Progress: 116/1587 symbols completed. ARMK took 1.2s. Estimated remaining: 10m 24s. Rate: 141.4 symbols/min [2025-10-01T22:35:42.652476] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:42.669090] [DEBUG] [LOCAL ] ARW: Loaded 33095 existing records from primary storage. [2025-10-01T22:35:42.669622] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-10-01T22:35:42.669779] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-01T22:35:42.672607] [INFO ] [MAIN ] ARW: Loaded 33095 primary data records. [2025-10-01T22:35:42.672519] [INFO ] [MAIN ] Derivative Progress: 117/1587 symbols completed. AROC took 1.3s. Estimated remaining: 10m 19s. Rate: 142.6 symbols/min [2025-10-01T22:35:42.672901] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:42.895793] [DEBUG] [LOCAL ] ASA: Loaded 14164 existing records from primary storage. [2025-10-01T22:35:42.930701] [INFO ] [MAIN ] ASA: Loaded 14164 primary data records. [2025-10-01T22:35:43.190616] [DEBUG] [LOCAL ] AS: Loaded 53087 existing records from primary storage. [2025-10-01T22:35:43.214937] [INFO ] [MAIN ] AS: Loaded 53087 primary data records. [2025-10-01T22:35:43.658895] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:43.689424] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33095 primary records. [2025-10-01T22:35:43.729763] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-01T22:35:43.809732] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-01T22:35:43.809936] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-01T22:35:43.812209] [INFO ] [MAIN ] Derivative Progress: 118/1587 symbols completed. ARW took 1.2s. Estimated remaining: 10m 27s. Rate: 140.6 symbols/min [2025-10-01T22:35:43.831612] [DEBUG] [MAIN ] ASA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:43.832548] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 14164 primary records. [2025-10-01T22:35:43.832782] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-01T22:35:43.855093] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-01T22:35:43.855428] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-01T22:35:43.858002] [INFO ] [MAIN ] Derivative Progress: 119/1587 symbols completed. ASA took 1.2s. Estimated remaining: 10m 22s. Rate: 141.6 symbols/min [2025-10-01T22:35:43.870629] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:35:43.871298] [INFO ] [MAIN ] AS: Generated 1793 derivative records from 53087 primary records. [2025-10-01T22:35:43.871362] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-01T22:35:43.886832] [DEBUG] [LOCAL ] AS: Derivative data saved (1793 records). [2025-10-01T22:35:43.886911] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-01T22:35:43.889767] [INFO ] [MAIN ] Derivative Progress: 120/1587 symbols completed. AS took 1.2s. Estimated remaining: 10m 17s. Rate: 142.7 symbols/min [2025-10-01T22:35:43.890458] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:43.890352] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:43.890605] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:43.975027] [DEBUG] [LOCAL ] ASC: Loaded 37387 existing records from primary storage. [2025-10-01T22:35:43.975275] [INFO ] [MAIN ] ASC: Loaded 37387 primary data records. [2025-10-01T22:35:43.976282] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-01T22:35:43.983560] [INFO ] [MAIN ] ASAN: Loaded 52722 primary data records. [2025-10-01T22:35:44.124764] [DEBUG] [LOCAL ] ASB: Loaded 49511 existing records from primary storage. [2025-10-01T22:35:44.177382] [INFO ] [MAIN ] ASB: Loaded 49511 primary data records. [2025-10-01T22:35:45.107205] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:45.110000] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52722 primary records. [2025-10-01T22:35:45.110994] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-01T22:35:45.135969] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:45.143740] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37387 primary records. [2025-10-01T22:35:45.145138] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-01T22:35:45.146710] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-01T22:35:45.147789] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-01T22:35:45.149712] [INFO ] [MAIN ] Derivative Progress: 121/1587 symbols completed. ASAN took 1.3s. Estimated remaining: 10m 26s. Rate: 140.4 symbols/min [2025-10-01T22:35:45.157774] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:45.172774] [DEBUG] [MAIN ] ASB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:45.177530] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49511 primary records. [2025-10-01T22:35:45.178041] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-01T22:35:45.195548] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-01T22:35:45.196355] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-01T22:35:45.199478] [INFO ] [MAIN ] Derivative Progress: 122/1587 symbols completed. ASC took 1.3s. Estimated remaining: 10m 22s. Rate: 141.4 symbols/min [2025-10-01T22:35:45.200252] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:45.218356] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-01T22:35:45.218256] [DEBUG] [LOCAL ] ASG: Loaded 19882 existing records from primary storage. [2025-10-01T22:35:45.218525] [INFO ] [MAIN ] ASG: Loaded 19882 primary data records. [2025-10-01T22:35:45.230180] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-01T22:35:45.259246] [INFO ] [MAIN ] Derivative Progress: 123/1587 symbols completed. ASB took 1.4s. Estimated remaining: 10m 17s. Rate: 142.4 symbols/min [2025-10-01T22:35:45.291930] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:45.363234] [DEBUG] [LOCAL ] ASGI: Loaded 22690 existing records from primary storage. [2025-10-01T22:35:45.363902] [INFO ] [MAIN ] ASGI: Loaded 22690 primary data records. [2025-10-01T22:35:45.822930] [DEBUG] [LOCAL ] ASGN: Loaded 36096 existing records from primary storage. [2025-10-01T22:35:45.867811] [INFO ] [MAIN ] ASGN: Loaded 36096 primary data records. [2025-10-01T22:35:46.213421] [DEBUG] [MAIN ] ASG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:46.344198] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19882 primary records. [2025-10-01T22:35:46.344904] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-01T22:35:46.382071] [DEBUG] [MAIN ] ASGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:46.383789] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22690 primary records. [2025-10-01T22:35:46.383916] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-01T22:35:46.386357] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-01T22:35:46.386521] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-01T22:35:46.389040] [INFO ] [MAIN ] Derivative Progress: 124/1587 symbols completed. ASG took 1.2s. Estimated remaining: 10m 25s. Rate: 140.5 symbols/min [2025-10-01T22:35:46.389706] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:46.412749] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-01T22:35:46.413177] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-01T22:35:46.415468] [INFO ] [MAIN ] Derivative Progress: 125/1587 symbols completed. ASGI took 1.2s. Estimated remaining: 10m 20s. Rate: 141.6 symbols/min [2025-10-01T22:35:46.416553] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:46.437687] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:46.438530] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36096 primary records. [2025-10-01T22:35:46.438606] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-01T22:35:46.471782] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-01T22:35:46.472034] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-01T22:35:46.475264] [INFO ] [MAIN ] Derivative Progress: 126/1587 symbols completed. ASGN took 1.2s. Estimated remaining: 10m 15s. Rate: 142.6 symbols/min [2025-10-01T22:35:46.476503] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:46.489767] [DEBUG] [LOCAL ] ASH: Loaded 37770 existing records from primary storage. [2025-10-01T22:35:46.497818] [INFO ] [MAIN ] ASH: Loaded 37770 primary data records. [2025-10-01T22:35:46.498423] [DEBUG] [LOCAL ] ASIX: Loaded 22665 existing records from primary storage. [2025-10-01T22:35:46.498590] [INFO ] [MAIN ] ASIX: Loaded 22665 primary data records. [2025-10-01T22:35:47.257108] [DEBUG] [LOCAL ] ASPN: Loaded 49592 existing records from primary storage. [2025-10-01T22:35:47.257595] [INFO ] [MAIN ] ASPN: Loaded 49592 primary data records. [2025-10-01T22:35:47.628476] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:47.629939] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37770 primary records. [2025-10-01T22:35:47.630148] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-01T22:35:47.666786] [DEBUG] [MAIN ] ASIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:47.668852] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22665 primary records. [2025-10-01T22:35:47.669312] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-01T22:35:47.670318] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-01T22:35:47.670834] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-01T22:35:47.674966] [INFO ] [MAIN ] Derivative Progress: 127/1587 symbols completed. ASH took 1.3s. Estimated remaining: 10m 23s. Rate: 140.5 symbols/min [2025-10-01T22:35:47.688963] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:47.695225] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-01T22:35:47.695492] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-01T22:35:47.698900] [INFO ] [MAIN ] Derivative Progress: 128/1587 symbols completed. ASIX took 1.3s. Estimated remaining: 10m 18s. Rate: 141.6 symbols/min [2025-10-01T22:35:47.701158] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:47.724685] [DEBUG] [LOCAL ] ASR: Loaded 9345 existing records from primary storage. [2025-10-01T22:35:47.725239] [INFO ] [MAIN ] ASR: Loaded 9345 primary data records. [2025-10-01T22:35:47.725465] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:47.732082] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49592 primary records. [2025-10-01T22:35:47.732189] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-01T22:35:47.835799] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-01T22:35:47.860600] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-01T22:35:47.868623] [INFO ] [MAIN ] Derivative Progress: 129/1587 symbols completed. ASPN took 1.4s. Estimated remaining: 10m 15s. Rate: 142.2 symbols/min [2025-10-01T22:35:47.869501] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:48.127975] [DEBUG] [LOCAL ] ASX: Loaded 52844 existing records from primary storage. [2025-10-01T22:35:48.128380] [INFO ] [MAIN ] ASX: Loaded 52844 primary data records. [2025-10-01T22:35:48.293633] [DEBUG] [LOCAL ] ATEN: Loaded 39400 existing records from primary storage. [2025-10-01T22:35:48.295718] [INFO ] [MAIN ] ATEN: Loaded 39400 primary data records. [2025-10-01T22:35:48.884053] [DEBUG] [MAIN ] ASR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:48.885249] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9345 primary records. [2025-10-01T22:35:48.885453] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-01T22:35:48.911170] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-01T22:35:48.911948] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-01T22:35:48.914801] [INFO ] [MAIN ] Derivative Progress: 130/1587 symbols completed. ASR took 1.2s. Estimated remaining: 10m 22s. Rate: 140.6 symbols/min [2025-10-01T22:35:48.915070] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:48.937133] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:48.937971] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52844 primary records. [2025-10-01T22:35:48.938322] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-01T22:35:48.979969] [DEBUG] [MAIN ] ATEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:48.983006] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-01T22:35:48.982588] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 39400 primary records. [2025-10-01T22:35:48.983192] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-01T22:35:48.983292] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-01T22:35:48.985964] [INFO ] [MAIN ] Derivative Progress: 131/1587 symbols completed. ASX took 1.3s. Estimated remaining: 10m 17s. Rate: 141.5 symbols/min [2025-10-01T22:35:48.986221] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:49.015204] [DEBUG] [LOCAL ] ATGE: Loaded 31426 existing records from primary storage. [2025-10-01T22:35:49.016216] [INFO ] [MAIN ] ATGE: Loaded 31426 primary data records. [2025-10-01T22:35:49.085319] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-01T22:35:49.129940] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-01T22:35:49.156285] [INFO ] [MAIN ] Derivative Progress: 132/1587 symbols completed. ATEN took 1.3s. Estimated remaining: 10m 14s. Rate: 142.2 symbols/min [2025-10-01T22:35:49.192932] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:49.199860] [DEBUG] [LOCAL ] ATHM: Loaded 32173 existing records from primary storage. [2025-10-01T22:35:49.257571] [INFO ] [MAIN ] ATHM: Loaded 32173 primary data records. [2025-10-01T22:35:49.469372] [DEBUG] [LOCAL ] ATHS: Loaded 6972 existing records from primary storage. [2025-10-01T22:35:49.496062] [INFO ] [MAIN ] ATHS: Loaded 6972 primary data records. [2025-10-01T22:35:50.134392] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:50.136460] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31426 primary records. [2025-10-01T22:35:50.136608] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-01T22:35:50.166153] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-01T22:35:50.166694] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-01T22:35:50.168886] [INFO ] [MAIN ] Derivative Progress: 133/1587 symbols completed. ATGE took 1.3s. Estimated remaining: 10m 20s. Rate: 140.7 symbols/min [2025-10-01T22:35:50.199955] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:50.201184] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 32173 primary records. [2025-10-01T22:35:50.200475] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:50.201892] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6972 primary records. [2025-10-01T22:35:50.201952] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-01T22:35:50.202426] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-01T22:35:50.231895] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-01T22:35:50.233475] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-01T22:35:50.233772] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-01T22:35:50.236665] [INFO ] [MAIN ] Derivative Progress: 134/1587 symbols completed. ATHS took 1.0s. Estimated remaining: 10m 16s. Rate: 141.6 symbols/min [2025-10-01T22:35:50.236778] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-01T22:35:50.239594] [INFO ] [MAIN ] Derivative Progress: 135/1587 symbols completed. ATHM took 1.3s. Estimated remaining: 10m 11s. Rate: 142.6 symbols/min [2025-10-01T22:35:50.240165] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:50.240301] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:50.240398] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:50.289945] [DEBUG] [LOCAL ] ATKR: Loaded 35682 existing records from primary storage. [2025-10-01T22:35:50.290286] [INFO ] [MAIN ] ATKR: Loaded 35682 primary data records. [2025-10-01T22:35:50.467915] [DEBUG] [LOCAL ] ATMU: Loaded 39344 existing records from primary storage. [2025-10-01T22:35:50.478320] [INFO ] [MAIN ] ATMU: Loaded 39344 primary data records. [2025-10-01T22:35:50.517879] [DEBUG] [LOCAL ] ATI: Loaded 51502 existing records from primary storage. [2025-10-01T22:35:50.589240] [INFO ] [MAIN ] ATI: Loaded 51502 primary data records. [2025-10-01T22:35:51.402959] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:51.404608] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35682 primary records. [2025-10-01T22:35:51.405175] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-01T22:35:51.443702] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-10-01T22:35:51.442414] [DEBUG] [MAIN ] ATMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:51.443926] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-01T22:35:51.447119] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39344 primary records. [2025-10-01T22:35:51.447399] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-01T22:35:51.446149] [INFO ] [MAIN ] Derivative Progress: 136/1587 symbols completed. ATKR took 1.2s. Estimated remaining: 10m 19s. Rate: 140.7 symbols/min [2025-10-01T22:35:51.448577] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:51.469618] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-10-01T22:35:51.483022] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-01T22:35:51.486011] [INFO ] [MAIN ] Derivative Progress: 137/1587 symbols completed. ATMU took 1.2s. Estimated remaining: 10m 14s. Rate: 141.6 symbols/min [2025-10-01T22:35:51.483336] [DEBUG] [MAIN ] ATI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:51.487022] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51502 primary records. [2025-10-01T22:35:51.487148] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:51.487577] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-01T22:35:51.505587] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-10-01T22:35:51.505733] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-01T22:35:51.522177] [INFO ] [MAIN ] Derivative Progress: 138/1587 symbols completed. ATI took 1.3s. Estimated remaining: 10m 10s. Rate: 142.6 symbols/min [2025-10-01T22:35:51.522606] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:51.536164] [DEBUG] [LOCAL ] ATS: Loaded 17831 existing records from primary storage. [2025-10-01T22:35:51.537058] [INFO ] [MAIN ] ATS: Loaded 17831 primary data records. [2025-10-01T22:35:51.580286] [DEBUG] [LOCAL ] ATR: Loaded 30432 existing records from primary storage. [2025-10-01T22:35:51.593600] [INFO ] [MAIN ] ATR: Loaded 30432 primary data records. [2025-10-01T22:35:52.273793] [DEBUG] [LOCAL ] ATUS: Loaded 49261 existing records from primary storage. [2025-10-01T22:35:52.274972] [INFO ] [MAIN ] ATUS: Loaded 49261 primary data records. [2025-10-01T22:35:52.668239] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:52.682782] [DEBUG] [MAIN ] ATS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:52.683580] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17831 primary records. [2025-10-01T22:35:52.682415] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30432 primary records. [2025-10-01T22:35:52.683700] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-01T22:35:52.684381] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-01T22:35:52.718878] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-01T22:35:52.719603] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-01T22:35:52.722713] [INFO ] [MAIN ] Derivative Progress: 139/1587 symbols completed. ATR took 1.3s. Estimated remaining: 10m 18s. Rate: 140.7 symbols/min [2025-10-01T22:35:52.723014] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:52.728393] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-01T22:35:52.729002] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-01T22:35:52.732157] [INFO ] [MAIN ] Derivative Progress: 140/1587 symbols completed. ATS took 1.2s. Estimated remaining: 10m 13s. Rate: 141.7 symbols/min [2025-10-01T22:35:52.733405] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:52.748525] [DEBUG] [MAIN ] ATUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:52.749369] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49261 primary records. [2025-10-01T22:35:52.749475] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-01T22:35:52.765987] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-01T22:35:52.766186] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-01T22:35:52.770081] [INFO ] [MAIN ] Derivative Progress: 141/1587 symbols completed. ATUS took 1.2s. Estimated remaining: 10m 8s. Rate: 142.6 symbols/min [2025-10-01T22:35:52.770451] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:52.777545] [DEBUG] [LOCAL ] AUNA: Loaded 4886 existing records from primary storage. [2025-10-01T22:35:52.777820] [INFO ] [MAIN ] AUNA: Loaded 4886 primary data records. [2025-10-01T22:35:52.969603] [DEBUG] [LOCAL ] AU: Loaded 52993 existing records from primary storage. [2025-10-01T22:35:52.988024] [DEBUG] [LOCAL ] AUB: Loaded 46326 existing records from primary storage. [2025-10-01T22:35:52.993393] [INFO ] [MAIN ] AU: Loaded 52993 primary data records. [2025-10-01T22:35:53.021872] [INFO ] [MAIN ] AUB: Loaded 46326 primary data records. [2025-10-01T22:35:53.973588] [DEBUG] [MAIN ] AUNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:53.975525] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 4886 primary records. [2025-10-01T22:35:53.975629] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-01T22:35:53.994446] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-10-01T22:35:53.994569] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-01T22:35:53.997357] [INFO ] [MAIN ] Derivative Progress: 142/1587 symbols completed. AUNA took 1.2s. Estimated remaining: 10m 16s. Rate: 140.7 symbols/min [2025-10-01T22:35:53.997702] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:54.034935] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:54.036674] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52993 primary records. [2025-10-01T22:35:54.037011] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:54.037299] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-01T22:35:54.038149] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46326 primary records. [2025-10-01T22:35:54.039313] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-01T22:35:54.080307] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-01T22:35:54.094681] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-01T22:35:54.096447] [DEBUG] [LOCAL ] AVA: Loaded 39411 existing records from primary storage. [2025-10-01T22:35:54.101541] [INFO ] [MAIN ] Derivative Progress: 143/1587 symbols completed. AU took 1.4s. Estimated remaining: 10m 13s. Rate: 141.4 symbols/min [2025-10-01T22:35:54.097692] [INFO ] [MAIN ] AVA: Loaded 39411 primary data records. [2025-10-01T22:35:54.101900] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:54.101683] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-01T22:35:54.120270] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-01T22:35:54.155022] [INFO ] [MAIN ] Derivative Progress: 144/1587 symbols completed. AUB took 1.4s. Estimated remaining: 10m 8s. Rate: 142.3 symbols/min [2025-10-01T22:35:54.179160] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:54.479566] [DEBUG] [LOCAL ] AVD: Loaded 22593 existing records from primary storage. [2025-10-01T22:35:54.479984] [INFO ] [MAIN ] AVD: Loaded 22593 primary data records. [2025-10-01T22:35:54.590193] [DEBUG] [LOCAL ] AVB: Loaded 41937 existing records from primary storage. [2025-10-01T22:35:54.591993] [INFO ] [MAIN ] AVB: Loaded 41937 primary data records. [2025-10-01T22:35:55.220609] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:55.221584] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39411 primary records. [2025-10-01T22:35:55.221888] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-01T22:35:55.254517] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:55.256215] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22593 primary records. [2025-10-01T22:35:55.257531] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-01T22:35:55.258921] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-01T22:35:55.259695] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-01T22:35:55.262934] [INFO ] [MAIN ] Derivative Progress: 145/1587 symbols completed. AVA took 1.3s. Estimated remaining: 10m 15s. Rate: 140.7 symbols/min [2025-10-01T22:35:55.263242] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:55.281120] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-01T22:35:55.281380] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-01T22:35:55.284185] [INFO ] [MAIN ] Derivative Progress: 146/1587 symbols completed. AVD took 1.1s. Estimated remaining: 10m 10s. Rate: 141.7 symbols/min [2025-10-01T22:35:55.284611] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:55.303013] [DEBUG] [MAIN ] AVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:55.303726] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 41937 primary records. [2025-10-01T22:35:55.309315] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-01T22:35:55.341267] [DEBUG] [LOCAL ] AVK: Loaded 17956 existing records from primary storage. [2025-10-01T22:35:55.342003] [INFO ] [MAIN ] AVK: Loaded 17956 primary data records. [2025-10-01T22:35:55.431536] [DEBUG] [LOCAL ] AVNS: Loaded 33718 existing records from primary storage. [2025-10-01T22:35:55.439609] [INFO ] [MAIN ] AVNS: Loaded 33718 primary data records. [2025-10-01T22:35:55.439770] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-01T22:35:55.475688] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-01T22:35:55.558090] [INFO ] [MAIN ] Derivative Progress: 147/1587 symbols completed. AVB took 1.5s. Estimated remaining: 10m 8s. Rate: 142.0 symbols/min [2025-10-01T22:35:55.581452] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:56.071363] [DEBUG] [LOCAL ] AVNT: Loaded 39175 existing records from primary storage. [2025-10-01T22:35:56.072806] [INFO ] [MAIN ] AVNT: Loaded 39175 primary data records. [2025-10-01T22:35:56.314565] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:56.342287] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 17956 primary records. [2025-10-01T22:35:56.475438] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-01T22:35:56.498987] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-01T22:35:56.500101] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-01T22:35:56.518477] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:56.516861] [INFO ] [MAIN ] Derivative Progress: 148/1587 symbols completed. AVK took 1.3s. Estimated remaining: 10m 13s. Rate: 140.8 symbols/min [2025-10-01T22:35:56.519730] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33718 primary records. [2025-10-01T22:35:56.519880] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-01T22:35:56.541557] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-01T22:35:56.542011] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-01T22:35:56.544705] [INFO ] [MAIN ] Derivative Progress: 149/1587 symbols completed. AVNS took 1.3s. Estimated remaining: 10m 9s. Rate: 141.7 symbols/min [2025-10-01T22:35:56.561158] [DEBUG] [MAIN ] AVNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:56.561817] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39175 primary records. [2025-10-01T22:35:56.561879] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-01T22:35:56.577518] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-01T22:35:56.577622] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-01T22:35:56.580831] [INFO ] [MAIN ] Derivative Progress: 150/1587 symbols completed. AVNT took 1.0s. Estimated remaining: 10m 5s. Rate: 142.5 symbols/min [2025-10-01T22:35:56.581382] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:56.581435] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:56.581270] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:56.617387] [DEBUG] [LOCAL ] AWF: Loaded 24390 existing records from primary storage. [2025-10-01T22:35:56.620427] [INFO ] [MAIN ] AWF: Loaded 24390 primary data records. [2025-10-01T22:35:56.729256] [DEBUG] [LOCAL ] AWI: Loaded 25337 existing records from primary storage. [2025-10-01T22:35:56.764258] [INFO ] [MAIN ] AWI: Loaded 25337 primary data records. [2025-10-01T22:35:56.841591] [DEBUG] [LOCAL ] AVY: Loaded 37474 existing records from primary storage. [2025-10-01T22:35:56.847387] [INFO ] [MAIN ] AVY: Loaded 37474 primary data records. [2025-10-01T22:35:57.733545] [DEBUG] [MAIN ] AWF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:57.734897] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24390 primary records. [2025-10-01T22:35:57.735004] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-01T22:35:57.756022] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-01T22:35:57.757730] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-01T22:35:57.772310] [DEBUG] [MAIN ] AWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:57.775544] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 25337 primary records. [2025-10-01T22:35:57.774504] [INFO ] [MAIN ] Derivative Progress: 151/1587 symbols completed. AWF took 1.2s. Estimated remaining: 10m 12s. Rate: 140.8 symbols/min [2025-10-01T22:35:57.775836] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-01T22:35:57.775926] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:57.791330] [DEBUG] [MAIN ] AVY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:57.802787] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37474 primary records. [2025-10-01T22:35:57.805683] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-01T22:35:57.825705] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-10-01T22:35:57.827540] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-01T22:35:57.830531] [INFO ] [MAIN ] Derivative Progress: 152/1587 symbols completed. AWI took 1.2s. Estimated remaining: 10m 8s. Rate: 141.6 symbols/min [2025-10-01T22:35:57.831622] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:57.832898] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-10-01T22:35:57.833191] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-01T22:35:57.836530] [INFO ] [MAIN ] Derivative Progress: 153/1587 symbols completed. AVY took 1.3s. Estimated remaining: 10m 4s. Rate: 142.6 symbols/min [2025-10-01T22:35:57.836979] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:57.877229] [DEBUG] [LOCAL ] AWP: Loaded 21493 existing records from primary storage. [2025-10-01T22:35:57.890805] [INFO ] [MAIN ] AWP: Loaded 21493 primary data records. [2025-10-01T22:35:57.893403] [DEBUG] [LOCAL ] AWK: Loaded 48703 existing records from primary storage. [2025-10-01T22:35:57.900023] [INFO ] [MAIN ] AWK: Loaded 48703 primary data records. [2025-10-01T22:35:57.901537] [DEBUG] [LOCAL ] AWR: Loaded 22600 existing records from primary storage. [2025-10-01T22:35:57.946460] [INFO ] [MAIN ] AWR: Loaded 22600 primary data records. [2025-10-01T22:35:59.059036] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:59.060137] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48703 primary records. [2025-10-01T22:35:59.060395] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-01T22:35:59.061977] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:59.063149] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21493 primary records. [2025-10-01T22:35:59.071838] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-01T22:35:59.111303] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-01T22:35:59.111742] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-01T22:35:59.111207] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:35:59.114930] [INFO ] [MAIN ] Derivative Progress: 154/1587 symbols completed. AWK took 1.3s. Estimated remaining: 10m 11s. Rate: 140.7 symbols/min [2025-10-01T22:35:59.116003] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22600 primary records. [2025-10-01T22:35:59.116579] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:59.117053] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-01T22:35:59.138973] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-01T22:35:59.139568] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-01T22:35:59.139758] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-01T22:35:59.139867] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-01T22:35:59.142827] [INFO ] [MAIN ] Derivative Progress: 155/1587 symbols completed. AWP took 1.3s. Estimated remaining: 10m 7s. Rate: 141.6 symbols/min [2025-10-01T22:35:59.143126] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:59.146340] [INFO ] [MAIN ] Derivative Progress: 156/1587 symbols completed. AWR took 1.3s. Estimated remaining: 10m 3s. Rate: 142.5 symbols/min [2025-10-01T22:35:59.146587] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:35:59.172906] [DEBUG] [LOCAL ] AX: Loaded 28317 existing records from primary storage. [2025-10-01T22:35:59.173153] [INFO ] [MAIN ] AX: Loaded 28317 primary data records. [2025-10-01T22:35:59.561477] [DEBUG] [LOCAL ] AXL: Loaded 50496 existing records from primary storage. [2025-10-01T22:35:59.573094] [INFO ] [MAIN ] AXL: Loaded 50496 primary data records. [2025-10-01T22:35:59.620499] [DEBUG] [LOCAL ] AXP: Loaded 53197 existing records from primary storage. [2025-10-01T22:35:59.651070] [INFO ] [MAIN ] AXP: Loaded 53197 primary data records. [2025-10-01T22:36:00.307039] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:00.308868] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28317 primary records. [2025-10-01T22:36:00.309389] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-01T22:36:00.335514] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-01T22:36:00.348949] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-01T22:36:00.352707] [INFO ] [MAIN ] Derivative Progress: 157/1587 symbols completed. AX took 1.2s. Estimated remaining: 10m 9s. Rate: 140.8 symbols/min [2025-10-01T22:36:00.353191] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:00.354490] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50496 primary records. [2025-10-01T22:36:00.353578] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:00.354938] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-01T22:36:00.376167] [DEBUG] [LOCAL ] AXR: Loaded 3037 existing records from primary storage. [2025-10-01T22:36:00.377554] [INFO ] [MAIN ] AXR: Loaded 3037 primary data records. [2025-10-01T22:36:00.401738] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-01T22:36:00.425314] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-01T22:36:00.436296] [INFO ] [MAIN ] Derivative Progress: 158/1587 symbols completed. AXL took 1.3s. Estimated remaining: 10m 6s. Rate: 141.5 symbols/min [2025-10-01T22:36:00.469194] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:00.534962] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:00.577219] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53197 primary records. [2025-10-01T22:36:00.595351] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-01T22:36:00.799832] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-01T22:36:00.800457] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-01T22:36:00.803861] [INFO ] [MAIN ] Derivative Progress: 159/1587 symbols completed. AXP took 1.7s. Estimated remaining: 10m 5s. Rate: 141.6 symbols/min [2025-10-01T22:36:00.804296] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:00.820259] [DEBUG] [LOCAL ] AXS: Loaded 38383 existing records from primary storage. [2025-10-01T22:36:00.820762] [INFO ] [MAIN ] AXS: Loaded 38383 primary data records. [2025-10-01T22:36:01.152290] [DEBUG] [MAIN ] AXR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:36:01.187251] [INFO ] [MAIN ] AXR: Generated 1793 derivative records from 3037 primary records. [2025-10-01T22:36:01.187480] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-01T22:36:01.211447] [DEBUG] [LOCAL ] AXTA: Loaded 52067 existing records from primary storage. [2025-10-01T22:36:01.216588] [INFO ] [MAIN ] AXTA: Loaded 52067 primary data records. [2025-10-01T22:36:01.311752] [DEBUG] [LOCAL ] AXR: Derivative data saved (1793 records). [2025-10-01T22:36:01.343947] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-01T22:36:01.346738] [INFO ] [MAIN ] Derivative Progress: 160/1587 symbols completed. AXR took 1.0s. Estimated remaining: 10m 6s. Rate: 141.4 symbols/min [2025-10-01T22:36:01.364516] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:01.582555] [DEBUG] [MAIN ] AXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:01.583833] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38383 primary records. [2025-10-01T22:36:01.583930] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-01T22:36:01.615998] [DEBUG] [LOCAL ] AYI: Loaded 25181 existing records from primary storage. [2025-10-01T22:36:01.617904] [INFO ] [MAIN ] AYI: Loaded 25181 primary data records. [2025-10-01T22:36:01.656887] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-01T22:36:01.683597] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-01T22:36:01.701823] [INFO ] [MAIN ] Derivative Progress: 161/1587 symbols completed. AXS took 1.2s. Estimated remaining: 10m 5s. Rate: 141.5 symbols/min [2025-10-01T22:36:01.720892] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:01.841168] [DEBUG] [LOCAL ] AZO: Loaded 11278 existing records from primary storage. [2025-10-01T22:36:01.861309] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:01.975745] [INFO ] [MAIN ] AZO: Loaded 11278 primary data records. [2025-10-01T22:36:01.992639] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52067 primary records. [2025-10-01T22:36:02.007574] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-01T22:36:02.137757] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-01T22:36:02.171441] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-01T22:36:02.214773] [INFO ] [MAIN ] Derivative Progress: 162/1587 symbols completed. AXTA took 1.4s. Estimated remaining: 10m 5s. Rate: 141.3 symbols/min [2025-10-01T22:36:02.219689] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:02.371230] [DEBUG] [MAIN ] AYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:02.373142] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25181 primary records. [2025-10-01T22:36:02.373548] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-01T22:36:02.385368] [DEBUG] [LOCAL ] AZZ: Loaded 21975 existing records from primary storage. [2025-10-01T22:36:02.398276] [INFO ] [MAIN ] AZZ: Loaded 21975 primary data records. [2025-10-01T22:36:02.463029] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-10-01T22:36:02.494694] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-01T22:36:02.503149] [INFO ] [MAIN ] Derivative Progress: 163/1587 symbols completed. AYI took 1.1s. Estimated remaining: 10m 3s. Rate: 141.6 symbols/min [2025-10-01T22:36:02.542430] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:02.564200] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11278 primary records. [2025-10-01T22:36:02.595729] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-01T22:36:02.768771] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-01T22:36:02.769852] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-01T22:36:02.772632] [INFO ] [MAIN ] Derivative Progress: 164/1587 symbols completed. AZO took 1.1s. Estimated remaining: 10m 2s. Rate: 141.9 symbols/min [2025-10-01T22:36:02.794405] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:02.795103] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 21975 primary records. [2025-10-01T22:36:02.795169] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-01T22:36:02.811275] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-10-01T22:36:02.811367] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-01T22:36:02.814226] [INFO ] [MAIN ] Derivative Progress: 165/1587 symbols completed. AZZ took 0.6s. Estimated remaining: 9m 58s. Rate: 142.7 symbols/min [2025-10-01T22:36:02.814738] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:02.814678] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:02.814974] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:02.919090] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-01T22:36:02.920594] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-01T22:36:02.920906] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-01T22:36:02.921103] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-01T22:36:03.104069] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-01T22:36:03.144121] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-01T22:36:04.021565] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:04.035893] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-01T22:36:04.036731] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-01T22:36:04.036964] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:04.039058] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-01T22:36:04.040503] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-01T22:36:04.084784] [DEBUG] [MAIN ] BAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:04.087170] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-01T22:36:04.088176] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-01T22:36:04.091919] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-01T22:36:04.092289] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-01T22:36:04.092192] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-01T22:36:04.094888] [INFO ] [MAIN ] Derivative Progress: 166/1587 symbols completed. BABA took 1.3s. Estimated remaining: 10m 5s. Rate: 141.0 symbols/min [2025-10-01T22:36:04.095015] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-01T22:36:04.106423] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:04.106683] [INFO ] [MAIN ] Derivative Progress: 167/1587 symbols completed. BA took 1.3s. Estimated remaining: 10m 1s. Rate: 141.8 symbols/min [2025-10-01T22:36:04.110022] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:04.115917] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-01T22:36:04.116208] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-01T22:36:04.118960] [INFO ] [MAIN ] Derivative Progress: 168/1587 symbols completed. BAC took 1.3s. Estimated remaining: 9m 57s. Rate: 142.6 symbols/min [2025-10-01T22:36:04.119236] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:04.156402] [DEBUG] [LOCAL ] BAK: Loaded 39146 existing records from primary storage. [2025-10-01T22:36:04.156704] [INFO ] [MAIN ] BAK: Loaded 39146 primary data records. [2025-10-01T22:36:04.380963] [DEBUG] [LOCAL ] BALL: Loaded 51797 existing records from primary storage. [2025-10-01T22:36:04.401894] [INFO ] [MAIN ] BALL: Loaded 51797 primary data records. [2025-10-01T22:36:04.391530] [DEBUG] [LOCAL ] BAH: Loaded 51669 existing records from primary storage. [2025-10-01T22:36:04.431542] [INFO ] [MAIN ] BAH: Loaded 51669 primary data records. [2025-10-01T22:36:05.345294] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:05.346957] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39146 primary records. [2025-10-01T22:36:05.347181] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-01T22:36:05.372407] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-01T22:36:05.372901] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-01T22:36:05.375008] [INFO ] [MAIN ] Derivative Progress: 169/1587 symbols completed. BAK took 1.3s. Estimated remaining: 10m 4s. Rate: 141.0 symbols/min [2025-10-01T22:36:05.375307] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:05.393321] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:05.394093] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51797 primary records. [2025-10-01T22:36:05.394274] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-01T22:36:05.424478] [DEBUG] [MAIN ] BAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:05.426538] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51669 primary records. [2025-10-01T22:36:05.427958] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-01T22:36:05.428107] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-01T22:36:05.428167] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-01T22:36:05.431830] [INFO ] [MAIN ] Derivative Progress: 170/1587 symbols completed. BALL took 1.3s. Estimated remaining: 10m 0s. Rate: 141.7 symbols/min [2025-10-01T22:36:05.440090] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:05.450630] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-10-01T22:36:05.450916] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-01T22:36:05.454134] [INFO ] [MAIN ] Derivative Progress: 171/1587 symbols completed. BAH took 1.3s. Estimated remaining: 9m 56s. Rate: 142.5 symbols/min [2025-10-01T22:36:05.454592] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:05.510192] [DEBUG] [LOCAL ] BAM: Loaded 51995 existing records from primary storage. [2025-10-01T22:36:05.510513] [INFO ] [MAIN ] BAM: Loaded 51995 primary data records. [2025-10-01T22:36:05.602490] [DEBUG] [LOCAL ] BAP: Loaded 26187 existing records from primary storage. [2025-10-01T22:36:05.627953] [INFO ] [MAIN ] BAP: Loaded 26187 primary data records. [2025-10-01T22:36:05.883636] [DEBUG] [LOCAL ] BANC: Loaded 51240 existing records from primary storage. [2025-10-01T22:36:05.898746] [INFO ] [MAIN ] BANC: Loaded 51240 primary data records. [2025-10-01T22:36:06.656146] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:06.659169] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 51995 primary records. [2025-10-01T22:36:06.659804] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-01T22:36:06.691865] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:06.697096] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26187 primary records. [2025-10-01T22:36:06.697312] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-01T22:36:06.697433] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-01T22:36:06.699441] [INFO ] [MAIN ] Derivative Progress: 172/1587 symbols completed. BAM took 1.3s. Estimated remaining: 10m 3s. Rate: 140.9 symbols/min [2025-10-01T22:36:06.697486] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-01T22:36:06.701084] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:06.722076] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-01T22:36:06.735571] [DEBUG] [MAIN ] BANC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:06.736291] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51240 primary records. [2025-10-01T22:36:06.736410] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-01T22:36:06.735282] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-01T22:36:06.739943] [INFO ] [MAIN ] Derivative Progress: 173/1587 symbols completed. BAP took 1.3s. Estimated remaining: 9m 59s. Rate: 141.6 symbols/min [2025-10-01T22:36:06.748168] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:06.758134] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-01T22:36:06.758293] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-01T22:36:06.761042] [INFO ] [MAIN ] Derivative Progress: 174/1587 symbols completed. BANC took 1.3s. Estimated remaining: 9m 55s. Rate: 142.4 symbols/min [2025-10-01T22:36:06.761349] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:06.796032] [DEBUG] [LOCAL ] BARK: Loaded 38105 existing records from primary storage. [2025-10-01T22:36:06.796231] [INFO ] [MAIN ] BARK: Loaded 38105 primary data records. [2025-10-01T22:36:07.054154] [DEBUG] [LOCAL ] BAX: Loaded 53493 existing records from primary storage. [2025-10-01T22:36:07.082070] [INFO ] [MAIN ] BAX: Loaded 53493 primary data records. [2025-10-01T22:36:07.211062] [DEBUG] [LOCAL ] BB: Loaded 52930 existing records from primary storage. [2025-10-01T22:36:07.211300] [INFO ] [MAIN ] BB: Loaded 52930 primary data records. [2025-10-01T22:36:07.953496] [DEBUG] [MAIN ] BARK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:07.955752] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38105 primary records. [2025-10-01T22:36:07.955889] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-01T22:36:07.977097] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-01T22:36:07.977522] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-01T22:36:07.980047] [INFO ] [MAIN ] Derivative Progress: 175/1587 symbols completed. BARK took 1.3s. Estimated remaining: 10m 1s. Rate: 140.9 symbols/min [2025-10-01T22:36:07.980367] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:08.014427] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:08.015770] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52930 primary records. [2025-10-01T22:36:08.014936] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:08.016574] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-01T22:36:08.016517] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53493 primary records. [2025-10-01T22:36:08.017261] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-01T22:36:08.050044] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-01T22:36:08.049964] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-01T22:36:08.050299] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-01T22:36:08.050387] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-01T22:36:08.052732] [INFO ] [MAIN ] Derivative Progress: 176/1587 symbols completed. BB took 1.3s. Estimated remaining: 9m 58s. Rate: 141.5 symbols/min [2025-10-01T22:36:08.053123] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:08.069845] [INFO ] [MAIN ] Derivative Progress: 177/1587 symbols completed. BAX took 1.3s. Estimated remaining: 9m 54s. Rate: 142.3 symbols/min [2025-10-01T22:36:08.070495] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:08.094127] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-01T22:36:08.094457] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-01T22:36:08.460244] [DEBUG] [LOCAL ] BBAR: Loaded 41510 existing records from primary storage. [2025-10-01T22:36:08.474557] [INFO ] [MAIN ] BBAR: Loaded 41510 primary data records. [2025-10-01T22:36:08.543993] [DEBUG] [LOCAL ] BBD: Loaded 53197 existing records from primary storage. [2025-10-01T22:36:08.550090] [INFO ] [MAIN ] BBD: Loaded 53197 primary data records. [2025-10-01T22:36:09.199256] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:09.200193] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-01T22:36:09.202500] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-01T22:36:09.221887] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-01T22:36:09.222202] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-01T22:36:09.224910] [INFO ] [MAIN ] Derivative Progress: 178/1587 symbols completed. BBAI took 1.2s. Estimated remaining: 9m 60s. Rate: 140.9 symbols/min [2025-10-01T22:36:09.246199] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:09.247136] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41510 primary records. [2025-10-01T22:36:09.247225] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-01T22:36:09.281459] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-01T22:36:09.281667] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-01T22:36:09.283890] [INFO ] [MAIN ] Derivative Progress: 179/1587 symbols completed. BBAR took 1.2s. Estimated remaining: 9m 57s. Rate: 141.6 symbols/min [2025-10-01T22:36:09.280869] [DEBUG] [MAIN ] BBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:09.284879] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53197 primary records. [2025-10-01T22:36:09.284949] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-01T22:36:09.300855] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-01T22:36:09.300924] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-01T22:36:09.304111] [INFO ] [MAIN ] Derivative Progress: 180/1587 symbols completed. BBD took 1.2s. Estimated remaining: 9m 53s. Rate: 142.4 symbols/min [2025-10-01T22:36:09.304544] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:09.304725] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:09.304494] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:09.317849] [DEBUG] [LOCAL ] BBDO: Loaded 4975 existing records from primary storage. [2025-10-01T22:36:09.322610] [INFO ] [MAIN ] BBDO: Loaded 4975 primary data records. [2025-10-01T22:36:09.389127] [DEBUG] [LOCAL ] BBN: Loaded 18077 existing records from primary storage. [2025-10-01T22:36:09.444800] [INFO ] [MAIN ] BBN: Loaded 18077 primary data records. [2025-10-01T22:36:09.565687] [DEBUG] [LOCAL ] BBDC: Loaded 32973 existing records from primary storage. [2025-10-01T22:36:09.819711] [INFO ] [MAIN ] BBDC: Loaded 32973 primary data records. [2025-10-01T22:36:10.412488] [DEBUG] [MAIN ] BBDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:10.414399] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 4975 primary records. [2025-10-01T22:36:10.414737] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-01T22:36:10.450276] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-01T22:36:10.450775] [DEBUG] [MAIN ] BBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:10.450900] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-01T22:36:10.454150] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18077 primary records. [2025-10-01T22:36:10.453059] [INFO ] [MAIN ] Derivative Progress: 181/1587 symbols completed. BBDO took 1.1s. Estimated remaining: 9m 58s. Rate: 141.0 symbols/min [2025-10-01T22:36:10.454671] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-01T22:36:10.454578] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:10.475898] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-10-01T22:36:10.477110] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-01T22:36:10.480712] [INFO ] [MAIN ] Derivative Progress: 182/1587 symbols completed. BBN took 1.2s. Estimated remaining: 9m 55s. Rate: 141.7 symbols/min [2025-10-01T22:36:10.484281] [DEBUG] [LOCAL ] BBU: Loaded 4720 existing records from primary storage. [2025-10-01T22:36:10.490507] [INFO ] [MAIN ] BBU: Loaded 4720 primary data records. [2025-10-01T22:36:10.490387] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:10.517751] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:10.543405] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 32973 primary records. [2025-10-01T22:36:10.557104] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-01T22:36:10.672266] [DEBUG] [LOCAL ] BBUC: Loaded 13313 existing records from primary storage. [2025-10-01T22:36:10.682985] [INFO ] [MAIN ] BBUC: Loaded 13313 primary data records. [2025-10-01T22:36:10.784036] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-01T22:36:10.784189] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-01T22:36:10.787216] [INFO ] [MAIN ] Derivative Progress: 183/1587 symbols completed. BBDC took 1.5s. Estimated remaining: 9m 53s. Rate: 142.0 symbols/min [2025-10-01T22:36:10.957314] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:11.257711] [DEBUG] [MAIN ] BBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:11.260130] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 4720 primary records. [2025-10-01T22:36:11.274461] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-01T22:36:11.284788] [DEBUG] [LOCAL ] BBVA: Loaded 49276 existing records from primary storage. [2025-10-01T22:36:11.289351] [INFO ] [MAIN ] BBVA: Loaded 49276 primary data records. [2025-10-01T22:36:11.336763] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-01T22:36:11.350902] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-01T22:36:11.370500] [INFO ] [MAIN ] Derivative Progress: 184/1587 symbols completed. BBU took 0.9s. Estimated remaining: 9m 54s. Rate: 141.7 symbols/min [2025-10-01T22:36:11.388697] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:11.514136] [DEBUG] [MAIN ] BBUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:11.556620] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13313 primary records. [2025-10-01T22:36:11.556830] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-01T22:36:11.692957] [DEBUG] [LOCAL ] BBW: Loaded 26701 existing records from primary storage. [2025-10-01T22:36:11.704307] [INFO ] [MAIN ] BBW: Loaded 26701 primary data records. [2025-10-01T22:36:11.833182] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-01T22:36:11.833364] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-01T22:36:11.836105] [INFO ] [MAIN ] Derivative Progress: 185/1587 symbols completed. BBUC took 1.3s. Estimated remaining: 9m 54s. Rate: 141.6 symbols/min [2025-10-01T22:36:11.836413] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:12.110865] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:12.111979] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49276 primary records. [2025-10-01T22:36:12.112409] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-01T22:36:12.145433] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-01T22:36:12.145903] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-01T22:36:12.148224] [INFO ] [MAIN ] Derivative Progress: 186/1587 symbols completed. BBVA took 1.2s. Estimated remaining: 9m 53s. Rate: 141.8 symbols/min [2025-10-01T22:36:12.148866] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:12.169763] [DEBUG] [MAIN ] BBW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:12.170670] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26701 primary records. [2025-10-01T22:36:12.186083] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-01T22:36:12.187588] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-10-01T22:36:12.188142] [INFO ] [MAIN ] BBWI: Loaded 53580 primary data records. [2025-10-01T22:36:12.292007] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-01T22:36:12.329721] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-01T22:36:12.338455] [INFO ] [MAIN ] Derivative Progress: 187/1587 symbols completed. BBW took 0.9s. Estimated remaining: 9m 51s. Rate: 142.2 symbols/min [2025-10-01T22:36:12.359347] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:12.558376] [DEBUG] [LOCAL ] BBY: Loaded 53466 existing records from primary storage. [2025-10-01T22:36:12.558727] [INFO ] [MAIN ] BBY: Loaded 53466 primary data records. [2025-10-01T22:36:12.925308] [DEBUG] [LOCAL ] BCAT: Loaded 34251 existing records from primary storage. [2025-10-01T22:36:12.925566] [INFO ] [MAIN ] BCAT: Loaded 34251 primary data records. [2025-10-01T22:36:13.095610] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:13.149304] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53580 primary records. [2025-10-01T22:36:13.275716] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-01T22:36:13.301231] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-01T22:36:13.301944] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-01T22:36:13.304349] [INFO ] [MAIN ] Derivative Progress: 188/1587 symbols completed. BBWI took 1.5s. Estimated remaining: 9m 54s. Rate: 141.2 symbols/min [2025-10-01T22:36:13.304675] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:13.320413] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:13.321538] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53466 primary records. [2025-10-01T22:36:13.321798] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-01T22:36:13.339880] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-01T22:36:13.340290] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-01T22:36:13.342667] [INFO ] [MAIN ] Derivative Progress: 189/1587 symbols completed. BBY took 1.2s. Estimated remaining: 9m 51s. Rate: 141.9 symbols/min [2025-10-01T22:36:13.342900] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:13.367936] [DEBUG] [MAIN ] BCAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:13.368875] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34251 primary records. [2025-10-01T22:36:13.369085] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-01T22:36:13.394125] [DEBUG] [LOCAL ] BCC: Loaded 28212 existing records from primary storage. [2025-10-01T22:36:13.397067] [INFO ] [MAIN ] BCC: Loaded 28212 primary data records. [2025-10-01T22:36:13.420407] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-01T22:36:13.444782] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-01T22:36:13.472341] [INFO ] [MAIN ] Derivative Progress: 190/1587 symbols completed. BCAT took 1.1s. Estimated remaining: 9m 48s. Rate: 142.4 symbols/min [2025-10-01T22:36:13.503798] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:13.761763] [DEBUG] [LOCAL ] BCE: Loaded 52287 existing records from primary storage. [2025-10-01T22:36:13.762023] [INFO ] [MAIN ] BCE: Loaded 52287 primary data records. [2025-10-01T22:36:13.904915] [DEBUG] [LOCAL ] BCH: Loaded 29569 existing records from primary storage. [2025-10-01T22:36:13.921018] [INFO ] [MAIN ] BCH: Loaded 29569 primary data records. [2025-10-01T22:36:14.544172] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:14.545399] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28212 primary records. [2025-10-01T22:36:14.545502] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-01T22:36:14.571544] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-10-01T22:36:14.573088] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-01T22:36:14.575814] [INFO ] [MAIN ] Derivative Progress: 191/1587 symbols completed. BCC took 1.3s. Estimated remaining: 9m 53s. Rate: 141.2 symbols/min [2025-10-01T22:36:14.590217] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:14.590407] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:14.591385] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52287 primary records. [2025-10-01T22:36:14.591984] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-01T22:36:14.612562] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-01T22:36:14.613778] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-01T22:36:14.618203] [INFO ] [MAIN ] Derivative Progress: 192/1587 symbols completed. BCE took 1.3s. Estimated remaining: 9m 50s. Rate: 141.9 symbols/min [2025-10-01T22:36:14.618759] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:14.641124] [DEBUG] [MAIN ] BCH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:14.642024] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29569 primary records. [2025-10-01T22:36:14.642190] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-01T22:36:14.664421] [DEBUG] [LOCAL ] BCO: Loaded 26080 existing records from primary storage. [2025-10-01T22:36:14.665547] [INFO ] [MAIN ] BCO: Loaded 26080 primary data records. [2025-10-01T22:36:14.809491] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-01T22:36:14.826719] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-01T22:36:14.821413] [DEBUG] [LOCAL ] BCSF: Loaded 27746 existing records from primary storage. [2025-10-01T22:36:14.834215] [INFO ] [MAIN ] Derivative Progress: 193/1587 symbols completed. BCH took 1.3s. Estimated remaining: 9m 48s. Rate: 142.3 symbols/min [2025-10-01T22:36:14.834519] [INFO ] [MAIN ] BCSF: Loaded 27746 primary data records. [2025-10-01T22:36:15.396378] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:15.397326] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 26080 primary records. [2025-10-01T22:36:15.397725] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-01T22:36:15.430219] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-01T22:36:15.430823] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-01T22:36:15.430740] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:15.433209] [INFO ] [MAIN ] Derivative Progress: 194/1587 symbols completed. BCO took 0.8s. Estimated remaining: 9m 49s. Rate: 142.0 symbols/min [2025-10-01T22:36:15.434045] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27746 primary records. [2025-10-01T22:36:15.434127] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-01T22:36:15.451069] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-01T22:36:15.451179] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-01T22:36:15.454114] [INFO ] [MAIN ] Derivative Progress: 195/1587 symbols completed. BCSF took 0.8s. Estimated remaining: 9m 45s. Rate: 142.7 symbols/min [2025-10-01T22:36:15.454984] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:15.455066] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:15.454867] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:15.492029] [DEBUG] [LOCAL ] BCX: Loaded 21685 existing records from primary storage. [2025-10-01T22:36:15.499825] [INFO ] [MAIN ] BCX: Loaded 21685 primary data records. [2025-10-01T22:36:15.501586] [DEBUG] [LOCAL ] BDC: Loaded 24616 existing records from primary storage. [2025-10-01T22:36:15.510036] [INFO ] [MAIN ] BDC: Loaded 24616 primary data records. [2025-10-01T22:36:15.535236] [DEBUG] [LOCAL ] BDJ: Loaded 28985 existing records from primary storage. [2025-10-01T22:36:15.634984] [INFO ] [MAIN ] BDJ: Loaded 28985 primary data records. [2025-10-01T22:36:16.632182] [DEBUG] [MAIN ] BDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:16.633349] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24616 primary records. [2025-10-01T22:36:16.633623] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:16.641600] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-01T22:36:16.648285] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21685 primary records. [2025-10-01T22:36:16.648579] [DEBUG] [MAIN ] BDJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:16.648731] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-01T22:36:16.649374] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 28985 primary records. [2025-10-01T22:36:16.657723] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-01T22:36:16.698913] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-01T22:36:16.699928] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-01T22:36:16.699808] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-01T22:36:16.700885] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-01T22:36:16.704221] [INFO ] [MAIN ] Derivative Progress: 196/1587 symbols completed. BDJ took 1.2s. Estimated remaining: 9m 51s. Rate: 141.2 symbols/min [2025-10-01T22:36:16.701248] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-01T22:36:16.704505] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:16.706961] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-01T22:36:16.706867] [INFO ] [MAIN ] Derivative Progress: 197/1587 symbols completed. BDC took 1.3s. Estimated remaining: 9m 47s. Rate: 142.0 symbols/min [2025-10-01T22:36:16.711216] [INFO ] [MAIN ] Derivative Progress: 198/1587 symbols completed. BCX took 1.3s. Estimated remaining: 9m 44s. Rate: 142.7 symbols/min [2025-10-01T22:36:16.711325] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:16.710908] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:16.769983] [DEBUG] [LOCAL ] BDN: Loaded 47488 existing records from primary storage. [2025-10-01T22:36:16.770356] [INFO ] [MAIN ] BDN: Loaded 47488 primary data records. [2025-10-01T22:36:16.933891] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-10-01T22:36:16.944951] [INFO ] [MAIN ] BE: Loaded 53653 primary data records. [2025-10-01T22:36:16.951541] [DEBUG] [LOCAL ] BDX: Loaded 52388 existing records from primary storage. [2025-10-01T22:36:16.962134] [INFO ] [MAIN ] BDX: Loaded 52388 primary data records. [2025-10-01T22:36:17.867222] [DEBUG] [MAIN ] BDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:17.868424] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47488 primary records. [2025-10-01T22:36:17.868701] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-01T22:36:17.907497] [DEBUG] [MAIN ] BE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:17.916075] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53653 primary records. [2025-10-01T22:36:17.925490] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-01T22:36:17.928525] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-01T22:36:17.928634] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-01T22:36:17.930838] [INFO ] [MAIN ] Derivative Progress: 199/1587 symbols completed. BDN took 1.2s. Estimated remaining: 9m 49s. Rate: 141.3 symbols/min [2025-10-01T22:36:17.926597] [DEBUG] [MAIN ] BDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:17.939256] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:17.946278] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52388 primary records. [2025-10-01T22:36:17.949945] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-01T22:36:17.949849] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-10-01T22:36:17.951316] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-01T22:36:17.961535] [INFO ] [MAIN ] Derivative Progress: 200/1587 symbols completed. BE took 1.3s. Estimated remaining: 9m 46s. Rate: 142.0 symbols/min [2025-10-01T22:36:17.961811] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:17.971674] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-01T22:36:17.972017] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-01T22:36:17.974793] [INFO ] [MAIN ] Derivative Progress: 201/1587 symbols completed. BDX took 1.3s. Estimated remaining: 9m 43s. Rate: 142.7 symbols/min [2025-10-01T22:36:17.975109] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:18.066324] [DEBUG] [LOCAL ] BEKE: Loaded 53239 existing records from primary storage. [2025-10-01T22:36:18.069347] [DEBUG] [LOCAL ] BEN: Loaded 53049 existing records from primary storage. [2025-10-01T22:36:18.068497] [INFO ] [MAIN ] BEKE: Loaded 53239 primary data records. [2025-10-01T22:36:18.081570] [INFO ] [MAIN ] BEN: Loaded 53049 primary data records. [2025-10-01T22:36:18.200456] [DEBUG] [LOCAL ] BEPC: Loaded 46451 existing records from primary storage. [2025-10-01T22:36:18.278879] [INFO ] [MAIN ] BEPC: Loaded 46451 primary data records. [2025-10-01T22:36:19.193399] [DEBUG] [MAIN ] BEKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:19.207603] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53239 primary records. [2025-10-01T22:36:19.206865] [DEBUG] [MAIN ] BEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:19.208487] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53049 primary records. [2025-10-01T22:36:19.208693] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-01T22:36:19.207759] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-01T22:36:19.237674] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-01T22:36:19.257936] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-01T22:36:19.261931] [INFO ] [MAIN ] Derivative Progress: 202/1587 symbols completed. BEN took 1.3s. Estimated remaining: 9m 48s. Rate: 141.2 symbols/min [2025-10-01T22:36:19.259843] [DEBUG] [MAIN ] BEPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:19.264337] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-01T22:36:19.263632] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46451 primary records. [2025-10-01T22:36:19.262869] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:19.264509] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-01T22:36:19.265976] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-01T22:36:19.268754] [INFO ] [MAIN ] Derivative Progress: 203/1587 symbols completed. BEKE took 1.3s. Estimated remaining: 9m 45s. Rate: 141.9 symbols/min [2025-10-01T22:36:19.281632] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:19.289207] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-10-01T22:36:19.289359] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-01T22:36:19.292176] [INFO ] [MAIN ] Derivative Progress: 204/1587 symbols completed. BEPC took 1.3s. Estimated remaining: 9m 42s. Rate: 142.6 symbols/min [2025-10-01T22:36:19.293469] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:19.297008] [DEBUG] [LOCAL ] BEPH: Loaded 5335 existing records from primary storage. [2025-10-01T22:36:19.297151] [INFO ] [MAIN ] BEPH: Loaded 5335 primary data records. [2025-10-01T22:36:19.354885] [DEBUG] [LOCAL ] BEPI: Loaded 3536 existing records from primary storage. [2025-10-01T22:36:19.393851] [INFO ] [MAIN ] BEPI: Loaded 3536 primary data records. [2025-10-01T22:36:19.380399] [DEBUG] [LOCAL ] BEPJ: Loaded 3149 existing records from primary storage. [2025-10-01T22:36:19.443792] [INFO ] [MAIN ] BEPJ: Loaded 3149 primary data records. [2025-10-01T22:36:20.346036] [DEBUG] [MAIN ] BEPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:20.346862] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5335 primary records. [2025-10-01T22:36:20.347061] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-01T22:36:20.393127] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-10-01T22:36:20.393886] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:36:20.394252] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:20.394083] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-01T22:36:20.395046] [INFO ] [MAIN ] BEPJ: Generated 1793 derivative records from 3149 primary records. [2025-10-01T22:36:20.397631] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3536 primary records. [2025-10-01T22:36:20.397800] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-01T22:36:20.396862] [INFO ] [MAIN ] Derivative Progress: 205/1587 symbols completed. BEPH took 1.1s. Estimated remaining: 9m 46s. Rate: 141.5 symbols/min [2025-10-01T22:36:20.397902] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-01T22:36:20.398027] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:20.436978] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1793 records). [2025-10-01T22:36:20.437464] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-01T22:36:20.440681] [INFO ] [MAIN ] Derivative Progress: 206/1587 symbols completed. BEPJ took 1.1s. Estimated remaining: 9m 43s. Rate: 142.1 symbols/min [2025-10-01T22:36:20.441448] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-01T22:36:20.441808] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-01T22:36:20.441724] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:20.445303] [INFO ] [MAIN ] Derivative Progress: 207/1587 symbols completed. BEPI took 1.2s. Estimated remaining: 9m 40s. Rate: 142.8 symbols/min [2025-10-01T22:36:20.445694] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:20.469980] [DEBUG] [LOCAL ] BFK: Loaded 13896 existing records from primary storage. [2025-10-01T22:36:20.470139] [INFO ] [MAIN ] BFK: Loaded 13896 primary data records. [2025-10-01T22:36:20.605848] [DEBUG] [LOCAL ] BFAM: Loaded 33171 existing records from primary storage. [2025-10-01T22:36:20.617260] [INFO ] [MAIN ] BFAM: Loaded 33171 primary data records. [2025-10-01T22:36:20.935336] [DEBUG] [LOCAL ] BFH: Loaded 41602 existing records from primary storage. [2025-10-01T22:36:20.985906] [INFO ] [MAIN ] BFH: Loaded 41602 primary data records. [2025-10-01T22:36:21.604846] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:21.606201] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13896 primary records. [2025-10-01T22:36:21.606703] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-01T22:36:21.642974] [DEBUG] [MAIN ] BFAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:21.645911] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-01T22:36:21.646727] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33171 primary records. [2025-10-01T22:36:21.647861] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-01T22:36:21.647806] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-01T22:36:21.650147] [INFO ] [MAIN ] Derivative Progress: 208/1587 symbols completed. BFK took 1.2s. Estimated remaining: 9m 45s. Rate: 141.5 symbols/min [2025-10-01T22:36:21.664896] [DEBUG] [MAIN ] BFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:21.665710] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41602 primary records. [2025-10-01T22:36:21.665786] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-01T22:36:21.694625] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-01T22:36:21.695000] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-01T22:36:21.697982] [INFO ] [MAIN ] Derivative Progress: 209/1587 symbols completed. BFAM took 1.3s. Estimated remaining: 9m 42s. Rate: 142.1 symbols/min [2025-10-01T22:36:21.699892] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-10-01T22:36:21.699958] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-01T22:36:21.702501] [INFO ] [MAIN ] Derivative Progress: 210/1587 symbols completed. BFH took 1.3s. Estimated remaining: 9m 39s. Rate: 142.8 symbols/min [2025-10-01T22:36:21.702908] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:21.702969] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:21.703115] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:21.724278] [DEBUG] [LOCAL ] BFS: Loaded 9143 existing records from primary storage. [2025-10-01T22:36:21.724409] [INFO ] [MAIN ] BFS: Loaded 9143 primary data records. [2025-10-01T22:36:21.770289] [DEBUG] [LOCAL ] BFZ: Loaded 12123 existing records from primary storage. [2025-10-01T22:36:21.815687] [INFO ] [MAIN ] BFZ: Loaded 12123 primary data records. [2025-10-01T22:36:22.036181] [DEBUG] [LOCAL ] BFLY: Loaded 51781 existing records from primary storage. [2025-10-01T22:36:22.092689] [INFO ] [MAIN ] BFLY: Loaded 51781 primary data records. [2025-10-01T22:36:22.839256] [DEBUG] [MAIN ] BFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:22.845213] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:22.846168] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9143 primary records. [2025-10-01T22:36:22.847065] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 12123 primary records. [2025-10-01T22:36:22.847182] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-01T22:36:22.846354] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-01T22:36:22.884111] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-01T22:36:22.884278] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-01T22:36:22.883639] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-01T22:36:22.886819] [INFO ] [MAIN ] Derivative Progress: 211/1587 symbols completed. BFZ took 1.2s. Estimated remaining: 9m 43s. Rate: 141.5 symbols/min [2025-10-01T22:36:22.887886] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-01T22:36:22.888044] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:22.890263] [INFO ] [MAIN ] Derivative Progress: 212/1587 symbols completed. BFS took 1.2s. Estimated remaining: 9m 40s. Rate: 142.2 symbols/min [2025-10-01T22:36:22.891117] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:22.904915] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:22.905622] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51781 primary records. [2025-10-01T22:36:22.905753] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-01T22:36:22.927311] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-01T22:36:22.927560] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-01T22:36:22.932023] [INFO ] [MAIN ] Derivative Progress: 213/1587 symbols completed. BFLY took 1.2s. Estimated remaining: 9m 37s. Rate: 142.8 symbols/min [2025-10-01T22:36:22.932270] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:22.942068] [DEBUG] [LOCAL ] BGB: Loaded 17523 existing records from primary storage. [2025-10-01T22:36:22.942269] [INFO ] [MAIN ] BGB: Loaded 17523 primary data records. [2025-10-01T22:36:23.086328] [DEBUG] [LOCAL ] BGH: Loaded 16856 existing records from primary storage. [2025-10-01T22:36:23.086522] [INFO ] [MAIN ] BGH: Loaded 16856 primary data records. [2025-10-01T22:36:23.291130] [DEBUG] [LOCAL ] BG: Loaded 50413 existing records from primary storage. [2025-10-01T22:36:23.427618] [INFO ] [MAIN ] BG: Loaded 50413 primary data records. [2025-10-01T22:36:24.055836] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:24.057509] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17523 primary records. [2025-10-01T22:36:24.057753] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-01T22:36:24.094419] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-01T22:36:24.093382] [DEBUG] [MAIN ] BGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:24.095324] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 16856 primary records. [2025-10-01T22:36:24.094532] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-01T22:36:24.097521] [INFO ] [MAIN ] Derivative Progress: 214/1587 symbols completed. BGB took 1.2s. Estimated remaining: 9m 42s. Rate: 141.6 symbols/min [2025-10-01T22:36:24.097693] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-01T22:36:24.098178] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:24.117393] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-01T22:36:24.123808] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-01T22:36:24.126462] [INFO ] [MAIN ] Derivative Progress: 215/1587 symbols completed. BGH took 1.2s. Estimated remaining: 9m 39s. Rate: 142.3 symbols/min [2025-10-01T22:36:24.126926] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:24.146085] [DEBUG] [MAIN ] BG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:24.146751] [DEBUG] [LOCAL ] BGR: Loaded 13508 existing records from primary storage. [2025-10-01T22:36:24.147660] [INFO ] [MAIN ] BGR: Loaded 13508 primary data records. [2025-10-01T22:36:24.147526] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50413 primary records. [2025-10-01T22:36:24.147752] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-01T22:36:24.296369] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-01T22:36:24.307089] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-01T22:36:24.321348] [INFO ] [MAIN ] Derivative Progress: 216/1587 symbols completed. BG took 1.4s. Estimated remaining: 9m 37s. Rate: 142.6 symbols/min [2025-10-01T22:36:24.337957] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:24.562810] [DEBUG] [LOCAL ] BGSF: Loaded 7403 existing records from primary storage. [2025-10-01T22:36:24.563002] [INFO ] [MAIN ] BGSF: Loaded 7403 primary data records. [2025-10-01T22:36:24.570418] [DEBUG] [LOCAL ] BGS: Loaded 50455 existing records from primary storage. [2025-10-01T22:36:24.583015] [INFO ] [MAIN ] BGS: Loaded 50455 primary data records. [2025-10-01T22:36:25.332319] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:25.333831] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13508 primary records. [2025-10-01T22:36:25.334265] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-01T22:36:25.357410] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-01T22:36:25.358125] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-01T22:36:25.360305] [INFO ] [MAIN ] Derivative Progress: 217/1587 symbols completed. BGR took 1.3s. Estimated remaining: 9m 40s. Rate: 141.6 symbols/min [2025-10-01T22:36:25.360707] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:25.381449] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:25.386766] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 7403 primary records. [2025-10-01T22:36:25.386945] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-01T22:36:25.424623] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-10-01T22:36:25.425401] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-01T22:36:25.425829] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:25.429899] [INFO ] [MAIN ] Derivative Progress: 218/1587 symbols completed. BGSF took 1.1s. Estimated remaining: 9m 38s. Rate: 142.2 symbols/min [2025-10-01T22:36:25.426768] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50455 primary records. [2025-10-01T22:36:25.430187] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:25.430438] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-01T22:36:25.427360] [DEBUG] [LOCAL ] BGT: Loaded 16603 existing records from primary storage. [2025-10-01T22:36:25.431807] [INFO ] [MAIN ] BGT: Loaded 16603 primary data records. [2025-10-01T22:36:25.571805] [DEBUG] [LOCAL ] BGX: Loaded 10935 existing records from primary storage. [2025-10-01T22:36:25.577966] [INFO ] [MAIN ] BGX: Loaded 10935 primary data records. [2025-10-01T22:36:25.594870] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-01T22:36:25.595105] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-01T22:36:25.658097] [INFO ] [MAIN ] Derivative Progress: 219/1587 symbols completed. BGS took 1.5s. Estimated remaining: 9m 36s. Rate: 142.5 symbols/min [2025-10-01T22:36:25.722354] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:26.171742] [DEBUG] [LOCAL ] BGY: Loaded 22399 existing records from primary storage. [2025-10-01T22:36:26.172180] [INFO ] [MAIN ] BGY: Loaded 22399 primary data records. [2025-10-01T22:36:26.529270] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:26.530479] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16603 primary records. [2025-10-01T22:36:26.534425] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-01T22:36:26.563017] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:26.564949] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10935 primary records. [2025-10-01T22:36:26.566354] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-01T22:36:26.577277] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-01T22:36:26.582010] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-01T22:36:26.586263] [INFO ] [MAIN ] Derivative Progress: 220/1587 symbols completed. BGT took 1.2s. Estimated remaining: 9m 39s. Rate: 141.7 symbols/min [2025-10-01T22:36:26.587603] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:26.590180] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-01T22:36:26.590548] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-01T22:36:26.594050] [INFO ] [MAIN ] Derivative Progress: 221/1587 symbols completed. BGX took 1.2s. Estimated remaining: 9m 36s. Rate: 142.3 symbols/min [2025-10-01T22:36:26.595860] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:26.618739] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:26.619478] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22399 primary records. [2025-10-01T22:36:26.619608] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-01T22:36:26.635582] [DEBUG] [LOCAL ] BH: Loaded 15869 existing records from primary storage. [2025-10-01T22:36:26.639981] [INFO ] [MAIN ] BH: Loaded 15869 primary data records. [2025-10-01T22:36:26.655423] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-01T22:36:26.677632] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-01T22:36:26.717827] [INFO ] [MAIN ] Derivative Progress: 222/1587 symbols completed. BGY took 1.0s. Estimated remaining: 9m 34s. Rate: 142.8 symbols/min [2025-10-01T22:36:26.741297] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:27.001886] [DEBUG] [LOCAL ] BHC: Loaded 46844 existing records from primary storage. [2025-10-01T22:36:27.002097] [INFO ] [MAIN ] BHC: Loaded 46844 primary data records. [2025-10-01T22:36:27.100150] [DEBUG] [LOCAL ] BHE: Loaded 24657 existing records from primary storage. [2025-10-01T22:36:27.130878] [INFO ] [MAIN ] BHE: Loaded 24657 primary data records. [2025-10-01T22:36:27.763333] [DEBUG] [MAIN ] BH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:27.766388] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 15869 primary records. [2025-10-01T22:36:27.766536] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-01T22:36:27.787206] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-10-01T22:36:27.787349] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-01T22:36:27.789747] [INFO ] [MAIN ] Derivative Progress: 223/1587 symbols completed. BH took 1.2s. Estimated remaining: 9m 37s. Rate: 141.8 symbols/min [2025-10-01T22:36:27.807554] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:27.808451] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46844 primary records. [2025-10-01T22:36:27.808669] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-01T22:36:27.827920] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-01T22:36:27.828089] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-01T22:36:27.830534] [INFO ] [MAIN ] Derivative Progress: 224/1587 symbols completed. BHC took 1.2s. Estimated remaining: 9m 34s. Rate: 142.4 symbols/min [2025-10-01T22:36:27.843806] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:27.844561] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 24657 primary records. [2025-10-01T22:36:27.844627] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-01T22:36:27.861310] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-01T22:36:27.861382] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-01T22:36:27.864097] [INFO ] [MAIN ] Derivative Progress: 225/1587 symbols completed. BHE took 1.1s. Estimated remaining: 9m 32s. Rate: 143.0 symbols/min [2025-10-01T22:36:27.864599] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:27.864826] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:27.864530] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:27.888270] [DEBUG] [LOCAL ] BHR: Loaded 21361 existing records from primary storage. [2025-10-01T22:36:27.888424] [INFO ] [MAIN ] BHR: Loaded 21361 primary data records. [2025-10-01T22:36:28.117074] [DEBUG] [LOCAL ] BHVN: Loaded 49802 existing records from primary storage. [2025-10-01T22:36:28.206838] [INFO ] [MAIN ] BHVN: Loaded 49802 primary data records. [2025-10-01T22:36:28.269175] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-01T22:36:28.279317] [INFO ] [MAIN ] BHP: Loaded 53373 primary data records. [2025-10-01T22:36:28.992722] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:28.994458] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21361 primary records. [2025-10-01T22:36:28.994712] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-01T22:36:29.013394] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-01T22:36:29.013860] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-01T22:36:29.016292] [INFO ] [MAIN ] Derivative Progress: 226/1587 symbols completed. BHR took 1.2s. Estimated remaining: 9m 36s. Rate: 141.9 symbols/min [2025-10-01T22:36:29.016857] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:29.034783] [DEBUG] [MAIN ] BHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:29.036031] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53373 primary records. [2025-10-01T22:36:29.036138] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-01T22:36:29.055780] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-01T22:36:29.063815] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-01T22:36:29.066223] [INFO ] [MAIN ] Derivative Progress: 227/1587 symbols completed. BHP took 1.2s. Estimated remaining: 9m 33s. Rate: 142.4 symbols/min [2025-10-01T22:36:29.071801] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:29.072171] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:29.073573] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49802 primary records. [2025-10-01T22:36:29.073881] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-01T22:36:29.105526] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-01T22:36:29.105819] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-01T22:36:29.109200] [INFO ] [MAIN ] Derivative Progress: 228/1587 symbols completed. BHVN took 1.2s. Estimated remaining: 9m 30s. Rate: 143.0 symbols/min [2025-10-01T22:36:29.115175] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:29.143547] [DEBUG] [LOCAL ] BIO: Loaded 24947 existing records from primary storage. [2025-10-01T22:36:29.143907] [INFO ] [MAIN ] BIO: Loaded 24947 primary data records. [2025-10-01T22:36:29.158571] [DEBUG] [LOCAL ] BILL: Loaded 52336 existing records from primary storage. [2025-10-01T22:36:29.181711] [INFO ] [MAIN ] BILL: Loaded 52336 primary data records. [2025-10-01T22:36:29.442394] [DEBUG] [LOCAL ] BIP: Loaded 39543 existing records from primary storage. [2025-10-01T22:36:29.488739] [INFO ] [MAIN ] BIP: Loaded 39543 primary data records. [2025-10-01T22:36:30.261410] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:30.263333] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 24947 primary records. [2025-10-01T22:36:30.267156] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-01T22:36:30.292397] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:30.296976] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52336 primary records. [2025-10-01T22:36:30.297753] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-01T22:36:30.320782] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-01T22:36:30.321218] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-01T22:36:30.324103] [INFO ] [MAIN ] Derivative Progress: 229/1587 symbols completed. BILL took 1.3s. Estimated remaining: 9m 35s. Rate: 141.8 symbols/min [2025-10-01T22:36:30.325704] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:30.325390] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-01T22:36:30.334479] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-01T22:36:30.342102] [INFO ] [MAIN ] Derivative Progress: 230/1587 symbols completed. BIO took 1.3s. Estimated remaining: 9m 32s. Rate: 142.4 symbols/min [2025-10-01T22:36:30.339924] [DEBUG] [MAIN ] BIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:30.343005] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39543 primary records. [2025-10-01T22:36:30.343378] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-01T22:36:30.343108] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:30.365691] [DEBUG] [LOCAL ] BIPH: Loaded 2578 existing records from primary storage. [2025-10-01T22:36:30.363155] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-01T22:36:30.366209] [INFO ] [MAIN ] BIPH: Loaded 2578 primary data records. [2025-10-01T22:36:30.369088] [DEBUG] [LOCAL ] BIPI: Loaded 3202 existing records from primary storage. [2025-10-01T22:36:30.366342] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-01T22:36:30.377193] [INFO ] [MAIN ] Derivative Progress: 231/1587 symbols completed. BIP took 1.3s. Estimated remaining: 9m 29s. Rate: 143.0 symbols/min [2025-10-01T22:36:30.377420] [INFO ] [MAIN ] BIPI: Loaded 3202 primary data records. [2025-10-01T22:36:30.377526] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:30.601791] [DEBUG] [LOCAL ] BIPJ: Loaded 3132 existing records from primary storage. [2025-10-01T22:36:30.697464] [INFO ] [MAIN ] BIPJ: Loaded 3132 primary data records. [2025-10-01T22:36:31.733597] [DEBUG] [MAIN ] BIPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:31.735253] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2578 primary records. [2025-10-01T22:36:31.734408] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:31.736153] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3202 primary records. [2025-10-01T22:36:31.736247] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-01T22:36:31.736493] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-01T22:36:31.753088] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-01T22:36:31.753213] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-01T22:36:31.755469] [INFO ] [MAIN ] Derivative Progress: 232/1587 symbols completed. BIPH took 1.4s. Estimated remaining: 9m 34s. Rate: 141.6 symbols/min [2025-10-01T22:36:31.762284] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:31.773140] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-01T22:36:31.773374] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-01T22:36:31.776797] [INFO ] [MAIN ] Derivative Progress: 233/1587 symbols completed. BIPI took 1.4s. Estimated remaining: 9m 31s. Rate: 142.2 symbols/min [2025-10-01T22:36:31.777076] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:31.792598] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:36:31.793636] [INFO ] [MAIN ] BIPJ: Generated 1793 derivative records from 3132 primary records. [2025-10-01T22:36:31.793810] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-01T22:36:31.818927] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1793 records). [2025-10-01T22:36:31.819091] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-01T22:36:31.822768] [INFO ] [MAIN ] Derivative Progress: 234/1587 symbols completed. BIPJ took 1.4s. Estimated remaining: 9m 29s. Rate: 142.7 symbols/min [2025-10-01T22:36:31.823143] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:31.848733] [DEBUG] [LOCAL ] BIT: Loaded 22791 existing records from primary storage. [2025-10-01T22:36:31.848907] [INFO ] [MAIN ] BIT: Loaded 22791 primary data records. [2025-10-01T22:36:31.971854] [DEBUG] [LOCAL ] BIRK: Loaded 50925 existing records from primary storage. [2025-10-01T22:36:31.984962] [INFO ] [MAIN ] BIRK: Loaded 50925 primary data records. [2025-10-01T22:36:32.432310] [DEBUG] [LOCAL ] BJ: Loaded 51373 existing records from primary storage. [2025-10-01T22:36:32.463485] [INFO ] [MAIN ] BJ: Loaded 51373 primary data records. [2025-10-01T22:36:32.944197] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:32.945571] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 22791 primary records. [2025-10-01T22:36:32.945833] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-01T22:36:32.974453] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-01T22:36:32.980114] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-01T22:36:32.980053] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:32.981264] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50925 primary records. [2025-10-01T22:36:32.983986] [INFO ] [MAIN ] Derivative Progress: 235/1587 symbols completed. BIT took 1.2s. Estimated remaining: 9m 33s. Rate: 141.7 symbols/min [2025-10-01T22:36:32.984326] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-01T22:36:32.984472] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:33.004703] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-01T22:36:33.005596] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-01T22:36:33.008360] [INFO ] [MAIN ] Derivative Progress: 236/1587 symbols completed. BIRK took 1.2s. Estimated remaining: 9m 30s. Rate: 142.2 symbols/min [2025-10-01T22:36:33.010343] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:33.025262] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:33.026107] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51373 primary records. [2025-10-01T22:36:33.026262] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-01T22:36:33.059201] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-01T22:36:33.059489] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-01T22:36:33.062877] [INFO ] [MAIN ] Derivative Progress: 237/1587 symbols completed. BJ took 1.2s. Estimated remaining: 9m 27s. Rate: 142.7 symbols/min [2025-10-01T22:36:33.063220] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:33.083961] [DEBUG] [LOCAL ] BK: Loaded 53537 existing records from primary storage. [2025-10-01T22:36:33.084179] [INFO ] [MAIN ] BK: Loaded 53537 primary data records. [2025-10-01T22:36:33.259527] [DEBUG] [LOCAL ] BKD: Loaded 50196 existing records from primary storage. [2025-10-01T22:36:33.289099] [INFO ] [MAIN ] BKD: Loaded 50196 primary data records. [2025-10-01T22:36:33.350132] [DEBUG] [LOCAL ] BKE: Loaded 34453 existing records from primary storage. [2025-10-01T22:36:33.356681] [INFO ] [MAIN ] BKE: Loaded 34453 primary data records. [2025-10-01T22:36:34.296789] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:34.298745] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53537 primary records. [2025-10-01T22:36:34.299344] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-01T22:36:34.340816] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-01T22:36:34.341469] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:34.341555] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-01T22:36:34.344998] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50196 primary records. [2025-10-01T22:36:34.344021] [INFO ] [MAIN ] Derivative Progress: 238/1587 symbols completed. BK took 1.4s. Estimated remaining: 9m 32s. Rate: 141.5 symbols/min [2025-10-01T22:36:34.346249] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-01T22:36:34.378050] [DEBUG] [MAIN ] BKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:34.378451] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-01T22:36:34.379396] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 34453 primary records. [2025-10-01T22:36:34.379497] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-01T22:36:34.379595] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-01T22:36:34.382709] [INFO ] [MAIN ] Derivative Progress: 239/1587 symbols completed. BKD took 1.4s. Estimated remaining: 9m 29s. Rate: 142.1 symbols/min [2025-10-01T22:36:34.398994] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-01T22:36:34.399107] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-01T22:36:34.401355] [INFO ] [MAIN ] Derivative Progress: 240/1587 symbols completed. BKE took 1.3s. Estimated remaining: 9m 27s. Rate: 142.6 symbols/min [2025-10-01T22:36:34.402144] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:34.402000] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:34.402076] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:34.412234] [DEBUG] [LOCAL ] BKN: Loaded 7730 existing records from primary storage. [2025-10-01T22:36:34.412519] [INFO ] [MAIN ] BKN: Loaded 7730 primary data records. [2025-10-01T22:36:34.772549] [DEBUG] [LOCAL ] BKKT: Loaded 35253 existing records from primary storage. [2025-10-01T22:36:34.783871] [INFO ] [MAIN ] BKKT: Loaded 35253 primary data records. [2025-10-01T22:36:34.783680] [DEBUG] [LOCAL ] BKH: Loaded 36630 existing records from primary storage. [2025-10-01T22:36:34.789698] [INFO ] [MAIN ] BKH: Loaded 36630 primary data records. [2025-10-01T22:36:35.496519] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:35.498278] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7730 primary records. [2025-10-01T22:36:35.498773] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-01T22:36:35.518168] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-01T22:36:35.519319] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-01T22:36:35.521747] [INFO ] [MAIN ] Derivative Progress: 241/1587 symbols completed. BKN took 1.1s. Estimated remaining: 9m 30s. Rate: 141.7 symbols/min [2025-10-01T22:36:35.521984] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:35.541622] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:35.542529] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 35253 primary records. [2025-10-01T22:36:35.542665] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-01T22:36:35.571133] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-01T22:36:35.577509] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-01T22:36:35.577416] [DEBUG] [MAIN ] BKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:35.579803] [INFO ] [MAIN ] Derivative Progress: 242/1587 symbols completed. BKKT took 1.2s. Estimated remaining: 9m 28s. Rate: 142.2 symbols/min [2025-10-01T22:36:35.580874] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:35.580609] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36630 primary records. [2025-10-01T22:36:35.581515] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-01T22:36:35.598855] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-01T22:36:35.599011] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-01T22:36:35.601456] [INFO ] [MAIN ] Derivative Progress: 243/1587 symbols completed. BKH took 1.2s. Estimated remaining: 9m 25s. Rate: 142.7 symbols/min [2025-10-01T22:36:35.601795] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:35.622239] [DEBUG] [LOCAL ] BKT: Loaded 11379 existing records from primary storage. [2025-10-01T22:36:35.622527] [INFO ] [MAIN ] BKT: Loaded 11379 primary data records. [2025-10-01T22:36:35.760383] [DEBUG] [LOCAL ] BKSY: Loaded 48210 existing records from primary storage. [2025-10-01T22:36:35.785838] [INFO ] [MAIN ] BKSY: Loaded 48210 primary data records. [2025-10-01T22:36:36.031972] [DEBUG] [LOCAL ] BKU: Loaded 41412 existing records from primary storage. [2025-10-01T22:36:36.053548] [INFO ] [MAIN ] BKU: Loaded 41412 primary data records. [2025-10-01T22:36:36.765909] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:36.767037] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 11379 primary records. [2025-10-01T22:36:36.768515] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-01T22:36:36.787431] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-01T22:36:36.787747] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-01T22:36:36.790309] [INFO ] [MAIN ] Derivative Progress: 244/1587 symbols completed. BKT took 1.2s. Estimated remaining: 9m 29s. Rate: 141.7 symbols/min [2025-10-01T22:36:36.791209] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:36.809534] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:36.810325] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41412 primary records. [2025-10-01T22:36:36.810500] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-01T22:36:36.831422] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-01T22:36:36.831687] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-01T22:36:36.834380] [INFO ] [MAIN ] Derivative Progress: 245/1587 symbols completed. BKU took 1.2s. Estimated remaining: 9m 26s. Rate: 142.2 symbols/min [2025-10-01T22:36:36.834858] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:36.858241] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:36.859208] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48210 primary records. [2025-10-01T22:36:36.859483] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-01T22:36:36.876884] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-01T22:36:36.877086] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-01T22:36:36.887898] [INFO ] [MAIN ] Derivative Progress: 246/1587 symbols completed. BKSY took 1.4s. Estimated remaining: 9m 24s. Rate: 142.7 symbols/min [2025-10-01T22:36:36.889515] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:36.890308] [DEBUG] [LOCAL ] BKV: Loaded 29752 existing records from primary storage. [2025-10-01T22:36:36.890610] [INFO ] [MAIN ] BKV: Loaded 29752 primary data records. [2025-10-01T22:36:37.133753] [DEBUG] [LOCAL ] BLD: Loaded 27631 existing records from primary storage. [2025-10-01T22:36:37.222574] [DEBUG] [LOCAL ] BLCO: Loaded 35433 existing records from primary storage. [2025-10-01T22:36:37.258426] [INFO ] [MAIN ] BLD: Loaded 27631 primary data records. [2025-10-01T22:36:37.258733] [INFO ] [MAIN ] BLCO: Loaded 35433 primary data records. [2025-10-01T22:36:37.961203] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:37.963231] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29752 primary records. [2025-10-01T22:36:37.963908] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-01T22:36:37.985272] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-01T22:36:37.985834] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-01T22:36:37.988735] [INFO ] [MAIN ] Derivative Progress: 247/1587 symbols completed. BKV took 1.2s. Estimated remaining: 9m 27s. Rate: 141.8 symbols/min [2025-10-01T22:36:37.989411] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:38.015476] [DEBUG] [MAIN ] BLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:38.016753] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 27631 primary records. [2025-10-01T22:36:38.016903] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-01T22:36:38.031473] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:38.043380] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35433 primary records. [2025-10-01T22:36:38.043496] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-01T22:36:38.049138] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-10-01T22:36:38.049227] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-01T22:36:38.059812] [INFO ] [MAIN ] Derivative Progress: 248/1587 symbols completed. BLD took 1.2s. Estimated remaining: 9m 25s. Rate: 142.2 symbols/min [2025-10-01T22:36:38.064231] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:38.085986] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-01T22:36:38.086120] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-01T22:36:38.088801] [INFO ] [MAIN ] Derivative Progress: 249/1587 symbols completed. BLCO took 1.3s. Estimated remaining: 9m 22s. Rate: 142.8 symbols/min [2025-10-01T22:36:38.093376] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:38.115366] [DEBUG] [LOCAL ] BLE: Loaded 14294 existing records from primary storage. [2025-10-01T22:36:38.116576] [DEBUG] [LOCAL ] BLDR: Loaded 51639 existing records from primary storage. [2025-10-01T22:36:38.116758] [INFO ] [MAIN ] BLE: Loaded 14294 primary data records. [2025-10-01T22:36:38.116837] [INFO ] [MAIN ] BLDR: Loaded 51639 primary data records. [2025-10-01T22:36:38.565362] [DEBUG] [LOCAL ] BLK: Loaded 34407 existing records from primary storage. [2025-10-01T22:36:38.834940] [INFO ] [MAIN ] BLK: Loaded 34407 primary data records. [2025-10-01T22:36:39.274890] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:39.289463] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:39.289172] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14294 primary records. [2025-10-01T22:36:39.290488] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-01T22:36:39.290188] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51639 primary records. [2025-10-01T22:36:39.290743] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-01T22:36:39.325832] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-01T22:36:39.321197] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-01T22:36:39.326191] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-01T22:36:39.326120] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-01T22:36:39.328933] [INFO ] [MAIN ] Derivative Progress: 250/1587 symbols completed. BLDR took 1.3s. Estimated remaining: 9m 26s. Rate: 141.7 symbols/min [2025-10-01T22:36:39.331869] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:39.332048] [INFO ] [MAIN ] Derivative Progress: 251/1587 symbols completed. BLE took 1.3s. Estimated remaining: 9m 24s. Rate: 142.2 symbols/min [2025-10-01T22:36:39.332390] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:39.351549] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:39.352605] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34407 primary records. [2025-10-01T22:36:39.356427] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-01T22:36:39.378540] [DEBUG] [LOCAL ] BLW: Loaded 13110 existing records from primary storage. [2025-10-01T22:36:39.379826] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-01T22:36:39.380067] [INFO ] [MAIN ] BLW: Loaded 13110 primary data records. [2025-10-01T22:36:39.380265] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-01T22:36:39.406531] [INFO ] [MAIN ] Derivative Progress: 252/1587 symbols completed. BLK took 1.3s. Estimated remaining: 9m 21s. Rate: 142.7 symbols/min [2025-10-01T22:36:39.426541] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:39.591680] [DEBUG] [LOCAL ] BLND: Loaded 49264 existing records from primary storage. [2025-10-01T22:36:39.629606] [INFO ] [MAIN ] BLND: Loaded 49264 primary data records. [2025-10-01T22:36:39.756067] [DEBUG] [LOCAL ] BLX: Loaded 15623 existing records from primary storage. [2025-10-01T22:36:39.770154] [INFO ] [MAIN ] BLX: Loaded 15623 primary data records. [2025-10-01T22:36:40.468673] [DEBUG] [MAIN ] BLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:40.471066] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 13110 primary records. [2025-10-01T22:36:40.471174] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-01T22:36:40.491809] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-10-01T22:36:40.492413] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-01T22:36:40.495140] [INFO ] [MAIN ] Derivative Progress: 253/1587 symbols completed. BLW took 1.2s. Estimated remaining: 9m 24s. Rate: 141.8 symbols/min [2025-10-01T22:36:40.512549] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:40.513680] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49264 primary records. [2025-10-01T22:36:40.514006] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-01T22:36:40.533850] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-01T22:36:40.534153] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-01T22:36:40.536847] [INFO ] [MAIN ] Derivative Progress: 254/1587 symbols completed. BLND took 1.2s. Estimated remaining: 9m 22s. Rate: 142.3 symbols/min [2025-10-01T22:36:40.553042] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:40.553855] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15623 primary records. [2025-10-01T22:36:40.553922] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-01T22:36:40.570014] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-01T22:36:40.570117] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-01T22:36:40.572849] [INFO ] [MAIN ] Derivative Progress: 255/1587 symbols completed. BLX took 1.1s. Estimated remaining: 9m 20s. Rate: 142.8 symbols/min [2025-10-01T22:36:40.573690] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:40.573595] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:40.573512] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:40.588128] [DEBUG] [LOCAL ] BME: Loaded 10934 existing records from primary storage. [2025-10-01T22:36:40.588390] [INFO ] [MAIN ] BME: Loaded 10934 primary data records. [2025-10-01T22:36:40.741285] [DEBUG] [LOCAL ] BMEZ: Loaded 26275 existing records from primary storage. [2025-10-01T22:36:40.825170] [INFO ] [MAIN ] BMEZ: Loaded 26275 primary data records. [2025-10-01T22:36:40.869145] [DEBUG] [LOCAL ] BMA: Loaded 35306 existing records from primary storage. [2025-10-01T22:36:40.967474] [INFO ] [MAIN ] BMA: Loaded 35306 primary data records. [2025-10-01T22:36:41.679459] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:41.681229] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10934 primary records. [2025-10-01T22:36:41.681506] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-01T22:36:41.702157] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-01T22:36:41.703367] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-01T22:36:41.705923] [INFO ] [MAIN ] Derivative Progress: 256/1587 symbols completed. BME took 1.1s. Estimated remaining: 9m 23s. Rate: 141.9 symbols/min [2025-10-01T22:36:41.707672] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:41.724154] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:41.726322] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26275 primary records. [2025-10-01T22:36:41.728116] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-01T22:36:41.755979] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:41.757978] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35306 primary records. [2025-10-01T22:36:41.764068] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-01T22:36:41.777001] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-01T22:36:41.778030] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-01T22:36:41.783765] [INFO ] [MAIN ] Derivative Progress: 257/1587 symbols completed. BMEZ took 1.2s. Estimated remaining: 9m 21s. Rate: 142.3 symbols/min [2025-10-01T22:36:41.784284] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:41.797725] [DEBUG] [LOCAL ] BMI: Loaded 24194 existing records from primary storage. [2025-10-01T22:36:41.798949] [INFO ] [MAIN ] BMI: Loaded 24194 primary data records. [2025-10-01T22:36:41.799668] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-01T22:36:41.802002] [DEBUG] [LOCAL ] BMN: Loaded 2576 existing records from primary storage. [2025-10-01T22:36:41.813987] [INFO ] [MAIN ] BMN: Loaded 2576 primary data records. [2025-10-01T22:36:41.813900] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-01T22:36:41.897619] [INFO ] [MAIN ] Derivative Progress: 258/1587 symbols completed. BMA took 1.3s. Estimated remaining: 9m 19s. Rate: 142.7 symbols/min [2025-10-01T22:36:41.934186] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:42.502979] [DEBUG] [LOCAL ] BMO: Loaded 41214 existing records from primary storage. [2025-10-01T22:36:42.503532] [INFO ] [MAIN ] BMO: Loaded 41214 primary data records. [2025-10-01T22:36:42.637912] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:42.643476] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24194 primary records. [2025-10-01T22:36:42.648888] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-01T22:36:42.718711] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7730 incomplete bins [2025-10-01T22:36:42.758717] [INFO ] [MAIN ] BMN: Generated 1788 derivative records from 2576 primary records. [2025-10-01T22:36:42.864080] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-01T22:36:42.903025] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-01T22:36:42.935280] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-01T22:36:42.939259] [INFO ] [MAIN ] Derivative Progress: 259/1587 symbols completed. BMI took 1.2s. Estimated remaining: 9m 21s. Rate: 141.9 symbols/min [2025-10-01T22:36:42.939570] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:42.957939] [DEBUG] [LOCAL ] BMN: Derivative data saved (1788 records). [2025-10-01T22:36:42.958635] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-01T22:36:42.961673] [INFO ] [MAIN ] Derivative Progress: 260/1587 symbols completed. BMN took 1.2s. Estimated remaining: 9m 19s. Rate: 142.4 symbols/min [2025-10-01T22:36:42.962062] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:42.990070] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:42.991085] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41214 primary records. [2025-10-01T22:36:42.991242] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-01T22:36:43.023993] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-01T22:36:43.024307] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-01T22:36:43.026871] [INFO ] [MAIN ] Derivative Progress: 261/1587 symbols completed. BMO took 1.1s. Estimated remaining: 9m 17s. Rate: 142.9 symbols/min [2025-10-01T22:36:43.027333] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:43.081238] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-01T22:36:43.081513] [INFO ] [MAIN ] BN: Loaded 52993 primary data records. [2025-10-01T22:36:43.082957] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-01T22:36:43.113401] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-01T22:36:43.317547] [DEBUG] [LOCAL ] BNED: Loaded 29491 existing records from primary storage. [2025-10-01T22:36:43.334691] [INFO ] [MAIN ] BNED: Loaded 29491 primary data records. [2025-10-01T22:36:44.130916] [DEBUG] [MAIN ] BN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:44.133859] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52993 primary records. [2025-10-01T22:36:44.134105] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-01T22:36:44.161228] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:44.163279] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-10-01T22:36:44.163526] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-01T22:36:44.167218] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-01T22:36:44.167461] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-01T22:36:44.169798] [INFO ] [MAIN ] Derivative Progress: 262/1587 symbols completed. BN took 1.2s. Estimated remaining: 9m 20s. Rate: 142.0 symbols/min [2025-10-01T22:36:44.170902] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:44.205178] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:44.204679] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-01T22:36:44.205375] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-01T22:36:44.206184] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29491 primary records. [2025-10-01T22:36:44.209101] [INFO ] [MAIN ] Derivative Progress: 263/1587 symbols completed. BMY took 1.3s. Estimated remaining: 9m 18s. Rate: 142.5 symbols/min [2025-10-01T22:36:44.209446] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-01T22:36:44.213029] [DEBUG] [LOCAL ] BNH: Loaded 5106 existing records from primary storage. [2025-10-01T22:36:44.213379] [INFO ] [MAIN ] BNH: Loaded 5106 primary data records. [2025-10-01T22:36:44.212749] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:44.349013] [DEBUG] [LOCAL ] BNJ: Loaded 2630 existing records from primary storage. [2025-10-01T22:36:44.361583] [INFO ] [MAIN ] BNJ: Loaded 2630 primary data records. [2025-10-01T22:36:44.474505] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-01T22:36:44.495758] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-01T22:36:44.531265] [INFO ] [MAIN ] Derivative Progress: 264/1587 symbols completed. BNED took 1.5s. Estimated remaining: 9m 17s. Rate: 142.6 symbols/min [2025-10-01T22:36:44.688666] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:44.987011] [DEBUG] [MAIN ] BNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:45.001823] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 5106 primary records. [2025-10-01T22:36:45.001927] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-01T22:36:45.003520] [DEBUG] [LOCAL ] BNL: Loaded 46913 existing records from primary storage. [2025-10-01T22:36:45.012038] [INFO ] [MAIN ] BNL: Loaded 46913 primary data records. [2025-10-01T22:36:45.021955] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-01T22:36:45.034545] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-01T22:36:45.042442] [INFO ] [MAIN ] Derivative Progress: 265/1587 symbols completed. BNH took 0.9s. Estimated remaining: 9m 17s. Rate: 142.5 symbols/min [2025-10-01T22:36:45.093199] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:45.105838] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-01T22:36:45.117218] [INFO ] [MAIN ] BNJ: Generated 1792 derivative records from 2630 primary records. [2025-10-01T22:36:45.117422] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-01T22:36:45.228139] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1792 records). [2025-10-01T22:36:45.269543] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-01T22:36:45.391105] [INFO ] [MAIN ] Derivative Progress: 266/1587 symbols completed. BNJ took 1.2s. Estimated remaining: 9m 16s. Rate: 142.6 symbols/min [2025-10-01T22:36:45.392133] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:45.412804] [DEBUG] [LOCAL ] BNT: Loaded 3373 existing records from primary storage. [2025-10-01T22:36:45.413688] [INFO ] [MAIN ] BNT: Loaded 3373 primary data records. [2025-10-01T22:36:45.549389] [DEBUG] [LOCAL ] BNS: Loaded 51486 existing records from primary storage. [2025-10-01T22:36:45.557256] [INFO ] [MAIN ] BNS: Loaded 51486 primary data records. [2025-10-01T22:36:45.939924] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:45.951735] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 46913 primary records. [2025-10-01T22:36:46.005982] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-01T22:36:46.160940] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-01T22:36:46.162033] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-01T22:36:46.164792] [INFO ] [MAIN ] Derivative Progress: 267/1587 symbols completed. BNL took 1.5s. Estimated remaining: 9m 17s. Rate: 142.1 symbols/min [2025-10-01T22:36:46.165463] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:46.179420] [DEBUG] [LOCAL ] BNY: Loaded 7113 existing records from primary storage. [2025-10-01T22:36:46.193598] [INFO ] [MAIN ] BNY: Loaded 7113 primary data records. [2025-10-01T22:36:46.194535] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:46.207781] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3373 primary records. [2025-10-01T22:36:46.219158] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-01T22:36:46.302837] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-10-01T22:36:46.308174] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-01T22:36:46.317563] [INFO ] [MAIN ] Derivative Progress: 268/1587 symbols completed. BNT took 0.9s. Estimated remaining: 9m 16s. Rate: 142.5 symbols/min [2025-10-01T22:36:46.348604] [DEBUG] [MAIN ] BNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:46.359807] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51486 primary records. [2025-10-01T22:36:46.365028] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-01T22:36:46.553921] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-01T22:36:46.568561] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-01T22:36:46.572328] [INFO ] [MAIN ] Derivative Progress: 269/1587 symbols completed. BNS took 1.5s. Estimated remaining: 9m 14s. Rate: 142.7 symbols/min [2025-10-01T22:36:46.595421] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:46.596092] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7113 primary records. [2025-10-01T22:36:46.596155] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-01T22:36:46.610787] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-01T22:36:46.610852] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-01T22:36:46.613380] [INFO ] [MAIN ] Derivative Progress: 270/1587 symbols completed. BNY took 0.4s. Estimated remaining: 9m 12s. Rate: 143.1 symbols/min [2025-10-01T22:36:46.613912] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:46.614497] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:46.614263] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:46.649492] [DEBUG] [LOCAL ] BOC: Loaded 18283 existing records from primary storage. [2025-10-01T22:36:46.657972] [INFO ] [MAIN ] BOC: Loaded 18283 primary data records. [2025-10-01T22:36:46.663912] [DEBUG] [LOCAL ] BOE: Loaded 17689 existing records from primary storage. [2025-10-01T22:36:46.683001] [INFO ] [MAIN ] BOE: Loaded 17689 primary data records. [2025-10-01T22:36:46.871771] [DEBUG] [LOCAL ] BOH: Loaded 30758 existing records from primary storage. [2025-10-01T22:36:46.903890] [INFO ] [MAIN ] BOH: Loaded 30758 primary data records. [2025-10-01T22:36:47.750233] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:47.750977] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:47.752506] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 17689 primary records. [2025-10-01T22:36:47.751817] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18283 primary records. [2025-10-01T22:36:47.752749] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-01T22:36:47.752798] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-01T22:36:47.797747] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-01T22:36:47.789494] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-01T22:36:47.802980] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-01T22:36:47.803060] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-01T22:36:47.808866] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:47.805611] [INFO ] [MAIN ] Derivative Progress: 271/1587 symbols completed. BOE took 1.2s. Estimated remaining: 9m 15s. Rate: 142.2 symbols/min [2025-10-01T22:36:47.809055] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:47.810006] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30758 primary records. [2025-10-01T22:36:47.809154] [INFO ] [MAIN ] Derivative Progress: 272/1587 symbols completed. BOC took 1.2s. Estimated remaining: 9m 13s. Rate: 142.7 symbols/min [2025-10-01T22:36:47.810618] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:47.810761] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-01T22:36:47.828272] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-01T22:36:47.828441] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-01T22:36:47.831599] [INFO ] [MAIN ] Derivative Progress: 273/1587 symbols completed. BOH took 1.2s. Estimated remaining: 9m 11s. Rate: 143.2 symbols/min [2025-10-01T22:36:47.831849] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:47.866534] [DEBUG] [LOCAL ] BOND: Loaded 32203 existing records from primary storage. [2025-10-01T22:36:47.866813] [INFO ] [MAIN ] BOND: Loaded 32203 primary data records. [2025-10-01T22:36:47.997809] [DEBUG] [LOCAL ] BOOT: Loaded 40532 existing records from primary storage. [2025-10-01T22:36:48.013721] [INFO ] [MAIN ] BOOT: Loaded 40532 primary data records. [2025-10-01T22:36:48.113141] [DEBUG] [LOCAL ] BORR: Loaded 51122 existing records from primary storage. [2025-10-01T22:36:48.139969] [INFO ] [MAIN ] BORR: Loaded 51122 primary data records. [2025-10-01T22:36:48.966133] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:36:48.967710] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32203 primary records. [2025-10-01T22:36:48.968367] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-01T22:36:48.989254] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-10-01T22:36:48.999516] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-01T22:36:49.007441] [INFO ] [MAIN ] Derivative Progress: 274/1587 symbols completed. BOND took 1.2s. Estimated remaining: 9m 14s. Rate: 142.3 symbols/min [2025-10-01T22:36:49.009197] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:49.008969] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:49.024278] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40532 primary records. [2025-10-01T22:36:49.024445] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-01T22:36:49.024157] [DEBUG] [MAIN ] BORR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:49.025322] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51122 primary records. [2025-10-01T22:36:49.026254] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-01T22:36:49.059303] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-10-01T22:36:49.058881] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-01T22:36:49.059470] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-01T22:36:49.059574] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-01T22:36:49.062307] [INFO ] [MAIN ] Derivative Progress: 275/1587 symbols completed. BOOT took 1.3s. Estimated remaining: 9m 12s. Rate: 142.7 symbols/min [2025-10-01T22:36:49.067006] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:49.067093] [INFO ] [MAIN ] Derivative Progress: 276/1587 symbols completed. BORR took 1.2s. Estimated remaining: 9m 9s. Rate: 143.2 symbols/min [2025-10-01T22:36:49.067773] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:49.108353] [DEBUG] [LOCAL ] BRC: Loaded 19040 existing records from primary storage. [2025-10-01T22:36:49.108544] [INFO ] [MAIN ] BRC: Loaded 19040 primary data records. [2025-10-01T22:36:49.266749] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-10-01T22:36:49.265757] [DEBUG] [LOCAL ] BR: Loaded 34667 existing records from primary storage. [2025-10-01T22:36:49.267292] [INFO ] [MAIN ] BR: Loaded 34667 primary data records. [2025-10-01T22:36:49.267169] [INFO ] [MAIN ] BP: Loaded 53711 primary data records. [2025-10-01T22:36:50.223508] [DEBUG] [MAIN ] BRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:50.224761] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 19040 primary records. [2025-10-01T22:36:50.225127] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-01T22:36:50.263187] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-01T22:36:50.264019] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-01T22:36:50.263539] [DEBUG] [MAIN ] BP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:50.265111] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53711 primary records. [2025-10-01T22:36:50.275575] [INFO ] [MAIN ] Derivative Progress: 277/1587 symbols completed. BRC took 1.2s. Estimated remaining: 9m 13s. Rate: 142.3 symbols/min [2025-10-01T22:36:50.280793] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-01T22:36:50.281220] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:50.281365] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:50.283413] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34667 primary records. [2025-10-01T22:36:50.284010] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-01T22:36:50.315973] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-10-01T22:36:50.316129] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-01T22:36:50.318863] [INFO ] [MAIN ] Derivative Progress: 278/1587 symbols completed. BP took 1.3s. Estimated remaining: 9m 10s. Rate: 142.7 symbols/min [2025-10-01T22:36:50.319530] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:50.320554] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-01T22:36:50.321195] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-01T22:36:50.324021] [INFO ] [MAIN ] Derivative Progress: 279/1587 symbols completed. BR took 1.3s. Estimated remaining: 9m 8s. Rate: 143.2 symbols/min [2025-10-01T22:36:50.324374] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:50.360411] [DEBUG] [LOCAL ] BRCC: Loaded 40209 existing records from primary storage. [2025-10-01T22:36:50.360709] [INFO ] [MAIN ] BRCC: Loaded 40209 primary data records. [2025-10-01T22:36:50.562493] [DEBUG] [LOCAL ] BROS: Loaded 53292 existing records from primary storage. [2025-10-01T22:36:50.749243] [DEBUG] [LOCAL ] BRO: Loaded 51893 existing records from primary storage. [2025-10-01T22:36:50.760385] [INFO ] [MAIN ] BRO: Loaded 51893 primary data records. [2025-10-01T22:36:50.759298] [INFO ] [MAIN ] BROS: Loaded 53292 primary data records. [2025-10-01T22:36:51.510369] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:51.511738] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40209 primary records. [2025-10-01T22:36:51.511964] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-01T22:36:51.530089] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-01T22:36:51.530630] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-01T22:36:51.533276] [INFO ] [MAIN ] Derivative Progress: 280/1587 symbols completed. BRCC took 1.3s. Estimated remaining: 9m 11s. Rate: 142.3 symbols/min [2025-10-01T22:36:51.534996] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:51.552130] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:51.553100] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53292 primary records. [2025-10-01T22:36:51.553278] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-01T22:36:51.585216] [DEBUG] [MAIN ] BRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:51.587701] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51893 primary records. [2025-10-01T22:36:51.589092] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-01T22:36:51.590603] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-01T22:36:51.590926] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-01T22:36:51.601028] [INFO ] [MAIN ] Derivative Progress: 281/1587 symbols completed. BROS took 1.3s. Estimated remaining: 9m 9s. Rate: 142.7 symbols/min [2025-10-01T22:36:51.605728] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:51.619041] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-10-01T22:36:51.620521] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-01T22:36:51.622735] [INFO ] [MAIN ] Derivative Progress: 282/1587 symbols completed. BRO took 1.3s. Estimated remaining: 9m 7s. Rate: 143.2 symbols/min [2025-10-01T22:36:51.623515] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:51.639094] [DEBUG] [LOCAL ] BRT: Loaded 4950 existing records from primary storage. [2025-10-01T22:36:51.638755] [DEBUG] [LOCAL ] BRSP: Loaded 36857 existing records from primary storage. [2025-10-01T22:36:51.639290] [INFO ] [MAIN ] BRT: Loaded 4950 primary data records. [2025-10-01T22:36:51.639387] [INFO ] [MAIN ] BRSP: Loaded 36857 primary data records. [2025-10-01T22:36:52.225829] [DEBUG] [LOCAL ] BRX: Loaded 51713 existing records from primary storage. [2025-10-01T22:36:52.311831] [INFO ] [MAIN ] BRX: Loaded 51713 primary data records. [2025-10-01T22:36:52.678514] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:52.679750] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4950 primary records. [2025-10-01T22:36:52.679949] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-01T22:36:52.702566] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:52.711942] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-10-01T22:36:52.710598] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36857 primary records. [2025-10-01T22:36:52.712245] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-01T22:36:52.712682] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-01T22:36:52.715113] [INFO ] [MAIN ] Derivative Progress: 283/1587 symbols completed. BRT took 1.1s. Estimated remaining: 9m 10s. Rate: 142.4 symbols/min [2025-10-01T22:36:52.734238] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-01T22:36:52.736021] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-01T22:36:52.739290] [INFO ] [MAIN ] Derivative Progress: 284/1587 symbols completed. BRSP took 1.2s. Estimated remaining: 9m 7s. Rate: 142.8 symbols/min [2025-10-01T22:36:52.752512] [DEBUG] [MAIN ] BRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:52.753222] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51713 primary records. [2025-10-01T22:36:52.753285] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-01T22:36:52.769874] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-01T22:36:52.769941] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-01T22:36:52.772509] [INFO ] [MAIN ] Derivative Progress: 285/1587 symbols completed. BRX took 1.1s. Estimated remaining: 9m 5s. Rate: 143.3 symbols/min [2025-10-01T22:36:52.772926] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:52.773043] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:52.773097] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:52.784461] [DEBUG] [LOCAL ] BSL: Loaded 8243 existing records from primary storage. [2025-10-01T22:36:52.784611] [INFO ] [MAIN ] BSL: Loaded 8243 primary data records. [2025-10-01T22:36:53.142418] [DEBUG] [LOCAL ] BSM: Loaded 32181 existing records from primary storage. [2025-10-01T22:36:53.159062] [DEBUG] [LOCAL ] BSBR: Loaded 35400 existing records from primary storage. [2025-10-01T22:36:53.160330] [INFO ] [MAIN ] BSBR: Loaded 35400 primary data records. [2025-10-01T22:36:53.160210] [INFO ] [MAIN ] BSM: Loaded 32181 primary data records. [2025-10-01T22:36:53.929632] [DEBUG] [MAIN ] BSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:53.932524] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8243 primary records. [2025-10-01T22:36:53.932886] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-01T22:36:53.951285] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-01T22:36:53.951454] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-01T22:36:53.954364] [INFO ] [MAIN ] Derivative Progress: 286/1587 symbols completed. BSL took 1.2s. Estimated remaining: 9m 8s. Rate: 142.4 symbols/min [2025-10-01T22:36:53.954962] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:53.965554] [DEBUG] [LOCAL ] BTA: Loaded 5410 existing records from primary storage. [2025-10-01T22:36:53.966123] [INFO ] [MAIN ] BTA: Loaded 5410 primary data records. [2025-10-01T22:36:54.122936] [DEBUG] [MAIN ] BSBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:54.123393] [DEBUG] [MAIN ] BSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:54.124265] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35400 primary records. [2025-10-01T22:36:54.124975] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32181 primary records. [2025-10-01T22:36:54.125053] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-01T22:36:54.125479] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-01T22:36:54.217979] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-01T22:36:54.246378] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-01T22:36:54.250770] [INFO ] [MAIN ] Derivative Progress: 287/1587 symbols completed. BSBR took 1.5s. Estimated remaining: 9m 7s. Rate: 142.5 symbols/min [2025-10-01T22:36:54.251212] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:54.379635] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-01T22:36:54.380580] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-01T22:36:54.382818] [INFO ] [MAIN ] Derivative Progress: 288/1587 symbols completed. BSM took 1.6s. Estimated remaining: 9m 5s. Rate: 142.9 symbols/min [2025-10-01T22:36:54.383135] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:54.412278] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:54.413171] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5410 primary records. [2025-10-01T22:36:54.413310] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-01T22:36:54.428916] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-01T22:36:54.429091] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-01T22:36:54.431998] [INFO ] [MAIN ] Derivative Progress: 289/1587 symbols completed. BTA took 0.5s. Estimated remaining: 9m 3s. Rate: 143.3 symbols/min [2025-10-01T22:36:54.432198] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:54.474142] [DEBUG] [LOCAL ] BTO: Loaded 8767 existing records from primary storage. [2025-10-01T22:36:54.474307] [INFO ] [MAIN ] BTO: Loaded 8767 primary data records. [2025-10-01T22:36:54.550674] [DEBUG] [LOCAL ] BTI: Loaded 53556 existing records from primary storage. [2025-10-01T22:36:54.565920] [INFO ] [MAIN ] BTI: Loaded 53556 primary data records. [2025-10-01T22:36:54.644356] [DEBUG] [LOCAL ] BTE: Loaded 52720 existing records from primary storage. [2025-10-01T22:36:54.670191] [INFO ] [MAIN ] BTE: Loaded 52720 primary data records. [2025-10-01T22:36:55.548186] [DEBUG] [MAIN ] BTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:55.549463] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8767 primary records. [2025-10-01T22:36:55.549907] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-01T22:36:55.567512] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-01T22:36:55.567926] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-01T22:36:55.570089] [INFO ] [MAIN ] Derivative Progress: 290/1587 symbols completed. BTO took 1.1s. Estimated remaining: 9m 6s. Rate: 142.5 symbols/min [2025-10-01T22:36:55.570455] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:55.604031] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:55.604409] [DEBUG] [MAIN ] BTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:55.606131] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53556 primary records. [2025-10-01T22:36:55.605316] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52720 primary records. [2025-10-01T22:36:55.606375] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-01T22:36:55.606793] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-01T22:36:55.641185] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-01T22:36:55.641321] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-01T22:36:55.638049] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-01T22:36:55.643953] [INFO ] [MAIN ] Derivative Progress: 291/1587 symbols completed. BTI took 1.3s. Estimated remaining: 9m 4s. Rate: 142.9 symbols/min [2025-10-01T22:36:55.644199] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:55.644299] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-01T22:36:55.647046] [INFO ] [MAIN ] Derivative Progress: 292/1587 symbols completed. BTE took 1.4s. Estimated remaining: 9m 2s. Rate: 143.4 symbols/min [2025-10-01T22:36:55.647664] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:55.688456] [DEBUG] [LOCAL ] BTU: Loaded 53311 existing records from primary storage. [2025-10-01T22:36:55.688700] [INFO ] [MAIN ] BTU: Loaded 53311 primary data records. [2025-10-01T22:36:55.869148] [DEBUG] [LOCAL ] BUR: Loaded 45140 existing records from primary storage. [2025-10-01T22:36:55.908442] [INFO ] [MAIN ] BUR: Loaded 45140 primary data records. [2025-10-01T22:36:55.954311] [DEBUG] [LOCAL ] BUD: Loaded 52716 existing records from primary storage. [2025-10-01T22:36:55.994711] [INFO ] [MAIN ] BUD: Loaded 52716 primary data records. [2025-10-01T22:36:56.789788] [DEBUG] [MAIN ] BTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:56.790730] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53311 primary records. [2025-10-01T22:36:56.791174] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-01T22:36:56.813509] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-01T22:36:56.827132] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-01T22:36:56.827612] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:56.830868] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52716 primary records. [2025-10-01T22:36:56.830009] [INFO ] [MAIN ] Derivative Progress: 293/1587 symbols completed. BTU took 1.3s. Estimated remaining: 9m 5s. Rate: 142.5 symbols/min [2025-10-01T22:36:56.831106] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-01T22:36:56.831378] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:56.851135] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-01T22:36:56.852289] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-01T22:36:56.855250] [INFO ] [MAIN ] Derivative Progress: 294/1587 symbols completed. BUD took 1.2s. Estimated remaining: 9m 3s. Rate: 142.9 symbols/min [2025-10-01T22:36:56.855436] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:56.869772] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:56.870592] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45140 primary records. [2025-10-01T22:36:56.870740] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-01T22:36:56.888350] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-01T22:36:56.888580] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-01T22:36:56.891298] [INFO ] [MAIN ] Derivative Progress: 295/1587 symbols completed. BUR took 1.2s. Estimated remaining: 9m 1s. Rate: 143.4 symbols/min [2025-10-01T22:36:56.891681] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:56.959231] [DEBUG] [LOCAL ] BURL: Loaded 45991 existing records from primary storage. [2025-10-01T22:36:56.960735] [INFO ] [MAIN ] BURL: Loaded 45991 primary data records. [2025-10-01T22:36:56.961535] [DEBUG] [LOCAL ] BVN: Loaded 44017 existing records from primary storage. [2025-10-01T22:36:57.028896] [INFO ] [MAIN ] BVN: Loaded 44017 primary data records. [2025-10-01T22:36:57.106318] [DEBUG] [LOCAL ] BW: Loaded 39882 existing records from primary storage. [2025-10-01T22:36:57.150414] [INFO ] [MAIN ] BW: Loaded 39882 primary data records. [2025-10-01T22:36:58.094057] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:58.096561] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45991 primary records. [2025-10-01T22:36:58.096927] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-01T22:36:58.126217] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:58.129047] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-01T22:36:58.129529] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-01T22:36:58.130309] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 44017 primary records. [2025-10-01T22:36:58.131683] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-01T22:36:58.133623] [INFO ] [MAIN ] Derivative Progress: 296/1587 symbols completed. BURL took 1.3s. Estimated remaining: 9m 4s. Rate: 142.4 symbols/min [2025-10-01T22:36:58.144070] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:58.153358] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-01T22:36:58.153681] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-01T22:36:58.164547] [INFO ] [MAIN ] Derivative Progress: 297/1587 symbols completed. BVN took 1.3s. Estimated remaining: 9m 2s. Rate: 142.9 symbols/min [2025-10-01T22:36:58.170349] [DEBUG] [MAIN ] BW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:58.171452] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39882 primary records. [2025-10-01T22:36:58.170522] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:58.171687] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-01T22:36:58.192379] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-10-01T22:36:58.192601] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-01T22:36:58.195317] [INFO ] [MAIN ] Derivative Progress: 298/1587 symbols completed. BW took 1.3s. Estimated remaining: 8m 60s. Rate: 143.3 symbols/min [2025-10-01T22:36:58.205246] [DEBUG] [LOCAL ] BWG: Loaded 12509 existing records from primary storage. [2025-10-01T22:36:58.205382] [INFO ] [MAIN ] BWG: Loaded 12509 primary data records. [2025-10-01T22:36:58.445924] [DEBUG] [LOCAL ] BWA: Loaded 52184 existing records from primary storage. [2025-10-01T22:36:58.465214] [INFO ] [MAIN ] BWA: Loaded 52184 primary data records. [2025-10-01T22:36:58.936104] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:58.937269] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12509 primary records. [2025-10-01T22:36:58.937484] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-01T22:36:58.955105] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-01T22:36:58.955331] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-01T22:36:58.957423] [INFO ] [MAIN ] Derivative Progress: 299/1587 symbols completed. BWG took 0.8s. Estimated remaining: 9m 1s. Rate: 142.9 symbols/min [2025-10-01T22:36:58.974731] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:36:58.975296] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52184 primary records. [2025-10-01T22:36:58.975355] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-01T22:36:58.991456] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-01T22:36:58.991524] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-01T22:36:58.994173] [INFO ] [MAIN ] Derivative Progress: 300/1587 symbols completed. BWA took 0.9s. Estimated remaining: 8m 59s. Rate: 143.4 symbols/min [2025-10-01T22:36:58.994666] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:58.994609] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:58.994833] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:36:59.007612] [DEBUG] [LOCAL ] BWNB: Loaded 4444 existing records from primary storage. [2025-10-01T22:36:59.007806] [INFO ] [MAIN ] BWNB: Loaded 4444 primary data records. [2025-10-01T22:36:59.056820] [DEBUG] [LOCAL ] BWMX: Loaded 7699 existing records from primary storage. [2025-10-01T22:36:59.084385] [INFO ] [MAIN ] BWMX: Loaded 7699 primary data records. [2025-10-01T22:36:59.244184] [DEBUG] [LOCAL ] BWLP: Loaded 32416 existing records from primary storage. [2025-10-01T22:36:59.326915] [INFO ] [MAIN ] BWLP: Loaded 32416 primary data records. [2025-10-01T22:37:00.074881] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:00.076977] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4444 primary records. [2025-10-01T22:37:00.077739] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-01T22:37:00.097186] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-01T22:37:00.098050] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-01T22:37:00.100902] [INFO ] [MAIN ] Derivative Progress: 301/1587 symbols completed. BWNB took 1.1s. Estimated remaining: 9m 1s. Rate: 142.6 symbols/min [2025-10-01T22:37:00.101433] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:00.128620] [DEBUG] [LOCAL ] BWSN: Loaded 5090 existing records from primary storage. [2025-10-01T22:37:00.128939] [DEBUG] [MAIN ] BWMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:00.129402] [INFO ] [MAIN ] BWSN: Loaded 5090 primary data records. [2025-10-01T22:37:00.135745] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7699 primary records. [2025-10-01T22:37:00.153115] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-01T22:37:00.293789] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-01T22:37:00.310017] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-01T22:37:00.304758] [DEBUG] [MAIN ] BWLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:00.342179] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32416 primary records. [2025-10-01T22:37:00.335574] [INFO ] [MAIN ] Derivative Progress: 302/1587 symbols completed. BWMX took 1.3s. Estimated remaining: 8m 60s. Rate: 142.8 symbols/min [2025-10-01T22:37:00.353716] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-01T22:37:00.353879] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:00.569076] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-01T22:37:00.569812] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-01T22:37:00.572564] [INFO ] [MAIN ] Derivative Progress: 303/1587 symbols completed. BWLP took 1.6s. Estimated remaining: 8m 59s. Rate: 143.0 symbols/min [2025-10-01T22:37:00.572824] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:00.597002] [DEBUG] [MAIN ] BWSN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:37:00.597889] [INFO ] [MAIN ] BWSN: Generated 1793 derivative records from 5090 primary records. [2025-10-01T22:37:00.598002] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-01T22:37:00.614785] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1793 records). [2025-10-01T22:37:00.615034] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-01T22:37:00.617520] [INFO ] [MAIN ] Derivative Progress: 304/1587 symbols completed. BWSN took 0.5s. Estimated remaining: 8m 57s. Rate: 143.4 symbols/min [2025-10-01T22:37:00.617954] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:00.670281] [DEBUG] [LOCAL ] BXC: Loaded 13649 existing records from primary storage. [2025-10-01T22:37:00.670458] [INFO ] [MAIN ] BXC: Loaded 13649 primary data records. [2025-10-01T22:37:00.671608] [DEBUG] [LOCAL ] BWXT: Loaded 46870 existing records from primary storage. [2025-10-01T22:37:00.676872] [INFO ] [MAIN ] BWXT: Loaded 46870 primary data records. [2025-10-01T22:37:00.911125] [DEBUG] [LOCAL ] BX: Loaded 53489 existing records from primary storage. [2025-10-01T22:37:00.932015] [INFO ] [MAIN ] BX: Loaded 53489 primary data records. [2025-10-01T22:37:01.759291] [DEBUG] [MAIN ] BXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:01.767452] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13649 primary records. [2025-10-01T22:37:01.768232] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:01.769684] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46870 primary records. [2025-10-01T22:37:01.770081] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-01T22:37:01.768740] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-01T22:37:01.818028] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-01T22:37:01.823781] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-01T22:37:01.823702] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-01T22:37:01.827098] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-01T22:37:01.827024] [INFO ] [MAIN ] Derivative Progress: 305/1587 symbols completed. BWXT took 1.5s. Estimated remaining: 8m 60s. Rate: 142.5 symbols/min [2025-10-01T22:37:01.835420] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:01.843767] [INFO ] [MAIN ] Derivative Progress: 306/1587 symbols completed. BXC took 1.2s. Estimated remaining: 8m 58s. Rate: 143.0 symbols/min [2025-10-01T22:37:01.845323] [DEBUG] [MAIN ] BX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:01.846352] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53489 primary records. [2025-10-01T22:37:01.844505] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:01.846539] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-01T22:37:01.869015] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-10-01T22:37:01.873803] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-01T22:37:01.877111] [INFO ] [MAIN ] Derivative Progress: 307/1587 symbols completed. BX took 1.3s. Estimated remaining: 8m 55s. Rate: 143.4 symbols/min [2025-10-01T22:37:01.877492] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:01.897797] [DEBUG] [LOCAL ] BXMX: Loaded 19559 existing records from primary storage. [2025-10-01T22:37:01.897944] [INFO ] [MAIN ] BXMX: Loaded 19559 primary data records. [2025-10-01T22:37:02.031605] [DEBUG] [LOCAL ] BXMT: Loaded 47227 existing records from primary storage. [2025-10-01T22:37:02.035939] [INFO ] [MAIN ] BXMT: Loaded 47227 primary data records. [2025-10-01T22:37:02.413235] [DEBUG] [LOCAL ] BXP: Loaded 49856 existing records from primary storage. [2025-10-01T22:37:02.425632] [INFO ] [MAIN ] BXP: Loaded 49856 primary data records. [2025-10-01T22:37:03.034126] [DEBUG] [MAIN ] BXMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:03.035774] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19559 primary records. [2025-10-01T22:37:03.036126] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-01T22:37:03.059060] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-01T22:37:03.059298] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-01T22:37:03.061586] [INFO ] [MAIN ] Derivative Progress: 308/1587 symbols completed. BXMX took 1.2s. Estimated remaining: 8m 58s. Rate: 142.6 symbols/min [2025-10-01T22:37:03.062066] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:03.076202] [DEBUG] [MAIN ] BXMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:03.077153] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47227 primary records. [2025-10-01T22:37:03.077428] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-01T22:37:03.096944] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-01T22:37:03.097107] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-01T22:37:03.099822] [INFO ] [MAIN ] Derivative Progress: 309/1587 symbols completed. BXMT took 1.3s. Estimated remaining: 8m 56s. Rate: 143.0 symbols/min [2025-10-01T22:37:03.100029] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:03.120143] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:03.121259] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49856 primary records. [2025-10-01T22:37:03.121454] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-01T22:37:03.177330] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-01T22:37:03.177885] [DEBUG] [LOCAL ] BY: Loaded 21678 existing records from primary storage. [2025-10-01T22:37:03.179020] [DEBUG] [LOCAL ] BXSL: Loaded 47639 existing records from primary storage. [2025-10-01T22:37:03.179111] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-01T22:37:03.179331] [INFO ] [MAIN ] BXSL: Loaded 47639 primary data records. [2025-10-01T22:37:03.182308] [INFO ] [MAIN ] BY: Loaded 21678 primary data records. [2025-10-01T22:37:03.182223] [INFO ] [MAIN ] Derivative Progress: 310/1587 symbols completed. BXP took 1.3s. Estimated remaining: 8m 54s. Rate: 143.4 symbols/min [2025-10-01T22:37:03.182558] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:03.854312] [DEBUG] [LOCAL ] BYD: Loaded 44923 existing records from primary storage. [2025-10-01T22:37:03.855274] [INFO ] [MAIN ] BYD: Loaded 44923 primary data records. [2025-10-01T22:37:04.236062] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:04.235606] [DEBUG] [MAIN ] BXSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:04.236998] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21678 primary records. [2025-10-01T22:37:04.237202] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-01T22:37:04.238087] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47639 primary records. [2025-10-01T22:37:04.240052] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-01T22:37:04.276452] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-01T22:37:04.275964] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-01T22:37:04.276785] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-01T22:37:04.276717] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-01T22:37:04.279487] [INFO ] [MAIN ] Derivative Progress: 311/1587 symbols completed. BY took 1.2s. Estimated remaining: 8m 57s. Rate: 142.6 symbols/min [2025-10-01T22:37:04.279690] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:04.282267] [INFO ] [MAIN ] Derivative Progress: 312/1587 symbols completed. BXSL took 1.2s. Estimated remaining: 8m 55s. Rate: 143.1 symbols/min [2025-10-01T22:37:04.284677] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:04.301061] [DEBUG] [MAIN ] BYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:04.302074] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44923 primary records. [2025-10-01T22:37:04.302235] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-01T22:37:04.328113] [DEBUG] [LOCAL ] BYM: Loaded 12042 existing records from primary storage. [2025-10-01T22:37:04.328255] [INFO ] [MAIN ] BYM: Loaded 12042 primary data records. [2025-10-01T22:37:04.387529] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-01T22:37:04.402442] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-01T22:37:04.447157] [INFO ] [MAIN ] Derivative Progress: 313/1587 symbols completed. BYD took 1.3s. Estimated remaining: 8m 53s. Rate: 143.4 symbols/min [2025-10-01T22:37:04.469496] [DEBUG] [LOCAL ] BZH: Loaded 32356 existing records from primary storage. [2025-10-01T22:37:04.469824] [INFO ] [MAIN ] BZH: Loaded 32356 primary data records. [2025-10-01T22:37:05.065068] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:05.066208] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12042 primary records. [2025-10-01T22:37:05.066517] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-01T22:37:05.097859] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-01T22:37:05.097965] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-01T22:37:05.097794] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:05.100086] [INFO ] [MAIN ] Derivative Progress: 314/1587 symbols completed. BYM took 0.8s. Estimated remaining: 8m 54s. Rate: 143.1 symbols/min [2025-10-01T22:37:05.100907] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32356 primary records. [2025-10-01T22:37:05.101106] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-01T22:37:05.117246] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-01T22:37:05.117314] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-01T22:37:05.120391] [INFO ] [MAIN ] Derivative Progress: 315/1587 symbols completed. BZH took 0.8s. Estimated remaining: 8m 52s. Rate: 143.5 symbols/min [2025-10-01T22:37:05.120929] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:05.121072] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:05.121630] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:05.157739] [DEBUG] [LOCAL ] CABO: Loaded 17049 existing records from primary storage. [2025-10-01T22:37:05.159184] [INFO ] [MAIN ] CABO: Loaded 17049 primary data records. [2025-10-01T22:37:05.159687] [DEBUG] [LOCAL ] CAAP: Loaded 19995 existing records from primary storage. [2025-10-01T22:37:05.172721] [INFO ] [MAIN ] CAAP: Loaded 19995 primary data records. [2025-10-01T22:37:05.513381] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-01T22:37:05.559021] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-10-01T22:37:06.239025] [DEBUG] [MAIN ] CABO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:06.240026] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 17049 primary records. [2025-10-01T22:37:06.240206] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-01T22:37:06.267464] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:06.270249] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19995 primary records. [2025-10-01T22:37:06.270351] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-01T22:37:06.271201] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-01T22:37:06.271439] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-01T22:37:06.276294] [INFO ] [MAIN ] Derivative Progress: 316/1587 symbols completed. CABO took 1.2s. Estimated remaining: 8m 54s. Rate: 142.7 symbols/min [2025-10-01T22:37:06.285543] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:06.293574] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-01T22:37:06.306140] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-01T22:37:06.309639] [INFO ] [MAIN ] Derivative Progress: 317/1587 symbols completed. CAAP took 1.2s. Estimated remaining: 8m 52s. Rate: 143.2 symbols/min [2025-10-01T22:37:06.309948] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:06.310945] [DEBUG] [MAIN ] C: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:06.311816] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-10-01T22:37:06.312005] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-01T22:37:06.335858] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-01T22:37:06.336038] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-01T22:37:06.339545] [INFO ] [MAIN ] Derivative Progress: 318/1587 symbols completed. C took 1.2s. Estimated remaining: 8m 50s. Rate: 143.6 symbols/min [2025-10-01T22:37:06.340398] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:06.349460] [DEBUG] [LOCAL ] CACI: Loaded 24519 existing records from primary storage. [2025-10-01T22:37:06.349668] [INFO ] [MAIN ] CACI: Loaded 24519 primary data records. [2025-10-01T22:37:06.750252] [DEBUG] [LOCAL ] CADE: Loaded 48856 existing records from primary storage. [2025-10-01T22:37:06.762290] [INFO ] [MAIN ] CADE: Loaded 48856 primary data records. [2025-10-01T22:37:06.763002] [DEBUG] [LOCAL ] CAE: Loaded 39036 existing records from primary storage. [2025-10-01T22:37:06.763174] [INFO ] [MAIN ] CAE: Loaded 39036 primary data records. [2025-10-01T22:37:07.450489] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:37:07.451746] [INFO ] [MAIN ] CACI: Generated 1793 derivative records from 24519 primary records. [2025-10-01T22:37:07.451955] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-01T22:37:07.471808] [DEBUG] [LOCAL ] CACI: Derivative data saved (1793 records). [2025-10-01T22:37:07.472151] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-01T22:37:07.474872] [INFO ] [MAIN ] Derivative Progress: 319/1587 symbols completed. CACI took 1.2s. Estimated remaining: 8m 53s. Rate: 142.8 symbols/min [2025-10-01T22:37:07.477941] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:07.493296] [DEBUG] [MAIN ] CADE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:07.495367] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 48856 primary records. [2025-10-01T22:37:07.495807] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-01T22:37:07.499635] [DEBUG] [LOCAL ] CAF: Loaded 3394 existing records from primary storage. [2025-10-01T22:37:07.500188] [INFO ] [MAIN ] CAF: Loaded 3394 primary data records. [2025-10-01T22:37:07.629186] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-01T22:37:07.604513] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:07.640434] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39036 primary records. [2025-10-01T22:37:07.640537] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-01T22:37:07.640707] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-01T22:37:07.667242] [INFO ] [MAIN ] Derivative Progress: 320/1587 symbols completed. CADE took 1.4s. Estimated remaining: 8m 51s. Rate: 143.0 symbols/min [2025-10-01T22:37:07.686207] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:07.711509] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-01T22:37:07.716911] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-01T22:37:07.732106] [INFO ] [MAIN ] Derivative Progress: 321/1587 symbols completed. CAE took 1.4s. Estimated remaining: 8m 50s. Rate: 143.4 symbols/min [2025-10-01T22:37:07.774509] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:07.940622] [DEBUG] [MAIN ] CAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:07.954167] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3394 primary records. [2025-10-01T22:37:07.954323] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-01T22:37:07.969971] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-01T22:37:07.985553] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-01T22:37:07.988867] [INFO ] [MAIN ] Derivative Progress: 322/1587 symbols completed. CAF took 0.5s. Estimated remaining: 8m 49s. Rate: 143.6 symbols/min [2025-10-01T22:37:07.989306] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:08.003926] [DEBUG] [LOCAL ] CAG: Loaded 53663 existing records from primary storage. [2025-10-01T22:37:08.005334] [INFO ] [MAIN ] CAG: Loaded 53663 primary data records. [2025-10-01T22:37:08.006691] [DEBUG] [LOCAL ] CAH: Loaded 51417 existing records from primary storage. [2025-10-01T22:37:08.006907] [INFO ] [MAIN ] CAH: Loaded 51417 primary data records. [2025-10-01T22:37:08.687186] [DEBUG] [LOCAL ] CAL: Loaded 43156 existing records from primary storage. [2025-10-01T22:37:08.688554] [INFO ] [MAIN ] CAL: Loaded 43156 primary data records. [2025-10-01T22:37:09.172876] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:09.173596] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:09.175043] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51417 primary records. [2025-10-01T22:37:09.176077] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-01T22:37:09.175960] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53663 primary records. [2025-10-01T22:37:09.178851] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-01T22:37:09.232150] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-01T22:37:09.233354] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-01T22:37:09.236769] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-01T22:37:09.237004] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-01T22:37:09.240562] [INFO ] [MAIN ] Derivative Progress: 323/1587 symbols completed. CAH took 1.5s. Estimated remaining: 8m 51s. Rate: 142.7 symbols/min [2025-10-01T22:37:09.241986] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:09.246143] [INFO ] [MAIN ] Derivative Progress: 324/1587 symbols completed. CAG took 1.6s. Estimated remaining: 8m 49s. Rate: 143.1 symbols/min [2025-10-01T22:37:09.248865] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:09.263851] [DEBUG] [MAIN ] CAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:09.264711] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43156 primary records. [2025-10-01T22:37:09.264858] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-01T22:37:09.291760] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-01T22:37:09.291948] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-01T22:37:09.294859] [INFO ] [MAIN ] Derivative Progress: 325/1587 symbols completed. CAL took 1.3s. Estimated remaining: 8m 48s. Rate: 143.5 symbols/min [2025-10-01T22:37:09.295177] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:09.306051] [DEBUG] [LOCAL ] CANG: Loaded 26966 existing records from primary storage. [2025-10-01T22:37:09.319006] [INFO ] [MAIN ] CANG: Loaded 26966 primary data records. [2025-10-01T22:37:09.351604] [DEBUG] [LOCAL ] CAPL: Loaded 5747 existing records from primary storage. [2025-10-01T22:37:09.358771] [INFO ] [MAIN ] CAPL: Loaded 5747 primary data records. [2025-10-01T22:37:09.522369] [DEBUG] [LOCAL ] CALX: Loaded 37899 existing records from primary storage. [2025-10-01T22:37:09.581202] [INFO ] [MAIN ] CALX: Loaded 37899 primary data records. [2025-10-01T22:37:10.407700] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:10.422073] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:10.421575] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26966 primary records. [2025-10-01T22:37:10.423137] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5747 primary records. [2025-10-01T22:37:10.423221] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-01T22:37:10.423530] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-01T22:37:10.455171] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-01T22:37:10.457698] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-01T22:37:10.460088] [INFO ] [MAIN ] Derivative Progress: 326/1587 symbols completed. CANG took 1.2s. Estimated remaining: 8m 50s. Rate: 142.8 symbols/min [2025-10-01T22:37:10.475166] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-01T22:37:10.475544] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-01T22:37:10.476153] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:10.478480] [INFO ] [MAIN ] Derivative Progress: 327/1587 symbols completed. CAPL took 1.2s. Estimated remaining: 8m 48s. Rate: 143.2 symbols/min [2025-10-01T22:37:10.475715] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:10.478689] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:10.479955] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37899 primary records. [2025-10-01T22:37:10.480399] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-01T22:37:10.498242] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-01T22:37:10.498371] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-01T22:37:10.500832] [INFO ] [MAIN ] Derivative Progress: 328/1587 symbols completed. CALX took 1.3s. Estimated remaining: 8m 46s. Rate: 143.6 symbols/min [2025-10-01T22:37:10.541548] [DEBUG] [LOCAL ] CARS: Loaded 39803 existing records from primary storage. [2025-10-01T22:37:10.554590] [INFO ] [MAIN ] CARS: Loaded 39803 primary data records. [2025-10-01T22:37:10.706115] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-10-01T22:37:10.737935] [INFO ] [MAIN ] CARR: Loaded 53594 primary data records. [2025-10-01T22:37:11.309728] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:11.311082] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39803 primary records. [2025-10-01T22:37:11.311237] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-01T22:37:11.331373] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-01T22:37:11.331541] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-01T22:37:11.333808] [INFO ] [MAIN ] Derivative Progress: 329/1587 symbols completed. CARS took 0.9s. Estimated remaining: 8m 47s. Rate: 143.2 symbols/min [2025-10-01T22:37:11.351394] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:11.352061] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53594 primary records. [2025-10-01T22:37:11.352127] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-01T22:37:11.368884] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-01T22:37:11.369017] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-01T22:37:11.371715] [INFO ] [MAIN ] Derivative Progress: 330/1587 symbols completed. CARR took 0.9s. Estimated remaining: 8m 45s. Rate: 143.6 symbols/min [2025-10-01T22:37:11.372160] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:11.372417] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:11.372311] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:11.382526] [DEBUG] [LOCAL ] CATO: Loaded 7016 existing records from primary storage. [2025-10-01T22:37:11.382722] [INFO ] [MAIN ] CATO: Loaded 7016 primary data records. [2025-10-01T22:37:11.796112] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-10-01T22:37:11.795232] [DEBUG] [LOCAL ] CAT: Loaded 52920 existing records from primary storage. [2025-10-01T22:37:11.797738] [INFO ] [MAIN ] CAVA: Loaded 53552 primary data records. [2025-10-01T22:37:11.798344] [INFO ] [MAIN ] CAT: Loaded 52920 primary data records. [2025-10-01T22:37:12.490909] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:12.492636] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 7016 primary records. [2025-10-01T22:37:12.492882] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-01T22:37:12.511905] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-01T22:37:12.512269] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-01T22:37:12.515298] [INFO ] [MAIN ] Derivative Progress: 331/1587 symbols completed. CATO took 1.1s. Estimated remaining: 8m 48s. Rate: 142.8 symbols/min [2025-10-01T22:37:12.516557] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:12.554973] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:12.556182] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53552 primary records. [2025-10-01T22:37:12.556347] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-01T22:37:12.555434] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:12.557991] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52920 primary records. [2025-10-01T22:37:12.558117] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-01T22:37:12.591973] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-10-01T22:37:12.593015] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-01T22:37:12.595116] [INFO ] [MAIN ] Derivative Progress: 332/1587 symbols completed. CAVA took 1.2s. Estimated remaining: 8m 46s. Rate: 143.2 symbols/min [2025-10-01T22:37:12.595873] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:12.595777] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-01T22:37:12.596077] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-01T22:37:12.598806] [INFO ] [MAIN ] Derivative Progress: 333/1587 symbols completed. CAT took 1.2s. Estimated remaining: 8m 44s. Rate: 143.6 symbols/min [2025-10-01T22:37:12.610225] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:12.621810] [DEBUG] [LOCAL ] CBAN: Loaded 10857 existing records from primary storage. [2025-10-01T22:37:12.622074] [INFO ] [MAIN ] CBAN: Loaded 10857 primary data records. [2025-10-01T22:37:12.763677] [DEBUG] [LOCAL ] CBL: Loaded 16243 existing records from primary storage. [2025-10-01T22:37:12.763214] [DEBUG] [LOCAL ] CB: Loaded 49947 existing records from primary storage. [2025-10-01T22:37:12.769474] [INFO ] [MAIN ] CB: Loaded 49947 primary data records. [2025-10-01T22:37:12.774912] [INFO ] [MAIN ] CBL: Loaded 16243 primary data records. [2025-10-01T22:37:13.705545] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:13.706947] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10857 primary records. [2025-10-01T22:37:13.707323] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-01T22:37:13.728829] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-01T22:37:13.730434] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-01T22:37:13.740483] [INFO ] [MAIN ] Derivative Progress: 334/1587 symbols completed. CBAN took 1.1s. Estimated remaining: 8m 46s. Rate: 142.8 symbols/min [2025-10-01T22:37:13.748406] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:13.748029] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:13.749333] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16243 primary records. [2025-10-01T22:37:13.749424] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-01T22:37:13.777415] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:13.782014] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49947 primary records. [2025-10-01T22:37:13.782849] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-01T22:37:13.796196] [DEBUG] [LOCAL ] CBNA: Loaded 2915 existing records from primary storage. [2025-10-01T22:37:13.796594] [INFO ] [MAIN ] CBNA: Loaded 2915 primary data records. [2025-10-01T22:37:13.874839] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-01T22:37:13.889018] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-01T22:37:13.909283] [INFO ] [MAIN ] Derivative Progress: 335/1587 symbols completed. CBL took 1.3s. Estimated remaining: 8m 45s. Rate: 143.1 symbols/min [2025-10-01T22:37:13.921978] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-01T22:37:13.922099] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-01T22:37:13.922191] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:13.930130] [INFO ] [MAIN ] Derivative Progress: 336/1587 symbols completed. CB took 1.4s. Estimated remaining: 8m 43s. Rate: 143.5 symbols/min [2025-10-01T22:37:13.935397] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:14.160679] [DEBUG] [LOCAL ] CBT: Loaded 30845 existing records from primary storage. [2025-10-01T22:37:14.174008] [INFO ] [MAIN ] CBT: Loaded 30845 primary data records. [2025-10-01T22:37:14.315135] [DEBUG] [LOCAL ] CBRE: Loaded 50580 existing records from primary storage. [2025-10-01T22:37:14.320963] [INFO ] [MAIN ] CBRE: Loaded 50580 primary data records. [2025-10-01T22:37:14.372807] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:14.493302] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2915 primary records. [2025-10-01T22:37:14.676738] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-01T22:37:14.916396] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-01T22:37:14.916973] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-01T22:37:14.919258] [INFO ] [MAIN ] Derivative Progress: 337/1587 symbols completed. CBNA took 1.2s. Estimated remaining: 8m 45s. Rate: 142.9 symbols/min [2025-10-01T22:37:14.920193] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:14.964832] [DEBUG] [LOCAL ] CBU: Loaded 22654 existing records from primary storage. [2025-10-01T22:37:14.965238] [INFO ] [MAIN ] CBU: Loaded 22654 primary data records. [2025-10-01T22:37:14.963962] [DEBUG] [MAIN ] CBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:14.966437] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30845 primary records. [2025-10-01T22:37:14.966685] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-01T22:37:15.095495] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-01T22:37:15.102490] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-01T22:37:15.110427] [INFO ] [MAIN ] Derivative Progress: 338/1587 symbols completed. CBT took 1.2s. Estimated remaining: 8m 43s. Rate: 143.2 symbols/min [2025-10-01T22:37:15.121082] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:15.315818] [DEBUG] [MAIN ] CBRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:15.326708] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50580 primary records. [2025-10-01T22:37:15.327614] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-01T22:37:15.348725] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-01T22:37:15.349558] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-01T22:37:15.361716] [INFO ] [MAIN ] Derivative Progress: 339/1587 symbols completed. CBRE took 1.4s. Estimated remaining: 8m 42s. Rate: 143.3 symbols/min [2025-10-01T22:37:15.362264] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:15.380080] [DEBUG] [LOCAL ] CBZ: Loaded 33691 existing records from primary storage. [2025-10-01T22:37:15.380384] [INFO ] [MAIN ] CBZ: Loaded 33691 primary data records. [2025-10-01T22:37:15.619019] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:15.800167] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22654 primary records. [2025-10-01T22:37:15.809738] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-01T22:37:15.812892] [DEBUG] [LOCAL ] CC: Loaded 53000 existing records from primary storage. [2025-10-01T22:37:15.813087] [INFO ] [MAIN ] CC: Loaded 53000 primary data records. [2025-10-01T22:37:15.967581] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-01T22:37:15.973085] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-01T22:37:15.992301] [INFO ] [MAIN ] Derivative Progress: 340/1587 symbols completed. CBU took 1.1s. Estimated remaining: 8m 43s. Rate: 143.1 symbols/min [2025-10-01T22:37:16.010571] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:16.174980] [DEBUG] [MAIN ] CBZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:16.177226] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33691 primary records. [2025-10-01T22:37:16.177441] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-01T22:37:16.197843] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-01T22:37:16.198370] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-01T22:37:16.219729] [INFO ] [MAIN ] Derivative Progress: 341/1587 symbols completed. CBZ took 1.1s. Estimated remaining: 8m 42s. Rate: 143.3 symbols/min [2025-10-01T22:37:16.220520] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:16.256449] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:16.260968] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53000 primary records. [2025-10-01T22:37:16.261153] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-01T22:37:16.263673] [DEBUG] [LOCAL ] CCI: Loaded 53139 existing records from primary storage. [2025-10-01T22:37:16.272219] [INFO ] [MAIN ] CCI: Loaded 53139 primary data records. [2025-10-01T22:37:16.325129] [DEBUG] [LOCAL ] CCIF: Loaded 15750 existing records from primary storage. [2025-10-01T22:37:16.332887] [INFO ] [MAIN ] CCIF: Loaded 15750 primary data records. [2025-10-01T22:37:16.339985] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-01T22:37:16.370835] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-01T22:37:16.440287] [INFO ] [MAIN ] Derivative Progress: 342/1587 symbols completed. CC took 1.1s. Estimated remaining: 8m 41s. Rate: 143.5 symbols/min [2025-10-01T22:37:16.445971] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:16.987137] [DEBUG] [LOCAL ] CCJ: Loaded 53674 existing records from primary storage. [2025-10-01T22:37:16.987804] [INFO ] [MAIN ] CCJ: Loaded 53674 primary data records. [2025-10-01T22:37:17.154573] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:17.167889] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53139 primary records. [2025-10-01T22:37:17.168245] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-01T22:37:17.383367] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:17.386360] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15750 primary records. [2025-10-01T22:37:17.387295] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-01T22:37:17.391061] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-01T22:37:17.404144] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-01T22:37:17.407324] [INFO ] [MAIN ] Derivative Progress: 343/1587 symbols completed. CCI took 1.4s. Estimated remaining: 8m 42s. Rate: 143.0 symbols/min [2025-10-01T22:37:17.416040] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-01T22:37:17.416190] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-01T22:37:17.420714] [INFO ] [MAIN ] Derivative Progress: 344/1587 symbols completed. CCIF took 1.2s. Estimated remaining: 8m 40s. Rate: 143.4 symbols/min [2025-10-01T22:37:17.449468] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:17.450281] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53674 primary records. [2025-10-01T22:37:17.450347] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-01T22:37:17.467339] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-01T22:37:17.467519] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-01T22:37:17.470233] [INFO ] [MAIN ] Derivative Progress: 345/1587 symbols completed. CCJ took 1.0s. Estimated remaining: 8m 38s. Rate: 143.7 symbols/min [2025-10-01T22:37:17.470897] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:17.471002] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:17.471334] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:17.557000] [DEBUG] [LOCAL ] CCO: Loaded 47896 existing records from primary storage. [2025-10-01T22:37:17.573340] [INFO ] [MAIN ] CCO: Loaded 47896 primary data records. [2025-10-01T22:37:17.603815] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-01T22:37:17.611241] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-01T22:37:17.661189] [DEBUG] [LOCAL ] CCK: Loaded 46232 existing records from primary storage. [2025-10-01T22:37:17.722944] [INFO ] [MAIN ] CCK: Loaded 46232 primary data records. [2025-10-01T22:37:18.717607] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:18.718224] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:18.719697] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-01T22:37:18.720838] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47896 primary records. [2025-10-01T22:37:18.734416] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-01T22:37:18.734341] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-01T22:37:18.746791] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:18.758290] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46232 primary records. [2025-10-01T22:37:18.764400] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-01T22:37:18.764516] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-01T22:37:18.764586] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-01T22:37:18.770835] [INFO ] [MAIN ] Derivative Progress: 346/1587 symbols completed. CCL took 1.3s. Estimated remaining: 8m 41s. Rate: 142.8 symbols/min [2025-10-01T22:37:18.771321] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:18.794907] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-01T22:37:18.795866] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-01T22:37:18.800095] [INFO ] [MAIN ] Derivative Progress: 347/1587 symbols completed. CCO took 1.3s. Estimated remaining: 8m 39s. Rate: 143.2 symbols/min [2025-10-01T22:37:18.800618] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:18.806708] [DEBUG] [LOCAL ] CCRD: Loaded 9107 existing records from primary storage. [2025-10-01T22:37:18.808627] [INFO ] [MAIN ] CCRD: Loaded 9107 primary data records. [2025-10-01T22:37:18.850305] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-01T22:37:18.885584] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-01T22:37:18.902320] [INFO ] [MAIN ] Derivative Progress: 348/1587 symbols completed. CCK took 1.4s. Estimated remaining: 8m 38s. Rate: 143.5 symbols/min [2025-10-01T22:37:18.902847] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:19.154433] [DEBUG] [LOCAL ] CCS: Loaded 30499 existing records from primary storage. [2025-10-01T22:37:19.178360] [INFO ] [MAIN ] CCS: Loaded 30499 primary data records. [2025-10-01T22:37:19.184786] [DEBUG] [LOCAL ] CCU: Loaded 23246 existing records from primary storage. [2025-10-01T22:37:19.202724] [INFO ] [MAIN ] CCU: Loaded 23246 primary data records. [2025-10-01T22:37:19.976436] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:19.977786] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9107 primary records. [2025-10-01T22:37:19.978255] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-01T22:37:19.995858] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-10-01T22:37:19.996375] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-01T22:37:19.998361] [INFO ] [MAIN ] Derivative Progress: 349/1587 symbols completed. CCRD took 1.2s. Estimated remaining: 8m 40s. Rate: 142.9 symbols/min [2025-10-01T22:37:19.998695] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:20.029270] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:20.035282] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 23246 primary records. [2025-10-01T22:37:20.035739] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-01T22:37:20.035638] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:20.037063] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30499 primary records. [2025-10-01T22:37:20.037237] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-01T22:37:20.072146] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-01T22:37:20.087233] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-01T22:37:20.091526] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-01T22:37:20.091389] [INFO ] [MAIN ] Derivative Progress: 350/1587 symbols completed. CCS took 1.3s. Estimated remaining: 8m 38s. Rate: 143.2 symbols/min [2025-10-01T22:37:20.091919] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-01T22:37:20.094367] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:20.094588] [INFO ] [MAIN ] Derivative Progress: 351/1587 symbols completed. CCU took 1.2s. Estimated remaining: 8m 36s. Rate: 143.6 symbols/min [2025-10-01T22:37:20.094976] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:20.121388] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-01T22:37:20.126606] [INFO ] [MAIN ] CDE: Loaded 53642 primary data records. [2025-10-01T22:37:20.126505] [DEBUG] [LOCAL ] CDLR: Loaded 9854 existing records from primary storage. [2025-10-01T22:37:20.144836] [INFO ] [MAIN ] CDLR: Loaded 9854 primary data records. [2025-10-01T22:37:20.728278] [DEBUG] [LOCAL ] CDP: Loaded 42586 existing records from primary storage. [2025-10-01T22:37:20.849764] [INFO ] [MAIN ] CDP: Loaded 42586 primary data records. [2025-10-01T22:37:21.211256] [DEBUG] [MAIN ] CDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:21.226347] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53642 primary records. [2025-10-01T22:37:21.225345] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:21.226927] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-01T22:37:21.227912] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9854 primary records. [2025-10-01T22:37:21.228896] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-01T22:37:21.261523] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-01T22:37:21.264908] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-01T22:37:21.267149] [INFO ] [MAIN ] Derivative Progress: 352/1587 symbols completed. CDLR took 1.2s. Estimated remaining: 8m 39s. Rate: 142.9 symbols/min [2025-10-01T22:37:21.267350] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:21.264800] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-01T22:37:21.267562] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-01T22:37:21.269767] [INFO ] [MAIN ] Derivative Progress: 353/1587 symbols completed. CDE took 1.3s. Estimated remaining: 8m 37s. Rate: 143.3 symbols/min [2025-10-01T22:37:21.270673] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:21.289231] [DEBUG] [MAIN ] CDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:21.297879] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42586 primary records. [2025-10-01T22:37:21.298074] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-01T22:37:21.315594] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-01T22:37:21.323745] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-01T22:37:21.326993] [INFO ] [MAIN ] Derivative Progress: 354/1587 symbols completed. CDP took 1.2s. Estimated remaining: 8m 35s. Rate: 143.6 symbols/min [2025-10-01T22:37:21.324261] [DEBUG] [LOCAL ] CDRE: Loaded 24990 existing records from primary storage. [2025-10-01T22:37:21.327572] [INFO ] [MAIN ] CDRE: Loaded 24990 primary data records. [2025-10-01T22:37:21.327324] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:21.466297] [DEBUG] [LOCAL ] CEE: Loaded 5946 existing records from primary storage. [2025-10-01T22:37:21.470988] [INFO ] [MAIN ] CEE: Loaded 5946 primary data records. [2025-10-01T22:37:21.636975] [DEBUG] [LOCAL ] CE: Loaded 51501 existing records from primary storage. [2025-10-01T22:37:21.812777] [INFO ] [MAIN ] CE: Loaded 51501 primary data records. [2025-10-01T22:37:22.463359] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:22.465685] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24990 primary records. [2025-10-01T22:37:22.466067] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-01T22:37:22.491147] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-01T22:37:22.491556] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-01T22:37:22.493835] [INFO ] [MAIN ] Derivative Progress: 355/1587 symbols completed. CDRE took 1.2s. Estimated remaining: 8m 37s. Rate: 142.9 symbols/min [2025-10-01T22:37:22.494274] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:22.515940] [DEBUG] [MAIN ] CEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:22.517498] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5946 primary records. [2025-10-01T22:37:22.517856] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-01T22:37:22.544261] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-01T22:37:22.554558] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-01T22:37:22.558708] [INFO ] [MAIN ] Derivative Progress: 356/1587 symbols completed. CEE took 1.2s. Estimated remaining: 8m 36s. Rate: 143.2 symbols/min [2025-10-01T22:37:22.574727] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:22.576007] [DEBUG] [MAIN ] CE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:22.577450] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51501 primary records. [2025-10-01T22:37:22.577725] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-01T22:37:22.611150] [DEBUG] [LOCAL ] CEPU: Loaded 25885 existing records from primary storage. [2025-10-01T22:37:22.611539] [INFO ] [MAIN ] CEPU: Loaded 25885 primary data records. [2025-10-01T22:37:22.613414] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-01T22:37:22.618786] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-01T22:37:22.636887] [INFO ] [MAIN ] Derivative Progress: 357/1587 symbols completed. CE took 1.4s. Estimated remaining: 8m 34s. Rate: 143.6 symbols/min [2025-10-01T22:37:22.668753] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:22.929410] [DEBUG] [LOCAL ] CF: Loaded 52176 existing records from primary storage. [2025-10-01T22:37:22.929702] [INFO ] [MAIN ] CF: Loaded 52176 primary data records. [2025-10-01T22:37:23.350925] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-01T22:37:23.367465] [INFO ] [MAIN ] CFG: Loaded 53624 primary data records. [2025-10-01T22:37:23.993075] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:23.994478] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25885 primary records. [2025-10-01T22:37:23.994938] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-01T22:37:24.017764] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-01T22:37:24.019158] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-01T22:37:24.024225] [INFO ] [MAIN ] Derivative Progress: 358/1587 symbols completed. CEPU took 1.5s. Estimated remaining: 8m 37s. Rate: 142.6 symbols/min [2025-10-01T22:37:24.039264] [DEBUG] [MAIN ] CF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:24.040083] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52176 primary records. [2025-10-01T22:37:24.040162] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-01T22:37:24.059321] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-01T22:37:24.061268] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-01T22:37:24.063936] [INFO ] [MAIN ] Derivative Progress: 359/1587 symbols completed. CF took 1.5s. Estimated remaining: 8m 35s. Rate: 143.0 symbols/min [2025-10-01T22:37:24.076956] [DEBUG] [MAIN ] CFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:24.077623] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53624 primary records. [2025-10-01T22:37:24.077712] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-01T22:37:24.093629] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-01T22:37:24.093742] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-01T22:37:24.096516] [INFO ] [MAIN ] Derivative Progress: 360/1587 symbols completed. CFG took 1.4s. Estimated remaining: 8m 33s. Rate: 143.4 symbols/min [2025-10-01T22:37:24.097323] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:24.097252] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:24.097164] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:24.101909] [DEBUG] [LOCAL ] CGV: Loaded 1400 existing records from primary storage. [2025-10-01T22:37:24.102089] [INFO ] [MAIN ] CGV: Loaded 1400 primary data records. [2025-10-01T22:37:24.479278] [DEBUG] [LOCAL ] CFR: Loaded 33188 existing records from primary storage. [2025-10-01T22:37:24.480880] [DEBUG] [LOCAL ] CGAU: Loaded 42721 existing records from primary storage. [2025-10-01T22:37:24.481330] [INFO ] [MAIN ] CGAU: Loaded 42721 primary data records. [2025-10-01T22:37:24.481242] [INFO ] [MAIN ] CFR: Loaded 33188 primary data records. [2025-10-01T22:37:25.234668] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:37:25.237087] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1400 primary records. [2025-10-01T22:37:25.237539] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-01T22:37:25.254133] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-01T22:37:25.254487] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-01T22:37:25.258531] [INFO ] [MAIN ] Derivative Progress: 361/1587 symbols completed. CGV took 1.2s. Estimated remaining: 8m 36s. Rate: 142.7 symbols/min [2025-10-01T22:37:25.259546] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:25.285945] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:25.295042] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42721 primary records. [2025-10-01T22:37:25.300264] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-01T22:37:25.300494] [DEBUG] [MAIN ] CFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:25.302121] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33188 primary records. [2025-10-01T22:37:25.302666] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-01T22:37:25.336990] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-01T22:37:25.336756] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-10-01T22:37:25.337180] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-01T22:37:25.339475] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-01T22:37:25.339360] [INFO ] [MAIN ] Derivative Progress: 362/1587 symbols completed. CGAU took 1.2s. Estimated remaining: 8m 34s. Rate: 143.0 symbols/min [2025-10-01T22:37:25.342744] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:25.342834] [INFO ] [MAIN ] Derivative Progress: 363/1587 symbols completed. CFR took 1.2s. Estimated remaining: 8m 32s. Rate: 143.4 symbols/min [2025-10-01T22:37:25.343453] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:25.377910] [DEBUG] [LOCAL ] CHE: Loaded 15044 existing records from primary storage. [2025-10-01T22:37:25.378143] [INFO ] [MAIN ] CHE: Loaded 15044 primary data records. [2025-10-01T22:37:25.496123] [DEBUG] [LOCAL ] CHD: Loaded 52113 existing records from primary storage. [2025-10-01T22:37:25.520034] [INFO ] [MAIN ] CHD: Loaded 52113 primary data records. [2025-10-01T22:37:25.901866] [DEBUG] [LOCAL ] CHGG: Loaded 47653 existing records from primary storage. [2025-10-01T22:37:25.908239] [INFO ] [MAIN ] CHGG: Loaded 47653 primary data records. [2025-10-01T22:37:26.497046] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:26.499713] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15044 primary records. [2025-10-01T22:37:26.500234] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-01T22:37:26.544181] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-01T22:37:26.545152] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-01T22:37:26.544931] [DEBUG] [MAIN ] CHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:26.547712] [INFO ] [MAIN ] Derivative Progress: 364/1587 symbols completed. CHE took 1.2s. Estimated remaining: 8m 34s. Rate: 142.6 symbols/min [2025-10-01T22:37:26.548915] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52113 primary records. [2025-10-01T22:37:26.549088] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:26.549287] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-01T22:37:26.570192] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-01T22:37:26.570735] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-01T22:37:26.573264] [INFO ] [MAIN ] Derivative Progress: 365/1587 symbols completed. CHD took 1.3s. Estimated remaining: 8m 33s. Rate: 143.0 symbols/min [2025-10-01T22:37:26.573506] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:26.589809] [DEBUG] [MAIN ] CHGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:26.590633] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47653 primary records. [2025-10-01T22:37:26.590886] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-01T22:37:26.622384] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-01T22:37:26.629684] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-01T22:37:26.632963] [INFO ] [MAIN ] Derivative Progress: 366/1587 symbols completed. CHGG took 1.3s. Estimated remaining: 8m 31s. Rate: 143.4 symbols/min [2025-10-01T22:37:26.633306] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:26.630066] [DEBUG] [LOCAL ] CHMI: Loaded 21894 existing records from primary storage. [2025-10-01T22:37:26.634105] [INFO ] [MAIN ] CHMI: Loaded 21894 primary data records. [2025-10-01T22:37:26.699082] [DEBUG] [LOCAL ] CHH: Loaded 32022 existing records from primary storage. [2025-10-01T22:37:26.727020] [INFO ] [MAIN ] CHH: Loaded 32022 primary data records. [2025-10-01T22:37:26.843869] [DEBUG] [LOCAL ] CHN: Loaded 4818 existing records from primary storage. [2025-10-01T22:37:26.874143] [INFO ] [MAIN ] CHN: Loaded 4818 primary data records. [2025-10-01T22:37:27.752472] [DEBUG] [MAIN ] CHMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:27.754071] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21894 primary records. [2025-10-01T22:37:27.754318] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-01T22:37:27.752901] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:27.756061] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32022 primary records. [2025-10-01T22:37:27.756366] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-01T22:37:27.787330] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-01T22:37:27.788502] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-01T22:37:27.790888] [INFO ] [MAIN ] Derivative Progress: 367/1587 symbols completed. CHMI took 1.2s. Estimated remaining: 8m 33s. Rate: 142.7 symbols/min [2025-10-01T22:37:27.806725] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:27.807067] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-01T22:37:27.807784] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-01T22:37:27.808125] [DEBUG] [MAIN ] CHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:27.809163] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4818 primary records. [2025-10-01T22:37:27.812503] [INFO ] [MAIN ] Derivative Progress: 368/1587 symbols completed. CHH took 1.3s. Estimated remaining: 8m 31s. Rate: 143.0 symbols/min [2025-10-01T22:37:27.809357] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-01T22:37:27.812913] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:27.829926] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-10-01T22:37:27.830122] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-01T22:37:27.838322] [INFO ] [MAIN ] Derivative Progress: 369/1587 symbols completed. CHN took 1.2s. Estimated remaining: 8m 30s. Rate: 143.4 symbols/min [2025-10-01T22:37:27.841177] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:27.847790] [DEBUG] [LOCAL ] CIA: Loaded 17039 existing records from primary storage. [2025-10-01T22:37:27.848182] [INFO ] [MAIN ] CIA: Loaded 17039 primary data records. [2025-10-01T22:37:28.003906] [DEBUG] [LOCAL ] CHPT: Loaded 48646 existing records from primary storage. [2025-10-01T22:37:28.019670] [INFO ] [MAIN ] CHPT: Loaded 48646 primary data records. [2025-10-01T22:37:28.413595] [DEBUG] [LOCAL ] CIEN: Loaded 52071 existing records from primary storage. [2025-10-01T22:37:28.545113] [INFO ] [MAIN ] CIEN: Loaded 52071 primary data records. [2025-10-01T22:37:28.907639] [DEBUG] [MAIN ] CIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:28.908759] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 17039 primary records. [2025-10-01T22:37:28.909044] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-01T22:37:28.942681] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-10-01T22:37:28.943700] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-01T22:37:28.943525] [DEBUG] [MAIN ] CHPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:28.946082] [INFO ] [MAIN ] Derivative Progress: 370/1587 symbols completed. CIA took 1.1s. Estimated remaining: 8m 31s. Rate: 142.8 symbols/min [2025-10-01T22:37:28.946960] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 48646 primary records. [2025-10-01T22:37:28.947376] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-01T22:37:28.947302] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:28.967799] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-10-01T22:37:28.971216] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-01T22:37:28.970910] [DEBUG] [LOCAL ] CIF: Loaded 4204 existing records from primary storage. [2025-10-01T22:37:28.971342] [INFO ] [MAIN ] CIF: Loaded 4204 primary data records. [2025-10-01T22:37:28.973622] [INFO ] [MAIN ] Derivative Progress: 371/1587 symbols completed. CHPT took 1.2s. Estimated remaining: 8m 30s. Rate: 143.1 symbols/min [2025-10-01T22:37:28.985740] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:29.092599] [DEBUG] [MAIN ] CIEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:29.106802] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52071 primary records. [2025-10-01T22:37:29.106931] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-01T22:37:29.404338] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-10-01T22:37:29.418001] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-01T22:37:29.423623] [DEBUG] [LOCAL ] CIG: Loaded 43824 existing records from primary storage. [2025-10-01T22:37:29.422543] [INFO ] [MAIN ] Derivative Progress: 372/1587 symbols completed. CIEN took 1.6s. Estimated remaining: 8m 29s. Rate: 143.1 symbols/min [2025-10-01T22:37:29.424681] [INFO ] [MAIN ] CIG: Loaded 43824 primary data records. [2025-10-01T22:37:29.424425] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:29.570519] [DEBUG] [LOCAL ] CII: Loaded 15206 existing records from primary storage. [2025-10-01T22:37:29.581031] [INFO ] [MAIN ] CII: Loaded 15206 primary data records. [2025-10-01T22:37:29.944968] [DEBUG] [MAIN ] CIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:30.026951] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4204 primary records. [2025-10-01T22:37:30.163339] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-01T22:37:30.183632] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-01T22:37:30.184590] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-01T22:37:30.187278] [INFO ] [MAIN ] Derivative Progress: 373/1587 symbols completed. CIF took 1.2s. Estimated remaining: 8m 30s. Rate: 142.8 symbols/min [2025-10-01T22:37:30.207266] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:30.208281] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43824 primary records. [2025-10-01T22:37:30.208542] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-01T22:37:30.229935] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-01T22:37:30.230202] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-01T22:37:30.232840] [INFO ] [MAIN ] Derivative Progress: 374/1587 symbols completed. CIG took 1.2s. Estimated remaining: 8m 29s. Rate: 143.1 symbols/min [2025-10-01T22:37:30.246269] [DEBUG] [MAIN ] CII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:30.246955] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15206 primary records. [2025-10-01T22:37:30.247019] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-01T22:37:30.262637] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-01T22:37:30.262781] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-01T22:37:30.266013] [INFO ] [MAIN ] Derivative Progress: 375/1587 symbols completed. CII took 0.8s. Estimated remaining: 8m 27s. Rate: 143.5 symbols/min [2025-10-01T22:37:30.266630] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:30.266741] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:30.266523] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:30.273970] [DEBUG] [LOCAL ] CIMN: Loaded 2682 existing records from primary storage. [2025-10-01T22:37:30.274195] [INFO ] [MAIN ] CIMN: Loaded 2682 primary data records. [2025-10-01T22:37:30.407013] [DEBUG] [LOCAL ] CIO: Loaded 20291 existing records from primary storage. [2025-10-01T22:37:30.418051] [INFO ] [MAIN ] CIO: Loaded 20291 primary data records. [2025-10-01T22:37:30.761045] [DEBUG] [LOCAL ] CIVI: Loaded 52597 existing records from primary storage. [2025-10-01T22:37:30.772238] [INFO ] [MAIN ] CIVI: Loaded 52597 primary data records. [2025-10-01T22:37:31.385691] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-01T22:37:31.387285] [INFO ] [MAIN ] CIMN: Generated 1792 derivative records from 2682 primary records. [2025-10-01T22:37:31.387703] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-01T22:37:31.407809] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1792 records). [2025-10-01T22:37:31.408351] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-01T22:37:31.410856] [INFO ] [MAIN ] Derivative Progress: 376/1587 symbols completed. CIMN took 1.1s. Estimated remaining: 8m 29s. Rate: 142.8 symbols/min [2025-10-01T22:37:31.411177] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:31.425426] [DEBUG] [MAIN ] CIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:31.426275] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20291 primary records. [2025-10-01T22:37:31.426526] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-01T22:37:31.465671] [DEBUG] [LOCAL ] CLCO: Loaded 12678 existing records from primary storage. [2025-10-01T22:37:31.466048] [INFO ] [MAIN ] CLCO: Loaded 12678 primary data records. [2025-10-01T22:37:31.465346] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:31.478952] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52597 primary records. [2025-10-01T22:37:31.489562] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-01T22:37:31.530805] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-01T22:37:31.554917] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-01T22:37:31.562998] [INFO ] [MAIN ] Derivative Progress: 377/1587 symbols completed. CIO took 1.3s. Estimated remaining: 8m 27s. Rate: 143.1 symbols/min [2025-10-01T22:37:31.570597] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:31.604503] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-01T22:37:31.615885] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-01T22:37:31.649394] [INFO ] [MAIN ] Derivative Progress: 378/1587 symbols completed. CIVI took 1.4s. Estimated remaining: 8m 26s. Rate: 143.4 symbols/min [2025-10-01T22:37:31.689475] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:31.863746] [DEBUG] [MAIN ] CLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:31.890243] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12678 primary records. [2025-10-01T22:37:31.892164] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-01T22:37:31.892442] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-01T22:37:31.890829] [DEBUG] [LOCAL ] CLH: Loaded 27798 existing records from primary storage. [2025-10-01T22:37:31.892373] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-01T22:37:31.905777] [INFO ] [MAIN ] CLH: Loaded 27798 primary data records. [2025-10-01T22:37:32.262329] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-10-01T22:37:32.378927] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-01T22:37:32.421515] [INFO ] [MAIN ] Derivative Progress: 379/1587 symbols completed. CLCO took 1.0s. Estimated remaining: 8m 27s. Rate: 143.0 symbols/min [2025-10-01T22:37:32.431785] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:32.610200] [DEBUG] [MAIN ] CLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:32.611264] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-10-01T22:37:32.611596] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-01T22:37:32.659295] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-01T22:37:32.659974] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:32.659636] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-01T22:37:32.660839] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27798 primary records. [2025-10-01T22:37:32.661077] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-01T22:37:32.664751] [INFO ] [MAIN ] Derivative Progress: 380/1587 symbols completed. CLF took 1.1s. Estimated remaining: 8m 26s. Rate: 143.2 symbols/min [2025-10-01T22:37:32.665010] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:32.694174] [DEBUG] [LOCAL ] CLS: Loaded 53619 existing records from primary storage. [2025-10-01T22:37:32.694606] [INFO ] [MAIN ] CLS: Loaded 53619 primary data records. [2025-10-01T22:37:32.751787] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-01T22:37:32.768330] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-01T22:37:32.787233] [INFO ] [MAIN ] Derivative Progress: 381/1587 symbols completed. CLH took 1.1s. Estimated remaining: 8m 24s. Rate: 143.5 symbols/min [2025-10-01T22:37:32.799797] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:33.091809] [DEBUG] [LOCAL ] CLVT: Loaded 51961 existing records from primary storage. [2025-10-01T22:37:33.099700] [INFO ] [MAIN ] CLVT: Loaded 51961 primary data records. [2025-10-01T22:37:33.100396] [DEBUG] [LOCAL ] CLW: Loaded 21778 existing records from primary storage. [2025-10-01T22:37:33.106566] [INFO ] [MAIN ] CLW: Loaded 21778 primary data records. [2025-10-01T22:37:33.821973] [DEBUG] [MAIN ] CLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:33.823876] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53619 primary records. [2025-10-01T22:37:33.824127] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-01T22:37:33.842402] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-01T22:37:33.842816] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-01T22:37:33.845458] [INFO ] [MAIN ] Derivative Progress: 382/1587 symbols completed. CLS took 1.4s. Estimated remaining: 8m 26s. Rate: 142.9 symbols/min [2025-10-01T22:37:33.845774] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:33.863585] [DEBUG] [MAIN ] CLVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:33.864448] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51961 primary records. [2025-10-01T22:37:33.864623] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-01T22:37:33.892343] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:33.897589] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21778 primary records. [2025-10-01T22:37:33.897791] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-01T22:37:33.896595] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-01T22:37:33.898332] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-01T22:37:33.900549] [INFO ] [MAIN ] Derivative Progress: 383/1587 symbols completed. CLVT took 1.2s. Estimated remaining: 8m 24s. Rate: 143.2 symbols/min [2025-10-01T22:37:33.901265] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:33.932130] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-01T22:37:33.932267] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-01T22:37:33.934775] [INFO ] [MAIN ] Derivative Progress: 384/1587 symbols completed. CLW took 1.1s. Estimated remaining: 8m 23s. Rate: 143.6 symbols/min [2025-10-01T22:37:33.935076] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:33.957108] [DEBUG] [LOCAL ] CLX: Loaded 51491 existing records from primary storage. [2025-10-01T22:37:33.957428] [INFO ] [MAIN ] CLX: Loaded 51491 primary data records. [2025-10-01T22:37:34.200962] [DEBUG] [LOCAL ] CM: Loaded 48556 existing records from primary storage. [2025-10-01T22:37:34.221218] [INFO ] [MAIN ] CM: Loaded 48556 primary data records. [2025-10-01T22:37:34.365313] [DEBUG] [LOCAL ] CMA: Loaded 49871 existing records from primary storage. [2025-10-01T22:37:34.410506] [INFO ] [MAIN ] CMA: Loaded 49871 primary data records. [2025-10-01T22:37:35.039136] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:35.040036] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51491 primary records. [2025-10-01T22:37:35.040345] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-01T22:37:35.063044] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-01T22:37:35.063325] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-01T22:37:35.065616] [INFO ] [MAIN ] Derivative Progress: 385/1587 symbols completed. CLX took 1.2s. Estimated remaining: 8m 25s. Rate: 142.9 symbols/min [2025-10-01T22:37:35.073372] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:35.079069] [DEBUG] [MAIN ] CM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:35.080137] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48556 primary records. [2025-10-01T22:37:35.080311] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-01T22:37:35.099779] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-01T22:37:35.108043] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-01T22:37:35.115254] [INFO ] [MAIN ] Derivative Progress: 386/1587 symbols completed. CM took 1.2s. Estimated remaining: 8m 23s. Rate: 143.3 symbols/min [2025-10-01T22:37:35.122476] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:35.115622] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:35.123760] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 49871 primary records. [2025-10-01T22:37:35.123994] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-01T22:37:35.153244] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-01T22:37:35.153390] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-01T22:37:35.155845] [INFO ] [MAIN ] Derivative Progress: 387/1587 symbols completed. CMA took 1.2s. Estimated remaining: 8m 21s. Rate: 143.6 symbols/min [2025-10-01T22:37:35.151999] [DEBUG] [LOCAL ] CMBT: Loaded 23471 existing records from primary storage. [2025-10-01T22:37:35.156142] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:35.156229] [INFO ] [MAIN ] CMBT: Loaded 23471 primary data records. [2025-10-01T22:37:35.227013] [DEBUG] [LOCAL ] CMCM: Loaded 4726 existing records from primary storage. [2025-10-01T22:37:35.257271] [INFO ] [MAIN ] CMCM: Loaded 4726 primary data records. [2025-10-01T22:37:35.640190] [DEBUG] [LOCAL ] CMC: Loaded 45589 existing records from primary storage. [2025-10-01T22:37:35.695133] [INFO ] [MAIN ] CMC: Loaded 45589 primary data records. [2025-10-01T22:37:36.247854] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:36.249685] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 23471 primary records. [2025-10-01T22:37:36.249836] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-01T22:37:36.265585] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:36.274551] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4726 primary records. [2025-10-01T22:37:36.276288] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-01T22:37:36.296285] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-01T22:37:36.297236] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-01T22:37:36.299913] [INFO ] [MAIN ] Derivative Progress: 388/1587 symbols completed. CMBT took 1.2s. Estimated remaining: 8m 23s. Rate: 142.9 symbols/min [2025-10-01T22:37:36.306163] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-01T22:37:36.306267] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-01T22:37:36.308562] [INFO ] [MAIN ] Derivative Progress: 389/1587 symbols completed. CMCM took 1.2s. Estimated remaining: 8m 22s. Rate: 143.3 symbols/min [2025-10-01T22:37:36.321426] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:36.322122] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45589 primary records. [2025-10-01T22:37:36.322189] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-01T22:37:36.337620] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-01T22:37:36.337717] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-01T22:37:36.340437] [INFO ] [MAIN ] Derivative Progress: 390/1587 symbols completed. CMC took 1.2s. Estimated remaining: 8m 20s. Rate: 143.6 symbols/min [2025-10-01T22:37:36.341022] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:36.340937] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:36.341853] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:36.413378] [DEBUG] [LOCAL ] CMP: Loaded 36257 existing records from primary storage. [2025-10-01T22:37:36.414847] [INFO ] [MAIN ] CMP: Loaded 36257 primary data records. [2025-10-01T22:37:36.414722] [DEBUG] [LOCAL ] CMI: Loaded 41704 existing records from primary storage. [2025-10-01T22:37:36.427015] [INFO ] [MAIN ] CMI: Loaded 41704 primary data records. [2025-10-01T22:37:36.615660] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-01T22:37:36.655432] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-10-01T22:37:37.500169] [DEBUG] [MAIN ] CMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:37.502853] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36257 primary records. [2025-10-01T22:37:37.503240] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-01T22:37:37.528800] [DEBUG] [MAIN ] CMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:37.533301] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41704 primary records. [2025-10-01T22:37:37.534104] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-01T22:37:37.538311] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-01T22:37:37.538706] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-01T22:37:37.565804] [INFO ] [MAIN ] Derivative Progress: 391/1587 symbols completed. CMP took 1.2s. Estimated remaining: 8m 22s. Rate: 142.9 symbols/min [2025-10-01T22:37:37.560226] [DEBUG] [MAIN ] CMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:37.569469] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:37.568486] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-10-01T22:37:37.572285] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-01T22:37:37.572072] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-01T22:37:37.573325] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-01T22:37:37.575837] [INFO ] [MAIN ] Derivative Progress: 392/1587 symbols completed. CMI took 1.2s. Estimated remaining: 8m 20s. Rate: 143.3 symbols/min [2025-10-01T22:37:37.583607] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:37.593194] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-10-01T22:37:37.593339] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-01T22:37:37.596071] [INFO ] [MAIN ] Derivative Progress: 393/1587 symbols completed. CMG took 1.3s. Estimated remaining: 8m 19s. Rate: 143.6 symbols/min [2025-10-01T22:37:37.596381] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:37.602415] [DEBUG] [LOCAL ] CMSA: Loaded 3509 existing records from primary storage. [2025-10-01T22:37:37.602554] [INFO ] [MAIN ] CMSA: Loaded 3509 primary data records. [2025-10-01T22:37:37.930040] [DEBUG] [LOCAL ] CMPO: Loaded 39242 existing records from primary storage. [2025-10-01T22:37:37.944627] [INFO ] [MAIN ] CMPO: Loaded 39242 primary data records. [2025-10-01T22:37:37.928730] [DEBUG] [LOCAL ] CMRE: Loaded 35458 existing records from primary storage. [2025-10-01T22:37:38.034955] [INFO ] [MAIN ] CMRE: Loaded 35458 primary data records. [2025-10-01T22:37:38.727818] [DEBUG] [MAIN ] CMSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:38.728743] [INFO ] [MAIN ] CMSA: Generated 1794 derivative records from 3509 primary records. [2025-10-01T22:37:38.729098] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-01T22:37:38.752250] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1794 records). [2025-10-01T22:37:38.753167] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-01T22:37:38.755630] [INFO ] [MAIN ] Derivative Progress: 394/1587 symbols completed. CMSA took 1.2s. Estimated remaining: 8m 21s. Rate: 143.0 symbols/min [2025-10-01T22:37:38.756032] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:38.792764] [DEBUG] [MAIN ] CMPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:38.796433] [DEBUG] [LOCAL ] CMSC: Loaded 5075 existing records from primary storage. [2025-10-01T22:37:38.792337] [DEBUG] [MAIN ] CMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:38.798354] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35458 primary records. [2025-10-01T22:37:38.797667] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 39242 primary records. [2025-10-01T22:37:38.798473] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-01T22:37:38.798707] [INFO ] [MAIN ] CMSC: Loaded 5075 primary data records. [2025-10-01T22:37:38.798544] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-01T22:37:38.923940] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-01T22:37:38.920170] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-01T22:37:38.924173] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-01T22:37:38.929463] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-01T22:37:38.949928] [INFO ] [MAIN ] Derivative Progress: 395/1587 symbols completed. CMPO took 1.4s. Estimated remaining: 8m 19s. Rate: 143.2 symbols/min [2025-10-01T22:37:38.957132] [INFO ] [MAIN ] Derivative Progress: 396/1587 symbols completed. CMRE took 1.4s. Estimated remaining: 8m 18s. Rate: 143.6 symbols/min [2025-10-01T22:37:38.957065] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:38.957494] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:39.183986] [DEBUG] [LOCAL ] CMSD: Loaded 8099 existing records from primary storage. [2025-10-01T22:37:39.184170] [INFO ] [MAIN ] CMSD: Loaded 8099 primary data records. [2025-10-01T22:37:39.344493] [DEBUG] [LOCAL ] CMTG: Loaded 36836 existing records from primary storage. [2025-10-01T22:37:39.351031] [INFO ] [MAIN ] CMTG: Loaded 36836 primary data records. [2025-10-01T22:37:39.771422] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:39.892547] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5075 primary records. [2025-10-01T22:37:39.949689] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-01T22:37:39.974363] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-01T22:37:39.974811] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-01T22:37:39.976993] [INFO ] [MAIN ] Derivative Progress: 397/1587 symbols completed. CMSC took 1.2s. Estimated remaining: 8m 19s. Rate: 143.0 symbols/min [2025-10-01T22:37:39.977151] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:39.996852] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:39.997864] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8099 primary records. [2025-10-01T22:37:39.998163] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-01T22:37:40.018898] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-01T22:37:40.029420] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-01T22:37:40.032172] [INFO ] [MAIN ] Derivative Progress: 398/1587 symbols completed. CMSD took 1.1s. Estimated remaining: 8m 18s. Rate: 143.3 symbols/min [2025-10-01T22:37:40.032525] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:40.046745] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:40.047606] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 36836 primary records. [2025-10-01T22:37:40.047731] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-01T22:37:40.075440] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-01T22:37:40.075758] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-01T22:37:40.078774] [INFO ] [MAIN ] Derivative Progress: 399/1587 symbols completed. CMTG took 1.1s. Estimated remaining: 8m 16s. Rate: 143.7 symbols/min [2025-10-01T22:37:40.079694] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:40.079506] [DEBUG] [LOCAL ] CNA: Loaded 32776 existing records from primary storage. [2025-10-01T22:37:40.080370] [INFO ] [MAIN ] CNA: Loaded 32776 primary data records. [2025-10-01T22:37:40.216185] [DEBUG] [LOCAL ] CNF: Loaded 10716 existing records from primary storage. [2025-10-01T22:37:40.222385] [INFO ] [MAIN ] CNF: Loaded 10716 primary data records. [2025-10-01T22:37:40.365832] [DEBUG] [LOCAL ] CNC: Loaded 53739 existing records from primary storage. [2025-10-01T22:37:40.414794] [INFO ] [MAIN ] CNC: Loaded 53739 primary data records. [2025-10-01T22:37:41.166363] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:41.167702] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32776 primary records. [2025-10-01T22:37:41.168111] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-01T22:37:41.190054] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-01T22:37:41.191990] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-01T22:37:41.194323] [INFO ] [MAIN ] Derivative Progress: 400/1587 symbols completed. CNA took 1.2s. Estimated remaining: 8m 18s. Rate: 143.1 symbols/min [2025-10-01T22:37:41.194930] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:41.216606] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:41.223725] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53739 primary records. [2025-10-01T22:37:41.222852] [DEBUG] [MAIN ] CNF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:37:41.223853] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-01T22:37:41.225530] [INFO ] [MAIN ] CNF: Generated 1793 derivative records from 10716 primary records. [2025-10-01T22:37:41.225700] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-01T22:37:41.254144] [DEBUG] [LOCAL ] CNF: Derivative data saved (1793 records). [2025-10-01T22:37:41.254947] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-01T22:37:41.257817] [INFO ] [MAIN ] Derivative Progress: 401/1587 symbols completed. CNF took 1.2s. Estimated remaining: 8m 16s. Rate: 143.4 symbols/min [2025-10-01T22:37:41.259099] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:41.262929] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-01T22:37:41.263087] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-01T22:37:41.265467] [INFO ] [MAIN ] Derivative Progress: 402/1587 symbols completed. CNC took 1.2s. Estimated remaining: 8m 15s. Rate: 143.7 symbols/min [2025-10-01T22:37:41.265806] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:41.314917] [DEBUG] [LOCAL ] CNH: Loaded 53555 existing records from primary storage. [2025-10-01T22:37:41.315203] [INFO ] [MAIN ] CNH: Loaded 53555 primary data records. [2025-10-01T22:37:41.547056] [DEBUG] [LOCAL ] CNK: Loaded 52876 existing records from primary storage. [2025-10-01T22:37:41.558607] [INFO ] [MAIN ] CNK: Loaded 52876 primary data records. [2025-10-01T22:37:41.692742] [DEBUG] [LOCAL ] CNI: Loaded 51668 existing records from primary storage. [2025-10-01T22:37:41.712478] [INFO ] [MAIN ] CNI: Loaded 51668 primary data records. [2025-10-01T22:37:42.441785] [DEBUG] [MAIN ] CNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:42.443051] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53555 primary records. [2025-10-01T22:37:42.443195] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-01T22:37:42.464887] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-10-01T22:37:42.465675] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-01T22:37:42.467901] [INFO ] [MAIN ] Derivative Progress: 403/1587 symbols completed. CNH took 1.3s. Estimated remaining: 8m 17s. Rate: 143.1 symbols/min [2025-10-01T22:37:42.487191] [DEBUG] [MAIN ] CNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:42.488109] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52876 primary records. [2025-10-01T22:37:42.499826] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-01T22:37:42.500300] [DEBUG] [MAIN ] CNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:42.501502] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51668 primary records. [2025-10-01T22:37:42.501793] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-01T22:37:42.530976] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-01T22:37:42.531470] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-01T22:37:42.535955] [INFO ] [MAIN ] Derivative Progress: 404/1587 symbols completed. CNI took 1.3s. Estimated remaining: 8m 15s. Rate: 143.4 symbols/min [2025-10-01T22:37:42.538828] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-01T22:37:42.538897] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-01T22:37:42.541225] [INFO ] [MAIN ] Derivative Progress: 405/1587 symbols completed. CNK took 1.3s. Estimated remaining: 8m 14s. Rate: 143.7 symbols/min [2025-10-01T22:37:42.541888] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:42.541979] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:42.542074] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:42.611202] [DEBUG] [LOCAL ] CNMD: Loaded 32280 existing records from primary storage. [2025-10-01T22:37:42.611604] [INFO ] [MAIN ] CNMD: Loaded 32280 primary data records. [2025-10-01T22:37:42.624793] [DEBUG] [LOCAL ] CNNE: Loaded 36373 existing records from primary storage. [2025-10-01T22:37:42.646466] [INFO ] [MAIN ] CNNE: Loaded 36373 primary data records. [2025-10-01T22:37:42.816333] [DEBUG] [LOCAL ] CNM: Loaded 50990 existing records from primary storage. [2025-10-01T22:37:42.830901] [INFO ] [MAIN ] CNM: Loaded 50990 primary data records. [2025-10-01T22:37:43.690696] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:43.691780] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32280 primary records. [2025-10-01T22:37:43.692220] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-01T22:37:43.713940] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-01T22:37:43.727528] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-01T22:37:43.730111] [INFO ] [MAIN ] Derivative Progress: 406/1587 symbols completed. CNMD took 1.2s. Estimated remaining: 8m 15s. Rate: 143.1 symbols/min [2025-10-01T22:37:43.727925] [DEBUG] [MAIN ] CNNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:43.730902] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:43.732151] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36373 primary records. [2025-10-01T22:37:43.732586] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-01T22:37:43.764954] [DEBUG] [MAIN ] CNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:43.766278] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 50990 primary records. [2025-10-01T22:37:43.768338] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-01T22:37:43.778916] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-01T22:37:43.779420] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-01T22:37:43.782104] [INFO ] [MAIN ] Derivative Progress: 407/1587 symbols completed. CNNE took 1.2s. Estimated remaining: 8m 14s. Rate: 143.4 symbols/min [2025-10-01T22:37:43.788724] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:43.790746] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-10-01T22:37:43.791131] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-01T22:37:43.793714] [INFO ] [MAIN ] Derivative Progress: 408/1587 symbols completed. CNM took 1.3s. Estimated remaining: 8m 12s. Rate: 143.7 symbols/min [2025-10-01T22:37:43.794293] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:43.830692] [DEBUG] [LOCAL ] CNS: Loaded 20584 existing records from primary storage. [2025-10-01T22:37:43.831397] [INFO ] [MAIN ] CNS: Loaded 20584 primary data records. [2025-10-01T22:37:43.889087] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-10-01T22:37:43.903074] [INFO ] [MAIN ] CNP: Loaded 53469 primary data records. [2025-10-01T22:37:44.190769] [DEBUG] [LOCAL ] CNQ: Loaded 53581 existing records from primary storage. [2025-10-01T22:37:44.201404] [INFO ] [MAIN ] CNQ: Loaded 53581 primary data records. [2025-10-01T22:37:44.972832] [DEBUG] [MAIN ] CNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:44.974037] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 20584 primary records. [2025-10-01T22:37:44.974423] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-01T22:37:44.995887] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-10-01T22:37:44.996581] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-01T22:37:44.998840] [INFO ] [MAIN ] Derivative Progress: 409/1587 symbols completed. CNS took 1.2s. Estimated remaining: 8m 14s. Rate: 143.0 symbols/min [2025-10-01T22:37:44.999342] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:45.015739] [DEBUG] [MAIN ] CNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:45.016779] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53469 primary records. [2025-10-01T22:37:45.016967] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-01T22:37:45.040067] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-01T22:37:45.052868] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-01T22:37:45.055604] [INFO ] [MAIN ] Derivative Progress: 410/1587 symbols completed. CNP took 1.3s. Estimated remaining: 8m 13s. Rate: 143.3 symbols/min [2025-10-01T22:37:45.056332] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:45.056220] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:45.057365] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53581 primary records. [2025-10-01T22:37:45.057831] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-01T22:37:45.093869] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-01T22:37:45.094083] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-01T22:37:45.096834] [INFO ] [MAIN ] Derivative Progress: 411/1587 symbols completed. CNQ took 1.3s. Estimated remaining: 8m 11s. Rate: 143.7 symbols/min [2025-10-01T22:37:45.099301] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:45.131448] [DEBUG] [LOCAL ] CNX: Loaded 51372 existing records from primary storage. [2025-10-01T22:37:45.131877] [INFO ] [MAIN ] CNX: Loaded 51372 primary data records. [2025-10-01T22:37:45.244551] [DEBUG] [LOCAL ] CODI: Loaded 40010 existing records from primary storage. [2025-10-01T22:37:45.263537] [INFO ] [MAIN ] CODI: Loaded 40010 primary data records. [2025-10-01T22:37:45.816028] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-01T22:37:45.860493] [INFO ] [MAIN ] COF: Loaded 53609 primary data records. [2025-10-01T22:37:46.231938] [DEBUG] [MAIN ] CNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:46.233762] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51372 primary records. [2025-10-01T22:37:46.234151] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-01T22:37:46.255198] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-10-01T22:37:46.256125] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-01T22:37:46.258676] [INFO ] [MAIN ] Derivative Progress: 412/1587 symbols completed. CNX took 1.3s. Estimated remaining: 8m 13s. Rate: 143.0 symbols/min [2025-10-01T22:37:46.258881] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:46.274838] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:46.275716] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 40010 primary records. [2025-10-01T22:37:46.275818] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-01T22:37:46.294574] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-01T22:37:46.294810] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-01T22:37:46.297468] [INFO ] [MAIN ] Derivative Progress: 413/1587 symbols completed. CODI took 1.2s. Estimated remaining: 8m 11s. Rate: 143.4 symbols/min [2025-10-01T22:37:46.297976] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:46.316896] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:46.317732] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53609 primary records. [2025-10-01T22:37:46.317883] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-01T22:37:46.351872] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-01T22:37:46.352196] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-01T22:37:46.355401] [INFO ] [MAIN ] Derivative Progress: 414/1587 symbols completed. COF took 1.3s. Estimated remaining: 8m 10s. Rate: 143.7 symbols/min [2025-10-01T22:37:46.355750] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:46.388850] [DEBUG] [LOCAL ] COLD: Loaded 52075 existing records from primary storage. [2025-10-01T22:37:46.389278] [INFO ] [MAIN ] COLD: Loaded 52075 primary data records. [2025-10-01T22:37:46.541344] [DEBUG] [LOCAL ] COMP: Loaded 53389 existing records from primary storage. [2025-10-01T22:37:46.568895] [DEBUG] [LOCAL ] COOK: Loaded 24333 existing records from primary storage. [2025-10-01T22:37:46.557995] [INFO ] [MAIN ] COMP: Loaded 53389 primary data records. [2025-10-01T22:37:46.581330] [INFO ] [MAIN ] COOK: Loaded 24333 primary data records. [2025-10-01T22:37:47.490792] [DEBUG] [MAIN ] COLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:47.491902] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52075 primary records. [2025-10-01T22:37:47.493000] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-01T22:37:47.513698] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-01T22:37:47.514536] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-01T22:37:47.516688] [INFO ] [MAIN ] Derivative Progress: 415/1587 symbols completed. COLD took 1.3s. Estimated remaining: 8m 12s. Rate: 143.0 symbols/min [2025-10-01T22:37:47.517194] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:47.537492] [DEBUG] [MAIN ] COOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:47.539787] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24333 primary records. [2025-10-01T22:37:47.540085] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-01T22:37:47.561180] [DEBUG] [MAIN ] COMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:47.566402] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53389 primary records. [2025-10-01T22:37:47.569625] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-01T22:37:47.570818] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-01T22:37:47.571578] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-01T22:37:47.574216] [INFO ] [MAIN ] Derivative Progress: 416/1587 symbols completed. COOK took 1.2s. Estimated remaining: 8m 10s. Rate: 143.3 symbols/min [2025-10-01T22:37:47.582085] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:47.591267] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-01T22:37:47.591457] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-01T22:37:47.594452] [INFO ] [MAIN ] Derivative Progress: 417/1587 symbols completed. COMP took 1.3s. Estimated remaining: 8m 9s. Rate: 143.7 symbols/min [2025-10-01T22:37:47.594845] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:47.634635] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-01T22:37:47.634945] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-01T22:37:47.811192] [DEBUG] [LOCAL ] COR: Loaded 47080 existing records from primary storage. [2025-10-01T22:37:47.832401] [INFO ] [MAIN ] COR: Loaded 47080 primary data records. [2025-10-01T22:37:47.897004] [DEBUG] [LOCAL ] COTY: Loaded 53229 existing records from primary storage. [2025-10-01T22:37:47.957859] [INFO ] [MAIN ] COTY: Loaded 53229 primary data records. [2025-10-01T22:37:48.791464] [DEBUG] [MAIN ] COP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:48.792618] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-10-01T22:37:48.793312] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-01T22:37:48.814837] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-01T22:37:48.816046] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-01T22:37:48.818142] [INFO ] [MAIN ] Derivative Progress: 418/1587 symbols completed. COP took 1.3s. Estimated remaining: 8m 10s. Rate: 143.0 symbols/min [2025-10-01T22:37:48.833833] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:48.834779] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47080 primary records. [2025-10-01T22:37:48.834960] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-01T22:37:48.849508] [DEBUG] [MAIN ] COTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:48.861818] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53229 primary records. [2025-10-01T22:37:48.862809] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-01T22:37:48.867023] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-01T22:37:48.867403] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-01T22:37:48.870072] [INFO ] [MAIN ] Derivative Progress: 419/1587 symbols completed. COR took 1.3s. Estimated remaining: 8m 9s. Rate: 143.3 symbols/min [2025-10-01T22:37:48.886042] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-10-01T22:37:48.886180] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-01T22:37:48.889013] [INFO ] [MAIN ] Derivative Progress: 420/1587 symbols completed. COTY took 1.3s. Estimated remaining: 8m 7s. Rate: 143.6 symbols/min [2025-10-01T22:37:48.889580] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:48.889526] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:48.889670] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:48.922549] [DEBUG] [LOCAL ] CPAY: Loaded 30628 existing records from primary storage. [2025-10-01T22:37:48.933524] [INFO ] [MAIN ] CPAY: Loaded 30628 primary data records. [2025-10-01T22:37:49.094496] [DEBUG] [LOCAL ] COUR: Loaded 48918 existing records from primary storage. [2025-10-01T22:37:49.131338] [INFO ] [MAIN ] COUR: Loaded 48918 primary data records. [2025-10-01T22:37:49.336313] [DEBUG] [LOCAL ] CP: Loaded 53267 existing records from primary storage. [2025-10-01T22:37:49.368964] [INFO ] [MAIN ] CP: Loaded 53267 primary data records. [2025-10-01T22:37:50.018444] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:50.020094] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30628 primary records. [2025-10-01T22:37:50.020266] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-01T22:37:50.042070] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-01T22:37:50.043485] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-01T22:37:50.046167] [INFO ] [MAIN ] Derivative Progress: 421/1587 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 9s. Rate: 143.0 symbols/min [2025-10-01T22:37:50.046639] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:50.070735] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:50.072744] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 48918 primary records. [2025-10-01T22:37:50.074526] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-01T22:37:50.090578] [DEBUG] [LOCAL ] CPF: Loaded 15158 existing records from primary storage. [2025-10-01T22:37:50.103279] [INFO ] [MAIN ] CPF: Loaded 15158 primary data records. [2025-10-01T22:37:50.106215] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-01T22:37:50.111664] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-01T22:37:50.136782] [INFO ] [MAIN ] Derivative Progress: 422/1587 symbols completed. COUR took 1.2s. Estimated remaining: 8m 8s. Rate: 143.3 symbols/min [2025-10-01T22:37:50.136974] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:50.137522] [DEBUG] [MAIN ] CP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:50.169260] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53267 primary records. [2025-10-01T22:37:50.178088] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-01T22:37:50.282892] [DEBUG] [LOCAL ] CPK: Loaded 13479 existing records from primary storage. [2025-10-01T22:37:50.266764] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-01T22:37:50.298474] [INFO ] [MAIN ] CPK: Loaded 13479 primary data records. [2025-10-01T22:37:50.303700] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-01T22:37:50.311529] [INFO ] [MAIN ] Derivative Progress: 423/1587 symbols completed. CP took 1.4s. Estimated remaining: 8m 7s. Rate: 143.5 symbols/min [2025-10-01T22:37:50.352337] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:50.914597] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:50.916160] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-10-01T22:37:50.916404] [INFO ] [MAIN ] CPNG: Loaded 53671 primary data records. [2025-10-01T22:37:50.917433] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15158 primary records. [2025-10-01T22:37:50.929798] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-01T22:37:51.036949] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-10-01T22:37:51.043143] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-01T22:37:51.065430] [INFO ] [MAIN ] Derivative Progress: 424/1587 symbols completed. CPF took 1.0s. Estimated remaining: 8m 7s. Rate: 143.2 symbols/min [2025-10-01T22:37:51.079046] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:51.095409] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:51.133957] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13479 primary records. [2025-10-01T22:37:51.143812] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-01T22:37:51.354171] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-01T22:37:51.354343] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-01T22:37:51.357025] [INFO ] [MAIN ] Derivative Progress: 425/1587 symbols completed. CPK took 1.2s. Estimated remaining: 8m 6s. Rate: 143.3 symbols/min [2025-10-01T22:37:51.357280] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:51.403301] [DEBUG] [MAIN ] CPNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:51.404075] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53671 primary records. [2025-10-01T22:37:51.404721] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-01T22:37:51.430721] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-10-01T22:37:51.423475] [DEBUG] [LOCAL ] CPS: Loaded 25887 existing records from primary storage. [2025-10-01T22:37:51.431036] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-01T22:37:51.431137] [INFO ] [MAIN ] CPS: Loaded 25887 primary data records. [2025-10-01T22:37:51.447680] [INFO ] [MAIN ] Derivative Progress: 426/1587 symbols completed. CPNG took 1.1s. Estimated remaining: 8m 5s. Rate: 143.6 symbols/min [2025-10-01T22:37:51.449354] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:51.462739] [DEBUG] [LOCAL ] CPRI: Loaded 52548 existing records from primary storage. [2025-10-01T22:37:51.473709] [INFO ] [MAIN ] CPRI: Loaded 52548 primary data records. [2025-10-01T22:37:52.165830] [DEBUG] [LOCAL ] CPT: Loaded 44368 existing records from primary storage. [2025-10-01T22:37:52.167435] [INFO ] [MAIN ] CPT: Loaded 44368 primary data records. [2025-10-01T22:37:52.534885] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:52.536185] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25887 primary records. [2025-10-01T22:37:52.543999] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-01T22:37:52.560276] [DEBUG] [MAIN ] CPRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:52.565577] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52548 primary records. [2025-10-01T22:37:52.568391] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-01T22:37:52.569565] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-01T22:37:52.570041] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-01T22:37:52.580564] [INFO ] [MAIN ] Derivative Progress: 427/1587 symbols completed. CPS took 1.2s. Estimated remaining: 8m 7s. Rate: 143.0 symbols/min [2025-10-01T22:37:52.583890] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:52.588606] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-01T22:37:52.588921] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-01T22:37:52.591776] [INFO ] [MAIN ] Derivative Progress: 428/1587 symbols completed. CPRI took 1.5s. Estimated remaining: 8m 5s. Rate: 143.3 symbols/min [2025-10-01T22:37:52.592300] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:52.610710] [DEBUG] [MAIN ] CPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:52.611587] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44368 primary records. [2025-10-01T22:37:52.611886] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-01T22:37:52.655619] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-01T22:37:52.655805] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-01T22:37:52.647604] [DEBUG] [LOCAL ] CQP: Loaded 19493 existing records from primary storage. [2025-10-01T22:37:52.658447] [INFO ] [MAIN ] Derivative Progress: 429/1587 symbols completed. CPT took 1.2s. Estimated remaining: 8m 4s. Rate: 143.6 symbols/min [2025-10-01T22:37:52.658782] [INFO ] [MAIN ] CQP: Loaded 19493 primary data records. [2025-10-01T22:37:52.658929] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:52.748806] [DEBUG] [LOCAL ] CR: Loaded 24428 existing records from primary storage. [2025-10-01T22:37:52.761383] [INFO ] [MAIN ] CR: Loaded 24428 primary data records. [2025-10-01T22:37:53.407796] [DEBUG] [LOCAL ] CRBG: Loaded 52361 existing records from primary storage. [2025-10-01T22:37:53.408434] [INFO ] [MAIN ] CRBG: Loaded 52361 primary data records. [2025-10-01T22:37:53.750942] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:53.751817] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 19493 primary records. [2025-10-01T22:37:53.752202] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-01T22:37:53.771786] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-01T22:37:53.772690] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-01T22:37:53.775222] [INFO ] [MAIN ] Derivative Progress: 430/1587 symbols completed. CQP took 1.2s. Estimated remaining: 8m 5s. Rate: 143.1 symbols/min [2025-10-01T22:37:53.776575] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:53.793520] [DEBUG] [MAIN ] CR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:53.794576] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24428 primary records. [2025-10-01T22:37:53.794769] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-01T22:37:53.825374] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-10-01T22:37:53.825758] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-01T22:37:53.828450] [INFO ] [MAIN ] Derivative Progress: 431/1587 symbols completed. CR took 1.2s. Estimated remaining: 8m 4s. Rate: 143.4 symbols/min [2025-10-01T22:37:53.828958] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:53.847851] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:53.859332] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52361 primary records. [2025-10-01T22:37:53.859680] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-01T22:37:53.894039] [DEBUG] [LOCAL ] CRC: Loaded 44050 existing records from primary storage. [2025-10-01T22:37:53.894191] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-01T22:37:53.894631] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-01T22:37:53.894377] [INFO ] [MAIN ] CRC: Loaded 44050 primary data records. [2025-10-01T22:37:53.897621] [INFO ] [MAIN ] Derivative Progress: 432/1587 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 2s. Rate: 143.6 symbols/min [2025-10-01T22:37:53.910302] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:54.111084] [DEBUG] [LOCAL ] CRGY: Loaded 52509 existing records from primary storage. [2025-10-01T22:37:54.146757] [INFO ] [MAIN ] CRGY: Loaded 52509 primary data records. [2025-10-01T22:37:54.434399] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-01T22:37:54.476984] [INFO ] [MAIN ] CRH: Loaded 53462 primary data records. [2025-10-01T22:37:55.037667] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:55.039686] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44050 primary records. [2025-10-01T22:37:55.040213] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-01T22:37:55.061455] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-01T22:37:55.062480] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-01T22:37:55.064626] [INFO ] [MAIN ] Derivative Progress: 433/1587 symbols completed. CRC took 1.3s. Estimated remaining: 8m 4s. Rate: 143.0 symbols/min [2025-10-01T22:37:55.079382] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:55.080411] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52509 primary records. [2025-10-01T22:37:55.080696] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-01T22:37:55.101828] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-01T22:37:55.102036] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-01T22:37:55.104543] [INFO ] [MAIN ] Derivative Progress: 434/1587 symbols completed. CRGY took 1.3s. Estimated remaining: 8m 3s. Rate: 143.3 symbols/min [2025-10-01T22:37:55.118348] [DEBUG] [MAIN ] CRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:55.119085] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53462 primary records. [2025-10-01T22:37:55.119152] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-01T22:37:55.135674] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-01T22:37:55.135786] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-01T22:37:55.138527] [INFO ] [MAIN ] Derivative Progress: 435/1587 symbols completed. CRH took 1.2s. Estimated remaining: 8m 1s. Rate: 143.6 symbols/min [2025-10-01T22:37:55.139109] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:55.139197] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:55.139369] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:55.229746] [DEBUG] [LOCAL ] CRI: Loaded 49912 existing records from primary storage. [2025-10-01T22:37:55.230251] [INFO ] [MAIN ] CRI: Loaded 49912 primary data records. [2025-10-01T22:37:55.231480] [DEBUG] [LOCAL ] CRL: Loaded 42959 existing records from primary storage. [2025-10-01T22:37:55.246424] [INFO ] [MAIN ] CRL: Loaded 42959 primary data records. [2025-10-01T22:37:55.270802] [DEBUG] [LOCAL ] CRK: Loaded 52153 existing records from primary storage. [2025-10-01T22:37:55.284634] [INFO ] [MAIN ] CRK: Loaded 52153 primary data records. [2025-10-01T22:37:56.353105] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:56.367032] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42959 primary records. [2025-10-01T22:37:56.379386] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-01T22:37:56.380711] [DEBUG] [MAIN ] CRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:56.380542] [DEBUG] [MAIN ] CRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:56.381781] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52153 primary records. [2025-10-01T22:37:56.382418] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49912 primary records. [2025-10-01T22:37:56.382738] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-01T22:37:56.382811] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-01T22:37:56.427198] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-01T22:37:56.428585] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-01T22:37:56.431074] [INFO ] [MAIN ] Derivative Progress: 436/1587 symbols completed. CRL took 1.3s. Estimated remaining: 8m 3s. Rate: 143.0 symbols/min [2025-10-01T22:37:56.431865] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:56.434610] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-01T22:37:56.434878] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-01T22:37:56.437553] [INFO ] [MAIN ] Derivative Progress: 437/1587 symbols completed. CRI took 1.3s. Estimated remaining: 8m 2s. Rate: 143.3 symbols/min [2025-10-01T22:37:56.440441] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-01T22:37:56.440537] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-01T22:37:56.439976] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:56.443128] [INFO ] [MAIN ] Derivative Progress: 438/1587 symbols completed. CRK took 1.3s. Estimated remaining: 8m 0s. Rate: 143.6 symbols/min [2025-10-01T22:37:56.444773] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:56.449257] [DEBUG] [LOCAL ] CRT: Loaded 4988 existing records from primary storage. [2025-10-01T22:37:56.449570] [INFO ] [MAIN ] CRT: Loaded 4988 primary data records. [2025-10-01T22:37:56.816562] [DEBUG] [LOCAL ] CSL: Loaded 31471 existing records from primary storage. [2025-10-01T22:37:56.831516] [INFO ] [MAIN ] CSL: Loaded 31471 primary data records. [2025-10-01T22:37:56.839896] [DEBUG] [LOCAL ] CSAN: Loaded 42343 existing records from primary storage. [2025-10-01T22:37:56.865146] [INFO ] [MAIN ] CSAN: Loaded 42343 primary data records. [2025-10-01T22:37:57.599015] [DEBUG] [MAIN ] CRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:57.601276] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4988 primary records. [2025-10-01T22:37:57.601968] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-01T22:37:57.621851] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-10-01T22:37:57.622062] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-01T22:37:57.624513] [INFO ] [MAIN ] Derivative Progress: 439/1587 symbols completed. CRT took 1.2s. Estimated remaining: 8m 2s. Rate: 143.0 symbols/min [2025-10-01T22:37:57.625051] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:57.666703] [DEBUG] [LOCAL ] CSR: Loaded 12788 existing records from primary storage. [2025-10-01T22:37:57.667092] [INFO ] [MAIN ] CSR: Loaded 12788 primary data records. [2025-10-01T22:37:57.667877] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:57.667383] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:57.673872] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31471 primary records. [2025-10-01T22:37:57.691350] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-01T22:37:57.681018] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42343 primary records. [2025-10-01T22:37:57.744408] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-01T22:37:57.813222] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-10-01T22:37:57.815444] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-01T22:37:57.816390] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-01T22:37:57.824413] [INFO ] [MAIN ] Derivative Progress: 440/1587 symbols completed. CSL took 1.4s. Estimated remaining: 8m 1s. Rate: 143.2 symbols/min [2025-10-01T22:37:57.840004] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-01T22:37:57.883424] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:57.900310] [INFO ] [MAIN ] Derivative Progress: 441/1587 symbols completed. CSAN took 1.4s. Estimated remaining: 7m 59s. Rate: 143.4 symbols/min [2025-10-01T22:37:58.033530] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:58.049755] [DEBUG] [LOCAL ] CTBB: Loaded 7070 existing records from primary storage. [2025-10-01T22:37:58.050167] [INFO ] [MAIN ] CTBB: Loaded 7070 primary data records. [2025-10-01T22:37:58.139996] [DEBUG] [LOCAL ] CSV: Loaded 12774 existing records from primary storage. [2025-10-01T22:37:58.151347] [INFO ] [MAIN ] CSV: Loaded 12774 primary data records. [2025-10-01T22:37:58.570534] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:58.617804] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12788 primary records. [2025-10-01T22:37:58.747291] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-01T22:37:58.768688] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-01T22:37:58.769093] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-01T22:37:58.772901] [INFO ] [MAIN ] Derivative Progress: 442/1587 symbols completed. CSR took 1.1s. Estimated remaining: 8m 0s. Rate: 143.1 symbols/min [2025-10-01T22:37:58.773558] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:58.795079] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:58.796015] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7070 primary records. [2025-10-01T22:37:58.796383] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-01T22:37:58.832912] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-01T22:37:58.838803] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-01T22:37:58.846713] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:58.851375] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12774 primary records. [2025-10-01T22:37:58.850289] [INFO ] [MAIN ] Derivative Progress: 443/1587 symbols completed. CTBB took 0.8s. Estimated remaining: 7m 59s. Rate: 143.4 symbols/min [2025-10-01T22:37:58.851760] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:58.851832] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-01T22:37:58.852889] [DEBUG] [LOCAL ] CTO: Loaded 27816 existing records from primary storage. [2025-10-01T22:37:58.853366] [INFO ] [MAIN ] CTO: Loaded 27816 primary data records. [2025-10-01T22:37:59.018115] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-01T22:37:59.054422] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-01T22:37:59.102478] [INFO ] [MAIN ] Derivative Progress: 444/1587 symbols completed. CSV took 1.2s. Estimated remaining: 7m 58s. Rate: 143.5 symbols/min [2025-10-01T22:37:59.227470] [DEBUG] [LOCAL ] CTOS: Loaded 36522 existing records from primary storage. [2025-10-01T22:37:59.227815] [INFO ] [MAIN ] CTOS: Loaded 36522 primary data records. [2025-10-01T22:37:59.227621] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:37:59.600756] [DEBUG] [MAIN ] CTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:37:59.601987] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27816 primary records. [2025-10-01T22:37:59.615924] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-01T22:37:59.620375] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-10-01T22:37:59.632385] [INFO ] [MAIN ] CTRA: Loaded 53648 primary data records. [2025-10-01T22:37:59.740483] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-01T22:37:59.754264] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-01T22:37:59.756887] [INFO ] [MAIN ] Derivative Progress: 445/1587 symbols completed. CTO took 1.0s. Estimated remaining: 7m 58s. Rate: 143.3 symbols/min [2025-10-01T22:37:59.763406] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:00.018633] [DEBUG] [MAIN ] CTOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:00.019868] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 36522 primary records. [2025-10-01T22:38:00.019941] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-01T22:38:00.040721] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-10-01T22:38:00.041958] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-01T22:38:00.044705] [INFO ] [MAIN ] Derivative Progress: 446/1587 symbols completed. CTOS took 1.2s. Estimated remaining: 7m 57s. Rate: 143.4 symbols/min [2025-10-01T22:38:00.045314] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:00.088132] [DEBUG] [LOCAL ] CTRI: Loaded 38669 existing records from primary storage. [2025-10-01T22:38:00.092534] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:00.092858] [INFO ] [MAIN ] CTRI: Loaded 38669 primary data records. [2025-10-01T22:38:00.093774] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53648 primary records. [2025-10-01T22:38:00.094160] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-01T22:38:00.201173] [DEBUG] [LOCAL ] CTS: Loaded 19374 existing records from primary storage. [2025-10-01T22:38:00.206500] [INFO ] [MAIN ] CTS: Loaded 19374 primary data records. [2025-10-01T22:38:00.292991] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-01T22:38:00.314383] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-01T22:38:00.316840] [INFO ] [MAIN ] Derivative Progress: 447/1587 symbols completed. CTRA took 1.1s. Estimated remaining: 7m 57s. Rate: 143.5 symbols/min [2025-10-01T22:38:00.352708] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:00.836355] [DEBUG] [MAIN ] CTRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:00.837579] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 38669 primary records. [2025-10-01T22:38:00.837881] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-01T22:38:00.866715] [DEBUG] [LOCAL ] CTVA: Loaded 53239 existing records from primary storage. [2025-10-01T22:38:00.872508] [INFO ] [MAIN ] CTVA: Loaded 53239 primary data records. [2025-10-01T22:38:00.905113] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-10-01T22:38:00.911698] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-01T22:38:00.911554] [DEBUG] [MAIN ] CTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:00.925931] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19374 primary records. [2025-10-01T22:38:00.931257] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-01T22:38:00.924631] [INFO ] [MAIN ] Derivative Progress: 448/1587 symbols completed. CTRI took 1.2s. Estimated remaining: 7m 57s. Rate: 143.4 symbols/min [2025-10-01T22:38:01.102867] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-01T22:38:01.109568] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-01T22:38:01.112088] [INFO ] [MAIN ] Derivative Progress: 449/1587 symbols completed. CTS took 1.1s. Estimated remaining: 7m 56s. Rate: 143.6 symbols/min [2025-10-01T22:38:01.256160] [DEBUG] [MAIN ] CTVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:01.256844] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53239 primary records. [2025-10-01T22:38:01.256908] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-01T22:38:01.272389] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-01T22:38:01.272466] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-01T22:38:01.274539] [INFO ] [MAIN ] Derivative Progress: 450/1587 symbols completed. CTVA took 0.9s. Estimated remaining: 7m 55s. Rate: 143.7 symbols/min [2025-10-01T22:38:01.275220] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:01.275335] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:01.275430] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:01.335943] [DEBUG] [LOCAL ] CURB: Loaded 32632 existing records from primary storage. [2025-10-01T22:38:01.351060] [INFO ] [MAIN ] CURB: Loaded 32632 primary data records. [2025-10-01T22:38:01.478506] [DEBUG] [LOCAL ] CUBE: Loaded 50642 existing records from primary storage. [2025-10-01T22:38:01.507545] [INFO ] [MAIN ] CUBE: Loaded 50642 primary data records. [2025-10-01T22:38:01.512602] [DEBUG] [LOCAL ] CUK: Loaded 51001 existing records from primary storage. [2025-10-01T22:38:01.541884] [INFO ] [MAIN ] CUK: Loaded 51001 primary data records. [2025-10-01T22:38:02.503961] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:02.505966] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32632 primary records. [2025-10-01T22:38:02.506114] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-01T22:38:02.526624] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-10-01T22:38:02.527005] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-01T22:38:02.529623] [INFO ] [MAIN ] Derivative Progress: 451/1587 symbols completed. CURB took 1.3s. Estimated remaining: 7m 56s. Rate: 143.1 symbols/min [2025-10-01T22:38:02.530008] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:02.550092] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:02.563770] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51001 primary records. [2025-10-01T22:38:02.564553] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-01T22:38:02.564486] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:02.566293] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50642 primary records. [2025-10-01T22:38:02.575565] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-01T22:38:02.612364] [DEBUG] [LOCAL ] CURV: Loaded 26720 existing records from primary storage. [2025-10-01T22:38:02.614297] [INFO ] [MAIN ] CURV: Loaded 26720 primary data records. [2025-10-01T22:38:02.633700] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-01T22:38:02.651420] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-01T22:38:02.681833] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-01T22:38:02.667338] [INFO ] [MAIN ] Derivative Progress: 452/1587 symbols completed. CUK took 1.4s. Estimated remaining: 7m 55s. Rate: 143.3 symbols/min [2025-10-01T22:38:02.705443] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:02.710853] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-01T22:38:02.713596] [INFO ] [MAIN ] Derivative Progress: 453/1587 symbols completed. CUBE took 1.4s. Estimated remaining: 7m 54s. Rate: 143.6 symbols/min [2025-10-01T22:38:02.740633] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:03.004997] [DEBUG] [LOCAL ] CUZ: Loaded 49353 existing records from primary storage. [2025-10-01T22:38:03.005392] [INFO ] [MAIN ] CUZ: Loaded 49353 primary data records. [2025-10-01T22:38:03.136857] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-10-01T22:38:03.154126] [INFO ] [MAIN ] CVE: Loaded 53556 primary data records. [2025-10-01T22:38:03.177456] [DEBUG] [MAIN ] CURV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:03.238699] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26720 primary records. [2025-10-01T22:38:03.475608] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-01T22:38:03.577939] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-01T22:38:03.610226] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-01T22:38:03.745012] [INFO ] [MAIN ] Derivative Progress: 454/1587 symbols completed. CURV took 1.2s. Estimated remaining: 7m 55s. Rate: 143.1 symbols/min [2025-10-01T22:38:03.745539] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:03.775627] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:03.777228] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49353 primary records. [2025-10-01T22:38:03.782822] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-01T22:38:03.785207] [DEBUG] [LOCAL ] CVLG: Loaded 15428 existing records from primary storage. [2025-10-01T22:38:03.795319] [INFO ] [MAIN ] CVLG: Loaded 15428 primary data records. [2025-10-01T22:38:03.899172] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-01T22:38:03.917725] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-01T22:38:03.932907] [INFO ] [MAIN ] Derivative Progress: 455/1587 symbols completed. CUZ took 1.2s. Estimated remaining: 7m 54s. Rate: 143.3 symbols/min [2025-10-01T22:38:03.958878] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:03.964076] [DEBUG] [MAIN ] CVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:03.981255] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53556 primary records. [2025-10-01T22:38:03.981393] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-01T22:38:04.098270] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-10-01T22:38:04.255468] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-01T22:38:04.258265] [INFO ] [MAIN ] Derivative Progress: 456/1587 symbols completed. CVE took 1.5s. Estimated remaining: 7m 53s. Rate: 143.4 symbols/min [2025-10-01T22:38:04.258689] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:04.303506] [DEBUG] [MAIN ] CVLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:04.304489] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15428 primary records. [2025-10-01T22:38:04.333986] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-01T22:38:04.336912] [DEBUG] [LOCAL ] CVNA: Loaded 52972 existing records from primary storage. [2025-10-01T22:38:04.346156] [INFO ] [MAIN ] CVNA: Loaded 52972 primary data records. [2025-10-01T22:38:04.480451] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-10-01T22:38:04.490756] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-01T22:38:04.495160] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-01T22:38:04.497472] [INFO ] [MAIN ] Derivative Progress: 457/1587 symbols completed. CVLG took 0.8s. Estimated remaining: 7m 52s. Rate: 143.5 symbols/min [2025-10-01T22:38:04.497616] [INFO ] [MAIN ] CVS: Loaded 53696 primary data records. [2025-10-01T22:38:04.497863] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:04.927758] [DEBUG] [LOCAL ] CW: Loaded 22276 existing records from primary storage. [2025-10-01T22:38:04.964983] [INFO ] [MAIN ] CW: Loaded 22276 primary data records. [2025-10-01T22:38:05.413749] [DEBUG] [MAIN ] CVNA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:38:05.416686] [INFO ] [MAIN ] CVNA: Generated 1793 derivative records from 52972 primary records. [2025-10-01T22:38:05.417274] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-01T22:38:05.456156] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1793 records). [2025-10-01T22:38:05.456670] [DEBUG] [MAIN ] CVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:05.457199] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-01T22:38:05.458022] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53696 primary records. [2025-10-01T22:38:05.458168] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-01T22:38:05.460936] [INFO ] [MAIN ] Derivative Progress: 458/1587 symbols completed. CVNA took 1.5s. Estimated remaining: 7m 53s. Rate: 143.1 symbols/min [2025-10-01T22:38:05.461620] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:05.483325] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-01T22:38:05.487096] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-01T22:38:05.489587] [INFO ] [MAIN ] Derivative Progress: 459/1587 symbols completed. CVS took 1.2s. Estimated remaining: 7m 52s. Rate: 143.4 symbols/min [2025-10-01T22:38:05.490024] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:05.511275] [DEBUG] [MAIN ] CW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:05.512289] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22276 primary records. [2025-10-01T22:38:05.512465] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-01T22:38:05.548000] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-10-01T22:38:05.548217] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-01T22:38:05.550299] [INFO ] [MAIN ] Derivative Progress: 460/1587 symbols completed. CW took 1.1s. Estimated remaining: 7m 51s. Rate: 143.7 symbols/min [2025-10-01T22:38:05.550693] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:05.575996] [DEBUG] [LOCAL ] CWH: Loaded 51374 existing records from primary storage. [2025-10-01T22:38:05.588206] [INFO ] [MAIN ] CWH: Loaded 51374 primary data records. [2025-10-01T22:38:05.734440] [DEBUG] [LOCAL ] CWT: Loaded 27897 existing records from primary storage. [2025-10-01T22:38:05.736298] [DEBUG] [LOCAL ] CWK: Loaded 49410 existing records from primary storage. [2025-10-01T22:38:05.746838] [INFO ] [MAIN ] CWT: Loaded 27897 primary data records. [2025-10-01T22:38:05.747024] [INFO ] [MAIN ] CWK: Loaded 49410 primary data records. [2025-10-01T22:38:06.713349] [DEBUG] [MAIN ] CWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:06.714619] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51374 primary records. [2025-10-01T22:38:06.715037] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-01T22:38:06.766339] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:06.766080] [DEBUG] [MAIN ] CWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:06.767364] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49410 primary records. [2025-10-01T22:38:06.768434] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27897 primary records. [2025-10-01T22:38:06.767598] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-01T22:38:06.768620] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-01T22:38:06.766452] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-10-01T22:38:06.769130] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-01T22:38:06.772360] [INFO ] [MAIN ] Derivative Progress: 461/1587 symbols completed. CWH took 1.3s. Estimated remaining: 7m 52s. Rate: 143.1 symbols/min [2025-10-01T22:38:06.781734] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:06.805538] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-01T22:38:06.806312] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-01T22:38:06.808819] [INFO ] [MAIN ] Derivative Progress: 462/1587 symbols completed. CWK took 1.3s. Estimated remaining: 7m 51s. Rate: 143.4 symbols/min [2025-10-01T22:38:06.809334] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-10-01T22:38:06.809720] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-01T22:38:06.812049] [INFO ] [MAIN ] Derivative Progress: 463/1587 symbols completed. CWT took 1.3s. Estimated remaining: 7m 49s. Rate: 143.7 symbols/min [2025-10-01T22:38:06.809561] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:06.825673] [DEBUG] [LOCAL ] CXE: Loaded 6571 existing records from primary storage. [2025-10-01T22:38:06.825876] [INFO ] [MAIN ] CXE: Loaded 6571 primary data records. [2025-10-01T22:38:07.057421] [DEBUG] [LOCAL ] CX: Loaded 52827 existing records from primary storage. [2025-10-01T22:38:07.175838] [INFO ] [MAIN ] CX: Loaded 52827 primary data records. [2025-10-01T22:38:07.519402] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:07.520892] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6571 primary records. [2025-10-01T22:38:07.520980] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-01T22:38:07.539119] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-01T22:38:07.539373] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-01T22:38:07.541805] [INFO ] [MAIN ] Derivative Progress: 464/1587 symbols completed. CXE took 0.7s. Estimated remaining: 7m 50s. Rate: 143.4 symbols/min [2025-10-01T22:38:07.557516] [DEBUG] [MAIN ] CX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:07.558240] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52827 primary records. [2025-10-01T22:38:07.558304] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-01T22:38:07.574932] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-01T22:38:07.575085] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-01T22:38:07.578028] [INFO ] [MAIN ] Derivative Progress: 465/1587 symbols completed. CX took 0.8s. Estimated remaining: 7m 48s. Rate: 143.7 symbols/min [2025-10-01T22:38:07.578599] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:07.578763] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:07.579916] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:07.588945] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-10-01T22:38:07.589218] [INFO ] [MAIN ] CXH: Loaded 4413 primary data records. [2025-10-01T22:38:07.961327] [DEBUG] [LOCAL ] CXM: Loaded 47646 existing records from primary storage. [2025-10-01T22:38:07.960604] [DEBUG] [LOCAL ] CXT: Loaded 30989 existing records from primary storage. [2025-10-01T22:38:07.961528] [INFO ] [MAIN ] CXT: Loaded 30989 primary data records. [2025-10-01T22:38:07.961620] [INFO ] [MAIN ] CXM: Loaded 47646 primary data records. [2025-10-01T22:38:08.701390] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:08.702994] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4413 primary records. [2025-10-01T22:38:08.703276] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-01T22:38:08.723610] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-10-01T22:38:08.723998] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-01T22:38:08.726564] [INFO ] [MAIN ] Derivative Progress: 466/1587 symbols completed. CXH took 1.1s. Estimated remaining: 7m 50s. Rate: 143.2 symbols/min [2025-10-01T22:38:08.727625] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:08.759388] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:08.765632] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47646 primary records. [2025-10-01T22:38:08.766094] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-01T22:38:08.767128] [DEBUG] [MAIN ] CXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:08.768995] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30989 primary records. [2025-10-01T22:38:08.778091] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-01T22:38:08.815453] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-01T22:38:08.816683] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-01T22:38:08.819265] [INFO ] [MAIN ] Derivative Progress: 467/1587 symbols completed. CXM took 1.2s. Estimated remaining: 7m 49s. Rate: 143.4 symbols/min [2025-10-01T22:38:08.831704] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:08.832349] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-01T22:38:08.834303] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-01T22:38:08.837260] [INFO ] [MAIN ] Derivative Progress: 468/1587 symbols completed. CXT took 1.3s. Estimated remaining: 7m 47s. Rate: 143.7 symbols/min [2025-10-01T22:38:08.838774] [DEBUG] [LOCAL ] CXW: Loaded 44030 existing records from primary storage. [2025-10-01T22:38:08.837706] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:08.839044] [INFO ] [MAIN ] CXW: Loaded 44030 primary data records. [2025-10-01T22:38:09.007584] [DEBUG] [LOCAL ] CYD: Loaded 26522 existing records from primary storage. [2025-10-01T22:38:09.025854] [INFO ] [MAIN ] CYD: Loaded 26522 primary data records. [2025-10-01T22:38:09.357749] [DEBUG] [LOCAL ] CYH: Loaded 47530 existing records from primary storage. [2025-10-01T22:38:09.363878] [INFO ] [MAIN ] CYH: Loaded 47530 primary data records. [2025-10-01T22:38:09.926011] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:09.927703] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44030 primary records. [2025-10-01T22:38:09.928013] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-01T22:38:09.949914] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-01T22:38:09.963975] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-01T22:38:09.964356] [DEBUG] [MAIN ] CYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:09.965432] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26522 primary records. [2025-10-01T22:38:09.965579] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-01T22:38:09.967733] [INFO ] [MAIN ] Derivative Progress: 469/1587 symbols completed. CXW took 1.2s. Estimated remaining: 7m 48s. Rate: 143.2 symbols/min [2025-10-01T22:38:09.968274] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:10.007839] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:10.014324] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47530 primary records. [2025-10-01T22:38:10.008588] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-01T22:38:10.014717] [DEBUG] [LOCAL ] DAC: Loaded 12526 existing records from primary storage. [2025-10-01T22:38:10.014927] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-01T22:38:10.015397] [INFO ] [MAIN ] DAC: Loaded 12526 primary data records. [2025-10-01T22:38:10.015464] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-01T22:38:10.030459] [INFO ] [MAIN ] Derivative Progress: 470/1587 symbols completed. CYD took 1.2s. Estimated remaining: 7m 47s. Rate: 143.4 symbols/min [2025-10-01T22:38:10.063861] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:10.147994] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-01T22:38:10.148181] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-01T22:38:10.150764] [INFO ] [MAIN ] Derivative Progress: 471/1587 symbols completed. CYH took 1.3s. Estimated remaining: 7m 46s. Rate: 143.7 symbols/min [2025-10-01T22:38:10.161368] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:10.401512] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-01T22:38:10.402029] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-01T22:38:10.553082] [DEBUG] [MAIN ] DAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:10.576763] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12526 primary records. [2025-10-01T22:38:10.593988] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-01T22:38:10.588722] [DEBUG] [LOCAL ] DAN: Loaded 48976 existing records from primary storage. [2025-10-01T22:38:10.618557] [INFO ] [MAIN ] DAN: Loaded 48976 primary data records. [2025-10-01T22:38:11.012099] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-01T22:38:11.037576] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-01T22:38:11.049418] [INFO ] [MAIN ] Derivative Progress: 472/1587 symbols completed. DAC took 1.1s. Estimated remaining: 7m 47s. Rate: 143.3 symbols/min [2025-10-01T22:38:11.203694] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:11.238886] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:11.247574] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-01T22:38:11.248520] [DEBUG] [LOCAL ] DAO: Loaded 20913 existing records from primary storage. [2025-10-01T22:38:11.249097] [INFO ] [MAIN ] DAO: Loaded 20913 primary data records. [2025-10-01T22:38:11.249015] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-01T22:38:11.402225] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-01T22:38:11.407843] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-01T22:38:11.428879] [INFO ] [MAIN ] Derivative Progress: 473/1587 symbols completed. DAL took 1.4s. Estimated remaining: 7m 46s. Rate: 143.3 symbols/min [2025-10-01T22:38:11.456828] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:11.497744] [DEBUG] [MAIN ] DAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:11.499183] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 48976 primary records. [2025-10-01T22:38:11.503493] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-01T22:38:11.648010] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-01T22:38:11.649051] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-01T22:38:11.651200] [INFO ] [MAIN ] Derivative Progress: 474/1587 symbols completed. DAN took 1.5s. Estimated remaining: 7m 45s. Rate: 143.5 symbols/min [2025-10-01T22:38:11.651885] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:11.689162] [DEBUG] [MAIN ] DAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:11.689998] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 20913 primary records. [2025-10-01T22:38:11.690227] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-01T22:38:11.706964] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-01T22:38:11.707260] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-01T22:38:11.709907] [INFO ] [MAIN ] Derivative Progress: 475/1587 symbols completed. DAO took 0.5s. Estimated remaining: 7m 44s. Rate: 143.7 symbols/min [2025-10-01T22:38:11.725290] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:11.727080] [DEBUG] [LOCAL ] DAR: Loaded 51846 existing records from primary storage. [2025-10-01T22:38:11.727372] [INFO ] [MAIN ] DAR: Loaded 51846 primary data records. [2025-10-01T22:38:11.874444] [DEBUG] [LOCAL ] DAY: Loaded 49528 existing records from primary storage. [2025-10-01T22:38:11.890611] [INFO ] [MAIN ] DAY: Loaded 49528 primary data records. [2025-10-01T22:38:12.270499] [DEBUG] [LOCAL ] DB: Loaded 52580 existing records from primary storage. [2025-10-01T22:38:12.281726] [INFO ] [MAIN ] DB: Loaded 52580 primary data records. [2025-10-01T22:38:12.831521] [DEBUG] [MAIN ] DAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:12.832943] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51846 primary records. [2025-10-01T22:38:12.833239] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-01T22:38:12.851604] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-01T22:38:12.852330] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-01T22:38:12.854725] [INFO ] [MAIN ] Derivative Progress: 476/1587 symbols completed. DAR took 1.4s. Estimated remaining: 7m 45s. Rate: 143.2 symbols/min [2025-10-01T22:38:12.854883] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:12.873061] [DEBUG] [MAIN ] DAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:12.873843] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49528 primary records. [2025-10-01T22:38:12.874031] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-01T22:38:12.892440] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-10-01T22:38:12.892863] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-01T22:38:12.895268] [INFO ] [MAIN ] Derivative Progress: 477/1587 symbols completed. DAY took 1.2s. Estimated remaining: 7m 44s. Rate: 143.5 symbols/min [2025-10-01T22:38:12.895796] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:12.922599] [DEBUG] [MAIN ] DB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:12.923392] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52580 primary records. [2025-10-01T22:38:12.923579] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-01T22:38:12.940727] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-01T22:38:12.953232] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-01T22:38:12.955949] [INFO ] [MAIN ] Derivative Progress: 478/1587 symbols completed. DB took 1.2s. Estimated remaining: 7m 43s. Rate: 143.8 symbols/min [2025-10-01T22:38:12.957209] [DEBUG] [LOCAL ] DBI: Loaded 44591 existing records from primary storage. [2025-10-01T22:38:12.957566] [INFO ] [MAIN ] DBI: Loaded 44591 primary data records. [2025-10-01T22:38:13.185471] [DEBUG] [LOCAL ] DBRG: Loaded 49736 existing records from primary storage. [2025-10-01T22:38:13.316556] [INFO ] [MAIN ] DBRG: Loaded 49736 primary data records. [2025-10-01T22:38:13.702253] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:13.703189] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 44591 primary records. [2025-10-01T22:38:13.703587] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-01T22:38:13.720991] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-01T22:38:13.721134] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-01T22:38:13.723275] [INFO ] [MAIN ] Derivative Progress: 479/1587 symbols completed. DBI took 0.9s. Estimated remaining: 7m 43s. Rate: 143.5 symbols/min [2025-10-01T22:38:13.740353] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:13.740983] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49736 primary records. [2025-10-01T22:38:13.741046] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-01T22:38:13.757566] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-01T22:38:13.757632] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-01T22:38:13.760161] [INFO ] [MAIN ] Derivative Progress: 480/1587 symbols completed. DBRG took 0.9s. Estimated remaining: 7m 42s. Rate: 143.8 symbols/min [2025-10-01T22:38:13.760744] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:13.760543] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:13.760638] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:13.776366] [DEBUG] [LOCAL ] DCO: Loaded 13871 existing records from primary storage. [2025-10-01T22:38:13.776704] [INFO ] [MAIN ] DCO: Loaded 13871 primary data records. [2025-10-01T22:38:14.022520] [DEBUG] [LOCAL ] DCI: Loaded 37344 existing records from primary storage. [2025-10-01T22:38:14.040691] [INFO ] [MAIN ] DCI: Loaded 37344 primary data records. [2025-10-01T22:38:14.063578] [DEBUG] [LOCAL ] DD: Loaded 52826 existing records from primary storage. [2025-10-01T22:38:14.211912] [INFO ] [MAIN ] DD: Loaded 52826 primary data records. [2025-10-01T22:38:14.954607] [DEBUG] [MAIN ] DCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:14.955921] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13871 primary records. [2025-10-01T22:38:14.956299] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-01T22:38:14.987364] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-01T22:38:14.987997] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-01T22:38:14.990934] [INFO ] [MAIN ] Derivative Progress: 481/1587 symbols completed. DCO took 1.2s. Estimated remaining: 7m 43s. Rate: 143.2 symbols/min [2025-10-01T22:38:14.991286] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:15.038560] [DEBUG] [MAIN ] DCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:15.039250] [DEBUG] [MAIN ] DD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:15.040477] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37344 primary records. [2025-10-01T22:38:15.040586] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-01T22:38:15.055871] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52826 primary records. [2025-10-01T22:38:15.056595] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-01T22:38:15.080792] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-10-01T22:38:15.103677] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-01T22:38:15.107339] [INFO ] [MAIN ] Derivative Progress: 482/1587 symbols completed. DD took 1.3s. Estimated remaining: 7m 42s. Rate: 143.4 symbols/min [2025-10-01T22:38:15.107737] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-01T22:38:15.107990] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:15.107877] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-01T22:38:15.111944] [INFO ] [MAIN ] Derivative Progress: 483/1587 symbols completed. DCI took 1.4s. Estimated remaining: 7m 41s. Rate: 143.7 symbols/min [2025-10-01T22:38:15.112234] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:15.146540] [DEBUG] [LOCAL ] DDD: Loaded 50889 existing records from primary storage. [2025-10-01T22:38:15.152022] [INFO ] [MAIN ] DDD: Loaded 50889 primary data records. [2025-10-01T22:38:15.214878] [DEBUG] [LOCAL ] DDS: Loaded 13050 existing records from primary storage. [2025-10-01T22:38:15.215107] [INFO ] [MAIN ] DDS: Loaded 13050 primary data records. [2025-10-01T22:38:15.562302] [DEBUG] [LOCAL ] DDL: Loaded 36749 existing records from primary storage. [2025-10-01T22:38:15.604164] [INFO ] [MAIN ] DDL: Loaded 36749 primary data records. [2025-10-01T22:38:16.453191] [DEBUG] [MAIN ] DDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:16.453534] [DEBUG] [MAIN ] DDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:16.454790] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 13050 primary records. [2025-10-01T22:38:16.455514] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50889 primary records. [2025-10-01T22:38:16.455667] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-01T22:38:16.456244] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-01T22:38:16.490490] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-10-01T22:38:16.493426] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-01T22:38:16.493920] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-01T22:38:16.493555] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-01T22:38:16.496223] [INFO ] [MAIN ] Derivative Progress: 484/1587 symbols completed. DDD took 1.5s. Estimated remaining: 7m 43s. Rate: 143.0 symbols/min [2025-10-01T22:38:16.496591] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:16.498911] [INFO ] [MAIN ] Derivative Progress: 485/1587 symbols completed. DDS took 1.4s. Estimated remaining: 7m 41s. Rate: 143.3 symbols/min [2025-10-01T22:38:16.500465] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:16.505919] [DEBUG] [LOCAL ] DDT: Loaded 2079 existing records from primary storage. [2025-10-01T22:38:16.506228] [INFO ] [MAIN ] DDT: Loaded 2079 primary data records. [2025-10-01T22:38:16.628261] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:16.641672] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36749 primary records. [2025-10-01T22:38:16.641820] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-01T22:38:16.869347] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-01T22:38:16.879721] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-01T22:38:16.882592] [INFO ] [MAIN ] Derivative Progress: 486/1587 symbols completed. DDL took 1.8s. Estimated remaining: 7m 41s. Rate: 143.3 symbols/min [2025-10-01T22:38:16.882968] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:16.899865] [DEBUG] [LOCAL ] DE: Loaded 47563 existing records from primary storage. [2025-10-01T22:38:16.900748] [INFO ] [MAIN ] DE: Loaded 47563 primary data records. [2025-10-01T22:38:17.259501] [DEBUG] [LOCAL ] DEA: Loaded 40853 existing records from primary storage. [2025-10-01T22:38:17.259899] [INFO ] [MAIN ] DEA: Loaded 40853 primary data records. [2025-10-01T22:38:17.374223] [DEBUG] [MAIN ] DDT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:38:17.386020] [INFO ] [MAIN ] DDT: Generated 1793 derivative records from 2079 primary records. [2025-10-01T22:38:17.392454] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-01T22:38:17.707488] [DEBUG] [LOCAL ] DDT: Derivative data saved (1793 records). [2025-10-01T22:38:17.709187] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-01T22:38:17.711481] [INFO ] [MAIN ] Derivative Progress: 487/1587 symbols completed. DDT took 1.2s. Estimated remaining: 7m 41s. Rate: 143.0 symbols/min [2025-10-01T22:38:17.711750] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:17.726753] [DEBUG] [MAIN ] DE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:17.728614] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47563 primary records. [2025-10-01T22:38:17.730039] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-01T22:38:17.751118] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-01T22:38:17.759921] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-01T22:38:17.762380] [INFO ] [MAIN ] Derivative Progress: 488/1587 symbols completed. DE took 1.3s. Estimated remaining: 7m 40s. Rate: 143.3 symbols/min [2025-10-01T22:38:17.762769] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:17.777582] [DEBUG] [LOCAL ] DEC: Loaded 30451 existing records from primary storage. [2025-10-01T22:38:17.781205] [INFO ] [MAIN ] DEC: Loaded 30451 primary data records. [2025-10-01T22:38:17.868958] [DEBUG] [MAIN ] DEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:17.902416] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40853 primary records. [2025-10-01T22:38:17.912390] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-01T22:38:18.180209] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-10-01T22:38:18.180446] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-01T22:38:18.183011] [INFO ] [MAIN ] Derivative Progress: 489/1587 symbols completed. DEA took 1.3s. Estimated remaining: 7m 40s. Rate: 143.3 symbols/min [2025-10-01T22:38:18.183357] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:18.184771] [DEBUG] [LOCAL ] DEI: Loaded 48359 existing records from primary storage. [2025-10-01T22:38:18.185900] [INFO ] [MAIN ] DEI: Loaded 48359 primary data records. [2025-10-01T22:38:18.589434] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-10-01T22:38:18.590507] [DEBUG] [MAIN ] DEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:18.591262] [INFO ] [MAIN ] DELL: Loaded 53735 primary data records. [2025-10-01T22:38:18.592325] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30451 primary records. [2025-10-01T22:38:18.592495] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-01T22:38:18.728720] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-10-01T22:38:18.729316] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-01T22:38:18.742002] [INFO ] [MAIN ] Derivative Progress: 490/1587 symbols completed. DEC took 1.0s. Estimated remaining: 7m 40s. Rate: 143.2 symbols/min [2025-10-01T22:38:18.747406] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:18.947808] [DEBUG] [MAIN ] DEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:18.957822] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48359 primary records. [2025-10-01T22:38:18.958140] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-01T22:38:18.986280] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-10-01T22:38:18.986946] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-01T22:38:18.989124] [INFO ] [MAIN ] Derivative Progress: 491/1587 symbols completed. DEI took 1.2s. Estimated remaining: 7m 39s. Rate: 143.3 symbols/min [2025-10-01T22:38:18.989497] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:19.002840] [DEBUG] [LOCAL ] DFH: Loaded 32278 existing records from primary storage. [2025-10-01T22:38:19.003338] [INFO ] [MAIN ] DFH: Loaded 32278 primary data records. [2025-10-01T22:38:19.137694] [DEBUG] [LOCAL ] DFIN: Loaded 23029 existing records from primary storage. [2025-10-01T22:38:19.176748] [INFO ] [MAIN ] DFIN: Loaded 23029 primary data records. [2025-10-01T22:38:19.240808] [DEBUG] [MAIN ] DELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:19.411889] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53735 primary records. [2025-10-01T22:38:19.430367] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-01T22:38:19.504501] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-10-01T22:38:19.538457] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-01T22:38:19.559922] [INFO ] [MAIN ] Derivative Progress: 492/1587 symbols completed. DELL took 1.4s. Estimated remaining: 7m 39s. Rate: 143.2 symbols/min [2025-10-01T22:38:19.578905] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:19.739436] [DEBUG] [LOCAL ] DFP: Loaded 11445 existing records from primary storage. [2025-10-01T22:38:19.739058] [DEBUG] [MAIN ] DFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:19.739912] [INFO ] [MAIN ] DFP: Loaded 11445 primary data records. [2025-10-01T22:38:19.740627] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32278 primary records. [2025-10-01T22:38:19.748026] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-01T22:38:19.951376] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-10-01T22:38:19.962779] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-01T22:38:19.981196] [INFO ] [MAIN ] Derivative Progress: 493/1587 symbols completed. DFH took 1.2s. Estimated remaining: 7m 38s. Rate: 143.2 symbols/min [2025-10-01T22:38:20.016048] [DEBUG] [MAIN ] DFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:20.032616] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23029 primary records. [2025-10-01T22:38:20.039095] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-01T22:38:20.190994] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-10-01T22:38:20.191403] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-01T22:38:20.194968] [INFO ] [MAIN ] Derivative Progress: 494/1587 symbols completed. DFIN took 1.2s. Estimated remaining: 7m 37s. Rate: 143.4 symbols/min [2025-10-01T22:38:20.216982] [DEBUG] [MAIN ] DFP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:20.217682] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11445 primary records. [2025-10-01T22:38:20.217756] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-01T22:38:20.235169] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-01T22:38:20.235311] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-01T22:38:20.237997] [INFO ] [MAIN ] Derivative Progress: 495/1587 symbols completed. DFP took 0.7s. Estimated remaining: 7m 36s. Rate: 143.6 symbols/min [2025-10-01T22:38:20.238549] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:20.238492] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:20.238692] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:20.263828] [DEBUG] [LOCAL ] DHF: Loaded 20944 existing records from primary storage. [2025-10-01T22:38:20.264095] [INFO ] [MAIN ] DHF: Loaded 20944 primary data records. [2025-10-01T22:38:20.438307] [DEBUG] [LOCAL ] DGX: Loaded 44915 existing records from primary storage. [2025-10-01T22:38:20.465840] [INFO ] [MAIN ] DGX: Loaded 44915 primary data records. [2025-10-01T22:38:20.683954] [DEBUG] [LOCAL ] DG: Loaded 53283 existing records from primary storage. [2025-10-01T22:38:20.737233] [INFO ] [MAIN ] DG: Loaded 53283 primary data records. [2025-10-01T22:38:21.331917] [DEBUG] [MAIN ] DHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:21.333827] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 20944 primary records. [2025-10-01T22:38:21.334496] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-01T22:38:21.355680] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-10-01T22:38:21.357082] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-01T22:38:21.359797] [INFO ] [MAIN ] Derivative Progress: 496/1587 symbols completed. DHF took 1.1s. Estimated remaining: 7m 37s. Rate: 143.1 symbols/min [2025-10-01T22:38:21.360043] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:21.374709] [DEBUG] [MAIN ] DGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:21.375906] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44915 primary records. [2025-10-01T22:38:21.376024] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-01T22:38:21.392997] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-10-01T22:38:21.393116] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-01T22:38:21.395263] [INFO ] [MAIN ] Derivative Progress: 497/1587 symbols completed. DGX took 1.2s. Estimated remaining: 7m 36s. Rate: 143.4 symbols/min [2025-10-01T22:38:21.395463] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:21.413808] [DEBUG] [MAIN ] DG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:21.414699] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53283 primary records. [2025-10-01T22:38:21.414841] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-01T22:38:21.437034] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-10-01T22:38:21.437187] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-01T22:38:21.440003] [INFO ] [MAIN ] Derivative Progress: 498/1587 symbols completed. DG took 1.2s. Estimated remaining: 7m 35s. Rate: 143.7 symbols/min [2025-10-01T22:38:21.440250] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:21.484224] [DEBUG] [LOCAL ] DHX: Loaded 13054 existing records from primary storage. [2025-10-01T22:38:21.484419] [INFO ] [MAIN ] DHX: Loaded 13054 primary data records. [2025-10-01T22:38:21.611976] [DEBUG] [LOCAL ] DHT: Loaded 47876 existing records from primary storage. [2025-10-01T22:38:21.635776] [INFO ] [MAIN ] DHT: Loaded 47876 primary data records. [2025-10-01T22:38:21.658626] [DEBUG] [LOCAL ] DHR: Loaded 53366 existing records from primary storage. [2025-10-01T22:38:21.694008] [INFO ] [MAIN ] DHR: Loaded 53366 primary data records. [2025-10-01T22:38:22.569332] [DEBUG] [MAIN ] DHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:22.570592] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13054 primary records. [2025-10-01T22:38:22.572859] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-01T22:38:22.591500] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-10-01T22:38:22.592016] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-01T22:38:22.594055] [INFO ] [MAIN ] Derivative Progress: 499/1587 symbols completed. DHX took 1.2s. Estimated remaining: 7m 36s. Rate: 143.2 symbols/min [2025-10-01T22:38:22.594674] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:22.619022] [DEBUG] [MAIN ] DHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:22.622242] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47876 primary records. [2025-10-01T22:38:22.622391] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-01T22:38:22.646967] [DEBUG] [MAIN ] DHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:22.651754] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53366 primary records. [2025-10-01T22:38:22.661593] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-01T22:38:22.666275] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-10-01T22:38:22.674008] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-01T22:38:22.691663] [INFO ] [MAIN ] Derivative Progress: 500/1587 symbols completed. DHT took 1.3s. Estimated remaining: 7m 35s. Rate: 143.4 symbols/min [2025-10-01T22:38:22.697391] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-10-01T22:38:22.695243] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:22.697528] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-01T22:38:22.701915] [INFO ] [MAIN ] Derivative Progress: 501/1587 symbols completed. DHR took 1.3s. Estimated remaining: 7m 34s. Rate: 143.6 symbols/min [2025-10-01T22:38:22.702512] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:22.698318] [DEBUG] [LOCAL ] DIN: Loaded 37210 existing records from primary storage. [2025-10-01T22:38:22.703776] [INFO ] [MAIN ] DIN: Loaded 37210 primary data records. [2025-10-01T22:38:23.107851] [DEBUG] [LOCAL ] DINO: Loaded 52932 existing records from primary storage. [2025-10-01T22:38:23.108816] [INFO ] [MAIN ] DINO: Loaded 52932 primary data records. [2025-10-01T22:38:23.223155] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-01T22:38:23.240193] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-01T22:38:23.837251] [DEBUG] [MAIN ] DIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:23.839940] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37210 primary records. [2025-10-01T22:38:23.840824] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-01T22:38:23.860788] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-01T22:38:23.861336] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-01T22:38:23.864002] [INFO ] [MAIN ] Derivative Progress: 502/1587 symbols completed. DIN took 1.3s. Estimated remaining: 7m 35s. Rate: 143.1 symbols/min [2025-10-01T22:38:23.865288] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:23.882781] [DEBUG] [MAIN ] DINO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:23.883591] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52932 primary records. [2025-10-01T22:38:23.883854] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-01T22:38:23.901174] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-01T22:38:23.902438] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-01T22:38:23.906280] [INFO ] [MAIN ] Derivative Progress: 503/1587 symbols completed. DINO took 1.2s. Estimated remaining: 7m 34s. Rate: 143.4 symbols/min [2025-10-01T22:38:23.906702] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:23.921072] [DEBUG] [MAIN ] DIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:23.921978] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-10-01T22:38:23.922166] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-01T22:38:23.966144] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-10-01T22:38:23.966426] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-01T22:38:23.985323] [DEBUG] [LOCAL ] DKL: Loaded 18651 existing records from primary storage. [2025-10-01T22:38:23.984893] [INFO ] [MAIN ] Derivative Progress: 504/1587 symbols completed. DIS took 1.3s. Estimated remaining: 7m 32s. Rate: 143.6 symbols/min [2025-10-01T22:38:23.987189] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:23.987345] [INFO ] [MAIN ] DKL: Loaded 18651 primary data records. [2025-10-01T22:38:24.010571] [DEBUG] [LOCAL ] DK: Loaded 49338 existing records from primary storage. [2025-10-01T22:38:24.062898] [INFO ] [MAIN ] DK: Loaded 49338 primary data records. [2025-10-01T22:38:24.710445] [DEBUG] [LOCAL ] DKS: Loaded 49749 existing records from primary storage. [2025-10-01T22:38:24.710760] [INFO ] [MAIN ] DKS: Loaded 49749 primary data records. [2025-10-01T22:38:25.052456] [DEBUG] [MAIN ] DKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:25.063255] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 18651 primary records. [2025-10-01T22:38:25.063472] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-01T22:38:25.086316] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-01T22:38:25.086738] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-01T22:38:25.088907] [INFO ] [MAIN ] Derivative Progress: 505/1587 symbols completed. DKL took 1.2s. Estimated remaining: 7m 33s. Rate: 143.2 symbols/min [2025-10-01T22:38:25.102230] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:25.104402] [DEBUG] [MAIN ] DK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:25.105318] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49338 primary records. [2025-10-01T22:38:25.105429] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-01T22:38:25.125227] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-10-01T22:38:25.125403] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-01T22:38:25.127859] [INFO ] [MAIN ] Derivative Progress: 506/1587 symbols completed. DK took 1.3s. Estimated remaining: 7m 32s. Rate: 143.4 symbols/min [2025-10-01T22:38:25.128445] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:25.150221] [DEBUG] [LOCAL ] DLNG: Loaded 6106 existing records from primary storage. [2025-10-01T22:38:25.151269] [INFO ] [MAIN ] DLNG: Loaded 6106 primary data records. [2025-10-01T22:38:25.236052] [DEBUG] [MAIN ] DKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:25.265693] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49749 primary records. [2025-10-01T22:38:25.291805] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-01T22:38:25.279593] [DEBUG] [LOCAL ] DLB: Loaded 32001 existing records from primary storage. [2025-10-01T22:38:25.302742] [INFO ] [MAIN ] DLB: Loaded 32001 primary data records. [2025-10-01T22:38:25.645479] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-10-01T22:38:25.645813] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-01T22:38:25.659152] [INFO ] [MAIN ] Derivative Progress: 507/1587 symbols completed. DKS took 1.7s. Estimated remaining: 7m 32s. Rate: 143.3 symbols/min [2025-10-01T22:38:25.670978] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:25.886186] [DEBUG] [MAIN ] DLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:25.888089] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6106 primary records. [2025-10-01T22:38:25.888187] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-01T22:38:25.903922] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-10-01T22:38:25.904117] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-01T22:38:25.906186] [INFO ] [MAIN ] Derivative Progress: 508/1587 symbols completed. DLNG took 0.8s. Estimated remaining: 7m 31s. Rate: 143.5 symbols/min [2025-10-01T22:38:25.943737] [DEBUG] [MAIN ] DLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:25.944754] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32001 primary records. [2025-10-01T22:38:25.944927] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-01T22:38:25.975623] [DEBUG] [LOCAL ] DLR: Loaded 50958 existing records from primary storage. [2025-10-01T22:38:25.976537] [INFO ] [MAIN ] DLR: Loaded 50958 primary data records. [2025-10-01T22:38:26.024283] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-10-01T22:38:26.059536] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-01T22:38:26.078898] [INFO ] [MAIN ] Derivative Progress: 509/1587 symbols completed. DLB took 1.0s. Estimated remaining: 7m 30s. Rate: 143.6 symbols/min [2025-10-01T22:38:26.340889] [DEBUG] [MAIN ] DLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:26.341598] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50958 primary records. [2025-10-01T22:38:26.341687] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-01T22:38:26.358133] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-01T22:38:26.358217] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-01T22:38:26.361032] [INFO ] [MAIN ] Derivative Progress: 510/1587 symbols completed. DLR took 0.7s. Estimated remaining: 7m 30s. Rate: 143.7 symbols/min [2025-10-01T22:38:26.362326] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:26.362539] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:26.362410] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:26.370216] [DEBUG] [LOCAL ] DMA: Loaded 4559 existing records from primary storage. [2025-10-01T22:38:26.370415] [INFO ] [MAIN ] DMA: Loaded 4559 primary data records. [2025-10-01T22:38:26.545926] [DEBUG] [LOCAL ] DLY: Loaded 19878 existing records from primary storage. [2025-10-01T22:38:26.601060] [INFO ] [MAIN ] DLY: Loaded 19878 primary data records. [2025-10-01T22:38:26.774591] [DEBUG] [LOCAL ] DLX: Loaded 28490 existing records from primary storage. [2025-10-01T22:38:26.788439] [INFO ] [MAIN ] DLX: Loaded 28490 primary data records. [2025-10-01T22:38:27.437308] [DEBUG] [MAIN ] DMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:27.440562] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4559 primary records. [2025-10-01T22:38:27.442143] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-01T22:38:27.462220] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-10-01T22:38:27.462572] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-01T22:38:27.465118] [INFO ] [MAIN ] Derivative Progress: 511/1587 symbols completed. DMA took 1.1s. Estimated remaining: 7m 31s. Rate: 143.3 symbols/min [2025-10-01T22:38:27.465317] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:27.484697] [DEBUG] [MAIN ] DLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:27.489933] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19878 primary records. [2025-10-01T22:38:27.490130] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-01T22:38:27.517533] [DEBUG] [LOCAL ] DMB: Loaded 10218 existing records from primary storage. [2025-10-01T22:38:27.517755] [INFO ] [MAIN ] DMB: Loaded 10218 primary data records. [2025-10-01T22:38:27.528905] [DEBUG] [MAIN ] DLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:27.535096] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28490 primary records. [2025-10-01T22:38:27.544465] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-01T22:38:27.556087] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-10-01T22:38:27.581131] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-01T22:38:27.637407] [INFO ] [MAIN ] Derivative Progress: 512/1587 symbols completed. DLY took 1.3s. Estimated remaining: 7m 30s. Rate: 143.4 symbols/min [2025-10-01T22:38:27.643160] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:27.866941] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-01T22:38:27.883010] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-01T22:38:27.886090] [INFO ] [MAIN ] Derivative Progress: 513/1587 symbols completed. DLX took 1.5s. Estimated remaining: 7m 29s. Rate: 143.5 symbols/min [2025-10-01T22:38:27.886329] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:27.917741] [DEBUG] [LOCAL ] DNP: Loaded 33239 existing records from primary storage. [2025-10-01T22:38:27.918411] [INFO ] [MAIN ] DNP: Loaded 33239 primary data records. [2025-10-01T22:38:28.294099] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-10-01T22:38:28.296943] [DEBUG] [MAIN ] DMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:28.298028] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10218 primary records. [2025-10-01T22:38:28.298297] [INFO ] [MAIN ] DOC: Loaded 53542 primary data records. [2025-10-01T22:38:28.298407] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-01T22:38:28.431040] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-10-01T22:38:28.446577] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-01T22:38:28.470797] [INFO ] [MAIN ] Derivative Progress: 514/1587 symbols completed. DMB took 1.0s. Estimated remaining: 7m 29s. Rate: 143.4 symbols/min [2025-10-01T22:38:28.495899] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:28.729620] [DEBUG] [MAIN ] DNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:28.730714] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33239 primary records. [2025-10-01T22:38:28.731148] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-01T22:38:28.755053] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-01T22:38:28.755512] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-01T22:38:28.758265] [INFO ] [MAIN ] Derivative Progress: 515/1587 symbols completed. DNP took 1.1s. Estimated remaining: 7m 28s. Rate: 143.5 symbols/min [2025-10-01T22:38:28.758728] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:28.791829] [DEBUG] [MAIN ] DOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:28.792628] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53542 primary records. [2025-10-01T22:38:28.792827] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-01T22:38:28.810139] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-01T22:38:28.825317] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-01T22:38:28.828027] [INFO ] [MAIN ] Derivative Progress: 516/1587 symbols completed. DOC took 0.9s. Estimated remaining: 7m 27s. Rate: 143.7 symbols/min [2025-10-01T22:38:28.829377] [DEBUG] [LOCAL ] DOCN: Loaded 50567 existing records from primary storage. [2025-10-01T22:38:28.829594] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:28.829739] [INFO ] [MAIN ] DOCN: Loaded 50567 primary data records. [2025-10-01T22:38:29.027576] [DEBUG] [LOCAL ] DOCS: Loaded 51126 existing records from primary storage. [2025-10-01T22:38:29.046031] [INFO ] [MAIN ] DOCS: Loaded 51126 primary data records. [2025-10-01T22:38:29.337770] [DEBUG] [LOCAL ] DOLE: Loaded 38416 existing records from primary storage. [2025-10-01T22:38:29.339781] [INFO ] [MAIN ] DOLE: Loaded 38416 primary data records. [2025-10-01T22:38:29.914888] [DEBUG] [MAIN ] DOCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:29.916864] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50567 primary records. [2025-10-01T22:38:29.917097] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-01T22:38:29.937163] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-01T22:38:29.937769] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-01T22:38:29.940337] [INFO ] [MAIN ] Derivative Progress: 517/1587 symbols completed. DOCN took 1.4s. Estimated remaining: 7m 28s. Rate: 143.3 symbols/min [2025-10-01T22:38:29.940838] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:29.960997] [DEBUG] [MAIN ] DOCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:29.962110] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 51126 primary records. [2025-10-01T22:38:29.962382] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-01T22:38:30.006617] [DEBUG] [MAIN ] DOLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:30.008148] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 38416 primary records. [2025-10-01T22:38:30.007242] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-10-01T22:38:30.018277] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-01T22:38:30.018490] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-01T22:38:30.020871] [INFO ] [MAIN ] Derivative Progress: 518/1587 symbols completed. DOCS took 1.3s. Estimated remaining: 7m 27s. Rate: 143.5 symbols/min [2025-10-01T22:38:30.021098] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:30.022702] [DEBUG] [LOCAL ] DOUG: Loaded 34405 existing records from primary storage. [2025-10-01T22:38:30.023484] [INFO ] [MAIN ] DOUG: Loaded 34405 primary data records. [2025-10-01T22:38:30.156898] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-10-01T22:38:30.161309] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-01T22:38:30.164263] [INFO ] [MAIN ] Derivative Progress: 519/1587 symbols completed. DOLE took 1.3s. Estimated remaining: 7m 26s. Rate: 143.7 symbols/min [2025-10-01T22:38:30.169828] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:30.402404] [DEBUG] [LOCAL ] DOV: Loaded 45454 existing records from primary storage. [2025-10-01T22:38:30.403364] [INFO ] [MAIN ] DOV: Loaded 45454 primary data records. [2025-10-01T22:38:30.819084] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-01T22:38:30.819370] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-01T22:38:31.150963] [DEBUG] [MAIN ] DOUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:31.167852] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34405 primary records. [2025-10-01T22:38:31.168301] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-01T22:38:31.192250] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-10-01T22:38:31.193029] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-01T22:38:31.203363] [INFO ] [MAIN ] Derivative Progress: 520/1587 symbols completed. DOUG took 1.3s. Estimated remaining: 7m 27s. Rate: 143.3 symbols/min [2025-10-01T22:38:31.207940] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:31.209505] [DEBUG] [MAIN ] DOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:31.210488] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45454 primary records. [2025-10-01T22:38:31.211177] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-01T22:38:31.230478] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-01T22:38:31.235085] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-01T22:38:31.238216] [INFO ] [MAIN ] Derivative Progress: 521/1587 symbols completed. DOV took 1.2s. Estimated remaining: 7m 26s. Rate: 143.5 symbols/min [2025-10-01T22:38:31.238942] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:31.250484] [DEBUG] [LOCAL ] DPG: Loaded 13579 existing records from primary storage. [2025-10-01T22:38:31.250887] [INFO ] [MAIN ] DPG: Loaded 13579 primary data records. [2025-10-01T22:38:31.278051] [DEBUG] [MAIN ] DOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:31.294169] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-10-01T22:38:31.317045] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-01T22:38:31.512347] [DEBUG] [LOCAL ] DRD: Loaded 36953 existing records from primary storage. [2025-10-01T22:38:31.547362] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-10-01T22:38:31.662488] [INFO ] [MAIN ] DRD: Loaded 36953 primary data records. [2025-10-01T22:38:31.672503] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-01T22:38:31.704796] [INFO ] [MAIN ] Derivative Progress: 522/1587 symbols completed. DOW took 1.5s. Estimated remaining: 7m 25s. Rate: 143.5 symbols/min [2025-10-01T22:38:31.731372] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:32.074882] [DEBUG] [MAIN ] DPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:32.076251] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13579 primary records. [2025-10-01T22:38:32.092487] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-01T22:38:32.094692] [DEBUG] [LOCAL ] DRH: Loaded 50489 existing records from primary storage. [2025-10-01T22:38:32.095282] [INFO ] [MAIN ] DRH: Loaded 50489 primary data records. [2025-10-01T22:38:32.242899] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-01T22:38:32.253728] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-01T22:38:32.267410] [INFO ] [MAIN ] Derivative Progress: 523/1587 symbols completed. DPG took 1.1s. Estimated remaining: 7m 25s. Rate: 143.4 symbols/min [2025-10-01T22:38:32.471957] [DEBUG] [MAIN ] DRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:32.482730] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 36953 primary records. [2025-10-01T22:38:32.482800] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-01T22:38:32.501770] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-01T22:38:32.502292] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-01T22:38:32.504622] [INFO ] [MAIN ] Derivative Progress: 524/1587 symbols completed. DRD took 1.3s. Estimated remaining: 7m 24s. Rate: 143.5 symbols/min [2025-10-01T22:38:32.525235] [DEBUG] [MAIN ] DRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:32.526020] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50489 primary records. [2025-10-01T22:38:32.526094] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-01T22:38:32.541723] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-10-01T22:38:32.541812] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-01T22:38:32.544475] [INFO ] [MAIN ] Derivative Progress: 525/1587 symbols completed. DRH took 0.8s. Estimated remaining: 7m 23s. Rate: 143.8 symbols/min [2025-10-01T22:38:32.545061] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:32.545206] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:32.545343] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:32.550374] [DEBUG] [LOCAL ] DSMC: Loaded 1887 existing records from primary storage. [2025-10-01T22:38:32.550702] [INFO ] [MAIN ] DSMC: Loaded 1887 primary data records. [2025-10-01T22:38:32.652370] [DEBUG] [LOCAL ] DRLL: Loaded 9443 existing records from primary storage. [2025-10-01T22:38:32.679846] [INFO ] [MAIN ] DRLL: Loaded 9443 primary data records. [2025-10-01T22:38:32.868154] [DEBUG] [LOCAL ] DSL: Loaded 28410 existing records from primary storage. [2025-10-01T22:38:32.909460] [INFO ] [MAIN ] DSL: Loaded 28410 primary data records. [2025-10-01T22:38:33.651378] [DEBUG] [MAIN ] DSMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:33.653132] [INFO ] [MAIN ] DSMC: Generated 1794 derivative records from 1887 primary records. [2025-10-01T22:38:33.653401] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-01T22:38:33.686145] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1794 records). [2025-10-01T22:38:33.686471] [DEBUG] [MAIN ] DRLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:33.687478] [INFO ] [MAIN ] DRLL: Generated 1794 derivative records from 9443 primary records. [2025-10-01T22:38:33.687574] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-01T22:38:33.686761] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-01T22:38:33.690325] [INFO ] [MAIN ] Derivative Progress: 526/1587 symbols completed. DSMC took 1.1s. Estimated remaining: 7m 24s. Rate: 143.3 symbols/min [2025-10-01T22:38:33.690926] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:33.730757] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1794 records). [2025-10-01T22:38:33.731248] [DEBUG] [MAIN ] DSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:33.731399] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-01T22:38:33.734868] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28410 primary records. [2025-10-01T22:38:33.733944] [INFO ] [MAIN ] Derivative Progress: 527/1587 symbols completed. DRLL took 1.2s. Estimated remaining: 7m 23s. Rate: 143.5 symbols/min [2025-10-01T22:38:33.735099] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-01T22:38:33.735236] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:33.744426] [DEBUG] [LOCAL ] DSU: Loaded 22542 existing records from primary storage. [2025-10-01T22:38:33.744845] [INFO ] [MAIN ] DSU: Loaded 22542 primary data records. [2025-10-01T22:38:33.852196] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-10-01T22:38:33.871289] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-01T22:38:33.886747] [INFO ] [MAIN ] Derivative Progress: 528/1587 symbols completed. DSL took 1.3s. Estimated remaining: 7m 22s. Rate: 143.7 symbols/min [2025-10-01T22:38:33.887543] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:34.025480] [DEBUG] [LOCAL ] DSX: Loaded 24050 existing records from primary storage. [2025-10-01T22:38:34.106460] [INFO ] [MAIN ] DSX: Loaded 24050 primary data records. [2025-10-01T22:38:34.477470] [DEBUG] [LOCAL ] DT: Loaded 52927 existing records from primary storage. [2025-10-01T22:38:34.478738] [INFO ] [MAIN ] DT: Loaded 52927 primary data records. [2025-10-01T22:38:34.637352] [DEBUG] [MAIN ] DSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:34.699693] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22542 primary records. [2025-10-01T22:38:34.700118] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-01T22:38:34.859207] [DEBUG] [MAIN ] DSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:34.860084] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-01T22:38:34.860985] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24050 primary records. [2025-10-01T22:38:34.861131] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-01T22:38:34.863718] [INFO ] [MAIN ] Derivative Progress: 529/1587 symbols completed. DSU took 1.2s. Estimated remaining: 7m 23s. Rate: 143.3 symbols/min [2025-10-01T22:38:34.861285] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-01T22:38:34.865238] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:34.886683] [DEBUG] [LOCAL ] DTB: Loaded 4913 existing records from primary storage. [2025-10-01T22:38:34.887858] [INFO ] [MAIN ] DTB: Loaded 4913 primary data records. [2025-10-01T22:38:34.954754] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-10-01T22:38:34.970115] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-01T22:38:34.989808] [INFO ] [MAIN ] Derivative Progress: 530/1587 symbols completed. DSX took 1.3s. Estimated remaining: 7m 22s. Rate: 143.5 symbols/min [2025-10-01T22:38:34.994768] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:35.023065] [DEBUG] [MAIN ] DT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:35.028472] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52927 primary records. [2025-10-01T22:38:35.028691] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-01T22:38:35.134631] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-10-01T22:38:35.290423] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-01T22:38:35.306796] [INFO ] [MAIN ] Derivative Progress: 531/1587 symbols completed. DT took 1.4s. Estimated remaining: 7m 21s. Rate: 143.6 symbols/min [2025-10-01T22:38:35.307791] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:35.319639] [DEBUG] [LOCAL ] DTG: Loaded 5956 existing records from primary storage. [2025-10-01T22:38:35.319829] [INFO ] [MAIN ] DTG: Loaded 5956 primary data records. [2025-10-01T22:38:35.505091] [DEBUG] [LOCAL ] DTE: Loaded 47740 existing records from primary storage. [2025-10-01T22:38:35.559101] [INFO ] [MAIN ] DTE: Loaded 47740 primary data records. [2025-10-01T22:38:35.781781] [DEBUG] [MAIN ] DTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:35.808213] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 4913 primary records. [2025-10-01T22:38:35.824448] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-01T22:38:36.078853] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-10-01T22:38:36.078987] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-01T22:38:36.081364] [INFO ] [MAIN ] Derivative Progress: 532/1587 symbols completed. DTB took 1.2s. Estimated remaining: 7m 22s. Rate: 143.4 symbols/min [2025-10-01T22:38:36.081895] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:36.104585] [DEBUG] [MAIN ] DTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:36.106419] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5956 primary records. [2025-10-01T22:38:36.106591] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-01T22:38:36.125934] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-10-01T22:38:36.126069] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-01T22:38:36.128354] [INFO ] [MAIN ] Derivative Progress: 533/1587 symbols completed. DTG took 0.8s. Estimated remaining: 7m 20s. Rate: 143.6 symbols/min [2025-10-01T22:38:36.128676] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:36.145866] [DEBUG] [MAIN ] DTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:36.160910] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47740 primary records. [2025-10-01T22:38:36.161132] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-01T22:38:36.178292] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-10-01T22:38:36.178428] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-01T22:38:36.180864] [INFO ] [MAIN ] Derivative Progress: 534/1587 symbols completed. DTE took 1.2s. Estimated remaining: 7m 19s. Rate: 143.8 symbols/min [2025-10-01T22:38:36.181236] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:36.201621] [DEBUG] [LOCAL ] DV: Loaded 51286 existing records from primary storage. [2025-10-01T22:38:36.201939] [INFO ] [MAIN ] DV: Loaded 51286 primary data records. [2025-10-01T22:38:36.381898] [DEBUG] [LOCAL ] DVA: Loaded 41054 existing records from primary storage. [2025-10-01T22:38:36.433758] [INFO ] [MAIN ] DVA: Loaded 41054 primary data records. [2025-10-01T22:38:36.730385] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-01T22:38:36.747374] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-10-01T22:38:37.154779] [DEBUG] [MAIN ] DV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:37.188948] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51286 primary records. [2025-10-01T22:38:37.190105] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-01T22:38:37.379574] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-01T22:38:37.380768] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-01T22:38:37.383493] [INFO ] [MAIN ] Derivative Progress: 535/1587 symbols completed. DV took 1.3s. Estimated remaining: 7m 20s. Rate: 143.3 symbols/min [2025-10-01T22:38:37.383833] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:37.401821] [DEBUG] [MAIN ] DVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:37.402634] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41054 primary records. [2025-10-01T22:38:37.402952] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-01T22:38:37.420795] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-01T22:38:37.421132] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-01T22:38:37.423514] [INFO ] [MAIN ] Derivative Progress: 536/1587 symbols completed. DVA took 1.3s. Estimated remaining: 7m 19s. Rate: 143.6 symbols/min [2025-10-01T22:38:37.423979] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:37.441754] [DEBUG] [MAIN ] DVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:37.442467] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-10-01T22:38:37.442604] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-01T22:38:37.474067] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-10-01T22:38:37.474231] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-01T22:38:37.476980] [INFO ] [MAIN ] Derivative Progress: 537/1587 symbols completed. DVN took 1.3s. Estimated remaining: 7m 18s. Rate: 143.8 symbols/min [2025-10-01T22:38:37.477241] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:37.510169] [DEBUG] [LOCAL ] DX: Loaded 52464 existing records from primary storage. [2025-10-01T22:38:37.510332] [INFO ] [MAIN ] DX: Loaded 52464 primary data records. [2025-10-01T22:38:37.665634] [DEBUG] [LOCAL ] DXC: Loaded 49790 existing records from primary storage. [2025-10-01T22:38:37.692894] [INFO ] [MAIN ] DXC: Loaded 49790 primary data records. [2025-10-01T22:38:37.698939] [DEBUG] [LOCAL ] DXYZ: Loaded 36866 existing records from primary storage. [2025-10-01T22:38:37.709282] [INFO ] [MAIN ] DXYZ: Loaded 36866 primary data records. [2025-10-01T22:38:38.582368] [DEBUG] [MAIN ] DX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:38.584164] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52464 primary records. [2025-10-01T22:38:38.584438] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-01T22:38:38.602386] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-10-01T22:38:38.602580] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-01T22:38:38.604695] [INFO ] [MAIN ] Derivative Progress: 538/1587 symbols completed. DX took 1.2s. Estimated remaining: 7m 19s. Rate: 143.4 symbols/min [2025-10-01T22:38:38.623112] [DEBUG] [MAIN ] DXYZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:38:38.625228] [INFO ] [MAIN ] DXYZ: Generated 1793 derivative records from 36866 primary records. [2025-10-01T22:38:38.625419] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-01T22:38:38.645936] [DEBUG] [MAIN ] DXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:38.650305] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49790 primary records. [2025-10-01T22:38:38.654487] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1793 records). [2025-10-01T22:38:38.654547] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-01T22:38:38.654946] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-01T22:38:38.657492] [INFO ] [MAIN ] Derivative Progress: 539/1587 symbols completed. DXYZ took 1.2s. Estimated remaining: 7m 18s. Rate: 143.6 symbols/min [2025-10-01T22:38:38.673320] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-10-01T22:38:38.673394] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-01T22:38:38.676483] [INFO ] [MAIN ] Derivative Progress: 540/1587 symbols completed. DXC took 1.3s. Estimated remaining: 7m 17s. Rate: 143.9 symbols/min [2025-10-01T22:38:38.676929] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:38.677057] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:38.677099] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:38.684850] [DEBUG] [LOCAL ] EAI: Loaded 3969 existing records from primary storage. [2025-10-01T22:38:38.685120] [INFO ] [MAIN ] EAI: Loaded 3969 primary data records. [2025-10-01T22:38:39.037783] [DEBUG] [LOCAL ] DY: Loaded 29088 existing records from primary storage. [2025-10-01T22:38:39.048330] [INFO ] [MAIN ] DY: Loaded 29088 primary data records. [2025-10-01T22:38:39.063175] [DEBUG] [LOCAL ] E: Loaded 33300 existing records from primary storage. [2025-10-01T22:38:39.074888] [INFO ] [MAIN ] E: Loaded 33300 primary data records. [2025-10-01T22:38:39.800183] [DEBUG] [MAIN ] EAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:39.803064] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3969 primary records. [2025-10-01T22:38:39.803200] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-01T22:38:39.827230] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-10-01T22:38:39.828213] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-01T22:38:39.830819] [INFO ] [MAIN ] Derivative Progress: 541/1587 symbols completed. EAI took 1.2s. Estimated remaining: 7m 18s. Rate: 143.4 symbols/min [2025-10-01T22:38:39.832799] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:39.867039] [DEBUG] [MAIN ] DY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:39.868416] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 29088 primary records. [2025-10-01T22:38:39.868520] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-01T22:38:39.867410] [DEBUG] [MAIN ] E: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:39.870286] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33300 primary records. [2025-10-01T22:38:39.870425] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-01T22:38:39.905353] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-10-01T22:38:39.906737] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-01T22:38:39.909616] [INFO ] [MAIN ] Derivative Progress: 542/1587 symbols completed. E took 1.2s. Estimated remaining: 7m 17s. Rate: 143.6 symbols/min [2025-10-01T22:38:39.910749] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:39.911119] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-01T22:38:39.919820] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-01T22:38:39.922616] [INFO ] [MAIN ] Derivative Progress: 543/1587 symbols completed. DY took 1.2s. Estimated remaining: 7m 15s. Rate: 143.9 symbols/min [2025-10-01T22:38:39.923662] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:39.936373] [DEBUG] [LOCAL ] EARN: Loaded 29659 existing records from primary storage. [2025-10-01T22:38:39.936605] [INFO ] [MAIN ] EARN: Loaded 29659 primary data records. [2025-10-01T22:38:40.307998] [DEBUG] [LOCAL ] EB: Loaded 37100 existing records from primary storage. [2025-10-01T22:38:40.322075] [INFO ] [MAIN ] EB: Loaded 37100 primary data records. [2025-10-01T22:38:40.334929] [DEBUG] [LOCAL ] EAT: Loaded 49771 existing records from primary storage. [2025-10-01T22:38:40.370331] [INFO ] [MAIN ] EAT: Loaded 49771 primary data records. [2025-10-01T22:38:41.002819] [DEBUG] [MAIN ] EARN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:41.006793] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 29659 primary records. [2025-10-01T22:38:41.007368] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-01T22:38:41.026793] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-10-01T22:38:41.027356] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-01T22:38:41.030221] [INFO ] [MAIN ] Derivative Progress: 544/1587 symbols completed. EARN took 1.2s. Estimated remaining: 7m 16s. Rate: 143.4 symbols/min [2025-10-01T22:38:41.030787] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:41.049070] [DEBUG] [MAIN ] EB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:41.049791] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 37100 primary records. [2025-10-01T22:38:41.049884] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-01T22:38:41.088927] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-10-01T22:38:41.093309] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-01T22:38:41.097252] [INFO ] [MAIN ] Derivative Progress: 545/1587 symbols completed. EB took 1.2s. Estimated remaining: 7m 15s. Rate: 143.6 symbols/min [2025-10-01T22:38:41.095181] [DEBUG] [LOCAL ] EBF: Loaded 19238 existing records from primary storage. [2025-10-01T22:38:41.097587] [INFO ] [MAIN ] EBF: Loaded 19238 primary data records. [2025-10-01T22:38:41.097973] [DEBUG] [MAIN ] EAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:41.103347] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:41.121604] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49771 primary records. [2025-10-01T22:38:41.159211] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-01T22:38:41.240555] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-10-01T22:38:41.257052] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-01T22:38:41.316234] [INFO ] [MAIN ] Derivative Progress: 546/1587 symbols completed. EAT took 1.4s. Estimated remaining: 7m 14s. Rate: 143.8 symbols/min [2025-10-01T22:38:41.430683] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:41.474026] [DEBUG] [LOCAL ] EBR: Loaded 43061 existing records from primary storage. [2025-10-01T22:38:41.474379] [INFO ] [MAIN ] EBR: Loaded 43061 primary data records. [2025-10-01T22:38:41.662036] [DEBUG] [LOCAL ] ECAT: Loaded 29543 existing records from primary storage. [2025-10-01T22:38:41.706624] [INFO ] [MAIN ] ECAT: Loaded 29543 primary data records. [2025-10-01T22:38:41.899571] [DEBUG] [MAIN ] EBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:41.911293] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19238 primary records. [2025-10-01T22:38:41.947447] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-01T22:38:42.132921] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-10-01T22:38:42.254204] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-01T22:38:42.265854] [INFO ] [MAIN ] Derivative Progress: 547/1587 symbols completed. EBF took 1.2s. Estimated remaining: 7m 15s. Rate: 143.4 symbols/min [2025-10-01T22:38:42.266281] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:42.287761] [DEBUG] [MAIN ] EBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:42.288600] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43061 primary records. [2025-10-01T22:38:42.289386] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-01T22:38:42.307188] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-01T22:38:42.307446] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-01T22:38:42.309956] [INFO ] [MAIN ] Derivative Progress: 548/1587 symbols completed. EBR took 1.2s. Estimated remaining: 7m 14s. Rate: 143.7 symbols/min [2025-10-01T22:38:42.310302] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:42.340712] [DEBUG] [MAIN ] ECAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:42.354451] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29543 primary records. [2025-10-01T22:38:42.354686] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-01T22:38:42.356804] [DEBUG] [LOCAL ] ECC: Loaded 43320 existing records from primary storage. [2025-10-01T22:38:42.357227] [INFO ] [MAIN ] ECC: Loaded 43320 primary data records. [2025-10-01T22:38:42.444434] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-01T22:38:42.484768] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-01T22:38:42.510793] [DEBUG] [LOCAL ] ECG: Loaded 33834 existing records from primary storage. [2025-10-01T22:38:42.514419] [INFO ] [MAIN ] ECG: Loaded 33834 primary data records. [2025-10-01T22:38:42.514263] [INFO ] [MAIN ] Derivative Progress: 549/1587 symbols completed. ECAT took 1.1s. Estimated remaining: 7m 13s. Rate: 143.8 symbols/min [2025-10-01T22:38:42.543022] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:43.116542] [DEBUG] [LOCAL ] ECL: Loaded 46734 existing records from primary storage. [2025-10-01T22:38:43.130251] [INFO ] [MAIN ] ECL: Loaded 46734 primary data records. [2025-10-01T22:38:43.131335] [DEBUG] [MAIN ] ECC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:43.168888] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43320 primary records. [2025-10-01T22:38:43.181861] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-01T22:38:43.270423] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-01T22:38:43.276202] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-01T22:38:43.299422] [INFO ] [MAIN ] Derivative Progress: 550/1587 symbols completed. ECC took 1.0s. Estimated remaining: 7m 13s. Rate: 143.6 symbols/min [2025-10-01T22:38:43.315387] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:43.505506] [DEBUG] [MAIN ] ECG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:43.506908] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33834 primary records. [2025-10-01T22:38:43.507565] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-01T22:38:43.540156] [DEBUG] [LOCAL ] ECO: Loaded 18402 existing records from primary storage. [2025-10-01T22:38:43.541808] [INFO ] [MAIN ] ECO: Loaded 18402 primary data records. [2025-10-01T22:38:43.579849] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-01T22:38:43.585333] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-01T22:38:43.590179] [INFO ] [MAIN ] Derivative Progress: 551/1587 symbols completed. ECG took 1.3s. Estimated remaining: 7m 13s. Rate: 143.6 symbols/min [2025-10-01T22:38:43.604069] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:43.781611] [DEBUG] [MAIN ] ECL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:43.940571] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46734 primary records. [2025-10-01T22:38:43.949231] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-01T22:38:43.971771] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-01T22:38:43.986378] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-01T22:38:43.989204] [INFO ] [MAIN ] Derivative Progress: 552/1587 symbols completed. ECL took 1.4s. Estimated remaining: 7m 12s. Rate: 143.7 symbols/min [2025-10-01T22:38:43.989560] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:44.029135] [DEBUG] [LOCAL ] ED: Loaded 52758 existing records from primary storage. [2025-10-01T22:38:44.029780] [INFO ] [MAIN ] ED: Loaded 52758 primary data records. [2025-10-01T22:38:44.029979] [DEBUG] [MAIN ] ECO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:44.030821] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18402 primary records. [2025-10-01T22:38:44.050321] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-01T22:38:44.184905] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-01T22:38:44.206342] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-01T22:38:44.190814] [DEBUG] [LOCAL ] EDD: Loaded 27172 existing records from primary storage. [2025-10-01T22:38:44.218538] [INFO ] [MAIN ] Derivative Progress: 553/1587 symbols completed. ECO took 0.9s. Estimated remaining: 7m 12s. Rate: 143.8 symbols/min [2025-10-01T22:38:44.245444] [INFO ] [MAIN ] EDD: Loaded 27172 primary data records. [2025-10-01T22:38:44.795202] [DEBUG] [MAIN ] ED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:44.796445] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52758 primary records. [2025-10-01T22:38:44.796582] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-01T22:38:44.815162] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-01T22:38:44.816142] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-01T22:38:44.819244] [INFO ] [MAIN ] Derivative Progress: 554/1587 symbols completed. ED took 1.2s. Estimated remaining: 7m 11s. Rate: 143.7 symbols/min [2025-10-01T22:38:44.832255] [DEBUG] [MAIN ] EDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:44.832968] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27172 primary records. [2025-10-01T22:38:44.833033] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-01T22:38:44.848185] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-01T22:38:44.848259] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-01T22:38:44.851117] [INFO ] [MAIN ] Derivative Progress: 555/1587 symbols completed. EDD took 0.9s. Estimated remaining: 7m 10s. Rate: 143.9 symbols/min [2025-10-01T22:38:44.851845] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:44.851766] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:44.852186] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:44.874434] [DEBUG] [LOCAL ] EDF: Loaded 13369 existing records from primary storage. [2025-10-01T22:38:44.874690] [INFO ] [MAIN ] EDF: Loaded 13369 primary data records. [2025-10-01T22:38:44.932011] [DEBUG] [LOCAL ] EDN: Loaded 18154 existing records from primary storage. [2025-10-01T22:38:44.938093] [INFO ] [MAIN ] EDN: Loaded 18154 primary data records. [2025-10-01T22:38:45.197684] [DEBUG] [LOCAL ] EDU: Loaded 44983 existing records from primary storage. [2025-10-01T22:38:45.203138] [INFO ] [MAIN ] EDU: Loaded 44983 primary data records. [2025-10-01T22:38:46.029387] [DEBUG] [MAIN ] EDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:46.032058] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13369 primary records. [2025-10-01T22:38:46.032539] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-01T22:38:46.059228] [DEBUG] [MAIN ] EDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:46.064414] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18154 primary records. [2025-10-01T22:38:46.064621] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-01T22:38:46.064888] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-01T22:38:46.065187] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-01T22:38:46.067844] [INFO ] [MAIN ] Derivative Progress: 556/1587 symbols completed. EDF took 1.2s. Estimated remaining: 7m 11s. Rate: 143.4 symbols/min [2025-10-01T22:38:46.068544] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:46.097233] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-01T22:38:46.101964] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-01T22:38:46.104779] [INFO ] [MAIN ] Derivative Progress: 557/1587 symbols completed. EDN took 1.3s. Estimated remaining: 7m 10s. Rate: 143.6 symbols/min [2025-10-01T22:38:46.105521] [DEBUG] [MAIN ] EDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:46.106526] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44983 primary records. [2025-10-01T22:38:46.105626] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:46.106711] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-01T22:38:46.132512] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-10-01T22:38:46.132830] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-01T22:38:46.135155] [INFO ] [MAIN ] Derivative Progress: 558/1587 symbols completed. EDU took 1.3s. Estimated remaining: 7m 9s. Rate: 143.9 symbols/min [2025-10-01T22:38:46.135521] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:46.146319] [DEBUG] [LOCAL ] EEX: Loaded 11493 existing records from primary storage. [2025-10-01T22:38:46.147097] [INFO ] [MAIN ] EEX: Loaded 11493 primary data records. [2025-10-01T22:38:46.214795] [DEBUG] [LOCAL ] EE: Loaded 32474 existing records from primary storage. [2025-10-01T22:38:46.270404] [DEBUG] [LOCAL ] EFR: Loaded 14641 existing records from primary storage. [2025-10-01T22:38:46.264634] [INFO ] [MAIN ] EE: Loaded 32474 primary data records. [2025-10-01T22:38:46.278774] [INFO ] [MAIN ] EFR: Loaded 14641 primary data records. [2025-10-01T22:38:47.202845] [DEBUG] [MAIN ] EEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:47.203706] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 11493 primary records. [2025-10-01T22:38:47.203895] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-01T22:38:47.238759] [DEBUG] [MAIN ] EE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:47.240408] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32474 primary records. [2025-10-01T22:38:47.241176] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-01T22:38:47.242084] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-01T22:38:47.242917] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-01T22:38:47.245711] [INFO ] [MAIN ] Derivative Progress: 559/1587 symbols completed. EEX took 1.1s. Estimated remaining: 7m 10s. Rate: 143.5 symbols/min [2025-10-01T22:38:47.267244] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:47.271987] [DEBUG] [MAIN ] EFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:47.277077] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-01T22:38:47.273510] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14641 primary records. [2025-10-01T22:38:47.277628] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-01T22:38:47.280079] [INFO ] [MAIN ] Derivative Progress: 560/1587 symbols completed. EE took 1.2s. Estimated remaining: 7m 9s. Rate: 143.7 symbols/min [2025-10-01T22:38:47.277755] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-01T22:38:47.281347] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:47.302356] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-01T22:38:47.302661] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-01T22:38:47.305223] [INFO ] [MAIN ] Derivative Progress: 561/1587 symbols completed. EFR took 1.2s. Estimated remaining: 7m 8s. Rate: 143.9 symbols/min [2025-10-01T22:38:47.305592] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:47.312141] [DEBUG] [LOCAL ] EFT: Loaded 12910 existing records from primary storage. [2025-10-01T22:38:47.312269] [INFO ] [MAIN ] EFT: Loaded 12910 primary data records. [2025-10-01T22:38:47.554688] [DEBUG] [LOCAL ] EFXT: Loaded 29191 existing records from primary storage. [2025-10-01T22:38:47.647975] [INFO ] [MAIN ] EFXT: Loaded 29191 primary data records. [2025-10-01T22:38:47.724398] [DEBUG] [LOCAL ] EFX: Loaded 44522 existing records from primary storage. [2025-10-01T22:38:47.751398] [INFO ] [MAIN ] EFX: Loaded 44522 primary data records. [2025-10-01T22:38:48.468885] [DEBUG] [MAIN ] EFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:48.470231] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 12910 primary records. [2025-10-01T22:38:48.470447] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-01T22:38:48.496766] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-10-01T22:38:48.513156] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-01T22:38:48.516022] [INFO ] [MAIN ] Derivative Progress: 562/1587 symbols completed. EFT took 1.2s. Estimated remaining: 7m 9s. Rate: 143.4 symbols/min [2025-10-01T22:38:48.516329] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:48.517120] [DEBUG] [MAIN ] EFXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:48.518107] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29191 primary records. [2025-10-01T22:38:48.519500] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-01T22:38:48.551065] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-01T22:38:48.551713] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-01T22:38:48.551505] [DEBUG] [MAIN ] EFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:48.553897] [INFO ] [MAIN ] Derivative Progress: 563/1587 symbols completed. EFXT took 1.2s. Estimated remaining: 7m 8s. Rate: 143.7 symbols/min [2025-10-01T22:38:48.555057] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44522 primary records. [2025-10-01T22:38:48.555230] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-01T22:38:48.554130] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:48.575439] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-10-01T22:38:48.575689] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-01T22:38:48.578249] [INFO ] [MAIN ] Derivative Progress: 564/1587 symbols completed. EFX took 1.3s. Estimated remaining: 7m 6s. Rate: 143.9 symbols/min [2025-10-01T22:38:48.578502] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:48.655273] [DEBUG] [LOCAL ] EGP: Loaded 30897 existing records from primary storage. [2025-10-01T22:38:48.655451] [DEBUG] [LOCAL ] EGO: Loaded 51595 existing records from primary storage. [2025-10-01T22:38:48.655597] [INFO ] [MAIN ] EGO: Loaded 51595 primary data records. [2025-10-01T22:38:48.661375] [INFO ] [MAIN ] EGP: Loaded 30897 primary data records. [2025-10-01T22:38:48.950975] [DEBUG] [LOCAL ] EGY: Loaded 42122 existing records from primary storage. [2025-10-01T22:38:49.033469] [INFO ] [MAIN ] EGY: Loaded 42122 primary data records. [2025-10-01T22:38:49.709178] [DEBUG] [MAIN ] EGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:49.711317] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51595 primary records. [2025-10-01T22:38:49.711945] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-01T22:38:49.739324] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-01T22:38:49.739795] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-01T22:38:49.744893] [INFO ] [MAIN ] Derivative Progress: 565/1587 symbols completed. EGO took 1.2s. Estimated remaining: 7m 7s. Rate: 143.5 symbols/min [2025-10-01T22:38:49.750890] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:49.763943] [DEBUG] [MAIN ] EGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:49.765025] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30897 primary records. [2025-10-01T22:38:49.765791] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-01T22:38:49.796982] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-01T22:38:49.802860] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-01T22:38:49.805692] [INFO ] [MAIN ] Derivative Progress: 566/1587 symbols completed. EGP took 1.3s. Estimated remaining: 7m 6s. Rate: 143.7 symbols/min [2025-10-01T22:38:49.805965] [DEBUG] [MAIN ] EGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:49.807354] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42122 primary records. [2025-10-01T22:38:49.806308] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:49.807607] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-01T22:38:49.835941] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-01T22:38:49.836161] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-01T22:38:49.839810] [INFO ] [MAIN ] Derivative Progress: 567/1587 symbols completed. EGY took 1.3s. Estimated remaining: 7m 5s. Rate: 143.9 symbols/min [2025-10-01T22:38:49.840252] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:49.852606] [DEBUG] [LOCAL ] EHAB: Loaded 29662 existing records from primary storage. [2025-10-01T22:38:49.853003] [INFO ] [MAIN ] EHAB: Loaded 29662 primary data records. [2025-10-01T22:38:49.990439] [DEBUG] [LOCAL ] EHI: Loaded 10613 existing records from primary storage. [2025-10-01T22:38:50.002927] [INFO ] [MAIN ] EHI: Loaded 10613 primary data records. [2025-10-01T22:38:50.059627] [DEBUG] [LOCAL ] EHC: Loaded 41099 existing records from primary storage. [2025-10-01T22:38:50.108558] [INFO ] [MAIN ] EHC: Loaded 41099 primary data records. [2025-10-01T22:38:50.981994] [DEBUG] [MAIN ] EHAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:50.984012] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29662 primary records. [2025-10-01T22:38:50.984617] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-01T22:38:51.006057] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-10-01T22:38:51.006228] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-01T22:38:51.010034] [INFO ] [MAIN ] Derivative Progress: 568/1587 symbols completed. EHAB took 1.3s. Estimated remaining: 7m 6s. Rate: 143.5 symbols/min [2025-10-01T22:38:51.028866] [DEBUG] [MAIN ] EHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:51.029715] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10613 primary records. [2025-10-01T22:38:51.029800] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-01T22:38:51.061951] [DEBUG] [MAIN ] EHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:51.062047] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-10-01T22:38:51.063123] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41099 primary records. [2025-10-01T22:38:51.063242] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-01T22:38:51.063336] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-01T22:38:51.066364] [INFO ] [MAIN ] Derivative Progress: 569/1587 symbols completed. EHI took 1.2s. Estimated remaining: 7m 5s. Rate: 143.7 symbols/min [2025-10-01T22:38:51.083881] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-10-01T22:38:51.084041] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-01T22:38:51.087559] [INFO ] [MAIN ] Derivative Progress: 570/1587 symbols completed. EHC took 1.3s. Estimated remaining: 7m 4s. Rate: 143.9 symbols/min [2025-10-01T22:38:51.088132] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:51.088267] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:51.088360] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:51.112030] [DEBUG] [LOCAL ] EIG: Loaded 20325 existing records from primary storage. [2025-10-01T22:38:51.112476] [INFO ] [MAIN ] EIG: Loaded 20325 primary data records. [2025-10-01T22:38:51.496516] [DEBUG] [LOCAL ] EL: Loaded 53392 existing records from primary storage. [2025-10-01T22:38:51.497403] [DEBUG] [LOCAL ] EIX: Loaded 53338 existing records from primary storage. [2025-10-01T22:38:51.497513] [INFO ] [MAIN ] EIX: Loaded 53338 primary data records. [2025-10-01T22:38:51.497607] [INFO ] [MAIN ] EL: Loaded 53392 primary data records. [2025-10-01T22:38:52.221832] [DEBUG] [MAIN ] EIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:52.224618] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20325 primary records. [2025-10-01T22:38:52.225196] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-01T22:38:52.245109] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-01T22:38:52.245466] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-01T22:38:52.248583] [INFO ] [MAIN ] Derivative Progress: 571/1587 symbols completed. EIG took 1.2s. Estimated remaining: 7m 5s. Rate: 143.5 symbols/min [2025-10-01T22:38:52.254673] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:52.272952] [DEBUG] [MAIN ] EIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:52.274163] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53338 primary records. [2025-10-01T22:38:52.286849] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-01T22:38:52.288530] [DEBUG] [MAIN ] EL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:52.289807] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53392 primary records. [2025-10-01T22:38:52.290168] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-01T22:38:52.318631] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-01T22:38:52.319905] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-01T22:38:52.323190] [INFO ] [MAIN ] Derivative Progress: 572/1587 symbols completed. EIX took 1.2s. Estimated remaining: 7m 4s. Rate: 143.7 symbols/min [2025-10-01T22:38:52.326267] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:52.326919] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-01T22:38:52.327056] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-01T22:38:52.329879] [INFO ] [MAIN ] Derivative Progress: 573/1587 symbols completed. EL took 1.2s. Estimated remaining: 7m 3s. Rate: 143.9 symbols/min [2025-10-01T22:38:52.330192] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:52.336113] [DEBUG] [LOCAL ] ELC: Loaded 3482 existing records from primary storage. [2025-10-01T22:38:52.336326] [INFO ] [MAIN ] ELC: Loaded 3482 primary data records. [2025-10-01T22:38:52.557012] [DEBUG] [LOCAL ] ELAN: Loaded 53254 existing records from primary storage. [2025-10-01T22:38:52.572527] [INFO ] [MAIN ] ELAN: Loaded 53254 primary data records. [2025-10-01T22:38:52.874547] [DEBUG] [LOCAL ] ELF: Loaded 52195 existing records from primary storage. [2025-10-01T22:38:52.905900] [INFO ] [MAIN ] ELF: Loaded 52195 primary data records. [2025-10-01T22:38:53.508254] [DEBUG] [MAIN ] ELC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:53.512333] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3482 primary records. [2025-10-01T22:38:53.512590] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-01T22:38:53.545095] [DEBUG] [MAIN ] ELAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:53.545809] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-10-01T22:38:53.546948] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53254 primary records. [2025-10-01T22:38:53.547224] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-01T22:38:53.550271] [INFO ] [MAIN ] Derivative Progress: 574/1587 symbols completed. ELC took 1.2s. Estimated remaining: 7m 4s. Rate: 143.4 symbols/min [2025-10-01T22:38:53.547413] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-01T22:38:53.550629] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:53.572713] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-01T22:38:53.586006] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-01T22:38:53.586356] [DEBUG] [MAIN ] ELF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:53.589768] [INFO ] [MAIN ] Derivative Progress: 575/1587 symbols completed. ELAN took 1.3s. Estimated remaining: 7m 3s. Rate: 143.7 symbols/min [2025-10-01T22:38:53.590941] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52195 primary records. [2025-10-01T22:38:53.591233] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-01T22:38:53.590098] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:53.620181] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-01T22:38:53.620300] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-01T22:38:53.622957] [INFO ] [MAIN ] Derivative Progress: 576/1587 symbols completed. ELF took 1.3s. Estimated remaining: 7m 2s. Rate: 143.9 symbols/min [2025-10-01T22:38:53.623239] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:53.661115] [DEBUG] [LOCAL ] ELME: Loaded 39181 existing records from primary storage. [2025-10-01T22:38:53.659842] [DEBUG] [LOCAL ] ELP: Loaded 25670 existing records from primary storage. [2025-10-01T22:38:53.661290] [INFO ] [MAIN ] ELME: Loaded 39181 primary data records. [2025-10-01T22:38:53.661440] [INFO ] [MAIN ] ELP: Loaded 25670 primary data records. [2025-10-01T22:38:54.366940] [DEBUG] [LOCAL ] ELS: Loaded 49457 existing records from primary storage. [2025-10-01T22:38:54.381700] [INFO ] [MAIN ] ELS: Loaded 49457 primary data records. [2025-10-01T22:38:54.808976] [DEBUG] [MAIN ] ELME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:54.810748] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39181 primary records. [2025-10-01T22:38:54.811635] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-01T22:38:54.843365] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-10-01T22:38:54.843728] [DEBUG] [MAIN ] ELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:54.844805] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25670 primary records. [2025-10-01T22:38:54.845030] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-01T22:38:54.847852] [INFO ] [MAIN ] Derivative Progress: 577/1587 symbols completed. ELME took 1.3s. Estimated remaining: 7m 3s. Rate: 143.4 symbols/min [2025-10-01T22:38:54.847956] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-01T22:38:54.848128] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:54.865962] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-10-01T22:38:54.866332] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-01T22:38:54.868868] [INFO ] [MAIN ] Derivative Progress: 578/1587 symbols completed. ELP took 1.3s. Estimated remaining: 7m 1s. Rate: 143.6 symbols/min [2025-10-01T22:38:54.869055] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:54.884230] [DEBUG] [LOCAL ] EMF: Loaded 3414 existing records from primary storage. [2025-10-01T22:38:54.889592] [INFO ] [MAIN ] EMF: Loaded 3414 primary data records. [2025-10-01T22:38:54.889900] [DEBUG] [MAIN ] ELS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:54.930630] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49457 primary records. [2025-10-01T22:38:54.937700] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-01T22:38:55.013685] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-10-01T22:38:55.026139] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-01T22:38:55.050945] [INFO ] [MAIN ] Derivative Progress: 579/1587 symbols completed. ELS took 1.4s. Estimated remaining: 7m 1s. Rate: 143.8 symbols/min [2025-10-01T22:38:55.073506] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:55.312827] [DEBUG] [LOCAL ] ELV: Loaded 50546 existing records from primary storage. [2025-10-01T22:38:55.313187] [INFO ] [MAIN ] ELV: Loaded 50546 primary data records. [2025-10-01T22:38:55.523809] [DEBUG] [LOCAL ] EMN: Loaded 50458 existing records from primary storage. [2025-10-01T22:38:55.539575] [INFO ] [MAIN ] EMN: Loaded 50458 primary data records. [2025-10-01T22:38:55.863136] [DEBUG] [MAIN ] EMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:55.887169] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3414 primary records. [2025-10-01T22:38:55.921215] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-01T22:38:56.063847] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-01T22:38:56.064308] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-01T22:38:56.066776] [INFO ] [MAIN ] Derivative Progress: 580/1587 symbols completed. EMF took 1.2s. Estimated remaining: 7m 1s. Rate: 143.4 symbols/min [2025-10-01T22:38:56.067604] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:56.089665] [DEBUG] [MAIN ] ELV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:56.090581] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50546 primary records. [2025-10-01T22:38:56.091214] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-01T22:38:56.110602] [DEBUG] [LOCAL ] EMO: Loaded 12527 existing records from primary storage. [2025-10-01T22:38:56.111029] [INFO ] [MAIN ] EMO: Loaded 12527 primary data records. [2025-10-01T22:38:56.128214] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-10-01T22:38:56.139451] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-01T22:38:56.142154] [INFO ] [MAIN ] Derivative Progress: 581/1587 symbols completed. ELV took 1.3s. Estimated remaining: 7m 0s. Rate: 143.6 symbols/min [2025-10-01T22:38:56.154570] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:56.259554] [DEBUG] [LOCAL ] EMP: Loaded 3063 existing records from primary storage. [2025-10-01T22:38:56.275463] [INFO ] [MAIN ] EMP: Loaded 3063 primary data records. [2025-10-01T22:38:56.371573] [DEBUG] [MAIN ] EMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:56.471836] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50458 primary records. [2025-10-01T22:38:56.593043] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-01T22:38:56.672046] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-01T22:38:56.703248] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-01T22:38:56.827445] [INFO ] [MAIN ] Derivative Progress: 582/1587 symbols completed. EMN took 1.8s. Estimated remaining: 7m 0s. Rate: 143.5 symbols/min [2025-10-01T22:38:56.828126] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:56.850201] [DEBUG] [MAIN ] EMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:56.851066] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12527 primary records. [2025-10-01T22:38:56.851760] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-01T22:38:56.870886] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-01T22:38:56.871299] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-01T22:38:56.873547] [INFO ] [MAIN ] Derivative Progress: 583/1587 symbols completed. EMO took 0.8s. Estimated remaining: 6m 59s. Rate: 143.7 symbols/min [2025-10-01T22:38:56.889920] [DEBUG] [MAIN ] EMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:56.890621] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 3063 primary records. [2025-10-01T22:38:56.890725] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-01T22:38:56.919296] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-10-01T22:38:56.919406] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-01T22:38:56.922022] [INFO ] [MAIN ] Derivative Progress: 584/1587 symbols completed. EMP took 0.8s. Estimated remaining: 6m 58s. Rate: 143.9 symbols/min [2025-10-01T22:38:56.940523] [DEBUG] [LOCAL ] EMR: Loaded 53250 existing records from primary storage. [2025-10-01T22:38:56.940704] [INFO ] [MAIN ] EMR: Loaded 53250 primary data records. [2025-10-01T22:38:57.303204] [DEBUG] [MAIN ] EMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:57.303875] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53250 primary records. [2025-10-01T22:38:57.303939] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-01T22:38:57.320360] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-10-01T22:38:57.320439] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-01T22:38:57.322835] [INFO ] [MAIN ] Derivative Progress: 585/1587 symbols completed. EMR took 0.5s. Estimated remaining: 6m 58s. Rate: 143.9 symbols/min [2025-10-01T22:38:57.323238] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:57.323338] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:57.323507] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:57.329575] [DEBUG] [LOCAL ] ENO: Loaded 1915 existing records from primary storage. [2025-10-01T22:38:57.329766] [INFO ] [MAIN ] ENO: Loaded 1915 primary data records. [2025-10-01T22:38:57.349316] [DEBUG] [LOCAL ] ENFY: Loaded 3099 existing records from primary storage. [2025-10-01T22:38:57.368016] [INFO ] [MAIN ] ENFY: Loaded 3099 primary data records. [2025-10-01T22:38:58.029195] [DEBUG] [LOCAL ] ENB: Loaded 53512 existing records from primary storage. [2025-10-01T22:38:58.029581] [INFO ] [MAIN ] ENB: Loaded 53512 primary data records. [2025-10-01T22:38:58.390101] [DEBUG] [MAIN ] ENFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:58.391309] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3099 primary records. [2025-10-01T22:38:58.391413] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-01T22:38:58.411822] [DEBUG] [MAIN ] ENO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:58.417051] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1915 primary records. [2025-10-01T22:38:58.421002] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-10-01T22:38:58.421205] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-01T22:38:58.418709] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-01T22:38:58.425478] [INFO ] [MAIN ] Derivative Progress: 586/1587 symbols completed. ENFY took 1.1s. Estimated remaining: 6m 58s. Rate: 143.5 symbols/min [2025-10-01T22:38:58.431716] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:58.443411] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-10-01T22:38:58.443566] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-01T22:38:58.446309] [INFO ] [MAIN ] Derivative Progress: 587/1587 symbols completed. ENO took 1.1s. Estimated remaining: 6m 57s. Rate: 143.8 symbols/min [2025-10-01T22:38:58.446718] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:58.461050] [DEBUG] [MAIN ] ENB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:58.461938] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53512 primary records. [2025-10-01T22:38:58.462053] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-01T22:38:58.481015] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-01T22:38:58.481160] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-01T22:38:58.483968] [INFO ] [MAIN ] Derivative Progress: 588/1587 symbols completed. ENB took 1.2s. Estimated remaining: 6m 56s. Rate: 144.0 symbols/min [2025-10-01T22:38:58.488029] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:58.536071] [DEBUG] [LOCAL ] ENOV: Loaded 44921 existing records from primary storage. [2025-10-01T22:38:58.536334] [INFO ] [MAIN ] ENOV: Loaded 44921 primary data records. [2025-10-01T22:38:58.666416] [DEBUG] [LOCAL ] ENR: Loaded 42858 existing records from primary storage. [2025-10-01T22:38:58.672484] [DEBUG] [LOCAL ] ENVA: Loaded 25283 existing records from primary storage. [2025-10-01T22:38:58.672706] [INFO ] [MAIN ] ENR: Loaded 42858 primary data records. [2025-10-01T22:38:58.683089] [INFO ] [MAIN ] ENVA: Loaded 25283 primary data records. [2025-10-01T22:38:59.642726] [DEBUG] [MAIN ] ENOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:59.646268] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44921 primary records. [2025-10-01T22:38:59.647486] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-01T22:38:59.663228] [DEBUG] [MAIN ] ENR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:59.675584] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 42858 primary records. [2025-10-01T22:38:59.675733] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-01T22:38:59.681298] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-10-01T22:38:59.691143] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-01T22:38:59.697588] [INFO ] [MAIN ] Derivative Progress: 589/1587 symbols completed. ENOV took 1.3s. Estimated remaining: 6m 57s. Rate: 143.5 symbols/min [2025-10-01T22:38:59.698273] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:59.716267] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-01T22:38:59.716541] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-01T22:38:59.720079] [INFO ] [MAIN ] Derivative Progress: 590/1587 symbols completed. ENR took 1.3s. Estimated remaining: 6m 56s. Rate: 143.7 symbols/min [2025-10-01T22:38:59.720390] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:59.720677] [DEBUG] [MAIN ] ENVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:38:59.722000] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25283 primary records. [2025-10-01T22:38:59.726467] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-01T22:38:59.748217] [DEBUG] [LOCAL ] EOD: Loaded 14412 existing records from primary storage. [2025-10-01T22:38:59.750524] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-01T22:38:59.750621] [INFO ] [MAIN ] EOD: Loaded 14412 primary data records. [2025-10-01T22:38:59.750815] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-01T22:38:59.753456] [INFO ] [MAIN ] Derivative Progress: 591/1587 symbols completed. ENVA took 1.3s. Estimated remaining: 6m 55s. Rate: 144.0 symbols/min [2025-10-01T22:38:59.765827] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:38:59.942182] [DEBUG] [LOCAL ] EOI: Loaded 10683 existing records from primary storage. [2025-10-01T22:38:59.973811] [INFO ] [MAIN ] EOI: Loaded 10683 primary data records. [2025-10-01T22:39:00.233146] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-01T22:39:00.247970] [INFO ] [MAIN ] EOG: Loaded 53344 primary data records. [2025-10-01T22:39:00.819970] [DEBUG] [MAIN ] EOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:00.821206] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14412 primary records. [2025-10-01T22:39:00.821970] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-01T22:39:00.839836] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-01T22:39:00.840303] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-01T22:39:00.842602] [INFO ] [MAIN ] Derivative Progress: 592/1587 symbols completed. EOD took 1.1s. Estimated remaining: 6m 56s. Rate: 143.6 symbols/min [2025-10-01T22:39:00.843103] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:00.861161] [DEBUG] [MAIN ] EOI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:00.861870] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10683 primary records. [2025-10-01T22:39:00.862194] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-01T22:39:00.905138] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-01T22:39:00.903899] [DEBUG] [LOCAL ] EOS: Loaded 15225 existing records from primary storage. [2025-10-01T22:39:00.905547] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-01T22:39:00.905619] [INFO ] [MAIN ] EOS: Loaded 15225 primary data records. [2025-10-01T22:39:00.905946] [DEBUG] [MAIN ] EOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:00.908452] [INFO ] [MAIN ] Derivative Progress: 593/1587 symbols completed. EOI took 1.1s. Estimated remaining: 6m 55s. Rate: 143.8 symbols/min [2025-10-01T22:39:00.908874] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:00.909798] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53344 primary records. [2025-10-01T22:39:00.948605] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-01T22:39:01.095957] [DEBUG] [LOCAL ] EOT: Loaded 6873 existing records from primary storage. [2025-10-01T22:39:01.117493] [INFO ] [MAIN ] EOT: Loaded 6873 primary data records. [2025-10-01T22:39:01.110435] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-01T22:39:01.180721] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-01T22:39:01.388123] [INFO ] [MAIN ] Derivative Progress: 594/1587 symbols completed. EOG took 1.7s. Estimated remaining: 6m 54s. Rate: 143.7 symbols/min [2025-10-01T22:39:01.416786] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:01.685334] [DEBUG] [LOCAL ] EPAC: Loaded 26946 existing records from primary storage. [2025-10-01T22:39:01.686806] [INFO ] [MAIN ] EPAC: Loaded 26946 primary data records. [2025-10-01T22:39:01.870727] [DEBUG] [MAIN ] EOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:01.882338] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15225 primary records. [2025-10-01T22:39:01.887765] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-01T22:39:02.103087] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-01T22:39:02.103256] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-01T22:39:02.105713] [INFO ] [MAIN ] Derivative Progress: 595/1587 symbols completed. EOS took 1.3s. Estimated remaining: 6m 55s. Rate: 143.6 symbols/min [2025-10-01T22:39:02.114142] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:02.119832] [DEBUG] [MAIN ] EOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:02.124912] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6873 primary records. [2025-10-01T22:39:02.125589] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-01T22:39:02.144477] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-01T22:39:02.145360] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-01T22:39:02.148265] [INFO ] [MAIN ] Derivative Progress: 596/1587 symbols completed. EOT took 1.2s. Estimated remaining: 6m 54s. Rate: 143.8 symbols/min [2025-10-01T22:39:02.148541] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:02.183521] [DEBUG] [MAIN ] EPAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:02.184312] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26946 primary records. [2025-10-01T22:39:02.184457] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-01T22:39:02.213200] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-10-01T22:39:02.221215] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-01T22:39:02.224248] [INFO ] [MAIN ] Derivative Progress: 597/1587 symbols completed. EPAC took 0.8s. Estimated remaining: 6m 53s. Rate: 144.0 symbols/min [2025-10-01T22:39:02.225771] [DEBUG] [LOCAL ] EPAM: Loaded 39752 existing records from primary storage. [2025-10-01T22:39:02.225958] [INFO ] [MAIN ] EPAM: Loaded 39752 primary data records. [2025-10-01T22:39:02.226060] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:02.365013] [DEBUG] [LOCAL ] EPC: Loaded 39811 existing records from primary storage. [2025-10-01T22:39:02.386734] [INFO ] [MAIN ] EPC: Loaded 39811 primary data records. [2025-10-01T22:39:02.759466] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-10-01T22:39:02.770409] [INFO ] [MAIN ] EPD: Loaded 53610 primary data records. [2025-10-01T22:39:03.302997] [DEBUG] [MAIN ] EPAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:03.304411] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39752 primary records. [2025-10-01T22:39:03.305281] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-01T22:39:03.329206] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-10-01T22:39:03.329492] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-01T22:39:03.334080] [INFO ] [MAIN ] Derivative Progress: 598/1587 symbols completed. EPAM took 1.2s. Estimated remaining: 6m 53s. Rate: 143.6 symbols/min [2025-10-01T22:39:03.355269] [DEBUG] [MAIN ] EPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:03.356522] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39811 primary records. [2025-10-01T22:39:03.356788] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-01T22:39:03.380109] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-10-01T22:39:03.392882] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-01T22:39:03.393092] [DEBUG] [MAIN ] EPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:03.395938] [INFO ] [MAIN ] Derivative Progress: 599/1587 symbols completed. EPC took 1.2s. Estimated remaining: 6m 52s. Rate: 143.8 symbols/min [2025-10-01T22:39:03.397008] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53610 primary records. [2025-10-01T22:39:03.397186] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-01T22:39:03.413995] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-01T22:39:03.414117] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-01T22:39:03.417042] [INFO ] [MAIN ] Derivative Progress: 600/1587 symbols completed. EPD took 1.2s. Estimated remaining: 6m 51s. Rate: 144.0 symbols/min [2025-10-01T22:39:03.417493] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:03.417628] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:03.418378] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:03.493529] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-10-01T22:39:03.493900] [INFO ] [MAIN ] EPRT: Loaded 48479 primary data records. [2025-10-01T22:39:03.638561] [DEBUG] [LOCAL ] EQH: Loaded 52653 existing records from primary storage. [2025-10-01T22:39:03.645043] [DEBUG] [LOCAL ] EPR: Loaded 43923 existing records from primary storage. [2025-10-01T22:39:03.645337] [INFO ] [MAIN ] EPR: Loaded 43923 primary data records. [2025-10-01T22:39:03.650609] [INFO ] [MAIN ] EQH: Loaded 52653 primary data records. [2025-10-01T22:39:04.623953] [DEBUG] [MAIN ] EPRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:04.625213] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48479 primary records. [2025-10-01T22:39:04.625828] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-01T22:39:04.648002] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-10-01T22:39:04.648376] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-01T22:39:04.650553] [INFO ] [MAIN ] Derivative Progress: 601/1587 symbols completed. EPRT took 1.2s. Estimated remaining: 6m 52s. Rate: 143.5 symbols/min [2025-10-01T22:39:04.650919] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:04.688997] [DEBUG] [MAIN ] EPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:04.690692] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43923 primary records. [2025-10-01T22:39:04.690931] [DEBUG] [MAIN ] EQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:04.691174] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-01T22:39:04.692351] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52653 primary records. [2025-10-01T22:39:04.693000] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-01T22:39:04.726961] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-01T22:39:04.727054] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-01T22:39:04.727456] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-01T22:39:04.730953] [INFO ] [MAIN ] Derivative Progress: 602/1587 symbols completed. EPR took 1.3s. Estimated remaining: 6m 51s. Rate: 143.7 symbols/min [2025-10-01T22:39:04.731276] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:04.727377] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-01T22:39:04.749391] [INFO ] [MAIN ] Derivative Progress: 603/1587 symbols completed. EQH took 1.3s. Estimated remaining: 6m 50s. Rate: 144.0 symbols/min [2025-10-01T22:39:04.750056] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:04.773847] [DEBUG] [LOCAL ] EQNR: Loaded 53033 existing records from primary storage. [2025-10-01T22:39:04.774093] [INFO ] [MAIN ] EQNR: Loaded 53033 primary data records. [2025-10-01T22:39:05.170671] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-01T22:39:05.170922] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-10-01T22:39:05.177460] [DEBUG] [LOCAL ] EQR: Loaded 51509 existing records from primary storage. [2025-10-01T22:39:05.196400] [INFO ] [MAIN ] EQR: Loaded 51509 primary data records. [2025-10-01T22:39:05.909529] [DEBUG] [MAIN ] EQNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:05.910752] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53033 primary records. [2025-10-01T22:39:05.910951] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-01T22:39:05.935357] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-01T22:39:05.936254] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-01T22:39:05.938790] [INFO ] [MAIN ] Derivative Progress: 604/1587 symbols completed. EQNR took 1.3s. Estimated remaining: 6m 51s. Rate: 143.5 symbols/min [2025-10-01T22:39:05.939139] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:05.962575] [DEBUG] [LOCAL ] EQV: Loaded 2736 existing records from primary storage. [2025-10-01T22:39:05.976369] [INFO ] [MAIN ] EQV: Loaded 2736 primary data records. [2025-10-01T22:39:05.976968] [DEBUG] [MAIN ] EQR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:05.990407] [DEBUG] [MAIN ] EQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:05.996635] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51509 primary records. [2025-10-01T22:39:06.004600] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-10-01T22:39:06.024716] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-01T22:39:06.033686] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-01T22:39:06.188414] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-01T22:39:06.221357] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-01T22:39:06.333869] [INFO ] [MAIN ] Derivative Progress: 605/1587 symbols completed. EQR took 1.6s. Estimated remaining: 6m 50s. Rate: 143.5 symbols/min [2025-10-01T22:39:06.348839] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:06.350278] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-01T22:39:06.351440] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-01T22:39:06.353553] [INFO ] [MAIN ] Derivative Progress: 606/1587 symbols completed. EQT took 1.6s. Estimated remaining: 6m 49s. Rate: 143.8 symbols/min [2025-10-01T22:39:06.353986] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:06.383348] [DEBUG] [MAIN ] EQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:06.384211] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2736 primary records. [2025-10-01T22:39:06.384329] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-01T22:39:06.422786] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-01T22:39:06.422989] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-01T22:39:06.437990] [INFO ] [MAIN ] Derivative Progress: 607/1587 symbols completed. EQV took 0.5s. Estimated remaining: 6m 48s. Rate: 144.0 symbols/min [2025-10-01T22:39:06.438266] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:06.439977] [DEBUG] [LOCAL ] ERO: Loaded 41247 existing records from primary storage. [2025-10-01T22:39:06.454384] [INFO ] [MAIN ] ERO: Loaded 41247 primary data records. [2025-10-01T22:39:06.466945] [DEBUG] [LOCAL ] ERJ: Loaded 50627 existing records from primary storage. [2025-10-01T22:39:06.477409] [INFO ] [MAIN ] ERJ: Loaded 50627 primary data records. [2025-10-01T22:39:07.170046] [DEBUG] [LOCAL ] ES: Loaded 52572 existing records from primary storage. [2025-10-01T22:39:07.170478] [INFO ] [MAIN ] ES: Loaded 52572 primary data records. [2025-10-01T22:39:07.627690] [DEBUG] [MAIN ] ERJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:07.627061] [DEBUG] [MAIN ] ERO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:07.628938] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41247 primary records. [2025-10-01T22:39:07.629059] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-01T22:39:07.651481] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50627 primary records. [2025-10-01T22:39:07.654609] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-01T22:39:07.706088] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-01T22:39:07.713289] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-01T22:39:07.717089] [INFO ] [MAIN ] Derivative Progress: 608/1587 symbols completed. ERJ took 1.4s. Estimated remaining: 6m 49s. Rate: 143.5 symbols/min [2025-10-01T22:39:07.718163] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:07.718804] [DEBUG] [MAIN ] ES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:07.741276] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-01T22:39:07.741440] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-01T22:39:07.744631] [INFO ] [MAIN ] Derivative Progress: 609/1587 symbols completed. ERO took 1.4s. Estimated remaining: 6m 48s. Rate: 143.7 symbols/min [2025-10-01T22:39:07.744949] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:07.771109] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52572 primary records. [2025-10-01T22:39:07.771389] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-01T22:39:07.794622] [DEBUG] [LOCAL ] ESAB: Loaded 26110 existing records from primary storage. [2025-10-01T22:39:07.795388] [INFO ] [MAIN ] ESAB: Loaded 26110 primary data records. [2025-10-01T22:39:07.840436] [DEBUG] [LOCAL ] ESE: Loaded 16706 existing records from primary storage. [2025-10-01T22:39:07.855490] [INFO ] [MAIN ] ESE: Loaded 16706 primary data records. [2025-10-01T22:39:07.886413] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-01T22:39:07.886589] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-01T22:39:07.889972] [INFO ] [MAIN ] Derivative Progress: 610/1587 symbols completed. ES took 1.5s. Estimated remaining: 6m 48s. Rate: 143.8 symbols/min [2025-10-01T22:39:07.919077] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:08.668184] [DEBUG] [LOCAL ] ESI: Loaded 50725 existing records from primary storage. [2025-10-01T22:39:08.670291] [INFO ] [MAIN ] ESI: Loaded 50725 primary data records. [2025-10-01T22:39:09.060820] [DEBUG] [MAIN ] ESE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:09.060311] [DEBUG] [MAIN ] ESAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:09.062926] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16706 primary records. [2025-10-01T22:39:09.063207] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-01T22:39:09.061735] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26110 primary records. [2025-10-01T22:39:09.064355] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-01T22:39:09.097686] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-01T22:39:09.098220] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-01T22:39:09.101175] [INFO ] [MAIN ] Derivative Progress: 611/1587 symbols completed. ESE took 1.4s. Estimated remaining: 6m 48s. Rate: 143.4 symbols/min [2025-10-01T22:39:09.101535] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:09.108153] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-01T22:39:09.108507] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-01T22:39:09.110973] [INFO ] [MAIN ] Derivative Progress: 612/1587 symbols completed. ESAB took 1.4s. Estimated remaining: 6m 47s. Rate: 143.6 symbols/min [2025-10-01T22:39:09.111369] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:09.132226] [DEBUG] [MAIN ] ESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:09.133202] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50725 primary records. [2025-10-01T22:39:09.133320] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-01T22:39:09.160005] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-01T22:39:09.160168] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-01T22:39:09.162805] [INFO ] [MAIN ] Derivative Progress: 613/1587 symbols completed. ESI took 1.2s. Estimated remaining: 6m 46s. Rate: 143.8 symbols/min [2025-10-01T22:39:09.186819] [DEBUG] [LOCAL ] ESNT: Loaded 38358 existing records from primary storage. [2025-10-01T22:39:09.187047] [INFO ] [MAIN ] ESNT: Loaded 38358 primary data records. [2025-10-01T22:39:09.337885] [DEBUG] [LOCAL ] ESRT: Loaded 46454 existing records from primary storage. [2025-10-01T22:39:09.360941] [INFO ] [MAIN ] ESRT: Loaded 46454 primary data records. [2025-10-01T22:39:09.876363] [DEBUG] [MAIN ] ESNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:09.877277] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38358 primary records. [2025-10-01T22:39:09.877487] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-01T22:39:09.901954] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-01T22:39:09.902317] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-01T22:39:09.917409] [INFO ] [MAIN ] Derivative Progress: 614/1587 symbols completed. ESNT took 0.8s. Estimated remaining: 6m 46s. Rate: 143.6 symbols/min [2025-10-01T22:39:09.918287] [DEBUG] [MAIN ] ESRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:09.918952] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46454 primary records. [2025-10-01T22:39:09.919017] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-01T22:39:09.935153] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-01T22:39:09.935223] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-01T22:39:09.938518] [INFO ] [MAIN ] Derivative Progress: 615/1587 symbols completed. ESRT took 0.8s. Estimated remaining: 6m 45s. Rate: 143.9 symbols/min [2025-10-01T22:39:09.938975] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:09.939107] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:09.939866] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:09.985176] [DEBUG] [LOCAL ] ESS: Loaded 29988 existing records from primary storage. [2025-10-01T22:39:10.000318] [INFO ] [MAIN ] ESS: Loaded 29988 primary data records. [2025-10-01T22:39:10.133416] [DEBUG] [LOCAL ] ESTC: Loaded 49968 existing records from primary storage. [2025-10-01T22:39:10.154538] [INFO ] [MAIN ] ESTC: Loaded 49968 primary data records. [2025-10-01T22:39:10.155921] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-01T22:39:10.178290] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-01T22:39:11.094826] [DEBUG] [MAIN ] ESS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:11.097205] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 29988 primary records. [2025-10-01T22:39:11.097677] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-01T22:39:11.111346] [DEBUG] [MAIN ] ESTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:11.113270] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 49968 primary records. [2025-10-01T22:39:11.113601] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-01T22:39:11.152216] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-01T22:39:11.158036] [DEBUG] [MAIN ] ET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:11.159398] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-01T22:39:11.159529] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-01T22:39:11.163338] [INFO ] [MAIN ] Derivative Progress: 616/1587 symbols completed. ESTC took 1.2s. Estimated remaining: 6m 46s. Rate: 143.4 symbols/min [2025-10-01T22:39:11.164715] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:11.159857] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-01T22:39:11.165151] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-01T22:39:11.165693] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-01T22:39:11.168198] [INFO ] [MAIN ] Derivative Progress: 617/1587 symbols completed. ESS took 1.2s. Estimated remaining: 6m 45s. Rate: 143.6 symbols/min [2025-10-01T22:39:11.169275] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:11.189501] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-01T22:39:11.189770] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-01T22:39:11.192551] [INFO ] [MAIN ] Derivative Progress: 618/1587 symbols completed. ET took 1.3s. Estimated remaining: 6m 44s. Rate: 143.9 symbols/min [2025-10-01T22:39:11.197853] [DEBUG] [LOCAL ] ETB: Loaded 12077 existing records from primary storage. [2025-10-01T22:39:11.198404] [INFO ] [MAIN ] ETB: Loaded 12077 primary data records. [2025-10-01T22:39:11.198240] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:11.363592] [DEBUG] [LOCAL ] ETD: Loaded 27426 existing records from primary storage. [2025-10-01T22:39:11.388278] [INFO ] [MAIN ] ETD: Loaded 27426 primary data records. [2025-10-01T22:39:11.539507] [DEBUG] [LOCAL ] ETG: Loaded 16472 existing records from primary storage. [2025-10-01T22:39:11.568741] [INFO ] [MAIN ] ETG: Loaded 16472 primary data records. [2025-10-01T22:39:12.263190] [DEBUG] [MAIN ] ETB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:12.265352] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12077 primary records. [2025-10-01T22:39:12.265780] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-01T22:39:12.285709] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-01T22:39:12.286106] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-01T22:39:12.288376] [INFO ] [MAIN ] Derivative Progress: 619/1587 symbols completed. ETB took 1.1s. Estimated remaining: 6m 45s. Rate: 143.5 symbols/min [2025-10-01T22:39:12.289059] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:12.306492] [DEBUG] [MAIN ] ETD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:12.314024] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27426 primary records. [2025-10-01T22:39:12.314493] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-01T22:39:12.328408] [DEBUG] [MAIN ] ETG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:12.343634] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16472 primary records. [2025-10-01T22:39:12.348304] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-01T22:39:12.349385] [DEBUG] [LOCAL ] ETJ: Loaded 16671 existing records from primary storage. [2025-10-01T22:39:12.352260] [INFO ] [MAIN ] ETJ: Loaded 16671 primary data records. [2025-10-01T22:39:12.353970] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-01T22:39:12.375724] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-01T22:39:12.381149] [INFO ] [MAIN ] Derivative Progress: 620/1587 symbols completed. ETD took 1.2s. Estimated remaining: 6m 44s. Rate: 143.7 symbols/min [2025-10-01T22:39:12.412081] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:12.453359] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-01T22:39:12.472322] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-01T22:39:12.482877] [INFO ] [MAIN ] Derivative Progress: 621/1587 symbols completed. ETG took 1.3s. Estimated remaining: 6m 43s. Rate: 143.8 symbols/min [2025-10-01T22:39:12.491552] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:12.739411] [DEBUG] [LOCAL ] ETO: Loaded 6515 existing records from primary storage. [2025-10-01T22:39:12.740314] [INFO ] [MAIN ] ETO: Loaded 6515 primary data records. [2025-10-01T22:39:12.942341] [DEBUG] [LOCAL ] ETN: Loaded 52758 existing records from primary storage. [2025-10-01T22:39:12.980832] [INFO ] [MAIN ] ETN: Loaded 52758 primary data records. [2025-10-01T22:39:13.254959] [DEBUG] [MAIN ] ETJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:13.261100] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16671 primary records. [2025-10-01T22:39:13.261253] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-01T22:39:13.508867] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-01T22:39:13.509067] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-01T22:39:13.511361] [INFO ] [MAIN ] Derivative Progress: 622/1587 symbols completed. ETJ took 1.2s. Estimated remaining: 6m 43s. Rate: 143.5 symbols/min [2025-10-01T22:39:13.512052] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:13.532404] [DEBUG] [MAIN ] ETO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:13.533336] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6515 primary records. [2025-10-01T22:39:13.533886] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-01T22:39:13.552810] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-01T22:39:13.553103] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-01T22:39:13.555803] [INFO ] [MAIN ] Derivative Progress: 623/1587 symbols completed. ETO took 1.1s. Estimated remaining: 6m 42s. Rate: 143.7 symbols/min [2025-10-01T22:39:13.556578] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:13.575784] [DEBUG] [MAIN ] ETN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:13.591871] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52758 primary records. [2025-10-01T22:39:13.592130] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-01T22:39:13.634704] [DEBUG] [LOCAL ] ETV: Loaded 21526 existing records from primary storage. [2025-10-01T22:39:13.638227] [INFO ] [MAIN ] ETV: Loaded 21526 primary data records. [2025-10-01T22:39:13.638099] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-01T22:39:13.638514] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-01T22:39:13.639744] [DEBUG] [LOCAL ] ETR: Loaded 53225 existing records from primary storage. [2025-10-01T22:39:13.648034] [INFO ] [MAIN ] Derivative Progress: 624/1587 symbols completed. ETN took 1.2s. Estimated remaining: 6m 42s. Rate: 143.9 symbols/min [2025-10-01T22:39:13.655455] [INFO ] [MAIN ] ETR: Loaded 53225 primary data records. [2025-10-01T22:39:13.677964] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:14.000367] [DEBUG] [LOCAL ] ETW: Loaded 25087 existing records from primary storage. [2025-10-01T22:39:14.077180] [INFO ] [MAIN ] ETW: Loaded 25087 primary data records. [2025-10-01T22:39:14.765544] [DEBUG] [MAIN ] ETV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:14.768464] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21526 primary records. [2025-10-01T22:39:14.768755] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-01T22:39:14.783523] [DEBUG] [MAIN ] ETR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:14.784808] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53225 primary records. [2025-10-01T22:39:14.785061] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-01T22:39:14.816811] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-01T22:39:14.818032] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-01T22:39:14.820099] [INFO ] [MAIN ] Derivative Progress: 625/1587 symbols completed. ETV took 1.3s. Estimated remaining: 6m 42s. Rate: 143.5 symbols/min [2025-10-01T22:39:14.820543] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:14.826884] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-01T22:39:14.828316] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-01T22:39:14.831181] [INFO ] [MAIN ] Derivative Progress: 626/1587 symbols completed. ETR took 1.3s. Estimated remaining: 6m 41s. Rate: 143.7 symbols/min [2025-10-01T22:39:14.831523] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:14.844804] [DEBUG] [MAIN ] ETW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:14.845899] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25087 primary records. [2025-10-01T22:39:14.846076] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-01T22:39:14.849847] [DEBUG] [LOCAL ] ETX: Loaded 5134 existing records from primary storage. [2025-10-01T22:39:14.850224] [INFO ] [MAIN ] ETX: Loaded 5134 primary data records. [2025-10-01T22:39:15.009687] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-01T22:39:15.053143] [DEBUG] [LOCAL ] ETY: Loaded 22753 existing records from primary storage. [2025-10-01T22:39:15.029262] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-01T22:39:15.088715] [INFO ] [MAIN ] Derivative Progress: 627/1587 symbols completed. ETW took 1.4s. Estimated remaining: 6m 41s. Rate: 143.8 symbols/min [2025-10-01T22:39:15.131897] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:15.131777] [INFO ] [MAIN ] ETY: Loaded 22753 primary data records. [2025-10-01T22:39:15.410203] [DEBUG] [LOCAL ] EVC: Loaded 18618 existing records from primary storage. [2025-10-01T22:39:15.432516] [INFO ] [MAIN ] EVC: Loaded 18618 primary data records. [2025-10-01T22:39:15.737413] [DEBUG] [MAIN ] ETX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:15.765066] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5134 primary records. [2025-10-01T22:39:15.813596] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-01T22:39:15.958082] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-01T22:39:15.959769] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-01T22:39:15.964917] [INFO ] [MAIN ] Derivative Progress: 628/1587 symbols completed. ETX took 1.1s. Estimated remaining: 6m 41s. Rate: 143.5 symbols/min [2025-10-01T22:39:15.979853] [DEBUG] [MAIN ] ETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:15.980711] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22753 primary records. [2025-10-01T22:39:15.980819] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-01T22:39:15.998964] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-01T22:39:15.999180] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-01T22:39:16.001560] [INFO ] [MAIN ] Derivative Progress: 629/1587 symbols completed. ETY took 1.2s. Estimated remaining: 6m 40s. Rate: 143.7 symbols/min [2025-10-01T22:39:16.017072] [DEBUG] [MAIN ] EVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:16.017740] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18618 primary records. [2025-10-01T22:39:16.017822] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-01T22:39:16.033248] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-01T22:39:16.033357] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-01T22:39:16.036327] [INFO ] [MAIN ] Derivative Progress: 630/1587 symbols completed. EVC took 0.9s. Estimated remaining: 6m 39s. Rate: 143.9 symbols/min [2025-10-01T22:39:16.036927] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:16.036981] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:16.036851] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:16.048477] [DEBUG] [LOCAL ] EVG: Loaded 5952 existing records from primary storage. [2025-10-01T22:39:16.048626] [INFO ] [MAIN ] EVG: Loaded 5952 primary data records. [2025-10-01T22:39:16.106456] [DEBUG] [LOCAL ] EVF: Loaded 9403 existing records from primary storage. [2025-10-01T22:39:16.124737] [INFO ] [MAIN ] EVF: Loaded 9403 primary data records. [2025-10-01T22:39:16.273867] [DEBUG] [LOCAL ] EVEX: Loaded 30504 existing records from primary storage. [2025-10-01T22:39:16.307338] [INFO ] [MAIN ] EVEX: Loaded 30504 primary data records. [2025-10-01T22:39:17.165987] [DEBUG] [MAIN ] EVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:17.168434] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5952 primary records. [2025-10-01T22:39:17.168782] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-01T22:39:17.198133] [DEBUG] [MAIN ] EVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:17.199851] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9403 primary records. [2025-10-01T22:39:17.200069] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-01T22:39:17.214934] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-01T22:39:17.218258] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-01T22:39:17.222279] [INFO ] [MAIN ] Derivative Progress: 631/1587 symbols completed. EVG took 1.2s. Estimated remaining: 6m 40s. Rate: 143.5 symbols/min [2025-10-01T22:39:17.223303] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:17.220171] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-01T22:39:17.224589] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-01T22:39:17.227096] [INFO ] [MAIN ] Derivative Progress: 632/1587 symbols completed. EVF took 1.2s. Estimated remaining: 6m 39s. Rate: 143.8 symbols/min [2025-10-01T22:39:17.227467] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:17.242317] [DEBUG] [MAIN ] EVEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:17.243065] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 30504 primary records. [2025-10-01T22:39:17.243228] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-01T22:39:17.267815] [DEBUG] [LOCAL ] EVN: Loaded 11144 existing records from primary storage. [2025-10-01T22:39:17.267453] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-01T22:39:17.267959] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-01T22:39:17.271718] [INFO ] [MAIN ] EVN: Loaded 11144 primary data records. [2025-10-01T22:39:17.271618] [INFO ] [MAIN ] Derivative Progress: 633/1587 symbols completed. EVEX took 1.2s. Estimated remaining: 6m 38s. Rate: 144.0 symbols/min [2025-10-01T22:39:17.277309] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:17.511514] [DEBUG] [LOCAL ] EVH: Loaded 49369 existing records from primary storage. [2025-10-01T22:39:17.647083] [INFO ] [MAIN ] EVH: Loaded 49369 primary data records. [2025-10-01T22:39:17.756543] [DEBUG] [LOCAL ] EVR: Loaded 34906 existing records from primary storage. [2025-10-01T22:39:17.784557] [INFO ] [MAIN ] EVR: Loaded 34906 primary data records. [2025-10-01T22:39:18.347173] [DEBUG] [MAIN ] EVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:18.348161] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 11144 primary records. [2025-10-01T22:39:18.349120] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-01T22:39:18.373921] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-01T22:39:18.374440] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-01T22:39:18.390107] [INFO ] [MAIN ] Derivative Progress: 634/1587 symbols completed. EVN took 1.2s. Estimated remaining: 6m 38s. Rate: 143.6 symbols/min [2025-10-01T22:39:18.390692] [DEBUG] [MAIN ] EVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:18.392172] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49369 primary records. [2025-10-01T22:39:18.390813] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:18.392305] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-01T22:39:18.411742] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-01T22:39:18.413602] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-01T22:39:18.416073] [INFO ] [MAIN ] Derivative Progress: 635/1587 symbols completed. EVH took 1.2s. Estimated remaining: 6m 37s. Rate: 143.8 symbols/min [2025-10-01T22:39:18.416296] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:18.435685] [DEBUG] [MAIN ] EVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:18.436848] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 34906 primary records. [2025-10-01T22:39:18.436993] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-01T22:39:18.458399] [DEBUG] [LOCAL ] EVT: Loaded 16951 existing records from primary storage. [2025-10-01T22:39:18.459282] [INFO ] [MAIN ] EVT: Loaded 16951 primary data records. [2025-10-01T22:39:18.542738] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-01T22:39:18.575586] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-01T22:39:18.609730] [DEBUG] [LOCAL ] EVTC: Loaded 26228 existing records from primary storage. [2025-10-01T22:39:18.612797] [INFO ] [MAIN ] Derivative Progress: 636/1587 symbols completed. EVR took 1.3s. Estimated remaining: 6m 37s. Rate: 143.9 symbols/min [2025-10-01T22:39:18.613082] [INFO ] [MAIN ] EVTC: Loaded 26228 primary data records. [2025-10-01T22:39:18.629066] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:19.224963] [DEBUG] [LOCAL ] EVTL: Loaded 38254 existing records from primary storage. [2025-10-01T22:39:19.225418] [INFO ] [MAIN ] EVTL: Loaded 38254 primary data records. [2025-10-01T22:39:19.538027] [DEBUG] [MAIN ] EVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:19.574968] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16951 primary records. [2025-10-01T22:39:19.575493] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-01T22:39:19.610892] [DEBUG] [MAIN ] EVTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:19.612788] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26228 primary records. [2025-10-01T22:39:19.612890] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-01T22:39:19.611891] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-01T22:39:19.613799] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-01T22:39:19.616017] [INFO ] [MAIN ] Derivative Progress: 637/1587 symbols completed. EVT took 1.2s. Estimated remaining: 6m 37s. Rate: 143.6 symbols/min [2025-10-01T22:39:19.616476] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:19.635351] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-01T22:39:19.635481] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-01T22:39:19.637939] [INFO ] [MAIN ] Derivative Progress: 638/1587 symbols completed. EVTC took 1.2s. Estimated remaining: 6m 36s. Rate: 143.8 symbols/min [2025-10-01T22:39:19.638178] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:19.669358] [DEBUG] [MAIN ] EVTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:19.670760] [DEBUG] [LOCAL ] EVTR: Loaded 23681 existing records from primary storage. [2025-10-01T22:39:19.670875] [INFO ] [MAIN ] EVTR: Loaded 23681 primary data records. [2025-10-01T22:39:19.671635] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 38254 primary records. [2025-10-01T22:39:19.671847] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-01T22:39:19.912852] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-01T22:39:19.928639] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-01T22:39:20.055338] [INFO ] [MAIN ] Derivative Progress: 639/1587 symbols completed. EVTL took 1.4s. Estimated remaining: 6m 36s. Rate: 143.8 symbols/min [2025-10-01T22:39:20.056680] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-01T22:39:20.056801] [INFO ] [MAIN ] EW: Loaded 53402 primary data records. [2025-10-01T22:39:20.057154] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:20.408631] [DEBUG] [LOCAL ] EXG: Loaded 34113 existing records from primary storage. [2025-10-01T22:39:20.411698] [INFO ] [MAIN ] EXG: Loaded 34113 primary data records. [2025-10-01T22:39:20.490513] [DEBUG] [MAIN ] EVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:20.506639] [INFO ] [MAIN ] EVTR: Generated 1794 derivative records from 23681 primary records. [2025-10-01T22:39:20.514815] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-01T22:39:20.781036] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1794 records). [2025-10-01T22:39:20.782107] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-01T22:39:20.784603] [INFO ] [MAIN ] Derivative Progress: 640/1587 symbols completed. EVTR took 1.2s. Estimated remaining: 6m 36s. Rate: 143.6 symbols/min [2025-10-01T22:39:20.786461] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:20.803185] [DEBUG] [MAIN ] EW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:20.804637] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53402 primary records. [2025-10-01T22:39:20.804865] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-01T22:39:20.823335] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-01T22:39:20.823765] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-01T22:39:20.826063] [INFO ] [MAIN ] Derivative Progress: 641/1587 symbols completed. EW took 1.2s. Estimated remaining: 6m 35s. Rate: 143.8 symbols/min [2025-10-01T22:39:20.826430] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:20.850673] [DEBUG] [MAIN ] EXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:20.851574] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34113 primary records. [2025-10-01T22:39:20.851742] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-01T22:39:20.894562] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-01T22:39:20.904741] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-01T22:39:20.908017] [INFO ] [MAIN ] Derivative Progress: 642/1587 symbols completed. EXG took 0.9s. Estimated remaining: 6m 34s. Rate: 144.0 symbols/min [2025-10-01T22:39:20.908365] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:20.922450] [DEBUG] [LOCAL ] EXP: Loaded 29652 existing records from primary storage. [2025-10-01T22:39:20.924184] [INFO ] [MAIN ] EXP: Loaded 29652 primary data records. [2025-10-01T22:39:20.930374] [DEBUG] [LOCAL ] EXK: Loaded 53136 existing records from primary storage. [2025-10-01T22:39:20.959500] [INFO ] [MAIN ] EXK: Loaded 53136 primary data records. [2025-10-01T22:39:21.539626] [DEBUG] [LOCAL ] EXPD: Loaded 47959 existing records from primary storage. [2025-10-01T22:39:21.655862] [INFO ] [MAIN ] EXPD: Loaded 47959 primary data records. [2025-10-01T22:39:22.011773] [DEBUG] [MAIN ] EXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:22.013510] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29652 primary records. [2025-10-01T22:39:22.013872] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-01T22:39:22.035204] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-01T22:39:22.036132] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-01T22:39:22.038747] [INFO ] [MAIN ] Derivative Progress: 643/1587 symbols completed. EXP took 1.2s. Estimated remaining: 6m 34s. Rate: 143.6 symbols/min [2025-10-01T22:39:22.052327] [DEBUG] [MAIN ] EXK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:22.053101] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53136 primary records. [2025-10-01T22:39:22.053258] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-01T22:39:22.072920] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-01T22:39:22.073123] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-01T22:39:22.075566] [INFO ] [MAIN ] Derivative Progress: 644/1587 symbols completed. EXK took 1.3s. Estimated remaining: 6m 33s. Rate: 143.8 symbols/min [2025-10-01T22:39:22.088215] [DEBUG] [MAIN ] EXPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:22.088850] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47959 primary records. [2025-10-01T22:39:22.088914] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-01T22:39:22.104879] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-01T22:39:22.104944] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-01T22:39:22.107663] [INFO ] [MAIN ] Derivative Progress: 645/1587 symbols completed. EXPD took 1.2s. Estimated remaining: 6m 32s. Rate: 144.0 symbols/min [2025-10-01T22:39:22.108199] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:22.108301] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:22.108118] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:22.172277] [DEBUG] [LOCAL ] FAF: Loaded 41688 existing records from primary storage. [2025-10-01T22:39:22.173055] [INFO ] [MAIN ] FAF: Loaded 41688 primary data records. [2025-10-01T22:39:22.242754] [DEBUG] [LOCAL ] EXR: Loaded 45268 existing records from primary storage. [2025-10-01T22:39:22.288943] [INFO ] [MAIN ] EXR: Loaded 45268 primary data records. [2025-10-01T22:39:22.338699] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-01T22:39:22.402322] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-01T22:39:23.301083] [DEBUG] [MAIN ] FAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:23.302615] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41688 primary records. [2025-10-01T22:39:23.304200] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-01T22:39:23.336059] [DEBUG] [MAIN ] EXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:23.337729] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45268 primary records. [2025-10-01T22:39:23.338763] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-01T22:39:23.338685] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-01T22:39:23.348711] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-01T22:39:23.351504] [INFO ] [MAIN ] Derivative Progress: 646/1587 symbols completed. FAF took 1.2s. Estimated remaining: 6m 33s. Rate: 143.6 symbols/min [2025-10-01T22:39:23.356762] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:23.375566] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-01T22:39:23.376138] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-01T22:39:23.375952] [DEBUG] [MAIN ] F: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:23.379861] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-01T22:39:23.378906] [INFO ] [MAIN ] Derivative Progress: 647/1587 symbols completed. EXR took 1.3s. Estimated remaining: 6m 32s. Rate: 143.8 symbols/min [2025-10-01T22:39:23.380183] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:23.380348] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-01T22:39:23.399891] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-01T22:39:23.400036] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-01T22:39:23.402883] [INFO ] [MAIN ] Derivative Progress: 648/1587 symbols completed. F took 1.3s. Estimated remaining: 6m 31s. Rate: 144.0 symbols/min [2025-10-01T22:39:23.403131] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:23.434775] [DEBUG] [LOCAL ] FBK: Loaded 26076 existing records from primary storage. [2025-10-01T22:39:23.434989] [INFO ] [MAIN ] FBK: Loaded 26076 primary data records. [2025-10-01T22:39:23.565051] [DEBUG] [LOCAL ] FBIN: Loaded 50327 existing records from primary storage. [2025-10-01T22:39:23.591750] [INFO ] [MAIN ] FBIN: Loaded 50327 primary data records. [2025-10-01T22:39:23.881365] [DEBUG] [LOCAL ] FBP: Loaded 45961 existing records from primary storage. [2025-10-01T22:39:23.902881] [INFO ] [MAIN ] FBP: Loaded 45961 primary data records. [2025-10-01T22:39:24.520478] [DEBUG] [MAIN ] FBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:24.521688] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 26076 primary records. [2025-10-01T22:39:24.522392] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-01T22:39:24.559021] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-01T22:39:24.559263] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-01T22:39:24.559861] [DEBUG] [MAIN ] FBIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:24.563666] [INFO ] [MAIN ] Derivative Progress: 649/1587 symbols completed. FBK took 1.2s. Estimated remaining: 6m 32s. Rate: 143.6 symbols/min [2025-10-01T22:39:24.565961] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:24.565855] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50327 primary records. [2025-10-01T22:39:24.567073] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-01T22:39:24.591480] [DEBUG] [MAIN ] FBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:24.595788] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45961 primary records. [2025-10-01T22:39:24.595982] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-01T22:39:24.620853] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-01T22:39:24.620490] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-01T22:39:24.621123] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-01T22:39:24.624082] [INFO ] [MAIN ] Derivative Progress: 650/1587 symbols completed. FBP took 1.2s. Estimated remaining: 6m 31s. Rate: 143.8 symbols/min [2025-10-01T22:39:24.624272] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-01T22:39:24.624561] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:24.627135] [INFO ] [MAIN ] Derivative Progress: 651/1587 symbols completed. FBIN took 1.3s. Estimated remaining: 6m 30s. Rate: 144.0 symbols/min [2025-10-01T22:39:24.627807] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:24.664942] [DEBUG] [LOCAL ] FC: Loaded 15437 existing records from primary storage. [2025-10-01T22:39:24.666138] [INFO ] [MAIN ] FC: Loaded 15437 primary data records. [2025-10-01T22:39:24.666031] [DEBUG] [LOCAL ] FBRT: Loaded 34730 existing records from primary storage. [2025-10-01T22:39:24.666450] [INFO ] [MAIN ] FBRT: Loaded 34730 primary data records. [2025-10-01T22:39:24.895098] [DEBUG] [LOCAL ] FCF: Loaded 39411 existing records from primary storage. [2025-10-01T22:39:24.918607] [INFO ] [MAIN ] FCF: Loaded 39411 primary data records. [2025-10-01T22:39:25.819226] [DEBUG] [MAIN ] FC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:25.821144] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15437 primary records. [2025-10-01T22:39:25.821325] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-01T22:39:25.837491] [DEBUG] [MAIN ] FBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:25.846752] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34730 primary records. [2025-10-01T22:39:25.851528] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-01T22:39:25.874356] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-01T22:39:25.875891] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-10-01T22:39:25.877042] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-01T22:39:25.877950] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-01T22:39:25.880953] [INFO ] [MAIN ] Derivative Progress: 652/1587 symbols completed. FC took 1.3s. Estimated remaining: 6m 31s. Rate: 143.6 symbols/min [2025-10-01T22:39:25.884180] [INFO ] [MAIN ] Derivative Progress: 653/1587 symbols completed. FBRT took 1.3s. Estimated remaining: 6m 30s. Rate: 143.8 symbols/min [2025-10-01T22:39:25.884431] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:25.883974] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:25.899779] [DEBUG] [MAIN ] FCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:25.900618] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39411 primary records. [2025-10-01T22:39:25.900793] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-01T22:39:25.928229] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-10-01T22:39:25.928382] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-01T22:39:25.931791] [INFO ] [MAIN ] Derivative Progress: 654/1587 symbols completed. FCF took 1.3s. Estimated remaining: 6m 29s. Rate: 144.0 symbols/min [2025-10-01T22:39:25.932225] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:25.952930] [DEBUG] [LOCAL ] FCN: Loaded 25935 existing records from primary storage. [2025-10-01T22:39:25.953089] [INFO ] [MAIN ] FCN: Loaded 25935 primary data records. [2025-10-01T22:39:26.047872] [DEBUG] [LOCAL ] FCPT: Loaded 37301 existing records from primary storage. [2025-10-01T22:39:26.053274] [INFO ] [MAIN ] FCPT: Loaded 37301 primary data records. [2025-10-01T22:39:26.135862] [DEBUG] [LOCAL ] FCT: Loaded 14609 existing records from primary storage. [2025-10-01T22:39:26.165373] [INFO ] [MAIN ] FCT: Loaded 14609 primary data records. [2025-10-01T22:39:27.027135] [DEBUG] [MAIN ] FCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:27.028359] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 25935 primary records. [2025-10-01T22:39:27.029891] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-01T22:39:27.068534] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-01T22:39:27.069286] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-01T22:39:27.069016] [DEBUG] [MAIN ] FCPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:27.084559] [INFO ] [MAIN ] Derivative Progress: 655/1587 symbols completed. FCN took 1.2s. Estimated remaining: 6m 29s. Rate: 143.6 symbols/min [2025-10-01T22:39:27.086090] [DEBUG] [MAIN ] FCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:27.085605] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37301 primary records. [2025-10-01T22:39:27.087121] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-01T22:39:27.087023] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:27.086875] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14609 primary records. [2025-10-01T22:39:27.088803] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-01T22:39:27.121745] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-01T22:39:27.122760] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-01T22:39:27.125383] [INFO ] [MAIN ] Derivative Progress: 656/1587 symbols completed. FCT took 1.2s. Estimated remaining: 6m 28s. Rate: 143.8 symbols/min [2025-10-01T22:39:27.122662] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-01T22:39:27.125671] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-01T22:39:27.128678] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:27.129133] [INFO ] [MAIN ] Derivative Progress: 657/1587 symbols completed. FCPT took 1.2s. Estimated remaining: 6m 27s. Rate: 144.0 symbols/min [2025-10-01T22:39:27.129282] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:27.191945] [DEBUG] [LOCAL ] FDS: Loaded 26623 existing records from primary storage. [2025-10-01T22:39:27.192354] [INFO ] [MAIN ] FDS: Loaded 26623 primary data records. [2025-10-01T22:39:27.225166] [DEBUG] [LOCAL ] FDP: Loaded 30111 existing records from primary storage. [2025-10-01T22:39:27.242927] [INFO ] [MAIN ] FDP: Loaded 30111 primary data records. [2025-10-01T22:39:27.296042] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-01T22:39:27.322976] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-10-01T22:39:28.302673] [DEBUG] [MAIN ] FDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:28.306787] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30111 primary records. [2025-10-01T22:39:28.307302] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-01T22:39:28.335412] [DEBUG] [MAIN ] FDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:28.337440] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26623 primary records. [2025-10-01T22:39:28.337818] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-01T22:39:28.366887] [DEBUG] [MAIN ] FCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:28.369440] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-10-01T22:39:28.369813] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-01T22:39:28.368695] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-01T22:39:28.371289] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-01T22:39:28.373413] [INFO ] [MAIN ] Derivative Progress: 658/1587 symbols completed. FDP took 1.2s. Estimated remaining: 6m 28s. Rate: 143.6 symbols/min [2025-10-01T22:39:28.391738] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-01T22:39:28.392366] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-01T22:39:28.395275] [INFO ] [MAIN ] Derivative Progress: 659/1587 symbols completed. FDS took 1.3s. Estimated remaining: 6m 27s. Rate: 143.8 symbols/min [2025-10-01T22:39:28.395917] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-01T22:39:28.396140] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-01T22:39:28.399820] [INFO ] [MAIN ] Derivative Progress: 660/1587 symbols completed. FCX took 1.3s. Estimated remaining: 6m 26s. Rate: 144.0 symbols/min [2025-10-01T22:39:28.400203] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:28.400357] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:28.400318] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:28.483288] [DEBUG] [LOCAL ] FERG: Loaded 48853 existing records from primary storage. [2025-10-01T22:39:28.483547] [INFO ] [MAIN ] FERG: Loaded 48853 primary data records. [2025-10-01T22:39:28.569918] [DEBUG] [LOCAL ] FDX: Loaded 51582 existing records from primary storage. [2025-10-01T22:39:28.580915] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-01T22:39:28.604001] [INFO ] [MAIN ] FE: Loaded 53430 primary data records. [2025-10-01T22:39:28.604110] [INFO ] [MAIN ] FDX: Loaded 51582 primary data records. [2025-10-01T22:39:29.662139] [DEBUG] [MAIN ] FDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:29.663300] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51582 primary records. [2025-10-01T22:39:29.676136] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-01T22:39:29.685238] [DEBUG] [MAIN ] FERG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:29.691751] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48853 primary records. [2025-10-01T22:39:29.699322] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-01T22:39:29.690907] [DEBUG] [MAIN ] FE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:29.704586] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53430 primary records. [2025-10-01T22:39:29.706039] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-01T22:39:29.737703] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-01T22:39:29.738117] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-01T22:39:29.738824] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-01T22:39:29.741114] [INFO ] [MAIN ] Derivative Progress: 661/1587 symbols completed. FERG took 1.3s. Estimated remaining: 6m 27s. Rate: 143.5 symbols/min [2025-10-01T22:39:29.741352] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:29.742053] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-01T22:39:29.744777] [INFO ] [MAIN ] Derivative Progress: 662/1587 symbols completed. FDX took 1.3s. Estimated remaining: 6m 26s. Rate: 143.8 symbols/min [2025-10-01T22:39:29.745262] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:29.750997] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-01T22:39:29.751295] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-01T22:39:29.753977] [INFO ] [MAIN ] Derivative Progress: 663/1587 symbols completed. FE took 1.4s. Estimated remaining: 6m 25s. Rate: 144.0 symbols/min [2025-10-01T22:39:29.754255] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:29.767022] [DEBUG] [LOCAL ] FET: Loaded 12872 existing records from primary storage. [2025-10-01T22:39:29.767204] [INFO ] [MAIN ] FET: Loaded 12872 primary data records. [2025-10-01T22:39:29.836946] [DEBUG] [LOCAL ] FFA: Loaded 5856 existing records from primary storage. [2025-10-01T22:39:29.864980] [INFO ] [MAIN ] FFA: Loaded 5856 primary data records. [2025-10-01T22:39:29.976929] [DEBUG] [LOCAL ] FF: Loaded 24977 existing records from primary storage. [2025-10-01T22:39:30.036288] [INFO ] [MAIN ] FF: Loaded 24977 primary data records. [2025-10-01T22:39:30.878945] [DEBUG] [MAIN ] FET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:30.886007] [DEBUG] [MAIN ] FFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:30.885555] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12872 primary records. [2025-10-01T22:39:30.886336] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-01T22:39:30.888097] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5856 primary records. [2025-10-01T22:39:30.888491] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-01T22:39:30.922286] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-01T22:39:30.922533] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-01T22:39:30.926453] [INFO ] [MAIN ] Derivative Progress: 664/1587 symbols completed. FET took 1.2s. Estimated remaining: 6m 26s. Rate: 143.6 symbols/min [2025-10-01T22:39:30.924460] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-10-01T22:39:30.926876] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-01T22:39:30.934953] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:30.942993] [INFO ] [MAIN ] Derivative Progress: 665/1587 symbols completed. FFA took 1.2s. Estimated remaining: 6m 25s. Rate: 143.8 symbols/min [2025-10-01T22:39:30.943459] [DEBUG] [MAIN ] FF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:30.943633] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:30.944983] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 24977 primary records. [2025-10-01T22:39:30.945593] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-01T22:39:30.966972] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-01T22:39:30.967166] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-01T22:39:30.970545] [INFO ] [MAIN ] Derivative Progress: 666/1587 symbols completed. FF took 1.2s. Estimated remaining: 6m 24s. Rate: 144.0 symbols/min [2025-10-01T22:39:30.970729] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:30.979728] [DEBUG] [LOCAL ] FFC: Loaded 16765 existing records from primary storage. [2025-10-01T22:39:30.992760] [INFO ] [MAIN ] FFC: Loaded 16765 primary data records. [2025-10-01T22:39:31.123018] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-10-01T22:39:31.136116] [INFO ] [MAIN ] FG: Loaded 22819 primary data records. [2025-10-01T22:39:31.148873] [DEBUG] [LOCAL ] FFWM: Loaded 35720 existing records from primary storage. [2025-10-01T22:39:31.161005] [INFO ] [MAIN ] FFWM: Loaded 35720 primary data records. [2025-10-01T22:39:32.088833] [DEBUG] [MAIN ] FFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:32.090679] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16765 primary records. [2025-10-01T22:39:32.089560] [DEBUG] [MAIN ] FG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:32.092220] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22819 primary records. [2025-10-01T22:39:32.090971] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-01T22:39:32.092575] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-01T22:39:32.128962] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-01T22:39:32.130465] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-01T22:39:32.133630] [INFO ] [MAIN ] Derivative Progress: 667/1587 symbols completed. FFC took 1.2s. Estimated remaining: 6m 24s. Rate: 143.6 symbols/min [2025-10-01T22:39:32.134028] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:32.150669] [DEBUG] [MAIN ] FFWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:32.152606] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-10-01T22:39:32.154836] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35720 primary records. [2025-10-01T22:39:32.155064] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-01T22:39:32.155001] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-01T22:39:32.158777] [INFO ] [MAIN ] Derivative Progress: 668/1587 symbols completed. FG took 1.2s. Estimated remaining: 6m 23s. Rate: 143.8 symbols/min [2025-10-01T22:39:32.159079] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:32.175447] [DEBUG] [LOCAL ] FGN: Loaded 3895 existing records from primary storage. [2025-10-01T22:39:32.180062] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-01T22:39:32.180422] [INFO ] [MAIN ] FGN: Loaded 3895 primary data records. [2025-10-01T22:39:32.180526] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-01T22:39:32.190111] [INFO ] [MAIN ] Derivative Progress: 669/1587 symbols completed. FFWM took 1.2s. Estimated remaining: 6m 22s. Rate: 144.0 symbols/min [2025-10-01T22:39:32.196069] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:32.578618] [DEBUG] [LOCAL ] FHI: Loaded 40247 existing records from primary storage. [2025-10-01T22:39:32.578922] [INFO ] [MAIN ] FHI: Loaded 40247 primary data records. [2025-10-01T22:39:32.748493] [DEBUG] [LOCAL ] FHN: Loaded 53365 existing records from primary storage. [2025-10-01T22:39:32.771195] [INFO ] [MAIN ] FHN: Loaded 53365 primary data records. [2025-10-01T22:39:33.283261] [DEBUG] [MAIN ] FGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:33.284242] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3895 primary records. [2025-10-01T22:39:33.285419] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-01T22:39:33.303203] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-01T22:39:33.304414] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-01T22:39:33.306799] [INFO ] [MAIN ] Derivative Progress: 670/1587 symbols completed. FGN took 1.2s. Estimated remaining: 6m 23s. Rate: 143.6 symbols/min [2025-10-01T22:39:33.307265] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:33.327120] [DEBUG] [MAIN ] FHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:33.327859] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40247 primary records. [2025-10-01T22:39:33.328466] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-01T22:39:33.346881] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-01T22:39:33.349266] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-01T22:39:33.352764] [INFO ] [MAIN ] Derivative Progress: 671/1587 symbols completed. FHI took 1.2s. Estimated remaining: 6m 22s. Rate: 143.8 symbols/min [2025-10-01T22:39:33.353017] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:33.367004] [DEBUG] [MAIN ] FHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:33.367909] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53365 primary records. [2025-10-01T22:39:33.368107] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-01T22:39:33.400214] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-01T22:39:33.400585] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-01T22:39:33.403599] [INFO ] [MAIN ] Derivative Progress: 672/1587 symbols completed. FHN took 1.2s. Estimated remaining: 6m 21s. Rate: 144.0 symbols/min [2025-10-01T22:39:33.403984] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:33.420263] [DEBUG] [LOCAL ] FICO: Loaded 20486 existing records from primary storage. [2025-10-01T22:39:33.435092] [INFO ] [MAIN ] FICO: Loaded 20486 primary data records. [2025-10-01T22:39:33.449923] [DEBUG] [LOCAL ] FI: Loaded 53499 existing records from primary storage. [2025-10-01T22:39:33.468187] [INFO ] [MAIN ] FI: Loaded 53499 primary data records. [2025-10-01T22:39:33.956536] [DEBUG] [LOCAL ] FIGS: Loaded 48826 existing records from primary storage. [2025-10-01T22:39:33.970325] [INFO ] [MAIN ] FIGS: Loaded 48826 primary data records. [2025-10-01T22:39:34.537858] [DEBUG] [MAIN ] FI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:34.551911] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53499 primary records. [2025-10-01T22:39:34.553419] [DEBUG] [MAIN ] FICO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:39:34.554396] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-01T22:39:34.554127] [INFO ] [MAIN ] FICO: Generated 1793 derivative records from 20486 primary records. [2025-10-01T22:39:34.555901] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-01T22:39:34.585352] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-01T22:39:34.589849] [DEBUG] [LOCAL ] FICO: Derivative data saved (1793 records). [2025-10-01T22:39:34.590169] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-01T22:39:34.592186] [INFO ] [MAIN ] Derivative Progress: 673/1587 symbols completed. FICO took 1.2s. Estimated remaining: 6m 22s. Rate: 143.6 symbols/min [2025-10-01T22:39:34.592447] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-01T22:39:34.595153] [INFO ] [MAIN ] Derivative Progress: 674/1587 symbols completed. FI took 1.3s. Estimated remaining: 6m 21s. Rate: 143.8 symbols/min [2025-10-01T22:39:34.613113] [DEBUG] [MAIN ] FIGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:34.613817] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48826 primary records. [2025-10-01T22:39:34.613881] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-01T22:39:34.635514] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-01T22:39:34.635687] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-01T22:39:34.638161] [INFO ] [MAIN ] Derivative Progress: 675/1587 symbols completed. FIGS took 1.2s. Estimated remaining: 6m 20s. Rate: 144.0 symbols/min [2025-10-01T22:39:34.638582] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:34.638716] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:34.638851] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:34.651376] [DEBUG] [LOCAL ] FINS: Loaded 8293 existing records from primary storage. [2025-10-01T22:39:34.651604] [INFO ] [MAIN ] FINS: Loaded 8293 primary data records. [2025-10-01T22:39:34.920425] [DEBUG] [LOCAL ] FINV: Loaded 45304 existing records from primary storage. [2025-10-01T22:39:34.921244] [DEBUG] [LOCAL ] FIHL: Loaded 39863 existing records from primary storage. [2025-10-01T22:39:35.043370] [INFO ] [MAIN ] FIHL: Loaded 39863 primary data records. [2025-10-01T22:39:35.042628] [INFO ] [MAIN ] FINV: Loaded 45304 primary data records. [2025-10-01T22:39:35.724406] [DEBUG] [MAIN ] FINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:35.725369] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8293 primary records. [2025-10-01T22:39:35.727192] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-01T22:39:35.744355] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-01T22:39:35.744766] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-01T22:39:35.746816] [INFO ] [MAIN ] Derivative Progress: 676/1587 symbols completed. FINS took 1.1s. Estimated remaining: 6m 20s. Rate: 143.7 symbols/min [2025-10-01T22:39:35.747169] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:35.767031] [DEBUG] [MAIN ] FINV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:35.768040] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45304 primary records. [2025-10-01T22:39:35.775607] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-01T22:39:35.781470] [DEBUG] [MAIN ] FIHL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:35.794743] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39863 primary records. [2025-10-01T22:39:35.797310] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-01T22:39:35.799297] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-01T22:39:35.799384] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-01T22:39:35.802316] [INFO ] [MAIN ] Derivative Progress: 677/1587 symbols completed. FINV took 1.2s. Estimated remaining: 6m 20s. Rate: 143.9 symbols/min [2025-10-01T22:39:35.802794] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:35.819290] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-01T22:39:35.833071] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-01T22:39:35.835287] [INFO ] [MAIN ] Derivative Progress: 678/1587 symbols completed. FIHL took 1.2s. Estimated remaining: 6m 19s. Rate: 144.1 symbols/min [2025-10-01T22:39:35.835590] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:35.843129] [DEBUG] [LOCAL ] FLC: Loaded 5422 existing records from primary storage. [2025-10-01T22:39:35.844049] [INFO ] [MAIN ] FLC: Loaded 5422 primary data records. [2025-10-01T22:39:35.918691] [DEBUG] [LOCAL ] FIS: Loaded 53361 existing records from primary storage. [2025-10-01T22:39:35.955512] [INFO ] [MAIN ] FIS: Loaded 53361 primary data records. [2025-10-01T22:39:36.069707] [DEBUG] [LOCAL ] FIX: Loaded 29792 existing records from primary storage. [2025-10-01T22:39:36.141206] [INFO ] [MAIN ] FIX: Loaded 29792 primary data records. [2025-10-01T22:39:36.950760] [DEBUG] [MAIN ] FLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:36.951861] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5422 primary records. [2025-10-01T22:39:36.952150] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-01T22:39:36.970679] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-01T22:39:36.970901] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-01T22:39:36.973066] [INFO ] [MAIN ] Derivative Progress: 679/1587 symbols completed. FLC took 1.1s. Estimated remaining: 6m 19s. Rate: 143.7 symbols/min [2025-10-01T22:39:36.973463] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:36.991737] [DEBUG] [MAIN ] FIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:36.992722] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53361 primary records. [2025-10-01T22:39:36.993626] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-01T22:39:37.011911] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-01T22:39:37.025741] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-01T22:39:37.027952] [INFO ] [MAIN ] Derivative Progress: 680/1587 symbols completed. FIS took 1.3s. Estimated remaining: 6m 18s. Rate: 143.9 symbols/min [2025-10-01T22:39:37.025672] [DEBUG] [MAIN ] FIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:37.029466] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 29792 primary records. [2025-10-01T22:39:37.029628] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-01T22:39:37.028126] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:37.055021] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-10-01T22:39:37.055256] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-01T22:39:37.058347] [INFO ] [MAIN ] Derivative Progress: 681/1587 symbols completed. FIX took 1.3s. Estimated remaining: 6m 17s. Rate: 144.1 symbols/min [2025-10-01T22:39:37.072696] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:37.106119] [DEBUG] [LOCAL ] FLG: Loaded 53320 existing records from primary storage. [2025-10-01T22:39:37.106414] [INFO ] [MAIN ] FLG: Loaded 53320 primary data records. [2025-10-01T22:39:37.252276] [DEBUG] [LOCAL ] FLNG: Loaded 33707 existing records from primary storage. [2025-10-01T22:39:37.263162] [INFO ] [MAIN ] FLNG: Loaded 33707 primary data records. [2025-10-01T22:39:37.572153] [DEBUG] [LOCAL ] FLO: Loaded 51910 existing records from primary storage. [2025-10-01T22:39:37.583929] [INFO ] [MAIN ] FLO: Loaded 51910 primary data records. [2025-10-01T22:39:38.180986] [DEBUG] [MAIN ] FLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:38.182756] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53320 primary records. [2025-10-01T22:39:38.182980] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-01T22:39:38.208282] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-01T22:39:38.209029] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-01T22:39:38.219381] [INFO ] [MAIN ] Derivative Progress: 682/1587 symbols completed. FLG took 1.2s. Estimated remaining: 6m 18s. Rate: 143.7 symbols/min [2025-10-01T22:39:38.225758] [DEBUG] [MAIN ] FLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:38.225379] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:38.227481] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33707 primary records. [2025-10-01T22:39:38.227808] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-01T22:39:38.246418] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-01T22:39:38.247532] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-01T22:39:38.252594] [INFO ] [MAIN ] Derivative Progress: 683/1587 symbols completed. FLNG took 1.2s. Estimated remaining: 6m 17s. Rate: 143.9 symbols/min [2025-10-01T22:39:38.253795] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:38.270313] [DEBUG] [MAIN ] FLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:38.271372] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51910 primary records. [2025-10-01T22:39:38.271563] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-01T22:39:38.291634] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-01T22:39:38.291975] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-01T22:39:38.295012] [INFO ] [MAIN ] Derivative Progress: 684/1587 symbols completed. FLO took 1.2s. Estimated remaining: 6m 16s. Rate: 144.1 symbols/min [2025-10-01T22:39:38.295310] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:38.348032] [DEBUG] [LOCAL ] FLR: Loaded 53125 existing records from primary storage. [2025-10-01T22:39:38.361165] [INFO ] [MAIN ] FLR: Loaded 53125 primary data records. [2025-10-01T22:39:38.375490] [DEBUG] [LOCAL ] FLS: Loaded 50175 existing records from primary storage. [2025-10-01T22:39:38.397820] [INFO ] [MAIN ] FLS: Loaded 50175 primary data records. [2025-10-01T22:39:38.640973] [DEBUG] [LOCAL ] FLUT: Loaded 50788 existing records from primary storage. [2025-10-01T22:39:38.651432] [INFO ] [MAIN ] FLUT: Loaded 50788 primary data records. [2025-10-01T22:39:39.471839] [DEBUG] [MAIN ] FLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:39.486176] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50175 primary records. [2025-10-01T22:39:39.486755] [DEBUG] [MAIN ] FLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:39.486972] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-01T22:39:39.488215] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53125 primary records. [2025-10-01T22:39:39.488847] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-01T22:39:39.517845] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-10-01T22:39:39.520260] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-01T22:39:39.522892] [INFO ] [MAIN ] Derivative Progress: 685/1587 symbols completed. FLS took 1.3s. Estimated remaining: 6m 17s. Rate: 143.7 symbols/min [2025-10-01T22:39:39.523494] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:39.524474] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-01T22:39:39.525311] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-01T22:39:39.527981] [INFO ] [MAIN ] Derivative Progress: 686/1587 symbols completed. FLR took 1.3s. Estimated remaining: 6m 16s. Rate: 143.9 symbols/min [2025-10-01T22:39:39.528332] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:39.547983] [DEBUG] [MAIN ] FLUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:39.553999] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50788 primary records. [2025-10-01T22:39:39.554159] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-01T22:39:39.578515] [DEBUG] [LOCAL ] FLXR: Loaded 20437 existing records from primary storage. [2025-10-01T22:39:39.581560] [INFO ] [MAIN ] FLXR: Loaded 20437 primary data records. [2025-10-01T22:39:39.581672] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-01T22:39:39.587074] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-01T22:39:39.620490] [INFO ] [MAIN ] Derivative Progress: 687/1587 symbols completed. FLUT took 1.3s. Estimated remaining: 6m 15s. Rate: 144.0 symbols/min [2025-10-01T22:39:39.650517] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:39.807180] [DEBUG] [LOCAL ] FMN: Loaded 5591 existing records from primary storage. [2025-10-01T22:39:39.833873] [INFO ] [MAIN ] FMN: Loaded 5591 primary data records. [2025-10-01T22:39:39.835208] [DEBUG] [LOCAL ] FMC: Loaded 51782 existing records from primary storage. [2025-10-01T22:39:39.853497] [INFO ] [MAIN ] FMC: Loaded 51782 primary data records. [2025-10-01T22:39:40.664525] [DEBUG] [MAIN ] FLXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:40.666553] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20437 primary records. [2025-10-01T22:39:40.666754] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-01T22:39:40.688748] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-10-01T22:39:40.690213] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-01T22:39:40.692944] [INFO ] [MAIN ] Derivative Progress: 688/1587 symbols completed. FLXR took 1.2s. Estimated remaining: 6m 15s. Rate: 143.7 symbols/min [2025-10-01T22:39:40.710408] [DEBUG] [MAIN ] FMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:40.713127] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51782 primary records. [2025-10-01T22:39:40.713959] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-01T22:39:40.736250] [DEBUG] [MAIN ] FMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:40.739837] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5591 primary records. [2025-10-01T22:39:40.742434] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-01T22:39:40.745473] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-01T22:39:40.745586] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-01T22:39:40.748145] [INFO ] [MAIN ] Derivative Progress: 689/1587 symbols completed. FMC took 1.2s. Estimated remaining: 6m 14s. Rate: 143.9 symbols/min [2025-10-01T22:39:40.762003] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-01T22:39:40.762068] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-01T22:39:40.765091] [INFO ] [MAIN ] Derivative Progress: 690/1587 symbols completed. FMN took 1.1s. Estimated remaining: 6m 14s. Rate: 144.1 symbols/min [2025-10-01T22:39:40.765479] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:40.765713] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:40.765605] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:40.770811] [DEBUG] [LOCAL ] FMY: Loaded 1397 existing records from primary storage. [2025-10-01T22:39:40.771116] [INFO ] [MAIN ] FMY: Loaded 1397 primary data records. [2025-10-01T22:39:41.189723] [DEBUG] [LOCAL ] FMS: Loaded 30083 existing records from primary storage. [2025-10-01T22:39:41.190749] [DEBUG] [LOCAL ] FMX: Loaded 40731 existing records from primary storage. [2025-10-01T22:39:41.190031] [INFO ] [MAIN ] FMS: Loaded 30083 primary data records. [2025-10-01T22:39:41.190885] [INFO ] [MAIN ] FMX: Loaded 40731 primary data records. [2025-10-01T22:39:41.888488] [DEBUG] [MAIN ] FMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:41.890996] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1397 primary records. [2025-10-01T22:39:41.892610] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-01T22:39:41.910399] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-10-01T22:39:41.910993] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-01T22:39:41.913383] [INFO ] [MAIN ] Derivative Progress: 691/1587 symbols completed. FMY took 1.1s. Estimated remaining: 6m 14s. Rate: 143.7 symbols/min [2025-10-01T22:39:41.913733] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:41.935527] [DEBUG] [MAIN ] FMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:41.936326] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40731 primary records. [2025-10-01T22:39:41.936516] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-01T22:39:41.978349] [DEBUG] [MAIN ] FMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:41.979505] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-01T22:39:41.980494] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30083 primary records. [2025-10-01T22:39:41.980636] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-01T22:39:41.980763] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-01T22:39:41.983743] [INFO ] [MAIN ] Derivative Progress: 692/1587 symbols completed. FMX took 1.2s. Estimated remaining: 6m 13s. Rate: 143.9 symbols/min [2025-10-01T22:39:41.984224] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:42.013703] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-01T22:39:42.013864] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-01T22:39:42.016773] [INFO ] [MAIN ] Derivative Progress: 693/1587 symbols completed. FMS took 1.3s. Estimated remaining: 6m 12s. Rate: 144.1 symbols/min [2025-10-01T22:39:42.017712] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:42.017473] [DEBUG] [LOCAL ] FN: Loaded 38577 existing records from primary storage. [2025-10-01T22:39:42.018351] [INFO ] [MAIN ] FN: Loaded 38577 primary data records. [2025-10-01T22:39:42.398453] [DEBUG] [LOCAL ] FNB: Loaded 52458 existing records from primary storage. [2025-10-01T22:39:42.400936] [INFO ] [MAIN ] FNB: Loaded 52458 primary data records. [2025-10-01T22:39:42.434073] [DEBUG] [LOCAL ] FND: Loaded 52101 existing records from primary storage. [2025-10-01T22:39:42.480038] [INFO ] [MAIN ] FND: Loaded 52101 primary data records. [2025-10-01T22:39:43.161119] [DEBUG] [MAIN ] FN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:43.162164] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 38577 primary records. [2025-10-01T22:39:43.162280] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-01T22:39:43.182040] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-01T22:39:43.182840] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-01T22:39:43.185499] [INFO ] [MAIN ] Derivative Progress: 694/1587 symbols completed. FN took 1.3s. Estimated remaining: 6m 13s. Rate: 143.7 symbols/min [2025-10-01T22:39:43.186063] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:43.209143] [DEBUG] [MAIN ] FNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:43.211614] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52458 primary records. [2025-10-01T22:39:43.211924] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-01T22:39:43.241113] [DEBUG] [MAIN ] FND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:43.243096] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-01T22:39:43.244060] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52101 primary records. [2025-10-01T22:39:43.244177] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-01T22:39:43.246331] [INFO ] [MAIN ] Derivative Progress: 695/1587 symbols completed. FNB took 1.3s. Estimated remaining: 6m 12s. Rate: 143.9 symbols/min [2025-10-01T22:39:43.246569] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:43.244244] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-01T22:39:43.283529] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-01T22:39:43.284739] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-01T22:39:43.287405] [INFO ] [MAIN ] Derivative Progress: 696/1587 symbols completed. FND took 1.3s. Estimated remaining: 6m 11s. Rate: 144.1 symbols/min [2025-10-01T22:39:43.284541] [DEBUG] [LOCAL ] FOA: Loaded 13079 existing records from primary storage. [2025-10-01T22:39:43.302405] [INFO ] [MAIN ] FOA: Loaded 13079 primary data records. [2025-10-01T22:39:43.287893] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:43.345713] [DEBUG] [LOCAL ] FNV: Loaded 46148 existing records from primary storage. [2025-10-01T22:39:43.392380] [INFO ] [MAIN ] FNV: Loaded 46148 primary data records. [2025-10-01T22:39:43.407894] [DEBUG] [LOCAL ] FOF: Loaded 8431 existing records from primary storage. [2025-10-01T22:39:43.436352] [INFO ] [MAIN ] FOF: Loaded 8431 primary data records. [2025-10-01T22:39:44.336046] [DEBUG] [MAIN ] FOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:44.337031] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13079 primary records. [2025-10-01T22:39:44.337432] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-01T22:39:44.359099] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-01T22:39:44.359561] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-01T22:39:44.374876] [DEBUG] [MAIN ] FOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:44.374414] [INFO ] [MAIN ] Derivative Progress: 697/1587 symbols completed. FOA took 1.1s. Estimated remaining: 6m 11s. Rate: 143.7 symbols/min [2025-10-01T22:39:44.375089] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:44.376041] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8431 primary records. [2025-10-01T22:39:44.388975] [DEBUG] [MAIN ] FNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:44.389978] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46148 primary records. [2025-10-01T22:39:44.389231] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-01T22:39:44.391681] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-01T22:39:44.420521] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-01T22:39:44.421170] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-01T22:39:44.423630] [INFO ] [MAIN ] Derivative Progress: 698/1587 symbols completed. FOF took 1.1s. Estimated remaining: 6m 11s. Rate: 143.9 symbols/min [2025-10-01T22:39:44.424894] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:44.433759] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-01T22:39:44.434058] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-01T22:39:44.436700] [INFO ] [MAIN ] Derivative Progress: 699/1587 symbols completed. FNV took 1.3s. Estimated remaining: 6m 10s. Rate: 144.1 symbols/min [2025-10-01T22:39:44.436963] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:44.445452] [DEBUG] [LOCAL ] FOR: Loaded 19842 existing records from primary storage. [2025-10-01T22:39:44.445691] [INFO ] [MAIN ] FOR: Loaded 19842 primary data records. [2025-10-01T22:39:44.567786] [DEBUG] [LOCAL ] FPF: Loaded 18186 existing records from primary storage. [2025-10-01T22:39:44.567946] [INFO ] [MAIN ] FPF: Loaded 18186 primary data records. [2025-10-01T22:39:44.872296] [DEBUG] [LOCAL ] FOUR: Loaded 49533 existing records from primary storage. [2025-10-01T22:39:44.921266] [INFO ] [MAIN ] FOUR: Loaded 49533 primary data records. [2025-10-01T22:39:45.548572] [DEBUG] [MAIN ] FOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:45.550992] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19842 primary records. [2025-10-01T22:39:45.551885] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-01T22:39:45.573098] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-01T22:39:45.573473] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-01T22:39:45.575956] [INFO ] [MAIN ] Derivative Progress: 700/1587 symbols completed. FOR took 1.2s. Estimated remaining: 6m 10s. Rate: 143.8 symbols/min [2025-10-01T22:39:45.576345] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:45.594725] [DEBUG] [MAIN ] FPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:45.596157] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18186 primary records. [2025-10-01T22:39:45.596521] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-01T22:39:45.643357] [DEBUG] [LOCAL ] FPH: Loaded 19419 existing records from primary storage. [2025-10-01T22:39:45.644130] [DEBUG] [MAIN ] FOUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:45.643455] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-01T22:39:45.644449] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-01T22:39:45.645403] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49533 primary records. [2025-10-01T22:39:45.647571] [INFO ] [MAIN ] Derivative Progress: 701/1587 symbols completed. FPF took 1.2s. Estimated remaining: 6m 9s. Rate: 143.9 symbols/min [2025-10-01T22:39:45.644363] [INFO ] [MAIN ] FPH: Loaded 19419 primary data records. [2025-10-01T22:39:45.648268] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-01T22:39:45.647844] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:45.729552] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-01T22:39:45.739067] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-01T22:39:45.760337] [INFO ] [MAIN ] Derivative Progress: 702/1587 symbols completed. FOUR took 1.3s. Estimated remaining: 6m 9s. Rate: 144.1 symbols/min [2025-10-01T22:39:45.760682] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:46.033032] [DEBUG] [LOCAL ] FPI: Loaded 31045 existing records from primary storage. [2025-10-01T22:39:46.033686] [INFO ] [MAIN ] FPI: Loaded 31045 primary data records. [2025-10-01T22:39:46.141570] [DEBUG] [LOCAL ] FR: Loaded 46429 existing records from primary storage. [2025-10-01T22:39:46.167384] [INFO ] [MAIN ] FR: Loaded 46429 primary data records. [2025-10-01T22:39:46.734490] [DEBUG] [MAIN ] FPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:46.746376] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19419 primary records. [2025-10-01T22:39:46.746585] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-01T22:39:46.769429] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-01T22:39:46.769606] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-01T22:39:46.772066] [INFO ] [MAIN ] Derivative Progress: 703/1587 symbols completed. FPH took 1.2s. Estimated remaining: 6m 9s. Rate: 143.8 symbols/min [2025-10-01T22:39:46.792966] [DEBUG] [MAIN ] FPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:46.793765] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31045 primary records. [2025-10-01T22:39:46.793852] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-01T22:39:46.826315] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-01T22:39:46.826412] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-01T22:39:46.828969] [INFO ] [MAIN ] Derivative Progress: 704/1587 symbols completed. FPI took 1.2s. Estimated remaining: 6m 8s. Rate: 144.0 symbols/min [2025-10-01T22:39:46.826749] [DEBUG] [MAIN ] FR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:46.829913] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46429 primary records. [2025-10-01T22:39:46.829988] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-01T22:39:46.845690] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-01T22:39:46.845792] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-01T22:39:46.848515] [INFO ] [MAIN ] Derivative Progress: 705/1587 symbols completed. FR took 1.1s. Estimated remaining: 6m 7s. Rate: 144.2 symbols/min [2025-10-01T22:39:46.849146] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:46.849279] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:46.849367] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:46.873248] [DEBUG] [LOCAL ] FRA: Loaded 14571 existing records from primary storage. [2025-10-01T22:39:46.880219] [INFO ] [MAIN ] FRA: Loaded 14571 primary data records. [2025-10-01T22:39:46.880686] [DEBUG] [LOCAL ] FRGE: Loaded 17691 existing records from primary storage. [2025-10-01T22:39:46.904595] [INFO ] [MAIN ] FRGE: Loaded 17691 primary data records. [2025-10-01T22:39:47.182099] [DEBUG] [LOCAL ] FRO: Loaded 51761 existing records from primary storage. [2025-10-01T22:39:47.222049] [INFO ] [MAIN ] FRO: Loaded 51761 primary data records. [2025-10-01T22:39:47.971201] [DEBUG] [MAIN ] FRGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:47.985545] [DEBUG] [MAIN ] FRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:47.986519] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 17691 primary records. [2025-10-01T22:39:47.987825] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14571 primary records. [2025-10-01T22:39:47.986922] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-01T22:39:47.988218] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-01T22:39:48.020583] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-01T22:39:48.022898] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-01T22:39:48.023018] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-01T22:39:48.025348] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-01T22:39:48.025262] [INFO ] [MAIN ] Derivative Progress: 706/1587 symbols completed. FRGE took 1.2s. Estimated remaining: 6m 8s. Rate: 143.8 symbols/min [2025-10-01T22:39:48.027878] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:48.028039] [INFO ] [MAIN ] Derivative Progress: 707/1587 symbols completed. FRA took 1.2s. Estimated remaining: 6m 7s. Rate: 144.0 symbols/min [2025-10-01T22:39:48.028794] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:48.046410] [DEBUG] [MAIN ] FRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:48.047256] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51761 primary records. [2025-10-01T22:39:48.047332] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-01T22:39:48.063717] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-01T22:39:48.064005] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-01T22:39:48.067148] [INFO ] [MAIN ] Derivative Progress: 708/1587 symbols completed. FRO took 1.2s. Estimated remaining: 6m 6s. Rate: 144.2 symbols/min [2025-10-01T22:39:48.067431] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:48.104366] [DEBUG] [LOCAL ] FSCO: Loaded 37554 existing records from primary storage. [2025-10-01T22:39:48.105555] [INFO ] [MAIN ] FSCO: Loaded 37554 primary data records. [2025-10-01T22:39:48.165136] [DEBUG] [LOCAL ] FRT: Loaded 41996 existing records from primary storage. [2025-10-01T22:39:48.179098] [INFO ] [MAIN ] FRT: Loaded 41996 primary data records. [2025-10-01T22:39:48.475611] [DEBUG] [LOCAL ] FSK: Loaded 49410 existing records from primary storage. [2025-10-01T22:39:48.486085] [INFO ] [MAIN ] FSK: Loaded 49410 primary data records. [2025-10-01T22:39:49.145853] [DEBUG] [MAIN ] FSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:49.146716] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 37554 primary records. [2025-10-01T22:39:49.146888] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-01T22:39:49.177307] [DEBUG] [MAIN ] FRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:49.179322] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41996 primary records. [2025-10-01T22:39:49.180104] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-01T22:39:49.185519] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-01T22:39:49.185779] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-01T22:39:49.196771] [INFO ] [MAIN ] Derivative Progress: 709/1587 symbols completed. FSCO took 1.2s. Estimated remaining: 6m 6s. Rate: 143.8 symbols/min [2025-10-01T22:39:49.198538] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:49.206095] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-01T22:39:49.206834] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-01T22:39:49.209294] [INFO ] [MAIN ] Derivative Progress: 710/1587 symbols completed. FRT took 1.2s. Estimated remaining: 6m 5s. Rate: 144.0 symbols/min [2025-10-01T22:39:49.209570] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:49.229631] [DEBUG] [MAIN ] FSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:49.230490] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49410 primary records. [2025-10-01T22:39:49.230635] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-01T22:39:49.268701] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-01T22:39:49.268906] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-01T22:39:49.271490] [INFO ] [MAIN ] Derivative Progress: 711/1587 symbols completed. FSK took 1.2s. Estimated remaining: 6m 4s. Rate: 144.2 symbols/min [2025-10-01T22:39:49.272022] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:49.306947] [DEBUG] [LOCAL ] FSLY: Loaded 51231 existing records from primary storage. [2025-10-01T22:39:49.307308] [INFO ] [MAIN ] FSLY: Loaded 51231 primary data records. [2025-10-01T22:39:49.407395] [DEBUG] [LOCAL ] FSM: Loaded 53292 existing records from primary storage. [2025-10-01T22:39:49.421108] [INFO ] [MAIN ] FSM: Loaded 53292 primary data records. [2025-10-01T22:39:49.640753] [DEBUG] [LOCAL ] FSS: Loaded 34065 existing records from primary storage. [2025-10-01T22:39:49.680530] [INFO ] [MAIN ] FSS: Loaded 34065 primary data records. [2025-10-01T22:39:50.389524] [DEBUG] [MAIN ] FSLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:50.390499] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51231 primary records. [2025-10-01T22:39:50.390637] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-01T22:39:50.415413] [DEBUG] [MAIN ] FSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:50.421453] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53292 primary records. [2025-10-01T22:39:50.422056] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-01T22:39:50.442362] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-01T22:39:50.443675] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-01T22:39:50.446324] [INFO ] [MAIN ] Derivative Progress: 712/1587 symbols completed. FSLY took 1.2s. Estimated remaining: 6m 5s. Rate: 143.8 symbols/min [2025-10-01T22:39:50.444002] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-01T22:39:50.446509] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:50.448334] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-01T22:39:50.451219] [INFO ] [MAIN ] Derivative Progress: 713/1587 symbols completed. FSM took 1.2s. Estimated remaining: 6m 4s. Rate: 144.0 symbols/min [2025-10-01T22:39:50.452591] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:50.469907] [DEBUG] [MAIN ] FSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:50.473910] [DEBUG] [LOCAL ] FT: Loaded 6535 existing records from primary storage. [2025-10-01T22:39:50.474878] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34065 primary records. [2025-10-01T22:39:50.475090] [INFO ] [MAIN ] FT: Loaded 6535 primary data records. [2025-10-01T22:39:50.475213] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-01T22:39:50.589287] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-01T22:39:50.589471] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-01T22:39:50.597405] [INFO ] [MAIN ] Derivative Progress: 714/1587 symbols completed. FSS took 1.3s. Estimated remaining: 6m 3s. Rate: 144.2 symbols/min [2025-10-01T22:39:50.602766] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:50.608813] [DEBUG] [LOCAL ] FTHY: Loaded 11958 existing records from primary storage. [2025-10-01T22:39:50.622923] [INFO ] [MAIN ] FTHY: Loaded 11958 primary data records. [2025-10-01T22:39:51.229310] [DEBUG] [LOCAL ] FTI: Loaded 53299 existing records from primary storage. [2025-10-01T22:39:51.230565] [INFO ] [MAIN ] FTI: Loaded 53299 primary data records. [2025-10-01T22:39:51.455259] [DEBUG] [MAIN ] FT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:51.639856] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6535 primary records. [2025-10-01T22:39:51.642105] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-01T22:39:51.668243] [DEBUG] [MAIN ] FTHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:51.674243] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11958 primary records. [2025-10-01T22:39:51.674856] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-01T22:39:51.674637] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-01T22:39:51.675510] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-01T22:39:51.678085] [INFO ] [MAIN ] Derivative Progress: 715/1587 symbols completed. FT took 1.2s. Estimated remaining: 6m 4s. Rate: 143.8 symbols/min [2025-10-01T22:39:51.678693] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:51.698001] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-01T22:39:51.698198] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-01T22:39:51.700907] [INFO ] [MAIN ] Derivative Progress: 716/1587 symbols completed. FTHY took 1.2s. Estimated remaining: 6m 3s. Rate: 144.0 symbols/min [2025-10-01T22:39:51.701284] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:51.727532] [DEBUG] [MAIN ] FTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:51.728473] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53299 primary records. [2025-10-01T22:39:51.728666] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-01T22:39:51.746124] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-01T22:39:51.756226] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-01T22:39:51.758622] [INFO ] [MAIN ] Derivative Progress: 717/1587 symbols completed. FTI took 1.2s. Estimated remaining: 6m 2s. Rate: 144.2 symbols/min [2025-10-01T22:39:51.758807] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:51.760378] [DEBUG] [LOCAL ] FTK: Loaded 32200 existing records from primary storage. [2025-10-01T22:39:51.760689] [INFO ] [MAIN ] FTK: Loaded 32200 primary data records. [2025-10-01T22:39:51.945389] [DEBUG] [LOCAL ] FTS: Loaded 42138 existing records from primary storage. [2025-10-01T22:39:51.955114] [INFO ] [MAIN ] FTS: Loaded 42138 primary data records. [2025-10-01T22:39:52.307007] [DEBUG] [LOCAL ] FTV: Loaded 52928 existing records from primary storage. [2025-10-01T22:39:52.316877] [INFO ] [MAIN ] FTV: Loaded 52928 primary data records. [2025-10-01T22:39:52.843671] [DEBUG] [MAIN ] FTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:52.844726] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32200 primary records. [2025-10-01T22:39:52.845746] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-01T22:39:52.867772] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-01T22:39:52.867973] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-01T22:39:52.883869] [INFO ] [MAIN ] Derivative Progress: 718/1587 symbols completed. FTK took 1.2s. Estimated remaining: 6m 2s. Rate: 143.9 symbols/min [2025-10-01T22:39:52.885104] [DEBUG] [MAIN ] FTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:52.886099] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42138 primary records. [2025-10-01T22:39:52.886309] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-01T22:39:52.903393] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-01T22:39:52.903598] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-01T22:39:52.906054] [INFO ] [MAIN ] Derivative Progress: 719/1587 symbols completed. FTS took 1.2s. Estimated remaining: 6m 2s. Rate: 144.1 symbols/min [2025-10-01T22:39:52.921884] [DEBUG] [MAIN ] FTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:52.922474] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52928 primary records. [2025-10-01T22:39:52.922536] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-01T22:39:52.938893] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-01T22:39:52.939006] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-01T22:39:52.941308] [INFO ] [MAIN ] Derivative Progress: 720/1587 symbols completed. FTV took 1.2s. Estimated remaining: 6m 1s. Rate: 144.2 symbols/min [2025-10-01T22:39:52.941964] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:52.942042] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:52.941877] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:52.947152] [DEBUG] [LOCAL ] FTWO: Loaded 1816 existing records from primary storage. [2025-10-01T22:39:52.947296] [INFO ] [MAIN ] FTWO: Loaded 1816 primary data records. [2025-10-01T22:39:53.310018] [DEBUG] [LOCAL ] FUL: Loaded 32983 existing records from primary storage. [2025-10-01T22:39:53.311106] [INFO ] [MAIN ] FUL: Loaded 32983 primary data records. [2025-10-01T22:39:53.382893] [DEBUG] [LOCAL ] FUBO: Loaded 53697 existing records from primary storage. [2025-10-01T22:39:53.404208] [INFO ] [MAIN ] FUBO: Loaded 53697 primary data records. [2025-10-01T22:39:54.128884] [DEBUG] [MAIN ] FTWO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:39:54.130782] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1816 primary records. [2025-10-01T22:39:54.130908] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-01T22:39:54.148765] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-01T22:39:54.149035] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-01T22:39:54.151591] [INFO ] [MAIN ] Derivative Progress: 721/1587 symbols completed. FTWO took 1.2s. Estimated remaining: 6m 1s. Rate: 143.9 symbols/min [2025-10-01T22:39:54.153285] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:54.174992] [DEBUG] [MAIN ] FUL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:54.176628] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32983 primary records. [2025-10-01T22:39:54.177546] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-01T22:39:54.207811] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-01T22:39:54.208203] [DEBUG] [MAIN ] FUBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:54.209170] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-01T22:39:54.209117] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53697 primary records. [2025-10-01T22:39:54.211462] [INFO ] [MAIN ] Derivative Progress: 722/1587 symbols completed. FUL took 1.3s. Estimated remaining: 6m 0s. Rate: 144.0 symbols/min [2025-10-01T22:39:54.211854] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-01T22:39:54.211674] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:54.229511] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-01T22:39:54.244159] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-01T22:39:54.246639] [INFO ] [MAIN ] Derivative Progress: 723/1587 symbols completed. FUBO took 1.3s. Estimated remaining: 5m 59s. Rate: 144.2 symbols/min [2025-10-01T22:39:54.246995] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:54.279942] [DEBUG] [LOCAL ] FVR: Loaded 21768 existing records from primary storage. [2025-10-01T22:39:54.280123] [INFO ] [MAIN ] FVR: Loaded 21768 primary data records. [2025-10-01T22:39:54.293926] [DEBUG] [LOCAL ] FUN: Loaded 51609 existing records from primary storage. [2025-10-01T22:39:54.305395] [INFO ] [MAIN ] FUN: Loaded 51609 primary data records. [2025-10-01T22:39:54.633883] [DEBUG] [LOCAL ] FVRR: Loaded 40034 existing records from primary storage. [2025-10-01T22:39:54.640728] [INFO ] [MAIN ] FVRR: Loaded 40034 primary data records. [2025-10-01T22:39:55.358014] [DEBUG] [MAIN ] FVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:55.360155] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21768 primary records. [2025-10-01T22:39:55.360446] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-01T22:39:55.384209] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-01T22:39:55.385094] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-01T22:39:55.387802] [INFO ] [MAIN ] Derivative Progress: 724/1587 symbols completed. FVR took 1.2s. Estimated remaining: 5m 60s. Rate: 143.9 symbols/min [2025-10-01T22:39:55.402244] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:55.403611] [DEBUG] [MAIN ] FUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:55.405523] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51609 primary records. [2025-10-01T22:39:55.405758] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-01T22:39:55.418752] [DEBUG] [LOCAL ] FXED: Loaded 1241 existing records from primary storage. [2025-10-01T22:39:55.419050] [INFO ] [MAIN ] FXED: Loaded 1241 primary data records. [2025-10-01T22:39:55.523941] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-01T22:39:55.540080] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-01T22:39:55.556716] [INFO ] [MAIN ] Derivative Progress: 725/1587 symbols completed. FUN took 1.4s. Estimated remaining: 5m 59s. Rate: 144.0 symbols/min [2025-10-01T22:39:55.563292] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:55.597828] [DEBUG] [MAIN ] FVRR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:55.638369] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40034 primary records. [2025-10-01T22:39:55.666770] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-01T22:39:55.811105] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-01T22:39:55.811777] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-01T22:39:55.814570] [INFO ] [MAIN ] Derivative Progress: 726/1587 symbols completed. FVRR took 1.6s. Estimated remaining: 5m 59s. Rate: 144.1 symbols/min [2025-10-01T22:39:55.815186] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:55.869900] [DEBUG] [MAIN ] FXED: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:39:55.872198] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1241 primary records. [2025-10-01T22:39:55.871355] [DEBUG] [LOCAL ] G: Loaded 49838 existing records from primary storage. [2025-10-01T22:39:55.872472] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-01T22:39:55.872571] [INFO ] [MAIN ] G: Loaded 49838 primary data records. [2025-10-01T22:39:55.921545] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-10-01T22:39:55.935676] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-01T22:39:55.981191] [INFO ] [MAIN ] Derivative Progress: 727/1587 symbols completed. FXED took 0.6s. Estimated remaining: 5m 58s. Rate: 144.2 symbols/min [2025-10-01T22:39:55.999454] [DEBUG] [LOCAL ] GAB: Loaded 27976 existing records from primary storage. [2025-10-01T22:39:56.014737] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:56.015187] [INFO ] [MAIN ] GAB: Loaded 27976 primary data records. [2025-10-01T22:39:56.102140] [DEBUG] [LOCAL ] GAM: Loaded 4061 existing records from primary storage. [2025-10-01T22:39:56.161968] [INFO ] [MAIN ] GAM: Loaded 4061 primary data records. [2025-10-01T22:39:56.955592] [DEBUG] [MAIN ] G: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:56.956545] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49838 primary records. [2025-10-01T22:39:56.957022] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-01T22:39:56.978490] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-01T22:39:56.979941] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-01T22:39:56.981995] [INFO ] [MAIN ] Derivative Progress: 728/1587 symbols completed. G took 1.4s. Estimated remaining: 5m 58s. Rate: 143.9 symbols/min [2025-10-01T22:39:56.982363] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:57.008807] [DEBUG] [MAIN ] GAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:57.010135] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27976 primary records. [2025-10-01T22:39:57.009337] [DEBUG] [MAIN ] GAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:57.010971] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4061 primary records. [2025-10-01T22:39:57.011127] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-01T22:39:57.010242] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-01T22:39:57.042380] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-01T22:39:57.043350] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-01T22:39:57.043510] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-01T22:39:57.045945] [INFO ] [MAIN ] Derivative Progress: 729/1587 symbols completed. GAM took 1.0s. Estimated remaining: 5m 57s. Rate: 144.1 symbols/min [2025-10-01T22:39:57.046140] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-01T22:39:57.046364] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:57.049266] [INFO ] [MAIN ] Derivative Progress: 730/1587 symbols completed. GAB took 1.2s. Estimated remaining: 5m 56s. Rate: 144.3 symbols/min [2025-10-01T22:39:57.049914] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:57.072486] [DEBUG] [LOCAL ] GBAB: Loaded 13085 existing records from primary storage. [2025-10-01T22:39:57.072696] [INFO ] [MAIN ] GBAB: Loaded 13085 primary data records. [2025-10-01T22:39:57.172792] [DEBUG] [LOCAL ] GATX: Loaded 18174 existing records from primary storage. [2025-10-01T22:39:57.180015] [INFO ] [MAIN ] GATX: Loaded 18174 primary data records. [2025-10-01T22:39:57.277106] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-10-01T22:39:57.311995] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-10-01T22:39:58.177096] [DEBUG] [MAIN ] GBAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:58.178673] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13085 primary records. [2025-10-01T22:39:58.179061] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-01T22:39:58.222989] [DEBUG] [MAIN ] GATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:58.225591] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18174 primary records. [2025-10-01T22:39:58.226491] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-01T22:39:58.239168] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-01T22:39:58.248353] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-01T22:39:58.250822] [INFO ] [MAIN ] Derivative Progress: 731/1587 symbols completed. GBAB took 1.2s. Estimated remaining: 5m 57s. Rate: 143.9 symbols/min [2025-10-01T22:39:58.251192] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:58.248447] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-01T22:39:58.259600] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-01T22:39:58.267801] [INFO ] [MAIN ] Derivative Progress: 732/1587 symbols completed. GATX took 1.2s. Estimated remaining: 5m 56s. Rate: 144.1 symbols/min [2025-10-01T22:39:58.268254] [DEBUG] [MAIN ] GAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:58.269359] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:58.269259] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-10-01T22:39:58.269606] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-01T22:39:58.293123] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-01T22:39:58.293330] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-01T22:39:58.297433] [INFO ] [MAIN ] Derivative Progress: 733/1587 symbols completed. GAP took 1.3s. Estimated remaining: 5m 55s. Rate: 144.3 symbols/min [2025-10-01T22:39:58.333534] [DEBUG] [LOCAL ] GBCI: Loaded 40011 existing records from primary storage. [2025-10-01T22:39:58.333758] [INFO ] [MAIN ] GBCI: Loaded 40011 primary data records. [2025-10-01T22:39:58.447697] [DEBUG] [LOCAL ] GBTG: Loaded 40046 existing records from primary storage. [2025-10-01T22:39:58.460116] [INFO ] [MAIN ] GBTG: Loaded 40046 primary data records. [2025-10-01T22:39:59.009774] [DEBUG] [MAIN ] GBCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:59.010674] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40011 primary records. [2025-10-01T22:39:59.010967] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-01T22:39:59.040599] [DEBUG] [MAIN ] GBTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:39:59.042022] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40046 primary records. [2025-10-01T22:39:59.042710] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-01T22:39:59.043512] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-01T22:39:59.043860] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-01T22:39:59.045860] [INFO ] [MAIN ] Derivative Progress: 734/1587 symbols completed. GBCI took 0.8s. Estimated remaining: 5m 55s. Rate: 144.1 symbols/min [2025-10-01T22:39:59.061190] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-01T22:39:59.061275] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-01T22:39:59.063403] [INFO ] [MAIN ] Derivative Progress: 735/1587 symbols completed. GBTG took 0.8s. Estimated remaining: 5m 54s. Rate: 144.3 symbols/min [2025-10-01T22:39:59.064008] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:59.064092] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:59.063943] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:39:59.098198] [DEBUG] [LOCAL ] GCO: Loaded 24664 existing records from primary storage. [2025-10-01T22:39:59.098547] [INFO ] [MAIN ] GCO: Loaded 24664 primary data records. [2025-10-01T22:39:59.255090] [DEBUG] [LOCAL ] GCI: Loaded 44121 existing records from primary storage. [2025-10-01T22:39:59.253781] [DEBUG] [LOCAL ] GBX: Loaded 29152 existing records from primary storage. [2025-10-01T22:39:59.276128] [INFO ] [MAIN ] GBX: Loaded 29152 primary data records. [2025-10-01T22:39:59.276229] [INFO ] [MAIN ] GCI: Loaded 44121 primary data records. [2025-10-01T22:40:00.197295] [DEBUG] [MAIN ] GCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:00.198436] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 24664 primary records. [2025-10-01T22:40:00.198747] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-01T22:40:00.233266] [DEBUG] [MAIN ] GCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:00.235568] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44121 primary records. [2025-10-01T22:40:00.236116] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-01T22:40:00.259356] [DEBUG] [MAIN ] GBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:00.260778] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29152 primary records. [2025-10-01T22:40:00.261207] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-10-01T22:40:00.262848] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-01T22:40:00.262923] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-01T22:40:00.268340] [INFO ] [MAIN ] Derivative Progress: 736/1587 symbols completed. GCO took 1.2s. Estimated remaining: 5m 55s. Rate: 143.9 symbols/min [2025-10-01T22:40:00.279608] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:00.284861] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-01T22:40:00.285928] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-01T22:40:00.293417] [INFO ] [MAIN ] Derivative Progress: 737/1587 symbols completed. GCI took 1.2s. Estimated remaining: 5m 54s. Rate: 144.1 symbols/min [2025-10-01T22:40:00.294441] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:00.300291] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-01T22:40:00.300557] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-01T22:40:00.303974] [INFO ] [MAIN ] Derivative Progress: 738/1587 symbols completed. GBX took 1.2s. Estimated remaining: 5m 53s. Rate: 144.3 symbols/min [2025-10-01T22:40:00.304307] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:00.318831] [DEBUG] [LOCAL ] GCV: Loaded 7370 existing records from primary storage. [2025-10-01T22:40:00.319136] [INFO ] [MAIN ] GCV: Loaded 7370 primary data records. [2025-10-01T22:40:00.366908] [DEBUG] [LOCAL ] GCTS: Loaded 19957 existing records from primary storage. [2025-10-01T22:40:00.390418] [INFO ] [MAIN ] GCTS: Loaded 19957 primary data records. [2025-10-01T22:40:00.688380] [DEBUG] [LOCAL ] GD: Loaded 47149 existing records from primary storage. [2025-10-01T22:40:00.744040] [INFO ] [MAIN ] GD: Loaded 47149 primary data records. [2025-10-01T22:40:01.496047] [DEBUG] [MAIN ] GCTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:01.510462] [DEBUG] [MAIN ] GCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:01.511448] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7370 primary records. [2025-10-01T22:40:01.511550] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-01T22:40:01.510150] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19957 primary records. [2025-10-01T22:40:01.512604] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-01T22:40:01.546633] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-01T22:40:01.546551] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-01T22:40:01.548520] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-01T22:40:01.547004] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-01T22:40:01.551084] [INFO ] [MAIN ] Derivative Progress: 739/1587 symbols completed. GCV took 1.3s. Estimated remaining: 5m 54s. Rate: 143.9 symbols/min [2025-10-01T22:40:01.554950] [INFO ] [MAIN ] Derivative Progress: 740/1587 symbols completed. GCTS took 1.3s. Estimated remaining: 5m 53s. Rate: 144.1 symbols/min [2025-10-01T22:40:01.555205] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:01.554854] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:01.572732] [DEBUG] [MAIN ] GD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:01.573563] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47149 primary records. [2025-10-01T22:40:01.573788] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-01T22:40:01.584508] [DEBUG] [LOCAL ] GDIV: Loaded 3623 existing records from primary storage. [2025-10-01T22:40:01.588486] [INFO ] [MAIN ] GDIV: Loaded 3623 primary data records. [2025-10-01T22:40:01.705724] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-01T22:40:01.716677] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-01T22:40:01.747404] [INFO ] [MAIN ] Derivative Progress: 741/1587 symbols completed. GD took 1.4s. Estimated remaining: 5m 52s. Rate: 144.2 symbols/min [2025-10-01T22:40:01.748381] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:01.899699] [DEBUG] [LOCAL ] GDDY: Loaded 49682 existing records from primary storage. [2025-10-01T22:40:01.902517] [DEBUG] [LOCAL ] GDL: Loaded 2566 existing records from primary storage. [2025-10-01T22:40:01.976735] [INFO ] [MAIN ] GDL: Loaded 2566 primary data records. [2025-10-01T22:40:02.024971] [INFO ] [MAIN ] GDDY: Loaded 49682 primary data records. [2025-10-01T22:40:02.946130] [DEBUG] [MAIN ] GDIV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:40:02.948630] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3623 primary records. [2025-10-01T22:40:02.949015] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-01T22:40:02.966463] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-10-01T22:40:02.967341] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-01T22:40:02.971026] [INFO ] [MAIN ] Derivative Progress: 742/1587 symbols completed. GDIV took 1.4s. Estimated remaining: 5m 52s. Rate: 143.8 symbols/min [2025-10-01T22:40:02.971687] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:02.992432] [DEBUG] [MAIN ] GDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:02.996383] [DEBUG] [LOCAL ] GDO: Loaded 5984 existing records from primary storage. [2025-10-01T22:40:02.996705] [INFO ] [MAIN ] GDO: Loaded 5984 primary data records. [2025-10-01T22:40:02.997693] [INFO ] [MAIN ] GDL: Generated 1794 derivative records from 2566 primary records. [2025-10-01T22:40:03.015862] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-01T22:40:03.162603] [DEBUG] [LOCAL ] GDL: Derivative data saved (1794 records). [2025-10-01T22:40:03.155357] [DEBUG] [MAIN ] GDDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:03.169138] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49682 primary records. [2025-10-01T22:40:03.168073] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-01T22:40:03.169337] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-01T22:40:03.177605] [INFO ] [MAIN ] Derivative Progress: 743/1587 symbols completed. GDL took 1.4s. Estimated remaining: 5m 52s. Rate: 143.9 symbols/min [2025-10-01T22:40:03.184139] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:03.398570] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-01T22:40:03.398815] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-01T22:40:03.401142] [INFO ] [MAIN ] Derivative Progress: 744/1587 symbols completed. GDDY took 1.8s. Estimated remaining: 5m 51s. Rate: 144.0 symbols/min [2025-10-01T22:40:03.402146] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:03.440719] [DEBUG] [LOCAL ] GDV: Loaded 19475 existing records from primary storage. [2025-10-01T22:40:03.440994] [INFO ] [MAIN ] GDV: Loaded 19475 primary data records. [2025-10-01T22:40:03.471955] [DEBUG] [LOCAL ] GDOT: Loaded 38324 existing records from primary storage. [2025-10-01T22:40:03.529448] [INFO ] [MAIN ] GDOT: Loaded 38324 primary data records. [2025-10-01T22:40:03.680972] [DEBUG] [MAIN ] GDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:03.692367] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5984 primary records. [2025-10-01T22:40:03.692529] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-01T22:40:03.981422] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-01T22:40:04.027102] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-01T22:40:04.151592] [INFO ] [MAIN ] Derivative Progress: 745/1587 symbols completed. GDO took 1.2s. Estimated remaining: 5m 51s. Rate: 143.9 symbols/min [2025-10-01T22:40:04.152214] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:04.179850] [DEBUG] [MAIN ] GDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:04.180674] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19475 primary records. [2025-10-01T22:40:04.180827] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-01T22:40:04.198114] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-01T22:40:04.198278] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-01T22:40:04.200495] [INFO ] [MAIN ] Derivative Progress: 746/1587 symbols completed. GDV took 0.8s. Estimated remaining: 5m 50s. Rate: 144.0 symbols/min [2025-10-01T22:40:04.201725] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:04.216953] [DEBUG] [MAIN ] GDOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:04.217703] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38324 primary records. [2025-10-01T22:40:04.217822] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-01T22:40:04.240691] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-01T22:40:04.240971] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-01T22:40:04.243719] [INFO ] [MAIN ] Derivative Progress: 747/1587 symbols completed. GDOT took 1.1s. Estimated remaining: 5m 49s. Rate: 144.2 symbols/min [2025-10-01T22:40:04.244106] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:04.270483] [DEBUG] [LOCAL ] GEF: Loaded 20682 existing records from primary storage. [2025-10-01T22:40:04.270670] [INFO ] [MAIN ] GEF: Loaded 20682 primary data records. [2025-10-01T22:40:04.419798] [DEBUG] [LOCAL ] GE: Loaded 53714 existing records from primary storage. [2025-10-01T22:40:04.426058] [INFO ] [MAIN ] GE: Loaded 53714 primary data records. [2025-10-01T22:40:04.792924] [DEBUG] [LOCAL ] GEL: Loaded 33118 existing records from primary storage. [2025-10-01T22:40:04.798687] [INFO ] [MAIN ] GEL: Loaded 33118 primary data records. [2025-10-01T22:40:05.453766] [DEBUG] [MAIN ] GEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:05.454899] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20682 primary records. [2025-10-01T22:40:05.456425] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-01T22:40:05.490753] [DEBUG] [MAIN ] GE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:05.491906] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53714 primary records. [2025-10-01T22:40:05.494122] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-01T22:40:05.494034] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-01T22:40:05.495143] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-01T22:40:05.497616] [INFO ] [MAIN ] Derivative Progress: 748/1587 symbols completed. GEF took 1.3s. Estimated remaining: 5m 50s. Rate: 143.8 symbols/min [2025-10-01T22:40:05.515757] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-01T22:40:05.515870] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-01T22:40:05.520120] [INFO ] [MAIN ] Derivative Progress: 749/1587 symbols completed. GE took 1.4s. Estimated remaining: 5m 49s. Rate: 144.0 symbols/min [2025-10-01T22:40:05.533971] [DEBUG] [MAIN ] GEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:05.534663] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 33118 primary records. [2025-10-01T22:40:05.534755] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-01T22:40:05.550709] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-10-01T22:40:05.550847] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-01T22:40:05.553583] [INFO ] [MAIN ] Derivative Progress: 750/1587 symbols completed. GEL took 1.3s. Estimated remaining: 5m 48s. Rate: 144.2 symbols/min [2025-10-01T22:40:05.554201] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:05.554121] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:05.554324] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:05.631851] [DEBUG] [LOCAL ] GES: Loaded 39414 existing records from primary storage. [2025-10-01T22:40:05.648301] [INFO ] [MAIN ] GES: Loaded 39414 primary data records. [2025-10-01T22:40:05.649286] [DEBUG] [LOCAL ] GENI: Loaded 52930 existing records from primary storage. [2025-10-01T22:40:05.688500] [DEBUG] [LOCAL ] GEO: Loaded 51950 existing records from primary storage. [2025-10-01T22:40:05.676884] [INFO ] [MAIN ] GENI: Loaded 52930 primary data records. [2025-10-01T22:40:05.692970] [INFO ] [MAIN ] GEO: Loaded 51950 primary data records. [2025-10-01T22:40:06.714317] [DEBUG] [MAIN ] GEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:06.716936] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51950 primary records. [2025-10-01T22:40:06.729786] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-01T22:40:06.738969] [DEBUG] [MAIN ] GES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:06.743864] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 39414 primary records. [2025-10-01T22:40:06.758038] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-01T22:40:06.762044] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-01T22:40:06.762689] [DEBUG] [MAIN ] GENI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:06.762139] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-01T22:40:06.764790] [INFO ] [MAIN ] Derivative Progress: 751/1587 symbols completed. GEO took 1.2s. Estimated remaining: 5m 49s. Rate: 143.8 symbols/min [2025-10-01T22:40:06.765197] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:06.766034] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52930 primary records. [2025-10-01T22:40:06.777885] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-01T22:40:06.784183] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-01T22:40:06.792757] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-01T22:40:06.797884] [INFO ] [MAIN ] Derivative Progress: 752/1587 symbols completed. GES took 1.2s. Estimated remaining: 5m 48s. Rate: 144.0 symbols/min [2025-10-01T22:40:06.798146] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:06.807335] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-01T22:40:06.807498] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-01T22:40:06.812872] [INFO ] [MAIN ] Derivative Progress: 753/1587 symbols completed. GENI took 1.3s. Estimated remaining: 5m 47s. Rate: 144.2 symbols/min [2025-10-01T22:40:06.813185] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:06.827488] [DEBUG] [LOCAL ] GF: Loaded 2967 existing records from primary storage. [2025-10-01T22:40:06.827622] [INFO ] [MAIN ] GF: Loaded 2967 primary data records. [2025-10-01T22:40:06.953371] [DEBUG] [LOCAL ] GETY: Loaded 35605 existing records from primary storage. [2025-10-01T22:40:06.983110] [INFO ] [MAIN ] GETY: Loaded 35605 primary data records. [2025-10-01T22:40:07.328896] [DEBUG] [LOCAL ] GEV: Loaded 53053 existing records from primary storage. [2025-10-01T22:40:07.339384] [INFO ] [MAIN ] GEV: Loaded 53053 primary data records. [2025-10-01T22:40:07.963583] [DEBUG] [MAIN ] GF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:07.965154] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2967 primary records. [2025-10-01T22:40:07.965560] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-01T22:40:07.983395] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-01T22:40:07.983535] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-01T22:40:07.985799] [INFO ] [MAIN ] Derivative Progress: 754/1587 symbols completed. GF took 1.2s. Estimated remaining: 5m 47s. Rate: 143.8 symbols/min [2025-10-01T22:40:07.986079] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:08.004239] [DEBUG] [MAIN ] GETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:08.005267] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35605 primary records. [2025-10-01T22:40:08.005503] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-01T22:40:08.032187] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-01T22:40:08.032361] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-01T22:40:08.044024] [INFO ] [MAIN ] Derivative Progress: 755/1587 symbols completed. GETY took 1.3s. Estimated remaining: 5m 47s. Rate: 144.0 symbols/min [2025-10-01T22:40:08.053358] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:08.053230] [DEBUG] [MAIN ] GEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:08.054437] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53053 primary records. [2025-10-01T22:40:08.054578] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-01T22:40:08.072279] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-01T22:40:08.081548] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-01T22:40:08.084689] [INFO ] [MAIN ] Derivative Progress: 756/1587 symbols completed. GEV took 1.3s. Estimated remaining: 5m 46s. Rate: 144.2 symbols/min [2025-10-01T22:40:08.085811] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:08.085621] [DEBUG] [LOCAL ] GFF: Loaded 30368 existing records from primary storage. [2025-10-01T22:40:08.086458] [INFO ] [MAIN ] GFF: Loaded 30368 primary data records. [2025-10-01T22:40:08.456304] [DEBUG] [LOCAL ] GFI: Loaded 53104 existing records from primary storage. [2025-10-01T22:40:08.457251] [INFO ] [MAIN ] GFI: Loaded 53104 primary data records. [2025-10-01T22:40:08.594110] [DEBUG] [LOCAL ] GFL: Loaded 47938 existing records from primary storage. [2025-10-01T22:40:08.638761] [INFO ] [MAIN ] GFL: Loaded 47938 primary data records. [2025-10-01T22:40:09.172165] [DEBUG] [MAIN ] GFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:09.173896] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30368 primary records. [2025-10-01T22:40:09.174598] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-01T22:40:09.193870] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-01T22:40:09.194421] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-01T22:40:09.196598] [INFO ] [MAIN ] Derivative Progress: 757/1587 symbols completed. GFF took 1.2s. Estimated remaining: 5m 46s. Rate: 143.8 symbols/min [2025-10-01T22:40:09.196875] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:09.215742] [DEBUG] [MAIN ] GFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:09.219255] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53104 primary records. [2025-10-01T22:40:09.219695] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-01T22:40:09.235279] [DEBUG] [LOCAL ] GFR: Loaded 8335 existing records from primary storage. [2025-10-01T22:40:09.240913] [INFO ] [MAIN ] GFR: Loaded 8335 primary data records. [2025-10-01T22:40:09.262347] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-01T22:40:09.278209] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-01T22:40:09.285121] [INFO ] [MAIN ] Derivative Progress: 758/1587 symbols completed. GFI took 1.2s. Estimated remaining: 5m 45s. Rate: 144.0 symbols/min [2025-10-01T22:40:09.297252] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:09.298190] [DEBUG] [MAIN ] GFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:09.298903] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47938 primary records. [2025-10-01T22:40:09.312899] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-01T22:40:09.486630] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-01T22:40:09.561348] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-01T22:40:09.649348] [INFO ] [MAIN ] Derivative Progress: 759/1587 symbols completed. GFL took 1.6s. Estimated remaining: 5m 45s. Rate: 144.0 symbols/min [2025-10-01T22:40:09.664482] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:09.691817] [DEBUG] [LOCAL ] GGB: Loaded 51093 existing records from primary storage. [2025-10-01T22:40:09.692298] [INFO ] [MAIN ] GGB: Loaded 51093 primary data records. [2025-10-01T22:40:09.839893] [DEBUG] [MAIN ] GFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:09.857080] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8335 primary records. [2025-10-01T22:40:09.868417] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-01T22:40:10.083522] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-10-01T22:40:10.083799] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-01T22:40:10.079887] [DEBUG] [LOCAL ] GGG: Loaded 40968 existing records from primary storage. [2025-10-01T22:40:10.086836] [INFO ] [MAIN ] GGG: Loaded 40968 primary data records. [2025-10-01T22:40:10.085961] [INFO ] [MAIN ] Derivative Progress: 760/1587 symbols completed. GFR took 0.9s. Estimated remaining: 5m 45s. Rate: 144.0 symbols/min [2025-10-01T22:40:10.087211] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:10.218632] [DEBUG] [LOCAL ] GGT: Loaded 14063 existing records from primary storage. [2025-10-01T22:40:10.232696] [INFO ] [MAIN ] GGT: Loaded 14063 primary data records. [2025-10-01T22:40:10.806837] [DEBUG] [MAIN ] GGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:10.807858] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51093 primary records. [2025-10-01T22:40:10.808024] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-01T22:40:10.829476] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-01T22:40:10.830246] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-01T22:40:10.832916] [INFO ] [MAIN ] Derivative Progress: 761/1587 symbols completed. GGB took 1.5s. Estimated remaining: 5m 44s. Rate: 143.9 symbols/min [2025-10-01T22:40:10.833224] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:10.854471] [DEBUG] [LOCAL ] GGZ: Loaded 2416 existing records from primary storage. [2025-10-01T22:40:10.856246] [INFO ] [MAIN ] GGZ: Loaded 2416 primary data records. [2025-10-01T22:40:10.856614] [DEBUG] [MAIN ] GGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:10.863187] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40968 primary records. [2025-10-01T22:40:10.877999] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-01T22:40:10.974773] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-01T22:40:10.990042] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-01T22:40:11.002320] [INFO ] [MAIN ] Derivative Progress: 762/1587 symbols completed. GGG took 1.3s. Estimated remaining: 5m 44s. Rate: 144.0 symbols/min [2025-10-01T22:40:11.009834] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:11.115612] [DEBUG] [MAIN ] GGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:11.123051] [DEBUG] [LOCAL ] GHC: Loaded 2669 existing records from primary storage. [2025-10-01T22:40:11.123408] [INFO ] [MAIN ] GHC: Loaded 2669 primary data records. [2025-10-01T22:40:11.237147] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14063 primary records. [2025-10-01T22:40:11.286845] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-01T22:40:11.457904] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-01T22:40:11.458188] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-01T22:40:11.481159] [INFO ] [MAIN ] Derivative Progress: 763/1587 symbols completed. GGT took 1.4s. Estimated remaining: 5m 43s. Rate: 143.9 symbols/min [2025-10-01T22:40:11.718174] [DEBUG] [MAIN ] GGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:11.719563] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2416 primary records. [2025-10-01T22:40:11.719814] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-01T22:40:11.747280] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-01T22:40:11.747590] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-01T22:40:11.750570] [INFO ] [MAIN ] Derivative Progress: 764/1587 symbols completed. GGZ took 0.9s. Estimated remaining: 5m 43s. Rate: 144.0 symbols/min [2025-10-01T22:40:11.770186] [DEBUG] [MAIN ] GHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:11.771003] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2669 primary records. [2025-10-01T22:40:11.771081] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-01T22:40:11.786198] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-10-01T22:40:11.786333] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-01T22:40:11.789046] [INFO ] [MAIN ] Derivative Progress: 765/1587 symbols completed. GHC took 0.8s. Estimated remaining: 5m 42s. Rate: 144.2 symbols/min [2025-10-01T22:40:11.789633] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:11.789765] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:11.789905] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:11.801115] [DEBUG] [LOCAL ] GHG: Loaded 3185 existing records from primary storage. [2025-10-01T22:40:11.803432] [INFO ] [MAIN ] GHG: Loaded 3185 primary data records. [2025-10-01T22:40:11.833051] [DEBUG] [LOCAL ] GHLD: Loaded 4179 existing records from primary storage. [2025-10-01T22:40:11.860719] [INFO ] [MAIN ] GHLD: Loaded 4179 primary data records. [2025-10-01T22:40:11.880296] [DEBUG] [LOCAL ] GHI: Loaded 7020 existing records from primary storage. [2025-10-01T22:40:11.921897] [INFO ] [MAIN ] GHI: Loaded 7020 primary data records. [2025-10-01T22:40:12.905467] [DEBUG] [MAIN ] GHLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:40:12.908271] [INFO ] [MAIN ] GHLD: Generated 1793 derivative records from 4179 primary records. [2025-10-01T22:40:12.908559] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-01T22:40:12.910110] [DEBUG] [MAIN ] GHG: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-01T22:40:12.935252] [DEBUG] [MAIN ] GHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:12.924311] [INFO ] [MAIN ] GHG: Generated 1792 derivative records from 3185 primary records. [2025-10-01T22:40:12.939588] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7020 primary records. [2025-10-01T22:40:12.940064] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-01T22:40:12.939926] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1793 records). [2025-10-01T22:40:12.941059] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-01T22:40:12.943369] [INFO ] [MAIN ] Derivative Progress: 766/1587 symbols completed. GHLD took 1.2s. Estimated remaining: 5m 42s. Rate: 143.8 symbols/min [2025-10-01T22:40:12.940968] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-01T22:40:12.955771] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:12.970423] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-01T22:40:12.977976] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-01T22:40:12.980622] [INFO ] [MAIN ] Derivative Progress: 767/1587 symbols completed. GHI took 1.2s. Estimated remaining: 5m 42s. Rate: 144.0 symbols/min [2025-10-01T22:40:12.983668] [DEBUG] [LOCAL ] GHG: Derivative data saved (1792 records). [2025-10-01T22:40:12.982789] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:12.984003] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-01T22:40:12.986895] [INFO ] [MAIN ] Derivative Progress: 768/1587 symbols completed. GHG took 1.2s. Estimated remaining: 5m 41s. Rate: 144.2 symbols/min [2025-10-01T22:40:12.987244] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:13.001183] [DEBUG] [LOCAL ] GHM: Loaded 14066 existing records from primary storage. [2025-10-01T22:40:13.001470] [INFO ] [MAIN ] GHM: Loaded 14066 primary data records. [2025-10-01T22:40:13.139960] [DEBUG] [LOCAL ] GHY: Loaded 20837 existing records from primary storage. [2025-10-01T22:40:13.160978] [INFO ] [MAIN ] GHY: Loaded 20837 primary data records. [2025-10-01T22:40:13.194440] [DEBUG] [LOCAL ] GIB: Loaded 32101 existing records from primary storage. [2025-10-01T22:40:13.225904] [INFO ] [MAIN ] GIB: Loaded 32101 primary data records. [2025-10-01T22:40:14.134747] [DEBUG] [MAIN ] GHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:14.136084] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14066 primary records. [2025-10-01T22:40:14.136265] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-01T22:40:14.172036] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-01T22:40:14.172548] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-01T22:40:14.172472] [DEBUG] [MAIN ] GHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:14.174772] [INFO ] [MAIN ] Derivative Progress: 769/1587 symbols completed. GHM took 1.2s. Estimated remaining: 5m 41s. Rate: 143.9 symbols/min [2025-10-01T22:40:14.175984] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20837 primary records. [2025-10-01T22:40:14.176270] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-01T22:40:14.176514] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:14.197748] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-01T22:40:14.202182] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-01T22:40:14.204667] [INFO ] [MAIN ] Derivative Progress: 770/1587 symbols completed. GHY took 1.2s. Estimated remaining: 5m 40s. Rate: 144.0 symbols/min [2025-10-01T22:40:14.218149] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:14.218448] [DEBUG] [MAIN ] GIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:14.225528] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32101 primary records. [2025-10-01T22:40:14.224565] [DEBUG] [LOCAL ] GIC: Loaded 13517 existing records from primary storage. [2025-10-01T22:40:14.225720] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-01T22:40:14.226405] [INFO ] [MAIN ] GIC: Loaded 13517 primary data records. [2025-10-01T22:40:14.370321] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-01T22:40:14.386184] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-01T22:40:14.399559] [INFO ] [MAIN ] Derivative Progress: 771/1587 symbols completed. GIB took 1.4s. Estimated remaining: 5m 40s. Rate: 144.1 symbols/min [2025-10-01T22:40:14.468322] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:14.623024] [DEBUG] [LOCAL ] GIL: Loaded 43388 existing records from primary storage. [2025-10-01T22:40:14.623354] [INFO ] [MAIN ] GIL: Loaded 43388 primary data records. [2025-10-01T22:40:14.917980] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-01T22:40:15.013889] [DEBUG] [MAIN ] GIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:15.013991] [INFO ] [MAIN ] GIS: Loaded 53672 primary data records. [2025-10-01T22:40:15.027442] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13517 primary records. [2025-10-01T22:40:15.056017] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-01T22:40:15.197515] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-01T22:40:15.207875] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-01T22:40:15.210456] [INFO ] [MAIN ] Derivative Progress: 772/1587 symbols completed. GIC took 1.0s. Estimated remaining: 5m 40s. Rate: 144.0 symbols/min [2025-10-01T22:40:15.247823] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:15.397816] [DEBUG] [MAIN ] GIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:15.398834] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43388 primary records. [2025-10-01T22:40:15.399046] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-01T22:40:15.430801] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-01T22:40:15.430951] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-01T22:40:15.433321] [INFO ] [MAIN ] Derivative Progress: 773/1587 symbols completed. GIL took 1.2s. Estimated remaining: 5m 39s. Rate: 144.0 symbols/min [2025-10-01T22:40:15.433796] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:15.453143] [DEBUG] [LOCAL ] GKOS: Loaded 42661 existing records from primary storage. [2025-10-01T22:40:15.453471] [INFO ] [MAIN ] GKOS: Loaded 42661 primary data records. [2025-10-01T22:40:15.495887] [DEBUG] [MAIN ] GIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:15.511993] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53672 primary records. [2025-10-01T22:40:15.525984] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-01T22:40:15.651354] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-01T22:40:15.673557] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-01T22:40:15.725203] [INFO ] [MAIN ] Derivative Progress: 774/1587 symbols completed. GIS took 1.3s. Estimated remaining: 5m 39s. Rate: 144.1 symbols/min [2025-10-01T22:40:15.855440] [DEBUG] [LOCAL ] GL: Loaded 37783 existing records from primary storage. [2025-10-01T22:40:15.855741] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:15.857161] [INFO ] [MAIN ] GL: Loaded 37783 primary data records. [2025-10-01T22:40:16.293955] [DEBUG] [LOCAL ] GLOB: Loaded 47585 existing records from primary storage. [2025-10-01T22:40:16.295012] [INFO ] [MAIN ] GLOB: Loaded 47585 primary data records. [2025-10-01T22:40:16.294555] [DEBUG] [MAIN ] GKOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:16.296156] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42661 primary records. [2025-10-01T22:40:16.301487] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-01T22:40:16.443349] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-01T22:40:16.454299] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-01T22:40:16.461964] [INFO ] [MAIN ] Derivative Progress: 775/1587 symbols completed. GKOS took 1.2s. Estimated remaining: 5m 38s. Rate: 144.0 symbols/min [2025-10-01T22:40:16.472424] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:16.677210] [DEBUG] [LOCAL ] GLP: Loaded 9351 existing records from primary storage. [2025-10-01T22:40:16.695682] [INFO ] [MAIN ] GLP: Loaded 9351 primary data records. [2025-10-01T22:40:16.697586] [DEBUG] [MAIN ] GL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:16.705066] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37783 primary records. [2025-10-01T22:40:16.724458] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-01T22:40:16.859446] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-01T22:40:16.875517] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-01T22:40:16.930798] [INFO ] [MAIN ] Derivative Progress: 776/1587 symbols completed. GL took 1.5s. Estimated remaining: 5m 38s. Rate: 143.9 symbols/min [2025-10-01T22:40:16.937833] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:17.088362] [DEBUG] [MAIN ] GLOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:17.089474] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47585 primary records. [2025-10-01T22:40:17.089724] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-01T22:40:17.112740] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-01T22:40:17.112954] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-01T22:40:17.115467] [INFO ] [MAIN ] Derivative Progress: 777/1587 symbols completed. GLOB took 1.3s. Estimated remaining: 5m 37s. Rate: 144.0 symbols/min [2025-10-01T22:40:17.115985] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:17.154955] [DEBUG] [MAIN ] GLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:17.155721] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9351 primary records. [2025-10-01T22:40:17.155787] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-01T22:40:17.173104] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-01T22:40:17.173464] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-01T22:40:17.176453] [INFO ] [MAIN ] Derivative Progress: 778/1587 symbols completed. GLP took 0.7s. Estimated remaining: 5m 37s. Rate: 144.2 symbols/min [2025-10-01T22:40:17.195392] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-01T22:40:17.195686] [INFO ] [MAIN ] GLW: Loaded 53636 primary data records. [2025-10-01T22:40:17.408429] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-10-01T22:40:17.439287] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-10-01T22:40:17.939676] [DEBUG] [MAIN ] GLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:17.940790] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53636 primary records. [2025-10-01T22:40:17.941016] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-01T22:40:17.958835] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-01T22:40:17.959080] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-01T22:40:17.961564] [INFO ] [MAIN ] Derivative Progress: 779/1587 symbols completed. GLW took 1.0s. Estimated remaining: 5m 37s. Rate: 144.0 symbols/min [2025-10-01T22:40:17.977748] [DEBUG] [MAIN ] GM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:17.978519] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-10-01T22:40:17.978586] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-01T22:40:17.994930] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-01T22:40:17.995057] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-01T22:40:17.997515] [INFO ] [MAIN ] Derivative Progress: 780/1587 symbols completed. GM took 0.9s. Estimated remaining: 5m 36s. Rate: 144.2 symbols/min [2025-10-01T22:40:17.998396] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:17.998470] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:17.998256] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:18.047748] [DEBUG] [LOCAL ] GMRE: Loaded 37396 existing records from primary storage. [2025-10-01T22:40:18.047917] [INFO ] [MAIN ] GMRE: Loaded 37396 primary data records. [2025-10-01T22:40:18.188892] [DEBUG] [LOCAL ] GMED: Loaded 48332 existing records from primary storage. [2025-10-01T22:40:18.193424] [INFO ] [MAIN ] GMED: Loaded 48332 primary data records. [2025-10-01T22:40:18.568696] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-10-01T22:40:18.569033] [INFO ] [MAIN ] GME: Loaded 53762 primary data records. [2025-10-01T22:40:19.180475] [DEBUG] [MAIN ] GMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:19.182289] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37396 primary records. [2025-10-01T22:40:19.182438] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-01T22:40:19.195697] [DEBUG] [MAIN ] GMED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:19.197878] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48332 primary records. [2025-10-01T22:40:19.198265] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-01T22:40:19.233946] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-01T22:40:19.234385] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-01T22:40:19.237684] [INFO ] [MAIN ] Derivative Progress: 781/1587 symbols completed. GMRE took 1.2s. Estimated remaining: 5m 36s. Rate: 143.8 symbols/min [2025-10-01T22:40:19.237899] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:19.238888] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-01T22:40:19.239756] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-01T22:40:19.242376] [INFO ] [MAIN ] Derivative Progress: 782/1587 symbols completed. GMED took 1.2s. Estimated remaining: 5m 35s. Rate: 144.0 symbols/min [2025-10-01T22:40:19.242592] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:19.265837] [DEBUG] [MAIN ] GME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:19.266612] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53762 primary records. [2025-10-01T22:40:19.273277] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-01T22:40:19.273198] [DEBUG] [LOCAL ] GNE: Loaded 17835 existing records from primary storage. [2025-10-01T22:40:19.274150] [INFO ] [MAIN ] GNE: Loaded 17835 primary data records. [2025-10-01T22:40:19.469618] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-01T22:40:19.469828] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-01T22:40:19.464390] [DEBUG] [LOCAL ] GNK: Loaded 40264 existing records from primary storage. [2025-10-01T22:40:19.488940] [INFO ] [MAIN ] Derivative Progress: 783/1587 symbols completed. GME took 1.5s. Estimated remaining: 5m 35s. Rate: 144.1 symbols/min [2025-10-01T22:40:19.485807] [INFO ] [MAIN ] GNK: Loaded 40264 primary data records. [2025-10-01T22:40:19.489153] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:20.043428] [DEBUG] [LOCAL ] GNL: Loaded 46827 existing records from primary storage. [2025-10-01T22:40:20.044594] [INFO ] [MAIN ] GNL: Loaded 46827 primary data records. [2025-10-01T22:40:20.169044] [DEBUG] [MAIN ] GNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:20.184680] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17835 primary records. [2025-10-01T22:40:20.197530] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-01T22:40:20.300923] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-01T22:40:20.305420] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-01T22:40:20.349822] [INFO ] [MAIN ] Derivative Progress: 784/1587 symbols completed. GNE took 1.1s. Estimated remaining: 5m 35s. Rate: 143.9 symbols/min [2025-10-01T22:40:20.433175] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:20.447727] [DEBUG] [MAIN ] GNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:20.448808] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40264 primary records. [2025-10-01T22:40:20.449009] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-01T22:40:20.469357] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-01T22:40:20.469677] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-01T22:40:20.472229] [INFO ] [MAIN ] Derivative Progress: 785/1587 symbols completed. GNK took 1.2s. Estimated remaining: 5m 34s. Rate: 144.0 symbols/min [2025-10-01T22:40:20.472924] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:20.484849] [DEBUG] [LOCAL ] GNT: Loaded 8141 existing records from primary storage. [2025-10-01T22:40:20.485345] [INFO ] [MAIN ] GNT: Loaded 8141 primary data records. [2025-10-01T22:40:20.676887] [DEBUG] [MAIN ] GNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:20.701140] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46827 primary records. [2025-10-01T22:40:20.702478] [DEBUG] [LOCAL ] GNRC: Loaded 45108 existing records from primary storage. [2025-10-01T22:40:20.731397] [INFO ] [MAIN ] GNRC: Loaded 45108 primary data records. [2025-10-01T22:40:20.731280] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-01T22:40:21.030234] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-01T22:40:21.030725] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-01T22:40:21.048626] [INFO ] [MAIN ] Derivative Progress: 786/1587 symbols completed. GNL took 1.6s. Estimated remaining: 5m 34s. Rate: 144.0 symbols/min [2025-10-01T22:40:21.049619] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:21.310740] [DEBUG] [MAIN ] GNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:21.311691] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8141 primary records. [2025-10-01T22:40:21.311939] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-01T22:40:21.347541] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-01T22:40:21.348175] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-01T22:40:21.352264] [INFO ] [MAIN ] Derivative Progress: 787/1587 symbols completed. GNT took 0.9s. Estimated remaining: 5m 33s. Rate: 144.0 symbols/min [2025-10-01T22:40:21.349710] [DEBUG] [LOCAL ] GNW: Loaded 51326 existing records from primary storage. [2025-10-01T22:40:21.353138] [INFO ] [MAIN ] GNW: Loaded 51326 primary data records. [2025-10-01T22:40:21.353046] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:21.489690] [DEBUG] [MAIN ] GNRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:21.508384] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45108 primary records. [2025-10-01T22:40:21.524344] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-01T22:40:21.778923] [DEBUG] [LOCAL ] GOF: Loaded 42589 existing records from primary storage. [2025-10-01T22:40:21.779615] [INFO ] [MAIN ] GOF: Loaded 42589 primary data records. [2025-10-01T22:40:21.781810] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-01T22:40:21.800931] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-01T22:40:21.839134] [INFO ] [MAIN ] Derivative Progress: 788/1587 symbols completed. GNRC took 1.4s. Estimated remaining: 5m 33s. Rate: 144.0 symbols/min [2025-10-01T22:40:21.863963] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:22.181035] [DEBUG] [MAIN ] GNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:22.182227] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51326 primary records. [2025-10-01T22:40:22.182321] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-01T22:40:22.184223] [DEBUG] [LOCAL ] GOLF: Loaded 31207 existing records from primary storage. [2025-10-01T22:40:22.185591] [INFO ] [MAIN ] GOLF: Loaded 31207 primary data records. [2025-10-01T22:40:22.342735] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-01T22:40:22.358987] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-01T22:40:22.378466] [INFO ] [MAIN ] Derivative Progress: 789/1587 symbols completed. GNW took 1.3s. Estimated remaining: 5m 33s. Rate: 143.9 symbols/min [2025-10-01T22:40:22.384266] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:22.593335] [DEBUG] [MAIN ] GOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:22.594227] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42589 primary records. [2025-10-01T22:40:22.594418] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-01T22:40:22.616021] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-01T22:40:22.616469] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-01T22:40:22.619323] [INFO ] [MAIN ] Derivative Progress: 790/1587 symbols completed. GOF took 1.3s. Estimated remaining: 5m 32s. Rate: 144.0 symbols/min [2025-10-01T22:40:22.619538] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:22.675422] [DEBUG] [MAIN ] GOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:22.676343] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31207 primary records. [2025-10-01T22:40:22.676508] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-01T22:40:22.678840] [DEBUG] [LOCAL ] GOOS: Loaded 45028 existing records from primary storage. [2025-10-01T22:40:22.687387] [INFO ] [MAIN ] GOOS: Loaded 45028 primary data records. [2025-10-01T22:40:22.734980] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-01T22:40:22.787596] [DEBUG] [LOCAL ] GOTU: Loaded 38435 existing records from primary storage. [2025-10-01T22:40:22.766341] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-01T22:40:22.818272] [INFO ] [MAIN ] Derivative Progress: 791/1587 symbols completed. GOLF took 1.0s. Estimated remaining: 5m 31s. Rate: 144.1 symbols/min [2025-10-01T22:40:22.815408] [INFO ] [MAIN ] GOTU: Loaded 38435 primary data records. [2025-10-01T22:40:22.864538] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:23.511880] [DEBUG] [LOCAL ] GPC: Loaded 46349 existing records from primary storage. [2025-10-01T22:40:23.512692] [INFO ] [MAIN ] GPC: Loaded 46349 primary data records. [2025-10-01T22:40:23.645842] [DEBUG] [MAIN ] GOOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:23.669577] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45028 primary records. [2025-10-01T22:40:23.682784] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-01T22:40:23.721952] [DEBUG] [MAIN ] GOTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:23.738034] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 38435 primary records. [2025-10-01T22:40:23.762373] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-01T22:40:23.812090] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-01T22:40:23.812249] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-01T22:40:23.815682] [INFO ] [MAIN ] Derivative Progress: 792/1587 symbols completed. GOOS took 1.4s. Estimated remaining: 5m 32s. Rate: 143.8 symbols/min [2025-10-01T22:40:23.815911] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:23.964559] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-01T22:40:23.965299] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-01T22:40:23.969258] [INFO ] [MAIN ] Derivative Progress: 793/1587 symbols completed. GOTU took 1.3s. Estimated remaining: 5m 31s. Rate: 144.0 symbols/min [2025-10-01T22:40:23.982935] [DEBUG] [LOCAL ] GPI: Loaded 14648 existing records from primary storage. [2025-10-01T22:40:23.983448] [INFO ] [MAIN ] GPI: Loaded 14648 primary data records. [2025-10-01T22:40:24.186572] [DEBUG] [MAIN ] GPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:24.218419] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46349 primary records. [2025-10-01T22:40:24.284250] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-01T22:40:24.365576] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-01T22:40:24.366216] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-01T22:40:24.368902] [INFO ] [MAIN ] Derivative Progress: 794/1587 symbols completed. GPC took 1.5s. Estimated remaining: 5m 31s. Rate: 144.0 symbols/min [2025-10-01T22:40:24.389433] [DEBUG] [MAIN ] GPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:24.390079] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 14648 primary records. [2025-10-01T22:40:24.390140] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-01T22:40:24.406275] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-10-01T22:40:24.406391] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-01T22:40:24.409082] [INFO ] [MAIN ] Derivative Progress: 795/1587 symbols completed. GPI took 0.6s. Estimated remaining: 5m 30s. Rate: 144.1 symbols/min [2025-10-01T22:40:24.409668] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:24.409828] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:24.409778] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:24.416961] [DEBUG] [LOCAL ] GPJA: Loaded 4229 existing records from primary storage. [2025-10-01T22:40:24.417133] [INFO ] [MAIN ] GPJA: Loaded 4229 primary data records. [2025-10-01T22:40:24.624014] [DEBUG] [LOCAL ] GPMT: Loaded 26086 existing records from primary storage. [2025-10-01T22:40:24.643852] [INFO ] [MAIN ] GPMT: Loaded 26086 primary data records. [2025-10-01T22:40:24.940130] [DEBUG] [LOCAL ] GPK: Loaded 52660 existing records from primary storage. [2025-10-01T22:40:24.946214] [INFO ] [MAIN ] GPK: Loaded 52660 primary data records. [2025-10-01T22:40:25.565394] [DEBUG] [MAIN ] GPJA: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-01T22:40:25.566725] [INFO ] [MAIN ] GPJA: Generated 1792 derivative records from 4229 primary records. [2025-10-01T22:40:25.568449] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-01T22:40:25.586241] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1792 records). [2025-10-01T22:40:25.586421] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-01T22:40:25.588959] [INFO ] [MAIN ] Derivative Progress: 796/1587 symbols completed. GPJA took 1.2s. Estimated remaining: 5m 30s. Rate: 143.8 symbols/min [2025-10-01T22:40:25.590403] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:25.611062] [DEBUG] [MAIN ] GPMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:25.612202] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26086 primary records. [2025-10-01T22:40:25.612304] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-01T22:40:25.632194] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-01T22:40:25.632446] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-01T22:40:25.634730] [INFO ] [MAIN ] Derivative Progress: 797/1587 symbols completed. GPMT took 1.2s. Estimated remaining: 5m 29s. Rate: 144.0 symbols/min [2025-10-01T22:40:25.647919] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:25.648489] [DEBUG] [MAIN ] GPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:25.651244] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52660 primary records. [2025-10-01T22:40:25.651472] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-01T22:40:25.684941] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-01T22:40:25.685095] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-01T22:40:25.687668] [INFO ] [MAIN ] Derivative Progress: 798/1587 symbols completed. GPK took 1.3s. Estimated remaining: 5m 28s. Rate: 144.1 symbols/min [2025-10-01T22:40:25.693195] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:25.712372] [DEBUG] [LOCAL ] GPN: Loaded 52049 existing records from primary storage. [2025-10-01T22:40:25.720763] [INFO ] [MAIN ] GPN: Loaded 52049 primary data records. [2025-10-01T22:40:25.721269] [DEBUG] [LOCAL ] GPOR: Loaded 23138 existing records from primary storage. [2025-10-01T22:40:25.726555] [INFO ] [MAIN ] GPOR: Loaded 23138 primary data records. [2025-10-01T22:40:26.078685] [DEBUG] [LOCAL ] GPRK: Loaded 39366 existing records from primary storage. [2025-10-01T22:40:26.269995] [INFO ] [MAIN ] GPRK: Loaded 39366 primary data records. [2025-10-01T22:40:26.790175] [DEBUG] [MAIN ] GPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:26.791336] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52049 primary records. [2025-10-01T22:40:26.811437] [DEBUG] [MAIN ] GPOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:26.812361] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23138 primary records. [2025-10-01T22:40:26.810979] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-01T22:40:26.812490] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-01T22:40:26.847675] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-10-01T22:40:26.848787] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-01T22:40:26.849805] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-01T22:40:26.848994] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-01T22:40:26.854101] [INFO ] [MAIN ] Derivative Progress: 799/1587 symbols completed. GPOR took 1.2s. Estimated remaining: 5m 29s. Rate: 143.8 symbols/min [2025-10-01T22:40:26.858428] [INFO ] [MAIN ] Derivative Progress: 800/1587 symbols completed. GPN took 1.3s. Estimated remaining: 5m 28s. Rate: 144.0 symbols/min [2025-10-01T22:40:26.858934] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:26.858230] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:26.874168] [DEBUG] [MAIN ] GPRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:26.875261] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39366 primary records. [2025-10-01T22:40:26.875361] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-01T22:40:26.897999] [DEBUG] [LOCAL ] GRC: Loaded 8958 existing records from primary storage. [2025-10-01T22:40:26.898833] [INFO ] [MAIN ] GRC: Loaded 8958 primary data records. [2025-10-01T22:40:26.995042] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-01T22:40:27.000957] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-01T22:40:27.003539] [INFO ] [MAIN ] Derivative Progress: 801/1587 symbols completed. GPRK took 1.3s. Estimated remaining: 5m 27s. Rate: 144.1 symbols/min [2025-10-01T22:40:27.009065] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:27.063235] [DEBUG] [LOCAL ] GRBK: Loaded 26888 existing records from primary storage. [2025-10-01T22:40:27.063550] [INFO ] [MAIN ] GRBK: Loaded 26888 primary data records. [2025-10-01T22:40:27.259143] [DEBUG] [LOCAL ] GRDN: Loaded 20512 existing records from primary storage. [2025-10-01T22:40:27.270747] [INFO ] [MAIN ] GRDN: Loaded 20512 primary data records. [2025-10-01T22:40:28.040208] [DEBUG] [MAIN ] GRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:28.041086] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8958 primary records. [2025-10-01T22:40:28.041182] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-01T22:40:28.074127] [DEBUG] [MAIN ] GRBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:28.076385] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26888 primary records. [2025-10-01T22:40:28.075493] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-01T22:40:28.076778] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-01T22:40:28.076712] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-01T22:40:28.079098] [INFO ] [MAIN ] Derivative Progress: 802/1587 symbols completed. GRC took 1.2s. Estimated remaining: 5m 28s. Rate: 143.8 symbols/min [2025-10-01T22:40:28.080522] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:28.098326] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-01T22:40:28.098565] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-01T22:40:28.102044] [INFO ] [MAIN ] Derivative Progress: 803/1587 symbols completed. GRBK took 1.2s. Estimated remaining: 5m 27s. Rate: 144.0 symbols/min [2025-10-01T22:40:28.102307] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:28.118612] [DEBUG] [MAIN ] GRDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:28.119505] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20512 primary records. [2025-10-01T22:40:28.119681] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-01T22:40:28.136904] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-01T22:40:28.137087] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-01T22:40:28.139502] [INFO ] [MAIN ] Derivative Progress: 804/1587 symbols completed. GRDN took 1.1s. Estimated remaining: 5m 26s. Rate: 144.1 symbols/min [2025-10-01T22:40:28.139830] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:28.168555] [DEBUG] [LOCAL ] GRMN: Loaded 41016 existing records from primary storage. [2025-10-01T22:40:28.168838] [INFO ] [MAIN ] GRMN: Loaded 41016 primary data records. [2025-10-01T22:40:28.346729] [DEBUG] [LOCAL ] GRNT: Loaded 33794 existing records from primary storage. [2025-10-01T22:40:28.407958] [DEBUG] [LOCAL ] GRND: Loaded 49918 existing records from primary storage. [2025-10-01T22:40:28.431748] [INFO ] [MAIN ] GRNT: Loaded 33794 primary data records. [2025-10-01T22:40:28.545387] [INFO ] [MAIN ] GRND: Loaded 49918 primary data records. [2025-10-01T22:40:29.245304] [DEBUG] [MAIN ] GRMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:29.247247] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41016 primary records. [2025-10-01T22:40:29.247580] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-01T22:40:29.268633] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-01T22:40:29.270378] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-01T22:40:29.273015] [INFO ] [MAIN ] Derivative Progress: 805/1587 symbols completed. GRMN took 1.2s. Estimated remaining: 5m 26s. Rate: 143.8 symbols/min [2025-10-01T22:40:29.273466] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:29.296062] [DEBUG] [MAIN ] GRNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:29.298706] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33794 primary records. [2025-10-01T22:40:29.298911] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-01T22:40:29.328771] [DEBUG] [MAIN ] GRND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:29.329625] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 49918 primary records. [2025-10-01T22:40:29.330011] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-01T22:40:29.324275] [DEBUG] [LOCAL ] GROV: Loaded 8902 existing records from primary storage. [2025-10-01T22:40:29.331546] [INFO ] [MAIN ] GROV: Loaded 8902 primary data records. [2025-10-01T22:40:29.434389] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-01T22:40:29.433385] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-01T22:40:29.443236] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-01T22:40:29.451309] [INFO ] [MAIN ] Derivative Progress: 806/1587 symbols completed. GRNT took 1.3s. Estimated remaining: 5m 26s. Rate: 143.9 symbols/min [2025-10-01T22:40:29.451437] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-01T22:40:29.482814] [INFO ] [MAIN ] Derivative Progress: 807/1587 symbols completed. GRND took 1.4s. Estimated remaining: 5m 25s. Rate: 144.1 symbols/min [2025-10-01T22:40:29.482605] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:29.499247] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:29.726843] [DEBUG] [LOCAL ] GRX: Loaded 4663 existing records from primary storage. [2025-10-01T22:40:29.727935] [INFO ] [MAIN ] GRX: Loaded 4663 primary data records. [2025-10-01T22:40:30.107689] [DEBUG] [LOCAL ] GS: Loaded 51875 existing records from primary storage. [2025-10-01T22:40:30.108926] [INFO ] [MAIN ] GS: Loaded 51875 primary data records. [2025-10-01T22:40:30.262147] [DEBUG] [MAIN ] GROV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:30.273887] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8902 primary records. [2025-10-01T22:40:30.292608] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-01T22:40:30.487675] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-01T22:40:30.501620] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-01T22:40:30.504391] [INFO ] [MAIN ] Derivative Progress: 808/1587 symbols completed. GROV took 1.2s. Estimated remaining: 5m 25s. Rate: 143.8 symbols/min [2025-10-01T22:40:30.505775] [DEBUG] [MAIN ] GRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:30.506747] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4663 primary records. [2025-10-01T22:40:30.506836] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-01T22:40:30.524556] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-01T22:40:30.524812] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-01T22:40:30.527401] [INFO ] [MAIN ] Derivative Progress: 809/1587 symbols completed. GRX took 1.0s. Estimated remaining: 5m 24s. Rate: 144.0 symbols/min [2025-10-01T22:40:30.544997] [DEBUG] [MAIN ] GS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:30.545600] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51875 primary records. [2025-10-01T22:40:30.545690] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-01T22:40:30.562316] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-01T22:40:30.562401] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-01T22:40:30.564790] [INFO ] [MAIN ] Derivative Progress: 810/1587 symbols completed. GS took 1.1s. Estimated remaining: 5m 23s. Rate: 144.2 symbols/min [2025-10-01T22:40:30.565193] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:30.565742] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:30.565322] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:30.648593] [DEBUG] [LOCAL ] GSL: Loaded 33326 existing records from primary storage. [2025-10-01T22:40:30.649959] [DEBUG] [LOCAL ] GSK: Loaded 53493 existing records from primary storage. [2025-10-01T22:40:30.650086] [INFO ] [MAIN ] GSL: Loaded 33326 primary data records. [2025-10-01T22:40:30.661017] [INFO ] [MAIN ] GSK: Loaded 53493 primary data records. [2025-10-01T22:40:30.724625] [DEBUG] [LOCAL ] GSBD: Loaded 39140 existing records from primary storage. [2025-10-01T22:40:30.778930] [INFO ] [MAIN ] GSBD: Loaded 39140 primary data records. [2025-10-01T22:40:31.752824] [DEBUG] [MAIN ] GSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:31.755855] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53493 primary records. [2025-10-01T22:40:31.758013] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-01T22:40:31.787263] [DEBUG] [MAIN ] GSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:31.789884] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33326 primary records. [2025-10-01T22:40:31.790989] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-01T22:40:31.791094] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-01T22:40:31.791225] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-01T22:40:31.794163] [INFO ] [MAIN ] Derivative Progress: 811/1587 symbols completed. GSK took 1.2s. Estimated remaining: 5m 24s. Rate: 143.8 symbols/min [2025-10-01T22:40:31.794326] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:31.825068] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-01T22:40:31.831212] [DEBUG] [MAIN ] GSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:31.830823] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-01T22:40:31.835153] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39140 primary records. [2025-10-01T22:40:31.834030] [INFO ] [MAIN ] Derivative Progress: 812/1587 symbols completed. GSL took 1.3s. Estimated remaining: 5m 23s. Rate: 144.0 symbols/min [2025-10-01T22:40:31.835412] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:31.835596] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-01T22:40:31.856837] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-01T22:40:31.856992] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-01T22:40:31.859778] [INFO ] [MAIN ] Derivative Progress: 813/1587 symbols completed. GSBD took 1.3s. Estimated remaining: 5m 22s. Rate: 144.1 symbols/min [2025-10-01T22:40:31.860079] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:31.914800] [DEBUG] [LOCAL ] GTES: Loaded 50520 existing records from primary storage. [2025-10-01T22:40:31.915087] [INFO ] [MAIN ] GTES: Loaded 50520 primary data records. [2025-10-01T22:40:32.060005] [DEBUG] [LOCAL ] GTLS: Loaded 42788 existing records from primary storage. [2025-10-01T22:40:32.076681] [INFO ] [MAIN ] GTLS: Loaded 42788 primary data records. [2025-10-01T22:40:32.347903] [DEBUG] [LOCAL ] GTN: Loaded 45476 existing records from primary storage. [2025-10-01T22:40:32.378911] [INFO ] [MAIN ] GTN: Loaded 45476 primary data records. [2025-10-01T22:40:33.040623] [DEBUG] [MAIN ] GTES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:33.043964] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50520 primary records. [2025-10-01T22:40:33.045999] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-01T22:40:33.078951] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-01T22:40:33.077781] [DEBUG] [MAIN ] GTLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:33.079081] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-01T22:40:33.081305] [INFO ] [MAIN ] Derivative Progress: 814/1587 symbols completed. GTES took 1.3s. Estimated remaining: 5m 23s. Rate: 143.8 symbols/min [2025-10-01T22:40:33.082303] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42788 primary records. [2025-10-01T22:40:33.082566] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-01T22:40:33.082678] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:33.101752] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-01T22:40:33.101884] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-01T22:40:33.104409] [INFO ] [MAIN ] Derivative Progress: 815/1587 symbols completed. GTLS took 1.3s. Estimated remaining: 5m 22s. Rate: 144.0 symbols/min [2025-10-01T22:40:33.104621] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:33.123788] [DEBUG] [MAIN ] GTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:33.129013] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45476 primary records. [2025-10-01T22:40:33.129206] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-01T22:40:33.159578] [DEBUG] [LOCAL ] GUT: Loaded 15316 existing records from primary storage. [2025-10-01T22:40:33.161562] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-01T22:40:33.161875] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-01T22:40:33.161982] [INFO ] [MAIN ] GUT: Loaded 15316 primary data records. [2025-10-01T22:40:33.164880] [INFO ] [MAIN ] Derivative Progress: 816/1587 symbols completed. GTN took 1.3s. Estimated remaining: 5m 21s. Rate: 144.1 symbols/min [2025-10-01T22:40:33.174034] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:33.220267] [DEBUG] [LOCAL ] GTY: Loaded 30286 existing records from primary storage. [2025-10-01T22:40:33.261539] [INFO ] [MAIN ] GTY: Loaded 30286 primary data records. [2025-10-01T22:40:33.722590] [DEBUG] [LOCAL ] GVA: Loaded 33140 existing records from primary storage. [2025-10-01T22:40:33.758497] [INFO ] [MAIN ] GVA: Loaded 33140 primary data records. [2025-10-01T22:40:34.363493] [DEBUG] [MAIN ] GUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:34.364873] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15316 primary records. [2025-10-01T22:40:34.366207] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-01T22:40:34.398452] [DEBUG] [MAIN ] GTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:34.400200] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30286 primary records. [2025-10-01T22:40:34.400673] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-01T22:40:34.414336] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-01T22:40:34.414603] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-01T22:40:34.416768] [INFO ] [MAIN ] Derivative Progress: 817/1587 symbols completed. GUT took 1.3s. Estimated remaining: 5m 21s. Rate: 143.8 symbols/min [2025-10-01T22:40:34.417639] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:34.422440] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-01T22:40:34.422954] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-01T22:40:34.425557] [INFO ] [MAIN ] Derivative Progress: 818/1587 symbols completed. GTY took 1.3s. Estimated remaining: 5m 21s. Rate: 143.9 symbols/min [2025-10-01T22:40:34.426828] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:34.443035] [DEBUG] [MAIN ] GVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:34.443788] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 33140 primary records. [2025-10-01T22:40:34.443988] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-01T22:40:34.465692] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-10-01T22:40:34.465822] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-01T22:40:34.468594] [INFO ] [MAIN ] Derivative Progress: 819/1587 symbols completed. GVA took 1.3s. Estimated remaining: 5m 20s. Rate: 144.1 symbols/min [2025-10-01T22:40:34.469193] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:34.482899] [DEBUG] [LOCAL ] GWH: Loaded 16083 existing records from primary storage. [2025-10-01T22:40:34.483117] [INFO ] [MAIN ] GWH: Loaded 16083 primary data records. [2025-10-01T22:40:34.591818] [DEBUG] [LOCAL ] GWW: Loaded 19477 existing records from primary storage. [2025-10-01T22:40:34.627084] [INFO ] [MAIN ] GWW: Loaded 19477 primary data records. [2025-10-01T22:40:34.977162] [DEBUG] [LOCAL ] IBTA: Loaded 37611 existing records from primary storage. [2025-10-01T22:40:34.988406] [INFO ] [MAIN ] IBTA: Loaded 37611 primary data records. [2025-10-01T22:40:35.569568] [DEBUG] [MAIN ] GWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:35.571268] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 16083 primary records. [2025-10-01T22:40:35.571490] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-01T22:40:35.606147] [DEBUG] [MAIN ] GWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:35.600133] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-01T22:40:35.607199] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19477 primary records. [2025-10-01T22:40:35.607427] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-01T22:40:35.609924] [INFO ] [MAIN ] Derivative Progress: 820/1587 symbols completed. GWH took 1.2s. Estimated remaining: 5m 20s. Rate: 143.8 symbols/min [2025-10-01T22:40:35.610395] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:35.610029] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-01T22:40:35.643756] [DEBUG] [MAIN ] IBTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:35.645448] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 37611 primary records. [2025-10-01T22:40:35.646344] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-01T22:40:35.648447] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-01T22:40:35.660733] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-01T22:40:35.664044] [INFO ] [MAIN ] Derivative Progress: 821/1587 symbols completed. GWW took 1.2s. Estimated remaining: 5m 19s. Rate: 143.9 symbols/min [2025-10-01T22:40:35.668278] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:35.668490] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-01T22:40:35.669120] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-01T22:40:35.671845] [INFO ] [MAIN ] Derivative Progress: 822/1587 symbols completed. IBTA took 1.2s. Estimated remaining: 5m 18s. Rate: 144.1 symbols/min [2025-10-01T22:40:35.672452] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:35.743118] [DEBUG] [LOCAL ] IDA: Loaded 32160 existing records from primary storage. [2025-10-01T22:40:35.759840] [DEBUG] [LOCAL ] ICL: Loaded 38446 existing records from primary storage. [2025-10-01T22:40:35.761206] [DEBUG] [LOCAL ] ICE: Loaded 53003 existing records from primary storage. [2025-10-01T22:40:35.761351] [INFO ] [MAIN ] ICE: Loaded 53003 primary data records. [2025-10-01T22:40:35.760001] [INFO ] [MAIN ] IDA: Loaded 32160 primary data records. [2025-10-01T22:40:35.761514] [INFO ] [MAIN ] ICL: Loaded 38446 primary data records. [2025-10-01T22:40:36.846288] [DEBUG] [MAIN ] ICL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:36.860443] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38446 primary records. [2025-10-01T22:40:36.861017] [DEBUG] [MAIN ] IDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:36.861748] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32160 primary records. [2025-10-01T22:40:36.875010] [DEBUG] [MAIN ] ICE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:36.874638] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-01T22:40:36.876280] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53003 primary records. [2025-10-01T22:40:36.876664] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-01T22:40:36.874722] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-01T22:40:36.922711] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-01T22:40:36.924004] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-01T22:40:36.928427] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-01T22:40:36.927181] [INFO ] [MAIN ] Derivative Progress: 823/1587 symbols completed. IDA took 1.3s. Estimated remaining: 5m 19s. Rate: 143.8 symbols/min [2025-10-01T22:40:36.930187] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-01T22:40:36.930110] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-01T22:40:36.932822] [INFO ] [MAIN ] Derivative Progress: 824/1587 symbols completed. ICE took 1.3s. Estimated remaining: 5m 18s. Rate: 143.9 symbols/min [2025-10-01T22:40:36.932951] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-01T22:40:36.935909] [INFO ] [MAIN ] Derivative Progress: 825/1587 symbols completed. ICL took 1.3s. Estimated remaining: 5m 17s. Rate: 144.1 symbols/min [2025-10-01T22:40:36.936682] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:36.936619] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:36.937261] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:36.955168] [DEBUG] [LOCAL ] IDE: Loaded 8754 existing records from primary storage. [2025-10-01T22:40:36.955299] [INFO ] [MAIN ] IDE: Loaded 8754 primary data records. [2025-10-01T22:40:37.059386] [DEBUG] [LOCAL ] IDT: Loaded 17953 existing records from primary storage. [2025-10-01T22:40:37.092608] [INFO ] [MAIN ] IDT: Loaded 17953 primary data records. [2025-10-01T22:40:37.221093] [DEBUG] [LOCAL ] IEX: Loaded 38359 existing records from primary storage. [2025-10-01T22:40:37.288798] [INFO ] [MAIN ] IEX: Loaded 38359 primary data records. [2025-10-01T22:40:38.011563] [DEBUG] [MAIN ] IDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:38.012898] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8754 primary records. [2025-10-01T22:40:38.013078] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-01T22:40:38.041518] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-01T22:40:38.047114] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-01T22:40:38.050828] [DEBUG] [MAIN ] IDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:38.050433] [INFO ] [MAIN ] Derivative Progress: 826/1587 symbols completed. IDE took 1.1s. Estimated remaining: 5m 17s. Rate: 143.8 symbols/min [2025-10-01T22:40:38.052492] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17953 primary records. [2025-10-01T22:40:38.052706] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:38.052926] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-01T22:40:38.072894] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-01T22:40:38.073350] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-01T22:40:38.076093] [INFO ] [MAIN ] Derivative Progress: 827/1587 symbols completed. IDT took 1.1s. Estimated remaining: 5m 17s. Rate: 144.0 symbols/min [2025-10-01T22:40:38.076550] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:38.094446] [DEBUG] [MAIN ] IEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:38.095363] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38359 primary records. [2025-10-01T22:40:38.095490] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-01T22:40:38.118593] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-01T22:40:38.118806] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-01T22:40:38.121248] [INFO ] [MAIN ] Derivative Progress: 828/1587 symbols completed. IEX took 1.2s. Estimated remaining: 5m 16s. Rate: 144.1 symbols/min [2025-10-01T22:40:38.128599] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:38.129155] [DEBUG] [LOCAL ] IFN: Loaded 18268 existing records from primary storage. [2025-10-01T22:40:38.129697] [INFO ] [MAIN ] IFN: Loaded 18268 primary data records. [2025-10-01T22:40:38.295150] [DEBUG] [LOCAL ] IFF: Loaded 50984 existing records from primary storage. [2025-10-01T22:40:38.316234] [INFO ] [MAIN ] IFF: Loaded 50984 primary data records. [2025-10-01T22:40:38.466701] [DEBUG] [LOCAL ] IFS: Loaded 23078 existing records from primary storage. [2025-10-01T22:40:38.602555] [INFO ] [MAIN ] IFS: Loaded 23078 primary data records. [2025-10-01T22:40:39.301951] [DEBUG] [MAIN ] IFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:39.303214] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18268 primary records. [2025-10-01T22:40:39.303402] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-01T22:40:39.327267] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-01T22:40:39.327695] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-01T22:40:39.329964] [INFO ] [MAIN ] Derivative Progress: 829/1587 symbols completed. IFN took 1.3s. Estimated remaining: 5m 16s. Rate: 143.8 symbols/min [2025-10-01T22:40:39.330596] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:39.344417] [DEBUG] [MAIN ] IFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:39.345315] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50984 primary records. [2025-10-01T22:40:39.345753] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-01T22:40:39.372846] [DEBUG] [LOCAL ] IGA: Loaded 9830 existing records from primary storage. [2025-10-01T22:40:39.373686] [INFO ] [MAIN ] IGA: Loaded 9830 primary data records. [2025-10-01T22:40:39.395126] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-01T22:40:39.422721] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-01T22:40:39.423398] [DEBUG] [MAIN ] IFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:39.426067] [INFO ] [MAIN ] Derivative Progress: 830/1587 symbols completed. IFF took 1.4s. Estimated remaining: 5m 16s. Rate: 143.9 symbols/min [2025-10-01T22:40:39.464633] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:39.486897] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 23078 primary records. [2025-10-01T22:40:39.514025] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-01T22:40:39.764334] [DEBUG] [LOCAL ] IGD: Loaded 19065 existing records from primary storage. [2025-10-01T22:40:39.762814] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-01T22:40:39.764615] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-01T22:40:39.764701] [INFO ] [MAIN ] IGD: Loaded 19065 primary data records. [2025-10-01T22:40:39.767426] [INFO ] [MAIN ] Derivative Progress: 831/1587 symbols completed. IFS took 1.6s. Estimated remaining: 5m 15s. Rate: 144.0 symbols/min [2025-10-01T22:40:39.767794] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:39.880614] [DEBUG] [LOCAL ] IGI: Loaded 3604 existing records from primary storage. [2025-10-01T22:40:39.894505] [INFO ] [MAIN ] IGI: Loaded 3604 primary data records. [2025-10-01T22:40:40.515022] [DEBUG] [MAIN ] IGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:40.516411] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9830 primary records. [2025-10-01T22:40:40.516546] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-01T22:40:40.544082] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-01T22:40:40.546101] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-01T22:40:40.548230] [INFO ] [MAIN ] Derivative Progress: 832/1587 symbols completed. IGA took 1.2s. Estimated remaining: 5m 15s. Rate: 143.8 symbols/min [2025-10-01T22:40:40.548995] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:40.569886] [DEBUG] [MAIN ] IGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:40.579381] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19065 primary records. [2025-10-01T22:40:40.584795] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-01T22:40:40.585153] [DEBUG] [MAIN ] IGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:40.587331] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3604 primary records. [2025-10-01T22:40:40.594801] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-01T22:40:40.625210] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-01T22:40:40.626976] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-01T22:40:40.630011] [INFO ] [MAIN ] Derivative Progress: 833/1587 symbols completed. IGD took 1.2s. Estimated remaining: 5m 14s. Rate: 144.0 symbols/min [2025-10-01T22:40:40.627377] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-01T22:40:40.630428] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:40.630571] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-01T22:40:40.642133] [INFO ] [MAIN ] Derivative Progress: 834/1587 symbols completed. IGI took 0.9s. Estimated remaining: 5m 13s. Rate: 144.1 symbols/min [2025-10-01T22:40:40.643734] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:40.644903] [DEBUG] [LOCAL ] IGR: Loaded 30496 existing records from primary storage. [2025-10-01T22:40:40.645156] [INFO ] [MAIN ] IGR: Loaded 30496 primary data records. [2025-10-01T22:40:40.693846] [DEBUG] [LOCAL ] IH: Loaded 3116 existing records from primary storage. [2025-10-01T22:40:40.722307] [INFO ] [MAIN ] IH: Loaded 3116 primary data records. [2025-10-01T22:40:40.768211] [DEBUG] [LOCAL ] IHD: Loaded 6958 existing records from primary storage. [2025-10-01T22:40:40.833971] [INFO ] [MAIN ] IHD: Loaded 6958 primary data records. [2025-10-01T22:40:41.732573] [DEBUG] [MAIN ] IGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:41.733760] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30496 primary records. [2025-10-01T22:40:41.742712] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-01T22:40:41.750190] [DEBUG] [MAIN ] IH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:41.760347] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3116 primary records. [2025-10-01T22:40:41.764345] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-01T22:40:41.787091] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-01T22:40:41.794210] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-01T22:40:41.796303] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-10-01T22:40:41.800156] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-01T22:40:41.799846] [INFO ] [MAIN ] Derivative Progress: 835/1587 symbols completed. IGR took 1.3s. Estimated remaining: 5m 14s. Rate: 143.8 symbols/min [2025-10-01T22:40:41.803920] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:41.804222] [INFO ] [MAIN ] Derivative Progress: 836/1587 symbols completed. IH took 1.2s. Estimated remaining: 5m 13s. Rate: 144.0 symbols/min [2025-10-01T22:40:41.804833] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:41.824579] [DEBUG] [MAIN ] IHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:41.825422] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 6958 primary records. [2025-10-01T22:40:41.825586] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-01T22:40:41.843272] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-01T22:40:41.843480] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-01T22:40:41.846344] [INFO ] [MAIN ] Derivative Progress: 837/1587 symbols completed. IHD took 1.2s. Estimated remaining: 5m 12s. Rate: 144.1 symbols/min [2025-10-01T22:40:41.846575] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:41.860883] [DEBUG] [LOCAL ] IIF: Loaded 5723 existing records from primary storage. [2025-10-01T22:40:41.861100] [INFO ] [MAIN ] IIF: Loaded 5723 primary data records. [2025-10-01T22:40:41.973597] [DEBUG] [LOCAL ] IHG: Loaded 24438 existing records from primary storage. [2025-10-01T22:40:41.995545] [INFO ] [MAIN ] IHG: Loaded 24438 primary data records. [2025-10-01T22:40:42.049251] [DEBUG] [LOCAL ] IHS: Loaded 39149 existing records from primary storage. [2025-10-01T22:40:42.101622] [INFO ] [MAIN ] IHS: Loaded 39149 primary data records. [2025-10-01T22:40:43.001480] [DEBUG] [MAIN ] IIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:43.002314] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5723 primary records. [2025-10-01T22:40:43.002495] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-01T22:40:43.021727] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-01T22:40:43.022901] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-01T22:40:43.025324] [INFO ] [MAIN ] Derivative Progress: 838/1587 symbols completed. IIF took 1.2s. Estimated remaining: 5m 12s. Rate: 143.8 symbols/min [2025-10-01T22:40:43.041098] [DEBUG] [MAIN ] IHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:43.042525] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24438 primary records. [2025-10-01T22:40:43.042687] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-01T22:40:43.056051] [DEBUG] [MAIN ] IHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:43.056990] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 39149 primary records. [2025-10-01T22:40:43.057080] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-01T22:40:43.090014] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-01T22:40:43.089686] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-01T22:40:43.090157] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-01T22:40:43.090239] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-01T22:40:43.092981] [INFO ] [MAIN ] Derivative Progress: 839/1587 symbols completed. IHG took 1.3s. Estimated remaining: 5m 12s. Rate: 144.0 symbols/min [2025-10-01T22:40:43.096016] [INFO ] [MAIN ] Derivative Progress: 840/1587 symbols completed. IHS took 1.3s. Estimated remaining: 5m 11s. Rate: 144.1 symbols/min [2025-10-01T22:40:43.096603] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:43.096534] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:43.096688] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:43.126979] [DEBUG] [LOCAL ] IIIN: Loaded 16358 existing records from primary storage. [2025-10-01T22:40:43.128149] [INFO ] [MAIN ] IIIN: Loaded 16358 primary data records. [2025-10-01T22:40:43.128524] [DEBUG] [LOCAL ] IIM: Loaded 16041 existing records from primary storage. [2025-10-01T22:40:43.142301] [INFO ] [MAIN ] IIM: Loaded 16041 primary data records. [2025-10-01T22:40:43.341095] [DEBUG] [LOCAL ] IIPR: Loaded 29798 existing records from primary storage. [2025-10-01T22:40:43.377454] [INFO ] [MAIN ] IIPR: Loaded 29798 primary data records. [2025-10-01T22:40:44.236571] [DEBUG] [MAIN ] IIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:44.237077] [DEBUG] [MAIN ] IIIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:44.239467] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16358 primary records. [2025-10-01T22:40:44.238422] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 16041 primary records. [2025-10-01T22:40:44.239690] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-01T22:40:44.239790] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-01T22:40:44.276719] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-01T22:40:44.278498] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-01T22:40:44.278262] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-01T22:40:44.278731] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-01T22:40:44.281371] [INFO ] [MAIN ] Derivative Progress: 841/1587 symbols completed. IIIN took 1.2s. Estimated remaining: 5m 11s. Rate: 143.8 symbols/min [2025-10-01T22:40:44.297847] [DEBUG] [MAIN ] IIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:44.297999] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:44.298171] [INFO ] [MAIN ] Derivative Progress: 842/1587 symbols completed. IIM took 1.2s. Estimated remaining: 5m 10s. Rate: 144.0 symbols/min [2025-10-01T22:40:44.299776] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29798 primary records. [2025-10-01T22:40:44.300064] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-01T22:40:44.300235] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:44.318963] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-01T22:40:44.319227] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-01T22:40:44.322224] [INFO ] [MAIN ] Derivative Progress: 843/1587 symbols completed. IIPR took 1.2s. Estimated remaining: 5m 10s. Rate: 144.2 symbols/min [2025-10-01T22:40:44.322525] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:44.368148] [DEBUG] [LOCAL ] IMAX: Loaded 42818 existing records from primary storage. [2025-10-01T22:40:44.368409] [INFO ] [MAIN ] IMAX: Loaded 42818 primary data records. [2025-10-01T22:40:44.526327] [DEBUG] [LOCAL ] INFA: Loaded 49567 existing records from primary storage. [2025-10-01T22:40:44.526688] [INFO ] [MAIN ] INFA: Loaded 49567 primary data records. [2025-10-01T22:40:44.701535] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-10-01T22:40:44.715717] [INFO ] [MAIN ] INFY: Loaded 53598 primary data records. [2025-10-01T22:40:45.568818] [DEBUG] [MAIN ] IMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:45.571351] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42818 primary records. [2025-10-01T22:40:45.571970] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-01T22:40:45.609212] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-01T22:40:45.620369] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-01T22:40:45.621974] [DEBUG] [MAIN ] INFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:45.627396] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49567 primary records. [2025-10-01T22:40:45.624847] [INFO ] [MAIN ] Derivative Progress: 844/1587 symbols completed. IMAX took 1.3s. Estimated remaining: 5m 10s. Rate: 143.8 symbols/min [2025-10-01T22:40:45.627821] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-01T22:40:45.627750] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:45.661748] [DEBUG] [MAIN ] INFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:45.670219] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53598 primary records. [2025-10-01T22:40:45.673914] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-01T22:40:45.679479] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-01T22:40:45.679702] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-01T22:40:45.683592] [INFO ] [MAIN ] Derivative Progress: 845/1587 symbols completed. INFA took 1.4s. Estimated remaining: 5m 9s. Rate: 143.9 symbols/min [2025-10-01T22:40:45.692045] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:45.701835] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-01T22:40:45.702624] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-01T22:40:45.705783] [INFO ] [MAIN ] Derivative Progress: 846/1587 symbols completed. INFY took 1.4s. Estimated remaining: 5m 9s. Rate: 144.1 symbols/min [2025-10-01T22:40:45.706082] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:45.772698] [DEBUG] [LOCAL ] ING: Loaded 50724 existing records from primary storage. [2025-10-01T22:40:45.773046] [INFO ] [MAIN ] ING: Loaded 50724 primary data records. [2025-10-01T22:40:45.911575] [DEBUG] [LOCAL ] INGM: Loaded 28652 existing records from primary storage. [2025-10-01T22:40:45.922948] [INFO ] [MAIN ] INGM: Loaded 28652 primary data records. [2025-10-01T22:40:45.929433] [DEBUG] [LOCAL ] INGR: Loaded 33339 existing records from primary storage. [2025-10-01T22:40:45.961712] [INFO ] [MAIN ] INGR: Loaded 33339 primary data records. [2025-10-01T22:40:46.845574] [DEBUG] [MAIN ] ING: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:46.846879] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50724 primary records. [2025-10-01T22:40:46.846986] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-01T22:40:46.866162] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-01T22:40:46.866442] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-01T22:40:46.868473] [INFO ] [MAIN ] Derivative Progress: 847/1587 symbols completed. ING took 1.2s. Estimated remaining: 5m 9s. Rate: 143.8 symbols/min [2025-10-01T22:40:46.869682] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:46.888349] [DEBUG] [MAIN ] INGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:46.902023] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28652 primary records. [2025-10-01T22:40:46.902333] [DEBUG] [MAIN ] INGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:46.903134] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-01T22:40:46.903021] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33339 primary records. [2025-10-01T22:40:46.903331] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-01T22:40:46.949210] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-01T22:40:46.949863] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-01T22:40:46.950069] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-01T22:40:46.950144] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-01T22:40:46.953585] [INFO ] [MAIN ] Derivative Progress: 848/1587 symbols completed. INGM took 1.3s. Estimated remaining: 5m 8s. Rate: 143.9 symbols/min [2025-10-01T22:40:46.957111] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:46.970293] [INFO ] [MAIN ] Derivative Progress: 849/1587 symbols completed. INGR took 1.3s. Estimated remaining: 5m 7s. Rate: 144.1 symbols/min [2025-10-01T22:40:46.971345] [DEBUG] [LOCAL ] INN: Loaded 41756 existing records from primary storage. [2025-10-01T22:40:46.971994] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:46.971540] [INFO ] [MAIN ] INN: Loaded 41756 primary data records. [2025-10-01T22:40:47.384588] [DEBUG] [LOCAL ] INSP: Loaded 37162 existing records from primary storage. [2025-10-01T22:40:47.386420] [INFO ] [MAIN ] INSP: Loaded 37162 primary data records. [2025-10-01T22:40:47.405361] [DEBUG] [LOCAL ] INSW: Loaded 39994 existing records from primary storage. [2025-10-01T22:40:47.426932] [INFO ] [MAIN ] INSW: Loaded 39994 primary data records. [2025-10-01T22:40:48.090171] [DEBUG] [MAIN ] INN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:48.091093] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41756 primary records. [2025-10-01T22:40:48.091523] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-01T22:40:48.114966] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-01T22:40:48.115266] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-01T22:40:48.119008] [INFO ] [MAIN ] Derivative Progress: 850/1587 symbols completed. INN took 1.2s. Estimated remaining: 5m 8s. Rate: 143.8 symbols/min [2025-10-01T22:40:48.120069] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:48.142857] [DEBUG] [MAIN ] INSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:48.144978] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 37162 primary records. [2025-10-01T22:40:48.145179] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-01T22:40:48.181796] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-01T22:40:48.182413] [DEBUG] [MAIN ] INSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:48.196298] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-01T22:40:48.197731] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39994 primary records. [2025-10-01T22:40:48.198150] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-01T22:40:48.200748] [INFO ] [MAIN ] Derivative Progress: 851/1587 symbols completed. INSP took 1.2s. Estimated remaining: 5m 7s. Rate: 143.9 symbols/min [2025-10-01T22:40:48.201928] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:48.237050] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-01T22:40:48.236127] [DEBUG] [LOCAL ] INVH: Loaded 53133 existing records from primary storage. [2025-10-01T22:40:48.237341] [INFO ] [MAIN ] INVH: Loaded 53133 primary data records. [2025-10-01T22:40:48.237544] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-01T22:40:48.258040] [INFO ] [MAIN ] Derivative Progress: 852/1587 symbols completed. INSW took 1.3s. Estimated remaining: 5m 6s. Rate: 144.1 symbols/min [2025-10-01T22:40:48.264143] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:48.410320] [DEBUG] [LOCAL ] INVX: Loaded 29044 existing records from primary storage. [2025-10-01T22:40:48.426139] [INFO ] [MAIN ] INVX: Loaded 29044 primary data records. [2025-10-01T22:40:48.802975] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-01T22:40:48.912731] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-01T22:40:49.322270] [DEBUG] [MAIN ] INVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:49.327056] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53133 primary records. [2025-10-01T22:40:49.333895] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-01T22:40:49.343706] [DEBUG] [MAIN ] INVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:49.346171] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29044 primary records. [2025-10-01T22:40:49.346440] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-01T22:40:49.400137] [DEBUG] [MAIN ] IONQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:49.402342] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-01T22:40:49.403059] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-01T22:40:49.403889] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-01T22:40:49.403176] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-01T22:40:49.404123] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-01T22:40:49.406786] [INFO ] [MAIN ] Derivative Progress: 853/1587 symbols completed. INVH took 1.3s. Estimated remaining: 5m 6s. Rate: 143.8 symbols/min [2025-10-01T22:40:49.407247] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-01T22:40:49.410518] [INFO ] [MAIN ] Derivative Progress: 854/1587 symbols completed. INVX took 1.2s. Estimated remaining: 5m 6s. Rate: 143.9 symbols/min [2025-10-01T22:40:49.427054] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-01T22:40:49.427199] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-01T22:40:49.430867] [INFO ] [MAIN ] Derivative Progress: 855/1587 symbols completed. IONQ took 1.2s. Estimated remaining: 5m 5s. Rate: 144.1 symbols/min [2025-10-01T22:40:49.431360] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:49.431584] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:49.431454] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:49.513530] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-10-01T22:40:49.534318] [INFO ] [MAIN ] IP: Loaded 53313 primary data records. [2025-10-01T22:40:49.592099] [DEBUG] [LOCAL ] IOT: Loaded 53471 existing records from primary storage. [2025-10-01T22:40:49.626216] [INFO ] [MAIN ] IOT: Loaded 53471 primary data records. [2025-10-01T22:40:49.642059] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-01T22:40:49.678582] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-10-01T22:40:50.600884] [DEBUG] [MAIN ] IP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:50.602335] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53313 primary records. [2025-10-01T22:40:50.602559] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-01T22:40:50.632103] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-01T22:40:50.637453] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-01T22:40:50.639818] [INFO ] [MAIN ] Derivative Progress: 856/1587 symbols completed. IP took 1.2s. Estimated remaining: 5m 5s. Rate: 143.8 symbols/min [2025-10-01T22:40:50.641148] [DEBUG] [MAIN ] IOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:50.641376] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:50.642242] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53471 primary records. [2025-10-01T22:40:50.643905] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-01T22:40:50.670553] [DEBUG] [MAIN ] IPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:50.674496] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53330 primary records. [2025-10-01T22:40:50.675482] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-01T22:40:50.676233] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-01T22:40:50.676509] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-01T22:40:50.679250] [INFO ] [MAIN ] Derivative Progress: 857/1587 symbols completed. IOT took 1.2s. Estimated remaining: 5m 4s. Rate: 143.9 symbols/min [2025-10-01T22:40:50.687130] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:50.702318] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-01T22:40:50.710291] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-01T22:40:50.713362] [INFO ] [MAIN ] Derivative Progress: 858/1587 symbols completed. IPG took 1.3s. Estimated remaining: 5m 4s. Rate: 144.1 symbols/min [2025-10-01T22:40:50.713885] [DEBUG] [LOCAL ] IPI: Loaded 21433 existing records from primary storage. [2025-10-01T22:40:50.718927] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:50.719129] [INFO ] [MAIN ] IPI: Loaded 21433 primary data records. [2025-10-01T22:40:50.772177] [DEBUG] [LOCAL ] IQI: Loaded 18090 existing records from primary storage. [2025-10-01T22:40:50.805376] [INFO ] [MAIN ] IQI: Loaded 18090 primary data records. [2025-10-01T22:40:51.244580] [DEBUG] [LOCAL ] IQV: Loaded 50102 existing records from primary storage. [2025-10-01T22:40:51.302632] [INFO ] [MAIN ] IQV: Loaded 50102 primary data records. [2025-10-01T22:40:51.841547] [DEBUG] [MAIN ] IPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:51.842983] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21433 primary records. [2025-10-01T22:40:51.843344] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-01T22:40:51.866547] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-01T22:40:51.868819] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-01T22:40:51.870829] [INFO ] [MAIN ] Derivative Progress: 859/1587 symbols completed. IPI took 1.2s. Estimated remaining: 5m 4s. Rate: 143.8 symbols/min [2025-10-01T22:40:51.871146] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:51.886215] [DEBUG] [MAIN ] IQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:51.887247] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 18090 primary records. [2025-10-01T22:40:51.887420] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-01T22:40:51.907072] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-01T22:40:51.907330] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-01T22:40:51.909743] [INFO ] [MAIN ] Derivative Progress: 860/1587 symbols completed. IQI took 1.2s. Estimated remaining: 5m 3s. Rate: 143.9 symbols/min [2025-10-01T22:40:51.922994] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:51.923369] [DEBUG] [MAIN ] IQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:51.924669] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50102 primary records. [2025-10-01T22:40:51.925060] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-01T22:40:51.942229] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-10-01T22:40:51.942346] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-01T22:40:51.944935] [INFO ] [MAIN ] Derivative Progress: 861/1587 symbols completed. IQV took 1.2s. Estimated remaining: 5m 2s. Rate: 144.1 symbols/min [2025-10-01T22:40:51.945125] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:51.987343] [DEBUG] [LOCAL ] IR: Loaded 52690 existing records from primary storage. [2025-10-01T22:40:51.987562] [INFO ] [MAIN ] IR: Loaded 52690 primary data records. [2025-10-01T22:40:52.070146] [DEBUG] [LOCAL ] IRS: Loaded 21936 existing records from primary storage. [2025-10-01T22:40:52.106599] [INFO ] [MAIN ] IRS: Loaded 21936 primary data records. [2025-10-01T22:40:52.172256] [DEBUG] [LOCAL ] IRM: Loaded 49302 existing records from primary storage. [2025-10-01T22:40:52.237011] [INFO ] [MAIN ] IRM: Loaded 49302 primary data records. [2025-10-01T22:40:53.075355] [DEBUG] [MAIN ] IR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:53.076837] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52690 primary records. [2025-10-01T22:40:53.077122] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-01T22:40:53.099706] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-01T22:40:53.100508] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-01T22:40:53.102995] [INFO ] [MAIN ] Derivative Progress: 862/1587 symbols completed. IR took 1.2s. Estimated remaining: 5m 2s. Rate: 143.8 symbols/min [2025-10-01T22:40:53.111347] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:53.117252] [DEBUG] [MAIN ] IRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:53.118774] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21936 primary records. [2025-10-01T22:40:53.119309] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-01T22:40:53.140309] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-01T22:40:53.140619] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-01T22:40:53.143375] [INFO ] [MAIN ] Derivative Progress: 863/1587 symbols completed. IRS took 1.2s. Estimated remaining: 5m 2s. Rate: 144.0 symbols/min [2025-10-01T22:40:53.151603] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:53.157366] [DEBUG] [MAIN ] IRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:53.159062] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49302 primary records. [2025-10-01T22:40:53.159277] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-01T22:40:53.179508] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-01T22:40:53.183711] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-01T22:40:53.186343] [INFO ] [MAIN ] Derivative Progress: 864/1587 symbols completed. IRM took 1.3s. Estimated remaining: 5m 1s. Rate: 144.1 symbols/min [2025-10-01T22:40:53.186680] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:53.206087] [DEBUG] [LOCAL ] ISD: Loaded 15574 existing records from primary storage. [2025-10-01T22:40:53.206263] [INFO ] [MAIN ] ISD: Loaded 15574 primary data records. [2025-10-01T22:40:53.367814] [DEBUG] [LOCAL ] IRT: Loaded 50401 existing records from primary storage. [2025-10-01T22:40:53.384376] [INFO ] [MAIN ] IRT: Loaded 50401 primary data records. [2025-10-01T22:40:53.529081] [DEBUG] [LOCAL ] IT: Loaded 42034 existing records from primary storage. [2025-10-01T22:40:53.665528] [INFO ] [MAIN ] IT: Loaded 42034 primary data records. [2025-10-01T22:40:54.412523] [DEBUG] [MAIN ] ISD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:54.414681] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15574 primary records. [2025-10-01T22:40:54.414783] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-01T22:40:54.439157] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-01T22:40:54.439470] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-01T22:40:54.441590] [INFO ] [MAIN ] Derivative Progress: 865/1587 symbols completed. ISD took 1.3s. Estimated remaining: 5m 1s. Rate: 143.8 symbols/min [2025-10-01T22:40:54.442025] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:54.458000] [DEBUG] [MAIN ] IRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:54.458967] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50401 primary records. [2025-10-01T22:40:54.459182] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-01T22:40:54.479141] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-01T22:40:54.479314] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-01T22:40:54.495466] [DEBUG] [MAIN ] IT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:54.495085] [INFO ] [MAIN ] Derivative Progress: 866/1587 symbols completed. IRT took 1.4s. Estimated remaining: 5m 1s. Rate: 143.9 symbols/min [2025-10-01T22:40:54.495816] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:54.496803] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 42034 primary records. [2025-10-01T22:40:54.505829] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-01T22:40:54.533216] [DEBUG] [LOCAL ] ITGR: Loaded 31386 existing records from primary storage. [2025-10-01T22:40:54.535015] [INFO ] [MAIN ] ITGR: Loaded 31386 primary data records. [2025-10-01T22:40:54.548414] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-10-01T22:40:54.597773] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-01T22:40:54.632043] [INFO ] [MAIN ] Derivative Progress: 867/1587 symbols completed. IT took 1.4s. Estimated remaining: 4m 60s. Rate: 144.0 symbols/min [2025-10-01T22:40:54.659782] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:54.729766] [DEBUG] [LOCAL ] ITT: Loaded 32783 existing records from primary storage. [2025-10-01T22:40:54.763021] [INFO ] [MAIN ] ITT: Loaded 32783 primary data records. [2025-10-01T22:40:55.266159] [DEBUG] [LOCAL ] ITUB: Loaded 53325 existing records from primary storage. [2025-10-01T22:40:55.266468] [INFO ] [MAIN ] ITUB: Loaded 53325 primary data records. [2025-10-01T22:40:55.461932] [DEBUG] [MAIN ] ITGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:55.596133] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31386 primary records. [2025-10-01T22:40:55.606923] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-01T22:40:55.629998] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-01T22:40:55.631158] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-01T22:40:55.633417] [INFO ] [MAIN ] Derivative Progress: 868/1587 symbols completed. ITGR took 1.2s. Estimated remaining: 5m 0s. Rate: 143.8 symbols/min [2025-10-01T22:40:55.648275] [DEBUG] [MAIN ] ITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:55.649197] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32783 primary records. [2025-10-01T22:40:55.649297] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-01T22:40:55.667725] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-01T22:40:55.669327] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-01T22:40:55.672070] [INFO ] [MAIN ] Derivative Progress: 869/1587 symbols completed. ITT took 1.2s. Estimated remaining: 4m 59s. Rate: 143.9 symbols/min [2025-10-01T22:40:55.686167] [DEBUG] [MAIN ] ITUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:55.686793] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53325 primary records. [2025-10-01T22:40:55.686855] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-01T22:40:55.702811] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-01T22:40:55.702877] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-01T22:40:55.705523] [INFO ] [MAIN ] Derivative Progress: 870/1587 symbols completed. ITUB took 1.0s. Estimated remaining: 4m 59s. Rate: 144.1 symbols/min [2025-10-01T22:40:55.706778] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:55.706910] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:55.707063] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:55.744321] [DEBUG] [LOCAL ] IVT: Loaded 30693 existing records from primary storage. [2025-10-01T22:40:55.753969] [INFO ] [MAIN ] IVT: Loaded 30693 primary data records. [2025-10-01T22:40:55.935071] [DEBUG] [LOCAL ] ITW: Loaded 45819 existing records from primary storage. [2025-10-01T22:40:55.922829] [DEBUG] [LOCAL ] IVR: Loaded 47888 existing records from primary storage. [2025-10-01T22:40:55.955894] [INFO ] [MAIN ] ITW: Loaded 45819 primary data records. [2025-10-01T22:40:55.970546] [INFO ] [MAIN ] IVR: Loaded 47888 primary data records. [2025-10-01T22:40:56.904883] [DEBUG] [MAIN ] IVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:56.905947] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30693 primary records. [2025-10-01T22:40:56.906163] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-01T22:40:56.932700] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-01T22:40:56.943162] [DEBUG] [MAIN ] ITW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:56.942461] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-01T22:40:56.944103] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45819 primary records. [2025-10-01T22:40:56.948576] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-01T22:40:56.947269] [INFO ] [MAIN ] Derivative Progress: 871/1587 symbols completed. IVT took 1.2s. Estimated remaining: 4m 59s. Rate: 143.8 symbols/min [2025-10-01T22:40:56.950298] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:56.972153] [DEBUG] [MAIN ] IVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:56.977328] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47888 primary records. [2025-10-01T22:40:56.980984] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-01T22:40:56.983108] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-01T22:40:56.983245] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-01T22:40:56.985848] [INFO ] [MAIN ] Derivative Progress: 872/1587 symbols completed. ITW took 1.3s. Estimated remaining: 4m 58s. Rate: 143.9 symbols/min [2025-10-01T22:40:56.986374] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:57.003386] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-01T22:40:57.003534] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-01T22:40:57.007237] [INFO ] [MAIN ] Derivative Progress: 873/1587 symbols completed. IVR took 1.3s. Estimated remaining: 4m 57s. Rate: 144.1 symbols/min [2025-10-01T22:40:57.007513] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:57.026383] [DEBUG] [LOCAL ] IX: Loaded 22501 existing records from primary storage. [2025-10-01T22:40:57.026515] [INFO ] [MAIN ] IX: Loaded 22501 primary data records. [2025-10-01T22:40:57.238207] [DEBUG] [LOCAL ] IVZ: Loaded 53128 existing records from primary storage. [2025-10-01T22:40:57.275884] [INFO ] [MAIN ] IVZ: Loaded 53128 primary data records. [2025-10-01T22:40:57.458674] [DEBUG] [LOCAL ] J: Loaded 40138 existing records from primary storage. [2025-10-01T22:40:57.472577] [INFO ] [MAIN ] J: Loaded 40138 primary data records. [2025-10-01T22:40:58.133033] [DEBUG] [MAIN ] IX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:58.134206] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22501 primary records. [2025-10-01T22:40:58.135806] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-01T22:40:58.172913] [DEBUG] [MAIN ] IVZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:58.175758] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53128 primary records. [2025-10-01T22:40:58.176281] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-01T22:40:58.194898] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-01T22:40:58.197173] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-01T22:40:58.200559] [INFO ] [MAIN ] Derivative Progress: 874/1587 symbols completed. IX took 1.2s. Estimated remaining: 4m 58s. Rate: 143.8 symbols/min [2025-10-01T22:40:58.202052] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:58.217137] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-01T22:40:58.217755] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-01T22:40:58.217675] [DEBUG] [MAIN ] J: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:58.218782] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40138 primary records. [2025-10-01T22:40:58.221146] [INFO ] [MAIN ] Derivative Progress: 875/1587 symbols completed. IVZ took 1.3s. Estimated remaining: 4m 57s. Rate: 143.9 symbols/min [2025-10-01T22:40:58.221419] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:58.221509] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-01T22:40:58.240248] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-01T22:40:58.240386] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-01T22:40:58.243380] [INFO ] [MAIN ] Derivative Progress: 876/1587 symbols completed. J took 1.2s. Estimated remaining: 4m 56s. Rate: 144.1 symbols/min [2025-10-01T22:40:58.243617] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:58.314007] [DEBUG] [LOCAL ] JBGS: Loaded 42383 existing records from primary storage. [2025-10-01T22:40:58.314307] [INFO ] [MAIN ] JBGS: Loaded 42383 primary data records. [2025-10-01T22:40:58.314981] [DEBUG] [LOCAL ] JBI: Loaded 43502 existing records from primary storage. [2025-10-01T22:40:58.320517] [INFO ] [MAIN ] JBI: Loaded 43502 primary data records. [2025-10-01T22:40:58.615459] [DEBUG] [LOCAL ] JBL: Loaded 48376 existing records from primary storage. [2025-10-01T22:40:58.648590] [INFO ] [MAIN ] JBL: Loaded 48376 primary data records. [2025-10-01T22:40:59.439783] [DEBUG] [MAIN ] JBGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:59.440974] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42383 primary records. [2025-10-01T22:40:59.454346] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-01T22:40:59.455282] [DEBUG] [MAIN ] JBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:59.457061] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43502 primary records. [2025-10-01T22:40:59.457447] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-01T22:40:59.493231] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-01T22:40:59.494037] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-01T22:40:59.496525] [INFO ] [MAIN ] Derivative Progress: 877/1587 symbols completed. JBGS took 1.3s. Estimated remaining: 4m 56s. Rate: 143.7 symbols/min [2025-10-01T22:40:59.496898] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:59.497939] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-01T22:40:59.498203] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-01T22:40:59.500348] [INFO ] [MAIN ] Derivative Progress: 878/1587 symbols completed. JBI took 1.3s. Estimated remaining: 4m 56s. Rate: 143.9 symbols/min [2025-10-01T22:40:59.500817] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:40:59.522007] [DEBUG] [MAIN ] JBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:40:59.523060] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48376 primary records. [2025-10-01T22:40:59.523299] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-01T22:40:59.543357] [DEBUG] [LOCAL ] JCE: Loaded 6781 existing records from primary storage. [2025-10-01T22:40:59.547826] [INFO ] [MAIN ] JCE: Loaded 6781 primary data records. [2025-10-01T22:40:59.613065] [DEBUG] [LOCAL ] JBND: Loaded 26039 existing records from primary storage. [2025-10-01T22:40:59.636785] [INFO ] [MAIN ] JBND: Loaded 26039 primary data records. [2025-10-01T22:40:59.650371] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-01T22:40:59.701181] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-01T22:40:59.723346] [INFO ] [MAIN ] Derivative Progress: 879/1587 symbols completed. JBL took 1.5s. Estimated remaining: 4m 55s. Rate: 144.0 symbols/min [2025-10-01T22:40:59.773554] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:00.309582] [DEBUG] [MAIN ] JCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:00.309099] [DEBUG] [LOCAL ] JCI: Loaded 53545 existing records from primary storage. [2025-10-01T22:41:00.309940] [INFO ] [MAIN ] JCI: Loaded 53545 primary data records. [2025-10-01T22:41:00.311076] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6781 primary records. [2025-10-01T22:41:00.311282] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-01T22:41:00.454621] [DEBUG] [MAIN ] JBND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:00.469336] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 26039 primary records. [2025-10-01T22:41:00.469546] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-01T22:41:00.469714] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-01T22:41:00.469797] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-01T22:41:00.472135] [INFO ] [MAIN ] Derivative Progress: 880/1587 symbols completed. JCE took 1.0s. Estimated remaining: 4m 55s. Rate: 143.9 symbols/min [2025-10-01T22:41:00.497062] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:00.579631] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-01T22:41:00.730879] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-01T22:41:00.771409] [INFO ] [MAIN ] Derivative Progress: 881/1587 symbols completed. JBND took 1.3s. Estimated remaining: 4m 54s. Rate: 143.9 symbols/min [2025-10-01T22:41:00.771812] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:00.797929] [DEBUG] [LOCAL ] JEQ: Loaded 8807 existing records from primary storage. [2025-10-01T22:41:00.798181] [INFO ] [MAIN ] JEQ: Loaded 8807 primary data records. [2025-10-01T22:41:00.926371] [DEBUG] [LOCAL ] JELD: Loaded 46073 existing records from primary storage. [2025-10-01T22:41:00.940109] [INFO ] [MAIN ] JELD: Loaded 46073 primary data records. [2025-10-01T22:41:01.156187] [DEBUG] [MAIN ] JCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:01.170082] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53545 primary records. [2025-10-01T22:41:01.289127] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-01T22:41:01.509184] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-01T22:41:01.526477] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-01T22:41:01.530015] [INFO ] [MAIN ] Derivative Progress: 882/1587 symbols completed. JCI took 1.8s. Estimated remaining: 4m 54s. Rate: 143.8 symbols/min [2025-10-01T22:41:01.530489] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:01.562289] [DEBUG] [MAIN ] JEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:01.563550] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8807 primary records. [2025-10-01T22:41:01.563762] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-01T22:41:01.605458] [DEBUG] [MAIN ] JELD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:01.610889] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46073 primary records. [2025-10-01T22:41:01.612506] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-01T22:41:01.619386] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-10-01T22:41:01.619765] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-01T22:41:01.639663] [INFO ] [MAIN ] Derivative Progress: 883/1587 symbols completed. JEQ took 0.9s. Estimated remaining: 4m 54s. Rate: 143.9 symbols/min [2025-10-01T22:41:01.649284] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-01T22:41:01.649390] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-01T22:41:01.652706] [INFO ] [MAIN ] Derivative Progress: 884/1587 symbols completed. JELD took 1.2s. Estimated remaining: 4m 53s. Rate: 144.0 symbols/min [2025-10-01T22:41:01.648286] [DEBUG] [LOCAL ] JFR: Loaded 30718 existing records from primary storage. [2025-10-01T22:41:01.652914] [INFO ] [MAIN ] JFR: Loaded 30718 primary data records. [2025-10-01T22:41:02.028257] [DEBUG] [MAIN ] JFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:02.028985] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30718 primary records. [2025-10-01T22:41:02.029050] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-01T22:41:02.045354] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-01T22:41:02.045440] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-01T22:41:02.047577] [INFO ] [MAIN ] Derivative Progress: 885/1587 symbols completed. JFR took 0.5s. Estimated remaining: 4m 52s. Rate: 144.1 symbols/min [2025-10-01T22:41:02.048295] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:02.048404] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:02.048633] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:02.055620] [DEBUG] [LOCAL ] JHI: Loaded 3586 existing records from primary storage. [2025-10-01T22:41:02.055782] [INFO ] [MAIN ] JHI: Loaded 3586 primary data records. [2025-10-01T22:41:02.146048] [DEBUG] [LOCAL ] JGH: Loaded 11062 existing records from primary storage. [2025-10-01T22:41:02.158419] [INFO ] [MAIN ] JGH: Loaded 11062 primary data records. [2025-10-01T22:41:02.680120] [DEBUG] [LOCAL ] JHG: Loaded 47664 existing records from primary storage. [2025-10-01T22:41:02.685553] [INFO ] [MAIN ] JHG: Loaded 47664 primary data records. [2025-10-01T22:41:03.190849] [DEBUG] [MAIN ] JHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:03.192488] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3586 primary records. [2025-10-01T22:41:03.192789] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-01T22:41:03.206876] [DEBUG] [MAIN ] JGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:03.208311] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 11062 primary records. [2025-10-01T22:41:03.209908] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-01T22:41:03.240318] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-01T22:41:03.241103] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-01T22:41:03.244209] [INFO ] [MAIN ] Derivative Progress: 886/1587 symbols completed. JGH took 1.2s. Estimated remaining: 4m 53s. Rate: 143.8 symbols/min [2025-10-01T22:41:03.245072] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:03.246130] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-01T22:41:03.246530] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-01T22:41:03.249094] [INFO ] [MAIN ] Derivative Progress: 887/1587 symbols completed. JHI took 1.2s. Estimated remaining: 4m 52s. Rate: 143.9 symbols/min [2025-10-01T22:41:03.249516] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:03.257321] [DEBUG] [LOCAL ] JHS: Loaded 2826 existing records from primary storage. [2025-10-01T22:41:03.270241] [INFO ] [MAIN ] JHS: Loaded 2826 primary data records. [2025-10-01T22:41:03.292102] [DEBUG] [MAIN ] JHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:03.322665] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47664 primary records. [2025-10-01T22:41:03.363792] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-01T22:41:03.644777] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-01T22:41:03.646038] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-01T22:41:03.649086] [INFO ] [MAIN ] Derivative Progress: 888/1587 symbols completed. JHG took 1.6s. Estimated remaining: 4m 51s. Rate: 143.9 symbols/min [2025-10-01T22:41:03.649417] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:03.678238] [DEBUG] [LOCAL ] JHX: Loaded 51882 existing records from primary storage. [2025-10-01T22:41:03.678763] [INFO ] [MAIN ] JHX: Loaded 51882 primary data records. [2025-10-01T22:41:03.752871] [DEBUG] [LOCAL ] JILL: Loaded 16664 existing records from primary storage. [2025-10-01T22:41:03.778951] [INFO ] [MAIN ] JILL: Loaded 16664 primary data records. [2025-10-01T22:41:04.187457] [DEBUG] [MAIN ] JHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:04.199754] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2826 primary records. [2025-10-01T22:41:04.255859] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-01T22:41:04.402919] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-01T22:41:04.403064] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-01T22:41:04.405504] [INFO ] [MAIN ] Derivative Progress: 889/1587 symbols completed. JHS took 1.2s. Estimated remaining: 4m 51s. Rate: 143.8 symbols/min [2025-10-01T22:41:04.406410] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:04.432753] [DEBUG] [MAIN ] JHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:04.436809] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 51882 primary records. [2025-10-01T22:41:04.437077] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-01T22:41:04.451053] [DEBUG] [MAIN ] JILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:04.452295] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16664 primary records. [2025-10-01T22:41:04.452568] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-01T22:41:04.495794] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-01T22:41:04.496442] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-01T22:41:04.499391] [INFO ] [MAIN ] Derivative Progress: 890/1587 symbols completed. JILL took 0.8s. Estimated remaining: 4m 51s. Rate: 143.9 symbols/min [2025-10-01T22:41:04.501055] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:04.517913] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-01T22:41:04.519017] [DEBUG] [LOCAL ] JKS: Loaded 40094 existing records from primary storage. [2025-10-01T22:41:04.518112] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-01T22:41:04.521804] [INFO ] [MAIN ] JKS: Loaded 40094 primary data records. [2025-10-01T22:41:04.521708] [INFO ] [MAIN ] Derivative Progress: 891/1587 symbols completed. JHX took 1.3s. Estimated remaining: 4m 50s. Rate: 144.1 symbols/min [2025-10-01T22:41:04.522186] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:04.672401] [DEBUG] [LOCAL ] JLS: Loaded 4138 existing records from primary storage. [2025-10-01T22:41:04.673094] [INFO ] [MAIN ] JLS: Loaded 4138 primary data records. [2025-10-01T22:41:04.869090] [DEBUG] [LOCAL ] JLL: Loaded 31546 existing records from primary storage. [2025-10-01T22:41:04.956801] [INFO ] [MAIN ] JLL: Loaded 31546 primary data records. [2025-10-01T22:41:05.655785] [DEBUG] [MAIN ] JKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:05.656896] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40094 primary records. [2025-10-01T22:41:05.657092] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-01T22:41:05.675945] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-01T22:41:05.676443] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-01T22:41:05.679748] [INFO ] [MAIN ] Derivative Progress: 892/1587 symbols completed. JKS took 1.3s. Estimated remaining: 4m 50s. Rate: 143.8 symbols/min [2025-10-01T22:41:05.682006] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:05.696330] [DEBUG] [MAIN ] JLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:05.697127] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4138 primary records. [2025-10-01T22:41:05.697315] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-01T22:41:05.729043] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-01T22:41:05.729737] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-01T22:41:05.729639] [DEBUG] [MAIN ] JLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:05.733902] [INFO ] [MAIN ] Derivative Progress: 893/1587 symbols completed. JLS took 1.2s. Estimated remaining: 4m 49s. Rate: 143.9 symbols/min [2025-10-01T22:41:05.730633] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31546 primary records. [2025-10-01T22:41:05.734144] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-01T22:41:05.734718] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:05.752317] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-01T22:41:05.765564] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-01T22:41:05.768413] [INFO ] [MAIN ] Derivative Progress: 894/1587 symbols completed. JLL took 1.3s. Estimated remaining: 4m 49s. Rate: 144.1 symbols/min [2025-10-01T22:41:05.768821] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:05.791310] [DEBUG] [LOCAL ] JMIA: Loaded 50668 existing records from primary storage. [2025-10-01T22:41:05.791551] [INFO ] [MAIN ] JMIA: Loaded 50668 primary data records. [2025-10-01T22:41:06.168847] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-10-01T22:41:06.186432] [INFO ] [MAIN ] JOBY: Loaded 53799 primary data records. [2025-10-01T22:41:06.192883] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-01T22:41:06.237826] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-01T22:41:06.890167] [DEBUG] [MAIN ] JMIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:06.891835] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50668 primary records. [2025-10-01T22:41:06.891949] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-01T22:41:06.915825] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-01T22:41:06.916030] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-01T22:41:06.920671] [INFO ] [MAIN ] Derivative Progress: 895/1587 symbols completed. JMIA took 1.2s. Estimated remaining: 4m 49s. Rate: 143.8 symbols/min [2025-10-01T22:41:06.922109] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:06.940148] [DEBUG] [MAIN ] JOBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:06.941148] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53799 primary records. [2025-10-01T22:41:06.941357] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-01T22:41:06.985429] [DEBUG] [MAIN ] JNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:06.994891] [DEBUG] [LOCAL ] JOE: Loaded 24154 existing records from primary storage. [2025-10-01T22:41:06.994401] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-01T22:41:06.985885] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-01T22:41:06.995053] [INFO ] [MAIN ] JOE: Loaded 24154 primary data records. [2025-10-01T22:41:07.000464] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-01T22:41:07.002886] [INFO ] [MAIN ] Derivative Progress: 896/1587 symbols completed. JOBY took 1.2s. Estimated remaining: 4m 48s. Rate: 143.9 symbols/min [2025-10-01T22:41:07.032077] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:06.995262] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-01T22:41:07.153547] [DEBUG] [LOCAL ] JOF: Loaded 7000 existing records from primary storage. [2025-10-01T22:41:07.157248] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-01T22:41:07.157355] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-01T22:41:07.162547] [INFO ] [MAIN ] JOF: Loaded 7000 primary data records. [2025-10-01T22:41:07.200818] [INFO ] [MAIN ] Derivative Progress: 897/1587 symbols completed. JNJ took 1.5s. Estimated remaining: 4m 48s. Rate: 144.0 symbols/min [2025-10-01T22:41:07.226708] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:07.795545] [DEBUG] [LOCAL ] JPC: Loaded 37095 existing records from primary storage. [2025-10-01T22:41:07.796191] [INFO ] [MAIN ] JPC: Loaded 37095 primary data records. [2025-10-01T22:41:08.151611] [DEBUG] [MAIN ] JOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:08.152495] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24154 primary records. [2025-10-01T22:41:08.152813] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-01T22:41:08.195938] [DEBUG] [MAIN ] JOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:08.199208] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 7000 primary records. [2025-10-01T22:41:08.199477] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-01T22:41:08.199717] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-01T22:41:08.202355] [INFO ] [MAIN ] Derivative Progress: 898/1587 symbols completed. JOE took 1.3s. Estimated remaining: 4m 48s. Rate: 143.8 symbols/min [2025-10-01T22:41:08.199804] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-01T22:41:08.220216] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-01T22:41:08.220352] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-01T22:41:08.223031] [INFO ] [MAIN ] Derivative Progress: 899/1587 symbols completed. JOF took 1.2s. Estimated remaining: 4m 47s. Rate: 143.9 symbols/min [2025-10-01T22:41:08.246394] [DEBUG] [MAIN ] JPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:08.247212] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37095 primary records. [2025-10-01T22:41:08.247290] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-01T22:41:08.271295] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-01T22:41:08.271471] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-01T22:41:08.274416] [INFO ] [MAIN ] Derivative Progress: 900/1587 symbols completed. JPC took 1.0s. Estimated remaining: 4m 46s. Rate: 144.1 symbols/min [2025-10-01T22:41:08.275043] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:08.275169] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:08.275251] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:08.306301] [DEBUG] [LOCAL ] JRI: Loaded 14885 existing records from primary storage. [2025-10-01T22:41:08.306578] [INFO ] [MAIN ] JRI: Loaded 14885 primary data records. [2025-10-01T22:41:08.417339] [DEBUG] [LOCAL ] JQC: Loaded 34263 existing records from primary storage. [2025-10-01T22:41:08.439482] [INFO ] [MAIN ] JQC: Loaded 34263 primary data records. [2025-10-01T22:41:08.807038] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-01T22:41:08.807824] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-01T22:41:09.400872] [DEBUG] [MAIN ] JRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:09.403380] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 14885 primary records. [2025-10-01T22:41:09.405836] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-01T22:41:09.435908] [DEBUG] [MAIN ] JQC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:09.437388] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 34263 primary records. [2025-10-01T22:41:09.439027] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-01T22:41:09.441153] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-01T22:41:09.441350] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-01T22:41:09.443662] [INFO ] [MAIN ] Derivative Progress: 901/1587 symbols completed. JRI took 1.2s. Estimated remaining: 4m 46s. Rate: 143.8 symbols/min [2025-10-01T22:41:09.454158] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:09.472859] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-01T22:41:09.478110] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-01T22:41:09.481061] [INFO ] [MAIN ] Derivative Progress: 902/1587 symbols completed. JQC took 1.2s. Estimated remaining: 4m 46s. Rate: 143.9 symbols/min [2025-10-01T22:41:09.484353] [DEBUG] [MAIN ] JPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:09.485232] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-01T22:41:09.485384] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:09.485591] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-01T22:41:09.506368] [DEBUG] [LOCAL ] JRS: Loaded 11305 existing records from primary storage. [2025-10-01T22:41:09.508706] [INFO ] [MAIN ] JRS: Loaded 11305 primary data records. [2025-10-01T22:41:09.595189] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-01T22:41:09.614159] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-01T22:41:09.631518] [INFO ] [MAIN ] Derivative Progress: 903/1587 symbols completed. JPM took 1.4s. Estimated remaining: 4m 45s. Rate: 144.0 symbols/min [2025-10-01T22:41:09.632454] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:09.892269] [DEBUG] [LOCAL ] JXN: Loaded 45580 existing records from primary storage. [2025-10-01T22:41:09.892685] [INFO ] [MAIN ] JXN: Loaded 45580 primary data records. [2025-10-01T22:41:10.272572] [DEBUG] [LOCAL ] K: Loaded 49977 existing records from primary storage. [2025-10-01T22:41:10.272964] [INFO ] [MAIN ] K: Loaded 49977 primary data records. [2025-10-01T22:41:10.408175] [DEBUG] [MAIN ] JRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:10.423907] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11305 primary records. [2025-10-01T22:41:10.428663] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-01T22:41:10.479781] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-01T22:41:10.480138] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-01T22:41:10.508039] [INFO ] [MAIN ] Derivative Progress: 904/1587 symbols completed. JRS took 1.1s. Estimated remaining: 4m 45s. Rate: 143.8 symbols/min [2025-10-01T22:41:10.543747] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:10.697984] [DEBUG] [MAIN ] JXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:10.703828] [DEBUG] [LOCAL ] KAI: Loaded 13309 existing records from primary storage. [2025-10-01T22:41:10.705135] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 45580 primary records. [2025-10-01T22:41:10.704147] [INFO ] [MAIN ] KAI: Loaded 13309 primary data records. [2025-10-01T22:41:10.705340] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-01T22:41:10.827834] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-01T22:41:10.840081] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-01T22:41:10.848570] [INFO ] [MAIN ] Derivative Progress: 905/1587 symbols completed. JXN took 1.4s. Estimated remaining: 4m 44s. Rate: 143.9 symbols/min [2025-10-01T22:41:10.871696] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:11.081281] [DEBUG] [MAIN ] K: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:11.082146] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49977 primary records. [2025-10-01T22:41:11.082431] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-01T22:41:11.102813] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-01T22:41:11.103586] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-01T22:41:11.105974] [INFO ] [MAIN ] Derivative Progress: 906/1587 symbols completed. K took 1.5s. Estimated remaining: 4m 44s. Rate: 143.9 symbols/min [2025-10-01T22:41:11.117408] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:11.152632] [DEBUG] [LOCAL ] KAR: Loaded 39968 existing records from primary storage. [2025-10-01T22:41:11.151303] [DEBUG] [MAIN ] KAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:11.152887] [INFO ] [MAIN ] KAR: Loaded 39968 primary data records. [2025-10-01T22:41:11.158685] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13309 primary records. [2025-10-01T22:41:11.193928] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-01T22:41:11.257334] [DEBUG] [LOCAL ] KB: Loaded 23969 existing records from primary storage. [2025-10-01T22:41:11.282568] [INFO ] [MAIN ] KB: Loaded 23969 primary data records. [2025-10-01T22:41:11.282713] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-01T22:41:11.318193] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-01T22:41:11.341673] [INFO ] [MAIN ] Derivative Progress: 907/1587 symbols completed. KAI took 0.8s. Estimated remaining: 4m 43s. Rate: 144.0 symbols/min [2025-10-01T22:41:11.383967] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:11.935844] [DEBUG] [LOCAL ] KBDC: Loaded 21161 existing records from primary storage. [2025-10-01T22:41:11.937095] [INFO ] [MAIN ] KBDC: Loaded 21161 primary data records. [2025-10-01T22:41:12.282866] [DEBUG] [MAIN ] KAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:12.283853] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39968 primary records. [2025-10-01T22:41:12.283963] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-01T22:41:12.318427] [DEBUG] [MAIN ] KB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:12.320228] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23969 primary records. [2025-10-01T22:41:12.321553] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-01T22:41:12.322740] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-01T22:41:12.330810] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-01T22:41:12.338099] [INFO ] [MAIN ] Derivative Progress: 908/1587 symbols completed. KAR took 1.5s. Estimated remaining: 4m 43s. Rate: 143.8 symbols/min [2025-10-01T22:41:12.340193] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:12.345897] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-01T22:41:12.346105] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-01T22:41:12.348856] [INFO ] [MAIN ] Derivative Progress: 909/1587 symbols completed. KB took 1.2s. Estimated remaining: 4m 43s. Rate: 143.9 symbols/min [2025-10-01T22:41:12.349115] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:12.369114] [DEBUG] [MAIN ] KBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:12.370149] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 21161 primary records. [2025-10-01T22:41:12.370263] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-01T22:41:12.390067] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-01T22:41:12.390449] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-01T22:41:12.393854] [INFO ] [MAIN ] Derivative Progress: 910/1587 symbols completed. KBDC took 1.0s. Estimated remaining: 4m 42s. Rate: 144.1 symbols/min [2025-10-01T22:41:12.394156] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:12.456285] [DEBUG] [LOCAL ] KBR: Loaded 48025 existing records from primary storage. [2025-10-01T22:41:12.458158] [INFO ] [MAIN ] KBR: Loaded 48025 primary data records. [2025-10-01T22:41:12.457895] [DEBUG] [LOCAL ] KBH: Loaded 48894 existing records from primary storage. [2025-10-01T22:41:12.458356] [INFO ] [MAIN ] KBH: Loaded 48894 primary data records. [2025-10-01T22:41:12.766452] [DEBUG] [LOCAL ] KD: Loaded 52309 existing records from primary storage. [2025-10-01T22:41:12.853622] [INFO ] [MAIN ] KD: Loaded 52309 primary data records. [2025-10-01T22:41:13.515610] [DEBUG] [MAIN ] KBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:13.517005] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48894 primary records. [2025-10-01T22:41:13.517275] [DEBUG] [MAIN ] KBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:13.518843] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-01T22:41:13.518786] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48025 primary records. [2025-10-01T22:41:13.519790] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-01T22:41:13.549829] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-01T22:41:13.550437] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-01T22:41:13.553576] [INFO ] [MAIN ] Derivative Progress: 911/1587 symbols completed. KBR took 1.2s. Estimated remaining: 4m 42s. Rate: 143.8 symbols/min [2025-10-01T22:41:13.555166] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:13.556865] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-01T22:41:13.557997] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-01T22:41:13.562200] [INFO ] [MAIN ] Derivative Progress: 912/1587 symbols completed. KBH took 1.2s. Estimated remaining: 4m 41s. Rate: 144.0 symbols/min [2025-10-01T22:41:13.562466] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:13.580269] [DEBUG] [LOCAL ] KEN: Loaded 4732 existing records from primary storage. [2025-10-01T22:41:13.580717] [DEBUG] [MAIN ] KD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:13.581495] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52309 primary records. [2025-10-01T22:41:13.581600] [INFO ] [MAIN ] KEN: Loaded 4732 primary data records. [2025-10-01T22:41:13.581755] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-01T22:41:13.983423] [DEBUG] [LOCAL ] KEP: Loaded 31109 existing records from primary storage. [2025-10-01T22:41:13.984040] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-01T22:41:13.984236] [INFO ] [MAIN ] KEP: Loaded 31109 primary data records. [2025-10-01T22:41:13.984457] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-01T22:41:13.987084] [INFO ] [MAIN ] Derivative Progress: 913/1587 symbols completed. KD took 1.6s. Estimated remaining: 4m 41s. Rate: 144.0 symbols/min [2025-10-01T22:41:14.335045] [DEBUG] [MAIN ] KEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:14.336302] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4732 primary records. [2025-10-01T22:41:14.336424] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-01T22:41:14.353891] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-01T22:41:14.354194] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-01T22:41:14.356520] [INFO ] [MAIN ] Derivative Progress: 914/1587 symbols completed. KEN took 0.8s. Estimated remaining: 4m 40s. Rate: 144.0 symbols/min [2025-10-01T22:41:14.375480] [DEBUG] [MAIN ] KEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:14.376300] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 31109 primary records. [2025-10-01T22:41:14.376371] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-01T22:41:14.393421] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-01T22:41:14.393495] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-01T22:41:14.396281] [INFO ] [MAIN ] Derivative Progress: 915/1587 symbols completed. KEP took 0.8s. Estimated remaining: 4m 40s. Rate: 144.1 symbols/min [2025-10-01T22:41:14.396826] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:14.396777] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:14.396883] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:14.402385] [DEBUG] [LOCAL ] KF: Loaded 2447 existing records from primary storage. [2025-10-01T22:41:14.402537] [INFO ] [MAIN ] KF: Loaded 2447 primary data records. [2025-10-01T22:41:14.760598] [DEBUG] [LOCAL ] KEX: Loaded 38135 existing records from primary storage. [2025-10-01T22:41:14.771887] [INFO ] [MAIN ] KEX: Loaded 38135 primary data records. [2025-10-01T22:41:14.903631] [DEBUG] [LOCAL ] KEYS: Loaded 43152 existing records from primary storage. [2025-10-01T22:41:14.908260] [INFO ] [MAIN ] KEYS: Loaded 43152 primary data records. [2025-10-01T22:41:15.501627] [DEBUG] [MAIN ] KF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:15.503242] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2447 primary records. [2025-10-01T22:41:15.503482] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-01T22:41:15.524016] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-10-01T22:41:15.524149] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-01T22:41:15.527014] [INFO ] [MAIN ] Derivative Progress: 916/1587 symbols completed. KF took 1.1s. Estimated remaining: 4m 40s. Rate: 143.8 symbols/min [2025-10-01T22:41:15.527336] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:15.547923] [DEBUG] [MAIN ] KEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:15.548814] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38135 primary records. [2025-10-01T22:41:15.549044] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-01T22:41:15.573455] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-01T22:41:15.573731] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-01T22:41:15.576179] [INFO ] [MAIN ] Derivative Progress: 917/1587 symbols completed. KEX took 1.2s. Estimated remaining: 4m 39s. Rate: 144.0 symbols/min [2025-10-01T22:41:15.576345] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:15.587794] [DEBUG] [LOCAL ] KFRC: Loaded 19595 existing records from primary storage. [2025-10-01T22:41:15.588942] [INFO ] [MAIN ] KFRC: Loaded 19595 primary data records. [2025-10-01T22:41:15.659834] [DEBUG] [LOCAL ] KFS: Loaded 8478 existing records from primary storage. [2025-10-01T22:41:15.672906] [INFO ] [MAIN ] KFS: Loaded 8478 primary data records. [2025-10-01T22:41:15.682734] [DEBUG] [MAIN ] KEYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:15.694158] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43152 primary records. [2025-10-01T22:41:15.701341] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-01T22:41:16.340715] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-01T22:41:16.341239] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-01T22:41:16.344621] [INFO ] [MAIN ] Derivative Progress: 918/1587 symbols completed. KEYS took 1.9s. Estimated remaining: 4m 39s. Rate: 143.8 symbols/min [2025-10-01T22:41:16.345597] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:16.376249] [DEBUG] [MAIN ] KFRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:16.386883] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19595 primary records. [2025-10-01T22:41:16.400619] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-01T22:41:16.401613] [DEBUG] [MAIN ] KFS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:41:16.403112] [INFO ] [MAIN ] KFS: Generated 1793 derivative records from 8478 primary records. [2025-10-01T22:41:16.403283] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-01T22:41:16.426756] [DEBUG] [LOCAL ] KFY: Loaded 29999 existing records from primary storage. [2025-10-01T22:41:16.435695] [INFO ] [MAIN ] KFY: Loaded 29999 primary data records. [2025-10-01T22:41:16.440757] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-01T22:41:16.457055] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-01T22:41:16.474050] [INFO ] [MAIN ] Derivative Progress: 919/1587 symbols completed. KFRC took 0.9s. Estimated remaining: 4m 38s. Rate: 144.0 symbols/min [2025-10-01T22:41:16.471375] [DEBUG] [LOCAL ] KFS: Derivative data saved (1793 records). [2025-10-01T22:41:16.499786] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:16.522675] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-01T22:41:16.538954] [INFO ] [MAIN ] Derivative Progress: 920/1587 symbols completed. KFS took 1.0s. Estimated remaining: 4m 38s. Rate: 144.1 symbols/min [2025-10-01T22:41:16.557500] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:16.857697] [DEBUG] [LOCAL ] KGS: Loaded 45668 existing records from primary storage. [2025-10-01T22:41:16.873015] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-01T22:41:16.873207] [INFO ] [MAIN ] KGS: Loaded 45668 primary data records. [2025-10-01T22:41:16.873858] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-10-01T22:41:16.885458] [DEBUG] [MAIN ] KFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:16.936899] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 29999 primary records. [2025-10-01T22:41:16.979887] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-01T22:41:17.427841] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-01T22:41:17.428112] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-01T22:41:17.550475] [INFO ] [MAIN ] Derivative Progress: 921/1587 symbols completed. KFY took 1.2s. Estimated remaining: 4m 38s. Rate: 143.9 symbols/min [2025-10-01T22:41:17.561261] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:17.605410] [DEBUG] [MAIN ] KGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:17.611974] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45668 primary records. [2025-10-01T22:41:17.610992] [DEBUG] [MAIN ] KGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:17.612772] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-10-01T22:41:17.612127] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-01T22:41:17.612916] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-01T22:41:17.660876] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-01T22:41:17.661516] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-01T22:41:17.679054] [INFO ] [MAIN ] Derivative Progress: 922/1587 symbols completed. KGS took 1.1s. Estimated remaining: 4m 37s. Rate: 144.0 symbols/min [2025-10-01T22:41:17.681893] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-01T22:41:17.681784] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:17.682148] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-01T22:41:17.686859] [DEBUG] [LOCAL ] KIM: Loaded 53045 existing records from primary storage. [2025-10-01T22:41:17.685424] [INFO ] [MAIN ] Derivative Progress: 923/1587 symbols completed. KGC took 1.2s. Estimated remaining: 4m 36s. Rate: 144.1 symbols/min [2025-10-01T22:41:17.687222] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:17.687874] [INFO ] [MAIN ] KIM: Loaded 53045 primary data records. [2025-10-01T22:41:17.815062] [DEBUG] [LOCAL ] KIO: Loaded 21220 existing records from primary storage. [2025-10-01T22:41:17.826368] [INFO ] [MAIN ] KIO: Loaded 21220 primary data records. [2025-10-01T22:41:18.432835] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-01T22:41:18.433296] [INFO ] [MAIN ] KKR: Loaded 53500 primary data records. [2025-10-01T22:41:18.799005] [DEBUG] [MAIN ] KIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:18.800133] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53045 primary records. [2025-10-01T22:41:18.801243] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-01T22:41:18.822266] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-01T22:41:18.835396] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-01T22:41:18.838312] [INFO ] [MAIN ] Derivative Progress: 924/1587 symbols completed. KIM took 1.3s. Estimated remaining: 4m 37s. Rate: 143.9 symbols/min [2025-10-01T22:41:18.838808] [DEBUG] [MAIN ] KIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:18.839098] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:18.840097] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21220 primary records. [2025-10-01T22:41:18.840461] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-01T22:41:18.860747] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-01T22:41:18.860922] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-01T22:41:18.863279] [INFO ] [MAIN ] Derivative Progress: 925/1587 symbols completed. KIO took 1.2s. Estimated remaining: 4m 36s. Rate: 144.0 symbols/min [2025-10-01T22:41:18.864028] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:18.867762] [DEBUG] [LOCAL ] KKRS: Loaded 5710 existing records from primary storage. [2025-10-01T22:41:18.867985] [INFO ] [MAIN ] KKRS: Loaded 5710 primary data records. [2025-10-01T22:41:19.092890] [DEBUG] [MAIN ] KKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:19.236038] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53500 primary records. [2025-10-01T22:41:19.237435] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-01T22:41:19.237330] [DEBUG] [LOCAL ] KLC: Loaded 36723 existing records from primary storage. [2025-10-01T22:41:19.237615] [INFO ] [MAIN ] KLC: Loaded 36723 primary data records. [2025-10-01T22:41:19.375916] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-01T22:41:19.376137] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-01T22:41:19.384843] [INFO ] [MAIN ] Derivative Progress: 926/1587 symbols completed. KKR took 1.7s. Estimated remaining: 4m 35s. Rate: 144.0 symbols/min [2025-10-01T22:41:19.412229] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:19.636742] [DEBUG] [MAIN ] KKRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:19.638261] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5710 primary records. [2025-10-01T22:41:19.638375] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-01T22:41:19.660309] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-01T22:41:19.660825] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-01T22:41:19.663479] [INFO ] [MAIN ] Derivative Progress: 927/1587 symbols completed. KKRS took 0.8s. Estimated remaining: 4m 35s. Rate: 144.0 symbols/min [2025-10-01T22:41:19.663747] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:19.702030] [DEBUG] [LOCAL ] KMPB: Loaded 3780 existing records from primary storage. [2025-10-01T22:41:19.699495] [DEBUG] [MAIN ] KLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:19.702882] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36723 primary records. [2025-10-01T22:41:19.702945] [INFO ] [MAIN ] KMPB: Loaded 3780 primary data records. [2025-10-01T22:41:19.708247] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-01T22:41:19.864308] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-01T22:41:19.871026] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-01T22:41:19.904448] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-01T22:41:19.969559] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-01T22:41:20.054095] [INFO ] [MAIN ] Derivative Progress: 928/1587 symbols completed. KLC took 1.2s. Estimated remaining: 4m 35s. Rate: 144.0 symbols/min [2025-10-01T22:41:20.540744] [DEBUG] [MAIN ] KMPB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:41:20.541601] [INFO ] [MAIN ] KMPB: Generated 1793 derivative records from 3780 primary records. [2025-10-01T22:41:20.541888] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-01T22:41:20.557349] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1793 records). [2025-10-01T22:41:20.557572] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-01T22:41:20.559965] [INFO ] [MAIN ] Derivative Progress: 929/1587 symbols completed. KMPB took 0.9s. Estimated remaining: 4m 34s. Rate: 144.0 symbols/min [2025-10-01T22:41:20.577088] [DEBUG] [MAIN ] KMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:20.577896] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-01T22:41:20.578026] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-01T22:41:20.595006] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-01T22:41:20.595148] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-01T22:41:20.597877] [INFO ] [MAIN ] Derivative Progress: 930/1587 symbols completed. KMI took 1.2s. Estimated remaining: 4m 34s. Rate: 144.1 symbols/min [2025-10-01T22:41:20.598556] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:20.598825] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:20.598935] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:20.683392] [DEBUG] [LOCAL ] KMPR: Loaded 38886 existing records from primary storage. [2025-10-01T22:41:20.685482] [DEBUG] [LOCAL ] KMX: Loaded 53161 existing records from primary storage. [2025-10-01T22:41:20.684204] [INFO ] [MAIN ] KMPR: Loaded 38886 primary data records. [2025-10-01T22:41:20.698529] [INFO ] [MAIN ] KMX: Loaded 53161 primary data records. [2025-10-01T22:41:20.724131] [DEBUG] [LOCAL ] KMT: Loaded 42939 existing records from primary storage. [2025-10-01T22:41:20.729351] [INFO ] [MAIN ] KMT: Loaded 42939 primary data records. [2025-10-01T22:41:21.759606] [DEBUG] [MAIN ] KMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:21.774244] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53161 primary records. [2025-10-01T22:41:21.774934] [DEBUG] [MAIN ] KMPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:21.776438] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-01T22:41:21.776287] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 38886 primary records. [2025-10-01T22:41:21.776600] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-01T22:41:21.821792] [DEBUG] [MAIN ] KMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:21.823530] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42939 primary records. [2025-10-01T22:41:21.824310] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-01T22:41:21.825803] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-01T22:41:21.825914] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-01T22:41:21.828857] [INFO ] [MAIN ] Derivative Progress: 931/1587 symbols completed. KMX took 1.2s. Estimated remaining: 4m 34s. Rate: 143.8 symbols/min [2025-10-01T22:41:21.829540] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:21.839904] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-01T22:41:21.844625] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-01T22:41:21.847198] [INFO ] [MAIN ] Derivative Progress: 932/1587 symbols completed. KMPR took 1.2s. Estimated remaining: 4m 33s. Rate: 144.0 symbols/min [2025-10-01T22:41:21.847419] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:21.851878] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-01T22:41:21.851952] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-01T22:41:21.854921] [INFO ] [MAIN ] Derivative Progress: 933/1587 symbols completed. KMT took 1.3s. Estimated remaining: 4m 32s. Rate: 144.1 symbols/min [2025-10-01T22:41:21.855117] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:21.868047] [DEBUG] [LOCAL ] KNOP: Loaded 10442 existing records from primary storage. [2025-10-01T22:41:21.868210] [INFO ] [MAIN ] KNOP: Loaded 10442 primary data records. [2025-10-01T22:41:22.051662] [DEBUG] [LOCAL ] KNF: Loaded 35852 existing records from primary storage. [2025-10-01T22:41:22.119114] [INFO ] [MAIN ] KNF: Loaded 35852 primary data records. [2025-10-01T22:41:22.157925] [DEBUG] [LOCAL ] KN: Loaded 38555 existing records from primary storage. [2025-10-01T22:41:22.158159] [INFO ] [MAIN ] KN: Loaded 38555 primary data records. [2025-10-01T22:41:22.975777] [DEBUG] [MAIN ] KNOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:22.977248] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10442 primary records. [2025-10-01T22:41:22.977665] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-01T22:41:22.996272] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-01T22:41:22.996756] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-01T22:41:22.999151] [INFO ] [MAIN ] Derivative Progress: 934/1587 symbols completed. KNOP took 1.1s. Estimated remaining: 4m 32s. Rate: 143.9 symbols/min [2025-10-01T22:41:22.999501] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:23.027145] [DEBUG] [MAIN ] KNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:23.041328] [DEBUG] [MAIN ] KN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:23.041008] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35852 primary records. [2025-10-01T22:41:23.042075] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38555 primary records. [2025-10-01T22:41:23.042177] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-01T22:41:23.049988] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-01T22:41:23.050441] [DEBUG] [LOCAL ] KNSL: Loaded 18181 existing records from primary storage. [2025-10-01T22:41:23.059436] [INFO ] [MAIN ] KNSL: Loaded 18181 primary data records. [2025-10-01T22:41:23.177892] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-01T22:41:23.183139] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-01T22:41:23.177823] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-01T22:41:23.206282] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-01T22:41:23.208563] [INFO ] [MAIN ] Derivative Progress: 935/1587 symbols completed. KN took 1.4s. Estimated remaining: 4m 32s. Rate: 143.9 symbols/min [2025-10-01T22:41:23.221423] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:23.226675] [INFO ] [MAIN ] Derivative Progress: 936/1587 symbols completed. KNF took 1.4s. Estimated remaining: 4m 31s. Rate: 144.1 symbols/min [2025-10-01T22:41:23.242902] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:23.469926] [DEBUG] [MAIN ] KNSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:23.471438] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18181 primary records. [2025-10-01T22:41:23.471700] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-01T22:41:23.511544] [DEBUG] [LOCAL ] KNTK: Loaded 46161 existing records from primary storage. [2025-10-01T22:41:23.513312] [INFO ] [MAIN ] KNTK: Loaded 46161 primary data records. [2025-10-01T22:41:23.553088] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-01T22:41:23.606400] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-01T22:41:23.651900] [INFO ] [MAIN ] Derivative Progress: 937/1587 symbols completed. KNSL took 0.7s. Estimated remaining: 4m 31s. Rate: 144.1 symbols/min [2025-10-01T22:41:23.657586] [DEBUG] [LOCAL ] KNX: Loaded 52589 existing records from primary storage. [2025-10-01T22:41:23.657899] [INFO ] [MAIN ] KNX: Loaded 52589 primary data records. [2025-10-01T22:41:23.663701] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:24.236922] [DEBUG] [LOCAL ] KODK: Loaded 43459 existing records from primary storage. [2025-10-01T22:41:24.237574] [INFO ] [MAIN ] KODK: Loaded 43459 primary data records. [2025-10-01T22:41:24.391696] [DEBUG] [MAIN ] KNTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:24.409007] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46161 primary records. [2025-10-01T22:41:24.460262] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-01T22:41:24.631147] [DEBUG] [MAIN ] KNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:24.632243] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52589 primary records. [2025-10-01T22:41:24.633515] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-01T22:41:24.637127] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-01T22:41:24.637266] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-01T22:41:24.639695] [INFO ] [MAIN ] Derivative Progress: 938/1587 symbols completed. KNTK took 1.4s. Estimated remaining: 4m 31s. Rate: 143.9 symbols/min [2025-10-01T22:41:24.649686] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:24.661334] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-01T22:41:24.661620] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-01T22:41:24.664532] [INFO ] [MAIN ] Derivative Progress: 939/1587 symbols completed. KNX took 1.4s. Estimated remaining: 4m 30s. Rate: 144.0 symbols/min [2025-10-01T22:41:24.665081] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:24.691897] [DEBUG] [MAIN ] KODK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:24.693027] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43459 primary records. [2025-10-01T22:41:24.693195] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-01T22:41:24.720289] [DEBUG] [LOCAL ] KOF: Loaded 26133 existing records from primary storage. [2025-10-01T22:41:24.727134] [INFO ] [MAIN ] KOF: Loaded 26133 primary data records. [2025-10-01T22:41:24.729581] [DEBUG] [LOCAL ] KOP: Loaded 17610 existing records from primary storage. [2025-10-01T22:41:24.735180] [INFO ] [MAIN ] KOP: Loaded 17610 primary data records. [2025-10-01T22:41:24.837405] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-01T22:41:24.878934] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-01T22:41:24.931059] [INFO ] [MAIN ] Derivative Progress: 940/1587 symbols completed. KODK took 1.3s. Estimated remaining: 4m 29s. Rate: 144.1 symbols/min [2025-10-01T22:41:24.960769] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:25.525038] [DEBUG] [LOCAL ] KOS: Loaded 53059 existing records from primary storage. [2025-10-01T22:41:25.527124] [INFO ] [MAIN ] KOS: Loaded 53059 primary data records. [2025-10-01T22:41:25.526920] [DEBUG] [MAIN ] KOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:25.529458] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26133 primary records. [2025-10-01T22:41:25.569465] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-01T22:41:25.667842] [DEBUG] [MAIN ] KOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:25.697419] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17610 primary records. [2025-10-01T22:41:25.709108] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-01T22:41:25.790785] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-01T22:41:25.797900] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-01T22:41:25.799337] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-01T22:41:25.929811] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-01T22:41:25.937801] [INFO ] [MAIN ] Derivative Progress: 941/1587 symbols completed. KOP took 1.3s. Estimated remaining: 4m 29s. Rate: 143.8 symbols/min [2025-10-01T22:41:25.956633] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:25.956740] [INFO ] [MAIN ] Derivative Progress: 942/1587 symbols completed. KOF took 1.3s. Estimated remaining: 4m 29s. Rate: 144.0 symbols/min [2025-10-01T22:41:25.957317] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:26.043058] [DEBUG] [MAIN ] KOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:26.043855] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53059 primary records. [2025-10-01T22:41:26.043941] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-01T22:41:26.092049] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-01T22:41:26.092306] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-01T22:41:26.111825] [INFO ] [MAIN ] Derivative Progress: 943/1587 symbols completed. KOS took 1.2s. Estimated remaining: 4m 28s. Rate: 144.1 symbols/min [2025-10-01T22:41:26.107846] [DEBUG] [LOCAL ] KRC: Loaded 48262 existing records from primary storage. [2025-10-01T22:41:26.113591] [INFO ] [MAIN ] KRC: Loaded 48262 primary data records. [2025-10-01T22:41:26.114462] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-01T22:41:26.114552] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-01T22:41:26.878584] [DEBUG] [MAIN ] KR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:26.879778] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-01T22:41:26.879917] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-01T22:41:26.897878] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-01T22:41:26.899094] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-01T22:41:26.901200] [INFO ] [MAIN ] Derivative Progress: 944/1587 symbols completed. KR took 0.9s. Estimated remaining: 4m 28s. Rate: 144.0 symbols/min [2025-10-01T22:41:26.916800] [DEBUG] [MAIN ] KRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:26.917589] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48262 primary records. [2025-10-01T22:41:26.917683] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-01T22:41:26.939137] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-01T22:41:26.939295] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-01T22:41:26.941756] [INFO ] [MAIN ] Derivative Progress: 945/1587 symbols completed. KRC took 1.0s. Estimated remaining: 4m 27s. Rate: 144.1 symbols/min [2025-10-01T22:41:26.942419] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:26.942517] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:26.943259] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:26.992814] [DEBUG] [LOCAL ] KRO: Loaded 26074 existing records from primary storage. [2025-10-01T22:41:26.993066] [INFO ] [MAIN ] KRO: Loaded 26074 primary data records. [2025-10-01T22:41:27.161095] [DEBUG] [LOCAL ] KRG: Loaded 49159 existing records from primary storage. [2025-10-01T22:41:27.177320] [INFO ] [MAIN ] KRG: Loaded 49159 primary data records. [2025-10-01T22:41:27.206959] [DEBUG] [LOCAL ] KREF: Loaded 37580 existing records from primary storage. [2025-10-01T22:41:27.247075] [INFO ] [MAIN ] KREF: Loaded 37580 primary data records. [2025-10-01T22:41:28.122779] [DEBUG] [MAIN ] KRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:28.124249] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26074 primary records. [2025-10-01T22:41:28.124476] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-01T22:41:28.143426] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-01T22:41:28.144339] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-01T22:41:28.146302] [INFO ] [MAIN ] Derivative Progress: 946/1587 symbols completed. KRO took 1.2s. Estimated remaining: 4m 27s. Rate: 143.8 symbols/min [2025-10-01T22:41:28.147010] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:28.167925] [DEBUG] [MAIN ] KRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:28.168893] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49159 primary records. [2025-10-01T22:41:28.169143] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-01T22:41:28.203836] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-01T22:41:28.204246] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-01T22:41:28.204130] [DEBUG] [MAIN ] KREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:28.206472] [INFO ] [MAIN ] Derivative Progress: 947/1587 symbols completed. KRG took 1.3s. Estimated remaining: 4m 27s. Rate: 143.9 symbols/min [2025-10-01T22:41:28.207470] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37580 primary records. [2025-10-01T22:41:28.207830] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:28.207725] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-01T22:41:28.235031] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-01T22:41:28.246295] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-01T22:41:28.249610] [INFO ] [MAIN ] Derivative Progress: 948/1587 symbols completed. KREF took 1.3s. Estimated remaining: 4m 26s. Rate: 144.1 symbols/min [2025-10-01T22:41:28.250997] [DEBUG] [LOCAL ] KRP: Loaded 37049 existing records from primary storage. [2025-10-01T22:41:28.251271] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:28.251184] [INFO ] [MAIN ] KRP: Loaded 37049 primary data records. [2025-10-01T22:41:28.633959] [DEBUG] [LOCAL ] KSS: Loaded 53603 existing records from primary storage. [2025-10-01T22:41:28.634365] [INFO ] [MAIN ] KSS: Loaded 53603 primary data records. [2025-10-01T22:41:28.757514] [DEBUG] [LOCAL ] KT: Loaded 45686 existing records from primary storage. [2025-10-01T22:41:28.766548] [INFO ] [MAIN ] KT: Loaded 45686 primary data records. [2025-10-01T22:41:29.408007] [DEBUG] [MAIN ] KRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:29.410719] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 37049 primary records. [2025-10-01T22:41:29.412556] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-01T22:41:29.432427] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-01T22:41:29.432778] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-01T22:41:29.435863] [INFO ] [MAIN ] Derivative Progress: 949/1587 symbols completed. KRP took 1.3s. Estimated remaining: 4m 26s. Rate: 143.8 symbols/min [2025-10-01T22:41:29.437292] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:29.459774] [DEBUG] [MAIN ] KSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:29.461734] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53603 primary records. [2025-10-01T22:41:29.462793] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-01T22:41:29.496827] [DEBUG] [MAIN ] KT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:29.497593] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45686 primary records. [2025-10-01T22:41:29.496457] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-01T22:41:29.497974] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-01T22:41:29.497906] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-01T22:41:29.501600] [INFO ] [MAIN ] Derivative Progress: 950/1587 symbols completed. KSS took 1.3s. Estimated remaining: 4m 26s. Rate: 143.9 symbols/min [2025-10-01T22:41:29.510993] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:29.528972] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-01T22:41:29.529104] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-01T22:41:29.531453] [INFO ] [MAIN ] Derivative Progress: 951/1587 symbols completed. KT took 1.3s. Estimated remaining: 4m 25s. Rate: 144.1 symbols/min [2025-10-01T22:41:29.531729] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:29.543163] [DEBUG] [LOCAL ] KTF: Loaded 12567 existing records from primary storage. [2025-10-01T22:41:29.543352] [INFO ] [MAIN ] KTF: Loaded 12567 primary data records. [2025-10-01T22:41:29.620307] [DEBUG] [LOCAL ] KTB: Loaded 41046 existing records from primary storage. [2025-10-01T22:41:29.631918] [INFO ] [MAIN ] KTB: Loaded 41046 primary data records. [2025-10-01T22:41:30.269628] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-01T22:41:30.271295] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-01T22:41:30.632985] [DEBUG] [MAIN ] KTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:30.634344] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 12567 primary records. [2025-10-01T22:41:30.637025] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-01T22:41:30.666741] [DEBUG] [MAIN ] KTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:30.670088] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41046 primary records. [2025-10-01T22:41:30.670638] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-01T22:41:30.670525] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-01T22:41:30.671813] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-01T22:41:30.683518] [INFO ] [MAIN ] Derivative Progress: 952/1587 symbols completed. KTF took 1.2s. Estimated remaining: 4m 25s. Rate: 143.8 symbols/min [2025-10-01T22:41:30.686782] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:30.693922] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-01T22:41:30.696243] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-01T22:41:30.698511] [INFO ] [MAIN ] Derivative Progress: 953/1587 symbols completed. KTB took 1.3s. Estimated remaining: 4m 24s. Rate: 143.9 symbols/min [2025-10-01T22:41:30.698914] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:30.715429] [DEBUG] [MAIN ] KVUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:30.716257] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-01T22:41:30.716322] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-01T22:41:30.745561] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-01T22:41:30.745777] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-01T22:41:30.748424] [INFO ] [MAIN ] Derivative Progress: 954/1587 symbols completed. KVUE took 1.2s. Estimated remaining: 4m 24s. Rate: 144.1 symbols/min [2025-10-01T22:41:30.748767] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:30.777356] [DEBUG] [LOCAL ] KVYO: Loaded 50071 existing records from primary storage. [2025-10-01T22:41:30.789594] [INFO ] [MAIN ] KVYO: Loaded 50071 primary data records. [2025-10-01T22:41:30.790386] [DEBUG] [LOCAL ] KW: Loaded 40529 existing records from primary storage. [2025-10-01T22:41:30.800044] [INFO ] [MAIN ] KW: Loaded 40529 primary data records. [2025-10-01T22:41:31.004802] [DEBUG] [LOCAL ] KWR: Loaded 16535 existing records from primary storage. [2025-10-01T22:41:31.041962] [INFO ] [MAIN ] KWR: Loaded 16535 primary data records. [2025-10-01T22:41:31.910751] [DEBUG] [MAIN ] KW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:31.917282] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40529 primary records. [2025-10-01T22:41:31.917536] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-01T22:41:31.916309] [DEBUG] [MAIN ] KVYO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:31.918720] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 50071 primary records. [2025-10-01T22:41:31.919674] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-01T22:41:31.968247] [DEBUG] [MAIN ] KWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:31.968626] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-01T22:41:31.971174] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-10-01T22:41:31.970694] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16535 primary records. [2025-10-01T22:41:31.969930] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-01T22:41:31.971374] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-01T22:41:31.973793] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-01T22:41:31.973563] [INFO ] [MAIN ] Derivative Progress: 955/1587 symbols completed. KW took 1.3s. Estimated remaining: 4m 24s. Rate: 143.8 symbols/min [2025-10-01T22:41:31.976173] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:31.976334] [INFO ] [MAIN ] Derivative Progress: 956/1587 symbols completed. KVYO took 1.3s. Estimated remaining: 4m 23s. Rate: 143.9 symbols/min [2025-10-01T22:41:31.976926] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:31.998720] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-01T22:41:31.999609] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-01T22:41:32.002422] [INFO ] [MAIN ] Derivative Progress: 957/1587 symbols completed. KWR took 1.3s. Estimated remaining: 4m 22s. Rate: 144.1 symbols/min [2025-10-01T22:41:32.002741] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:32.029132] [DEBUG] [LOCAL ] KYN: Loaded 30010 existing records from primary storage. [2025-10-01T22:41:32.029358] [INFO ] [MAIN ] KYN: Loaded 30010 primary data records. [2025-10-01T22:41:32.204547] [DEBUG] [LOCAL ] L: Loaded 40991 existing records from primary storage. [2025-10-01T22:41:32.249964] [INFO ] [MAIN ] L: Loaded 40991 primary data records. [2025-10-01T22:41:32.447269] [DEBUG] [LOCAL ] LAC: Loaded 52362 existing records from primary storage. [2025-10-01T22:41:32.458117] [INFO ] [MAIN ] LAC: Loaded 52362 primary data records. [2025-10-01T22:41:33.210537] [DEBUG] [MAIN ] KYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:33.212076] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30010 primary records. [2025-10-01T22:41:33.212268] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-01T22:41:33.234975] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-01T22:41:33.235727] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-01T22:41:33.238361] [INFO ] [MAIN ] Derivative Progress: 958/1587 symbols completed. KYN took 1.3s. Estimated remaining: 4m 22s. Rate: 143.8 symbols/min [2025-10-01T22:41:33.261163] [DEBUG] [MAIN ] LAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:33.267553] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52362 primary records. [2025-10-01T22:41:33.278441] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-01T22:41:33.280103] [DEBUG] [MAIN ] L: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:33.281333] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40991 primary records. [2025-10-01T22:41:33.281601] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-01T22:41:33.318627] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-01T22:41:33.319232] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-01T22:41:33.321671] [INFO ] [MAIN ] Derivative Progress: 959/1587 symbols completed. LAC took 1.3s. Estimated remaining: 4m 22s. Rate: 143.9 symbols/min [2025-10-01T22:41:33.322452] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-10-01T22:41:33.322774] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-01T22:41:33.325435] [INFO ] [MAIN ] Derivative Progress: 960/1587 symbols completed. L took 1.3s. Estimated remaining: 4m 21s. Rate: 144.0 symbols/min [2025-10-01T22:41:33.326091] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:33.326013] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:33.325910] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:33.333505] [DEBUG] [LOCAL ] LANV: Loaded 2826 existing records from primary storage. [2025-10-01T22:41:33.333713] [INFO ] [MAIN ] LANV: Loaded 2826 primary data records. [2025-10-01T22:41:33.486115] [DEBUG] [LOCAL ] LAD: Loaded 23471 existing records from primary storage. [2025-10-01T22:41:33.502225] [INFO ] [MAIN ] LAD: Loaded 23471 primary data records. [2025-10-01T22:41:33.771571] [DEBUG] [LOCAL ] LADR: Loaded 38885 existing records from primary storage. [2025-10-01T22:41:33.777812] [INFO ] [MAIN ] LADR: Loaded 38885 primary data records. [2025-10-01T22:41:34.477554] [DEBUG] [MAIN ] LANV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:34.478830] [INFO ] [MAIN ] LANV: Generated 1794 derivative records from 2826 primary records. [2025-10-01T22:41:34.480814] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-01T22:41:34.500242] [DEBUG] [LOCAL ] LANV: Derivative data saved (1794 records). [2025-10-01T22:41:34.500438] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-01T22:41:34.502873] [INFO ] [MAIN ] Derivative Progress: 961/1587 symbols completed. LANV took 1.2s. Estimated remaining: 4m 21s. Rate: 143.8 symbols/min [2025-10-01T22:41:34.503550] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:34.531277] [DEBUG] [MAIN ] LAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:34.532586] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23471 primary records. [2025-10-01T22:41:34.544737] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-01T22:41:34.551765] [DEBUG] [MAIN ] LADR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:34.552966] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38885 primary records. [2025-10-01T22:41:34.570355] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-01T22:41:34.570923] [DEBUG] [LOCAL ] LAW: Loaded 14021 existing records from primary storage. [2025-10-01T22:41:34.574873] [INFO ] [MAIN ] LAW: Loaded 14021 primary data records. [2025-10-01T22:41:34.695350] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-10-01T22:41:34.713690] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-01T22:41:34.733454] [INFO ] [MAIN ] Derivative Progress: 962/1587 symbols completed. LAD took 1.4s. Estimated remaining: 4m 21s. Rate: 143.8 symbols/min [2025-10-01T22:41:34.745060] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-01T22:41:34.745214] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:34.745418] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-01T22:41:34.807118] [INFO ] [MAIN ] Derivative Progress: 963/1587 symbols completed. LADR took 1.5s. Estimated remaining: 4m 20s. Rate: 144.0 symbols/min [2025-10-01T22:41:34.930192] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:34.994956] [DEBUG] [MAIN ] LAW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:34.996224] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14021 primary records. [2025-10-01T22:41:34.996354] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-01T22:41:35.020505] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-01T22:41:35.020823] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-01T22:41:35.037454] [INFO ] [MAIN ] Derivative Progress: 964/1587 symbols completed. LAW took 0.5s. Estimated remaining: 4m 20s. Rate: 144.0 symbols/min [2025-10-01T22:41:35.056156] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:35.057633] [DEBUG] [LOCAL ] LAZ: Loaded 44922 existing records from primary storage. [2025-10-01T22:41:35.058789] [INFO ] [MAIN ] LAZ: Loaded 44922 primary data records. [2025-10-01T22:41:35.058302] [DEBUG] [LOCAL ] LB: Loaded 37751 existing records from primary storage. [2025-10-01T22:41:35.064288] [INFO ] [MAIN ] LB: Loaded 37751 primary data records. [2025-10-01T22:41:35.795561] [DEBUG] [LOCAL ] LBRT: Loaded 52912 existing records from primary storage. [2025-10-01T22:41:35.797360] [INFO ] [MAIN ] LBRT: Loaded 52912 primary data records. [2025-10-01T22:41:36.216612] [DEBUG] [MAIN ] LAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:36.216060] [DEBUG] [MAIN ] LB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:36.217733] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37751 primary records. [2025-10-01T22:41:36.218236] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-01T22:41:36.219058] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44922 primary records. [2025-10-01T22:41:36.220051] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-01T22:41:36.254621] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-01T22:41:36.255504] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-01T22:41:36.257813] [INFO ] [MAIN ] Derivative Progress: 965/1587 symbols completed. LAZ took 1.5s. Estimated remaining: 4m 20s. Rate: 143.7 symbols/min [2025-10-01T22:41:36.258844] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-01T22:41:36.258153] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:36.259016] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-01T22:41:36.261007] [INFO ] [MAIN ] Derivative Progress: 966/1587 symbols completed. LB took 1.3s. Estimated remaining: 4m 19s. Rate: 143.9 symbols/min [2025-10-01T22:41:36.261172] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:36.279333] [DEBUG] [MAIN ] LBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:36.280260] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52912 primary records. [2025-10-01T22:41:36.280353] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-01T22:41:36.309177] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-01T22:41:36.309445] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-01T22:41:36.312005] [INFO ] [MAIN ] Derivative Progress: 967/1587 symbols completed. LBRT took 1.3s. Estimated remaining: 4m 18s. Rate: 144.0 symbols/min [2025-10-01T22:41:36.312269] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:36.323009] [DEBUG] [LOCAL ] LCII: Loaded 28050 existing records from primary storage. [2025-10-01T22:41:36.333088] [INFO ] [MAIN ] LCII: Loaded 28050 primary data records. [2025-10-01T22:41:36.464555] [DEBUG] [LOCAL ] LC: Loaded 47835 existing records from primary storage. [2025-10-01T22:41:36.470675] [INFO ] [MAIN ] LC: Loaded 47835 primary data records. [2025-10-01T22:41:36.860610] [DEBUG] [LOCAL ] LDI: Loaded 44137 existing records from primary storage. [2025-10-01T22:41:36.928438] [INFO ] [MAIN ] LDI: Loaded 44137 primary data records. [2025-10-01T22:41:37.422605] [DEBUG] [MAIN ] LCII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:37.424316] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28050 primary records. [2025-10-01T22:41:37.424792] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-01T22:41:37.448130] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-10-01T22:41:37.461175] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-01T22:41:37.461703] [DEBUG] [MAIN ] LC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:37.464386] [INFO ] [MAIN ] Derivative Progress: 968/1587 symbols completed. LCII took 1.2s. Estimated remaining: 4m 18s. Rate: 143.8 symbols/min [2025-10-01T22:41:37.465317] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47835 primary records. [2025-10-01T22:41:37.465571] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-01T22:41:37.465698] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:37.486719] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-01T22:41:37.488042] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-01T22:41:37.490865] [INFO ] [MAIN ] Derivative Progress: 969/1587 symbols completed. LC took 1.2s. Estimated remaining: 4m 18s. Rate: 143.9 symbols/min [2025-10-01T22:41:37.491104] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:37.507830] [DEBUG] [MAIN ] LDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:37.508687] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44137 primary records. [2025-10-01T22:41:37.508867] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-01T22:41:37.535416] [DEBUG] [LOCAL ] LDP: Loaded 12928 existing records from primary storage. [2025-10-01T22:41:37.536471] [INFO ] [MAIN ] LDP: Loaded 12928 primary data records. [2025-10-01T22:41:37.542276] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-01T22:41:37.561046] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-01T22:41:37.586610] [INFO ] [MAIN ] Derivative Progress: 970/1587 symbols completed. LDI took 1.3s. Estimated remaining: 4m 17s. Rate: 144.0 symbols/min [2025-10-01T22:41:37.606519] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:37.716069] [DEBUG] [LOCAL ] LDOS: Loaded 45597 existing records from primary storage. [2025-10-01T22:41:37.749045] [INFO ] [MAIN ] LDOS: Loaded 45597 primary data records. [2025-10-01T22:41:38.069629] [DEBUG] [LOCAL ] LEA: Loaded 41746 existing records from primary storage. [2025-10-01T22:41:38.075431] [INFO ] [MAIN ] LEA: Loaded 41746 primary data records. [2025-10-01T22:41:38.671344] [DEBUG] [MAIN ] LDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:38.672974] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12928 primary records. [2025-10-01T22:41:38.673550] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-01T22:41:38.696315] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-01T22:41:38.696624] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-01T22:41:38.699085] [INFO ] [MAIN ] Derivative Progress: 971/1587 symbols completed. LDP took 1.2s. Estimated remaining: 4m 17s. Rate: 143.8 symbols/min [2025-10-01T22:41:38.707039] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:38.713349] [DEBUG] [MAIN ] LDOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:38.714363] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45597 primary records. [2025-10-01T22:41:38.714755] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-01T22:41:38.734343] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-01T22:41:38.736345] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-01T22:41:38.738887] [INFO ] [MAIN ] Derivative Progress: 972/1587 symbols completed. LDOS took 1.3s. Estimated remaining: 4m 16s. Rate: 143.9 symbols/min [2025-10-01T22:41:38.739166] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:38.753955] [DEBUG] [MAIN ] LEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:38.754910] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41746 primary records. [2025-10-01T22:41:38.755127] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-01T22:41:38.772836] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-01T22:41:38.772987] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-01T22:41:38.775797] [INFO ] [MAIN ] Derivative Progress: 973/1587 symbols completed. LEA took 1.2s. Estimated remaining: 4m 16s. Rate: 144.0 symbols/min [2025-10-01T22:41:38.812828] [DEBUG] [LOCAL ] LEG: Loaded 50265 existing records from primary storage. [2025-10-01T22:41:38.812986] [INFO ] [MAIN ] LEG: Loaded 50265 primary data records. [2025-10-01T22:41:38.988888] [DEBUG] [LOCAL ] LEN: Loaded 53177 existing records from primary storage. [2025-10-01T22:41:38.999317] [INFO ] [MAIN ] LEN: Loaded 53177 primary data records. [2025-10-01T22:41:39.551228] [DEBUG] [MAIN ] LEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:39.552094] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50265 primary records. [2025-10-01T22:41:39.552299] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-01T22:41:39.570620] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-01T22:41:39.572091] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-01T22:41:39.574458] [INFO ] [MAIN ] Derivative Progress: 974/1587 symbols completed. LEG took 0.9s. Estimated remaining: 4m 16s. Rate: 143.9 symbols/min [2025-10-01T22:41:39.588210] [DEBUG] [MAIN ] LEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:39.588964] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53177 primary records. [2025-10-01T22:41:39.589034] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-01T22:41:39.606205] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-01T22:41:39.606419] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-01T22:41:39.609137] [INFO ] [MAIN ] Derivative Progress: 975/1587 symbols completed. LEN took 0.9s. Estimated remaining: 4m 15s. Rate: 144.0 symbols/min [2025-10-01T22:41:39.609815] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:39.610068] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:39.609911] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:39.636045] [DEBUG] [LOCAL ] LEO: Loaded 17282 existing records from primary storage. [2025-10-01T22:41:39.642837] [INFO ] [MAIN ] LEO: Loaded 17282 primary data records. [2025-10-01T22:41:39.643158] [DEBUG] [LOCAL ] LFT: Loaded 18303 existing records from primary storage. [2025-10-01T22:41:39.662515] [INFO ] [MAIN ] LFT: Loaded 18303 primary data records. [2025-10-01T22:41:39.963222] [DEBUG] [LOCAL ] LEVI: Loaded 51565 existing records from primary storage. [2025-10-01T22:41:39.974628] [INFO ] [MAIN ] LEVI: Loaded 51565 primary data records. [2025-10-01T22:41:40.805122] [DEBUG] [MAIN ] LEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:40.806631] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 17282 primary records. [2025-10-01T22:41:40.808625] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-01T22:41:40.843197] [DEBUG] [MAIN ] LFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:40.842848] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-01T22:41:40.843382] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-01T22:41:40.846973] [INFO ] [MAIN ] Derivative Progress: 976/1587 symbols completed. LEO took 1.2s. Estimated remaining: 4m 15s. Rate: 143.7 symbols/min [2025-10-01T22:41:40.844465] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18303 primary records. [2025-10-01T22:41:40.847612] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-01T22:41:40.848582] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:40.881578] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-01T22:41:40.886695] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-01T22:41:40.889411] [INFO ] [MAIN ] Derivative Progress: 977/1587 symbols completed. LFT took 1.3s. Estimated remaining: 4m 14s. Rate: 143.9 symbols/min [2025-10-01T22:41:40.889995] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:40.889893] [DEBUG] [MAIN ] LEVI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:41:40.895610] [INFO ] [MAIN ] LEVI: Generated 1793 derivative records from 51565 primary records. [2025-10-01T22:41:40.896302] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-01T22:41:40.896063] [DEBUG] [LOCAL ] LGI: Loaded 9839 existing records from primary storage. [2025-10-01T22:41:40.897056] [INFO ] [MAIN ] LGI: Loaded 9839 primary data records. [2025-10-01T22:41:41.019370] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1793 records). [2025-10-01T22:41:41.034417] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-01T22:41:41.036710] [INFO ] [MAIN ] Derivative Progress: 978/1587 symbols completed. LEVI took 1.4s. Estimated remaining: 4m 14s. Rate: 144.0 symbols/min [2025-10-01T22:41:41.045991] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:41.275845] [DEBUG] [LOCAL ] LH: Loaded 37827 existing records from primary storage. [2025-10-01T22:41:41.276199] [INFO ] [MAIN ] LH: Loaded 37827 primary data records. [2025-10-01T22:41:41.652108] [DEBUG] [LOCAL ] LHX: Loaded 48686 existing records from primary storage. [2025-10-01T22:41:41.652574] [INFO ] [MAIN ] LHX: Loaded 48686 primary data records. [2025-10-01T22:41:41.883582] [DEBUG] [MAIN ] LGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:42.010953] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 9839 primary records. [2025-10-01T22:41:42.011253] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-01T22:41:42.028450] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-01T22:41:42.032285] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-01T22:41:42.035495] [INFO ] [MAIN ] Derivative Progress: 979/1587 symbols completed. LGI took 1.2s. Estimated remaining: 4m 14s. Rate: 143.8 symbols/min [2025-10-01T22:41:42.036518] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:42.054455] [DEBUG] [MAIN ] LH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:42.056005] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37827 primary records. [2025-10-01T22:41:42.056794] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-01T22:41:42.085046] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-01T22:41:42.093605] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-01T22:41:42.097058] [INFO ] [MAIN ] Derivative Progress: 980/1587 symbols completed. LH took 1.2s. Estimated remaining: 4m 13s. Rate: 143.9 symbols/min [2025-10-01T22:41:42.100691] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:42.127203] [DEBUG] [LOCAL ] LII: Loaded 27988 existing records from primary storage. [2025-10-01T22:41:42.126324] [DEBUG] [MAIN ] LHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:42.128246] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48686 primary records. [2025-10-01T22:41:42.128394] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-01T22:41:42.128330] [INFO ] [MAIN ] LII: Loaded 27988 primary data records. [2025-10-01T22:41:42.259995] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-01T22:41:42.260199] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-01T22:41:42.263020] [INFO ] [MAIN ] Derivative Progress: 981/1587 symbols completed. LHX took 1.2s. Estimated remaining: 4m 13s. Rate: 144.0 symbols/min [2025-10-01T22:41:42.263227] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:42.497016] [DEBUG] [LOCAL ] LITB: Loaded 4340 existing records from primary storage. [2025-10-01T22:41:42.499158] [INFO ] [MAIN ] LITB: Loaded 4340 primary data records. [2025-10-01T22:41:42.498836] [DEBUG] [LOCAL ] LION: Loaded 44271 existing records from primary storage. [2025-10-01T22:41:42.511353] [INFO ] [MAIN ] LION: Loaded 44271 primary data records. [2025-10-01T22:41:43.226232] [DEBUG] [MAIN ] LII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:43.228783] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27988 primary records. [2025-10-01T22:41:43.229230] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-01T22:41:43.249517] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-01T22:41:43.249948] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-01T22:41:43.252519] [INFO ] [MAIN ] Derivative Progress: 982/1587 symbols completed. LII took 1.2s. Estimated remaining: 4m 12s. Rate: 143.8 symbols/min [2025-10-01T22:41:43.253045] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:43.271717] [DEBUG] [MAIN ] LITB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:43.272902] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4340 primary records. [2025-10-01T22:41:43.273242] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-01T22:41:43.291689] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-01T22:41:43.292093] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-01T22:41:43.294748] [INFO ] [MAIN ] Derivative Progress: 983/1587 symbols completed. LITB took 1.0s. Estimated remaining: 4m 12s. Rate: 143.9 symbols/min [2025-10-01T22:41:43.308019] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:43.308476] [DEBUG] [MAIN ] LION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:43.309600] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 44271 primary records. [2025-10-01T22:41:43.309888] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-01T22:41:43.330286] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-01T22:41:43.344634] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-01T22:41:43.347512] [INFO ] [MAIN ] Derivative Progress: 984/1587 symbols completed. LION took 1.2s. Estimated remaining: 4m 11s. Rate: 144.0 symbols/min [2025-10-01T22:41:43.347892] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:43.372430] [DEBUG] [LOCAL ] LLY: Loaded 53285 existing records from primary storage. [2025-10-01T22:41:43.374585] [INFO ] [MAIN ] LLY: Loaded 53285 primary data records. [2025-10-01T22:41:43.626211] [DEBUG] [LOCAL ] LMND: Loaded 51874 existing records from primary storage. [2025-10-01T22:41:43.746383] [INFO ] [MAIN ] LMND: Loaded 51874 primary data records. [2025-10-01T22:41:43.775101] [DEBUG] [LOCAL ] LMT: Loaded 49847 existing records from primary storage. [2025-10-01T22:41:43.781115] [INFO ] [MAIN ] LMT: Loaded 49847 primary data records. [2025-10-01T22:41:44.455611] [DEBUG] [MAIN ] LLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:44.458433] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53285 primary records. [2025-10-01T22:41:44.458689] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-01T22:41:44.481216] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-01T22:41:44.481971] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-01T22:41:44.484669] [INFO ] [MAIN ] Derivative Progress: 985/1587 symbols completed. LLY took 1.2s. Estimated remaining: 4m 11s. Rate: 143.8 symbols/min [2025-10-01T22:41:44.484973] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:44.513463] [DEBUG] [MAIN ] LMND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:44.519487] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51874 primary records. [2025-10-01T22:41:44.519883] [DEBUG] [MAIN ] LMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:44.520024] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-01T22:41:44.521236] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49847 primary records. [2025-10-01T22:41:44.521927] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-01T22:41:44.551317] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-01T22:41:44.554417] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-01T22:41:44.557040] [INFO ] [MAIN ] Derivative Progress: 986/1587 symbols completed. LMND took 1.2s. Estimated remaining: 4m 11s. Rate: 143.9 symbols/min [2025-10-01T22:41:44.558528] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-01T22:41:44.557826] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:44.558777] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-01T22:41:44.561727] [INFO ] [MAIN ] Derivative Progress: 987/1587 symbols completed. LMT took 1.2s. Estimated remaining: 4m 10s. Rate: 144.0 symbols/min [2025-10-01T22:41:44.562123] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:44.584063] [DEBUG] [LOCAL ] LND: Loaded 4914 existing records from primary storage. [2025-10-01T22:41:44.584245] [INFO ] [MAIN ] LND: Loaded 4914 primary data records. [2025-10-01T22:41:44.724826] [DEBUG] [LOCAL ] LNC: Loaded 51610 existing records from primary storage. [2025-10-01T22:41:44.735967] [INFO ] [MAIN ] LNC: Loaded 51610 primary data records. [2025-10-01T22:41:45.330752] [DEBUG] [LOCAL ] LNG: Loaded 51384 existing records from primary storage. [2025-10-01T22:41:45.331057] [INFO ] [MAIN ] LNG: Loaded 51384 primary data records. [2025-10-01T22:41:45.687892] [DEBUG] [MAIN ] LND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:45.692016] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4914 primary records. [2025-10-01T22:41:45.692821] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-01T22:41:45.723574] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-01T22:41:45.721981] [DEBUG] [MAIN ] LNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:45.724748] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51610 primary records. [2025-10-01T22:41:45.724846] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-01T22:41:45.723793] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-01T22:41:45.728168] [INFO ] [MAIN ] Derivative Progress: 988/1587 symbols completed. LND took 1.2s. Estimated remaining: 4m 10s. Rate: 143.8 symbols/min [2025-10-01T22:41:45.745949] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-01T22:41:45.746070] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-01T22:41:45.748357] [INFO ] [MAIN ] Derivative Progress: 989/1587 symbols completed. LNC took 1.3s. Estimated remaining: 4m 9s. Rate: 143.9 symbols/min [2025-10-01T22:41:45.765900] [DEBUG] [MAIN ] LNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:45.766577] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51384 primary records. [2025-10-01T22:41:45.766664] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-01T22:41:45.782878] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-01T22:41:45.782989] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-01T22:41:45.785517] [INFO ] [MAIN ] Derivative Progress: 990/1587 symbols completed. LNG took 1.2s. Estimated remaining: 4m 9s. Rate: 144.1 symbols/min [2025-10-01T22:41:45.786224] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:45.786109] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:45.785966] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:45.801440] [DEBUG] [LOCAL ] LNN: Loaded 11157 existing records from primary storage. [2025-10-01T22:41:45.801579] [INFO ] [MAIN ] LNN: Loaded 11157 primary data records. [2025-10-01T22:41:45.948680] [DEBUG] [LOCAL ] LOB: Loaded 27380 existing records from primary storage. [2025-10-01T22:41:45.960685] [INFO ] [MAIN ] LOB: Loaded 27380 primary data records. [2025-10-01T22:41:46.210894] [DEBUG] [LOCAL ] LOAR: Loaded 41649 existing records from primary storage. [2025-10-01T22:41:46.242347] [INFO ] [MAIN ] LOAR: Loaded 41649 primary data records. [2025-10-01T22:41:46.889675] [DEBUG] [MAIN ] LNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:46.891163] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11157 primary records. [2025-10-01T22:41:46.891311] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-01T22:41:46.909560] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-01T22:41:46.909819] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-01T22:41:46.912439] [INFO ] [MAIN ] Derivative Progress: 991/1587 symbols completed. LNN took 1.1s. Estimated remaining: 4m 9s. Rate: 143.8 symbols/min [2025-10-01T22:41:46.913420] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:46.924278] [DEBUG] [LOCAL ] LOCL: Loaded 3632 existing records from primary storage. [2025-10-01T22:41:46.924616] [INFO ] [MAIN ] LOCL: Loaded 3632 primary data records. [2025-10-01T22:41:46.963027] [DEBUG] [MAIN ] LOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:46.981699] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27380 primary records. [2025-10-01T22:41:47.019373] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-01T22:41:47.125354] [DEBUG] [MAIN ] LOAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:47.131767] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41649 primary records. [2025-10-01T22:41:47.132215] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-01T22:41:47.385323] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-01T22:41:47.386888] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-01T22:41:47.389220] [INFO ] [MAIN ] Derivative Progress: 992/1587 symbols completed. LOB took 1.6s. Estimated remaining: 4m 8s. Rate: 143.8 symbols/min [2025-10-01T22:41:47.389365] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:47.391925] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-01T22:41:47.392782] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-01T22:41:47.396059] [INFO ] [MAIN ] Derivative Progress: 993/1587 symbols completed. LOAR took 1.6s. Estimated remaining: 4m 8s. Rate: 143.9 symbols/min [2025-10-01T22:41:47.396768] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:47.430067] [DEBUG] [MAIN ] LOCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:47.430817] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3632 primary records. [2025-10-01T22:41:47.430898] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-01T22:41:47.447733] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-01T22:41:47.448043] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-01T22:41:47.450882] [INFO ] [MAIN ] Derivative Progress: 994/1587 symbols completed. LOCL took 0.5s. Estimated remaining: 4m 7s. Rate: 144.1 symbols/min [2025-10-01T22:41:47.461093] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:47.462428] [DEBUG] [LOCAL ] LOMA: Loaded 32067 existing records from primary storage. [2025-10-01T22:41:47.462614] [INFO ] [MAIN ] LOMA: Loaded 32067 primary data records. [2025-10-01T22:41:47.851742] [DEBUG] [LOCAL ] LOW: Loaded 52943 existing records from primary storage. [2025-10-01T22:41:47.853178] [DEBUG] [LOCAL ] LPG: Loaded 39882 existing records from primary storage. [2025-10-01T22:41:47.853591] [INFO ] [MAIN ] LOW: Loaded 52943 primary data records. [2025-10-01T22:41:47.853711] [INFO ] [MAIN ] LPG: Loaded 39882 primary data records. [2025-10-01T22:41:48.554295] [DEBUG] [MAIN ] LOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:48.556017] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32067 primary records. [2025-10-01T22:41:48.556461] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-01T22:41:48.577153] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-01T22:41:48.577592] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-01T22:41:48.580413] [INFO ] [MAIN ] Derivative Progress: 995/1587 symbols completed. LOMA took 1.2s. Estimated remaining: 4m 7s. Rate: 143.8 symbols/min [2025-10-01T22:41:48.581158] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:48.601163] [DEBUG] [MAIN ] LPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:48.602207] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39882 primary records. [2025-10-01T22:41:48.602283] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-01T22:41:48.629561] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-01T22:41:48.638769] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-01T22:41:48.647140] [INFO ] [MAIN ] Derivative Progress: 996/1587 symbols completed. LPG took 1.2s. Estimated remaining: 4m 6s. Rate: 143.9 symbols/min [2025-10-01T22:41:48.656268] [DEBUG] [MAIN ] LOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:48.657496] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:48.658541] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52943 primary records. [2025-10-01T22:41:48.658905] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-01T22:41:48.659930] [DEBUG] [LOCAL ] LPL: Loaded 26529 existing records from primary storage. [2025-10-01T22:41:48.660145] [INFO ] [MAIN ] LPL: Loaded 26529 primary data records. [2025-10-01T22:41:48.760189] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-01T22:41:48.779862] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-01T22:41:48.790193] [INFO ] [MAIN ] Derivative Progress: 997/1587 symbols completed. LOW took 1.4s. Estimated remaining: 4m 6s. Rate: 144.0 symbols/min [2025-10-01T22:41:48.803051] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:49.046993] [DEBUG] [LOCAL ] LPX: Loaded 39688 existing records from primary storage. [2025-10-01T22:41:49.047345] [INFO ] [MAIN ] LPX: Loaded 39688 primary data records. [2025-10-01T22:41:49.283954] [DEBUG] [LOCAL ] LRN: Loaded 39775 existing records from primary storage. [2025-10-01T22:41:49.309076] [INFO ] [MAIN ] LRN: Loaded 39775 primary data records. [2025-10-01T22:41:49.688098] [DEBUG] [MAIN ] LPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:49.712894] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 26529 primary records. [2025-10-01T22:41:49.713248] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-01T22:41:49.866457] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-01T22:41:49.867107] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-01T22:41:49.869873] [INFO ] [MAIN ] Derivative Progress: 998/1587 symbols completed. LPL took 1.3s. Estimated remaining: 4m 6s. Rate: 143.8 symbols/min [2025-10-01T22:41:49.870841] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:49.894974] [DEBUG] [MAIN ] LPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:49.895832] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39688 primary records. [2025-10-01T22:41:49.896011] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-01T22:41:49.915225] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-01T22:41:49.915488] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-01T22:41:49.917887] [INFO ] [MAIN ] Derivative Progress: 999/1587 symbols completed. LPX took 1.3s. Estimated remaining: 4m 5s. Rate: 143.9 symbols/min [2025-10-01T22:41:49.918287] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:49.946091] [DEBUG] [MAIN ] LRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:49.947087] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39775 primary records. [2025-10-01T22:41:49.947151] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-01T22:41:49.985488] [DEBUG] [LOCAL ] LSPD: Loaded 42896 existing records from primary storage. [2025-10-01T22:41:49.996598] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-01T22:41:49.997016] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-01T22:41:49.996864] [INFO ] [MAIN ] LSPD: Loaded 42896 primary data records. [2025-10-01T22:41:50.000328] [INFO ] [MAIN ] Derivative Progress: 1000/1587 symbols completed. LRN took 1.2s. Estimated remaining: 4m 5s. Rate: 144.0 symbols/min [2025-10-01T22:41:50.020818] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:50.120226] [DEBUG] [LOCAL ] LTC: Loaded 30230 existing records from primary storage. [2025-10-01T22:41:50.135172] [INFO ] [MAIN ] LTC: Loaded 30230 primary data records. [2025-10-01T22:41:50.668690] [DEBUG] [LOCAL ] LTH: Loaded 51747 existing records from primary storage. [2025-10-01T22:41:50.800574] [INFO ] [MAIN ] LTH: Loaded 51747 primary data records. [2025-10-01T22:41:51.177996] [DEBUG] [MAIN ] LSPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:51.179131] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42896 primary records. [2025-10-01T22:41:51.179423] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-01T22:41:51.194922] [DEBUG] [MAIN ] LTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:51.210700] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30230 primary records. [2025-10-01T22:41:51.211512] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-01T22:41:51.213684] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-01T22:41:51.221417] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-01T22:41:51.227469] [INFO ] [MAIN ] Derivative Progress: 1001/1587 symbols completed. LSPD took 1.4s. Estimated remaining: 4m 5s. Rate: 143.8 symbols/min [2025-10-01T22:41:51.228710] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:51.235531] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-01T22:41:51.236052] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-01T22:41:51.238490] [INFO ] [MAIN ] Derivative Progress: 1002/1587 symbols completed. LTC took 1.3s. Estimated remaining: 4m 4s. Rate: 143.9 symbols/min [2025-10-01T22:41:51.238953] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:51.256283] [DEBUG] [MAIN ] LTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:51.257109] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51747 primary records. [2025-10-01T22:41:51.257314] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-01T22:41:51.284879] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-01T22:41:51.285103] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-01T22:41:51.288604] [INFO ] [MAIN ] Derivative Progress: 1003/1587 symbols completed. LTH took 1.3s. Estimated remaining: 4m 3s. Rate: 144.0 symbols/min [2025-10-01T22:41:51.307365] [DEBUG] [LOCAL ] LTM: Loaded 36988 existing records from primary storage. [2025-10-01T22:41:51.307528] [INFO ] [MAIN ] LTM: Loaded 36988 primary data records. [2025-10-01T22:41:51.507314] [DEBUG] [LOCAL ] LU: Loaded 48987 existing records from primary storage. [2025-10-01T22:41:51.516829] [INFO ] [MAIN ] LU: Loaded 48987 primary data records. [2025-10-01T22:41:52.107290] [DEBUG] [MAIN ] LTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:52.108206] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 36988 primary records. [2025-10-01T22:41:52.108441] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-01T22:41:52.126526] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-01T22:41:52.127323] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-01T22:41:52.131761] [INFO ] [MAIN ] Derivative Progress: 1004/1587 symbols completed. LTM took 0.9s. Estimated remaining: 4m 3s. Rate: 143.9 symbols/min [2025-10-01T22:41:52.147096] [DEBUG] [MAIN ] LU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:52.147864] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48987 primary records. [2025-10-01T22:41:52.147949] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-01T22:41:52.164211] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-01T22:41:52.164363] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-01T22:41:52.167028] [INFO ] [MAIN ] Derivative Progress: 1005/1587 symbols completed. LU took 0.9s. Estimated remaining: 4m 2s. Rate: 144.0 symbols/min [2025-10-01T22:41:52.167679] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:52.167609] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:52.167915] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:52.197994] [DEBUG] [LOCAL ] LUCK: Loaded 24646 existing records from primary storage. [2025-10-01T22:41:52.198187] [INFO ] [MAIN ] LUCK: Loaded 24646 primary data records. [2025-10-01T22:41:52.590230] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-10-01T22:41:52.592148] [INFO ] [MAIN ] LUMN: Loaded 53634 primary data records. [2025-10-01T22:41:52.591969] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-01T22:41:52.597775] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-01T22:41:53.277224] [DEBUG] [MAIN ] LUCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:53.278544] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 24646 primary records. [2025-10-01T22:41:53.279811] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-01T22:41:53.298707] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-01T22:41:53.299027] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-01T22:41:53.301974] [INFO ] [MAIN ] Derivative Progress: 1006/1587 symbols completed. LUCK took 1.1s. Estimated remaining: 4m 2s. Rate: 143.8 symbols/min [2025-10-01T22:41:53.304357] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:53.329911] [DEBUG] [MAIN ] LUMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:53.331060] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53634 primary records. [2025-10-01T22:41:53.331235] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-01T22:41:53.345317] [DEBUG] [MAIN ] LUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:53.357089] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-01T22:41:53.360609] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-01T22:41:53.362158] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-01T22:41:53.362469] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-01T22:41:53.364882] [INFO ] [MAIN ] Derivative Progress: 1007/1587 symbols completed. LUMN took 1.2s. Estimated remaining: 4m 2s. Rate: 143.9 symbols/min [2025-10-01T22:41:53.372521] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:53.381669] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-01T22:41:53.396070] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-01T22:41:53.398972] [INFO ] [MAIN ] Derivative Progress: 1008/1587 symbols completed. LUV took 1.2s. Estimated remaining: 4m 1s. Rate: 144.0 symbols/min [2025-10-01T22:41:53.399349] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:53.429523] [DEBUG] [LOCAL ] LVWR: Loaded 17692 existing records from primary storage. [2025-10-01T22:41:53.429769] [INFO ] [MAIN ] LVWR: Loaded 17692 primary data records. [2025-10-01T22:41:53.431087] [DEBUG] [LOCAL ] LVS: Loaded 53563 existing records from primary storage. [2025-10-01T22:41:53.436428] [INFO ] [MAIN ] LVS: Loaded 53563 primary data records. [2025-10-01T22:41:53.849885] [DEBUG] [LOCAL ] LW: Loaded 51158 existing records from primary storage. [2025-10-01T22:41:53.990380] [INFO ] [MAIN ] LW: Loaded 51158 primary data records. [2025-10-01T22:41:54.555243] [DEBUG] [MAIN ] LVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:54.557002] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53563 primary records. [2025-10-01T22:41:54.557262] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-01T22:41:54.557711] [DEBUG] [MAIN ] LVWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:54.559141] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 17692 primary records. [2025-10-01T22:41:54.559747] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-01T22:41:54.593961] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-10-01T22:41:54.596800] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-01T22:41:54.600005] [INFO ] [MAIN ] Derivative Progress: 1009/1587 symbols completed. LVS took 1.3s. Estimated remaining: 4m 1s. Rate: 143.7 symbols/min [2025-10-01T22:41:54.600705] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:54.601867] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-01T22:41:54.602543] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-01T22:41:54.604953] [INFO ] [MAIN ] Derivative Progress: 1010/1587 symbols completed. LVWR took 1.2s. Estimated remaining: 4m 1s. Rate: 143.9 symbols/min [2025-10-01T22:41:54.605602] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:54.624540] [DEBUG] [MAIN ] LW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:54.625494] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51158 primary records. [2025-10-01T22:41:54.630205] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-01T22:41:54.651628] [DEBUG] [LOCAL ] LXFR: Loaded 16834 existing records from primary storage. [2025-10-01T22:41:54.653873] [INFO ] [MAIN ] LXFR: Loaded 16834 primary data records. [2025-10-01T22:41:54.672086] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-01T22:41:54.684486] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-01T22:41:54.702107] [INFO ] [MAIN ] Derivative Progress: 1011/1587 symbols completed. LW took 1.3s. Estimated remaining: 4m 0s. Rate: 144.0 symbols/min [2025-10-01T22:41:54.733760] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:54.877319] [DEBUG] [LOCAL ] LXP: Loaded 50700 existing records from primary storage. [2025-10-01T22:41:54.898978] [INFO ] [MAIN ] LXP: Loaded 50700 primary data records. [2025-10-01T22:41:54.952157] [DEBUG] [LOCAL ] LXU: Loaded 31708 existing records from primary storage. [2025-10-01T22:41:55.076187] [INFO ] [MAIN ] LXU: Loaded 31708 primary data records. [2025-10-01T22:41:55.826730] [DEBUG] [MAIN ] LXFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:55.828417] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16834 primary records. [2025-10-01T22:41:55.828544] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-01T22:41:55.848385] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-01T22:41:55.848513] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-01T22:41:55.850600] [INFO ] [MAIN ] Derivative Progress: 1012/1587 symbols completed. LXFR took 1.2s. Estimated remaining: 4m 0s. Rate: 143.7 symbols/min [2025-10-01T22:41:55.851405] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:55.888621] [DEBUG] [MAIN ] LXU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:55.889049] [DEBUG] [MAIN ] LXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:55.890057] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50700 primary records. [2025-10-01T22:41:55.891024] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31708 primary records. [2025-10-01T22:41:55.891128] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-01T22:41:55.891927] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-01T22:41:55.922601] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-01T22:41:55.924615] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-01T22:41:55.924872] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-01T22:41:55.927825] [INFO ] [MAIN ] Derivative Progress: 1013/1587 symbols completed. LXU took 1.2s. Estimated remaining: 3m 59s. Rate: 143.9 symbols/min [2025-10-01T22:41:55.927964] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-01T22:41:55.928104] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:55.931208] [INFO ] [MAIN ] Derivative Progress: 1014/1587 symbols completed. LXP took 1.3s. Estimated remaining: 3m 59s. Rate: 144.0 symbols/min [2025-10-01T22:41:55.931562] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:55.977701] [DEBUG] [LOCAL ] LYB: Loaded 53602 existing records from primary storage. [2025-10-01T22:41:55.977951] [INFO ] [MAIN ] LYB: Loaded 53602 primary data records. [2025-10-01T22:41:56.180090] [DEBUG] [LOCAL ] LYV: Loaded 51121 existing records from primary storage. [2025-10-01T22:41:56.199992] [INFO ] [MAIN ] LYV: Loaded 51121 primary data records. [2025-10-01T22:41:56.455571] [DEBUG] [LOCAL ] LYG: Loaded 52795 existing records from primary storage. [2025-10-01T22:41:56.487062] [INFO ] [MAIN ] LYG: Loaded 52795 primary data records. [2025-10-01T22:41:57.128115] [DEBUG] [MAIN ] LYB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:57.129784] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53602 primary records. [2025-10-01T22:41:57.130156] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-01T22:41:57.148848] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-01T22:41:57.149190] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-01T22:41:57.151849] [INFO ] [MAIN ] Derivative Progress: 1015/1587 symbols completed. LYB took 1.3s. Estimated remaining: 3m 59s. Rate: 143.7 symbols/min [2025-10-01T22:41:57.152253] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:57.176177] [DEBUG] [MAIN ] LYV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:57.177431] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51121 primary records. [2025-10-01T22:41:57.190711] [DEBUG] [MAIN ] LYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:57.190388] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-01T22:41:57.192354] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52795 primary records. [2025-10-01T22:41:57.192441] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-01T22:41:57.231745] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-01T22:41:57.233944] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-01T22:41:57.246729] [INFO ] [MAIN ] Derivative Progress: 1016/1587 symbols completed. LYG took 1.3s. Estimated remaining: 3m 58s. Rate: 143.8 symbols/min [2025-10-01T22:41:57.249525] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-01T22:41:57.249841] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:57.251055] [DEBUG] [LOCAL ] LZB: Loaded 35517 existing records from primary storage. [2025-10-01T22:41:57.249746] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-01T22:41:57.253338] [INFO ] [MAIN ] Derivative Progress: 1017/1587 symbols completed. LYV took 1.3s. Estimated remaining: 3m 58s. Rate: 144.0 symbols/min [2025-10-01T22:41:57.253732] [INFO ] [MAIN ] LZB: Loaded 35517 primary data records. [2025-10-01T22:41:57.254020] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:57.392696] [DEBUG] [LOCAL ] LZM: Loaded 13976 existing records from primary storage. [2025-10-01T22:41:57.393049] [INFO ] [MAIN ] LZM: Loaded 13976 primary data records. [2025-10-01T22:41:57.806046] [DEBUG] [LOCAL ] M: Loaded 53535 existing records from primary storage. [2025-10-01T22:41:57.838286] [INFO ] [MAIN ] M: Loaded 53535 primary data records. [2025-10-01T22:41:58.412017] [DEBUG] [MAIN ] LZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:58.413514] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35517 primary records. [2025-10-01T22:41:58.414413] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-01T22:41:58.433222] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-01T22:41:58.434908] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-01T22:41:58.440396] [INFO ] [MAIN ] Derivative Progress: 1018/1587 symbols completed. LZB took 1.3s. Estimated remaining: 3m 58s. Rate: 143.7 symbols/min [2025-10-01T22:41:58.456934] [DEBUG] [MAIN ] LZM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:58.457795] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13976 primary records. [2025-10-01T22:41:58.458187] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-01T22:41:58.477272] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-01T22:41:58.478081] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-01T22:41:58.480610] [INFO ] [MAIN ] Derivative Progress: 1019/1587 symbols completed. LZM took 1.2s. Estimated remaining: 3m 57s. Rate: 143.8 symbols/min [2025-10-01T22:41:58.496066] [DEBUG] [MAIN ] M: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:58.496779] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53535 primary records. [2025-10-01T22:41:58.496844] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-01T22:41:58.513113] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-01T22:41:58.513212] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-01T22:41:58.516053] [INFO ] [MAIN ] Derivative Progress: 1020/1587 symbols completed. M took 1.3s. Estimated remaining: 3m 56s. Rate: 144.0 symbols/min [2025-10-01T22:41:58.516723] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:58.516812] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:58.516671] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:58.577903] [DEBUG] [LOCAL ] MAA: Loaded 42625 existing records from primary storage. [2025-10-01T22:41:58.578203] [INFO ] [MAIN ] MAA: Loaded 42625 primary data records. [2025-10-01T22:41:58.726034] [DEBUG] [LOCAL ] MA: Loaded 52525 existing records from primary storage. [2025-10-01T22:41:58.726421] [INFO ] [MAIN ] MA: Loaded 52525 primary data records. [2025-10-01T22:41:58.797060] [DEBUG] [LOCAL ] MAC: Loaded 49670 existing records from primary storage. [2025-10-01T22:41:58.835674] [INFO ] [MAIN ] MAC: Loaded 49670 primary data records. [2025-10-01T22:41:59.743015] [DEBUG] [MAIN ] MAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:59.744581] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42625 primary records. [2025-10-01T22:41:59.744825] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-01T22:41:59.767421] [DEBUG] [MAIN ] MA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:59.777366] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52525 primary records. [2025-10-01T22:41:59.776208] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-01T22:41:59.777868] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-01T22:41:59.777997] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-01T22:41:59.780606] [INFO ] [MAIN ] Derivative Progress: 1021/1587 symbols completed. MAA took 1.3s. Estimated remaining: 3m 56s. Rate: 143.7 symbols/min [2025-10-01T22:41:59.781895] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:59.803232] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-01T22:41:59.803616] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-01T22:41:59.806141] [INFO ] [MAIN ] Derivative Progress: 1022/1587 symbols completed. MA took 1.3s. Estimated remaining: 3m 56s. Rate: 143.8 symbols/min [2025-10-01T22:41:59.806407] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:59.820471] [DEBUG] [MAIN ] MAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:41:59.821302] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49670 primary records. [2025-10-01T22:41:59.821409] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-01T22:41:59.848809] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-01T22:41:59.849019] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-01T22:41:59.851837] [INFO ] [MAIN ] Derivative Progress: 1023/1587 symbols completed. MAC took 1.3s. Estimated remaining: 3m 55s. Rate: 143.9 symbols/min [2025-10-01T22:41:59.852169] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:41:59.864388] [DEBUG] [LOCAL ] MAGN: Loaded 34828 existing records from primary storage. [2025-10-01T22:41:59.875698] [INFO ] [MAIN ] MAGN: Loaded 34828 primary data records. [2025-10-01T22:42:00.005178] [DEBUG] [LOCAL ] MAIN: Loaded 41168 existing records from primary storage. [2025-10-01T22:42:00.041573] [INFO ] [MAIN ] MAIN: Loaded 41168 primary data records. [2025-10-01T22:42:00.295121] [DEBUG] [LOCAL ] MAN: Loaded 43461 existing records from primary storage. [2025-10-01T22:42:00.405740] [INFO ] [MAIN ] MAN: Loaded 43461 primary data records. [2025-10-01T22:42:01.028718] [DEBUG] [MAIN ] MAGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:01.030508] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 34828 primary records. [2025-10-01T22:42:01.031014] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-01T22:42:01.066553] [DEBUG] [MAIN ] MAIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:01.067939] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-01T22:42:01.069039] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41168 primary records. [2025-10-01T22:42:01.069238] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-01T22:42:01.069322] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-01T22:42:01.071566] [INFO ] [MAIN ] Derivative Progress: 1024/1587 symbols completed. MAGN took 1.3s. Estimated remaining: 3m 55s. Rate: 143.7 symbols/min [2025-10-01T22:42:01.072802] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:01.091066] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-01T22:42:01.091499] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-01T22:42:01.095121] [INFO ] [MAIN ] Derivative Progress: 1025/1587 symbols completed. MAIN took 1.3s. Estimated remaining: 3m 54s. Rate: 143.8 symbols/min [2025-10-01T22:42:01.095876] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:01.113418] [DEBUG] [MAIN ] MAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:01.122534] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43461 primary records. [2025-10-01T22:42:01.122827] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-01T22:42:01.148422] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-01T22:42:01.149676] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-01T22:42:01.150197] [DEBUG] [LOCAL ] MANU: Loaded 26805 existing records from primary storage. [2025-10-01T22:42:01.153140] [INFO ] [MAIN ] Derivative Progress: 1026/1587 symbols completed. MAN took 1.3s. Estimated remaining: 3m 54s. Rate: 143.9 symbols/min [2025-10-01T22:42:01.150388] [INFO ] [MAIN ] MANU: Loaded 26805 primary data records. [2025-10-01T22:42:01.153319] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:01.592935] [DEBUG] [LOCAL ] MATV: Loaded 36693 existing records from primary storage. [2025-10-01T22:42:01.593275] [INFO ] [MAIN ] MATV: Loaded 36693 primary data records. [2025-10-01T22:42:01.596003] [DEBUG] [LOCAL ] MAS: Loaded 52326 existing records from primary storage. [2025-10-01T22:42:01.596191] [INFO ] [MAIN ] MAS: Loaded 52326 primary data records. [2025-10-01T22:42:02.354061] [DEBUG] [MAIN ] MANU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:02.357995] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 26805 primary records. [2025-10-01T22:42:02.358903] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-01T22:42:02.378301] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-01T22:42:02.379428] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-01T22:42:02.383063] [INFO ] [MAIN ] Derivative Progress: 1027/1587 symbols completed. MANU took 1.3s. Estimated remaining: 3m 54s. Rate: 143.7 symbols/min [2025-10-01T22:42:02.386018] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:02.414215] [DEBUG] [MAIN ] MATV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:02.415690] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 36693 primary records. [2025-10-01T22:42:02.414902] [DEBUG] [MAIN ] MAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:02.415943] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-01T22:42:02.416690] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52326 primary records. [2025-10-01T22:42:02.417168] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-01T22:42:02.451615] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-01T22:42:02.453053] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-01T22:42:02.463454] [INFO ] [MAIN ] Derivative Progress: 1028/1587 symbols completed. MAS took 1.4s. Estimated remaining: 3m 53s. Rate: 143.8 symbols/min [2025-10-01T22:42:02.463690] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:02.461260] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-01T22:42:02.464169] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-01T22:42:02.466701] [INFO ] [MAIN ] Derivative Progress: 1029/1587 symbols completed. MATV took 1.3s. Estimated remaining: 3m 53s. Rate: 143.9 symbols/min [2025-10-01T22:42:02.467025] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:02.482370] [DEBUG] [LOCAL ] MATX: Loaded 31529 existing records from primary storage. [2025-10-01T22:42:02.482730] [INFO ] [MAIN ] MATX: Loaded 31529 primary data records. [2025-10-01T22:42:02.635585] [DEBUG] [LOCAL ] MAX: Loaded 30716 existing records from primary storage. [2025-10-01T22:42:02.635918] [INFO ] [MAIN ] MAX: Loaded 30716 primary data records. [2025-10-01T22:42:02.961796] [DEBUG] [LOCAL ] MBC: Loaded 43173 existing records from primary storage. [2025-10-01T22:42:02.981023] [INFO ] [MAIN ] MBC: Loaded 43173 primary data records. [2025-10-01T22:42:03.632580] [DEBUG] [MAIN ] MATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:03.633869] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31529 primary records. [2025-10-01T22:42:03.634490] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-01T22:42:03.674895] [DEBUG] [MAIN ] MAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:03.678247] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30716 primary records. [2025-10-01T22:42:03.679636] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-01T22:42:03.697312] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-01T22:42:03.698536] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-01T22:42:03.701530] [INFO ] [MAIN ] Derivative Progress: 1030/1587 symbols completed. MATX took 1.3s. Estimated remaining: 3m 53s. Rate: 143.6 symbols/min [2025-10-01T22:42:03.702117] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:03.711854] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-01T22:42:03.712107] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-01T22:42:03.715051] [INFO ] [MAIN ] Derivative Progress: 1031/1587 symbols completed. MAX took 1.3s. Estimated remaining: 3m 52s. Rate: 143.8 symbols/min [2025-10-01T22:42:03.728503] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:03.729116] [DEBUG] [MAIN ] MBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:03.730438] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43173 primary records. [2025-10-01T22:42:03.730692] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-01T22:42:03.771614] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-01T22:42:03.771440] [DEBUG] [LOCAL ] MBI: Loaded 24272 existing records from primary storage. [2025-10-01T22:42:03.771892] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-01T22:42:03.772001] [INFO ] [MAIN ] MBI: Loaded 24272 primary data records. [2025-10-01T22:42:03.775938] [INFO ] [MAIN ] Derivative Progress: 1032/1587 symbols completed. MBC took 1.3s. Estimated remaining: 3m 51s. Rate: 143.9 symbols/min [2025-10-01T22:42:03.807206] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:03.983401] [DEBUG] [LOCAL ] MCB: Loaded 11400 existing records from primary storage. [2025-10-01T22:42:03.988856] [INFO ] [MAIN ] MCB: Loaded 11400 primary data records. [2025-10-01T22:42:04.020231] [DEBUG] [LOCAL ] MC: Loaded 44087 existing records from primary storage. [2025-10-01T22:42:04.086073] [INFO ] [MAIN ] MC: Loaded 44087 primary data records. [2025-10-01T22:42:04.925049] [DEBUG] [MAIN ] MBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:04.926430] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24272 primary records. [2025-10-01T22:42:04.926784] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-01T22:42:04.974668] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-01T22:42:04.975368] [DEBUG] [MAIN ] MC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:04.981755] [DEBUG] [MAIN ] MCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:04.981403] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44087 primary records. [2025-10-01T22:42:04.981990] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-01T22:42:04.981885] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-01T22:42:04.982809] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11400 primary records. [2025-10-01T22:42:04.985573] [INFO ] [MAIN ] Derivative Progress: 1033/1587 symbols completed. MBI took 1.3s. Estimated remaining: 3m 51s. Rate: 143.6 symbols/min [2025-10-01T22:42:04.986412] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-01T22:42:05.019304] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-01T22:42:05.019919] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-01T22:42:05.022905] [INFO ] [MAIN ] Derivative Progress: 1034/1587 symbols completed. MCB took 1.2s. Estimated remaining: 3m 51s. Rate: 143.8 symbols/min [2025-10-01T22:42:05.023020] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-01T22:42:05.023226] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-01T22:42:05.025994] [INFO ] [MAIN ] Derivative Progress: 1035/1587 symbols completed. MC took 1.3s. Estimated remaining: 3m 50s. Rate: 143.9 symbols/min [2025-10-01T22:42:05.026332] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:05.026393] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:05.026569] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:05.038396] [DEBUG] [LOCAL ] MCN: Loaded 8211 existing records from primary storage. [2025-10-01T22:42:05.038719] [INFO ] [MAIN ] MCN: Loaded 8211 primary data records. [2025-10-01T22:42:05.088821] [DEBUG] [LOCAL ] MCI: Loaded 6368 existing records from primary storage. [2025-10-01T22:42:05.125247] [INFO ] [MAIN ] MCI: Loaded 6368 primary data records. [2025-10-01T22:42:05.622947] [DEBUG] [LOCAL ] MCK: Loaded 39151 existing records from primary storage. [2025-10-01T22:42:05.736696] [INFO ] [MAIN ] MCK: Loaded 39151 primary data records. [2025-10-01T22:42:06.140251] [DEBUG] [MAIN ] MCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:06.141598] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8211 primary records. [2025-10-01T22:42:06.142792] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-01T22:42:06.163176] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-01T22:42:06.163502] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-01T22:42:06.165947] [INFO ] [MAIN ] Derivative Progress: 1036/1587 symbols completed. MCN took 1.1s. Estimated remaining: 3m 50s. Rate: 143.6 symbols/min [2025-10-01T22:42:06.166297] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:06.181536] [DEBUG] [MAIN ] MCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:06.182533] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6368 primary records. [2025-10-01T22:42:06.182810] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-01T22:42:06.199750] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-01T22:42:06.200277] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-01T22:42:06.202912] [INFO ] [MAIN ] Derivative Progress: 1037/1587 symbols completed. MCI took 1.2s. Estimated remaining: 3m 50s. Rate: 143.8 symbols/min [2025-10-01T22:42:06.203325] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:06.224724] [DEBUG] [MAIN ] MCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:06.230035] [DEBUG] [LOCAL ] MCR: Loaded 8766 existing records from primary storage. [2025-10-01T22:42:06.230140] [INFO ] [MAIN ] MCR: Loaded 8766 primary data records. [2025-10-01T22:42:06.229628] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39151 primary records. [2025-10-01T22:42:06.252318] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-01T22:42:06.419274] [DEBUG] [LOCAL ] MCO: Loaded 39277 existing records from primary storage. [2025-10-01T22:42:06.482383] [INFO ] [MAIN ] MCO: Loaded 39277 primary data records. [2025-10-01T22:42:06.610099] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-01T22:42:06.626527] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-01T22:42:06.639193] [INFO ] [MAIN ] Derivative Progress: 1038/1587 symbols completed. MCK took 1.6s. Estimated remaining: 3m 49s. Rate: 143.8 symbols/min [2025-10-01T22:42:06.644753] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:06.838834] [DEBUG] [LOCAL ] MCS: Loaded 20933 existing records from primary storage. [2025-10-01T22:42:06.862301] [INFO ] [MAIN ] MCS: Loaded 20933 primary data records. [2025-10-01T22:42:07.215149] [DEBUG] [MAIN ] MCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:07.243598] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8766 primary records. [2025-10-01T22:42:07.422787] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-01T22:42:07.462289] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-01T22:42:07.462808] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-01T22:42:07.466019] [INFO ] [MAIN ] Derivative Progress: 1039/1587 symbols completed. MCR took 1.3s. Estimated remaining: 3m 49s. Rate: 143.6 symbols/min [2025-10-01T22:42:07.466756] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:07.482476] [DEBUG] [MAIN ] MCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:07.483908] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39277 primary records. [2025-10-01T22:42:07.484022] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-01T22:42:07.508282] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-01T22:42:07.508746] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-01T22:42:07.511943] [INFO ] [MAIN ] Derivative Progress: 1040/1587 symbols completed. MCO took 1.3s. Estimated remaining: 3m 48s. Rate: 143.8 symbols/min [2025-10-01T22:42:07.512437] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:07.538974] [DEBUG] [MAIN ] MCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:07.547918] [DEBUG] [LOCAL ] MCY: Loaded 24385 existing records from primary storage. [2025-10-01T22:42:07.548986] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 20933 primary records. [2025-10-01T22:42:07.549272] [INFO ] [MAIN ] MCY: Loaded 24385 primary data records. [2025-10-01T22:42:07.549444] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-01T22:42:07.717013] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-01T22:42:07.791189] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-01T22:42:07.797288] [INFO ] [MAIN ] Derivative Progress: 1041/1587 symbols completed. MCS took 1.2s. Estimated remaining: 3m 48s. Rate: 143.8 symbols/min [2025-10-01T22:42:07.915158] [DEBUG] [LOCAL ] MD: Loaded 38329 existing records from primary storage. [2025-10-01T22:42:07.924750] [INFO ] [MAIN ] MD: Loaded 38329 primary data records. [2025-10-01T22:42:07.924502] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:08.031406] [DEBUG] [LOCAL ] MDST: Loaded 5682 existing records from primary storage. [2025-10-01T22:42:08.054438] [INFO ] [MAIN ] MDST: Loaded 5682 primary data records. [2025-10-01T22:42:08.650816] [DEBUG] [MAIN ] MCY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:08.652427] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 24385 primary records. [2025-10-01T22:42:08.652785] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-01T22:42:08.674771] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-01T22:42:08.675188] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-01T22:42:08.679564] [INFO ] [MAIN ] Derivative Progress: 1042/1587 symbols completed. MCY took 1.2s. Estimated remaining: 3m 48s. Rate: 143.6 symbols/min [2025-10-01T22:42:08.691287] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:08.697740] [DEBUG] [MAIN ] MD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:08.698886] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38329 primary records. [2025-10-01T22:42:08.699486] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-01T22:42:08.720025] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-01T22:42:08.722812] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-01T22:42:08.726778] [INFO ] [MAIN ] Derivative Progress: 1043/1587 symbols completed. MD took 1.2s. Estimated remaining: 3m 47s. Rate: 143.8 symbols/min [2025-10-01T22:42:08.727172] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:08.743958] [DEBUG] [MAIN ] MDST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:08.744783] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5682 primary records. [2025-10-01T22:42:08.745251] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-01T22:42:08.761820] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-10-01T22:42:08.762018] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-01T22:42:08.764707] [INFO ] [MAIN ] Derivative Progress: 1044/1587 symbols completed. MDST took 0.8s. Estimated remaining: 3m 46s. Rate: 143.9 symbols/min [2025-10-01T22:42:08.765073] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:08.793464] [DEBUG] [LOCAL ] MDV: Loaded 8486 existing records from primary storage. [2025-10-01T22:42:08.793615] [INFO ] [MAIN ] MDV: Loaded 8486 primary data records. [2025-10-01T22:42:08.944022] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-01T22:42:08.983871] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-01T22:42:09.018975] [DEBUG] [LOCAL ] MDU: Loaded 47936 existing records from primary storage. [2025-10-01T22:42:09.071736] [INFO ] [MAIN ] MDU: Loaded 47936 primary data records. [2025-10-01T22:42:09.943777] [DEBUG] [MAIN ] MDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:09.944961] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8486 primary records. [2025-10-01T22:42:09.945194] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-01T22:42:09.965526] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-01T22:42:09.968607] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-01T22:42:09.972490] [INFO ] [MAIN ] Derivative Progress: 1045/1587 symbols completed. MDV took 1.2s. Estimated remaining: 3m 46s. Rate: 143.6 symbols/min [2025-10-01T22:42:09.974813] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:09.995215] [DEBUG] [MAIN ] MDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:09.996534] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47936 primary records. [2025-10-01T22:42:10.012441] [DEBUG] [MAIN ] MDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:10.013330] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-01T22:42:10.013458] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-01T22:42:10.012105] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-01T22:42:10.051161] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-01T22:42:10.052729] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-01T22:42:10.055514] [INFO ] [MAIN ] Derivative Progress: 1046/1587 symbols completed. MDU took 1.3s. Estimated remaining: 3m 46s. Rate: 143.7 symbols/min [2025-10-01T22:42:10.056049] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:10.065255] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-01T22:42:10.065418] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-01T22:42:10.069203] [DEBUG] [LOCAL ] MEC: Loaded 16283 existing records from primary storage. [2025-10-01T22:42:10.068600] [INFO ] [MAIN ] Derivative Progress: 1047/1587 symbols completed. MDT took 1.4s. Estimated remaining: 3m 45s. Rate: 143.9 symbols/min [2025-10-01T22:42:10.069393] [INFO ] [MAIN ] MEC: Loaded 16283 primary data records. [2025-10-01T22:42:10.069635] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:10.221576] [DEBUG] [LOCAL ] MED: Loaded 21517 existing records from primary storage. [2025-10-01T22:42:10.240197] [INFO ] [MAIN ] MED: Loaded 21517 primary data records. [2025-10-01T22:42:10.508926] [DEBUG] [LOCAL ] MEG: Loaded 31808 existing records from primary storage. [2025-10-01T22:42:10.515430] [INFO ] [MAIN ] MEG: Loaded 31808 primary data records. [2025-10-01T22:42:11.145319] [DEBUG] [MAIN ] MEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:11.146461] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16283 primary records. [2025-10-01T22:42:11.147706] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-01T22:42:11.166778] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-01T22:42:11.166970] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-01T22:42:11.169395] [INFO ] [MAIN ] Derivative Progress: 1048/1587 symbols completed. MEC took 1.2s. Estimated remaining: 3m 45s. Rate: 143.7 symbols/min [2025-10-01T22:42:11.188575] [DEBUG] [MAIN ] MED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:11.201599] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21517 primary records. [2025-10-01T22:42:11.201962] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-01T22:42:11.201899] [DEBUG] [MAIN ] MEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:11.202863] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31808 primary records. [2025-10-01T22:42:11.203281] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-01T22:42:11.234306] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-01T22:42:11.234907] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-01T22:42:11.238124] [INFO ] [MAIN ] Derivative Progress: 1049/1587 symbols completed. MEG took 1.2s. Estimated remaining: 3m 45s. Rate: 143.8 symbols/min [2025-10-01T22:42:11.239075] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-01T22:42:11.239220] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-01T22:42:11.242475] [INFO ] [MAIN ] Derivative Progress: 1050/1587 symbols completed. MED took 1.2s. Estimated remaining: 3m 44s. Rate: 143.9 symbols/min [2025-10-01T22:42:11.242930] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:11.243023] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:11.242869] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:11.274713] [DEBUG] [LOCAL ] MEGI: Loaded 20116 existing records from primary storage. [2025-10-01T22:42:11.275011] [INFO ] [MAIN ] MEGI: Loaded 20116 primary data records. [2025-10-01T22:42:11.362142] [DEBUG] [LOCAL ] MEI: Loaded 32017 existing records from primary storage. [2025-10-01T22:42:11.395324] [INFO ] [MAIN ] MEI: Loaded 32017 primary data records. [2025-10-01T22:42:11.683294] [DEBUG] [LOCAL ] MET: Loaded 53311 existing records from primary storage. [2025-10-01T22:42:11.689166] [INFO ] [MAIN ] MET: Loaded 53311 primary data records. [2025-10-01T22:42:12.411697] [DEBUG] [MAIN ] MEGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:12.413013] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20116 primary records. [2025-10-01T22:42:12.413310] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-01T22:42:12.446036] [DEBUG] [MAIN ] MEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:12.447130] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-01T22:42:12.447417] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-01T22:42:12.448219] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32017 primary records. [2025-10-01T22:42:12.448419] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-01T22:42:12.451120] [INFO ] [MAIN ] Derivative Progress: 1051/1587 symbols completed. MEGI took 1.2s. Estimated remaining: 3m 44s. Rate: 143.6 symbols/min [2025-10-01T22:42:12.469831] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-01T22:42:12.470159] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-01T22:42:12.467093] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:12.473257] [INFO ] [MAIN ] Derivative Progress: 1052/1587 symbols completed. MEI took 1.2s. Estimated remaining: 3m 43s. Rate: 143.8 symbols/min [2025-10-01T22:42:12.473858] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:12.487800] [DEBUG] [MAIN ] MET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:12.489033] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53311 primary records. [2025-10-01T22:42:12.489267] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-01T22:42:12.508214] [DEBUG] [LOCAL ] MFAN: Loaded 4236 existing records from primary storage. [2025-10-01T22:42:12.509268] [INFO ] [MAIN ] MFAN: Loaded 4236 primary data records. [2025-10-01T22:42:12.566244] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-01T22:42:12.624434] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-01T22:42:12.642899] [INFO ] [MAIN ] Derivative Progress: 1053/1587 symbols completed. MET took 1.4s. Estimated remaining: 3m 43s. Rate: 143.9 symbols/min [2025-10-01T22:42:12.659462] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:12.879830] [DEBUG] [LOCAL ] MFA: Loaded 45479 existing records from primary storage. [2025-10-01T22:42:12.881153] [INFO ] [MAIN ] MFA: Loaded 45479 primary data records. [2025-10-01T22:42:12.884057] [DEBUG] [LOCAL ] MFAO: Loaded 3828 existing records from primary storage. [2025-10-01T22:42:12.896678] [INFO ] [MAIN ] MFAO: Loaded 3828 primary data records. [2025-10-01T22:42:13.594042] [DEBUG] [MAIN ] MFAN: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-01T22:42:13.597331] [INFO ] [MAIN ] MFAN: Generated 1792 derivative records from 4236 primary records. [2025-10-01T22:42:13.597600] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-01T22:42:13.616636] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1792 records). [2025-10-01T22:42:13.616841] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-01T22:42:13.619806] [INFO ] [MAIN ] Derivative Progress: 1054/1587 symbols completed. MFAN took 1.1s. Estimated remaining: 3m 43s. Rate: 143.7 symbols/min [2025-10-01T22:42:13.620313] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:13.650521] [DEBUG] [MAIN ] MFAO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:42:13.656365] [INFO ] [MAIN ] MFAO: Generated 1793 derivative records from 3828 primary records. [2025-10-01T22:42:13.656600] [DEBUG] [MAIN ] MFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:13.656750] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-01T22:42:13.658204] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45479 primary records. [2025-10-01T22:42:13.658469] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-01T22:42:13.686721] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1793 records). [2025-10-01T22:42:13.687092] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-01T22:42:13.690275] [INFO ] [MAIN ] Derivative Progress: 1055/1587 symbols completed. MFAO took 1.0s. Estimated remaining: 3m 42s. Rate: 143.8 symbols/min [2025-10-01T22:42:13.690437] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:13.695842] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-01T22:42:13.695997] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-01T22:42:13.699168] [INFO ] [MAIN ] Derivative Progress: 1056/1587 symbols completed. MFA took 1.2s. Estimated remaining: 3m 41s. Rate: 143.9 symbols/min [2025-10-01T22:42:13.699432] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:13.729758] [DEBUG] [LOCAL ] MFM: Loaded 14610 existing records from primary storage. [2025-10-01T22:42:13.729915] [INFO ] [MAIN ] MFM: Loaded 14610 primary data records. [2025-10-01T22:42:13.868926] [DEBUG] [LOCAL ] MFC: Loaded 51162 existing records from primary storage. [2025-10-01T22:42:13.885359] [INFO ] [MAIN ] MFC: Loaded 51162 primary data records. [2025-10-01T22:42:14.276908] [DEBUG] [LOCAL ] MFG: Loaded 49225 existing records from primary storage. [2025-10-01T22:42:14.303860] [INFO ] [MAIN ] MFG: Loaded 49225 primary data records. [2025-10-01T22:42:14.872306] [DEBUG] [MAIN ] MFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:14.873329] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14610 primary records. [2025-10-01T22:42:14.873675] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-01T22:42:14.893465] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-01T22:42:14.894110] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-01T22:42:14.897983] [INFO ] [MAIN ] Derivative Progress: 1057/1587 symbols completed. MFM took 1.2s. Estimated remaining: 3m 41s. Rate: 143.7 symbols/min [2025-10-01T22:42:14.899166] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:14.915598] [DEBUG] [MAIN ] MFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:14.916704] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51162 primary records. [2025-10-01T22:42:14.917066] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-01T22:42:14.938405] [DEBUG] [LOCAL ] MFSG: Loaded 5380 existing records from primary storage. [2025-10-01T22:42:14.939043] [INFO ] [MAIN ] MFSG: Loaded 5380 primary data records. [2025-10-01T22:42:14.997872] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-01T22:42:15.016592] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-01T22:42:15.038986] [INFO ] [MAIN ] Derivative Progress: 1058/1587 symbols completed. MFC took 1.4s. Estimated remaining: 3m 41s. Rate: 143.8 symbols/min [2025-10-01T22:42:15.053817] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:15.138767] [DEBUG] [MAIN ] MFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:15.290287] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49225 primary records. [2025-10-01T22:42:15.300376] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-01T22:42:15.314908] [DEBUG] [LOCAL ] MFSI: Loaded 11442 existing records from primary storage. [2025-10-01T22:42:15.319315] [INFO ] [MAIN ] MFSI: Loaded 11442 primary data records. [2025-10-01T22:42:15.387328] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-01T22:42:15.403065] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-01T22:42:15.419785] [INFO ] [MAIN ] Derivative Progress: 1059/1587 symbols completed. MFG took 1.7s. Estimated remaining: 3m 40s. Rate: 143.8 symbols/min [2025-10-01T22:42:15.446504] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:15.538486] [DEBUG] [LOCAL ] MFSV: Loaded 2553 existing records from primary storage. [2025-10-01T22:42:15.554810] [INFO ] [MAIN ] MFSV: Loaded 2553 primary data records. [2025-10-01T22:42:15.807328] [DEBUG] [MAIN ] MFSG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:42:15.824276] [INFO ] [MAIN ] MFSG: Generated 1793 derivative records from 5380 primary records. [2025-10-01T22:42:15.860395] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-01T22:42:16.034526] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1793 records). [2025-10-01T22:42:16.035678] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-01T22:42:16.038770] [INFO ] [MAIN ] Derivative Progress: 1060/1587 symbols completed. MFSG took 1.1s. Estimated remaining: 3m 40s. Rate: 143.7 symbols/min [2025-10-01T22:42:16.040265] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:16.057349] [DEBUG] [MAIN ] MFSI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:42:16.058201] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 11442 primary records. [2025-10-01T22:42:16.058522] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-01T22:42:16.080562] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-01T22:42:16.087008] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-01T22:42:16.088256] [DEBUG] [LOCAL ] MG: Loaded 16389 existing records from primary storage. [2025-10-01T22:42:16.088372] [INFO ] [MAIN ] MG: Loaded 16389 primary data records. [2025-10-01T22:42:16.091251] [INFO ] [MAIN ] Derivative Progress: 1061/1587 symbols completed. MFSI took 1.0s. Estimated remaining: 3m 39s. Rate: 143.8 symbols/min [2025-10-01T22:42:16.092470] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:16.203747] [DEBUG] [MAIN ] MFSV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-01T22:42:16.231300] [INFO ] [MAIN ] MFSV: Generated 1792 derivative records from 2553 primary records. [2025-10-01T22:42:16.231495] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-01T22:42:16.529776] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1792 records). [2025-10-01T22:42:16.529933] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-01T22:42:16.533291] [INFO ] [MAIN ] Derivative Progress: 1062/1587 symbols completed. MFSV took 1.1s. Estimated remaining: 3m 39s. Rate: 143.8 symbols/min [2025-10-01T22:42:16.533726] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:16.544121] [DEBUG] [LOCAL ] MGF: Loaded 4260 existing records from primary storage. [2025-10-01T22:42:16.544543] [INFO ] [MAIN ] MGF: Loaded 4260 primary data records. [2025-10-01T22:42:16.603995] [DEBUG] [LOCAL ] MGA: Loaded 50657 existing records from primary storage. [2025-10-01T22:42:16.660335] [INFO ] [MAIN ] MGA: Loaded 50657 primary data records. [2025-10-01T22:42:17.239594] [DEBUG] [MAIN ] MG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:17.255137] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16389 primary records. [2025-10-01T22:42:17.256040] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-01T22:42:17.277455] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-01T22:42:17.277609] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-01T22:42:17.280875] [INFO ] [MAIN ] Derivative Progress: 1063/1587 symbols completed. MG took 1.2s. Estimated remaining: 3m 39s. Rate: 143.7 symbols/min [2025-10-01T22:42:17.300347] [DEBUG] [MAIN ] MGF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:17.301215] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4260 primary records. [2025-10-01T22:42:17.301385] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-01T22:42:17.336291] [DEBUG] [MAIN ] MGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:17.337242] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50657 primary records. [2025-10-01T22:42:17.337404] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-10-01T22:42:17.337552] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-01T22:42:17.337639] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-01T22:42:17.340226] [INFO ] [MAIN ] Derivative Progress: 1064/1587 symbols completed. MGF took 0.8s. Estimated remaining: 3m 38s. Rate: 143.8 symbols/min [2025-10-01T22:42:17.362620] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-01T22:42:17.362795] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-01T22:42:17.366480] [INFO ] [MAIN ] Derivative Progress: 1065/1587 symbols completed. MGA took 1.3s. Estimated remaining: 3m 38s. Rate: 143.9 symbols/min [2025-10-01T22:42:17.367043] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:17.367097] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:17.367154] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:17.374791] [DEBUG] [LOCAL ] MGRD: Loaded 2238 existing records from primary storage. [2025-10-01T22:42:17.375093] [INFO ] [MAIN ] MGRD: Loaded 2238 primary data records. [2025-10-01T22:42:17.427148] [DEBUG] [LOCAL ] MGR: Loaded 5614 existing records from primary storage. [2025-10-01T22:42:17.441625] [INFO ] [MAIN ] MGR: Loaded 5614 primary data records. [2025-10-01T22:42:17.950781] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-10-01T22:42:17.978204] [INFO ] [MAIN ] MGM: Loaded 53608 primary data records. [2025-10-01T22:42:18.526784] [DEBUG] [MAIN ] MGRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:18.530457] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2238 primary records. [2025-10-01T22:42:18.531706] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-01T22:42:18.567224] [DEBUG] [MAIN ] MGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:18.569727] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5614 primary records. [2025-10-01T22:42:18.570491] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-01T22:42:18.573778] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-01T22:42:18.573979] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-01T22:42:18.594611] [INFO ] [MAIN ] Derivative Progress: 1066/1587 symbols completed. MGRD took 1.2s. Estimated remaining: 3m 38s. Rate: 143.7 symbols/min [2025-10-01T22:42:18.597484] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:18.603373] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-01T22:42:18.606624] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-01T22:42:18.609911] [INFO ] [MAIN ] Derivative Progress: 1067/1587 symbols completed. MGR took 1.2s. Estimated remaining: 3m 37s. Rate: 143.8 symbols/min [2025-10-01T22:42:18.610600] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:18.634915] [DEBUG] [LOCAL ] MGRE: Loaded 6698 existing records from primary storage. [2025-10-01T22:42:18.635985] [INFO ] [MAIN ] MGRE: Loaded 6698 primary data records. [2025-10-01T22:42:18.635862] [DEBUG] [MAIN ] MGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:18.637322] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53608 primary records. [2025-10-01T22:42:18.683463] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-01T22:42:19.006127] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-01T22:42:19.006517] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-01T22:42:19.009376] [INFO ] [MAIN ] Derivative Progress: 1068/1587 symbols completed. MGM took 1.6s. Estimated remaining: 3m 37s. Rate: 143.8 symbols/min [2025-10-01T22:42:19.010566] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:19.030382] [DEBUG] [LOCAL ] MGY: Loaded 52421 existing records from primary storage. [2025-10-01T22:42:19.030681] [INFO ] [MAIN ] MGY: Loaded 52421 primary data records. [2025-10-01T22:42:19.146855] [DEBUG] [LOCAL ] MHD: Loaded 12377 existing records from primary storage. [2025-10-01T22:42:19.156580] [INFO ] [MAIN ] MHD: Loaded 12377 primary data records. [2025-10-01T22:42:19.536317] [DEBUG] [MAIN ] MGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:19.543543] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6698 primary records. [2025-10-01T22:42:19.560902] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-01T22:42:19.782278] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-01T22:42:19.783057] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-01T22:42:19.786417] [INFO ] [MAIN ] Derivative Progress: 1069/1587 symbols completed. MGRE took 1.2s. Estimated remaining: 3m 36s. Rate: 143.7 symbols/min [2025-10-01T22:42:19.786713] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:19.807486] [DEBUG] [MAIN ] MGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:19.811379] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52421 primary records. [2025-10-01T22:42:19.816902] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-01T22:42:19.816824] [DEBUG] [LOCAL ] MHF: Loaded 8704 existing records from primary storage. [2025-10-01T22:42:19.818187] [INFO ] [MAIN ] MHF: Loaded 8704 primary data records. [2025-10-01T22:42:19.895818] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-01T22:42:19.931076] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-01T22:42:19.941351] [INFO ] [MAIN ] Derivative Progress: 1070/1587 symbols completed. MGY took 1.3s. Estimated remaining: 3m 36s. Rate: 143.8 symbols/min [2025-10-01T22:42:19.949995] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:19.980409] [DEBUG] [MAIN ] MHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:20.022291] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12377 primary records. [2025-10-01T22:42:20.022497] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-01T22:42:20.206145] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-01T22:42:20.207035] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-01T22:42:20.209796] [INFO ] [MAIN ] Derivative Progress: 1071/1587 symbols completed. MHD took 1.2s. Estimated remaining: 3m 35s. Rate: 143.8 symbols/min [2025-10-01T22:42:20.210048] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:20.231469] [DEBUG] [LOCAL ] MHN: Loaded 7578 existing records from primary storage. [2025-10-01T22:42:20.232864] [INFO ] [MAIN ] MHN: Loaded 7578 primary data records. [2025-10-01T22:42:20.350224] [DEBUG] [LOCAL ] MHK: Loaded 42192 existing records from primary storage. [2025-10-01T22:42:20.364084] [INFO ] [MAIN ] MHK: Loaded 42192 primary data records. [2025-10-01T22:42:20.792520] [DEBUG] [MAIN ] MHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:20.833621] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8704 primary records. [2025-10-01T22:42:20.834134] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-01T22:42:21.026040] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-01T22:42:21.026680] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-01T22:42:21.029358] [INFO ] [MAIN ] Derivative Progress: 1072/1587 symbols completed. MHF took 1.2s. Estimated remaining: 3m 35s. Rate: 143.7 symbols/min [2025-10-01T22:42:21.030098] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:21.052231] [DEBUG] [MAIN ] MHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:21.053250] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7578 primary records. [2025-10-01T22:42:21.053502] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-01T22:42:21.079590] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-01T22:42:21.079866] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-01T22:42:21.082706] [INFO ] [MAIN ] Derivative Progress: 1073/1587 symbols completed. MHN took 0.9s. Estimated remaining: 3m 34s. Rate: 143.8 symbols/min [2025-10-01T22:42:21.083089] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:21.107902] [DEBUG] [MAIN ] MHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:21.107280] [DEBUG] [LOCAL ] MHO: Loaded 23962 existing records from primary storage. [2025-10-01T22:42:21.108338] [INFO ] [MAIN ] MHO: Loaded 23962 primary data records. [2025-10-01T22:42:21.109277] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42192 primary records. [2025-10-01T22:42:21.122120] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-01T22:42:21.232264] [DEBUG] [LOCAL ] MIN: Loaded 13146 existing records from primary storage. [2025-10-01T22:42:21.238270] [INFO ] [MAIN ] MIN: Loaded 13146 primary data records. [2025-10-01T22:42:21.485681] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-01T22:42:21.625695] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-01T22:42:21.639204] [INFO ] [MAIN ] Derivative Progress: 1074/1587 symbols completed. MHK took 1.7s. Estimated remaining: 3m 34s. Rate: 143.8 symbols/min [2025-10-01T22:42:21.650629] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:21.878912] [DEBUG] [MAIN ] MHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:21.880092] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23962 primary records. [2025-10-01T22:42:21.880674] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-01T22:42:21.930405] [DEBUG] [LOCAL ] MIR: Loaded 51020 existing records from primary storage. [2025-10-01T22:42:21.931359] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-01T22:42:21.932094] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-01T22:42:21.931872] [DEBUG] [MAIN ] MIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:21.932009] [INFO ] [MAIN ] MIR: Loaded 51020 primary data records. [2025-10-01T22:42:21.935828] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13146 primary records. [2025-10-01T22:42:21.934870] [INFO ] [MAIN ] Derivative Progress: 1075/1587 symbols completed. MHO took 0.9s. Estimated remaining: 3m 34s. Rate: 143.8 symbols/min [2025-10-01T22:42:21.941227] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-01T22:42:21.974944] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:22.035893] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-01T22:42:22.054590] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-01T22:42:22.069594] [INFO ] [MAIN ] Derivative Progress: 1076/1587 symbols completed. MIN took 1.0s. Estimated remaining: 3m 33s. Rate: 143.9 symbols/min [2025-10-01T22:42:22.082831] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:22.094050] [DEBUG] [LOCAL ] MITP: Loaded 2402 existing records from primary storage. [2025-10-01T22:42:22.128225] [INFO ] [MAIN ] MITP: Loaded 2402 primary data records. [2025-10-01T22:42:22.412526] [DEBUG] [LOCAL ] MITT: Loaded 22930 existing records from primary storage. [2025-10-01T22:42:22.413202] [INFO ] [MAIN ] MITT: Loaded 22930 primary data records. [2025-10-01T22:42:23.035516] [DEBUG] [MAIN ] MIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:23.037994] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51020 primary records. [2025-10-01T22:42:23.038335] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-01T22:42:23.061322] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-01T22:42:23.061716] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-01T22:42:23.064599] [INFO ] [MAIN ] Derivative Progress: 1077/1587 symbols completed. MIR took 1.4s. Estimated remaining: 3m 33s. Rate: 143.7 symbols/min [2025-10-01T22:42:23.066010] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:23.088199] [DEBUG] [MAIN ] MITP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:23.091566] [DEBUG] [LOCAL ] MIY: Loaded 5968 existing records from primary storage. [2025-10-01T22:42:23.092343] [INFO ] [MAIN ] MITP: Generated 1794 derivative records from 2402 primary records. [2025-10-01T22:42:23.092469] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-01T22:42:23.092539] [INFO ] [MAIN ] MIY: Loaded 5968 primary data records. [2025-10-01T22:42:23.217160] [DEBUG] [LOCAL ] MITP: Derivative data saved (1794 records). [2025-10-01T22:42:23.230410] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-01T22:42:23.233004] [INFO ] [MAIN ] Derivative Progress: 1078/1587 symbols completed. MITP took 1.3s. Estimated remaining: 3m 32s. Rate: 143.8 symbols/min [2025-10-01T22:42:23.251833] [DEBUG] [MAIN ] MITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:23.263122] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22930 primary records. [2025-10-01T22:42:23.268335] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-01T22:42:23.483964] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-01T22:42:23.484265] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-01T22:42:23.486972] [INFO ] [MAIN ] Derivative Progress: 1079/1587 symbols completed. MITT took 1.4s. Estimated remaining: 3m 32s. Rate: 143.9 symbols/min [2025-10-01T22:42:23.509992] [DEBUG] [MAIN ] MIY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:23.510750] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 5968 primary records. [2025-10-01T22:42:23.510826] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-01T22:42:23.526639] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-01T22:42:23.526843] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-01T22:42:23.529861] [INFO ] [MAIN ] Derivative Progress: 1080/1587 symbols completed. MIY took 0.5s. Estimated remaining: 3m 31s. Rate: 144.0 symbols/min [2025-10-01T22:42:23.530683] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:23.530808] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:23.531082] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:23.600019] [DEBUG] [LOCAL ] MKL: Loaded 34014 existing records from primary storage. [2025-10-01T22:42:23.615298] [INFO ] [MAIN ] MKL: Loaded 34014 primary data records. [2025-10-01T22:42:23.630428] [DEBUG] [LOCAL ] MLI: Loaded 43527 existing records from primary storage. [2025-10-01T22:42:23.647974] [INFO ] [MAIN ] MLI: Loaded 43527 primary data records. [2025-10-01T22:42:23.759057] [DEBUG] [LOCAL ] MKC: Loaded 52440 existing records from primary storage. [2025-10-01T22:42:23.781492] [INFO ] [MAIN ] MKC: Loaded 52440 primary data records. [2025-10-01T22:42:24.770258] [DEBUG] [MAIN ] MKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:24.771217] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34014 primary records. [2025-10-01T22:42:24.771443] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-01T22:42:24.802421] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-01T22:42:24.803871] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-01T22:42:24.803793] [DEBUG] [MAIN ] MLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:24.805850] [INFO ] [MAIN ] Derivative Progress: 1081/1587 symbols completed. MKL took 1.3s. Estimated remaining: 3m 31s. Rate: 143.7 symbols/min [2025-10-01T22:42:24.806832] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:24.807967] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43527 primary records. [2025-10-01T22:42:24.808123] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-01T22:42:24.836500] [DEBUG] [MAIN ] MKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:24.838080] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52440 primary records. [2025-10-01T22:42:24.838688] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-01T22:42:24.850083] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-01T22:42:24.853854] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-01T22:42:24.857516] [INFO ] [MAIN ] Derivative Progress: 1082/1587 symbols completed. MLI took 1.3s. Estimated remaining: 3m 31s. Rate: 143.8 symbols/min [2025-10-01T22:42:24.858672] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:24.871450] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-01T22:42:24.871600] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-01T22:42:24.874059] [INFO ] [MAIN ] Derivative Progress: 1083/1587 symbols completed. MKC took 1.3s. Estimated remaining: 3m 30s. Rate: 143.9 symbols/min [2025-10-01T22:42:24.874337] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:24.887939] [DEBUG] [LOCAL ] MLM: Loaded 29977 existing records from primary storage. [2025-10-01T22:42:24.888152] [INFO ] [MAIN ] MLM: Loaded 29977 primary data records. [2025-10-01T22:42:24.931594] [DEBUG] [LOCAL ] MLP: Loaded 2986 existing records from primary storage. [2025-10-01T22:42:24.968838] [INFO ] [MAIN ] MLP: Loaded 2986 primary data records. [2025-10-01T22:42:25.014427] [DEBUG] [LOCAL ] MLNK: Loaded 25390 existing records from primary storage. [2025-10-01T22:42:25.064287] [INFO ] [MAIN ] MLNK: Loaded 25390 primary data records. [2025-10-01T22:42:25.978619] [DEBUG] [MAIN ] MLM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:25.979943] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 29977 primary records. [2025-10-01T22:42:25.980795] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-01T22:42:26.014050] [DEBUG] [MAIN ] MLP: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-01T22:42:26.016200] [INFO ] [MAIN ] MLP: Generated 1792 derivative records from 2986 primary records. [2025-10-01T22:42:26.016308] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-01T22:42:26.030066] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-01T22:42:26.031206] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-01T22:42:26.030932] [DEBUG] [MAIN ] MLNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:26.037982] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25390 primary records. [2025-10-01T22:42:26.040042] [INFO ] [MAIN ] Derivative Progress: 1084/1587 symbols completed. MLM took 1.2s. Estimated remaining: 3m 30s. Rate: 143.7 symbols/min [2025-10-01T22:42:26.041296] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:26.041386] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-01T22:42:26.048687] [DEBUG] [LOCAL ] MLP: Derivative data saved (1792 records). [2025-10-01T22:42:26.049014] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-01T22:42:26.052196] [INFO ] [MAIN ] Derivative Progress: 1085/1587 symbols completed. MLP took 1.2s. Estimated remaining: 3m 29s. Rate: 143.8 symbols/min [2025-10-01T22:42:26.052786] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:26.073042] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-01T22:42:26.073204] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-01T22:42:26.075679] [INFO ] [MAIN ] Derivative Progress: 1086/1587 symbols completed. MLNK took 1.2s. Estimated remaining: 3m 29s. Rate: 144.0 symbols/min [2025-10-01T22:42:26.075899] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:26.082249] [DEBUG] [LOCAL ] MLR: Loaded 12504 existing records from primary storage. [2025-10-01T22:42:26.082379] [INFO ] [MAIN ] MLR: Loaded 12504 primary data records. [2025-10-01T22:42:26.206122] [DEBUG] [LOCAL ] MMD: Loaded 11388 existing records from primary storage. [2025-10-01T22:42:26.222104] [INFO ] [MAIN ] MMD: Loaded 11388 primary data records. [2025-10-01T22:42:26.588194] [DEBUG] [LOCAL ] MMC: Loaded 51794 existing records from primary storage. [2025-10-01T22:42:26.590059] [INFO ] [MAIN ] MMC: Loaded 51794 primary data records. [2025-10-01T22:42:27.252542] [DEBUG] [MAIN ] MLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:27.253857] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12504 primary records. [2025-10-01T22:42:27.253961] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-01T22:42:27.271701] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-01T22:42:27.271978] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-01T22:42:27.274271] [INFO ] [MAIN ] Derivative Progress: 1087/1587 symbols completed. MLR took 1.2s. Estimated remaining: 3m 29s. Rate: 143.7 symbols/min [2025-10-01T22:42:27.275556] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:27.294040] [DEBUG] [MAIN ] MMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:27.294908] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11388 primary records. [2025-10-01T22:42:27.295350] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-01T22:42:27.338623] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-01T22:42:27.339344] [DEBUG] [LOCAL ] MMI: Loaded 15098 existing records from primary storage. [2025-10-01T22:42:27.339447] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-01T22:42:27.339766] [DEBUG] [MAIN ] MMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:27.340679] [INFO ] [MAIN ] MMI: Loaded 15098 primary data records. [2025-10-01T22:42:27.342978] [INFO ] [MAIN ] Derivative Progress: 1088/1587 symbols completed. MMD took 1.3s. Estimated remaining: 3m 28s. Rate: 143.8 symbols/min [2025-10-01T22:42:27.340578] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51794 primary records. [2025-10-01T22:42:27.348715] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-01T22:42:27.348543] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:27.574135] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-01T22:42:27.579258] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-01T22:42:27.710872] [INFO ] [MAIN ] Derivative Progress: 1089/1587 symbols completed. MMC took 1.7s. Estimated remaining: 3m 28s. Rate: 143.8 symbols/min [2025-10-01T22:42:27.712251] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:27.768163] [DEBUG] [LOCAL ] MMS: Loaded 33864 existing records from primary storage. [2025-10-01T22:42:27.770083] [INFO ] [MAIN ] MMS: Loaded 33864 primary data records. [2025-10-01T22:42:27.888659] [DEBUG] [LOCAL ] MMM: Loaded 53167 existing records from primary storage. [2025-10-01T22:42:27.887347] [DEBUG] [MAIN ] MMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:27.888826] [INFO ] [MAIN ] MMM: Loaded 53167 primary data records. [2025-10-01T22:42:27.900030] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15098 primary records. [2025-10-01T22:42:27.929174] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-01T22:42:28.288772] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-01T22:42:28.314816] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-01T22:42:28.348974] [INFO ] [MAIN ] Derivative Progress: 1090/1587 symbols completed. MMI took 1.1s. Estimated remaining: 3m 27s. Rate: 143.8 symbols/min [2025-10-01T22:42:28.499435] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:28.520432] [DEBUG] [LOCAL ] MMT: Loaded 10794 existing records from primary storage. [2025-10-01T22:42:28.520591] [INFO ] [MAIN ] MMT: Loaded 10794 primary data records. [2025-10-01T22:42:28.690367] [DEBUG] [MAIN ] MMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:28.721408] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33864 primary records. [2025-10-01T22:42:28.741989] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-01T22:42:28.761366] [DEBUG] [MAIN ] MMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:28.776284] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53167 primary records. [2025-10-01T22:42:28.776448] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-01T22:42:28.948750] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-01T22:42:28.946753] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-01T22:42:28.949255] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-01T22:42:28.952247] [INFO ] [MAIN ] Derivative Progress: 1091/1587 symbols completed. MMM took 1.6s. Estimated remaining: 3m 27s. Rate: 143.7 symbols/min [2025-10-01T22:42:28.952623] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:28.952401] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-01T22:42:28.955065] [INFO ] [MAIN ] Derivative Progress: 1092/1587 symbols completed. MMS took 1.2s. Estimated remaining: 3m 26s. Rate: 143.8 symbols/min [2025-10-01T22:42:28.956110] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:28.978779] [DEBUG] [LOCAL ] MMU: Loaded 16842 existing records from primary storage. [2025-10-01T22:42:28.984276] [INFO ] [MAIN ] MMU: Loaded 16842 primary data records. [2025-10-01T22:42:29.003896] [DEBUG] [MAIN ] MMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:29.035977] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10794 primary records. [2025-10-01T22:42:29.062343] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-01T22:42:29.086922] [DEBUG] [LOCAL ] MNR: Loaded 24370 existing records from primary storage. [2025-10-01T22:42:29.104941] [INFO ] [MAIN ] MNR: Loaded 24370 primary data records. [2025-10-01T22:42:29.573209] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-01T22:42:29.640825] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-01T22:42:29.761393] [INFO ] [MAIN ] Derivative Progress: 1093/1587 symbols completed. MMT took 1.3s. Estimated remaining: 3m 26s. Rate: 143.7 symbols/min [2025-10-01T22:42:29.813436] [DEBUG] [MAIN ] MMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:29.814383] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16842 primary records. [2025-10-01T22:42:29.827502] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-01T22:42:29.827432] [DEBUG] [MAIN ] MNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:29.829160] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24370 primary records. [2025-10-01T22:42:29.829519] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-01T22:42:29.855029] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-01T22:42:29.860629] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-01T22:42:29.862541] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-01T22:42:29.865247] [INFO ] [MAIN ] Derivative Progress: 1094/1587 symbols completed. MMU took 0.9s. Estimated remaining: 3m 26s. Rate: 143.8 symbols/min [2025-10-01T22:42:29.865430] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-01T22:42:29.868496] [INFO ] [MAIN ] Derivative Progress: 1095/1587 symbols completed. MNR took 0.9s. Estimated remaining: 3m 25s. Rate: 143.9 symbols/min [2025-10-01T22:42:29.869047] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:29.868976] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:29.869265] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:29.942240] [DEBUG] [LOCAL ] MOD: Loaded 45228 existing records from primary storage. [2025-10-01T22:42:29.969272] [INFO ] [MAIN ] MOD: Loaded 45228 primary data records. [2025-10-01T22:42:29.995837] [DEBUG] [LOCAL ] MNSO: Loaded 44366 existing records from primary storage. [2025-10-01T22:42:29.988975] [DEBUG] [LOCAL ] MODG: Loaded 51528 existing records from primary storage. [2025-10-01T22:42:30.007608] [INFO ] [MAIN ] MNSO: Loaded 44366 primary data records. [2025-10-01T22:42:30.012886] [INFO ] [MAIN ] MODG: Loaded 51528 primary data records. [2025-10-01T22:42:31.030404] [DEBUG] [MAIN ] MOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:31.031288] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45228 primary records. [2025-10-01T22:42:31.031504] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-01T22:42:31.076884] [DEBUG] [MAIN ] MODG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:31.083411] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-01T22:42:31.082997] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51528 primary records. [2025-10-01T22:42:31.083922] [DEBUG] [MAIN ] MNSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:31.083564] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-01T22:42:31.085830] [INFO ] [MAIN ] Derivative Progress: 1096/1587 symbols completed. MOD took 1.2s. Estimated remaining: 3m 25s. Rate: 143.7 symbols/min [2025-10-01T22:42:31.086719] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44366 primary records. [2025-10-01T22:42:31.085986] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-01T22:42:31.086895] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-01T22:42:31.087358] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:31.121218] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-01T22:42:31.121934] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-01T22:42:31.125143] [INFO ] [MAIN ] Derivative Progress: 1097/1587 symbols completed. MNSO took 1.3s. Estimated remaining: 3m 24s. Rate: 143.8 symbols/min [2025-10-01T22:42:31.125846] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:31.126188] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-01T22:42:31.126551] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-01T22:42:31.129057] [INFO ] [MAIN ] Derivative Progress: 1098/1587 symbols completed. MODG took 1.3s. Estimated remaining: 3m 24s. Rate: 143.9 symbols/min [2025-10-01T22:42:31.129336] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:31.193510] [DEBUG] [LOCAL ] RWT: Loaded 40850 existing records from primary storage. [2025-10-01T22:42:31.193773] [INFO ] [MAIN ] RWT: Loaded 40850 primary data records. [2025-10-01T22:42:31.311844] [DEBUG] [LOCAL ] RVTY: Loaded 47521 existing records from primary storage. [2025-10-01T22:42:31.348036] [INFO ] [MAIN ] RVTY: Loaded 47521 primary data records. [2025-10-01T22:42:31.336712] [DEBUG] [LOCAL ] RTX: Loaded 53707 existing records from primary storage. [2025-10-01T22:42:31.377043] [INFO ] [MAIN ] RTX: Loaded 53707 primary data records. [2025-10-01T22:42:32.399001] [DEBUG] [MAIN ] RWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:32.400181] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40850 primary records. [2025-10-01T22:42:32.400367] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-01T22:42:32.420119] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-10-01T22:42:32.420752] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-01T22:42:32.425579] [INFO ] [MAIN ] Derivative Progress: 1099/1587 symbols completed. RWT took 1.3s. Estimated remaining: 3m 24s. Rate: 143.7 symbols/min [2025-10-01T22:42:32.427383] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:32.444837] [DEBUG] [MAIN ] RVTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:32.446123] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47521 primary records. [2025-10-01T22:42:32.460569] [DEBUG] [MAIN ] RTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:32.461445] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53707 primary records. [2025-10-01T22:42:32.461525] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-01T22:42:32.454679] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-10-01T22:42:32.500169] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-10-01T22:42:32.499024] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-10-01T22:42:32.500397] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-10-01T22:42:32.502875] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-10-01T22:42:32.502793] [INFO ] [MAIN ] Derivative Progress: 1100/1587 symbols completed. RTX took 1.4s. Estimated remaining: 3m 23s. Rate: 143.8 symbols/min [2025-10-01T22:42:32.506062] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:32.506256] [INFO ] [MAIN ] Derivative Progress: 1101/1587 symbols completed. RVTY took 1.4s. Estimated remaining: 3m 23s. Rate: 143.9 symbols/min [2025-10-01T22:42:32.506540] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:32.543469] [DEBUG] [LOCAL ] RXO: Loaded 47845 existing records from primary storage. [2025-10-01T22:42:32.543630] [INFO ] [MAIN ] RXO: Loaded 47845 primary data records. [2025-10-01T22:42:32.722939] [DEBUG] [LOCAL ] RYAM: Loaded 35046 existing records from primary storage. [2025-10-01T22:42:32.733548] [INFO ] [MAIN ] RYAM: Loaded 35046 primary data records. [2025-10-01T22:42:33.010111] [DEBUG] [LOCAL ] RY: Loaded 47873 existing records from primary storage. [2025-10-01T22:42:33.036085] [INFO ] [MAIN ] RY: Loaded 47873 primary data records. [2025-10-01T22:42:33.662158] [DEBUG] [MAIN ] RXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:33.663631] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47845 primary records. [2025-10-01T22:42:33.663808] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-01T22:42:33.685258] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-10-01T22:42:33.685615] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-01T22:42:33.687906] [INFO ] [MAIN ] Derivative Progress: 1102/1587 symbols completed. RXO took 1.3s. Estimated remaining: 3m 23s. Rate: 143.7 symbols/min [2025-10-01T22:42:33.688879] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:33.704084] [DEBUG] [MAIN ] RYAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:33.705134] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35046 primary records. [2025-10-01T22:42:33.705468] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-01T22:42:33.723535] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-10-01T22:42:33.724765] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-01T22:42:33.727715] [INFO ] [MAIN ] Derivative Progress: 1103/1587 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 22s. Rate: 143.8 symbols/min [2025-10-01T22:42:33.727895] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:33.744044] [DEBUG] [MAIN ] RY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:33.745060] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47873 primary records. [2025-10-01T22:42:33.745217] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-01T22:42:33.799218] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-10-01T22:42:33.799849] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-01T22:42:33.799747] [DEBUG] [LOCAL ] RYI: Loaded 21545 existing records from primary storage. [2025-10-01T22:42:33.802468] [INFO ] [MAIN ] Derivative Progress: 1104/1587 symbols completed. RY took 1.3s. Estimated remaining: 3m 21s. Rate: 143.9 symbols/min [2025-10-01T22:42:33.800045] [INFO ] [MAIN ] RYI: Loaded 21545 primary data records. [2025-10-01T22:42:33.803600] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:33.803260] [DEBUG] [LOCAL ] RYAN: Loaded 44469 existing records from primary storage. [2025-10-01T22:42:33.826353] [INFO ] [MAIN ] RYAN: Loaded 44469 primary data records. [2025-10-01T22:42:34.559871] [DEBUG] [LOCAL ] RYN: Loaded 45585 existing records from primary storage. [2025-10-01T22:42:34.560862] [INFO ] [MAIN ] RYN: Loaded 45585 primary data records. [2025-10-01T22:42:34.923811] [DEBUG] [MAIN ] RYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:34.937708] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21545 primary records. [2025-10-01T22:42:34.938406] [DEBUG] [MAIN ] RYAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:34.940231] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-01T22:42:34.940169] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44469 primary records. [2025-10-01T22:42:34.941478] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-01T22:42:34.975779] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-10-01T22:42:34.975953] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-01T22:42:34.974859] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-10-01T22:42:34.978522] [INFO ] [MAIN ] Derivative Progress: 1105/1587 symbols completed. RYI took 1.3s. Estimated remaining: 3m 21s. Rate: 143.7 symbols/min [2025-10-01T22:42:34.978982] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-01T22:42:34.978899] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:34.981459] [INFO ] [MAIN ] Derivative Progress: 1106/1587 symbols completed. RYAN took 1.3s. Estimated remaining: 3m 21s. Rate: 143.8 symbols/min [2025-10-01T22:42:34.981856] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:35.010470] [DEBUG] [LOCAL ] RZC: Loaded 6792 existing records from primary storage. [2025-10-01T22:42:35.010259] [DEBUG] [MAIN ] RYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:35.011552] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45585 primary records. [2025-10-01T22:42:35.014421] [DEBUG] [LOCAL ] RZB: Loaded 6201 existing records from primary storage. [2025-10-01T22:42:35.014531] [INFO ] [MAIN ] RZC: Loaded 6792 primary data records. [2025-10-01T22:42:35.019762] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-01T22:42:35.031731] [INFO ] [MAIN ] RZB: Loaded 6201 primary data records. [2025-10-01T22:42:35.264998] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-01T22:42:35.291611] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-01T22:42:35.345063] [INFO ] [MAIN ] Derivative Progress: 1107/1587 symbols completed. RYN took 1.5s. Estimated remaining: 3m 20s. Rate: 143.8 symbols/min [2025-10-01T22:42:35.433971] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:35.759888] [DEBUG] [MAIN ] RZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:35.761405] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6201 primary records. [2025-10-01T22:42:35.761691] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-01T22:42:35.762577] [DEBUG] [MAIN ] RZC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:35.763568] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6792 primary records. [2025-10-01T22:42:35.763689] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-01T22:42:35.796206] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-01T22:42:35.796568] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-01T22:42:35.796294] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-10-01T22:42:35.813363] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-01T22:42:35.798852] [INFO ] [MAIN ] Derivative Progress: 1108/1587 symbols completed. RZC took 0.8s. Estimated remaining: 3m 20s. Rate: 143.8 symbols/min [2025-10-01T22:42:35.817273] [INFO ] [MAIN ] Derivative Progress: 1109/1587 symbols completed. RZB took 0.8s. Estimated remaining: 3m 19s. Rate: 143.9 symbols/min [2025-10-01T22:42:35.818746] [DEBUG] [LOCAL ] S: Loaded 53535 existing records from primary storage. [2025-10-01T22:42:35.818843] [INFO ] [MAIN ] S: Loaded 53535 primary data records. [2025-10-01T22:42:36.163476] [DEBUG] [MAIN ] S: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:36.164140] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53535 primary records. [2025-10-01T22:42:36.164203] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-01T22:42:36.180081] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-01T22:42:36.180184] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-01T22:42:36.182284] [INFO ] [MAIN ] Derivative Progress: 1110/1587 symbols completed. S took 0.7s. Estimated remaining: 3m 19s. Rate: 143.9 symbols/min [2025-10-01T22:42:36.182825] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:36.182938] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:36.183280] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:36.198923] [DEBUG] [LOCAL ] SABA: Loaded 9259 existing records from primary storage. [2025-10-01T22:42:36.199113] [INFO ] [MAIN ] SABA: Loaded 9259 primary data records. [2025-10-01T22:42:36.389795] [DEBUG] [LOCAL ] SAFE: Loaded 30222 existing records from primary storage. [2025-10-01T22:42:36.410030] [INFO ] [MAIN ] SAFE: Loaded 30222 primary data records. [2025-10-01T22:42:36.661125] [DEBUG] [LOCAL ] SA: Loaded 43403 existing records from primary storage. [2025-10-01T22:42:36.687208] [INFO ] [MAIN ] SA: Loaded 43403 primary data records. [2025-10-01T22:42:37.272590] [DEBUG] [MAIN ] SABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:37.274133] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9259 primary records. [2025-10-01T22:42:37.274484] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-01T22:42:37.293918] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-10-01T22:42:37.294434] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-01T22:42:37.297861] [INFO ] [MAIN ] Derivative Progress: 1111/1587 symbols completed. SABA took 1.1s. Estimated remaining: 3m 19s. Rate: 143.7 symbols/min [2025-10-01T22:42:37.299927] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:37.315348] [DEBUG] [MAIN ] SAFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:37.316567] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30222 primary records. [2025-10-01T22:42:37.316901] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-01T22:42:37.343431] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-01T22:42:37.343912] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-01T22:42:37.346419] [INFO ] [MAIN ] Derivative Progress: 1112/1587 symbols completed. SAFE took 1.2s. Estimated remaining: 3m 18s. Rate: 143.8 symbols/min [2025-10-01T22:42:37.346739] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:37.360366] [DEBUG] [MAIN ] SA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:37.368469] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43403 primary records. [2025-10-01T22:42:37.368960] [DEBUG] [LOCAL ] SAH: Loaded 21928 existing records from primary storage. [2025-10-01T22:42:37.369130] [INFO ] [MAIN ] SAH: Loaded 21928 primary data records. [2025-10-01T22:42:37.369214] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-01T22:42:37.514268] [DEBUG] [LOCAL ] SAM: Loaded 21433 existing records from primary storage. [2025-10-01T22:42:37.519442] [INFO ] [MAIN ] SAM: Loaded 21433 primary data records. [2025-10-01T22:42:37.679881] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-01T22:42:37.842354] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-01T22:42:37.879099] [INFO ] [MAIN ] Derivative Progress: 1113/1587 symbols completed. SA took 1.7s. Estimated remaining: 3m 18s. Rate: 143.8 symbols/min [2025-10-01T22:42:37.880024] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:38.157518] [DEBUG] [MAIN ] SAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:38.158694] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21928 primary records. [2025-10-01T22:42:38.158948] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-01T22:42:38.198752] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-01T22:42:38.227530] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-01T22:42:38.228689] [DEBUG] [MAIN ] SAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:38.229725] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21433 primary records. [2025-10-01T22:42:38.233738] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-01T22:42:38.232050] [INFO ] [MAIN ] Derivative Progress: 1114/1587 symbols completed. SAH took 0.9s. Estimated remaining: 3m 17s. Rate: 143.8 symbols/min [2025-10-01T22:42:38.233612] [DEBUG] [LOCAL ] SAN: Loaded 52993 existing records from primary storage. [2025-10-01T22:42:38.234162] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:38.234061] [INFO ] [MAIN ] SAN: Loaded 52993 primary data records. [2025-10-01T22:42:38.438563] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-01T22:42:38.477572] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-01T22:42:38.647680] [INFO ] [MAIN ] Derivative Progress: 1115/1587 symbols completed. SAM took 1.3s. Estimated remaining: 3m 17s. Rate: 143.8 symbols/min [2025-10-01T22:42:38.648862] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:38.669350] [DEBUG] [LOCAL ] SAND: Loaded 51813 existing records from primary storage. [2025-10-01T22:42:38.669988] [INFO ] [MAIN ] SAND: Loaded 51813 primary data records. [2025-10-01T22:42:39.026922] [DEBUG] [LOCAL ] SAP: Loaded 50011 existing records from primary storage. [2025-10-01T22:42:39.029600] [INFO ] [MAIN ] SAP: Loaded 50011 primary data records. [2025-10-01T22:42:39.124914] [DEBUG] [MAIN ] SAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:39.166977] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52993 primary records. [2025-10-01T22:42:39.168099] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-01T22:42:39.407429] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-01T22:42:39.409567] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-01T22:42:39.412074] [INFO ] [MAIN ] Derivative Progress: 1116/1587 symbols completed. SAN took 1.5s. Estimated remaining: 3m 17s. Rate: 143.7 symbols/min [2025-10-01T22:42:39.413740] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:39.428540] [DEBUG] [MAIN ] SAND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:39.429849] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51813 primary records. [2025-10-01T22:42:39.430444] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-01T22:42:39.455110] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-10-01T22:42:39.455404] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-01T22:42:39.458005] [INFO ] [MAIN ] Derivative Progress: 1117/1587 symbols completed. SAND took 1.2s. Estimated remaining: 3m 16s. Rate: 143.8 symbols/min [2025-10-01T22:42:39.458393] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:39.465154] [DEBUG] [LOCAL ] SAR: Loaded 16209 existing records from primary storage. [2025-10-01T22:42:39.465398] [INFO ] [MAIN ] SAR: Loaded 16209 primary data records. [2025-10-01T22:42:39.631560] [DEBUG] [MAIN ] SAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:39.637937] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 50011 primary records. [2025-10-01T22:42:39.684981] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-01T22:42:39.867586] [DEBUG] [LOCAL ] SARO: Loaded 48609 existing records from primary storage. [2025-10-01T22:42:39.869990] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-01T22:42:39.870100] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-01T22:42:39.869626] [INFO ] [MAIN ] SARO: Loaded 48609 primary data records. [2025-10-01T22:42:39.873098] [INFO ] [MAIN ] Derivative Progress: 1118/1587 symbols completed. SAP took 1.2s. Estimated remaining: 3m 16s. Rate: 143.8 symbols/min [2025-10-01T22:42:39.878524] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:40.227487] [DEBUG] [LOCAL ] SB: Loaded 33223 existing records from primary storage. [2025-10-01T22:42:40.228700] [INFO ] [MAIN ] SB: Loaded 33223 primary data records. [2025-10-01T22:42:40.359669] [DEBUG] [MAIN ] SAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:40.360711] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16209 primary records. [2025-10-01T22:42:40.360900] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-01T22:42:40.638270] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-01T22:42:40.639397] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-01T22:42:40.642992] [INFO ] [MAIN ] Derivative Progress: 1119/1587 symbols completed. SAR took 1.2s. Estimated remaining: 3m 15s. Rate: 143.7 symbols/min [2025-10-01T22:42:40.644237] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:40.659327] [DEBUG] [MAIN ] SARO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:40.662698] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48609 primary records. [2025-10-01T22:42:40.662921] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-01T22:42:40.682551] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-01T22:42:40.682990] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-01T22:42:40.685123] [INFO ] [MAIN ] Derivative Progress: 1120/1587 symbols completed. SARO took 1.2s. Estimated remaining: 3m 15s. Rate: 143.8 symbols/min [2025-10-01T22:42:40.685939] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:40.696606] [DEBUG] [LOCAL ] SBI: Loaded 7603 existing records from primary storage. [2025-10-01T22:42:40.710099] [INFO ] [MAIN ] SBI: Loaded 7603 primary data records. [2025-10-01T22:42:40.779351] [DEBUG] [MAIN ] SB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:40.817214] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33223 primary records. [2025-10-01T22:42:40.846264] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-01T22:42:40.846197] [DEBUG] [LOCAL ] SBH: Loaded 49787 existing records from primary storage. [2025-10-01T22:42:40.854719] [INFO ] [MAIN ] SBH: Loaded 49787 primary data records. [2025-10-01T22:42:41.024828] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-01T22:42:41.074039] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-01T22:42:41.214918] [INFO ] [MAIN ] Derivative Progress: 1121/1587 symbols completed. SB took 1.3s. Estimated remaining: 3m 14s. Rate: 143.8 symbols/min [2025-10-01T22:42:41.238244] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:41.462667] [DEBUG] [LOCAL ] SBR: Loaded 7384 existing records from primary storage. [2025-10-01T22:42:41.464009] [INFO ] [MAIN ] SBR: Loaded 7384 primary data records. [2025-10-01T22:42:41.846960] [DEBUG] [MAIN ] SBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:41.848115] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7603 primary records. [2025-10-01T22:42:41.848780] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-01T22:42:41.875701] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-01T22:42:41.876229] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-01T22:42:41.894788] [INFO ] [MAIN ] Derivative Progress: 1122/1587 symbols completed. SBI took 1.2s. Estimated remaining: 3m 14s. Rate: 143.7 symbols/min [2025-10-01T22:42:41.895826] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:41.892406] [DEBUG] [MAIN ] SBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:41.897147] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49787 primary records. [2025-10-01T22:42:41.897969] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-01T22:42:41.916888] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-01T22:42:41.917116] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-01T22:42:41.919414] [INFO ] [MAIN ] Derivative Progress: 1123/1587 symbols completed. SBH took 1.3s. Estimated remaining: 3m 14s. Rate: 143.8 symbols/min [2025-10-01T22:42:41.938446] [DEBUG] [MAIN ] SBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:41.939279] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7384 primary records. [2025-10-01T22:42:41.939365] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-01T22:42:41.955710] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-01T22:42:41.966082] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-01T22:42:41.968585] [INFO ] [MAIN ] Derivative Progress: 1124/1587 symbols completed. SBR took 0.7s. Estimated remaining: 3m 13s. Rate: 143.9 symbols/min [2025-10-01T22:42:41.989904] [DEBUG] [LOCAL ] SBS: Loaded 49476 existing records from primary storage. [2025-10-01T22:42:41.990061] [INFO ] [MAIN ] SBS: Loaded 49476 primary data records. [2025-10-01T22:42:42.336606] [DEBUG] [MAIN ] SBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:42.337529] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49476 primary records. [2025-10-01T22:42:42.337613] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-01T22:42:42.355099] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-01T22:42:42.355191] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-01T22:42:42.357326] [INFO ] [MAIN ] Derivative Progress: 1125/1587 symbols completed. SBS took 0.5s. Estimated remaining: 3m 13s. Rate: 143.9 symbols/min [2025-10-01T22:42:42.357845] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:42.358125] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:42.357904] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:42.376340] [DEBUG] [LOCAL ] SBSI: Loaded 14756 existing records from primary storage. [2025-10-01T22:42:42.376498] [INFO ] [MAIN ] SBSI: Loaded 14756 primary data records. [2025-10-01T22:42:42.616064] [DEBUG] [LOCAL ] SCCO: Loaded 49412 existing records from primary storage. [2025-10-01T22:42:42.625624] [INFO ] [MAIN ] SCCO: Loaded 49412 primary data records. [2025-10-01T22:42:42.905417] [DEBUG] [LOCAL ] SBSW: Loaded 53034 existing records from primary storage. [2025-10-01T22:42:42.918872] [INFO ] [MAIN ] SBSW: Loaded 53034 primary data records. [2025-10-01T22:42:43.586752] [DEBUG] [MAIN ] SBSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:43.588560] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14756 primary records. [2025-10-01T22:42:43.589504] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-01T22:42:43.627862] [DEBUG] [MAIN ] SCCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:43.630312] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49412 primary records. [2025-10-01T22:42:43.633006] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-01T22:42:43.633596] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-01T22:42:43.634416] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-01T22:42:43.637473] [INFO ] [MAIN ] Derivative Progress: 1126/1587 symbols completed. SBSI took 1.3s. Estimated remaining: 3m 13s. Rate: 143.7 symbols/min [2025-10-01T22:42:43.638925] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:43.660701] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-01T22:42:43.660913] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-01T22:42:43.663725] [INFO ] [MAIN ] Derivative Progress: 1127/1587 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 12s. Rate: 143.8 symbols/min [2025-10-01T22:42:43.664039] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:43.695026] [DEBUG] [MAIN ] SBSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:43.695791] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53034 primary records. [2025-10-01T22:42:43.695941] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-01T22:42:43.701796] [DEBUG] [LOCAL ] SCD: Loaded 12798 existing records from primary storage. [2025-10-01T22:42:43.702673] [INFO ] [MAIN ] SCD: Loaded 12798 primary data records. [2025-10-01T22:42:43.766919] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-01T22:42:43.772679] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-01T22:42:43.793493] [INFO ] [MAIN ] Derivative Progress: 1128/1587 symbols completed. SBSW took 1.4s. Estimated remaining: 3m 11s. Rate: 143.9 symbols/min [2025-10-01T22:42:43.838705] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:44.084821] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-01T22:42:44.094063] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-01T22:42:44.381874] [DEBUG] [LOCAL ] SCI: Loaded 46432 existing records from primary storage. [2025-10-01T22:42:44.522334] [INFO ] [MAIN ] SCI: Loaded 46432 primary data records. [2025-10-01T22:42:44.631271] [DEBUG] [MAIN ] SCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:44.666265] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12798 primary records. [2025-10-01T22:42:44.680761] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-01T22:42:44.941983] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-01T22:42:44.942880] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-01T22:42:44.945823] [INFO ] [MAIN ] Derivative Progress: 1129/1587 symbols completed. SCD took 1.3s. Estimated remaining: 3m 11s. Rate: 143.7 symbols/min [2025-10-01T22:42:44.946760] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:44.973015] [DEBUG] [MAIN ] SCHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:44.973814] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-01T22:42:44.974001] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-01T22:42:45.003949] [DEBUG] [LOCAL ] SCL: Loaded 14887 existing records from primary storage. [2025-10-01T22:42:45.005845] [INFO ] [MAIN ] SCL: Loaded 14887 primary data records. [2025-10-01T22:42:45.004559] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-01T22:42:45.031062] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-01T22:42:45.046730] [INFO ] [MAIN ] Derivative Progress: 1130/1587 symbols completed. SCHW took 1.4s. Estimated remaining: 3m 11s. Rate: 143.8 symbols/min [2025-10-01T22:42:45.060903] [DEBUG] [MAIN ] SCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:45.061034] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:45.081009] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46432 primary records. [2025-10-01T22:42:45.099346] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-01T22:42:45.413044] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-01T22:42:45.413372] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-01T22:42:45.415607] [INFO ] [MAIN ] Derivative Progress: 1131/1587 symbols completed. SCI took 1.6s. Estimated remaining: 3m 10s. Rate: 143.8 symbols/min [2025-10-01T22:42:45.415814] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:45.427924] [DEBUG] [LOCAL ] SCM: Loaded 19787 existing records from primary storage. [2025-10-01T22:42:45.429078] [INFO ] [MAIN ] SCM: Loaded 19787 primary data records. [2025-10-01T22:42:45.812131] [DEBUG] [LOCAL ] SCS: Loaded 43438 existing records from primary storage. [2025-10-01T22:42:45.814507] [INFO ] [MAIN ] SCS: Loaded 43438 primary data records. [2025-10-01T22:42:45.874896] [DEBUG] [MAIN ] SCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:45.881407] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14887 primary records. [2025-10-01T22:42:45.888699] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-01T22:42:45.978573] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-01T22:42:45.985328] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-01T22:42:46.003828] [INFO ] [MAIN ] Derivative Progress: 1132/1587 symbols completed. SCL took 1.1s. Estimated remaining: 3m 10s. Rate: 143.7 symbols/min [2025-10-01T22:42:46.019710] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:46.223818] [DEBUG] [MAIN ] SCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:46.225436] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19787 primary records. [2025-10-01T22:42:46.225955] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-01T22:42:46.244701] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-01T22:42:46.253945] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-01T22:42:46.256890] [INFO ] [MAIN ] Derivative Progress: 1133/1587 symbols completed. SCM took 1.2s. Estimated remaining: 3m 9s. Rate: 143.8 symbols/min [2025-10-01T22:42:46.257681] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:46.294944] [DEBUG] [LOCAL ] SDHC: Loaded 10361 existing records from primary storage. [2025-10-01T22:42:46.294311] [DEBUG] [LOCAL ] SD: Loaded 28680 existing records from primary storage. [2025-10-01T22:42:46.295283] [DEBUG] [MAIN ] SCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:46.296294] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43438 primary records. [2025-10-01T22:42:46.295545] [INFO ] [MAIN ] SDHC: Loaded 10361 primary data records. [2025-10-01T22:42:46.296393] [INFO ] [MAIN ] SD: Loaded 28680 primary data records. [2025-10-01T22:42:46.296692] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-01T22:42:46.625156] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-01T22:42:46.662212] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-01T22:42:46.811244] [INFO ] [MAIN ] Derivative Progress: 1134/1587 symbols completed. SCS took 1.4s. Estimated remaining: 3m 9s. Rate: 143.7 symbols/min [2025-10-01T22:42:46.860515] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:47.000698] [DEBUG] [LOCAL ] SDHY: Loaded 10584 existing records from primary storage. [2025-10-01T22:42:47.001593] [INFO ] [MAIN ] SDHY: Loaded 10584 primary data records. [2025-10-01T22:42:47.419615] [DEBUG] [MAIN ] SDHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:47.421013] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10361 primary records. [2025-10-01T22:42:47.421260] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-01T22:42:47.448789] [DEBUG] [MAIN ] SD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:47.460863] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28680 primary records. [2025-10-01T22:42:47.461352] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-01T22:42:47.459724] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-01T22:42:47.462565] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-01T22:42:47.464928] [INFO ] [MAIN ] Derivative Progress: 1135/1587 symbols completed. SDHC took 1.2s. Estimated remaining: 3m 9s. Rate: 143.7 symbols/min [2025-10-01T22:42:47.465135] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:47.484684] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-01T22:42:47.485047] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-01T22:42:47.487862] [INFO ] [MAIN ] Derivative Progress: 1136/1587 symbols completed. SD took 1.5s. Estimated remaining: 3m 8s. Rate: 143.8 symbols/min [2025-10-01T22:42:47.488284] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:47.507861] [DEBUG] [MAIN ] SDHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:47.508747] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10584 primary records. [2025-10-01T22:42:47.508950] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-01T22:42:47.526137] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-01T22:42:47.526356] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-01T22:42:47.528897] [INFO ] [MAIN ] Derivative Progress: 1137/1587 symbols completed. SDHY took 0.7s. Estimated remaining: 3m 8s. Rate: 143.9 symbols/min [2025-10-01T22:42:47.529291] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:47.573732] [DEBUG] [LOCAL ] SDRL: Loaded 41610 existing records from primary storage. [2025-10-01T22:42:47.574123] [INFO ] [MAIN ] SDRL: Loaded 41610 primary data records. [2025-10-01T22:42:47.702221] [DEBUG] [LOCAL ] SE: Loaded 53362 existing records from primary storage. [2025-10-01T22:42:47.727292] [INFO ] [MAIN ] SE: Loaded 53362 primary data records. [2025-10-01T22:42:47.914165] [DEBUG] [LOCAL ] SEE: Loaded 48272 existing records from primary storage. [2025-10-01T22:42:48.059172] [INFO ] [MAIN ] SEE: Loaded 48272 primary data records. [2025-10-01T22:42:48.670078] [DEBUG] [MAIN ] SDRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:48.672475] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41610 primary records. [2025-10-01T22:42:48.672624] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-01T22:42:48.696298] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-01T22:42:48.710530] [DEBUG] [MAIN ] SE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:48.710630] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-01T22:42:48.712946] [INFO ] [MAIN ] Derivative Progress: 1138/1587 symbols completed. SDRL took 1.2s. Estimated remaining: 3m 8s. Rate: 143.7 symbols/min [2025-10-01T22:42:48.713871] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53362 primary records. [2025-10-01T22:42:48.714296] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-01T22:42:48.734094] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-10-01T22:42:48.734316] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-01T22:42:48.737115] [INFO ] [MAIN ] Derivative Progress: 1139/1587 symbols completed. SE took 1.2s. Estimated remaining: 3m 7s. Rate: 143.8 symbols/min [2025-10-01T22:42:48.752442] [DEBUG] [MAIN ] SEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:48.753306] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48272 primary records. [2025-10-01T22:42:48.753370] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-01T22:42:48.769797] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-01T22:42:48.769884] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-01T22:42:48.772585] [INFO ] [MAIN ] Derivative Progress: 1140/1587 symbols completed. SEE took 1.2s. Estimated remaining: 3m 6s. Rate: 143.9 symbols/min [2025-10-01T22:42:48.773040] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:48.773188] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:48.773602] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:48.790085] [DEBUG] [LOCAL ] SEG: Loaded 13650 existing records from primary storage. [2025-10-01T22:42:48.790247] [INFO ] [MAIN ] SEG: Loaded 13650 primary data records. [2025-10-01T22:42:49.091603] [DEBUG] [LOCAL ] SEM: Loaded 42748 existing records from primary storage. [2025-10-01T22:42:49.130148] [DEBUG] [LOCAL ] SEI: Loaded 49654 existing records from primary storage. [2025-10-01T22:42:49.186408] [INFO ] [MAIN ] SEI: Loaded 49654 primary data records. [2025-10-01T22:42:49.186270] [INFO ] [MAIN ] SEM: Loaded 42748 primary data records. [2025-10-01T22:42:49.999284] [DEBUG] [MAIN ] SEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:50.001592] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13650 primary records. [2025-10-01T22:42:50.002796] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-01T22:42:50.025946] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-01T22:42:50.026912] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-01T22:42:50.029191] [INFO ] [MAIN ] Derivative Progress: 1141/1587 symbols completed. SEG took 1.3s. Estimated remaining: 3m 6s. Rate: 143.6 symbols/min [2025-10-01T22:42:50.030376] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:50.056195] [DEBUG] [MAIN ] SEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:50.057586] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49654 primary records. [2025-10-01T22:42:50.057746] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-01T22:42:50.098951] [DEBUG] [MAIN ] SEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:50.100695] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42748 primary records. [2025-10-01T22:42:50.100855] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-01T22:42:50.111441] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-01T22:42:50.113598] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-01T22:42:50.116590] [INFO ] [MAIN ] Derivative Progress: 1142/1587 symbols completed. SEI took 1.3s. Estimated remaining: 3m 6s. Rate: 143.7 symbols/min [2025-10-01T22:42:50.132254] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:50.137874] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-01T22:42:50.138342] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-01T22:42:50.141088] [INFO ] [MAIN ] Derivative Progress: 1143/1587 symbols completed. SEM took 1.4s. Estimated remaining: 3m 5s. Rate: 143.9 symbols/min [2025-10-01T22:42:50.141397] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:50.143138] [DEBUG] [LOCAL ] SEMR: Loaded 41589 existing records from primary storage. [2025-10-01T22:42:50.143379] [INFO ] [MAIN ] SEMR: Loaded 41589 primary data records. [2025-10-01T22:42:50.528549] [DEBUG] [LOCAL ] SF: Loaded 41562 existing records from primary storage. [2025-10-01T22:42:50.529500] [INFO ] [MAIN ] SF: Loaded 41562 primary data records. [2025-10-01T22:42:50.531043] [DEBUG] [LOCAL ] SES: Loaded 51558 existing records from primary storage. [2025-10-01T22:42:50.531462] [INFO ] [MAIN ] SES: Loaded 51558 primary data records. [2025-10-01T22:42:51.234609] [DEBUG] [MAIN ] SEMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:51.236185] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41589 primary records. [2025-10-01T22:42:51.236740] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-01T22:42:51.258965] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-01T22:42:51.259100] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-01T22:42:51.261778] [INFO ] [MAIN ] Derivative Progress: 1144/1587 symbols completed. SEMR took 1.2s. Estimated remaining: 3m 5s. Rate: 143.7 symbols/min [2025-10-01T22:42:51.262094] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:51.273244] [DEBUG] [LOCAL ] SFB: Loaded 4130 existing records from primary storage. [2025-10-01T22:42:51.275818] [INFO ] [MAIN ] SFB: Loaded 4130 primary data records. [2025-10-01T22:42:51.330280] [DEBUG] [MAIN ] SES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:51.359210] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51558 primary records. [2025-10-01T22:42:51.399068] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-01T22:42:51.400917] [DEBUG] [MAIN ] SF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:51.414627] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41562 primary records. [2025-10-01T22:42:51.419936] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-01T22:42:51.512135] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-01T22:42:51.526259] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-01T22:42:51.536100] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-01T22:42:51.565741] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-01T22:42:51.565584] [INFO ] [MAIN ] Derivative Progress: 1145/1587 symbols completed. SES took 1.4s. Estimated remaining: 3m 5s. Rate: 143.7 symbols/min [2025-10-01T22:42:51.665981] [INFO ] [MAIN ] Derivative Progress: 1146/1587 symbols completed. SF took 1.5s. Estimated remaining: 3m 4s. Rate: 143.8 symbols/min [2025-10-01T22:42:51.663006] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:51.693973] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:51.724376] [DEBUG] [LOCAL ] SFBS: Loaded 21055 existing records from primary storage. [2025-10-01T22:42:51.724877] [INFO ] [MAIN ] SFBS: Loaded 21055 primary data records. [2025-10-01T22:42:51.767734] [DEBUG] [MAIN ] SFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:51.800201] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4130 primary records. [2025-10-01T22:42:51.852352] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-01T22:42:51.948048] [DEBUG] [LOCAL ] SFL: Loaded 45252 existing records from primary storage. [2025-10-01T22:42:51.979048] [INFO ] [MAIN ] SFL: Loaded 45252 primary data records. [2025-10-01T22:42:52.222045] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-01T22:42:52.243198] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-01T22:42:52.257619] [INFO ] [MAIN ] Derivative Progress: 1147/1587 symbols completed. SFB took 1.0s. Estimated remaining: 3m 4s. Rate: 143.7 symbols/min [2025-10-01T22:42:52.269030] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:52.597012] [DEBUG] [MAIN ] SFBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:52.597910] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21055 primary records. [2025-10-01T22:42:52.598163] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-01T22:42:52.634422] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-10-01T22:42:52.633033] [DEBUG] [LOCAL ] SG: Loaded 53451 existing records from primary storage. [2025-10-01T22:42:52.635048] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-01T22:42:52.635353] [INFO ] [MAIN ] SG: Loaded 53451 primary data records. [2025-10-01T22:42:52.637814] [INFO ] [MAIN ] Derivative Progress: 1148/1587 symbols completed. SFBS took 1.0s. Estimated remaining: 3m 3s. Rate: 143.7 symbols/min [2025-10-01T22:42:52.638212] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:52.767795] [DEBUG] [MAIN ] SFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:52.789539] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45252 primary records. [2025-10-01T22:42:52.814701] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-01T22:42:53.006579] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-01T22:42:53.007505] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-01T22:42:53.023677] [INFO ] [MAIN ] Derivative Progress: 1149/1587 symbols completed. SFL took 1.3s. Estimated remaining: 3m 3s. Rate: 143.8 symbols/min [2025-10-01T22:42:53.025858] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:53.027427] [DEBUG] [LOCAL ] SGHC: Loaded 46072 existing records from primary storage. [2025-10-01T22:42:53.028045] [INFO ] [MAIN ] SGHC: Loaded 46072 primary data records. [2025-10-01T22:42:53.096122] [DEBUG] [LOCAL ] SGU: Loaded 6708 existing records from primary storage. [2025-10-01T22:42:53.129994] [INFO ] [MAIN ] SGU: Loaded 6708 primary data records. [2025-10-01T22:42:53.475327] [DEBUG] [MAIN ] SG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:53.613335] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53451 primary records. [2025-10-01T22:42:53.618322] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-01T22:42:53.767981] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-01T22:42:53.769216] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-01T22:42:53.771780] [INFO ] [MAIN ] Derivative Progress: 1150/1587 symbols completed. SG took 1.5s. Estimated remaining: 3m 3s. Rate: 143.7 symbols/min [2025-10-01T22:42:53.772510] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:53.800524] [DEBUG] [MAIN ] SGHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:53.801714] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 46072 primary records. [2025-10-01T22:42:53.801900] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-01T22:42:53.818448] [DEBUG] [MAIN ] SGU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:53.830716] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6708 primary records. [2025-10-01T22:42:53.833619] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-01T22:42:53.835952] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-01T22:42:53.836376] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-01T22:42:53.838756] [INFO ] [MAIN ] Derivative Progress: 1151/1587 symbols completed. SGHC took 1.2s. Estimated remaining: 3m 2s. Rate: 143.8 symbols/min [2025-10-01T22:42:53.839288] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:53.867556] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-01T22:42:53.867731] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-01T22:42:53.870243] [INFO ] [MAIN ] Derivative Progress: 1152/1587 symbols completed. SGU took 0.8s. Estimated remaining: 3m 1s. Rate: 143.9 symbols/min [2025-10-01T22:42:53.870690] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:53.895203] [DEBUG] [LOCAL ] SHAK: Loaded 48937 existing records from primary storage. [2025-10-01T22:42:53.895487] [INFO ] [MAIN ] SHAK: Loaded 48937 primary data records. [2025-10-01T22:42:53.991887] [DEBUG] [LOCAL ] SHCO: Loaded 25860 existing records from primary storage. [2025-10-01T22:42:54.023906] [INFO ] [MAIN ] SHCO: Loaded 25860 primary data records. [2025-10-01T22:42:54.447023] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-10-01T22:42:54.453120] [INFO ] [MAIN ] SHEL: Loaded 53671 primary data records. [2025-10-01T22:42:55.014638] [DEBUG] [MAIN ] SHAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:55.015548] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48937 primary records. [2025-10-01T22:42:55.015786] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-01T22:42:55.038109] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-01T22:42:55.051676] [DEBUG] [MAIN ] SHCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:55.052536] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25860 primary records. [2025-10-01T22:42:55.051263] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-01T22:42:55.052707] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-01T22:42:55.055076] [INFO ] [MAIN ] Derivative Progress: 1153/1587 symbols completed. SHAK took 1.3s. Estimated remaining: 3m 1s. Rate: 143.6 symbols/min [2025-10-01T22:42:55.086126] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-01T22:42:55.086230] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-01T22:42:55.088727] [INFO ] [MAIN ] Derivative Progress: 1154/1587 symbols completed. SHCO took 1.2s. Estimated remaining: 3m 1s. Rate: 143.8 symbols/min [2025-10-01T22:42:55.086060] [DEBUG] [MAIN ] SHEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:55.089536] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53671 primary records. [2025-10-01T22:42:55.089600] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-01T22:42:55.105565] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-01T22:42:55.105754] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-01T22:42:55.108377] [INFO ] [MAIN ] Derivative Progress: 1155/1587 symbols completed. SHEL took 1.2s. Estimated remaining: 3m 0s. Rate: 143.9 symbols/min [2025-10-01T22:42:55.108900] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:55.108970] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:55.109097] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:55.115377] [DEBUG] [LOCAL ] SHOC: Loaded 3478 existing records from primary storage. [2025-10-01T22:42:55.115520] [INFO ] [MAIN ] SHOC: Loaded 3478 primary data records. [2025-10-01T22:42:55.334492] [DEBUG] [LOCAL ] SHG: Loaded 26523 existing records from primary storage. [2025-10-01T22:42:55.373993] [INFO ] [MAIN ] SHG: Loaded 26523 primary data records. [2025-10-01T22:42:55.566783] [DEBUG] [LOCAL ] SHO: Loaded 49689 existing records from primary storage. [2025-10-01T22:42:55.586061] [INFO ] [MAIN ] SHO: Loaded 49689 primary data records. [2025-10-01T22:42:56.249903] [DEBUG] [MAIN ] SHOC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:42:56.251014] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3478 primary records. [2025-10-01T22:42:56.251491] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-01T22:42:56.274520] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-01T22:42:56.276702] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-01T22:42:56.279584] [INFO ] [MAIN ] Derivative Progress: 1156/1587 symbols completed. SHOC took 1.2s. Estimated remaining: 3m 0s. Rate: 143.7 symbols/min [2025-10-01T22:42:56.280047] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:56.295536] [DEBUG] [MAIN ] SHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:56.297362] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26523 primary records. [2025-10-01T22:42:56.298339] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-01T22:42:56.320735] [DEBUG] [MAIN ] SHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:56.322908] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49689 primary records. [2025-10-01T22:42:56.325856] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-01T22:42:56.345632] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-01T22:42:56.346297] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-01T22:42:56.349468] [INFO ] [MAIN ] Derivative Progress: 1157/1587 symbols completed. SHG took 1.2s. Estimated remaining: 2m 59s. Rate: 143.8 symbols/min [2025-10-01T22:42:56.349912] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:56.353442] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-01T22:42:56.353622] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-01T22:42:56.356497] [INFO ] [MAIN ] Derivative Progress: 1158/1587 symbols completed. SHO took 1.2s. Estimated remaining: 2m 59s. Rate: 143.9 symbols/min [2025-10-01T22:42:56.356927] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:56.396309] [DEBUG] [LOCAL ] SHW: Loaded 50319 existing records from primary storage. [2025-10-01T22:42:56.405432] [INFO ] [MAIN ] SHW: Loaded 50319 primary data records. [2025-10-01T22:42:56.552318] [DEBUG] [LOCAL ] SID: Loaded 42317 existing records from primary storage. [2025-10-01T22:42:56.564387] [INFO ] [MAIN ] SID: Loaded 42317 primary data records. [2025-10-01T22:42:56.696268] [DEBUG] [LOCAL ] SIG: Loaded 46221 existing records from primary storage. [2025-10-01T22:42:56.835855] [INFO ] [MAIN ] SIG: Loaded 46221 primary data records. [2025-10-01T22:42:57.554552] [DEBUG] [MAIN ] SHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:57.556029] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50319 primary records. [2025-10-01T22:42:57.556352] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-01T22:42:57.596672] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-01T22:42:57.597328] [DEBUG] [MAIN ] SID: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:57.597043] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-01T22:42:57.599862] [INFO ] [MAIN ] Derivative Progress: 1159/1587 symbols completed. SHW took 1.3s. Estimated remaining: 2m 59s. Rate: 143.6 symbols/min [2025-10-01T22:42:57.601022] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42317 primary records. [2025-10-01T22:42:57.601122] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:57.601305] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-01T22:42:57.625866] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-01T22:42:57.626280] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-01T22:42:57.628960] [INFO ] [MAIN ] Derivative Progress: 1160/1587 symbols completed. SID took 1.3s. Estimated remaining: 2m 58s. Rate: 143.7 symbols/min [2025-10-01T22:42:57.643024] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:57.643573] [DEBUG] [MAIN ] SIG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:42:57.651423] [INFO ] [MAIN ] SIG: Generated 1793 derivative records from 46221 primary records. [2025-10-01T22:42:57.651761] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-01T22:42:57.680197] [DEBUG] [LOCAL ] SII: Loaded 23579 existing records from primary storage. [2025-10-01T22:42:57.680450] [INFO ] [MAIN ] SII: Loaded 23579 primary data records. [2025-10-01T22:42:57.679560] [DEBUG] [LOCAL ] SIG: Derivative data saved (1793 records). [2025-10-01T22:42:57.680716] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-01T22:42:57.683532] [INFO ] [MAIN ] Derivative Progress: 1161/1587 symbols completed. SIG took 1.3s. Estimated remaining: 2m 58s. Rate: 143.9 symbols/min [2025-10-01T22:42:57.707129] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:57.826835] [DEBUG] [LOCAL ] SILA: Loaded 30819 existing records from primary storage. [2025-10-01T22:42:57.839928] [INFO ] [MAIN ] SILA: Loaded 30819 primary data records. [2025-10-01T22:42:58.297517] [DEBUG] [LOCAL ] SITC: Loaded 41600 existing records from primary storage. [2025-10-01T22:42:58.421006] [INFO ] [MAIN ] SITC: Loaded 41600 primary data records. [2025-10-01T22:42:58.865708] [DEBUG] [MAIN ] SII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:58.867399] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23579 primary records. [2025-10-01T22:42:58.867540] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-01T22:42:58.890443] [DEBUG] [MAIN ] SILA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:58.898701] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30819 primary records. [2025-10-01T22:42:58.899768] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-01T22:42:58.900152] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-01T22:42:58.901106] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-01T22:42:58.903548] [INFO ] [MAIN ] Derivative Progress: 1162/1587 symbols completed. SII took 1.3s. Estimated remaining: 2m 58s. Rate: 143.6 symbols/min [2025-10-01T22:42:58.903985] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:58.922913] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-01T22:42:58.923273] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-01T22:42:58.925937] [INFO ] [MAIN ] Derivative Progress: 1163/1587 symbols completed. SILA took 1.3s. Estimated remaining: 2m 57s. Rate: 143.7 symbols/min [2025-10-01T22:42:58.926403] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:58.945408] [DEBUG] [MAIN ] SITC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:42:58.956197] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41600 primary records. [2025-10-01T22:42:58.956431] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-01T22:42:58.986241] [DEBUG] [LOCAL ] SITE: Loaded 35012 existing records from primary storage. [2025-10-01T22:42:58.986815] [INFO ] [MAIN ] SITE: Loaded 35012 primary data records. [2025-10-01T22:42:58.988366] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-01T22:42:59.012500] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-01T22:42:59.048285] [INFO ] [MAIN ] Derivative Progress: 1164/1587 symbols completed. SITC took 1.3s. Estimated remaining: 2m 56s. Rate: 143.8 symbols/min [2025-10-01T22:42:59.105351] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:42:59.371712] [DEBUG] [LOCAL ] SJM: Loaded 50162 existing records from primary storage. [2025-10-01T22:42:59.372097] [INFO ] [MAIN ] SJM: Loaded 50162 primary data records. [2025-10-01T22:42:59.429397] [DEBUG] [LOCAL ] SJT: Loaded 22413 existing records from primary storage. [2025-10-01T22:42:59.486516] [INFO ] [MAIN ] SJT: Loaded 22413 primary data records. [2025-10-01T22:43:00.119165] [DEBUG] [MAIN ] SITE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:00.120369] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35012 primary records. [2025-10-01T22:43:00.120604] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-01T22:43:00.146913] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-01T22:43:00.149014] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-01T22:43:00.152161] [INFO ] [MAIN ] Derivative Progress: 1165/1587 symbols completed. SITE took 1.2s. Estimated remaining: 2m 56s. Rate: 143.6 symbols/min [2025-10-01T22:43:00.152898] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:00.169595] [DEBUG] [MAIN ] SJM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:00.170490] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50162 primary records. [2025-10-01T22:43:00.170707] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-01T22:43:00.192810] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-01T22:43:00.193469] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-01T22:43:00.210564] [INFO ] [MAIN ] Derivative Progress: 1166/1587 symbols completed. SJM took 1.3s. Estimated remaining: 2m 56s. Rate: 143.7 symbols/min [2025-10-01T22:43:00.212266] [DEBUG] [MAIN ] SJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:00.213171] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22413 primary records. [2025-10-01T22:43:00.213334] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:00.213616] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-01T22:43:00.243300] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-01T22:43:00.243466] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-01T22:43:00.246151] [INFO ] [MAIN ] Derivative Progress: 1167/1587 symbols completed. SJT took 1.1s. Estimated remaining: 2m 55s. Rate: 143.8 symbols/min [2025-10-01T22:43:00.250766] [DEBUG] [LOCAL ] SKIL: Loaded 6339 existing records from primary storage. [2025-10-01T22:43:00.262432] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:00.264328] [DEBUG] [LOCAL ] SKE: Loaded 35974 existing records from primary storage. [2025-10-01T22:43:00.262784] [INFO ] [MAIN ] SKIL: Loaded 6339 primary data records. [2025-10-01T22:43:00.264758] [INFO ] [MAIN ] SKE: Loaded 35974 primary data records. [2025-10-01T22:43:00.537834] [DEBUG] [LOCAL ] SKLZ: Loaded 11725 existing records from primary storage. [2025-10-01T22:43:00.597316] [INFO ] [MAIN ] SKLZ: Loaded 11725 primary data records. [2025-10-01T22:43:01.423517] [DEBUG] [MAIN ] SKIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:01.424071] [DEBUG] [MAIN ] SKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:01.425317] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6339 primary records. [2025-10-01T22:43:01.426492] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35974 primary records. [2025-10-01T22:43:01.426732] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-01T22:43:01.426630] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-01T22:43:01.459431] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-01T22:43:01.460798] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-01T22:43:01.466911] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-01T22:43:01.467375] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-01T22:43:01.465586] [INFO ] [MAIN ] Derivative Progress: 1168/1587 symbols completed. SKE took 1.3s. Estimated remaining: 2m 55s. Rate: 143.6 symbols/min [2025-10-01T22:43:01.470691] [INFO ] [MAIN ] Derivative Progress: 1169/1587 symbols completed. SKIL took 1.3s. Estimated remaining: 2m 55s. Rate: 143.7 symbols/min [2025-10-01T22:43:01.486119] [DEBUG] [MAIN ] SKLZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:01.486860] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11725 primary records. [2025-10-01T22:43:01.486924] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-01T22:43:01.502638] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-01T22:43:01.502744] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-01T22:43:01.505578] [INFO ] [MAIN ] Derivative Progress: 1170/1587 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 54s. Rate: 143.8 symbols/min [2025-10-01T22:43:01.506571] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:01.506513] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:01.506461] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:01.570739] [DEBUG] [LOCAL ] SKY: Loaded 37776 existing records from primary storage. [2025-10-01T22:43:01.571023] [INFO ] [MAIN ] SKY: Loaded 37776 primary data records. [2025-10-01T22:43:01.719504] [DEBUG] [LOCAL ] SKT: Loaded 42490 existing records from primary storage. [2025-10-01T22:43:01.718815] [DEBUG] [LOCAL ] SKM: Loaded 34920 existing records from primary storage. [2025-10-01T22:43:01.719883] [INFO ] [MAIN ] SKT: Loaded 42490 primary data records. [2025-10-01T22:43:01.720140] [INFO ] [MAIN ] SKM: Loaded 34920 primary data records. [2025-10-01T22:43:02.690017] [DEBUG] [MAIN ] SKY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:02.691751] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37776 primary records. [2025-10-01T22:43:02.691866] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-01T22:43:02.731752] [DEBUG] [MAIN ] SKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:02.733244] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42490 primary records. [2025-10-01T22:43:02.733467] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-01T22:43:02.749878] [DEBUG] [MAIN ] SKM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:02.748837] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-01T22:43:02.750785] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 34920 primary records. [2025-10-01T22:43:02.751139] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-01T22:43:02.760969] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-01T22:43:02.753528] [INFO ] [MAIN ] Derivative Progress: 1171/1587 symbols completed. SKY took 1.2s. Estimated remaining: 2m 54s. Rate: 143.6 symbols/min [2025-10-01T22:43:02.766151] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:02.785257] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-01T22:43:02.787953] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-01T22:43:02.794750] [INFO ] [MAIN ] Derivative Progress: 1172/1587 symbols completed. SKT took 1.3s. Estimated remaining: 2m 53s. Rate: 143.7 symbols/min [2025-10-01T22:43:02.795737] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:02.795617] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-10-01T22:43:02.796011] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-01T22:43:02.798954] [INFO ] [MAIN ] Derivative Progress: 1173/1587 symbols completed. SKM took 1.3s. Estimated remaining: 2m 53s. Rate: 143.8 symbols/min [2025-10-01T22:43:02.799200] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:02.806732] [DEBUG] [LOCAL ] SKYH: Loaded 16585 existing records from primary storage. [2025-10-01T22:43:02.807131] [INFO ] [MAIN ] SKYH: Loaded 16585 primary data records. [2025-10-01T22:43:03.213663] [DEBUG] [LOCAL ] SLF: Loaded 38732 existing records from primary storage. [2025-10-01T22:43:03.228255] [INFO ] [MAIN ] SLF: Loaded 38732 primary data records. [2025-10-01T22:43:03.252840] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-01T22:43:03.284496] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-01T22:43:03.932694] [DEBUG] [MAIN ] SKYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:03.935084] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16585 primary records. [2025-10-01T22:43:03.935830] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-01T22:43:03.956177] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-01T22:43:03.957481] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-01T22:43:03.960758] [INFO ] [MAIN ] Derivative Progress: 1174/1587 symbols completed. SKYH took 1.2s. Estimated remaining: 2m 53s. Rate: 143.6 symbols/min [2025-10-01T22:43:03.961279] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:03.983791] [DEBUG] [MAIN ] SLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:03.996783] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-01T22:43:03.996985] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-01T22:43:03.998044] [DEBUG] [MAIN ] SLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:03.998871] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38732 primary records. [2025-10-01T22:43:03.998988] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-01T22:43:04.038985] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-01T22:43:04.039689] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-01T22:43:04.041827] [INFO ] [MAIN ] Derivative Progress: 1175/1587 symbols completed. SLF took 1.2s. Estimated remaining: 2m 52s. Rate: 143.7 symbols/min [2025-10-01T22:43:04.042226] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:04.043820] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-01T22:43:04.044006] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-01T22:43:04.046666] [INFO ] [MAIN ] Derivative Progress: 1176/1587 symbols completed. SLB took 1.3s. Estimated remaining: 2m 51s. Rate: 143.8 symbols/min [2025-10-01T22:43:04.046945] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:04.062433] [DEBUG] [LOCAL ] SLG: Loaded 45322 existing records from primary storage. [2025-10-01T22:43:04.062679] [INFO ] [MAIN ] SLG: Loaded 45322 primary data records. [2025-10-01T22:43:04.447547] [DEBUG] [LOCAL ] SLGN: Loaded 40426 existing records from primary storage. [2025-10-01T22:43:04.447788] [INFO ] [MAIN ] SLGN: Loaded 40426 primary data records. [2025-10-01T22:43:04.446329] [DEBUG] [LOCAL ] SLQT: Loaded 43514 existing records from primary storage. [2025-10-01T22:43:04.448038] [INFO ] [MAIN ] SLQT: Loaded 43514 primary data records. [2025-10-01T22:43:05.132948] [DEBUG] [MAIN ] SLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:05.133915] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45322 primary records. [2025-10-01T22:43:05.134209] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-01T22:43:05.154814] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-01T22:43:05.156126] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-01T22:43:05.158610] [INFO ] [MAIN ] Derivative Progress: 1177/1587 symbols completed. SLG took 1.2s. Estimated remaining: 2m 51s. Rate: 143.6 symbols/min [2025-10-01T22:43:05.159856] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:05.177373] [DEBUG] [MAIN ] SLGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:05.186166] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40426 primary records. [2025-10-01T22:43:05.191570] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-01T22:43:05.191879] [DEBUG] [MAIN ] SLQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:05.193428] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43514 primary records. [2025-10-01T22:43:05.193721] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-01T22:43:05.232500] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-01T22:43:05.233153] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-01T22:43:05.236355] [INFO ] [MAIN ] Derivative Progress: 1178/1587 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 51s. Rate: 143.7 symbols/min [2025-10-01T22:43:05.236881] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:05.239911] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-01T22:43:05.240413] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-01T22:43:05.243902] [INFO ] [MAIN ] Derivative Progress: 1179/1587 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 50s. Rate: 143.8 symbols/min [2025-10-01T22:43:05.244358] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:05.255887] [DEBUG] [LOCAL ] SLVM: Loaded 27991 existing records from primary storage. [2025-10-01T22:43:05.256083] [INFO ] [MAIN ] SLVM: Loaded 27991 primary data records. [2025-10-01T22:43:05.330968] [DEBUG] [LOCAL ] SMBK: Loaded 8141 existing records from primary storage. [2025-10-01T22:43:05.365198] [INFO ] [MAIN ] SMBK: Loaded 8141 primary data records. [2025-10-01T22:43:05.866778] [DEBUG] [LOCAL ] SM: Loaded 52323 existing records from primary storage. [2025-10-01T22:43:05.982733] [INFO ] [MAIN ] SM: Loaded 52323 primary data records. [2025-10-01T22:43:06.353289] [DEBUG] [MAIN ] SLVM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:06.356801] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27991 primary records. [2025-10-01T22:43:06.357286] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-01T22:43:06.384788] [DEBUG] [MAIN ] SMBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:06.388980] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8141 primary records. [2025-10-01T22:43:06.390480] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-01T22:43:06.390635] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-01T22:43:06.389576] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-01T22:43:06.392978] [INFO ] [MAIN ] Derivative Progress: 1180/1587 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 50s. Rate: 143.6 symbols/min [2025-10-01T22:43:06.393476] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:06.417971] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-01T22:43:06.418817] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-01T22:43:06.422035] [INFO ] [MAIN ] Derivative Progress: 1181/1587 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 49s. Rate: 143.7 symbols/min [2025-10-01T22:43:06.422423] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:06.428409] [DEBUG] [LOCAL ] SMC: Loaded 11412 existing records from primary storage. [2025-10-01T22:43:06.441300] [INFO ] [MAIN ] SMC: Loaded 11412 primary data records. [2025-10-01T22:43:06.442410] [DEBUG] [MAIN ] SM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:06.448465] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52323 primary records. [2025-10-01T22:43:06.455075] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-01T22:43:06.590155] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-01T22:43:06.642788] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-01T22:43:06.684418] [INFO ] [MAIN ] Derivative Progress: 1182/1587 symbols completed. SM took 1.4s. Estimated remaining: 2m 49s. Rate: 143.8 symbols/min [2025-10-01T22:43:06.796712] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:06.828760] [DEBUG] [LOCAL ] SMFG: Loaded 48138 existing records from primary storage. [2025-10-01T22:43:06.829899] [INFO ] [MAIN ] SMFG: Loaded 48138 primary data records. [2025-10-01T22:43:07.201273] [DEBUG] [LOCAL ] SMG: Loaded 43718 existing records from primary storage. [2025-10-01T22:43:07.202164] [INFO ] [MAIN ] SMG: Loaded 43718 primary data records. [2025-10-01T22:43:07.308819] [DEBUG] [MAIN ] SMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:07.330099] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11412 primary records. [2025-10-01T22:43:07.344029] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-01T22:43:07.639316] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-01T22:43:07.639521] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-01T22:43:07.642014] [INFO ] [MAIN ] Derivative Progress: 1183/1587 symbols completed. SMC took 1.2s. Estimated remaining: 2m 49s. Rate: 143.6 symbols/min [2025-10-01T22:43:07.671002] [DEBUG] [MAIN ] SMFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:07.672126] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48138 primary records. [2025-10-01T22:43:07.672204] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-01T22:43:07.690353] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-01T22:43:07.690510] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-01T22:43:07.693804] [INFO ] [MAIN ] Derivative Progress: 1184/1587 symbols completed. SMFG took 1.3s. Estimated remaining: 2m 48s. Rate: 143.7 symbols/min [2025-10-01T22:43:07.709963] [DEBUG] [MAIN ] SMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:07.710972] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43718 primary records. [2025-10-01T22:43:07.711039] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-01T22:43:07.726623] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-01T22:43:07.726735] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-01T22:43:07.728984] [INFO ] [MAIN ] Derivative Progress: 1185/1587 symbols completed. SMG took 0.9s. Estimated remaining: 2m 48s. Rate: 143.8 symbols/min [2025-10-01T22:43:07.729490] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:07.729424] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:07.730315] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:07.757871] [DEBUG] [LOCAL ] SMP: Loaded 19309 existing records from primary storage. [2025-10-01T22:43:07.758124] [INFO ] [MAIN ] SMP: Loaded 19309 primary data records. [2025-10-01T22:43:07.922701] [DEBUG] [LOCAL ] SMRT: Loaded 43885 existing records from primary storage. [2025-10-01T22:43:07.945045] [INFO ] [MAIN ] SMRT: Loaded 43885 primary data records. [2025-10-01T22:43:08.058812] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-10-01T22:43:08.215036] [INFO ] [MAIN ] SMR: Loaded 53797 primary data records. [2025-10-01T22:43:08.862293] [DEBUG] [MAIN ] SMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:08.863281] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19309 primary records. [2025-10-01T22:43:08.863564] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-01T22:43:08.883898] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-01T22:43:08.884978] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-01T22:43:08.887898] [INFO ] [MAIN ] Derivative Progress: 1186/1587 symbols completed. SMP took 1.2s. Estimated remaining: 2m 48s. Rate: 143.6 symbols/min [2025-10-01T22:43:08.888962] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:08.902741] [DEBUG] [MAIN ] SMRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:08.903700] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43885 primary records. [2025-10-01T22:43:08.903945] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-01T22:43:08.932187] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-01T22:43:08.938223] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-01T22:43:08.938132] [DEBUG] [MAIN ] SMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:08.941714] [INFO ] [MAIN ] Derivative Progress: 1187/1587 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 47s. Rate: 143.7 symbols/min [2025-10-01T22:43:08.939166] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53797 primary records. [2025-10-01T22:43:08.942164] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-01T22:43:08.941986] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:08.978188] [DEBUG] [LOCAL ] SMWB: Loaded 32455 existing records from primary storage. [2025-10-01T22:43:08.979017] [INFO ] [MAIN ] SMWB: Loaded 32455 primary data records. [2025-10-01T22:43:09.040008] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-10-01T22:43:09.073922] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-01T22:43:09.096394] [INFO ] [MAIN ] Derivative Progress: 1188/1587 symbols completed. SMR took 1.4s. Estimated remaining: 2m 46s. Rate: 143.8 symbols/min [2025-10-01T22:43:09.110738] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:09.396700] [DEBUG] [LOCAL ] SN: Loaded 49773 existing records from primary storage. [2025-10-01T22:43:09.397096] [INFO ] [MAIN ] SN: Loaded 49773 primary data records. [2025-10-01T22:43:09.446539] [DEBUG] [LOCAL ] SNA: Loaded 25934 existing records from primary storage. [2025-10-01T22:43:09.460909] [INFO ] [MAIN ] SNA: Loaded 25934 primary data records. [2025-10-01T22:43:10.138216] [DEBUG] [MAIN ] SMWB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:10.139491] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32455 primary records. [2025-10-01T22:43:10.140624] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-01T22:43:10.161343] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-01T22:43:10.161726] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-01T22:43:10.165235] [INFO ] [MAIN ] Derivative Progress: 1189/1587 symbols completed. SMWB took 1.3s. Estimated remaining: 2m 46s. Rate: 143.6 symbols/min [2025-10-01T22:43:10.165534] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:10.189252] [DEBUG] [MAIN ] SN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:10.190282] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49773 primary records. [2025-10-01T22:43:10.190532] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-01T22:43:10.216551] [DEBUG] [MAIN ] SNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:10.217894] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25934 primary records. [2025-10-01T22:43:10.218129] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-01T22:43:10.234586] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-01T22:43:10.235682] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-01T22:43:10.238258] [INFO ] [MAIN ] Derivative Progress: 1190/1587 symbols completed. SN took 1.3s. Estimated remaining: 2m 46s. Rate: 143.7 symbols/min [2025-10-01T22:43:10.241078] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-01T22:43:10.254872] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:10.254682] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-01T22:43:10.257594] [INFO ] [MAIN ] Derivative Progress: 1191/1587 symbols completed. SNA took 1.1s. Estimated remaining: 2m 45s. Rate: 143.8 symbols/min [2025-10-01T22:43:10.258261] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:10.266754] [DEBUG] [LOCAL ] SNDA: Loaded 4515 existing records from primary storage. [2025-10-01T22:43:10.267767] [INFO ] [MAIN ] SNDA: Loaded 4515 primary data records. [2025-10-01T22:43:10.386059] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-01T22:43:10.386411] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-01T22:43:10.803139] [DEBUG] [LOCAL ] SNDR: Loaded 40712 existing records from primary storage. [2025-10-01T22:43:10.817535] [INFO ] [MAIN ] SNDR: Loaded 40712 primary data records. [2025-10-01T22:43:11.391230] [DEBUG] [MAIN ] SNDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:11.392872] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4515 primary records. [2025-10-01T22:43:11.393671] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-01T22:43:11.413934] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-10-01T22:43:11.415051] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-01T22:43:11.417209] [INFO ] [MAIN ] Derivative Progress: 1192/1587 symbols completed. SNDA took 1.2s. Estimated remaining: 2m 45s. Rate: 143.6 symbols/min [2025-10-01T22:43:11.417539] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:11.432318] [DEBUG] [MAIN ] SNAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:11.433585] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-01T22:43:11.433773] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-01T22:43:11.453786] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-01T22:43:11.454218] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-01T22:43:11.465327] [INFO ] [MAIN ] Derivative Progress: 1193/1587 symbols completed. SNAP took 1.3s. Estimated remaining: 2m 44s. Rate: 143.7 symbols/min [2025-10-01T22:43:11.470873] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:11.471329] [DEBUG] [MAIN ] SNDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:11.472111] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40712 primary records. [2025-10-01T22:43:11.472444] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-01T22:43:11.491140] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-01T22:43:11.502311] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-01T22:43:11.505129] [INFO ] [MAIN ] Derivative Progress: 1194/1587 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 44s. Rate: 143.8 symbols/min [2025-10-01T22:43:11.505389] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:11.525138] [DEBUG] [LOCAL ] SNN: Loaded 44238 existing records from primary storage. [2025-10-01T22:43:11.525450] [INFO ] [MAIN ] SNN: Loaded 44238 primary data records. [2025-10-01T22:43:11.778145] [DEBUG] [LOCAL ] SNOW: Loaded 53591 existing records from primary storage. [2025-10-01T22:43:11.783038] [INFO ] [MAIN ] SNOW: Loaded 53591 primary data records. [2025-10-01T22:43:11.927239] [DEBUG] [LOCAL ] SNV: Loaded 48860 existing records from primary storage. [2025-10-01T22:43:11.961355] [INFO ] [MAIN ] SNV: Loaded 48860 primary data records. [2025-10-01T22:43:12.691351] [DEBUG] [MAIN ] SNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:12.693221] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44238 primary records. [2025-10-01T22:43:12.693524] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-01T22:43:12.713440] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-01T22:43:12.713627] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-01T22:43:12.717127] [INFO ] [MAIN ] Derivative Progress: 1195/1587 symbols completed. SNN took 1.3s. Estimated remaining: 2m 44s. Rate: 143.6 symbols/min [2025-10-01T22:43:12.718344] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:12.733825] [DEBUG] [MAIN ] SNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:12.734575] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53591 primary records. [2025-10-01T22:43:12.734793] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-01T22:43:12.754449] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-10-01T22:43:12.768248] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-01T22:43:12.768548] [DEBUG] [MAIN ] SNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:12.771882] [INFO ] [MAIN ] Derivative Progress: 1196/1587 symbols completed. SNOW took 1.3s. Estimated remaining: 2m 43s. Rate: 143.7 symbols/min [2025-10-01T22:43:12.769503] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48860 primary records. [2025-10-01T22:43:12.772049] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-01T22:43:12.772168] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:12.790083] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-01T22:43:12.790267] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-01T22:43:12.802106] [INFO ] [MAIN ] Derivative Progress: 1197/1587 symbols completed. SNV took 1.3s. Estimated remaining: 2m 43s. Rate: 143.8 symbols/min [2025-10-01T22:43:12.802365] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:12.821838] [DEBUG] [LOCAL ] SNX: Loaded 40047 existing records from primary storage. [2025-10-01T22:43:12.822146] [INFO ] [MAIN ] SNX: Loaded 40047 primary data records. [2025-10-01T22:43:13.203525] [DEBUG] [LOCAL ] SO: Loaded 53606 existing records from primary storage. [2025-10-01T22:43:13.213397] [INFO ] [MAIN ] SO: Loaded 53606 primary data records. [2025-10-01T22:43:13.215861] [DEBUG] [LOCAL ] SOBO: Loaded 39455 existing records from primary storage. [2025-10-01T22:43:13.238904] [INFO ] [MAIN ] SOBO: Loaded 39455 primary data records. [2025-10-01T22:43:13.971800] [DEBUG] [MAIN ] SNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:13.973260] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 40047 primary records. [2025-10-01T22:43:13.973375] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-01T22:43:13.995247] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-01T22:43:13.995502] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-01T22:43:13.998341] [INFO ] [MAIN ] Derivative Progress: 1198/1587 symbols completed. SNX took 1.3s. Estimated remaining: 2m 43s. Rate: 143.6 symbols/min [2025-10-01T22:43:14.019812] [DEBUG] [MAIN ] SO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:14.021897] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53606 primary records. [2025-10-01T22:43:14.022056] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-01T22:43:14.035193] [DEBUG] [MAIN ] SOBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:14.035989] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39455 primary records. [2025-10-01T22:43:14.047261] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-01T22:43:14.061276] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-01T22:43:14.064679] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-01T22:43:14.067149] [INFO ] [MAIN ] Derivative Progress: 1199/1587 symbols completed. SO took 1.3s. Estimated remaining: 2m 42s. Rate: 143.7 symbols/min [2025-10-01T22:43:14.070898] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-01T22:43:14.070965] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-01T22:43:14.073557] [INFO ] [MAIN ] Derivative Progress: 1200/1587 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 41s. Rate: 143.8 symbols/min [2025-10-01T22:43:14.074065] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:14.073988] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:14.074157] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:14.082403] [DEBUG] [LOCAL ] SOJC: Loaded 5037 existing records from primary storage. [2025-10-01T22:43:14.082530] [INFO ] [MAIN ] SOJC: Loaded 5037 primary data records. [2025-10-01T22:43:14.185329] [DEBUG] [LOCAL ] SOJD: Loaded 13097 existing records from primary storage. [2025-10-01T22:43:14.212162] [INFO ] [MAIN ] SOJD: Loaded 13097 primary data records. [2025-10-01T22:43:14.644458] [DEBUG] [LOCAL ] SOC: Loaded 50432 existing records from primary storage. [2025-10-01T22:43:14.656241] [INFO ] [MAIN ] SOC: Loaded 50432 primary data records. [2025-10-01T22:43:15.208510] [DEBUG] [MAIN ] SOJC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:15.211911] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 5037 primary records. [2025-10-01T22:43:15.212195] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-01T22:43:15.241999] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-01T22:43:15.242589] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-01T22:43:15.245297] [INFO ] [MAIN ] Derivative Progress: 1201/1587 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 41s. Rate: 143.6 symbols/min [2025-10-01T22:43:15.245617] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:15.242534] [DEBUG] [MAIN ] SOJD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:15.246831] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 13097 primary records. [2025-10-01T22:43:15.247302] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-01T22:43:15.266751] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-01T22:43:15.270269] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-01T22:43:15.273196] [INFO ] [MAIN ] Derivative Progress: 1202/1587 symbols completed. SOJD took 1.2s. Estimated remaining: 2m 41s. Rate: 143.7 symbols/min [2025-10-01T22:43:15.273490] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:15.291985] [DEBUG] [LOCAL ] SOJE: Loaded 9364 existing records from primary storage. [2025-10-01T22:43:15.288012] [DEBUG] [MAIN ] SOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:15.292803] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50432 primary records. [2025-10-01T22:43:15.292970] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-01T22:43:15.292120] [INFO ] [MAIN ] SOJE: Loaded 9364 primary data records. [2025-10-01T22:43:15.425865] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-01T22:43:15.435928] [DEBUG] [LOCAL ] SOL: Loaded 13261 existing records from primary storage. [2025-10-01T22:43:15.439999] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-01T22:43:15.442856] [INFO ] [MAIN ] Derivative Progress: 1203/1587 symbols completed. SOC took 1.4s. Estimated remaining: 2m 40s. Rate: 143.8 symbols/min [2025-10-01T22:43:15.443513] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:15.443620] [INFO ] [MAIN ] SOL: Loaded 13261 primary data records. [2025-10-01T22:43:16.034227] [DEBUG] [LOCAL ] SOLV: Loaded 43988 existing records from primary storage. [2025-10-01T22:43:16.034677] [INFO ] [MAIN ] SOLV: Loaded 43988 primary data records. [2025-10-01T22:43:16.244938] [DEBUG] [MAIN ] SOJE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:16.414470] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9364 primary records. [2025-10-01T22:43:16.430371] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-01T22:43:16.451209] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-01T22:43:16.451843] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-01T22:43:16.454363] [INFO ] [MAIN ] Derivative Progress: 1204/1587 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 40s. Rate: 143.6 symbols/min [2025-10-01T22:43:16.456478] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:16.475150] [DEBUG] [MAIN ] SOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:16.476022] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13261 primary records. [2025-10-01T22:43:16.476583] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-01T22:43:16.494873] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-01T22:43:16.495098] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-01T22:43:16.498307] [INFO ] [MAIN ] Derivative Progress: 1205/1587 symbols completed. SOL took 1.2s. Estimated remaining: 2m 39s. Rate: 143.7 symbols/min [2025-10-01T22:43:16.499350] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:16.519093] [DEBUG] [MAIN ] SOLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:16.531379] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 43988 primary records. [2025-10-01T22:43:16.531520] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-01T22:43:16.552106] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-01T22:43:16.567304] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-01T22:43:16.570399] [INFO ] [MAIN ] Derivative Progress: 1206/1587 symbols completed. SOLV took 1.1s. Estimated remaining: 2m 39s. Rate: 143.8 symbols/min [2025-10-01T22:43:16.572323] [DEBUG] [LOCAL ] SON: Loaded 43079 existing records from primary storage. [2025-10-01T22:43:16.572615] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:16.572872] [INFO ] [MAIN ] SON: Loaded 43079 primary data records. [2025-10-01T22:43:16.708296] [DEBUG] [LOCAL ] SOR: Loaded 2877 existing records from primary storage. [2025-10-01T22:43:16.741826] [INFO ] [MAIN ] SOR: Loaded 2877 primary data records. [2025-10-01T22:43:16.787849] [DEBUG] [LOCAL ] SONY: Loaded 53358 existing records from primary storage. [2025-10-01T22:43:16.987920] [INFO ] [MAIN ] SONY: Loaded 53358 primary data records. [2025-10-01T22:43:17.638686] [DEBUG] [MAIN ] SON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:17.640203] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43079 primary records. [2025-10-01T22:43:17.640315] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-01T22:43:17.660083] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-01T22:43:17.660224] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-01T22:43:17.662443] [INFO ] [MAIN ] Derivative Progress: 1207/1587 symbols completed. SON took 1.2s. Estimated remaining: 2m 39s. Rate: 143.6 symbols/min [2025-10-01T22:43:17.662796] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:17.684614] [DEBUG] [MAIN ] SOR: Filtered 6931 bins outside market hours, 7729 incomplete bins [2025-10-01T22:43:17.687172] [INFO ] [MAIN ] SOR: Generated 1789 derivative records from 2877 primary records. [2025-10-01T22:43:17.687420] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-01T22:43:17.692128] [DEBUG] [LOCAL ] SOS: Loaded 8693 existing records from primary storage. [2025-10-01T22:43:17.693250] [INFO ] [MAIN ] SOS: Loaded 8693 primary data records. [2025-10-01T22:43:17.767285] [DEBUG] [MAIN ] SONY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:17.770800] [DEBUG] [LOCAL ] SOR: Derivative data saved (1789 records). [2025-10-01T22:43:17.771636] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53358 primary records. [2025-10-01T22:43:17.776960] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-01T22:43:17.784727] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-01T22:43:17.797491] [INFO ] [MAIN ] Derivative Progress: 1208/1587 symbols completed. SOR took 1.2s. Estimated remaining: 2m 38s. Rate: 143.7 symbols/min [2025-10-01T22:43:17.830875] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:17.876504] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-01T22:43:17.913456] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-01T22:43:17.928623] [INFO ] [MAIN ] Derivative Progress: 1209/1587 symbols completed. SONY took 1.4s. Estimated remaining: 2m 38s. Rate: 143.8 symbols/min [2025-10-01T22:43:17.943777] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:18.102959] [DEBUG] [LOCAL ] SPB: Loaded 34038 existing records from primary storage. [2025-10-01T22:43:18.103767] [INFO ] [MAIN ] SPB: Loaded 34038 primary data records. [2025-10-01T22:43:18.346805] [DEBUG] [LOCAL ] SPCE: Loaded 49928 existing records from primary storage. [2025-10-01T22:43:18.466914] [INFO ] [MAIN ] SPCE: Loaded 49928 primary data records. [2025-10-01T22:43:18.492766] [DEBUG] [MAIN ] SOS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:18.529980] [INFO ] [MAIN ] SOS: Generated 1793 derivative records from 8693 primary records. [2025-10-01T22:43:18.536635] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-01T22:43:18.638484] [DEBUG] [LOCAL ] SOS: Derivative data saved (1793 records). [2025-10-01T22:43:18.744817] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-01T22:43:18.753967] [INFO ] [MAIN ] Derivative Progress: 1210/1587 symbols completed. SOS took 1.1s. Estimated remaining: 2m 37s. Rate: 143.7 symbols/min [2025-10-01T22:43:18.754738] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:18.898584] [DEBUG] [LOCAL ] SPE: Loaded 6350 existing records from primary storage. [2025-10-01T22:43:18.904615] [DEBUG] [MAIN ] SPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:18.904769] [INFO ] [MAIN ] SPE: Loaded 6350 primary data records. [2025-10-01T22:43:18.905495] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34038 primary records. [2025-10-01T22:43:18.910755] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-01T22:43:19.045348] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-01T22:43:19.051450] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-01T22:43:19.069740] [INFO ] [MAIN ] Derivative Progress: 1211/1587 symbols completed. SPB took 1.2s. Estimated remaining: 2m 37s. Rate: 143.7 symbols/min [2025-10-01T22:43:19.080773] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:19.280751] [DEBUG] [MAIN ] SPCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:19.282052] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49928 primary records. [2025-10-01T22:43:19.282262] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-01T22:43:19.303797] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-01T22:43:19.304048] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-01T22:43:19.306506] [INFO ] [MAIN ] Derivative Progress: 1212/1587 symbols completed. SPCE took 1.4s. Estimated remaining: 2m 37s. Rate: 143.8 symbols/min [2025-10-01T22:43:19.307146] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:19.340033] [DEBUG] [MAIN ] SPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:19.340882] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6350 primary records. [2025-10-01T22:43:19.341000] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-01T22:43:19.358210] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-01T22:43:19.358328] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-01T22:43:19.374256] [INFO ] [MAIN ] Derivative Progress: 1213/1587 symbols completed. SPE took 0.6s. Estimated remaining: 2m 36s. Rate: 143.9 symbols/min [2025-10-01T22:43:19.377476] [DEBUG] [LOCAL ] SPG: Loaded 50270 existing records from primary storage. [2025-10-01T22:43:19.377784] [INFO ] [MAIN ] SPG: Loaded 50270 primary data records. [2025-10-01T22:43:19.563052] [DEBUG] [LOCAL ] SPGI: Loaded 45757 existing records from primary storage. [2025-10-01T22:43:19.592490] [INFO ] [MAIN ] SPGI: Loaded 45757 primary data records. [2025-10-01T22:43:20.133911] [DEBUG] [MAIN ] SPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:20.135031] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50270 primary records. [2025-10-01T22:43:20.135220] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-01T22:43:20.153141] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-01T22:43:20.153249] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-01T22:43:20.155752] [INFO ] [MAIN ] Derivative Progress: 1214/1587 symbols completed. SPG took 1.1s. Estimated remaining: 2m 36s. Rate: 143.8 symbols/min [2025-10-01T22:43:20.172787] [DEBUG] [MAIN ] SPGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:20.173427] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45757 primary records. [2025-10-01T22:43:20.173489] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-01T22:43:20.189242] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-01T22:43:20.189314] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-01T22:43:20.191862] [INFO ] [MAIN ] Derivative Progress: 1215/1587 symbols completed. SPGI took 0.9s. Estimated remaining: 2m 35s. Rate: 143.9 symbols/min [2025-10-01T22:43:20.192397] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:20.192512] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:20.192850] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:20.214962] [DEBUG] [LOCAL ] SPH: Loaded 17477 existing records from primary storage. [2025-10-01T22:43:20.215330] [INFO ] [MAIN ] SPH: Loaded 17477 primary data records. [2025-10-01T22:43:20.395496] [DEBUG] [LOCAL ] SPIR: Loaded 37093 existing records from primary storage. [2025-10-01T22:43:20.434063] [INFO ] [MAIN ] SPIR: Loaded 37093 primary data records. [2025-10-01T22:43:20.467080] [DEBUG] [LOCAL ] SPHR: Loaded 40056 existing records from primary storage. [2025-10-01T22:43:20.579408] [INFO ] [MAIN ] SPHR: Loaded 40056 primary data records. [2025-10-01T22:43:21.318519] [DEBUG] [MAIN ] SPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:21.319873] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 17477 primary records. [2025-10-01T22:43:21.321422] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-01T22:43:21.341411] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-01T22:43:21.341843] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-01T22:43:21.344493] [INFO ] [MAIN ] Derivative Progress: 1216/1587 symbols completed. SPH took 1.2s. Estimated remaining: 2m 35s. Rate: 143.6 symbols/min [2025-10-01T22:43:21.344964] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:21.384963] [DEBUG] [MAIN ] SPIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:21.390533] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37093 primary records. [2025-10-01T22:43:21.376989] [DEBUG] [LOCAL ] SPMC: Loaded 5380 existing records from primary storage. [2025-10-01T22:43:21.391146] [DEBUG] [MAIN ] SPHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:21.390875] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-01T22:43:21.391818] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40056 primary records. [2025-10-01T22:43:21.392786] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-01T22:43:21.393140] [INFO ] [MAIN ] SPMC: Loaded 5380 primary data records. [2025-10-01T22:43:21.493525] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-01T22:43:21.504994] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-01T22:43:21.527933] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-01T22:43:21.546222] [INFO ] [MAIN ] Derivative Progress: 1217/1587 symbols completed. SPIR took 1.4s. Estimated remaining: 2m 34s. Rate: 143.7 symbols/min [2025-10-01T22:43:21.522739] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-01T22:43:21.553696] [INFO ] [MAIN ] Derivative Progress: 1218/1587 symbols completed. SPHR took 1.4s. Estimated remaining: 2m 34s. Rate: 143.8 symbols/min [2025-10-01T22:43:21.569907] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:21.553563] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:21.825221] [DEBUG] [MAIN ] SPMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:21.828539] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5380 primary records. [2025-10-01T22:43:21.828720] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-01T22:43:21.842604] [DEBUG] [LOCAL ] SPNT: Loaded 34829 existing records from primary storage. [2025-10-01T22:43:21.844379] [INFO ] [MAIN ] SPNT: Loaded 34829 primary data records. [2025-10-01T22:43:21.885494] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-10-01T22:43:21.884781] [DEBUG] [LOCAL ] SPOT: Loaded 50577 existing records from primary storage. [2025-10-01T22:43:21.890983] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-01T22:43:21.909321] [INFO ] [MAIN ] SPOT: Loaded 50577 primary data records. [2025-10-01T22:43:21.917280] [INFO ] [MAIN ] Derivative Progress: 1219/1587 symbols completed. SPMC took 0.6s. Estimated remaining: 2m 34s. Rate: 143.8 symbols/min [2025-10-01T22:43:22.002501] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:22.570870] [DEBUG] [LOCAL ] SPR: Loaded 41174 existing records from primary storage. [2025-10-01T22:43:22.571157] [INFO ] [MAIN ] SPR: Loaded 41174 primary data records. [2025-10-01T22:43:22.985786] [DEBUG] [MAIN ] SPNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:22.994758] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34829 primary records. [2025-10-01T22:43:23.000033] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-01T22:43:22.999974] [DEBUG] [MAIN ] SPOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:23.001402] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50577 primary records. [2025-10-01T22:43:23.001849] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-01T22:43:23.029228] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-01T22:43:23.032534] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-01T22:43:23.035008] [INFO ] [MAIN ] Derivative Progress: 1220/1587 symbols completed. SPNT took 1.5s. Estimated remaining: 2m 33s. Rate: 143.6 symbols/min [2025-10-01T22:43:23.037735] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:23.041207] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-10-01T22:43:23.041665] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-01T22:43:23.044398] [INFO ] [MAIN ] Derivative Progress: 1221/1587 symbols completed. SPOT took 1.5s. Estimated remaining: 2m 33s. Rate: 143.8 symbols/min [2025-10-01T22:43:23.044605] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:23.054302] [DEBUG] [LOCAL ] SPRU: Loaded 9123 existing records from primary storage. [2025-10-01T22:43:23.054727] [INFO ] [MAIN ] SPRU: Loaded 9123 primary data records. [2025-10-01T22:43:23.216029] [DEBUG] [LOCAL ] SPXC: Loaded 23393 existing records from primary storage. [2025-10-01T22:43:23.233834] [INFO ] [MAIN ] SPXC: Loaded 23393 primary data records. [2025-10-01T22:43:23.305949] [DEBUG] [MAIN ] SPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:23.428117] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41174 primary records. [2025-10-01T22:43:23.477269] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-01T22:43:23.601828] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-01T22:43:23.638047] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-01T22:43:23.645198] [INFO ] [MAIN ] Derivative Progress: 1222/1587 symbols completed. SPR took 1.6s. Estimated remaining: 2m 32s. Rate: 143.7 symbols/min [2025-10-01T22:43:23.646075] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:23.799372] [DEBUG] [LOCAL ] SPXX: Loaded 9111 existing records from primary storage. [2025-10-01T22:43:23.814899] [INFO ] [MAIN ] SPXX: Loaded 9111 primary data records. [2025-10-01T22:43:23.821857] [DEBUG] [MAIN ] SPRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:23.860215] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9123 primary records. [2025-10-01T22:43:23.860488] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-01T22:43:23.966661] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-01T22:43:23.999065] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-01T22:43:24.020602] [INFO ] [MAIN ] Derivative Progress: 1223/1587 symbols completed. SPRU took 1.0s. Estimated remaining: 2m 32s. Rate: 143.7 symbols/min [2025-10-01T22:43:24.042776] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:24.218395] [DEBUG] [MAIN ] SPXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:24.220411] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23393 primary records. [2025-10-01T22:43:24.220798] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-01T22:43:24.243431] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-01T22:43:24.244811] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-01T22:43:24.247605] [INFO ] [MAIN ] Derivative Progress: 1224/1587 symbols completed. SPXC took 1.2s. Estimated remaining: 2m 31s. Rate: 143.8 symbols/min [2025-10-01T22:43:24.260378] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:24.297669] [DEBUG] [MAIN ] SPXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:24.299125] [DEBUG] [LOCAL ] SQM: Loaded 48598 existing records from primary storage. [2025-10-01T22:43:24.306410] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9111 primary records. [2025-10-01T22:43:24.306759] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-01T22:43:24.306663] [INFO ] [MAIN ] SQM: Loaded 48598 primary data records. [2025-10-01T22:43:24.433398] [DEBUG] [LOCAL ] SQNS: Loaded 26380 existing records from primary storage. [2025-10-01T22:43:24.438755] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-01T22:43:24.459888] [INFO ] [MAIN ] SQNS: Loaded 26380 primary data records. [2025-10-01T22:43:24.465814] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-01T22:43:24.514125] [INFO ] [MAIN ] Derivative Progress: 1225/1587 symbols completed. SPXX took 0.9s. Estimated remaining: 2m 31s. Rate: 143.8 symbols/min [2025-10-01T22:43:24.595614] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:25.060467] [DEBUG] [LOCAL ] SR: Loaded 32814 existing records from primary storage. [2025-10-01T22:43:25.061764] [INFO ] [MAIN ] SR: Loaded 32814 primary data records. [2025-10-01T22:43:25.120624] [DEBUG] [MAIN ] SQM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:25.137393] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48598 primary records. [2025-10-01T22:43:25.169991] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-01T22:43:25.304375] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-01T22:43:25.362271] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-01T22:43:25.478201] [INFO ] [MAIN ] Derivative Progress: 1226/1587 symbols completed. SQM took 1.4s. Estimated remaining: 2m 31s. Rate: 143.7 symbols/min [2025-10-01T22:43:25.484442] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:25.511127] [DEBUG] [MAIN ] SQNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:25.513240] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 26380 primary records. [2025-10-01T22:43:25.514001] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-01T22:43:25.533891] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-01T22:43:25.534207] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-01T22:43:25.536965] [INFO ] [MAIN ] Derivative Progress: 1227/1587 symbols completed. SQNS took 1.3s. Estimated remaining: 2m 30s. Rate: 143.8 symbols/min [2025-10-01T22:43:25.537348] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:25.558200] [DEBUG] [MAIN ] SR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:25.559027] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32814 primary records. [2025-10-01T22:43:25.559301] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-01T22:43:25.579423] [DEBUG] [LOCAL ] SREA: Loaded 10419 existing records from primary storage. [2025-10-01T22:43:25.587902] [INFO ] [MAIN ] SREA: Loaded 10419 primary data records. [2025-10-01T22:43:25.703276] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-01T22:43:25.717943] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-01T22:43:25.729434] [INFO ] [MAIN ] Derivative Progress: 1228/1587 symbols completed. SR took 1.1s. Estimated remaining: 2m 30s. Rate: 143.8 symbols/min [2025-10-01T22:43:25.735395] [DEBUG] [LOCAL ] SRE: Loaded 53423 existing records from primary storage. [2025-10-01T22:43:25.736116] [INFO ] [MAIN ] SRE: Loaded 53423 primary data records. [2025-10-01T22:43:26.297819] [DEBUG] [MAIN ] SREA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:26.298795] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10419 primary records. [2025-10-01T22:43:26.299315] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-01T22:43:26.318317] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-01T22:43:26.318612] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-01T22:43:26.333229] [INFO ] [MAIN ] Derivative Progress: 1229/1587 symbols completed. SREA took 0.8s. Estimated remaining: 2m 29s. Rate: 143.8 symbols/min [2025-10-01T22:43:26.333744] [DEBUG] [MAIN ] SRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:26.334560] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53423 primary records. [2025-10-01T22:43:26.334627] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-01T22:43:26.350433] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-01T22:43:26.350503] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-01T22:43:26.353043] [INFO ] [MAIN ] Derivative Progress: 1230/1587 symbols completed. SRE took 0.9s. Estimated remaining: 2m 29s. Rate: 143.9 symbols/min [2025-10-01T22:43:26.353433] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:26.353558] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:26.353712] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:26.385787] [DEBUG] [LOCAL ] SRG: Loaded 15546 existing records from primary storage. [2025-10-01T22:43:26.385968] [INFO ] [MAIN ] SRG: Loaded 15546 primary data records. [2025-10-01T22:43:26.490509] [DEBUG] [LOCAL ] SRI: Loaded 27179 existing records from primary storage. [2025-10-01T22:43:26.495852] [INFO ] [MAIN ] SRI: Loaded 27179 primary data records. [2025-10-01T22:43:26.646954] [DEBUG] [LOCAL ] SRFM: Loaded 36756 existing records from primary storage. [2025-10-01T22:43:26.696216] [INFO ] [MAIN ] SRFM: Loaded 36756 primary data records. [2025-10-01T22:43:27.504409] [DEBUG] [MAIN ] SRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:27.506688] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15546 primary records. [2025-10-01T22:43:27.506975] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-01T22:43:27.526058] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-01T22:43:27.526289] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-01T22:43:27.528791] [INFO ] [MAIN ] Derivative Progress: 1231/1587 symbols completed. SRG took 1.2s. Estimated remaining: 2m 29s. Rate: 143.7 symbols/min [2025-10-01T22:43:27.542841] [DEBUG] [MAIN ] SRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:27.542477] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:27.544029] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 27179 primary records. [2025-10-01T22:43:27.544358] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-01T22:43:27.565385] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-01T22:43:27.567386] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-01T22:43:27.570565] [INFO ] [MAIN ] Derivative Progress: 1232/1587 symbols completed. SRI took 1.2s. Estimated remaining: 2m 28s. Rate: 143.8 symbols/min [2025-10-01T22:43:27.584246] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:27.585610] [DEBUG] [MAIN ] SRFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:27.590553] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 36756 primary records. [2025-10-01T22:43:27.590749] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-01T22:43:27.589732] [DEBUG] [LOCAL ] SRV: Loaded 7385 existing records from primary storage. [2025-10-01T22:43:27.591006] [INFO ] [MAIN ] SRV: Loaded 7385 primary data records. [2025-10-01T22:43:27.678849] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-10-01T22:43:27.708837] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-01T22:43:27.719332] [INFO ] [MAIN ] Derivative Progress: 1233/1587 symbols completed. SRFM took 1.4s. Estimated remaining: 2m 28s. Rate: 143.9 symbols/min [2025-10-01T22:43:27.728804] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:27.983404] [DEBUG] [LOCAL ] SSB: Loaded 42655 existing records from primary storage. [2025-10-01T22:43:27.983813] [INFO ] [MAIN ] SSB: Loaded 42655 primary data records. [2025-10-01T22:43:28.047068] [DEBUG] [LOCAL ] SSD: Loaded 22456 existing records from primary storage. [2025-10-01T22:43:28.080711] [INFO ] [MAIN ] SSD: Loaded 22456 primary data records. [2025-10-01T22:43:28.695452] [DEBUG] [MAIN ] SRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:28.697442] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7385 primary records. [2025-10-01T22:43:28.697973] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-01T22:43:28.717695] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-01T22:43:28.718154] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-01T22:43:28.720779] [INFO ] [MAIN ] Derivative Progress: 1234/1587 symbols completed. SRV took 1.2s. Estimated remaining: 2m 27s. Rate: 143.7 symbols/min [2025-10-01T22:43:28.721375] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:28.740929] [DEBUG] [MAIN ] SSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:28.741775] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42655 primary records. [2025-10-01T22:43:28.742143] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-01T22:43:28.776085] [DEBUG] [MAIN ] SSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:28.777120] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-01T22:43:28.787905] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22456 primary records. [2025-10-01T22:43:28.788463] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-01T22:43:28.788345] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-01T22:43:28.791447] [INFO ] [MAIN ] Derivative Progress: 1235/1587 symbols completed. SSB took 1.2s. Estimated remaining: 2m 27s. Rate: 143.8 symbols/min [2025-10-01T22:43:28.792315] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:28.808295] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-10-01T22:43:28.809327] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-01T22:43:28.812010] [INFO ] [MAIN ] Derivative Progress: 1236/1587 symbols completed. SSD took 1.1s. Estimated remaining: 2m 26s. Rate: 143.9 symbols/min [2025-10-01T22:43:28.812895] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:28.827349] [DEBUG] [LOCAL ] SSL: Loaded 41183 existing records from primary storage. [2025-10-01T22:43:28.830773] [INFO ] [MAIN ] SSL: Loaded 41183 primary data records. [2025-10-01T22:43:28.888771] [DEBUG] [LOCAL ] SST: Loaded 11876 existing records from primary storage. [2025-10-01T22:43:28.907977] [INFO ] [MAIN ] SST: Loaded 11876 primary data records. [2025-10-01T22:43:29.139481] [DEBUG] [LOCAL ] SSTK: Loaded 25942 existing records from primary storage. [2025-10-01T22:43:29.220727] [INFO ] [MAIN ] SSTK: Loaded 25942 primary data records. [2025-10-01T22:43:29.983214] [DEBUG] [MAIN ] SSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:29.984597] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41183 primary records. [2025-10-01T22:43:29.985296] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-01T22:43:30.007692] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-01T22:43:30.008330] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-01T22:43:30.010919] [INFO ] [MAIN ] Derivative Progress: 1237/1587 symbols completed. SSL took 1.3s. Estimated remaining: 2m 26s. Rate: 143.7 symbols/min [2025-10-01T22:43:30.011073] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:30.028671] [DEBUG] [MAIN ] SST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:30.029793] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11876 primary records. [2025-10-01T22:43:30.030021] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-01T22:43:30.061208] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-01T22:43:30.059231] [DEBUG] [MAIN ] SSTK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:30.061489] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-01T22:43:30.062366] [INFO ] [MAIN ] SSTK: Generated 1793 derivative records from 25942 primary records. [2025-10-01T22:43:30.065673] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-01T22:43:30.065542] [INFO ] [MAIN ] Derivative Progress: 1238/1587 symbols completed. SST took 1.3s. Estimated remaining: 2m 26s. Rate: 143.8 symbols/min [2025-10-01T22:43:30.066814] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:30.084027] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1793 records). [2025-10-01T22:43:30.084209] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-01T22:43:30.086839] [INFO ] [MAIN ] Derivative Progress: 1239/1587 symbols completed. SSTK took 1.3s. Estimated remaining: 2m 25s. Rate: 143.9 symbols/min [2025-10-01T22:43:30.087129] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:30.117223] [DEBUG] [LOCAL ] STC: Loaded 17459 existing records from primary storage. [2025-10-01T22:43:30.117446] [INFO ] [MAIN ] STC: Loaded 17459 primary data records. [2025-10-01T22:43:30.261150] [DEBUG] [LOCAL ] ST: Loaded 49737 existing records from primary storage. [2025-10-01T22:43:30.267201] [INFO ] [MAIN ] ST: Loaded 49737 primary data records. [2025-10-01T22:43:30.621389] [DEBUG] [LOCAL ] STAG: Loaded 50065 existing records from primary storage. [2025-10-01T22:43:30.621590] [INFO ] [MAIN ] STAG: Loaded 50065 primary data records. [2025-10-01T22:43:31.223340] [DEBUG] [MAIN ] STC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:31.224455] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17459 primary records. [2025-10-01T22:43:31.225586] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-01T22:43:31.258626] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-01T22:43:31.258903] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-01T22:43:31.261848] [INFO ] [MAIN ] Derivative Progress: 1240/1587 symbols completed. STC took 1.2s. Estimated remaining: 2m 25s. Rate: 143.7 symbols/min [2025-10-01T22:43:31.262315] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:31.262182] [DEBUG] [MAIN ] ST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:31.263955] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49737 primary records. [2025-10-01T22:43:31.264617] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-01T22:43:31.296392] [DEBUG] [MAIN ] STAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:31.300394] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50065 primary records. [2025-10-01T22:43:31.301981] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-01T22:43:31.301896] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-01T22:43:31.302269] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-01T22:43:31.305311] [INFO ] [MAIN ] Derivative Progress: 1241/1587 symbols completed. ST took 1.3s. Estimated remaining: 2m 24s. Rate: 143.8 symbols/min [2025-10-01T22:43:31.305973] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:31.325431] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-01T22:43:31.325784] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-01T22:43:31.328630] [INFO ] [MAIN ] Derivative Progress: 1242/1587 symbols completed. STAG took 1.3s. Estimated remaining: 2m 24s. Rate: 143.9 symbols/min [2025-10-01T22:43:31.329153] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:31.359514] [DEBUG] [LOCAL ] STE: Loaded 35328 existing records from primary storage. [2025-10-01T22:43:31.359726] [INFO ] [MAIN ] STE: Loaded 35328 primary data records. [2025-10-01T22:43:31.440544] [DEBUG] [LOCAL ] STEL: Loaded 23143 existing records from primary storage. [2025-10-01T22:43:31.459206] [INFO ] [MAIN ] STEL: Loaded 23143 primary data records. [2025-10-01T22:43:31.865350] [DEBUG] [LOCAL ] STEM: Loaded 39350 existing records from primary storage. [2025-10-01T22:43:31.871307] [INFO ] [MAIN ] STEM: Loaded 39350 primary data records. [2025-10-01T22:43:32.480739] [DEBUG] [MAIN ] STE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:32.481869] [INFO ] [MAIN ] STE: Generated 1793 derivative records from 35328 primary records. [2025-10-01T22:43:32.481970] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-01T22:43:32.508718] [DEBUG] [MAIN ] STEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:32.512757] [DEBUG] [LOCAL ] STE: Derivative data saved (1793 records). [2025-10-01T22:43:32.513564] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-01T22:43:32.515831] [INFO ] [MAIN ] Derivative Progress: 1243/1587 symbols completed. STE took 1.3s. Estimated remaining: 2m 24s. Rate: 143.7 symbols/min [2025-10-01T22:43:32.513494] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23143 primary records. [2025-10-01T22:43:32.516585] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-01T22:43:32.536540] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-01T22:43:32.536772] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-01T22:43:32.539863] [INFO ] [MAIN ] Derivative Progress: 1244/1587 symbols completed. STEL took 1.2s. Estimated remaining: 2m 23s. Rate: 143.8 symbols/min [2025-10-01T22:43:32.552826] [DEBUG] [MAIN ] STEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:32.553522] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39350 primary records. [2025-10-01T22:43:32.553583] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-01T22:43:32.569343] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-01T22:43:32.569422] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-01T22:43:32.571879] [INFO ] [MAIN ] Derivative Progress: 1245/1587 symbols completed. STEM took 1.2s. Estimated remaining: 2m 23s. Rate: 143.9 symbols/min [2025-10-01T22:43:32.572445] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:32.573075] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:32.572843] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:32.589597] [DEBUG] [LOCAL ] STK: Loaded 9423 existing records from primary storage. [2025-10-01T22:43:32.589769] [INFO ] [MAIN ] STK: Loaded 9423 primary data records. [2025-10-01T22:43:32.680067] [DEBUG] [LOCAL ] STEW: Loaded 16128 existing records from primary storage. [2025-10-01T22:43:32.700839] [INFO ] [MAIN ] STEW: Loaded 16128 primary data records. [2025-10-01T22:43:33.090385] [DEBUG] [LOCAL ] STLA: Loaded 53543 existing records from primary storage. [2025-10-01T22:43:33.100978] [INFO ] [MAIN ] STLA: Loaded 53543 primary data records. [2025-10-01T22:43:33.648890] [DEBUG] [MAIN ] STK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:33.650034] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9423 primary records. [2025-10-01T22:43:33.650235] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-01T22:43:33.664144] [DEBUG] [MAIN ] STEW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:33.672718] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16128 primary records. [2025-10-01T22:43:33.674234] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-01T22:43:33.696168] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-01T22:43:33.698298] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-01T22:43:33.701463] [INFO ] [MAIN ] Derivative Progress: 1246/1587 symbols completed. STK took 1.1s. Estimated remaining: 2m 22s. Rate: 143.7 symbols/min [2025-10-01T22:43:33.699140] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-01T22:43:33.703462] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:33.704163] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-01T22:43:33.707007] [INFO ] [MAIN ] Derivative Progress: 1247/1587 symbols completed. STEW took 1.1s. Estimated remaining: 2m 22s. Rate: 143.8 symbols/min [2025-10-01T22:43:33.707687] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:33.722307] [DEBUG] [MAIN ] STLA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:33.723297] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53543 primary records. [2025-10-01T22:43:33.723426] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-01T22:43:33.741675] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-01T22:43:33.741813] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-01T22:43:33.744975] [INFO ] [MAIN ] Derivative Progress: 1248/1587 symbols completed. STLA took 1.2s. Estimated remaining: 2m 21s. Rate: 143.9 symbols/min [2025-10-01T22:43:33.750617] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:33.761793] [DEBUG] [LOCAL ] STN: Loaded 22870 existing records from primary storage. [2025-10-01T22:43:33.762102] [INFO ] [MAIN ] STN: Loaded 22870 primary data records. [2025-10-01T22:43:34.151317] [DEBUG] [LOCAL ] STM: Loaded 53580 existing records from primary storage. [2025-10-01T22:43:34.164343] [INFO ] [MAIN ] STM: Loaded 53580 primary data records. [2025-10-01T22:43:34.165216] [DEBUG] [LOCAL ] STNG: Loaded 43841 existing records from primary storage. [2025-10-01T22:43:34.198848] [INFO ] [MAIN ] STNG: Loaded 43841 primary data records. [2025-10-01T22:43:34.840125] [DEBUG] [MAIN ] STN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:34.842323] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22870 primary records. [2025-10-01T22:43:34.842601] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-01T22:43:34.863209] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-01T22:43:34.864095] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-01T22:43:34.867839] [INFO ] [MAIN ] Derivative Progress: 1249/1587 symbols completed. STN took 1.2s. Estimated remaining: 2m 21s. Rate: 143.7 symbols/min [2025-10-01T22:43:34.868274] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:34.891318] [DEBUG] [MAIN ] STM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:34.893435] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53580 primary records. [2025-10-01T22:43:34.894723] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-01T22:43:34.923751] [DEBUG] [LOCAL ] STRV: Loaded 11394 existing records from primary storage. [2025-10-01T22:43:34.928477] [INFO ] [MAIN ] STRV: Loaded 11394 primary data records. [2025-10-01T22:43:34.930748] [DEBUG] [MAIN ] STNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:34.933240] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43841 primary records. [2025-10-01T22:43:34.932352] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-01T22:43:34.933407] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-01T22:43:34.946101] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-01T22:43:34.948184] [INFO ] [MAIN ] Derivative Progress: 1250/1587 symbols completed. STM took 1.2s. Estimated remaining: 2m 21s. Rate: 143.8 symbols/min [2025-10-01T22:43:34.972716] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:35.075789] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-01T22:43:35.080506] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-01T22:43:35.083287] [INFO ] [MAIN ] Derivative Progress: 1251/1587 symbols completed. STNG took 1.3s. Estimated remaining: 2m 20s. Rate: 143.9 symbols/min [2025-10-01T22:43:35.100620] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:35.330376] [DEBUG] [LOCAL ] STVN: Loaded 26254 existing records from primary storage. [2025-10-01T22:43:35.330750] [INFO ] [MAIN ] STVN: Loaded 26254 primary data records. [2025-10-01T22:43:35.438281] [DEBUG] [LOCAL ] STT: Loaded 50958 existing records from primary storage. [2025-10-01T22:43:35.474460] [INFO ] [MAIN ] STT: Loaded 50958 primary data records. [2025-10-01T22:43:35.907448] [DEBUG] [MAIN ] STRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:35.936202] [INFO ] [MAIN ] STRV: Generated 1794 derivative records from 11394 primary records. [2025-10-01T22:43:35.936296] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-01T22:43:36.105285] [DEBUG] [LOCAL ] STRV: Derivative data saved (1794 records). [2025-10-01T22:43:36.105994] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-01T22:43:36.108481] [INFO ] [MAIN ] Derivative Progress: 1252/1587 symbols completed. STRV took 1.2s. Estimated remaining: 2m 20s. Rate: 143.7 symbols/min [2025-10-01T22:43:36.109051] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:36.126840] [DEBUG] [MAIN ] STVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:36.127944] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26254 primary records. [2025-10-01T22:43:36.128088] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-01T22:43:36.145677] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-01T22:43:36.146304] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-01T22:43:36.148687] [INFO ] [MAIN ] Derivative Progress: 1253/1587 symbols completed. STVN took 1.0s. Estimated remaining: 2m 19s. Rate: 143.8 symbols/min [2025-10-01T22:43:36.149045] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:36.154004] [DEBUG] [LOCAL ] STXD: Loaded 1289 existing records from primary storage. [2025-10-01T22:43:36.154171] [INFO ] [MAIN ] STXD: Loaded 1289 primary data records. [2025-10-01T22:43:36.274664] [DEBUG] [MAIN ] STT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:36.304846] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 50958 primary records. [2025-10-01T22:43:36.305013] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-01T22:43:36.545409] [DEBUG] [LOCAL ] STWD: Loaded 51884 existing records from primary storage. [2025-10-01T22:43:36.546999] [INFO ] [MAIN ] STWD: Loaded 51884 primary data records. [2025-10-01T22:43:36.591736] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-10-01T22:43:36.631337] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-01T22:43:36.648605] [INFO ] [MAIN ] Derivative Progress: 1254/1587 symbols completed. STT took 1.7s. Estimated remaining: 2m 19s. Rate: 143.8 symbols/min [2025-10-01T22:43:36.676170] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:36.772341] [DEBUG] [LOCAL ] STXE: Loaded 2183 existing records from primary storage. [2025-10-01T22:43:36.829714] [INFO ] [MAIN ] STXE: Loaded 2183 primary data records. [2025-10-01T22:43:37.058767] [DEBUG] [MAIN ] STXD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:37.059794] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1289 primary records. [2025-10-01T22:43:37.061253] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-01T22:43:37.288588] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-10-01T22:43:37.288757] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-01T22:43:37.290819] [INFO ] [MAIN ] Derivative Progress: 1255/1587 symbols completed. STXD took 1.1s. Estimated remaining: 2m 19s. Rate: 143.7 symbols/min [2025-10-01T22:43:37.291637] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:37.311761] [DEBUG] [MAIN ] STWD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:37.312891] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51884 primary records. [2025-10-01T22:43:37.312991] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-01T22:43:37.315847] [DEBUG] [LOCAL ] STXG: Loaded 2509 existing records from primary storage. [2025-10-01T22:43:37.316329] [INFO ] [MAIN ] STXG: Loaded 2509 primary data records. [2025-10-01T22:43:37.452745] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-01T22:43:37.467718] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-01T22:43:37.470989] [INFO ] [MAIN ] Derivative Progress: 1256/1587 symbols completed. STWD took 1.4s. Estimated remaining: 2m 18s. Rate: 143.8 symbols/min [2025-10-01T22:43:37.487338] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:37.701674] [DEBUG] [LOCAL ] STXK: Loaded 1483 existing records from primary storage. [2025-10-01T22:43:37.702686] [DEBUG] [MAIN ] STXE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:37.703707] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2183 primary records. [2025-10-01T22:43:37.703875] [INFO ] [MAIN ] STXK: Loaded 1483 primary data records. [2025-10-01T22:43:37.703806] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-01T22:43:37.842237] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-10-01T22:43:37.862959] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-01T22:43:37.921054] [INFO ] [MAIN ] Derivative Progress: 1257/1587 symbols completed. STXE took 1.2s. Estimated remaining: 2m 18s. Rate: 143.8 symbols/min [2025-10-01T22:43:38.086540] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:38.104024] [DEBUG] [LOCAL ] STXT: Loaded 2540 existing records from primary storage. [2025-10-01T22:43:38.104877] [INFO ] [MAIN ] STXT: Loaded 2540 primary data records. [2025-10-01T22:43:38.240945] [DEBUG] [MAIN ] STXG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:38.263180] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2509 primary records. [2025-10-01T22:43:38.304689] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-01T22:43:38.465926] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-01T22:43:38.467109] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-01T22:43:38.471344] [INFO ] [MAIN ] Derivative Progress: 1258/1587 symbols completed. STXG took 1.2s. Estimated remaining: 2m 17s. Rate: 143.8 symbols/min [2025-10-01T22:43:38.487883] [DEBUG] [MAIN ] STXK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:38.488979] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1483 primary records. [2025-10-01T22:43:38.489089] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-01T22:43:38.505681] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-10-01T22:43:38.506006] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-01T22:43:38.508334] [INFO ] [MAIN ] Derivative Progress: 1259/1587 symbols completed. STXK took 1.0s. Estimated remaining: 2m 17s. Rate: 143.9 symbols/min [2025-10-01T22:43:38.524001] [DEBUG] [MAIN ] STXT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:38.524734] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2540 primary records. [2025-10-01T22:43:38.524798] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-01T22:43:38.539521] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-10-01T22:43:38.539601] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-01T22:43:38.542317] [INFO ] [MAIN ] Derivative Progress: 1260/1587 symbols completed. STXT took 0.5s. Estimated remaining: 2m 16s. Rate: 144.0 symbols/min [2025-10-01T22:43:38.543029] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:38.542871] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:38.542961] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:38.548241] [DEBUG] [LOCAL ] STXV: Loaded 1575 existing records from primary storage. [2025-10-01T22:43:38.548501] [INFO ] [MAIN ] STXV: Loaded 1575 primary data records. [2025-10-01T22:43:38.922469] [DEBUG] [LOCAL ] SU: Loaded 53452 existing records from primary storage. [2025-10-01T22:43:38.936187] [INFO ] [MAIN ] SU: Loaded 53452 primary data records. [2025-10-01T22:43:38.938507] [DEBUG] [LOCAL ] STZ: Loaded 52287 existing records from primary storage. [2025-10-01T22:43:38.950734] [INFO ] [MAIN ] STZ: Loaded 52287 primary data records. [2025-10-01T22:43:39.350006] [DEBUG] [MAIN ] STXV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:43:39.466279] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1575 primary records. [2025-10-01T22:43:39.502594] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-01T22:43:39.655796] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-10-01T22:43:39.657053] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-01T22:43:39.659844] [INFO ] [MAIN ] Derivative Progress: 1261/1587 symbols completed. STXV took 1.1s. Estimated remaining: 2m 16s. Rate: 143.8 symbols/min [2025-10-01T22:43:39.660140] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:39.683435] [DEBUG] [MAIN ] SU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:39.684212] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53452 primary records. [2025-10-01T22:43:39.684304] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-01T22:43:39.704243] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-01T22:43:39.704450] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-01T22:43:39.706829] [INFO ] [MAIN ] Derivative Progress: 1262/1587 symbols completed. SU took 1.2s. Estimated remaining: 2m 16s. Rate: 143.9 symbols/min [2025-10-01T22:43:39.715144] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:39.730989] [DEBUG] [MAIN ] STZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:39.732214] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52287 primary records. [2025-10-01T22:43:39.732496] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-01T22:43:39.762950] [DEBUG] [LOCAL ] SUI: Loaded 41743 existing records from primary storage. [2025-10-01T22:43:39.763414] [INFO ] [MAIN ] SUI: Loaded 41743 primary data records. [2025-10-01T22:43:39.764571] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-10-01T22:43:39.764806] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-01T22:43:39.801677] [INFO ] [MAIN ] Derivative Progress: 1263/1587 symbols completed. STZ took 1.3s. Estimated remaining: 2m 15s. Rate: 144.0 symbols/min [2025-10-01T22:43:39.815758] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:39.975337] [DEBUG] [LOCAL ] SUN: Loaded 37534 existing records from primary storage. [2025-10-01T22:43:39.998948] [INFO ] [MAIN ] SUN: Loaded 37534 primary data records. [2025-10-01T22:43:40.306261] [DEBUG] [LOCAL ] SUPV: Loaded 47322 existing records from primary storage. [2025-10-01T22:43:40.361153] [INFO ] [MAIN ] SUPV: Loaded 47322 primary data records. [2025-10-01T22:43:40.863128] [DEBUG] [MAIN ] SUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:40.864069] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41743 primary records. [2025-10-01T22:43:40.864798] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-01T22:43:40.885520] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-01T22:43:40.886014] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-01T22:43:40.888486] [INFO ] [MAIN ] Derivative Progress: 1264/1587 symbols completed. SUI took 1.2s. Estimated remaining: 2m 15s. Rate: 143.8 symbols/min [2025-10-01T22:43:40.889179] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:40.907093] [DEBUG] [MAIN ] SUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:40.907926] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37534 primary records. [2025-10-01T22:43:40.908204] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-01T22:43:40.925836] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-01T22:43:40.926019] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-01T22:43:40.928520] [INFO ] [MAIN ] Derivative Progress: 1265/1587 symbols completed. SUN took 1.2s. Estimated remaining: 2m 14s. Rate: 143.9 symbols/min [2025-10-01T22:43:40.928877] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:40.956832] [DEBUG] [MAIN ] SUPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:40.957740] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47322 primary records. [2025-10-01T22:43:40.957927] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-01T22:43:40.996943] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-01T22:43:40.997220] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-01T22:43:41.002073] [DEBUG] [LOCAL ] SUZ: Loaded 45628 existing records from primary storage. [2025-10-01T22:43:41.000589] [INFO ] [MAIN ] Derivative Progress: 1266/1587 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 14s. Rate: 144.0 symbols/min [2025-10-01T22:43:41.002402] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:41.002900] [INFO ] [MAIN ] SUZ: Loaded 45628 primary data records. [2025-10-01T22:43:41.175024] [DEBUG] [LOCAL ] SVV: Loaded 39746 existing records from primary storage. [2025-10-01T22:43:41.210368] [INFO ] [MAIN ] SVV: Loaded 39746 primary data records. [2025-10-01T22:43:41.542013] [DEBUG] [LOCAL ] SW: Loaded 53162 existing records from primary storage. [2025-10-01T22:43:41.604877] [INFO ] [MAIN ] SW: Loaded 53162 primary data records. [2025-10-01T22:43:42.126277] [DEBUG] [MAIN ] SUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:42.127958] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45628 primary records. [2025-10-01T22:43:42.128259] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-01T22:43:42.153720] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-01T22:43:42.154126] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-01T22:43:42.156676] [INFO ] [MAIN ] Derivative Progress: 1267/1587 symbols completed. SUZ took 1.3s. Estimated remaining: 2m 14s. Rate: 143.8 symbols/min [2025-10-01T22:43:42.164777] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:42.172549] [DEBUG] [MAIN ] SVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:42.173999] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39746 primary records. [2025-10-01T22:43:42.174267] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-01T22:43:42.194127] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-01T22:43:42.194311] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-01T22:43:42.197933] [INFO ] [MAIN ] Derivative Progress: 1268/1587 symbols completed. SVV took 1.3s. Estimated remaining: 2m 13s. Rate: 143.9 symbols/min [2025-10-01T22:43:42.198259] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:42.219346] [DEBUG] [MAIN ] SW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:42.220342] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53162 primary records. [2025-10-01T22:43:42.220536] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-01T22:43:42.249630] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-01T22:43:42.249914] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-01T22:43:42.252714] [INFO ] [MAIN ] Derivative Progress: 1269/1587 symbols completed. SW took 1.3s. Estimated remaining: 2m 13s. Rate: 144.0 symbols/min [2025-10-01T22:43:42.253184] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:42.281139] [DEBUG] [LOCAL ] SWX: Loaded 31005 existing records from primary storage. [2025-10-01T22:43:42.281361] [INFO ] [MAIN ] SWX: Loaded 31005 primary data records. [2025-10-01T22:43:42.309264] [DEBUG] [LOCAL ] SWZ: Loaded 6050 existing records from primary storage. [2025-10-01T22:43:42.331973] [INFO ] [MAIN ] SWZ: Loaded 6050 primary data records. [2025-10-01T22:43:42.503452] [DEBUG] [LOCAL ] SWK: Loaded 52406 existing records from primary storage. [2025-10-01T22:43:42.528971] [INFO ] [MAIN ] SWK: Loaded 52406 primary data records. [2025-10-01T22:43:43.456391] [DEBUG] [MAIN ] SWX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:43.459453] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31005 primary records. [2025-10-01T22:43:43.459587] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-01T22:43:43.457943] [DEBUG] [MAIN ] SWZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:43.460469] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6050 primary records. [2025-10-01T22:43:43.461511] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-01T22:43:43.496568] [DEBUG] [MAIN ] SWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:43.502590] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52406 primary records. [2025-10-01T22:43:43.499159] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-01T22:43:43.504087] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-01T22:43:43.504437] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-01T22:43:43.509271] [INFO ] [MAIN ] Derivative Progress: 1270/1587 symbols completed. SWX took 1.3s. Estimated remaining: 2m 12s. Rate: 143.8 symbols/min [2025-10-01T22:43:43.510026] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:43.510542] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-10-01T22:43:43.510985] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-01T22:43:43.522032] [INFO ] [MAIN ] Derivative Progress: 1271/1587 symbols completed. SWZ took 1.3s. Estimated remaining: 2m 12s. Rate: 143.9 symbols/min [2025-10-01T22:43:43.526332] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:43.532210] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-01T22:43:43.532438] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-01T22:43:43.535239] [INFO ] [MAIN ] Derivative Progress: 1272/1587 symbols completed. SWK took 1.4s. Estimated remaining: 2m 11s. Rate: 144.0 symbols/min [2025-10-01T22:43:43.535533] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:43.545435] [DEBUG] [LOCAL ] SXI: Loaded 11546 existing records from primary storage. [2025-10-01T22:43:43.545565] [INFO ] [MAIN ] SXI: Loaded 11546 primary data records. [2025-10-01T22:43:43.917700] [DEBUG] [LOCAL ] SXT: Loaded 29411 existing records from primary storage. [2025-10-01T22:43:43.918097] [INFO ] [MAIN ] SXT: Loaded 29411 primary data records. [2025-10-01T22:43:43.924713] [DEBUG] [LOCAL ] SXC: Loaded 41433 existing records from primary storage. [2025-10-01T22:43:43.932825] [INFO ] [MAIN ] SXC: Loaded 41433 primary data records. [2025-10-01T22:43:44.753239] [DEBUG] [MAIN ] SXI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:44.754290] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11546 primary records. [2025-10-01T22:43:44.755289] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-01T22:43:44.780820] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-01T22:43:44.782928] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-01T22:43:44.785439] [INFO ] [MAIN ] Derivative Progress: 1273/1587 symbols completed. SXI took 1.3s. Estimated remaining: 2m 11s. Rate: 143.7 symbols/min [2025-10-01T22:43:44.798873] [DEBUG] [MAIN ] SXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:44.799573] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29411 primary records. [2025-10-01T22:43:44.799767] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-01T22:43:44.819576] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-01T22:43:44.819778] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-01T22:43:44.821986] [INFO ] [MAIN ] Derivative Progress: 1274/1587 symbols completed. SXT took 1.3s. Estimated remaining: 2m 11s. Rate: 143.9 symbols/min [2025-10-01T22:43:44.835259] [DEBUG] [MAIN ] SXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:44.835893] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41433 primary records. [2025-10-01T22:43:44.835958] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-01T22:43:44.851892] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-01T22:43:44.851961] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-01T22:43:44.854951] [INFO ] [MAIN ] Derivative Progress: 1275/1587 symbols completed. SXC took 1.3s. Estimated remaining: 2m 10s. Rate: 144.0 symbols/min [2025-10-01T22:43:44.855364] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:44.855575] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:44.855508] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:44.925422] [DEBUG] [LOCAL ] SYK: Loaded 46895 existing records from primary storage. [2025-10-01T22:43:44.925588] [INFO ] [MAIN ] SYK: Loaded 46895 primary data records. [2025-10-01T22:43:45.068096] [DEBUG] [LOCAL ] SYF: Loaded 53442 existing records from primary storage. [2025-10-01T22:43:45.082629] [INFO ] [MAIN ] SYF: Loaded 53442 primary data records. [2025-10-01T22:43:45.241698] [DEBUG] [LOCAL ] SYY: Loaded 53221 existing records from primary storage. [2025-10-01T22:43:45.394429] [INFO ] [MAIN ] SYY: Loaded 53221 primary data records. [2025-10-01T22:43:46.029428] [DEBUG] [MAIN ] SYK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:46.030722] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46895 primary records. [2025-10-01T22:43:46.031282] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-01T22:43:46.067913] [DEBUG] [MAIN ] SYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:46.068756] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-10-01T22:43:46.068842] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-01T22:43:46.069528] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53442 primary records. [2025-10-01T22:43:46.071777] [INFO ] [MAIN ] Derivative Progress: 1276/1587 symbols completed. SYK took 1.2s. Estimated remaining: 2m 10s. Rate: 143.7 symbols/min [2025-10-01T22:43:46.072212] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-01T22:43:46.073278] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:46.091340] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-01T22:43:46.093197] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-01T22:43:46.095807] [INFO ] [MAIN ] Derivative Progress: 1277/1587 symbols completed. SYF took 1.2s. Estimated remaining: 2m 9s. Rate: 143.8 symbols/min [2025-10-01T22:43:46.096133] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:46.110299] [DEBUG] [MAIN ] SYY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:46.111214] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53221 primary records. [2025-10-01T22:43:46.111370] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-01T22:43:46.129281] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-01T22:43:46.129458] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-01T22:43:46.133218] [INFO ] [MAIN ] Derivative Progress: 1278/1587 symbols completed. SYY took 1.3s. Estimated remaining: 2m 9s. Rate: 143.9 symbols/min [2025-10-01T22:43:46.133564] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:46.191770] [DEBUG] [LOCAL ] TAC: Loaded 42555 existing records from primary storage. [2025-10-01T22:43:46.191954] [INFO ] [MAIN ] TAC: Loaded 42555 primary data records. [2025-10-01T22:43:46.341896] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-01T22:43:46.354791] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-01T22:43:46.454236] [DEBUG] [LOCAL ] TAK: Loaded 49821 existing records from primary storage. [2025-10-01T22:43:46.473723] [INFO ] [MAIN ] TAK: Loaded 49821 primary data records. [2025-10-01T22:43:47.369703] [DEBUG] [MAIN ] TAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:47.370946] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42555 primary records. [2025-10-01T22:43:47.371125] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-01T22:43:47.394954] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-01T22:43:47.395417] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-01T22:43:47.397817] [INFO ] [MAIN ] Derivative Progress: 1279/1587 symbols completed. TAC took 1.3s. Estimated remaining: 2m 9s. Rate: 143.7 symbols/min [2025-10-01T22:43:47.419505] [DEBUG] [MAIN ] T: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:47.398187] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:47.426182] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-01T22:43:47.425252] [DEBUG] [MAIN ] TAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:47.426898] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-01T22:43:47.426810] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49821 primary records. [2025-10-01T22:43:47.427967] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-01T22:43:47.459300] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-01T22:43:47.460461] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-01T22:43:47.463937] [INFO ] [MAIN ] Derivative Progress: 1280/1587 symbols completed. T took 1.4s. Estimated remaining: 2m 8s. Rate: 143.8 symbols/min [2025-10-01T22:43:47.464899] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:47.467528] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-01T22:43:47.467761] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-01T22:43:47.470889] [INFO ] [MAIN ] Derivative Progress: 1281/1587 symbols completed. TAK took 1.3s. Estimated remaining: 2m 8s. Rate: 143.9 symbols/min [2025-10-01T22:43:47.471216] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:47.571058] [DEBUG] [LOCAL ] TAL: Loaded 51940 existing records from primary storage. [2025-10-01T22:43:47.572825] [INFO ] [MAIN ] TAL: Loaded 51940 primary data records. [2025-10-01T22:43:47.572630] [DEBUG] [LOCAL ] TALO: Loaded 50794 existing records from primary storage. [2025-10-01T22:43:47.578381] [INFO ] [MAIN ] TALO: Loaded 50794 primary data records. [2025-10-01T22:43:47.683019] [DEBUG] [LOCAL ] TAP: Loaded 52899 existing records from primary storage. [2025-10-01T22:43:47.796741] [INFO ] [MAIN ] TAP: Loaded 52899 primary data records. [2025-10-01T22:43:48.657553] [DEBUG] [MAIN ] TALO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:48.659121] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50794 primary records. [2025-10-01T22:43:48.659293] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-01T22:43:48.685959] [DEBUG] [MAIN ] TAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:48.688951] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51940 primary records. [2025-10-01T22:43:48.689323] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-01T22:43:48.722438] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-01T22:43:48.723011] [DEBUG] [MAIN ] TAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:48.723507] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-01T22:43:48.727379] [INFO ] [MAIN ] Derivative Progress: 1282/1587 symbols completed. TALO took 1.3s. Estimated remaining: 2m 7s. Rate: 143.7 symbols/min [2025-10-01T22:43:48.729263] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:48.730679] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-01T22:43:48.732488] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-01T22:43:48.734462] [INFO ] [MAIN ] Derivative Progress: 1283/1587 symbols completed. TAL took 1.3s. Estimated remaining: 2m 7s. Rate: 143.8 symbols/min [2025-10-01T22:43:48.734784] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:48.731941] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52899 primary records. [2025-10-01T22:43:48.735506] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-01T22:43:48.758399] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-01T22:43:48.763721] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-01T22:43:48.763608] [DEBUG] [LOCAL ] TBB: Loaded 11716 existing records from primary storage. [2025-10-01T22:43:48.766148] [INFO ] [MAIN ] Derivative Progress: 1284/1587 symbols completed. TAP took 1.3s. Estimated remaining: 2m 6s. Rate: 143.9 symbols/min [2025-10-01T22:43:48.766423] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:48.766853] [INFO ] [MAIN ] TBB: Loaded 11716 primary data records. [2025-10-01T22:43:48.972812] [DEBUG] [LOCAL ] TBI: Loaded 22542 existing records from primary storage. [2025-10-01T22:43:48.974056] [DEBUG] [LOCAL ] TBBB: Loaded 35666 existing records from primary storage. [2025-10-01T22:43:48.980565] [INFO ] [MAIN ] TBI: Loaded 22542 primary data records. [2025-10-01T22:43:49.003369] [INFO ] [MAIN ] TBBB: Loaded 35666 primary data records. [2025-10-01T22:43:49.906235] [DEBUG] [MAIN ] TBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:49.907329] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11716 primary records. [2025-10-01T22:43:49.907821] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-01T22:43:49.930521] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-01T22:43:49.931338] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-01T22:43:49.934070] [INFO ] [MAIN ] Derivative Progress: 1285/1587 symbols completed. TBB took 1.2s. Estimated remaining: 2m 6s. Rate: 143.7 symbols/min [2025-10-01T22:43:49.934450] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:49.949004] [DEBUG] [MAIN ] TBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:49.950195] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22542 primary records. [2025-10-01T22:43:49.950298] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-01T22:43:49.967690] [DEBUG] [LOCAL ] TBN: Loaded 3526 existing records from primary storage. [2025-10-01T22:43:49.969004] [INFO ] [MAIN ] TBN: Loaded 3526 primary data records. [2025-10-01T22:43:50.007295] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-01T22:43:50.035529] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-01T22:43:50.067006] [INFO ] [MAIN ] Derivative Progress: 1286/1587 symbols completed. TBI took 1.3s. Estimated remaining: 2m 6s. Rate: 143.8 symbols/min [2025-10-01T22:43:50.095224] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:50.130490] [DEBUG] [MAIN ] TBBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:50.192336] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35666 primary records. [2025-10-01T22:43:50.294759] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-01T22:43:50.341895] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-01T22:43:50.342401] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-01T22:43:50.344942] [INFO ] [MAIN ] Derivative Progress: 1287/1587 symbols completed. TBBB took 1.6s. Estimated remaining: 2m 5s. Rate: 143.8 symbols/min [2025-10-01T22:43:50.345626] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:50.399014] [DEBUG] [LOCAL ] TD: Loaded 52278 existing records from primary storage. [2025-10-01T22:43:50.404841] [INFO ] [MAIN ] TD: Loaded 52278 primary data records. [2025-10-01T22:43:50.405277] [DEBUG] [MAIN ] TBN: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-01T22:43:50.430352] [INFO ] [MAIN ] TBN: Generated 1791 derivative records from 3526 primary records. [2025-10-01T22:43:50.447354] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-01T22:43:50.558277] [DEBUG] [LOCAL ] TBN: Derivative data saved (1791 records). [2025-10-01T22:43:50.563788] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-01T22:43:50.614052] [INFO ] [MAIN ] Derivative Progress: 1288/1587 symbols completed. TBN took 0.7s. Estimated remaining: 2m 5s. Rate: 143.9 symbols/min [2025-10-01T22:43:50.784201] [DEBUG] [LOCAL ] TDC: Loaded 46627 existing records from primary storage. [2025-10-01T22:43:50.785030] [INFO ] [MAIN ] TDC: Loaded 46627 primary data records. [2025-10-01T22:43:51.144067] [DEBUG] [MAIN ] TD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:51.145431] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52278 primary records. [2025-10-01T22:43:51.146117] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-01T22:43:51.165721] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-01T22:43:51.165867] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-01T22:43:51.168225] [INFO ] [MAIN ] Derivative Progress: 1289/1587 symbols completed. TD took 1.1s. Estimated remaining: 2m 4s. Rate: 143.8 symbols/min [2025-10-01T22:43:51.186434] [DEBUG] [MAIN ] TDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:51.187181] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46627 primary records. [2025-10-01T22:43:51.187248] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-01T22:43:51.202680] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-01T22:43:51.202788] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-01T22:43:51.205310] [INFO ] [MAIN ] Derivative Progress: 1290/1587 symbols completed. TDC took 0.9s. Estimated remaining: 2m 4s. Rate: 143.9 symbols/min [2025-10-01T22:43:51.205872] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:51.205987] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:51.206129] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:51.216743] [DEBUG] [LOCAL ] TDF: Loaded 6409 existing records from primary storage. [2025-10-01T22:43:51.216969] [INFO ] [MAIN ] TDF: Loaded 6409 primary data records. [2025-10-01T22:43:51.352780] [DEBUG] [LOCAL ] TDG: Loaded 22010 existing records from primary storage. [2025-10-01T22:43:51.371695] [INFO ] [MAIN ] TDG: Loaded 22010 primary data records. [2025-10-01T22:43:51.762058] [DEBUG] [LOCAL ] TDOC: Loaded 53345 existing records from primary storage. [2025-10-01T22:43:51.762625] [INFO ] [MAIN ] TDOC: Loaded 53345 primary data records. [2025-10-01T22:43:52.353349] [DEBUG] [MAIN ] TDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:52.354984] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6409 primary records. [2025-10-01T22:43:52.355402] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-01T22:43:52.375562] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-01T22:43:52.376076] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-01T22:43:52.382397] [INFO ] [MAIN ] Derivative Progress: 1291/1587 symbols completed. TDF took 1.2s. Estimated remaining: 2m 4s. Rate: 143.7 symbols/min [2025-10-01T22:43:52.382708] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:52.397809] [DEBUG] [MAIN ] TDG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:52.399018] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22010 primary records. [2025-10-01T22:43:52.399383] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-01T22:43:52.420269] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-01T22:43:52.420462] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-01T22:43:52.430933] [INFO ] [MAIN ] Derivative Progress: 1292/1587 symbols completed. TDG took 1.2s. Estimated remaining: 2m 3s. Rate: 143.8 symbols/min [2025-10-01T22:43:52.436855] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:52.436596] [DEBUG] [MAIN ] TDOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:52.439134] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53345 primary records. [2025-10-01T22:43:52.439625] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-01T22:43:52.456699] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-01T22:43:52.456887] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-01T22:43:52.459509] [INFO ] [MAIN ] Derivative Progress: 1293/1587 symbols completed. TDOC took 1.3s. Estimated remaining: 2m 3s. Rate: 143.9 symbols/min [2025-10-01T22:43:52.459842] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:52.492883] [DEBUG] [LOCAL ] TDS: Loaded 42745 existing records from primary storage. [2025-10-01T22:43:52.508579] [INFO ] [MAIN ] TDS: Loaded 42745 primary data records. [2025-10-01T22:43:52.607418] [DEBUG] [LOCAL ] TDY: Loaded 22602 existing records from primary storage. [2025-10-01T22:43:52.622089] [INFO ] [MAIN ] TDY: Loaded 22602 primary data records. [2025-10-01T22:43:52.649580] [DEBUG] [LOCAL ] TDW: Loaded 45292 existing records from primary storage. [2025-10-01T22:43:52.673220] [INFO ] [MAIN ] TDW: Loaded 45292 primary data records. [2025-10-01T22:43:53.669562] [DEBUG] [MAIN ] TDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:53.670431] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42745 primary records. [2025-10-01T22:43:53.670725] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-01T22:43:53.721630] [DEBUG] [MAIN ] TDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:53.721097] [DEBUG] [MAIN ] TDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:53.723753] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22602 primary records. [2025-10-01T22:43:53.722481] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45292 primary records. [2025-10-01T22:43:53.724209] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-01T22:43:53.724317] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-01T22:43:53.724487] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-01T22:43:53.727355] [INFO ] [MAIN ] Derivative Progress: 1294/1587 symbols completed. TDS took 1.3s. Estimated remaining: 2m 2s. Rate: 143.7 symbols/min [2025-10-01T22:43:53.724380] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-01T22:43:53.727894] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:53.763443] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-01T22:43:53.764990] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-01T22:43:53.765089] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-01T22:43:53.767470] [INFO ] [MAIN ] Derivative Progress: 1295/1587 symbols completed. TDW took 1.3s. Estimated remaining: 2m 2s. Rate: 143.8 symbols/min [2025-10-01T22:43:53.767690] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-01T22:43:53.767803] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:53.770536] [INFO ] [MAIN ] Derivative Progress: 1296/1587 symbols completed. TDY took 1.3s. Estimated remaining: 2m 1s. Rate: 143.9 symbols/min [2025-10-01T22:43:53.772889] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:53.778920] [DEBUG] [LOCAL ] TEAF: Loaded 7618 existing records from primary storage. [2025-10-01T22:43:53.779088] [INFO ] [MAIN ] TEAF: Loaded 7618 primary data records. [2025-10-01T22:43:54.167150] [DEBUG] [LOCAL ] TEF: Loaded 37342 existing records from primary storage. [2025-10-01T22:43:54.167435] [INFO ] [MAIN ] TEF: Loaded 37342 primary data records. [2025-10-01T22:43:54.278780] [DEBUG] [LOCAL ] TECK: Loaded 53432 existing records from primary storage. [2025-10-01T22:43:54.300012] [INFO ] [MAIN ] TECK: Loaded 53432 primary data records. [2025-10-01T22:43:54.872900] [DEBUG] [MAIN ] TEAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:54.874816] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7618 primary records. [2025-10-01T22:43:54.875047] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-01T22:43:54.894044] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-01T22:43:54.894864] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-01T22:43:54.898048] [INFO ] [MAIN ] Derivative Progress: 1297/1587 symbols completed. TEAF took 1.2s. Estimated remaining: 2m 1s. Rate: 143.7 symbols/min [2025-10-01T22:43:54.898635] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:54.919011] [DEBUG] [MAIN ] TEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:54.919901] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37342 primary records. [2025-10-01T22:43:54.920076] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-01T22:43:54.942348] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-01T22:43:54.950236] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-01T22:43:54.954964] [INFO ] [MAIN ] Derivative Progress: 1298/1587 symbols completed. TEF took 1.2s. Estimated remaining: 2m 1s. Rate: 143.8 symbols/min [2025-10-01T22:43:54.955134] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:54.952797] [DEBUG] [LOCAL ] TEI: Loaded 21097 existing records from primary storage. [2025-10-01T22:43:54.955670] [INFO ] [MAIN ] TEI: Loaded 21097 primary data records. [2025-10-01T22:43:54.974173] [DEBUG] [MAIN ] TECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:55.017857] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53432 primary records. [2025-10-01T22:43:55.042354] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-01T22:43:55.164444] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-01T22:43:55.181068] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-01T22:43:55.184286] [INFO ] [MAIN ] Derivative Progress: 1299/1587 symbols completed. TECK took 1.4s. Estimated remaining: 2m 0s. Rate: 143.9 symbols/min [2025-10-01T22:43:55.190273] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:55.353134] [DEBUG] [LOCAL ] TEL: Loaded 51107 existing records from primary storage. [2025-10-01T22:43:55.353370] [INFO ] [MAIN ] TEL: Loaded 51107 primary data records. [2025-10-01T22:43:55.604233] [DEBUG] [LOCAL ] TEN: Loaded 30676 existing records from primary storage. [2025-10-01T22:43:55.726533] [INFO ] [MAIN ] TEN: Loaded 30676 primary data records. [2025-10-01T22:43:55.764674] [DEBUG] [MAIN ] TEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:55.796455] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21097 primary records. [2025-10-01T22:43:55.819902] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-01T22:43:56.137084] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-01T22:43:56.137497] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-01T22:43:56.140336] [INFO ] [MAIN ] Derivative Progress: 1300/1587 symbols completed. TEI took 1.2s. Estimated remaining: 1m 60s. Rate: 143.7 symbols/min [2025-10-01T22:43:56.141471] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:56.161287] [DEBUG] [MAIN ] TEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:56.162230] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51107 primary records. [2025-10-01T22:43:56.163329] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-01T22:43:56.193337] [DEBUG] [LOCAL ] TEO: Loaded 22070 existing records from primary storage. [2025-10-01T22:43:56.194483] [INFO ] [MAIN ] TEO: Loaded 22070 primary data records. [2025-10-01T22:43:56.195889] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-01T22:43:56.195996] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-01T22:43:56.198597] [INFO ] [MAIN ] Derivative Progress: 1301/1587 symbols completed. TEL took 1.2s. Estimated remaining: 1m 59s. Rate: 143.8 symbols/min [2025-10-01T22:43:56.234782] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:56.327928] [DEBUG] [MAIN ] TEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:56.339939] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30676 primary records. [2025-10-01T22:43:56.381635] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-01T22:43:56.552707] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-01T22:43:56.552882] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-01T22:43:56.555375] [INFO ] [MAIN ] Derivative Progress: 1302/1587 symbols completed. TEN took 1.4s. Estimated remaining: 1m 59s. Rate: 143.8 symbols/min [2025-10-01T22:43:56.555616] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:56.603573] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-10-01T22:43:56.616932] [INFO ] [MAIN ] TEVA: Loaded 53632 primary data records. [2025-10-01T22:43:56.617606] [DEBUG] [MAIN ] TEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:56.650976] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22070 primary records. [2025-10-01T22:43:56.667336] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-01T22:43:56.797633] [DEBUG] [LOCAL ] TEX: Loaded 44214 existing records from primary storage. [2025-10-01T22:43:56.850760] [INFO ] [MAIN ] TEX: Loaded 44214 primary data records. [2025-10-01T22:43:57.066836] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-01T22:43:57.087050] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-01T22:43:57.089915] [INFO ] [MAIN ] Derivative Progress: 1303/1587 symbols completed. TEO took 0.9s. Estimated remaining: 1m 58s. Rate: 143.8 symbols/min [2025-10-01T22:43:57.354601] [DEBUG] [MAIN ] TEVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:57.355789] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53632 primary records. [2025-10-01T22:43:57.355864] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-01T22:43:57.377881] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-10-01T22:43:57.378129] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-01T22:43:57.380727] [INFO ] [MAIN ] Derivative Progress: 1304/1587 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 58s. Rate: 143.8 symbols/min [2025-10-01T22:43:57.397965] [DEBUG] [MAIN ] TEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:57.398719] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44214 primary records. [2025-10-01T22:43:57.398789] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-01T22:43:57.415208] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-01T22:43:57.415380] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-01T22:43:57.417585] [INFO ] [MAIN ] Derivative Progress: 1305/1587 symbols completed. TEX took 0.9s. Estimated remaining: 1m 58s. Rate: 143.9 symbols/min [2025-10-01T22:43:57.418237] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:57.418344] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:57.418448] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:57.448791] [DEBUG] [LOCAL ] TFIN: Loaded 23462 existing records from primary storage. [2025-10-01T22:43:57.449074] [INFO ] [MAIN ] TFIN: Loaded 23462 primary data records. [2025-10-01T22:43:57.609925] [DEBUG] [LOCAL ] TFII: Loaded 33721 existing records from primary storage. [2025-10-01T22:43:57.671150] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-01T22:43:57.647202] [INFO ] [MAIN ] TFII: Loaded 33721 primary data records. [2025-10-01T22:43:57.681827] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-01T22:43:58.600409] [DEBUG] [MAIN ] TFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:58.601468] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23462 primary records. [2025-10-01T22:43:58.602255] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-01T22:43:58.625628] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-01T22:43:58.626443] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-01T22:43:58.628821] [INFO ] [MAIN ] Derivative Progress: 1306/1587 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 57s. Rate: 143.7 symbols/min [2025-10-01T22:43:58.629023] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:58.663970] [DEBUG] [MAIN ] TFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:58.665319] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-01T22:43:58.665561] [DEBUG] [MAIN ] TFII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:58.665729] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-01T22:43:58.667025] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33721 primary records. [2025-10-01T22:43:58.667240] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-01T22:43:58.702563] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-01T22:43:58.703527] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-01T22:43:58.706236] [INFO ] [MAIN ] Derivative Progress: 1307/1587 symbols completed. TFII took 1.3s. Estimated remaining: 1m 57s. Rate: 143.8 symbols/min [2025-10-01T22:43:58.707118] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:58.718636] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-01T22:43:58.719219] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-01T22:43:58.722227] [INFO ] [MAIN ] Derivative Progress: 1308/1587 symbols completed. TFC took 1.3s. Estimated remaining: 1m 56s. Rate: 143.9 symbols/min [2025-10-01T22:43:58.722679] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:58.742840] [DEBUG] [LOCAL ] TFPM: Loaded 37949 existing records from primary storage. [2025-10-01T22:43:58.748048] [INFO ] [MAIN ] TFPM: Loaded 37949 primary data records. [2025-10-01T22:43:58.747842] [DEBUG] [LOCAL ] TG: Loaded 10408 existing records from primary storage. [2025-10-01T22:43:58.748285] [INFO ] [MAIN ] TG: Loaded 10408 primary data records. [2025-10-01T22:43:59.041058] [DEBUG] [LOCAL ] TFX: Loaded 37085 existing records from primary storage. [2025-10-01T22:43:59.047210] [INFO ] [MAIN ] TFX: Loaded 37085 primary data records. [2025-10-01T22:43:59.858532] [DEBUG] [MAIN ] TFPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:59.860544] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 37949 primary records. [2025-10-01T22:43:59.860809] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-01T22:43:59.876449] [DEBUG] [MAIN ] TG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:59.886046] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10408 primary records. [2025-10-01T22:43:59.886303] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-01T22:43:59.904732] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-01T22:43:59.905423] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-01T22:43:59.907980] [INFO ] [MAIN ] Derivative Progress: 1309/1587 symbols completed. TFPM took 1.3s. Estimated remaining: 1m 56s. Rate: 143.7 symbols/min [2025-10-01T22:43:59.908295] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:59.924271] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-01T22:43:59.929312] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-01T22:43:59.929532] [DEBUG] [MAIN ] TFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:43:59.933059] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37085 primary records. [2025-10-01T22:43:59.933168] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-01T22:43:59.932175] [INFO ] [MAIN ] Derivative Progress: 1310/1587 symbols completed. TG took 1.2s. Estimated remaining: 1m 56s. Rate: 143.8 symbols/min [2025-10-01T22:43:59.933412] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:59.961112] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-01T22:43:59.963258] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-01T22:43:59.965879] [INFO ] [MAIN ] Derivative Progress: 1311/1587 symbols completed. TFX took 1.3s. Estimated remaining: 1m 55s. Rate: 143.9 symbols/min [2025-10-01T22:43:59.974567] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:43:59.975693] [DEBUG] [LOCAL ] TGLS: Loaded 27989 existing records from primary storage. [2025-10-01T22:43:59.976058] [INFO ] [MAIN ] TGLS: Loaded 27989 primary data records. [2025-10-01T22:44:00.212367] [DEBUG] [LOCAL ] TGNA: Loaded 48684 existing records from primary storage. [2025-10-01T22:44:00.236888] [INFO ] [MAIN ] TGNA: Loaded 48684 primary data records. [2025-10-01T22:44:00.237619] [DEBUG] [LOCAL ] TGS: Loaded 32839 existing records from primary storage. [2025-10-01T22:44:00.426479] [INFO ] [MAIN ] TGS: Loaded 32839 primary data records. [2025-10-01T22:44:01.122788] [DEBUG] [MAIN ] TGLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:01.125166] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27989 primary records. [2025-10-01T22:44:01.125536] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-01T22:44:01.165016] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-01T22:44:01.164530] [DEBUG] [MAIN ] TGNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:01.166056] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48684 primary records. [2025-10-01T22:44:01.165150] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-01T22:44:01.168392] [INFO ] [MAIN ] Derivative Progress: 1312/1587 symbols completed. TGLS took 1.3s. Estimated remaining: 1m 55s. Rate: 143.7 symbols/min [2025-10-01T22:44:01.168509] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-01T22:44:01.168734] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:01.182533] [DEBUG] [MAIN ] TGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:01.183638] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32839 primary records. [2025-10-01T22:44:01.184033] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-01T22:44:01.216936] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-01T22:44:01.218405] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-01T22:44:01.217773] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-01T22:44:01.221317] [INFO ] [MAIN ] Derivative Progress: 1313/1587 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 54s. Rate: 143.8 symbols/min [2025-10-01T22:44:01.221524] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:01.222103] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-01T22:44:01.224936] [INFO ] [MAIN ] Derivative Progress: 1314/1587 symbols completed. TGS took 1.3s. Estimated remaining: 1m 54s. Rate: 143.9 symbols/min [2025-10-01T22:44:01.225210] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:01.264957] [DEBUG] [LOCAL ] THG: Loaded 21689 existing records from primary storage. [2025-10-01T22:44:01.265178] [INFO ] [MAIN ] THG: Loaded 21689 primary data records. [2025-10-01T22:44:01.346307] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-01T22:44:01.367875] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-10-01T22:44:01.672229] [DEBUG] [LOCAL ] THC: Loaded 47674 existing records from primary storage. [2025-10-01T22:44:01.812931] [INFO ] [MAIN ] THC: Loaded 47674 primary data records. [2025-10-01T22:44:02.382404] [DEBUG] [MAIN ] THG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:02.385007] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21689 primary records. [2025-10-01T22:44:02.385232] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-01T22:44:02.413361] [DEBUG] [MAIN ] TGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:02.415023] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-10-01T22:44:02.415727] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-01T22:44:02.419091] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-01T22:44:02.419232] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-01T22:44:02.421767] [INFO ] [MAIN ] Derivative Progress: 1315/1587 symbols completed. THG took 1.2s. Estimated remaining: 1m 54s. Rate: 143.7 symbols/min [2025-10-01T22:44:02.430942] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:02.440421] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-01T22:44:02.440626] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-01T22:44:02.443979] [INFO ] [MAIN ] Derivative Progress: 1316/1587 symbols completed. TGT took 1.3s. Estimated remaining: 1m 53s. Rate: 143.8 symbols/min [2025-10-01T22:44:02.444453] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:02.447787] [DEBUG] [LOCAL ] THIR: Loaded 2204 existing records from primary storage. [2025-10-01T22:44:02.448212] [INFO ] [MAIN ] THIR: Loaded 2204 primary data records. [2025-10-01T22:44:02.543618] [DEBUG] [LOCAL ] THLV: Loaded 1543 existing records from primary storage. [2025-10-01T22:44:02.570575] [INFO ] [MAIN ] THLV: Loaded 1543 primary data records. [2025-10-01T22:44:02.609393] [DEBUG] [MAIN ] THC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:02.654456] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47674 primary records. [2025-10-01T22:44:02.691100] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-01T22:44:02.997219] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-01T22:44:03.002690] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-01T22:44:03.040276] [INFO ] [MAIN ] Derivative Progress: 1317/1587 symbols completed. THC took 1.8s. Estimated remaining: 1m 53s. Rate: 143.8 symbols/min [2025-10-01T22:44:03.186492] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:03.255106] [DEBUG] [MAIN ] THLV: Filtered 6931 bins outside market hours, 7730 incomplete bins [2025-10-01T22:44:03.255759] [DEBUG] [MAIN ] THIR: Filtered 6931 bins outside market hours, 7734 incomplete bins [2025-10-01T22:44:03.256575] [INFO ] [MAIN ] THLV: Generated 1788 derivative records from 1543 primary records. [2025-10-01T22:44:03.257313] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-01T22:44:03.257245] [INFO ] [MAIN ] THIR: Generated 1784 derivative records from 2204 primary records. [2025-10-01T22:44:03.257404] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-01T22:44:03.297188] [DEBUG] [LOCAL ] THO: Loaded 41945 existing records from primary storage. [2025-10-01T22:44:03.298689] [INFO ] [MAIN ] THO: Loaded 41945 primary data records. [2025-10-01T22:44:03.329112] [DEBUG] [LOCAL ] THIR: Derivative data saved (1784 records). [2025-10-01T22:44:03.316755] [DEBUG] [LOCAL ] THLV: Derivative data saved (1788 records). [2025-10-01T22:44:03.329248] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-01T22:44:03.350598] [INFO ] [MAIN ] Derivative Progress: 1318/1587 symbols completed. THIR took 0.9s. Estimated remaining: 1m 52s. Rate: 143.8 symbols/min [2025-10-01T22:44:03.350715] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-01T22:44:03.383671] [INFO ] [MAIN ] Derivative Progress: 1319/1587 symbols completed. THLV took 0.9s. Estimated remaining: 1m 52s. Rate: 143.9 symbols/min [2025-10-01T22:44:03.684553] [DEBUG] [MAIN ] THO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:03.685247] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41945 primary records. [2025-10-01T22:44:03.685310] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-01T22:44:03.702584] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-01T22:44:03.702749] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-01T22:44:03.705042] [INFO ] [MAIN ] Derivative Progress: 1320/1587 symbols completed. THO took 0.5s. Estimated remaining: 1m 51s. Rate: 143.9 symbols/min [2025-10-01T22:44:03.705500] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:03.705566] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:03.705816] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:03.732848] [DEBUG] [LOCAL ] THR: Loaded 19834 existing records from primary storage. [2025-10-01T22:44:03.732986] [INFO ] [MAIN ] THR: Loaded 19834 primary data records. [2025-10-01T22:44:03.828268] [DEBUG] [LOCAL ] THQ: Loaded 24975 existing records from primary storage. [2025-10-01T22:44:03.833622] [INFO ] [MAIN ] THQ: Loaded 24975 primary data records. [2025-10-01T22:44:04.012532] [DEBUG] [LOCAL ] THS: Loaded 38195 existing records from primary storage. [2025-10-01T22:44:04.078327] [INFO ] [MAIN ] THS: Loaded 38195 primary data records. [2025-10-01T22:44:04.832239] [DEBUG] [MAIN ] THR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:04.841553] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19834 primary records. [2025-10-01T22:44:04.847048] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-01T22:44:04.847224] [DEBUG] [MAIN ] THQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:04.848985] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24975 primary records. [2025-10-01T22:44:04.849469] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-01T22:44:04.893311] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-01T22:44:04.894981] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-01T22:44:04.893954] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-01T22:44:04.895245] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-01T22:44:04.898228] [INFO ] [MAIN ] Derivative Progress: 1321/1587 symbols completed. THR took 1.2s. Estimated remaining: 1m 51s. Rate: 143.7 symbols/min [2025-10-01T22:44:04.903250] [INFO ] [MAIN ] Derivative Progress: 1322/1587 symbols completed. THQ took 1.2s. Estimated remaining: 1m 51s. Rate: 143.8 symbols/min [2025-10-01T22:44:04.902388] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:04.903808] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:04.919296] [DEBUG] [MAIN ] THS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:04.920217] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38195 primary records. [2025-10-01T22:44:04.920444] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-01T22:44:04.938618] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-01T22:44:04.938847] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-01T22:44:04.941234] [INFO ] [MAIN ] Derivative Progress: 1323/1587 symbols completed. THS took 1.2s. Estimated remaining: 1m 50s. Rate: 143.9 symbols/min [2025-10-01T22:44:04.941550] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:04.957775] [DEBUG] [LOCAL ] TISI: Loaded 3733 existing records from primary storage. [2025-10-01T22:44:04.957996] [INFO ] [MAIN ] TISI: Loaded 3733 primary data records. [2025-10-01T22:44:05.039894] [DEBUG] [LOCAL ] THW: Loaded 19428 existing records from primary storage. [2025-10-01T22:44:05.068284] [INFO ] [MAIN ] THW: Loaded 19428 primary data records. [2025-10-01T22:44:05.170103] [DEBUG] [LOCAL ] TIMB: Loaded 36109 existing records from primary storage. [2025-10-01T22:44:05.206085] [INFO ] [MAIN ] TIMB: Loaded 36109 primary data records. [2025-10-01T22:44:06.013992] [DEBUG] [MAIN ] TISI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:06.027395] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3733 primary records. [2025-10-01T22:44:06.027890] [DEBUG] [MAIN ] THW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:06.028002] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-01T22:44:06.028719] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19428 primary records. [2025-10-01T22:44:06.028988] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-01T22:44:06.051363] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-10-01T22:44:06.060287] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-01T22:44:06.064001] [INFO ] [MAIN ] Derivative Progress: 1324/1587 symbols completed. TISI took 1.1s. Estimated remaining: 1m 50s. Rate: 143.8 symbols/min [2025-10-01T22:44:06.064448] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:06.065489] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-01T22:44:06.066105] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-01T22:44:06.081988] [DEBUG] [MAIN ] TIMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:06.081548] [INFO ] [MAIN ] Derivative Progress: 1325/1587 symbols completed. THW took 1.2s. Estimated remaining: 1m 49s. Rate: 143.9 symbols/min [2025-10-01T22:44:06.082945] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 36109 primary records. [2025-10-01T22:44:06.083061] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-01T22:44:06.083213] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:06.101602] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-01T22:44:06.101843] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-01T22:44:06.104719] [INFO ] [MAIN ] Derivative Progress: 1326/1587 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 49s. Rate: 144.0 symbols/min [2025-10-01T22:44:06.104971] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:06.127498] [DEBUG] [LOCAL ] TIXT: Loaded 31569 existing records from primary storage. [2025-10-01T22:44:06.127752] [INFO ] [MAIN ] TIXT: Loaded 31569 primary data records. [2025-10-01T22:44:06.511902] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-01T22:44:06.510045] [DEBUG] [LOCAL ] TK: Loaded 39476 existing records from primary storage. [2025-10-01T22:44:06.512285] [INFO ] [MAIN ] TJX: Loaded 53668 primary data records. [2025-10-01T22:44:06.512351] [INFO ] [MAIN ] TK: Loaded 39476 primary data records. [2025-10-01T22:44:07.263176] [DEBUG] [MAIN ] TIXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:07.264498] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31569 primary records. [2025-10-01T22:44:07.265876] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-01T22:44:07.283948] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-01T22:44:07.284333] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-01T22:44:07.286990] [INFO ] [MAIN ] Derivative Progress: 1327/1587 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 49s. Rate: 143.8 symbols/min [2025-10-01T22:44:07.287298] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:07.321174] [DEBUG] [MAIN ] TJX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:07.320905] [DEBUG] [MAIN ] TK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:07.322222] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39476 primary records. [2025-10-01T22:44:07.323011] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53668 primary records. [2025-10-01T22:44:07.322415] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-01T22:44:07.323429] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-01T22:44:07.356076] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-01T22:44:07.356890] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-01T22:44:07.360619] [INFO ] [MAIN ] Derivative Progress: 1328/1587 symbols completed. TJX took 1.3s. Estimated remaining: 1m 48s. Rate: 143.8 symbols/min [2025-10-01T22:44:07.371696] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-01T22:44:07.371813] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-01T22:44:07.373900] [INFO ] [MAIN ] Derivative Progress: 1329/1587 symbols completed. TK took 1.3s. Estimated remaining: 1m 48s. Rate: 144.0 symbols/min [2025-10-01T22:44:07.371155] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:07.374594] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:07.391390] [DEBUG] [LOCAL ] TKC: Loaded 39003 existing records from primary storage. [2025-10-01T22:44:07.391671] [INFO ] [MAIN ] TKC: Loaded 39003 primary data records. [2025-10-01T22:44:07.783384] [DEBUG] [LOCAL ] TKR: Loaded 40069 existing records from primary storage. [2025-10-01T22:44:07.784937] [DEBUG] [LOCAL ] TKO: Loaded 44051 existing records from primary storage. [2025-10-01T22:44:07.785139] [INFO ] [MAIN ] TKR: Loaded 40069 primary data records. [2025-10-01T22:44:07.785223] [INFO ] [MAIN ] TKO: Loaded 44051 primary data records. [2025-10-01T22:44:08.491325] [DEBUG] [MAIN ] TKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:08.492931] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 39003 primary records. [2025-10-01T22:44:08.493252] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-01T22:44:08.513896] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-01T22:44:08.514701] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-01T22:44:08.524781] [INFO ] [MAIN ] Derivative Progress: 1330/1587 symbols completed. TKC took 1.2s. Estimated remaining: 1m 47s. Rate: 143.8 symbols/min [2025-10-01T22:44:08.529989] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:08.530729] [DEBUG] [MAIN ] TKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:08.532274] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40069 primary records. [2025-10-01T22:44:08.532491] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-01T22:44:08.551813] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-01T22:44:08.553553] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-01T22:44:08.555884] [INFO ] [MAIN ] Derivative Progress: 1331/1587 symbols completed. TKR took 1.2s. Estimated remaining: 1m 47s. Rate: 143.9 symbols/min [2025-10-01T22:44:08.556469] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:08.570369] [DEBUG] [MAIN ] TKO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:08.571691] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44051 primary records. [2025-10-01T22:44:08.571976] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-01T22:44:08.606055] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-01T22:44:08.613119] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-01T22:44:08.613015] [DEBUG] [LOCAL ] TLYS: Loaded 16584 existing records from primary storage. [2025-10-01T22:44:08.616321] [INFO ] [MAIN ] TLYS: Loaded 16584 primary data records. [2025-10-01T22:44:08.616091] [INFO ] [MAIN ] Derivative Progress: 1332/1587 symbols completed. TKO took 1.2s. Estimated remaining: 1m 46s. Rate: 144.0 symbols/min [2025-10-01T22:44:08.633250] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:08.661940] [DEBUG] [LOCAL ] TLK: Loaded 39238 existing records from primary storage. [2025-10-01T22:44:08.662117] [INFO ] [MAIN ] TLK: Loaded 39238 primary data records. [2025-10-01T22:44:09.355514] [DEBUG] [LOCAL ] TM: Loaded 36397 existing records from primary storage. [2025-10-01T22:44:09.355885] [INFO ] [MAIN ] TM: Loaded 36397 primary data records. [2025-10-01T22:44:09.724007] [DEBUG] [MAIN ] TLYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:09.726402] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16584 primary records. [2025-10-01T22:44:09.729746] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-01T22:44:09.757177] [DEBUG] [MAIN ] TLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:09.758923] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 39238 primary records. [2025-10-01T22:44:09.759375] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-01T22:44:09.778119] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-01T22:44:09.778496] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-01T22:44:09.781264] [INFO ] [MAIN ] Derivative Progress: 1333/1587 symbols completed. TLYS took 1.2s. Estimated remaining: 1m 46s. Rate: 143.8 symbols/min [2025-10-01T22:44:09.785295] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-01T22:44:09.785442] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-01T22:44:09.788921] [INFO ] [MAIN ] Derivative Progress: 1334/1587 symbols completed. TLK took 1.3s. Estimated remaining: 1m 46s. Rate: 143.9 symbols/min [2025-10-01T22:44:09.804467] [DEBUG] [MAIN ] TM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:09.805062] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36397 primary records. [2025-10-01T22:44:09.805125] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-01T22:44:09.820911] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-01T22:44:09.820974] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-01T22:44:09.823768] [INFO ] [MAIN ] Derivative Progress: 1335/1587 symbols completed. TM took 1.2s. Estimated remaining: 1m 45s. Rate: 144.0 symbols/min [2025-10-01T22:44:09.824129] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:09.824241] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:09.824526] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:09.867461] [DEBUG] [LOCAL ] TMHC: Loaded 45382 existing records from primary storage. [2025-10-01T22:44:09.867670] [INFO ] [MAIN ] TMHC: Loaded 45382 primary data records. [2025-10-01T22:44:10.082453] [DEBUG] [LOCAL ] TMO: Loaded 52345 existing records from primary storage. [2025-10-01T22:44:10.140497] [DEBUG] [LOCAL ] TME: Loaded 53192 existing records from primary storage. [2025-10-01T22:44:10.139617] [INFO ] [MAIN ] TMO: Loaded 52345 primary data records. [2025-10-01T22:44:10.284089] [INFO ] [MAIN ] TME: Loaded 53192 primary data records. [2025-10-01T22:44:11.000803] [DEBUG] [MAIN ] TMHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:11.001802] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45382 primary records. [2025-10-01T22:44:11.002020] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-01T22:44:11.021487] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-01T22:44:11.021982] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-01T22:44:11.024480] [INFO ] [MAIN ] Derivative Progress: 1336/1587 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 45s. Rate: 143.8 symbols/min [2025-10-01T22:44:11.024760] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:11.044280] [DEBUG] [MAIN ] TMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:11.045303] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52345 primary records. [2025-10-01T22:44:11.050267] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-01T22:44:11.074932] [DEBUG] [LOCAL ] TNC: Loaded 14841 existing records from primary storage. [2025-10-01T22:44:11.090635] [INFO ] [MAIN ] TNC: Loaded 14841 primary data records. [2025-10-01T22:44:11.091548] [DEBUG] [MAIN ] TME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:11.093783] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53192 primary records. [2025-10-01T22:44:11.099458] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-01T22:44:11.157410] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-01T22:44:11.182253] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-01T22:44:11.195391] [INFO ] [MAIN ] Derivative Progress: 1337/1587 symbols completed. TMO took 1.4s. Estimated remaining: 1m 44s. Rate: 143.8 symbols/min [2025-10-01T22:44:11.233488] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:11.254527] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-01T22:44:11.254833] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-01T22:44:11.258339] [INFO ] [MAIN ] Derivative Progress: 1338/1587 symbols completed. TME took 1.4s. Estimated remaining: 1m 44s. Rate: 143.9 symbols/min [2025-10-01T22:44:11.258584] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:11.541893] [DEBUG] [LOCAL ] TNET: Loaded 28523 existing records from primary storage. [2025-10-01T22:44:11.542599] [INFO ] [MAIN ] TNET: Loaded 28523 primary data records. [2025-10-01T22:44:11.627096] [DEBUG] [LOCAL ] TNK: Loaded 35156 existing records from primary storage. [2025-10-01T22:44:11.676709] [INFO ] [MAIN ] TNK: Loaded 35156 primary data records. [2025-10-01T22:44:12.151167] [DEBUG] [MAIN ] TNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:12.254900] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14841 primary records. [2025-10-01T22:44:12.269448] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-01T22:44:12.308727] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-01T22:44:12.309151] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-01T22:44:12.312464] [INFO ] [MAIN ] Derivative Progress: 1339/1587 symbols completed. TNC took 1.3s. Estimated remaining: 1m 44s. Rate: 143.8 symbols/min [2025-10-01T22:44:12.313110] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:12.335263] [DEBUG] [MAIN ] TNET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:12.336164] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28523 primary records. [2025-10-01T22:44:12.336485] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-01T22:44:12.358422] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-01T22:44:12.359561] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-01T22:44:12.362244] [INFO ] [MAIN ] Derivative Progress: 1340/1587 symbols completed. TNET took 1.1s. Estimated remaining: 1m 43s. Rate: 143.8 symbols/min [2025-10-01T22:44:12.372794] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:12.387440] [DEBUG] [MAIN ] TNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:12.388301] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35156 primary records. [2025-10-01T22:44:12.388463] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-01T22:44:12.419115] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-01T22:44:12.419429] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-01T22:44:12.422601] [INFO ] [MAIN ] Derivative Progress: 1341/1587 symbols completed. TNK took 1.2s. Estimated remaining: 1m 43s. Rate: 143.9 symbols/min [2025-10-01T22:44:12.423063] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:12.425112] [DEBUG] [LOCAL ] TNL: Loaded 41731 existing records from primary storage. [2025-10-01T22:44:12.426957] [INFO ] [MAIN ] TNL: Loaded 41731 primary data records. [2025-10-01T22:44:12.829226] [DEBUG] [LOCAL ] TOL: Loaded 50831 existing records from primary storage. [2025-10-01T22:44:12.829625] [INFO ] [MAIN ] TOL: Loaded 50831 primary data records. [2025-10-01T22:44:12.876931] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-10-01T22:44:12.929086] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-10-01T22:44:13.654609] [DEBUG] [MAIN ] TNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:13.657245] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41731 primary records. [2025-10-01T22:44:13.657496] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-01T22:44:13.686547] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-01T22:44:13.700735] [DEBUG] [MAIN ] TOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:13.700053] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-01T22:44:13.705020] [INFO ] [MAIN ] Derivative Progress: 1342/1587 symbols completed. TNL took 1.4s. Estimated remaining: 1m 42s. Rate: 143.7 symbols/min [2025-10-01T22:44:13.707094] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50831 primary records. [2025-10-01T22:44:13.705532] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:13.707379] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-01T22:44:13.727784] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-01T22:44:13.727988] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-01T22:44:13.731129] [INFO ] [MAIN ] Derivative Progress: 1343/1587 symbols completed. TOL took 1.4s. Estimated remaining: 1m 42s. Rate: 143.8 symbols/min [2025-10-01T22:44:13.733012] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:13.747862] [DEBUG] [MAIN ] TOST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:13.748730] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-10-01T22:44:13.755417] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-01T22:44:13.776137] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-01T22:44:13.785004] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-01T22:44:13.788034] [INFO ] [MAIN ] Derivative Progress: 1344/1587 symbols completed. TOST took 1.4s. Estimated remaining: 1m 41s. Rate: 143.9 symbols/min [2025-10-01T22:44:13.789305] [DEBUG] [LOCAL ] TPB: Loaded 25047 existing records from primary storage. [2025-10-01T22:44:13.789701] [INFO ] [MAIN ] TPB: Loaded 25047 primary data records. [2025-10-01T22:44:13.789534] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:13.939532] [DEBUG] [LOCAL ] TPC: Loaded 38735 existing records from primary storage. [2025-10-01T22:44:13.945384] [INFO ] [MAIN ] TPC: Loaded 38735 primary data records. [2025-10-01T22:44:14.316915] [DEBUG] [LOCAL ] TPH: Loaded 44944 existing records from primary storage. [2025-10-01T22:44:14.322401] [INFO ] [MAIN ] TPH: Loaded 44944 primary data records. [2025-10-01T22:44:14.900695] [DEBUG] [MAIN ] TPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:14.902254] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 25047 primary records. [2025-10-01T22:44:14.902800] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-01T22:44:14.925222] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-01T22:44:14.939509] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-01T22:44:14.940098] [DEBUG] [MAIN ] TPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:14.941021] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38735 primary records. [2025-10-01T22:44:14.943471] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-01T22:44:14.943384] [INFO ] [MAIN ] Derivative Progress: 1345/1587 symbols completed. TPB took 1.2s. Estimated remaining: 1m 41s. Rate: 143.7 symbols/min [2025-10-01T22:44:14.944919] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:14.964162] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-01T22:44:14.967317] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-01T22:44:14.971982] [INFO ] [MAIN ] Derivative Progress: 1346/1587 symbols completed. TPC took 1.2s. Estimated remaining: 1m 41s. Rate: 143.8 symbols/min [2025-10-01T22:44:14.973153] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:14.979599] [DEBUG] [LOCAL ] TPL: Loaded 12298 existing records from primary storage. [2025-10-01T22:44:14.987600] [INFO ] [MAIN ] TPL: Loaded 12298 primary data records. [2025-10-01T22:44:15.024399] [DEBUG] [MAIN ] TPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:15.047875] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44944 primary records. [2025-10-01T22:44:15.081094] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-01T22:44:15.389336] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-01T22:44:15.389798] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-01T22:44:15.392466] [INFO ] [MAIN ] Derivative Progress: 1347/1587 symbols completed. TPH took 1.6s. Estimated remaining: 1m 40s. Rate: 143.8 symbols/min [2025-10-01T22:44:15.392758] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:15.416360] [DEBUG] [LOCAL ] TPR: Loaded 53466 existing records from primary storage. [2025-10-01T22:44:15.416831] [INFO ] [MAIN ] TPR: Loaded 53466 primary data records. [2025-10-01T22:44:15.569530] [DEBUG] [LOCAL ] TPVG: Loaded 26947 existing records from primary storage. [2025-10-01T22:44:15.575778] [INFO ] [MAIN ] TPVG: Loaded 26947 primary data records. [2025-10-01T22:44:15.944429] [DEBUG] [MAIN ] TPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:15.986455] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12298 primary records. [2025-10-01T22:44:16.055863] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-01T22:44:16.200063] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-01T22:44:16.201392] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-01T22:44:16.204415] [INFO ] [MAIN ] Derivative Progress: 1348/1587 symbols completed. TPL took 1.3s. Estimated remaining: 1m 40s. Rate: 143.7 symbols/min [2025-10-01T22:44:16.223901] [DEBUG] [MAIN ] TPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:16.224934] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53466 primary records. [2025-10-01T22:44:16.225150] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-01T22:44:16.244346] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-01T22:44:16.244627] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-01T22:44:16.247052] [INFO ] [MAIN ] Derivative Progress: 1349/1587 symbols completed. TPR took 1.3s. Estimated remaining: 1m 39s. Rate: 143.8 symbols/min [2025-10-01T22:44:16.266723] [DEBUG] [MAIN ] TPVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:16.268291] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 26947 primary records. [2025-10-01T22:44:16.268355] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-01T22:44:16.284253] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-01T22:44:16.284321] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-01T22:44:16.287021] [INFO ] [MAIN ] Derivative Progress: 1350/1587 symbols completed. TPVG took 0.9s. Estimated remaining: 1m 39s. Rate: 143.9 symbols/min [2025-10-01T22:44:16.287637] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:16.287573] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:16.287822] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:16.301112] [DEBUG] [LOCAL ] TPZ: Loaded 4914 existing records from primary storage. [2025-10-01T22:44:16.301516] [INFO ] [MAIN ] TPZ: Loaded 4914 primary data records. [2025-10-01T22:44:16.343890] [DEBUG] [LOCAL ] TPYP: Loaded 7913 existing records from primary storage. [2025-10-01T22:44:16.366977] [INFO ] [MAIN ] TPYP: Loaded 7913 primary data records. [2025-10-01T22:44:16.482885] [DEBUG] [LOCAL ] TR: Loaded 18492 existing records from primary storage. [2025-10-01T22:44:16.518496] [INFO ] [MAIN ] TR: Loaded 18492 primary data records. [2025-10-01T22:44:17.386505] [DEBUG] [MAIN ] TPZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:44:17.388967] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 4914 primary records. [2025-10-01T22:44:17.389288] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-01T22:44:17.404155] [DEBUG] [MAIN ] TPYP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:44:17.405303] [INFO ] [MAIN ] TPYP: Generated 1793 derivative records from 7913 primary records. [2025-10-01T22:44:17.405499] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-01T22:44:17.456285] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1793 records). [2025-10-01T22:44:17.455274] [DEBUG] [MAIN ] TR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:17.457769] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18492 primary records. [2025-10-01T22:44:17.457856] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-01T22:44:17.462635] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-01T22:44:17.461677] [INFO ] [MAIN ] Derivative Progress: 1351/1587 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 39s. Rate: 143.7 symbols/min [2025-10-01T22:44:17.462834] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-10-01T22:44:17.463472] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:17.463978] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-01T22:44:17.466540] [INFO ] [MAIN ] Derivative Progress: 1352/1587 symbols completed. TPZ took 1.2s. Estimated remaining: 1m 38s. Rate: 143.8 symbols/min [2025-10-01T22:44:17.476221] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:17.491165] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-01T22:44:17.491412] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-01T22:44:17.494444] [INFO ] [MAIN ] Derivative Progress: 1353/1587 symbols completed. TR took 1.2s. Estimated remaining: 1m 38s. Rate: 143.9 symbols/min [2025-10-01T22:44:17.505254] [DEBUG] [LOCAL ] TRAK: Loaded 9422 existing records from primary storage. [2025-10-01T22:44:17.499555] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:17.505804] [INFO ] [MAIN ] TRAK: Loaded 9422 primary data records. [2025-10-01T22:44:17.557229] [DEBUG] [LOCAL ] TRC: Loaded 15736 existing records from primary storage. [2025-10-01T22:44:17.581692] [INFO ] [MAIN ] TRC: Loaded 15736 primary data records. [2025-10-01T22:44:18.209905] [DEBUG] [LOCAL ] TREX: Loaded 49932 existing records from primary storage. [2025-10-01T22:44:18.318482] [INFO ] [MAIN ] TREX: Loaded 49932 primary data records. [2025-10-01T22:44:18.692263] [DEBUG] [MAIN ] TRAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:18.695365] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9422 primary records. [2025-10-01T22:44:18.697037] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-01T22:44:18.721296] [DEBUG] [MAIN ] TRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:18.731847] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-01T22:44:18.731747] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15736 primary records. [2025-10-01T22:44:18.732159] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-01T22:44:18.732626] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-01T22:44:18.736226] [INFO ] [MAIN ] Derivative Progress: 1354/1587 symbols completed. TRAK took 1.3s. Estimated remaining: 1m 37s. Rate: 143.7 symbols/min [2025-10-01T22:44:18.736690] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:18.756871] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-01T22:44:18.757086] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-01T22:44:18.759777] [INFO ] [MAIN ] Derivative Progress: 1355/1587 symbols completed. TRC took 1.3s. Estimated remaining: 1m 37s. Rate: 143.8 symbols/min [2025-10-01T22:44:18.760185] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:18.780808] [DEBUG] [MAIN ] TREX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:18.781772] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49932 primary records. [2025-10-01T22:44:18.782012] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-01T22:44:18.801001] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-01T22:44:18.816275] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-01T22:44:18.827604] [INFO ] [MAIN ] Derivative Progress: 1356/1587 symbols completed. TREX took 1.3s. Estimated remaining: 1m 36s. Rate: 143.9 symbols/min [2025-10-01T22:44:18.827986] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:18.846095] [DEBUG] [LOCAL ] TRN: Loaded 37021 existing records from primary storage. [2025-10-01T22:44:18.861219] [INFO ] [MAIN ] TRN: Loaded 37021 primary data records. [2025-10-01T22:44:18.881191] [DEBUG] [LOCAL ] TRGP: Loaded 50698 existing records from primary storage. [2025-10-01T22:44:18.906172] [INFO ] [MAIN ] TRGP: Loaded 50698 primary data records. [2025-10-01T22:44:19.167137] [DEBUG] [LOCAL ] TRNO: Loaded 43942 existing records from primary storage. [2025-10-01T22:44:19.203926] [INFO ] [MAIN ] TRNO: Loaded 43942 primary data records. [2025-10-01T22:44:19.958847] [DEBUG] [MAIN ] TRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:19.972637] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 37021 primary records. [2025-10-01T22:44:19.973376] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-01T22:44:19.973314] [DEBUG] [MAIN ] TRGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:19.974948] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50698 primary records. [2025-10-01T22:44:19.975032] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-01T22:44:20.026991] [DEBUG] [MAIN ] TRNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:20.027968] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43942 primary records. [2025-10-01T22:44:20.026231] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-01T22:44:20.028669] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-01T22:44:20.028992] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-01T22:44:20.032359] [INFO ] [MAIN ] Derivative Progress: 1357/1587 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 36s. Rate: 143.7 symbols/min [2025-10-01T22:44:20.033556] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:20.033960] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-01T22:44:20.034681] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-01T22:44:20.037260] [INFO ] [MAIN ] Derivative Progress: 1358/1587 symbols completed. TRN took 1.3s. Estimated remaining: 1m 36s. Rate: 143.8 symbols/min [2025-10-01T22:44:20.049817] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:20.058479] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-01T22:44:20.058765] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-01T22:44:20.062456] [INFO ] [MAIN ] Derivative Progress: 1359/1587 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 35s. Rate: 143.9 symbols/min [2025-10-01T22:44:20.062899] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:20.142868] [DEBUG] [LOCAL ] TROX: Loaded 51877 existing records from primary storage. [2025-10-01T22:44:20.143128] [INFO ] [MAIN ] TROX: Loaded 51877 primary data records. [2025-10-01T22:44:20.143704] [DEBUG] [LOCAL ] TRTX: Loaded 37574 existing records from primary storage. [2025-10-01T22:44:20.148977] [INFO ] [MAIN ] TRTX: Loaded 37574 primary data records. [2025-10-01T22:44:20.383698] [DEBUG] [LOCAL ] TRP: Loaded 52101 existing records from primary storage. [2025-10-01T22:44:20.422518] [INFO ] [MAIN ] TRP: Loaded 52101 primary data records. [2025-10-01T22:44:21.280506] [DEBUG] [MAIN ] TRTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:21.281755] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37574 primary records. [2025-10-01T22:44:21.290602] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-01T22:44:21.306473] [DEBUG] [MAIN ] TROX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:21.311863] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51877 primary records. [2025-10-01T22:44:21.313088] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-01T22:44:21.332686] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-01T22:44:21.333510] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-01T22:44:21.336278] [INFO ] [MAIN ] Derivative Progress: 1360/1587 symbols completed. TRTX took 1.3s. Estimated remaining: 1m 35s. Rate: 143.7 symbols/min [2025-10-01T22:44:21.337038] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:21.339419] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-01T22:44:21.341231] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-01T22:44:21.344483] [INFO ] [MAIN ] Derivative Progress: 1361/1587 symbols completed. TROX took 1.3s. Estimated remaining: 1m 34s. Rate: 143.8 symbols/min [2025-10-01T22:44:21.344784] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:21.365354] [DEBUG] [MAIN ] TRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:21.366127] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52101 primary records. [2025-10-01T22:44:21.366195] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-01T22:44:21.383058] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-01T22:44:21.383259] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-01T22:44:21.386375] [INFO ] [MAIN ] Derivative Progress: 1362/1587 symbols completed. TRP took 1.3s. Estimated remaining: 1m 34s. Rate: 143.9 symbols/min [2025-10-01T22:44:21.386689] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:21.456530] [DEBUG] [LOCAL ] TRV: Loaded 47782 existing records from primary storage. [2025-10-01T22:44:21.456871] [INFO ] [MAIN ] TRV: Loaded 47782 primary data records. [2025-10-01T22:44:21.458241] [DEBUG] [LOCAL ] TRU: Loaded 51238 existing records from primary storage. [2025-10-01T22:44:21.470935] [INFO ] [MAIN ] TRU: Loaded 51238 primary data records. [2025-10-01T22:44:21.761576] [DEBUG] [LOCAL ] TS: Loaded 51685 existing records from primary storage. [2025-10-01T22:44:21.777272] [INFO ] [MAIN ] TS: Loaded 51685 primary data records. [2025-10-01T22:44:22.672811] [DEBUG] [MAIN ] TRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:22.674205] [DEBUG] [MAIN ] TRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:22.673880] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47782 primary records. [2025-10-01T22:44:22.674993] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51238 primary records. [2025-10-01T22:44:22.675083] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-01T22:44:22.675138] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-01T22:44:22.710182] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-01T22:44:22.711087] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-01T22:44:22.714629] [INFO ] [MAIN ] Derivative Progress: 1363/1587 symbols completed. TRU took 1.4s. Estimated remaining: 1m 34s. Rate: 143.7 symbols/min [2025-10-01T22:44:22.718317] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-01T22:44:22.718547] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-01T22:44:22.720562] [INFO ] [MAIN ] Derivative Progress: 1364/1587 symbols completed. TRV took 1.4s. Estimated remaining: 1m 33s. Rate: 143.8 symbols/min [2025-10-01T22:44:22.738604] [DEBUG] [MAIN ] TS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:22.739488] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51685 primary records. [2025-10-01T22:44:22.739562] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-01T22:44:22.758357] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-01T22:44:22.758547] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-01T22:44:22.761325] [INFO ] [MAIN ] Derivative Progress: 1365/1587 symbols completed. TS took 1.4s. Estimated remaining: 1m 33s. Rate: 143.9 symbols/min [2025-10-01T22:44:22.761940] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:22.762135] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:22.762570] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:22.773332] [DEBUG] [LOCAL ] TSI: Loaded 7354 existing records from primary storage. [2025-10-01T22:44:22.773558] [INFO ] [MAIN ] TSI: Loaded 7354 primary data records. [2025-10-01T22:44:22.936113] [DEBUG] [LOCAL ] TSE: Loaded 28310 existing records from primary storage. [2025-10-01T22:44:22.941605] [INFO ] [MAIN ] TSE: Loaded 28310 primary data records. [2025-10-01T22:44:23.080502] [DEBUG] [LOCAL ] TSLX: Loaded 35196 existing records from primary storage. [2025-10-01T22:44:23.102709] [INFO ] [MAIN ] TSLX: Loaded 35196 primary data records. [2025-10-01T22:44:23.925256] [DEBUG] [MAIN ] TSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:23.926216] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 7354 primary records. [2025-10-01T22:44:23.927018] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-01T22:44:23.946034] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-01T22:44:23.946672] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-01T22:44:23.948756] [INFO ] [MAIN ] Derivative Progress: 1366/1587 symbols completed. TSI took 1.2s. Estimated remaining: 1m 32s. Rate: 143.7 symbols/min [2025-10-01T22:44:23.949072] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:23.964542] [DEBUG] [MAIN ] TSE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:23.965438] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28310 primary records. [2025-10-01T22:44:23.965532] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-01T22:44:23.999983] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-01T22:44:24.000669] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-01T22:44:24.000393] [DEBUG] [MAIN ] TSLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:24.001596] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35196 primary records. [2025-10-01T22:44:24.004322] [INFO ] [MAIN ] Derivative Progress: 1367/1587 symbols completed. TSE took 1.2s. Estimated remaining: 1m 32s. Rate: 143.8 symbols/min [2025-10-01T22:44:24.004811] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-01T22:44:24.005163] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:24.038717] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-01T22:44:24.039087] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-01T22:44:24.042199] [INFO ] [MAIN ] Derivative Progress: 1368/1587 symbols completed. TSLX took 1.3s. Estimated remaining: 1m 31s. Rate: 143.8 symbols/min [2025-10-01T22:44:24.042534] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:24.067453] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-01T22:44:24.072948] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-01T22:44:24.072787] [DEBUG] [LOCAL ] TSQ: Loaded 12024 existing records from primary storage. [2025-10-01T22:44:24.078410] [INFO ] [MAIN ] TSQ: Loaded 12024 primary data records. [2025-10-01T22:44:24.404132] [DEBUG] [LOCAL ] TSN: Loaded 52908 existing records from primary storage. [2025-10-01T22:44:24.404338] [INFO ] [MAIN ] TSN: Loaded 52908 primary data records. [2025-10-01T22:44:25.267020] [DEBUG] [MAIN ] TSQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:25.274676] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 12024 primary records. [2025-10-01T22:44:25.284697] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-01T22:44:25.284553] [DEBUG] [MAIN ] TSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:25.286969] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-01T22:44:25.294164] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-01T22:44:25.316311] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-01T22:44:25.317004] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-01T22:44:25.319045] [INFO ] [MAIN ] Derivative Progress: 1369/1587 symbols completed. TSQ took 1.3s. Estimated remaining: 1m 31s. Rate: 143.6 symbols/min [2025-10-01T22:44:25.319204] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:25.339193] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-01T22:44:25.339566] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-01T22:44:25.342207] [INFO ] [MAIN ] Derivative Progress: 1370/1587 symbols completed. TSM took 1.4s. Estimated remaining: 1m 31s. Rate: 143.7 symbols/min [2025-10-01T22:44:25.342601] [DEBUG] [MAIN ] TSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:25.343420] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52908 primary records. [2025-10-01T22:44:25.343769] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-01T22:44:25.343536] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:25.363372] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-01T22:44:25.363596] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-01T22:44:25.367034] [INFO ] [MAIN ] Derivative Progress: 1371/1587 symbols completed. TSN took 1.4s. Estimated remaining: 1m 30s. Rate: 143.8 symbols/min [2025-10-01T22:44:25.367226] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:25.413958] [DEBUG] [LOCAL ] TT: Loaded 47697 existing records from primary storage. [2025-10-01T22:44:25.426019] [INFO ] [MAIN ] TT: Loaded 47697 primary data records. [2025-10-01T22:44:25.448167] [DEBUG] [LOCAL ] TTC: Loaded 42098 existing records from primary storage. [2025-10-01T22:44:25.465167] [INFO ] [MAIN ] TTC: Loaded 42098 primary data records. [2025-10-01T22:44:25.922987] [DEBUG] [LOCAL ] TTE: Loaded 51637 existing records from primary storage. [2025-10-01T22:44:25.940751] [INFO ] [MAIN ] TTE: Loaded 51637 primary data records. [2025-10-01T22:44:26.482568] [DEBUG] [MAIN ] TT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:26.485236] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47697 primary records. [2025-10-01T22:44:26.487472] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-01T22:44:26.519440] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-01T22:44:26.520315] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-01T22:44:26.522664] [INFO ] [MAIN ] Derivative Progress: 1372/1587 symbols completed. TT took 1.2s. Estimated remaining: 1m 30s. Rate: 143.6 symbols/min [2025-10-01T22:44:26.523712] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:26.520059] [DEBUG] [MAIN ] TTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:26.527716] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42098 primary records. [2025-10-01T22:44:26.527990] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-01T22:44:26.552032] [DEBUG] [MAIN ] TTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:26.556470] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51637 primary records. [2025-10-01T22:44:26.557153] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-01T22:44:26.561763] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-01T22:44:26.561852] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-01T22:44:26.565261] [INFO ] [MAIN ] Derivative Progress: 1373/1587 symbols completed. TTC took 1.2s. Estimated remaining: 1m 29s. Rate: 143.7 symbols/min [2025-10-01T22:44:26.565863] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:26.584862] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-01T22:44:26.585250] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-01T22:44:26.587865] [INFO ] [MAIN ] Derivative Progress: 1374/1587 symbols completed. TTE took 1.2s. Estimated remaining: 1m 29s. Rate: 143.8 symbols/min [2025-10-01T22:44:26.588326] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:26.638381] [DEBUG] [LOCAL ] TTI: Loaded 45626 existing records from primary storage. [2025-10-01T22:44:26.638791] [INFO ] [MAIN ] TTI: Loaded 45626 primary data records. [2025-10-01T22:44:26.781624] [DEBUG] [LOCAL ] TU: Loaded 49853 existing records from primary storage. [2025-10-01T22:44:26.781899] [INFO ] [MAIN ] TU: Loaded 49853 primary data records. [2025-10-01T22:44:26.898618] [DEBUG] [LOCAL ] TUYA: Loaded 46181 existing records from primary storage. [2025-10-01T22:44:26.973676] [INFO ] [MAIN ] TUYA: Loaded 46181 primary data records. [2025-10-01T22:44:27.805753] [DEBUG] [MAIN ] TTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:27.808499] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45626 primary records. [2025-10-01T22:44:27.808613] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-01T22:44:27.837139] [DEBUG] [MAIN ] TU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:27.838614] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49853 primary records. [2025-10-01T22:44:27.839330] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-01T22:44:27.861585] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-01T22:44:27.862224] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-01T22:44:27.864362] [INFO ] [MAIN ] Derivative Progress: 1375/1587 symbols completed. TTI took 1.3s. Estimated remaining: 1m 29s. Rate: 143.6 symbols/min [2025-10-01T22:44:27.864574] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:27.862334] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-01T22:44:27.865195] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-01T22:44:27.868370] [INFO ] [MAIN ] Derivative Progress: 1376/1587 symbols completed. TU took 1.3s. Estimated remaining: 1m 28s. Rate: 143.7 symbols/min [2025-10-01T22:44:27.868876] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:27.889894] [DEBUG] [MAIN ] TUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:27.891012] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46181 primary records. [2025-10-01T22:44:27.891173] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-01T22:44:27.894452] [DEBUG] [LOCAL ] TVC: Loaded 3341 existing records from primary storage. [2025-10-01T22:44:27.895319] [INFO ] [MAIN ] TVC: Loaded 3341 primary data records. [2025-10-01T22:44:27.972823] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-01T22:44:27.985855] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-01T22:44:28.020790] [INFO ] [MAIN ] Derivative Progress: 1377/1587 symbols completed. TUYA took 1.4s. Estimated remaining: 1m 28s. Rate: 143.8 symbols/min [2025-10-01T22:44:28.034882] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:28.298170] [DEBUG] [LOCAL ] TV: Loaded 42694 existing records from primary storage. [2025-10-01T22:44:28.298620] [INFO ] [MAIN ] TV: Loaded 42694 primary data records. [2025-10-01T22:44:28.423057] [DEBUG] [LOCAL ] TWI: Loaded 34181 existing records from primary storage. [2025-10-01T22:44:28.444766] [INFO ] [MAIN ] TWI: Loaded 34181 primary data records. [2025-10-01T22:44:29.010116] [DEBUG] [MAIN ] TVC: Filtered 6931 bins outside market hours, 7728 incomplete bins [2025-10-01T22:44:29.022473] [INFO ] [MAIN ] TVC: Generated 1790 derivative records from 3341 primary records. [2025-10-01T22:44:29.023517] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-01T22:44:29.040103] [DEBUG] [LOCAL ] TVC: Derivative data saved (1790 records). [2025-10-01T22:44:29.041383] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-01T22:44:29.043911] [INFO ] [MAIN ] Derivative Progress: 1378/1587 symbols completed. TVC took 1.2s. Estimated remaining: 1m 27s. Rate: 143.6 symbols/min [2025-10-01T22:44:29.064773] [DEBUG] [MAIN ] TV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:29.065493] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 42694 primary records. [2025-10-01T22:44:29.065776] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-01T22:44:29.084665] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-01T22:44:29.084891] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-01T22:44:29.087330] [INFO ] [MAIN ] Derivative Progress: 1379/1587 symbols completed. TV took 1.2s. Estimated remaining: 1m 27s. Rate: 143.7 symbols/min [2025-10-01T22:44:29.100614] [DEBUG] [MAIN ] TWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:29.101319] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34181 primary records. [2025-10-01T22:44:29.101382] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-01T22:44:29.117356] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-01T22:44:29.117434] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-01T22:44:29.120163] [INFO ] [MAIN ] Derivative Progress: 1380/1587 symbols completed. TWI took 1.1s. Estimated remaining: 1m 26s. Rate: 143.8 symbols/min [2025-10-01T22:44:29.120577] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:29.120784] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:29.120707] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:29.126745] [DEBUG] [LOCAL ] TWN: Loaded 3170 existing records from primary storage. [2025-10-01T22:44:29.126937] [INFO ] [MAIN ] TWN: Loaded 3170 primary data records. [2025-10-01T22:44:29.551070] [DEBUG] [LOCAL ] TWO: Loaded 48359 existing records from primary storage. [2025-10-01T22:44:29.552301] [INFO ] [MAIN ] TWO: Loaded 48359 primary data records. [2025-10-01T22:44:29.550242] [DEBUG] [LOCAL ] TWLO: Loaded 52713 existing records from primary storage. [2025-10-01T22:44:29.552820] [INFO ] [MAIN ] TWLO: Loaded 52713 primary data records. [2025-10-01T22:44:30.115043] [DEBUG] [MAIN ] TWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:30.239434] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3170 primary records. [2025-10-01T22:44:30.240856] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-01T22:44:30.263474] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-01T22:44:30.263837] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-01T22:44:30.266614] [INFO ] [MAIN ] Derivative Progress: 1381/1587 symbols completed. TWN took 1.1s. Estimated remaining: 1m 26s. Rate: 143.6 symbols/min [2025-10-01T22:44:30.268111] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:30.287370] [DEBUG] [MAIN ] TWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:30.288282] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48359 primary records. [2025-10-01T22:44:30.288452] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-01T22:44:30.323389] [DEBUG] [LOCAL ] TX: Loaded 23378 existing records from primary storage. [2025-10-01T22:44:30.333955] [INFO ] [MAIN ] TX: Loaded 23378 primary data records. [2025-10-01T22:44:30.333882] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-01T22:44:30.339811] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-01T22:44:30.342201] [INFO ] [MAIN ] Derivative Progress: 1382/1587 symbols completed. TWO took 1.2s. Estimated remaining: 1m 26s. Rate: 143.7 symbols/min [2025-10-01T22:44:30.366626] [DEBUG] [MAIN ] TWLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:30.366230] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:30.389566] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52713 primary records. [2025-10-01T22:44:30.406113] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-01T22:44:30.494123] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-01T22:44:30.499695] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-01T22:44:30.502665] [INFO ] [MAIN ] Derivative Progress: 1383/1587 symbols completed. TWLO took 1.4s. Estimated remaining: 1m 25s. Rate: 143.8 symbols/min [2025-10-01T22:44:30.508111] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:30.772628] [DEBUG] [LOCAL ] TXO: Loaded 18939 existing records from primary storage. [2025-10-01T22:44:30.772075] [DEBUG] [LOCAL ] TXNM: Loaded 43433 existing records from primary storage. [2025-10-01T22:44:30.773697] [INFO ] [MAIN ] TXNM: Loaded 43433 primary data records. [2025-10-01T22:44:30.774027] [INFO ] [MAIN ] TXO: Loaded 18939 primary data records. [2025-10-01T22:44:31.492090] [DEBUG] [MAIN ] TX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:31.494747] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23378 primary records. [2025-10-01T22:44:31.495593] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-01T22:44:31.519776] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-01T22:44:31.520303] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-01T22:44:31.522825] [INFO ] [MAIN ] Derivative Progress: 1384/1587 symbols completed. TX took 1.3s. Estimated remaining: 1m 25s. Rate: 143.6 symbols/min [2025-10-01T22:44:31.523196] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:31.560220] [DEBUG] [MAIN ] TXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:31.559949] [DEBUG] [MAIN ] TXNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:31.561050] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18939 primary records. [2025-10-01T22:44:31.561281] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-01T22:44:31.562607] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43433 primary records. [2025-10-01T22:44:31.562957] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-01T22:44:31.595038] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-01T22:44:31.595414] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-01T22:44:31.609035] [INFO ] [MAIN ] Derivative Progress: 1385/1587 symbols completed. TXO took 1.1s. Estimated remaining: 1m 24s. Rate: 143.7 symbols/min [2025-10-01T22:44:31.612890] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:31.614458] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-01T22:44:31.614618] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-01T22:44:31.617873] [INFO ] [MAIN ] Derivative Progress: 1386/1587 symbols completed. TXNM took 1.3s. Estimated remaining: 1m 24s. Rate: 143.8 symbols/min [2025-10-01T22:44:31.618135] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:31.640288] [DEBUG] [LOCAL ] TY: Loaded 7549 existing records from primary storage. [2025-10-01T22:44:31.642030] [DEBUG] [LOCAL ] TXT: Loaded 49738 existing records from primary storage. [2025-10-01T22:44:31.640575] [INFO ] [MAIN ] TY: Loaded 7549 primary data records. [2025-10-01T22:44:31.645799] [INFO ] [MAIN ] TXT: Loaded 49738 primary data records. [2025-10-01T22:44:31.822446] [DEBUG] [LOCAL ] TYG: Loaded 14151 existing records from primary storage. [2025-10-01T22:44:31.897336] [INFO ] [MAIN ] TYG: Loaded 14151 primary data records. [2025-10-01T22:44:32.741349] [DEBUG] [MAIN ] TY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:32.742334] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7549 primary records. [2025-10-01T22:44:32.742500] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-01T22:44:32.770715] [DEBUG] [MAIN ] TXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:32.772906] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49738 primary records. [2025-10-01T22:44:32.773504] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-01T22:44:32.790118] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-01T22:44:32.793757] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-01T22:44:32.812908] [INFO ] [MAIN ] Derivative Progress: 1387/1587 symbols completed. TY took 1.2s. Estimated remaining: 1m 24s. Rate: 143.6 symbols/min [2025-10-01T22:44:32.814226] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-01T22:44:32.815135] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-01T22:44:32.814887] [DEBUG] [MAIN ] TYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:32.814415] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:32.817901] [INFO ] [MAIN ] Derivative Progress: 1388/1587 symbols completed. TXT took 1.3s. Estimated remaining: 1m 23s. Rate: 143.7 symbols/min [2025-10-01T22:44:32.819568] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:32.819308] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14151 primary records. [2025-10-01T22:44:32.820072] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-01T22:44:32.838623] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-01T22:44:32.839034] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-01T22:44:32.842160] [INFO ] [MAIN ] Derivative Progress: 1389/1587 symbols completed. TYG took 1.2s. Estimated remaining: 1m 23s. Rate: 143.8 symbols/min [2025-10-01T22:44:32.849415] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:32.882474] [DEBUG] [LOCAL ] TYL: Loaded 22149 existing records from primary storage. [2025-10-01T22:44:32.882906] [INFO ] [MAIN ] TYL: Loaded 22149 primary data records. [2025-10-01T22:44:33.035701] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-01T22:44:33.040502] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-01T22:44:33.369557] [DEBUG] [LOCAL ] UA: Loaded 50468 existing records from primary storage. [2025-10-01T22:44:33.379168] [INFO ] [MAIN ] UA: Loaded 50468 primary data records. [2025-10-01T22:44:34.036588] [DEBUG] [MAIN ] TYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:34.038111] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22149 primary records. [2025-10-01T22:44:34.038387] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-01T22:44:34.060037] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-01T22:44:34.060842] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-01T22:44:34.063590] [INFO ] [MAIN ] Derivative Progress: 1390/1587 symbols completed. TYL took 1.2s. Estimated remaining: 1m 22s. Rate: 143.6 symbols/min [2025-10-01T22:44:34.077240] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:34.077787] [DEBUG] [MAIN ] U: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:34.082613] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-01T22:44:34.082977] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-01T22:44:34.110840] [DEBUG] [MAIN ] UA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:34.116191] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50468 primary records. [2025-10-01T22:44:34.116630] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-01T22:44:34.123051] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-01T22:44:34.132909] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-01T22:44:34.139682] [INFO ] [MAIN ] Derivative Progress: 1391/1587 symbols completed. U took 1.3s. Estimated remaining: 1m 22s. Rate: 143.7 symbols/min [2025-10-01T22:44:34.140850] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:34.161671] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-01T22:44:34.161889] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-01T22:44:34.165064] [INFO ] [MAIN ] Derivative Progress: 1392/1587 symbols completed. UA took 1.3s. Estimated remaining: 1m 21s. Rate: 143.8 symbols/min [2025-10-01T22:44:34.165499] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:34.169063] [DEBUG] [LOCAL ] UAN: Loaded 5392 existing records from primary storage. [2025-10-01T22:44:34.170406] [INFO ] [MAIN ] UAN: Loaded 5392 primary data records. [2025-10-01T22:44:34.258280] [DEBUG] [LOCAL ] UAA: Loaded 53507 existing records from primary storage. [2025-10-01T22:44:34.283727] [INFO ] [MAIN ] UAA: Loaded 53507 primary data records. [2025-10-01T22:44:34.775853] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-01T22:44:34.803231] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-01T22:44:35.299374] [DEBUG] [MAIN ] UAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:35.301039] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5392 primary records. [2025-10-01T22:44:35.301500] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-01T22:44:35.326017] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-01T22:44:35.326854] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-01T22:44:35.329766] [INFO ] [MAIN ] Derivative Progress: 1393/1587 symbols completed. UAN took 1.2s. Estimated remaining: 1m 21s. Rate: 143.6 symbols/min [2025-10-01T22:44:35.346219] [DEBUG] [MAIN ] UAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:35.347195] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53507 primary records. [2025-10-01T22:44:35.347393] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-01T22:44:35.364321] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-01T22:44:35.364639] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-01T22:44:35.368178] [INFO ] [MAIN ] Derivative Progress: 1394/1587 symbols completed. UAA took 1.3s. Estimated remaining: 1m 21s. Rate: 143.7 symbols/min [2025-10-01T22:44:35.383531] [DEBUG] [MAIN ] UBER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:35.384239] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-01T22:44:35.384304] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-01T22:44:35.400217] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-01T22:44:35.400295] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-01T22:44:35.403146] [INFO ] [MAIN ] Derivative Progress: 1395/1587 symbols completed. UBER took 1.2s. Estimated remaining: 1m 20s. Rate: 143.8 symbols/min [2025-10-01T22:44:35.403936] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:35.404083] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:35.404429] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:35.468802] [DEBUG] [LOCAL ] UCB: Loaded 37802 existing records from primary storage. [2025-10-01T22:44:35.468958] [INFO ] [MAIN ] UCB: Loaded 37802 primary data records. [2025-10-01T22:44:35.625364] [DEBUG] [LOCAL ] UDR: Loaded 51828 existing records from primary storage. [2025-10-01T22:44:35.625247] [DEBUG] [LOCAL ] UBS: Loaded 52398 existing records from primary storage. [2025-10-01T22:44:35.631277] [INFO ] [MAIN ] UBS: Loaded 52398 primary data records. [2025-10-01T22:44:35.651982] [INFO ] [MAIN ] UDR: Loaded 51828 primary data records. [2025-10-01T22:44:36.578768] [DEBUG] [MAIN ] UCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:36.580293] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37802 primary records. [2025-10-01T22:44:36.580961] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-01T22:44:36.619552] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-10-01T22:44:36.620481] [DEBUG] [MAIN ] UBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:36.624013] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52398 primary records. [2025-10-01T22:44:36.624133] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-01T22:44:36.623150] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-01T22:44:36.626973] [INFO ] [MAIN ] Derivative Progress: 1396/1587 symbols completed. UCB took 1.2s. Estimated remaining: 1m 20s. Rate: 143.6 symbols/min [2025-10-01T22:44:36.627350] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:36.652126] [DEBUG] [MAIN ] UDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:36.661105] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51828 primary records. [2025-10-01T22:44:36.659690] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-01T22:44:36.661383] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-01T22:44:36.661508] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-01T22:44:36.664203] [INFO ] [MAIN ] Derivative Progress: 1397/1587 symbols completed. UBS took 1.3s. Estimated remaining: 1m 19s. Rate: 143.7 symbols/min [2025-10-01T22:44:36.664896] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:36.692093] [DEBUG] [LOCAL ] UFI: Loaded 8076 existing records from primary storage. [2025-10-01T22:44:36.693257] [INFO ] [MAIN ] UFI: Loaded 8076 primary data records. [2025-10-01T22:44:36.693121] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-01T22:44:36.705609] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-01T22:44:36.747149] [INFO ] [MAIN ] Derivative Progress: 1398/1587 symbols completed. UDR took 1.3s. Estimated remaining: 1m 19s. Rate: 143.8 symbols/min [2025-10-01T22:44:36.768922] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:36.853102] [DEBUG] [LOCAL ] UE: Loaded 42710 existing records from primary storage. [2025-10-01T22:44:36.853779] [INFO ] [MAIN ] UE: Loaded 42710 primary data records. [2025-10-01T22:44:37.461892] [DEBUG] [LOCAL ] UGI: Loaded 50508 existing records from primary storage. [2025-10-01T22:44:37.462775] [INFO ] [MAIN ] UGI: Loaded 50508 primary data records. [2025-10-01T22:44:37.654428] [DEBUG] [MAIN ] UFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:37.701290] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8076 primary records. [2025-10-01T22:44:37.817781] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-01T22:44:37.854253] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-01T22:44:37.859520] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-01T22:44:37.859845] [DEBUG] [MAIN ] UE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:37.862741] [INFO ] [MAIN ] Derivative Progress: 1399/1587 symbols completed. UFI took 1.2s. Estimated remaining: 1m 19s. Rate: 143.6 symbols/min [2025-10-01T22:44:37.863902] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42710 primary records. [2025-10-01T22:44:37.864227] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-01T22:44:37.865453] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:37.884387] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-01T22:44:37.886024] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-01T22:44:37.888891] [INFO ] [MAIN ] Derivative Progress: 1400/1587 symbols completed. UE took 1.3s. Estimated remaining: 1m 18s. Rate: 143.7 symbols/min [2025-10-01T22:44:37.889353] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:37.915434] [DEBUG] [MAIN ] UGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:37.922123] [DEBUG] [LOCAL ] UHAL: Loaded 16573 existing records from primary storage. [2025-10-01T22:44:37.923442] [INFO ] [MAIN ] UHAL: Loaded 16573 primary data records. [2025-10-01T22:44:37.923143] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50508 primary records. [2025-10-01T22:44:37.933988] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-01T22:44:37.990906] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-01T22:44:38.031509] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-01T22:44:38.034360] [INFO ] [MAIN ] Derivative Progress: 1401/1587 symbols completed. UGI took 1.3s. Estimated remaining: 1m 18s. Rate: 143.8 symbols/min [2025-10-01T22:44:38.055096] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:38.072028] [DEBUG] [LOCAL ] UGP: Loaded 42915 existing records from primary storage. [2025-10-01T22:44:38.087463] [INFO ] [MAIN ] UGP: Loaded 42915 primary data records. [2025-10-01T22:44:38.739233] [DEBUG] [LOCAL ] UHS: Loaded 40867 existing records from primary storage. [2025-10-01T22:44:38.740258] [INFO ] [MAIN ] UHS: Loaded 40867 primary data records. [2025-10-01T22:44:39.103937] [DEBUG] [MAIN ] UHAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:39.113802] [DEBUG] [MAIN ] UGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:39.114886] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16573 primary records. [2025-10-01T22:44:39.115728] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42915 primary records. [2025-10-01T22:44:39.115875] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-01T22:44:39.115962] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-01T22:44:39.150139] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-01T22:44:39.151286] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-01T22:44:39.151551] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-01T22:44:39.154071] [INFO ] [MAIN ] Derivative Progress: 1402/1587 symbols completed. UHAL took 1.3s. Estimated remaining: 1m 17s. Rate: 143.6 symbols/min [2025-10-01T22:44:39.151462] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-01T22:44:39.155581] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:39.158341] [INFO ] [MAIN ] Derivative Progress: 1403/1587 symbols completed. UGP took 1.3s. Estimated remaining: 1m 17s. Rate: 143.7 symbols/min [2025-10-01T22:44:39.159003] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:39.179250] [DEBUG] [MAIN ] UHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:39.180298] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40867 primary records. [2025-10-01T22:44:39.180366] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-01T22:44:39.211209] [DEBUG] [LOCAL ] UHT: Loaded 9936 existing records from primary storage. [2025-10-01T22:44:39.211732] [DEBUG] [LOCAL ] UI: Loaded 13056 existing records from primary storage. [2025-10-01T22:44:39.211392] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-01T22:44:39.211951] [INFO ] [MAIN ] UHT: Loaded 9936 primary data records. [2025-10-01T22:44:39.212089] [INFO ] [MAIN ] UI: Loaded 13056 primary data records. [2025-10-01T22:44:39.212022] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-01T22:44:39.239723] [INFO ] [MAIN ] Derivative Progress: 1404/1587 symbols completed. UHS took 1.2s. Estimated remaining: 1m 16s. Rate: 143.8 symbols/min [2025-10-01T22:44:39.240025] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:39.794679] [DEBUG] [LOCAL ] UIS: Loaded 36978 existing records from primary storage. [2025-10-01T22:44:39.910569] [INFO ] [MAIN ] UIS: Loaded 36978 primary data records. [2025-10-01T22:44:40.286063] [DEBUG] [MAIN ] UHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:40.287608] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 9936 primary records. [2025-10-01T22:44:40.302158] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-01T22:44:40.302019] [DEBUG] [MAIN ] UI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:40.303807] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13056 primary records. [2025-10-01T22:44:40.304188] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-01T22:44:40.341672] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-01T22:44:40.342472] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-01T22:44:40.345232] [INFO ] [MAIN ] Derivative Progress: 1405/1587 symbols completed. UHT took 1.2s. Estimated remaining: 1m 16s. Rate: 143.6 symbols/min [2025-10-01T22:44:40.346565] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:40.351924] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-01T22:44:40.353927] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-01T22:44:40.357690] [INFO ] [MAIN ] Derivative Progress: 1406/1587 symbols completed. UI took 1.2s. Estimated remaining: 1m 16s. Rate: 143.7 symbols/min [2025-10-01T22:44:40.358141] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:40.373552] [DEBUG] [MAIN ] UIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:40.374396] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36978 primary records. [2025-10-01T22:44:40.374540] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-01T22:44:40.391957] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-01T22:44:40.392071] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-01T22:44:40.394800] [INFO ] [MAIN ] Derivative Progress: 1407/1587 symbols completed. UIS took 1.2s. Estimated remaining: 1m 15s. Rate: 143.8 symbols/min [2025-10-01T22:44:40.395091] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:40.459706] [DEBUG] [LOCAL ] UL: Loaded 53068 existing records from primary storage. [2025-10-01T22:44:40.461350] [INFO ] [MAIN ] UL: Loaded 53068 primary data records. [2025-10-01T22:44:40.462303] [DEBUG] [LOCAL ] ULS: Loaded 39473 existing records from primary storage. [2025-10-01T22:44:40.495241] [INFO ] [MAIN ] ULS: Loaded 39473 primary data records. [2025-10-01T22:44:40.793914] [DEBUG] [LOCAL ] UMC: Loaded 52704 existing records from primary storage. [2025-10-01T22:44:40.822917] [INFO ] [MAIN ] UMC: Loaded 52704 primary data records. [2025-10-01T22:44:41.622300] [DEBUG] [MAIN ] UL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:41.623605] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53068 primary records. [2025-10-01T22:44:41.625179] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-01T22:44:41.645433] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-01T22:44:41.660580] [DEBUG] [MAIN ] ULS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:41.660060] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-01T22:44:41.663947] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39473 primary records. [2025-10-01T22:44:41.664207] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-01T22:44:41.663063] [INFO ] [MAIN ] Derivative Progress: 1408/1587 symbols completed. UL took 1.3s. Estimated remaining: 1m 15s. Rate: 143.6 symbols/min [2025-10-01T22:44:41.682986] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-01T22:44:41.684094] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-01T22:44:41.687593] [INFO ] [MAIN ] Derivative Progress: 1409/1587 symbols completed. ULS took 1.3s. Estimated remaining: 1m 14s. Rate: 143.7 symbols/min [2025-10-01T22:44:41.701210] [DEBUG] [MAIN ] UMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:41.701851] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52704 primary records. [2025-10-01T22:44:41.701916] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-01T22:44:41.718180] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-01T22:44:41.718254] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-01T22:44:41.721225] [INFO ] [MAIN ] Derivative Progress: 1410/1587 symbols completed. UMC took 1.3s. Estimated remaining: 1m 14s. Rate: 143.8 symbols/min [2025-10-01T22:44:41.721791] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:41.721732] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:41.721859] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:41.737515] [DEBUG] [LOCAL ] UNF: Loaded 12062 existing records from primary storage. [2025-10-01T22:44:41.737790] [INFO ] [MAIN ] UNF: Loaded 12062 primary data records. [2025-10-01T22:44:41.928725] [DEBUG] [LOCAL ] UMH: Loaded 33609 existing records from primary storage. [2025-10-01T22:44:41.941857] [INFO ] [MAIN ] UMH: Loaded 33609 primary data records. [2025-10-01T22:44:42.000492] [DEBUG] [LOCAL ] UNFI: Loaded 41973 existing records from primary storage. [2025-10-01T22:44:42.156123] [INFO ] [MAIN ] UNFI: Loaded 41973 primary data records. [2025-10-01T22:44:42.858301] [DEBUG] [MAIN ] UNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:42.860017] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 12062 primary records. [2025-10-01T22:44:42.860305] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-01T22:44:42.881233] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-01T22:44:42.881725] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-01T22:44:42.884859] [INFO ] [MAIN ] Derivative Progress: 1411/1587 symbols completed. UNF took 1.2s. Estimated remaining: 1m 14s. Rate: 143.6 symbols/min [2025-10-01T22:44:42.885270] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:42.901602] [DEBUG] [MAIN ] UNFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:42.904948] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41973 primary records. [2025-10-01T22:44:42.905158] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-01T22:44:42.934953] [DEBUG] [MAIN ] UMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:42.936085] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33609 primary records. [2025-10-01T22:44:42.935035] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-01T22:44:42.936180] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-01T22:44:42.936292] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-01T22:44:42.938877] [INFO ] [MAIN ] Derivative Progress: 1412/1587 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 13s. Rate: 143.7 symbols/min [2025-10-01T22:44:42.940443] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:42.965574] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-01T22:44:42.965879] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-01T22:44:42.969224] [INFO ] [MAIN ] Derivative Progress: 1413/1587 symbols completed. UMH took 1.2s. Estimated remaining: 1m 13s. Rate: 143.8 symbols/min [2025-10-01T22:44:42.969517] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:42.977882] [DEBUG] [LOCAL ] UNMA: Loaded 3513 existing records from primary storage. [2025-10-01T22:44:42.992080] [INFO ] [MAIN ] UNMA: Loaded 3513 primary data records. [2025-10-01T22:44:43.133754] [DEBUG] [LOCAL ] UNH: Loaded 53795 existing records from primary storage. [2025-10-01T22:44:43.139742] [INFO ] [MAIN ] UNH: Loaded 53795 primary data records. [2025-10-01T22:44:43.457460] [DEBUG] [LOCAL ] UNM: Loaded 48469 existing records from primary storage. [2025-10-01T22:44:43.471142] [INFO ] [MAIN ] UNM: Loaded 48469 primary data records. [2025-10-01T22:44:44.056768] [DEBUG] [MAIN ] UNMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:44.057960] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3513 primary records. [2025-10-01T22:44:44.072532] [DEBUG] [MAIN ] UNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:44.071138] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-01T22:44:44.073560] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53795 primary records. [2025-10-01T22:44:44.073930] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-01T22:44:44.105286] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-01T22:44:44.106381] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-01T22:44:44.109206] [INFO ] [MAIN ] Derivative Progress: 1414/1587 symbols completed. UNH took 1.2s. Estimated remaining: 1m 12s. Rate: 143.6 symbols/min [2025-10-01T22:44:44.109879] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:44.113985] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-10-01T22:44:44.115886] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-01T22:44:44.118753] [INFO ] [MAIN ] Derivative Progress: 1415/1587 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 12s. Rate: 143.7 symbols/min [2025-10-01T22:44:44.119215] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:44.132567] [DEBUG] [MAIN ] UNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:44.133367] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48469 primary records. [2025-10-01T22:44:44.133592] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-01T22:44:44.151137] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-01T22:44:44.151286] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-01T22:44:44.154570] [INFO ] [MAIN ] Derivative Progress: 1416/1587 symbols completed. UNM took 1.2s. Estimated remaining: 1m 11s. Rate: 143.8 symbols/min [2025-10-01T22:44:44.154857] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:44.223188] [DEBUG] [LOCAL ] UP: Loaded 43152 existing records from primary storage. [2025-10-01T22:44:44.225141] [INFO ] [MAIN ] UP: Loaded 43152 primary data records. [2025-10-01T22:44:44.261923] [DEBUG] [LOCAL ] UNP: Loaded 53271 existing records from primary storage. [2025-10-01T22:44:44.313523] [INFO ] [MAIN ] UNP: Loaded 53271 primary data records. [2025-10-01T22:44:44.423070] [DEBUG] [LOCAL ] URI: Loaded 35649 existing records from primary storage. [2025-10-01T22:44:44.452979] [INFO ] [MAIN ] URI: Loaded 35649 primary data records. [2025-10-01T22:44:45.341936] [DEBUG] [MAIN ] UP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:45.343213] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43152 primary records. [2025-10-01T22:44:45.343578] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-01T22:44:45.377683] [DEBUG] [MAIN ] UNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:45.379464] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53271 primary records. [2025-10-01T22:44:45.380357] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-01T22:44:45.391484] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-01T22:44:45.402986] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-01T22:44:45.405920] [INFO ] [MAIN ] Derivative Progress: 1417/1587 symbols completed. UP took 1.3s. Estimated remaining: 1m 11s. Rate: 143.6 symbols/min [2025-10-01T22:44:45.407038] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:45.407975] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-01T22:44:45.408588] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-01T22:44:45.411573] [INFO ] [MAIN ] Derivative Progress: 1418/1587 symbols completed. UNP took 1.3s. Estimated remaining: 1m 11s. Rate: 143.7 symbols/min [2025-10-01T22:44:45.412167] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:45.427292] [DEBUG] [MAIN ] URI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:45.432354] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 35649 primary records. [2025-10-01T22:44:45.432626] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-01T22:44:45.450520] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-01T22:44:45.450734] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-01T22:44:45.453519] [INFO ] [MAIN ] Derivative Progress: 1419/1587 symbols completed. URI took 1.3s. Estimated remaining: 1m 10s. Rate: 143.8 symbols/min [2025-10-01T22:44:45.453955] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:45.479440] [DEBUG] [LOCAL ] USAC: Loaded 22250 existing records from primary storage. [2025-10-01T22:44:45.479688] [INFO ] [MAIN ] USAC: Loaded 22250 primary data records. [2025-10-01T22:44:45.608538] [DEBUG] [LOCAL ] USA: Loaded 35974 existing records from primary storage. [2025-10-01T22:44:45.614548] [INFO ] [MAIN ] USA: Loaded 35974 primary data records. [2025-10-01T22:44:46.010825] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-01T22:44:46.061098] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-01T22:44:46.576958] [DEBUG] [MAIN ] USAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:46.579675] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22250 primary records. [2025-10-01T22:44:46.580878] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-01T22:44:46.595363] [DEBUG] [MAIN ] USA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:46.597141] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 35974 primary records. [2025-10-01T22:44:46.605637] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-01T22:44:46.633231] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-01T22:44:46.634107] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-01T22:44:46.637149] [INFO ] [MAIN ] Derivative Progress: 1420/1587 symbols completed. USA took 1.2s. Estimated remaining: 1m 10s. Rate: 143.6 symbols/min [2025-10-01T22:44:46.637888] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:46.639760] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-01T22:44:46.640094] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-01T22:44:46.642766] [INFO ] [MAIN ] Derivative Progress: 1421/1587 symbols completed. USAC took 1.2s. Estimated remaining: 1m 9s. Rate: 143.7 symbols/min [2025-10-01T22:44:46.643319] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:46.662251] [DEBUG] [MAIN ] USB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:46.663603] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-01T22:44:46.668390] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-01T22:44:46.690417] [DEBUG] [LOCAL ] USNA: Loaded 17841 existing records from primary storage. [2025-10-01T22:44:46.691155] [INFO ] [MAIN ] USNA: Loaded 17841 primary data records. [2025-10-01T22:44:46.769384] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-01T22:44:46.797666] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-01T22:44:46.822781] [INFO ] [MAIN ] Derivative Progress: 1422/1587 symbols completed. USB took 1.4s. Estimated remaining: 1m 9s. Rate: 143.8 symbols/min [2025-10-01T22:44:46.827742] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:46.934376] [DEBUG] [LOCAL ] USFD: Loaded 51195 existing records from primary storage. [2025-10-01T22:44:47.065697] [INFO ] [MAIN ] USFD: Loaded 51195 primary data records. [2025-10-01T22:44:47.129592] [DEBUG] [LOCAL ] USPH: Loaded 16687 existing records from primary storage. [2025-10-01T22:44:47.153966] [INFO ] [MAIN ] USPH: Loaded 16687 primary data records. [2025-10-01T22:44:47.833299] [DEBUG] [MAIN ] USNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:47.834795] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17841 primary records. [2025-10-01T22:44:47.834997] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-01T22:44:47.868106] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-01T22:44:47.876604] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-01T22:44:47.879087] [INFO ] [MAIN ] Derivative Progress: 1423/1587 symbols completed. USNA took 1.2s. Estimated remaining: 1m 9s. Rate: 143.6 symbols/min [2025-10-01T22:44:47.876491] [DEBUG] [MAIN ] USFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:47.880910] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51195 primary records. [2025-10-01T22:44:47.881037] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-01T22:44:47.895289] [DEBUG] [MAIN ] USPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:47.904029] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16687 primary records. [2025-10-01T22:44:47.905281] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-01T22:44:47.925018] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-01T22:44:47.925599] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-01T22:44:47.928924] [INFO ] [MAIN ] Derivative Progress: 1424/1587 symbols completed. USFD took 1.3s. Estimated remaining: 1m 8s. Rate: 143.7 symbols/min [2025-10-01T22:44:47.933701] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-01T22:44:47.933779] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-01T22:44:47.937913] [INFO ] [MAIN ] Derivative Progress: 1425/1587 symbols completed. USPH took 1.1s. Estimated remaining: 1m 8s. Rate: 143.8 symbols/min [2025-10-01T22:44:47.938923] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:47.939139] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:47.939058] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:47.957571] [DEBUG] [LOCAL ] UTL: Loaded 11321 existing records from primary storage. [2025-10-01T22:44:47.957795] [INFO ] [MAIN ] UTL: Loaded 11321 primary data records. [2025-10-01T22:44:48.115116] [DEBUG] [LOCAL ] UTF: Loaded 29257 existing records from primary storage. [2025-10-01T22:44:48.131778] [INFO ] [MAIN ] UTF: Loaded 29257 primary data records. [2025-10-01T22:44:48.121218] [DEBUG] [LOCAL ] UTI: Loaded 40440 existing records from primary storage. [2025-10-01T22:44:48.131967] [INFO ] [MAIN ] UTI: Loaded 40440 primary data records. [2025-10-01T22:44:49.062287] [DEBUG] [MAIN ] UTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:49.063591] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11321 primary records. [2025-10-01T22:44:49.063732] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-01T22:44:49.112592] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-01T22:44:49.111942] [DEBUG] [MAIN ] UTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:49.113279] [DEBUG] [MAIN ] UTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:49.114711] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40440 primary records. [2025-10-01T22:44:49.114830] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-01T22:44:49.115859] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 29257 primary records. [2025-10-01T22:44:49.118420] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-01T22:44:49.118307] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-01T22:44:49.118194] [INFO ] [MAIN ] Derivative Progress: 1426/1587 symbols completed. UTL took 1.2s. Estimated remaining: 1m 7s. Rate: 143.6 symbols/min [2025-10-01T22:44:49.119717] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:49.139092] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-01T22:44:49.147086] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-01T22:44:49.154875] [INFO ] [MAIN ] Derivative Progress: 1427/1587 symbols completed. UTF took 1.2s. Estimated remaining: 1m 7s. Rate: 143.7 symbols/min [2025-10-01T22:44:49.155260] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:49.162586] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-01T22:44:49.162792] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-01T22:44:49.165725] [INFO ] [MAIN ] Derivative Progress: 1428/1587 symbols completed. UTI took 1.2s. Estimated remaining: 1m 6s. Rate: 143.8 symbols/min [2025-10-01T22:44:49.166002] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:49.195042] [DEBUG] [LOCAL ] UVE: Loaded 21782 existing records from primary storage. [2025-10-01T22:44:49.195375] [INFO ] [MAIN ] UVE: Loaded 21782 primary data records. [2025-10-01T22:44:49.344061] [DEBUG] [LOCAL ] UTZ: Loaded 44744 existing records from primary storage. [2025-10-01T22:44:49.344742] [DEBUG] [LOCAL ] UVV: Loaded 22514 existing records from primary storage. [2025-10-01T22:44:49.345188] [INFO ] [MAIN ] UVV: Loaded 22514 primary data records. [2025-10-01T22:44:49.345079] [INFO ] [MAIN ] UTZ: Loaded 44744 primary data records. [2025-10-01T22:44:50.289793] [DEBUG] [MAIN ] UVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:50.290630] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21782 primary records. [2025-10-01T22:44:50.291137] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-01T22:44:50.309440] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-01T22:44:50.309958] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-01T22:44:50.313222] [INFO ] [MAIN ] Derivative Progress: 1429/1587 symbols completed. UVE took 1.2s. Estimated remaining: 1m 6s. Rate: 143.6 symbols/min [2025-10-01T22:44:50.314161] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:50.331185] [DEBUG] [MAIN ] UTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:50.332364] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44744 primary records. [2025-10-01T22:44:50.332663] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-01T22:44:50.346995] [DEBUG] [MAIN ] UVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:50.359519] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22514 primary records. [2025-10-01T22:44:50.360151] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-01T22:44:50.365700] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-01T22:44:50.365922] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-01T22:44:50.369468] [INFO ] [MAIN ] Derivative Progress: 1430/1587 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 6s. Rate: 143.7 symbols/min [2025-10-01T22:44:50.381214] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:50.386240] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-01T22:44:50.386388] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-01T22:44:50.389205] [INFO ] [MAIN ] Derivative Progress: 1431/1587 symbols completed. UVV took 1.2s. Estimated remaining: 1m 5s. Rate: 143.8 symbols/min [2025-10-01T22:44:50.389762] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:50.414828] [DEBUG] [LOCAL ] UZD: Loaded 6411 existing records from primary storage. [2025-10-01T22:44:50.415046] [INFO ] [MAIN ] UZD: Loaded 6411 primary data records. [2025-10-01T22:44:50.481436] [DEBUG] [LOCAL ] UZE: Loaded 7443 existing records from primary storage. [2025-10-01T22:44:50.514467] [INFO ] [MAIN ] UZE: Loaded 7443 primary data records. [2025-10-01T22:44:50.586932] [DEBUG] [LOCAL ] UWMC: Loaded 52775 existing records from primary storage. [2025-10-01T22:44:50.598017] [INFO ] [MAIN ] UWMC: Loaded 52775 primary data records. [2025-10-01T22:44:51.509353] [DEBUG] [MAIN ] UZD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:51.512185] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6411 primary records. [2025-10-01T22:44:51.512513] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-01T22:44:51.542466] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-01T22:44:51.543700] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-01T22:44:51.546456] [INFO ] [MAIN ] Derivative Progress: 1432/1587 symbols completed. UZD took 1.2s. Estimated remaining: 1m 5s. Rate: 143.7 symbols/min [2025-10-01T22:44:51.544122] [DEBUG] [MAIN ] UZE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:51.554692] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:51.560553] [DEBUG] [MAIN ] UWMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:51.561581] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52775 primary records. [2025-10-01T22:44:51.562279] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7443 primary records. [2025-10-01T22:44:51.562444] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-01T22:44:51.562686] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-01T22:44:51.589754] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-01T22:44:51.592524] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-01T22:44:51.599370] [INFO ] [MAIN ] Derivative Progress: 1433/1587 symbols completed. UWMC took 1.3s. Estimated remaining: 1m 4s. Rate: 143.7 symbols/min [2025-10-01T22:44:51.605115] [DEBUG] [LOCAL ] UZF: Loaded 6456 existing records from primary storage. [2025-10-01T22:44:51.605211] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:51.606031] [INFO ] [MAIN ] UZF: Loaded 6456 primary data records. [2025-10-01T22:44:51.616491] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-01T22:44:51.625571] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-01T22:44:51.637397] [INFO ] [MAIN ] Derivative Progress: 1434/1587 symbols completed. UZE took 1.2s. Estimated remaining: 1m 4s. Rate: 143.8 symbols/min [2025-10-01T22:44:51.663200] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:52.021142] [DEBUG] [LOCAL ] VAC: Loaded 34393 existing records from primary storage. [2025-10-01T22:44:52.021477] [INFO ] [MAIN ] VAC: Loaded 34393 primary data records. [2025-10-01T22:44:52.022282] [DEBUG] [LOCAL ] V: Loaded 53755 existing records from primary storage. [2025-10-01T22:44:52.028621] [INFO ] [MAIN ] V: Loaded 53755 primary data records. [2025-10-01T22:44:52.701034] [DEBUG] [MAIN ] UZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:52.702209] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6456 primary records. [2025-10-01T22:44:52.702471] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-01T22:44:52.720981] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-10-01T22:44:52.721499] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-01T22:44:52.724501] [INFO ] [MAIN ] Derivative Progress: 1435/1587 symbols completed. UZF took 1.2s. Estimated remaining: 1m 3s. Rate: 143.7 symbols/min [2025-10-01T22:44:52.725487] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:52.751748] [DEBUG] [MAIN ] V: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:52.753591] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53755 primary records. [2025-10-01T22:44:52.753840] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-01T22:44:52.787688] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-01T22:44:52.787903] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-01T22:44:52.784946] [DEBUG] [MAIN ] VAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:52.792999] [INFO ] [MAIN ] Derivative Progress: 1436/1587 symbols completed. V took 1.2s. Estimated remaining: 1m 3s. Rate: 143.8 symbols/min [2025-10-01T22:44:52.793350] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:52.794463] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34393 primary records. [2025-10-01T22:44:52.794881] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-01T22:44:52.827460] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-01T22:44:52.827699] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-01T22:44:52.830569] [INFO ] [MAIN ] Derivative Progress: 1437/1587 symbols completed. VAC took 1.2s. Estimated remaining: 1m 3s. Rate: 143.8 symbols/min [2025-10-01T22:44:52.830891] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:52.853402] [DEBUG] [LOCAL ] VATE: Loaded 5334 existing records from primary storage. [2025-10-01T22:44:52.853747] [INFO ] [MAIN ] VATE: Loaded 5334 primary data records. [2025-10-01T22:44:52.860004] [DEBUG] [LOCAL ] VAL: Loaded 50306 existing records from primary storage. [2025-10-01T22:44:52.878269] [INFO ] [MAIN ] VAL: Loaded 50306 primary data records. [2025-10-01T22:44:53.529551] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-10-01T22:44:53.545093] [INFO ] [MAIN ] VALE: Loaded 53694 primary data records. [2025-10-01T22:44:53.976399] [DEBUG] [MAIN ] VATE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:53.979026] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5334 primary records. [2025-10-01T22:44:53.979357] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-01T22:44:53.977774] [DEBUG] [MAIN ] VAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:53.980589] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50306 primary records. [2025-10-01T22:44:53.981755] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-01T22:44:54.010485] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-01T22:44:54.013586] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-01T22:44:54.014868] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-01T22:44:54.017528] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-01T22:44:54.017319] [INFO ] [MAIN ] Derivative Progress: 1438/1587 symbols completed. VATE took 1.2s. Estimated remaining: 1m 2s. Rate: 143.7 symbols/min [2025-10-01T22:44:54.021145] [INFO ] [MAIN ] Derivative Progress: 1439/1587 symbols completed. VAL took 1.3s. Estimated remaining: 1m 2s. Rate: 143.8 symbols/min [2025-10-01T22:44:54.038505] [DEBUG] [MAIN ] VALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:54.039375] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53694 primary records. [2025-10-01T22:44:54.039438] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-01T22:44:54.054606] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-01T22:44:54.054696] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-01T22:44:54.056938] [INFO ] [MAIN ] Derivative Progress: 1440/1587 symbols completed. VALE took 1.3s. Estimated remaining: 1m 1s. Rate: 143.9 symbols/min [2025-10-01T22:44:54.057333] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:54.057451] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:54.057398] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:54.072141] [DEBUG] [LOCAL ] VBF: Loaded 6911 existing records from primary storage. [2025-10-01T22:44:54.072401] [INFO ] [MAIN ] VBF: Loaded 6911 primary data records. [2025-10-01T22:44:54.172039] [DEBUG] [LOCAL ] VCV: Loaded 13723 existing records from primary storage. [2025-10-01T22:44:54.199799] [INFO ] [MAIN ] VCV: Loaded 13723 primary data records. [2025-10-01T22:44:54.562152] [DEBUG] [LOCAL ] VEEV: Loaded 47055 existing records from primary storage. [2025-10-01T22:44:54.572843] [INFO ] [MAIN ] VEEV: Loaded 47055 primary data records. [2025-10-01T22:44:55.149555] [DEBUG] [MAIN ] VBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:55.151135] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 6911 primary records. [2025-10-01T22:44:55.151685] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-01T22:44:55.169289] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-01T22:44:55.170023] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-01T22:44:55.173176] [INFO ] [MAIN ] Derivative Progress: 1441/1587 symbols completed. VBF took 1.1s. Estimated remaining: 1m 1s. Rate: 143.7 symbols/min [2025-10-01T22:44:55.176165] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:55.192693] [DEBUG] [MAIN ] VCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:55.193636] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13723 primary records. [2025-10-01T22:44:55.193925] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-01T22:44:55.217372] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-01T22:44:55.219536] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-01T22:44:55.222343] [INFO ] [MAIN ] Derivative Progress: 1442/1587 symbols completed. VCV took 1.2s. Estimated remaining: 1m 1s. Rate: 143.8 symbols/min [2025-10-01T22:44:55.227800] [DEBUG] [LOCAL ] VEL: Loaded 12787 existing records from primary storage. [2025-10-01T22:44:55.228125] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:55.228590] [INFO ] [MAIN ] VEL: Loaded 12787 primary data records. [2025-10-01T22:44:55.277277] [DEBUG] [MAIN ] VEEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:55.291990] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47055 primary records. [2025-10-01T22:44:55.292206] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-01T22:44:55.611887] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-01T22:44:55.612051] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-01T22:44:55.615430] [INFO ] [MAIN ] Derivative Progress: 1443/1587 symbols completed. VEEV took 1.6s. Estimated remaining: 1m 0s. Rate: 143.8 symbols/min [2025-10-01T22:44:55.615791] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:55.635273] [DEBUG] [LOCAL ] VET: Loaded 43905 existing records from primary storage. [2025-10-01T22:44:55.635692] [INFO ] [MAIN ] VET: Loaded 43905 primary data records. [2025-10-01T22:44:56.061570] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-10-01T22:44:56.075819] [DEBUG] [MAIN ] VEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:56.077769] [INFO ] [MAIN ] VFC: Loaded 53610 primary data records. [2025-10-01T22:44:56.077683] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12787 primary records. [2025-10-01T22:44:56.084093] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-01T22:44:56.224958] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-01T22:44:56.230759] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-01T22:44:56.254860] [INFO ] [MAIN ] Derivative Progress: 1444/1587 symbols completed. VEL took 1.1s. Estimated remaining: 59.7s. Rate: 143.7 symbols/min [2025-10-01T22:44:56.282025] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:56.461622] [DEBUG] [MAIN ] VET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:56.463242] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 43905 primary records. [2025-10-01T22:44:56.463697] [DEBUG] [LOCAL ] VGI: Loaded 5152 existing records from primary storage. [2025-10-01T22:44:56.463916] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-01T22:44:56.464394] [INFO ] [MAIN ] VGI: Loaded 5152 primary data records. [2025-10-01T22:44:56.666950] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-01T22:44:56.803674] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-01T22:44:56.824374] [INFO ] [MAIN ] Derivative Progress: 1445/1587 symbols completed. VET took 1.6s. Estimated remaining: 59.3s. Rate: 143.7 symbols/min [2025-10-01T22:44:56.825809] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:56.841258] [DEBUG] [MAIN ] VFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:56.842788] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53610 primary records. [2025-10-01T22:44:56.843191] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-01T22:44:56.867378] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-01T22:44:56.867524] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-01T22:44:56.870008] [INFO ] [MAIN ] Derivative Progress: 1446/1587 symbols completed. VFC took 1.3s. Estimated remaining: 58.8s. Rate: 143.8 symbols/min [2025-10-01T22:44:56.870184] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:56.880891] [DEBUG] [LOCAL ] VGM: Loaded 18325 existing records from primary storage. [2025-10-01T22:44:56.881324] [INFO ] [MAIN ] VGM: Loaded 18325 primary data records. [2025-10-01T22:44:56.935867] [DEBUG] [LOCAL ] VHI: Loaded 2766 existing records from primary storage. [2025-10-01T22:44:56.967315] [INFO ] [MAIN ] VHI: Loaded 2766 primary data records. [2025-10-01T22:44:57.214074] [DEBUG] [MAIN ] VGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:57.235394] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5152 primary records. [2025-10-01T22:44:57.377807] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-01T22:44:57.612458] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-01T22:44:57.613777] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-01T22:44:57.617397] [INFO ] [MAIN ] Derivative Progress: 1447/1587 symbols completed. VGI took 1.3s. Estimated remaining: 58.5s. Rate: 143.7 symbols/min [2025-10-01T22:44:57.618198] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:57.641618] [DEBUG] [MAIN ] VGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:57.643063] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18325 primary records. [2025-10-01T22:44:57.643141] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-01T22:44:57.674941] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-01T22:44:57.680203] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-01T22:44:57.682881] [INFO ] [MAIN ] Derivative Progress: 1448/1587 symbols completed. VGM took 0.9s. Estimated remaining: 58.0s. Rate: 143.8 symbols/min [2025-10-01T22:44:57.683321] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:57.683127] [DEBUG] [MAIN ] VHI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:44:57.684572] [INFO ] [MAIN ] VHI: Generated 1793 derivative records from 2766 primary records. [2025-10-01T22:44:57.684786] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-01T22:44:57.715079] [DEBUG] [LOCAL ] VHI: Derivative data saved (1793 records). [2025-10-01T22:44:57.715287] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-01T22:44:57.718165] [INFO ] [MAIN ] Derivative Progress: 1449/1587 symbols completed. VHI took 0.8s. Estimated remaining: 57.6s. Rate: 143.9 symbols/min [2025-10-01T22:44:57.718487] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:57.738300] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-10-01T22:44:57.738539] [INFO ] [MAIN ] VICI: Loaded 53647 primary data records. [2025-10-01T22:44:58.139414] [DEBUG] [LOCAL ] VIK: Loaded 52494 existing records from primary storage. [2025-10-01T22:44:58.151747] [INFO ] [MAIN ] VIK: Loaded 52494 primary data records. [2025-10-01T22:44:58.294943] [DEBUG] [LOCAL ] VIPS: Loaded 51338 existing records from primary storage. [2025-10-01T22:44:58.321753] [INFO ] [MAIN ] VIPS: Loaded 51338 primary data records. [2025-10-01T22:44:58.870747] [DEBUG] [MAIN ] VICI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:58.872747] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53647 primary records. [2025-10-01T22:44:58.873036] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-01T22:44:58.908407] [DEBUG] [MAIN ] VIK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:44:58.911210] [INFO ] [MAIN ] VIK: Generated 1793 derivative records from 52494 primary records. [2025-10-01T22:44:58.912605] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-01T22:44:58.912727] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-01T22:44:58.913188] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-01T22:44:58.916495] [INFO ] [MAIN ] Derivative Progress: 1450/1587 symbols completed. VICI took 1.3s. Estimated remaining: 57.2s. Rate: 143.7 symbols/min [2025-10-01T22:44:58.925868] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:58.934563] [DEBUG] [LOCAL ] VIK: Derivative data saved (1793 records). [2025-10-01T22:44:58.935817] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-01T22:44:58.938100] [INFO ] [MAIN ] Derivative Progress: 1451/1587 symbols completed. VIK took 1.3s. Estimated remaining: 56.8s. Rate: 143.8 symbols/min [2025-10-01T22:44:58.938484] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:58.957965] [DEBUG] [MAIN ] VIPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:44:58.958811] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51338 primary records. [2025-10-01T22:44:58.959034] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-01T22:44:58.976777] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-01T22:44:58.976914] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-01T22:44:58.979801] [INFO ] [MAIN ] Derivative Progress: 1452/1587 symbols completed. VIPS took 1.3s. Estimated remaining: 56.3s. Rate: 143.9 symbols/min [2025-10-01T22:44:58.980221] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:44:59.023229] [DEBUG] [LOCAL ] VIRT: Loaded 46652 existing records from primary storage. [2025-10-01T22:44:59.036603] [INFO ] [MAIN ] VIRT: Loaded 46652 primary data records. [2025-10-01T22:44:59.037429] [DEBUG] [LOCAL ] VIST: Loaded 45965 existing records from primary storage. [2025-10-01T22:44:59.049853] [INFO ] [MAIN ] VIST: Loaded 45965 primary data records. [2025-10-01T22:44:59.373995] [DEBUG] [LOCAL ] VIV: Loaded 44969 existing records from primary storage. [2025-10-01T22:44:59.392502] [INFO ] [MAIN ] VIV: Loaded 44969 primary data records. [2025-10-01T22:45:00.125859] [DEBUG] [MAIN ] VIRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:00.127804] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46652 primary records. [2025-10-01T22:45:00.128139] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-01T22:45:00.151442] [DEBUG] [MAIN ] VIST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:00.156567] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 45965 primary records. [2025-10-01T22:45:00.156847] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-01T22:45:00.178679] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-01T22:45:00.180058] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-01T22:45:00.183276] [INFO ] [MAIN ] Derivative Progress: 1453/1587 symbols completed. VIST took 1.2s. Estimated remaining: 56.0s. Rate: 143.7 symbols/min [2025-10-01T22:45:00.185616] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-01T22:45:00.198479] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-01T22:45:00.200978] [INFO ] [MAIN ] Derivative Progress: 1454/1587 symbols completed. VIRT took 1.3s. Estimated remaining: 55.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:00.198758] [DEBUG] [MAIN ] VIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:00.201999] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44969 primary records. [2025-10-01T22:45:00.202078] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-01T22:45:00.218855] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-01T22:45:00.218958] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-01T22:45:00.221818] [INFO ] [MAIN ] Derivative Progress: 1455/1587 symbols completed. VIV took 1.2s. Estimated remaining: 55.0s. Rate: 143.9 symbols/min [2025-10-01T22:45:00.222427] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:00.222342] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:00.222605] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:00.249906] [DEBUG] [LOCAL ] VKQ: Loaded 17622 existing records from primary storage. [2025-10-01T22:45:00.250075] [INFO ] [MAIN ] VKQ: Loaded 17622 primary data records. [2025-10-01T22:45:00.356758] [DEBUG] [LOCAL ] VLN: Loaded 29086 existing records from primary storage. [2025-10-01T22:45:00.387331] [INFO ] [MAIN ] VLN: Loaded 29086 primary data records. [2025-10-01T22:45:00.771909] [DEBUG] [LOCAL ] VLO: Loaded 53073 existing records from primary storage. [2025-10-01T22:45:00.793061] [INFO ] [MAIN ] VLO: Loaded 53073 primary data records. [2025-10-01T22:45:01.394160] [DEBUG] [MAIN ] VKQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:01.396428] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17622 primary records. [2025-10-01T22:45:01.396783] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-01T22:45:01.416081] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-01T22:45:01.418503] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-01T22:45:01.421290] [INFO ] [MAIN ] Derivative Progress: 1456/1587 symbols completed. VKQ took 1.2s. Estimated remaining: 54.7s. Rate: 143.7 symbols/min [2025-10-01T22:45:01.429748] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:01.436392] [DEBUG] [MAIN ] VLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:01.437326] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 29086 primary records. [2025-10-01T22:45:01.437597] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-01T22:45:01.458782] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-01T22:45:01.459045] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-01T22:45:01.461908] [INFO ] [MAIN ] Derivative Progress: 1457/1587 symbols completed. VLN took 1.2s. Estimated remaining: 54.3s. Rate: 143.8 symbols/min [2025-10-01T22:45:01.474988] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:01.475881] [DEBUG] [MAIN ] VLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:01.476561] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53073 primary records. [2025-10-01T22:45:01.476792] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-01T22:45:01.508912] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-01T22:45:01.509031] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-01T22:45:01.511919] [INFO ] [MAIN ] Derivative Progress: 1458/1587 symbols completed. VLO took 1.3s. Estimated remaining: 53.8s. Rate: 143.9 symbols/min [2025-10-01T22:45:01.512215] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:01.508801] [DEBUG] [LOCAL ] VLT: Loaded 4542 existing records from primary storage. [2025-10-01T22:45:01.512463] [INFO ] [MAIN ] VLT: Loaded 4542 primary data records. [2025-10-01T22:45:01.660188] [DEBUG] [LOCAL ] VLRS: Loaded 40366 existing records from primary storage. [2025-10-01T22:45:01.664916] [INFO ] [MAIN ] VLRS: Loaded 40366 primary data records. [2025-10-01T22:45:02.087914] [DEBUG] [LOCAL ] VLTO: Loaded 46023 existing records from primary storage. [2025-10-01T22:45:02.107282] [INFO ] [MAIN ] VLTO: Loaded 46023 primary data records. [2025-10-01T22:45:02.722978] [DEBUG] [MAIN ] VLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:02.724879] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4542 primary records. [2025-10-01T22:45:02.725253] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-01T22:45:02.750352] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-01T22:45:02.752057] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-01T22:45:02.755246] [INFO ] [MAIN ] Derivative Progress: 1459/1587 symbols completed. VLT took 1.3s. Estimated remaining: 53.5s. Rate: 143.7 symbols/min [2025-10-01T22:45:02.757510] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:02.775635] [DEBUG] [MAIN ] VLRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:02.776934] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40366 primary records. [2025-10-01T22:45:02.777304] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-01T22:45:02.797673] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-01T22:45:02.798115] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-01T22:45:02.801081] [INFO ] [MAIN ] Derivative Progress: 1460/1587 symbols completed. VLRS took 1.4s. Estimated remaining: 53.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:02.801379] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:02.815387] [DEBUG] [MAIN ] VLTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:02.816692] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46023 primary records. [2025-10-01T22:45:02.816840] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-01T22:45:02.836698] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-01T22:45:02.836998] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-01T22:45:02.839604] [INFO ] [MAIN ] Derivative Progress: 1461/1587 symbols completed. VLTO took 1.3s. Estimated remaining: 52.6s. Rate: 143.8 symbols/min [2025-10-01T22:45:02.839927] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:02.862772] [DEBUG] [LOCAL ] VMI: Loaded 15418 existing records from primary storage. [2025-10-01T22:45:02.862956] [INFO ] [MAIN ] VMI: Loaded 15418 primary data records. [2025-10-01T22:45:02.990357] [DEBUG] [LOCAL ] VMC: Loaded 43268 existing records from primary storage. [2025-10-01T22:45:03.010688] [INFO ] [MAIN ] VMC: Loaded 43268 primary data records. [2025-10-01T22:45:03.011314] [DEBUG] [LOCAL ] VMO: Loaded 21043 existing records from primary storage. [2025-10-01T22:45:03.011480] [INFO ] [MAIN ] VMO: Loaded 21043 primary data records. [2025-10-01T22:45:04.000581] [DEBUG] [MAIN ] VMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:04.002057] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15418 primary records. [2025-10-01T22:45:04.002465] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-01T22:45:04.027044] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-10-01T22:45:04.027191] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-01T22:45:04.031756] [INFO ] [MAIN ] Derivative Progress: 1462/1587 symbols completed. VMI took 1.2s. Estimated remaining: 52.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:04.040314] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:04.047016] [DEBUG] [MAIN ] VMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:04.050899] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43268 primary records. [2025-10-01T22:45:04.051622] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-01T22:45:04.081450] [DEBUG] [LOCAL ] VNCE: Loaded 8032 existing records from primary storage. [2025-10-01T22:45:04.086758] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-01T22:45:04.086547] [DEBUG] [MAIN ] VMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:04.086960] [INFO ] [MAIN ] VNCE: Loaded 8032 primary data records. [2025-10-01T22:45:04.087900] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 21043 primary records. [2025-10-01T22:45:04.099772] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-01T22:45:04.111292] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-01T22:45:04.139969] [INFO ] [MAIN ] Derivative Progress: 1463/1587 symbols completed. VMC took 1.4s. Estimated remaining: 51.8s. Rate: 143.7 symbols/min [2025-10-01T22:45:04.170202] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:04.225101] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-01T22:45:04.225746] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-01T22:45:04.234374] [INFO ] [MAIN ] Derivative Progress: 1464/1587 symbols completed. VMO took 1.4s. Estimated remaining: 51.3s. Rate: 143.8 symbols/min [2025-10-01T22:45:04.250426] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:04.515449] [DEBUG] [MAIN ] VNCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:04.518529] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 8032 primary records. [2025-10-01T22:45:04.520497] [DEBUG] [LOCAL ] VNO: Loaded 48848 existing records from primary storage. [2025-10-01T22:45:04.520838] [INFO ] [MAIN ] VNO: Loaded 48848 primary data records. [2025-10-01T22:45:04.520990] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-01T22:45:04.581329] [DEBUG] [LOCAL ] VNT: Loaded 43549 existing records from primary storage. [2025-10-01T22:45:04.587669] [INFO ] [MAIN ] VNT: Loaded 43549 primary data records. [2025-10-01T22:45:04.772262] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-10-01T22:45:04.836978] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-01T22:45:05.111972] [INFO ] [MAIN ] Derivative Progress: 1465/1587 symbols completed. VNCE took 1.1s. Estimated remaining: 50.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:05.270404] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:05.286379] [DEBUG] [LOCAL ] VOC: Loaded 8913 existing records from primary storage. [2025-10-01T22:45:05.287505] [INFO ] [MAIN ] VOC: Loaded 8913 primary data records. [2025-10-01T22:45:05.507514] [DEBUG] [MAIN ] VNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:05.658610] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48848 primary records. [2025-10-01T22:45:05.658904] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-01T22:45:05.675581] [DEBUG] [MAIN ] VNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:05.688685] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43549 primary records. [2025-10-01T22:45:05.689494] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-01T22:45:05.715741] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-01T22:45:05.716323] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-01T22:45:05.719063] [INFO ] [MAIN ] Derivative Progress: 1466/1587 symbols completed. VNO took 1.5s. Estimated remaining: 50.5s. Rate: 143.7 symbols/min [2025-10-01T22:45:05.719871] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:05.723424] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-01T22:45:05.723727] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-01T22:45:05.726173] [INFO ] [MAIN ] Derivative Progress: 1467/1587 symbols completed. VNT took 1.5s. Estimated remaining: 50.1s. Rate: 143.8 symbols/min [2025-10-01T22:45:05.726884] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:05.753927] [DEBUG] [MAIN ] VOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:05.754851] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8913 primary records. [2025-10-01T22:45:05.755024] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-01T22:45:05.771277] [DEBUG] [LOCAL ] VPG: Loaded 17071 existing records from primary storage. [2025-10-01T22:45:05.774258] [INFO ] [MAIN ] VPG: Loaded 17071 primary data records. [2025-10-01T22:45:05.784216] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-01T22:45:05.801415] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-01T22:45:05.841381] [INFO ] [MAIN ] Derivative Progress: 1468/1587 symbols completed. VOC took 0.6s. Estimated remaining: 49.6s. Rate: 143.8 symbols/min [2025-10-01T22:45:05.936543] [DEBUG] [LOCAL ] VOYA: Loaded 42502 existing records from primary storage. [2025-10-01T22:45:05.947349] [INFO ] [MAIN ] VOYA: Loaded 42502 primary data records. [2025-10-01T22:45:06.511237] [DEBUG] [MAIN ] VPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:06.512331] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17071 primary records. [2025-10-01T22:45:06.512674] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-01T22:45:06.533859] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-01T22:45:06.534071] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-01T22:45:06.536448] [INFO ] [MAIN ] Derivative Progress: 1469/1587 symbols completed. VPG took 0.8s. Estimated remaining: 49.2s. Rate: 143.8 symbols/min [2025-10-01T22:45:06.550216] [DEBUG] [MAIN ] VOYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:06.550986] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42502 primary records. [2025-10-01T22:45:06.551051] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-01T22:45:06.568383] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-01T22:45:06.568553] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-01T22:45:06.571794] [INFO ] [MAIN ] Derivative Progress: 1470/1587 symbols completed. VOYA took 0.9s. Estimated remaining: 48.8s. Rate: 143.9 symbols/min [2025-10-01T22:45:06.572366] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:06.572424] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:06.572593] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:06.581812] [DEBUG] [LOCAL ] VPV: Loaded 5397 existing records from primary storage. [2025-10-01T22:45:06.582290] [INFO ] [MAIN ] VPV: Loaded 5397 primary data records. [2025-10-01T22:45:06.826267] [DEBUG] [LOCAL ] VRE: Loaded 34992 existing records from primary storage. [2025-10-01T22:45:06.826588] [INFO ] [MAIN ] VRE: Loaded 34992 primary data records. [2025-10-01T22:45:07.104663] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-01T22:45:07.121017] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-01T22:45:07.732467] [DEBUG] [MAIN ] VPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:07.733951] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5397 primary records. [2025-10-01T22:45:07.734295] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-01T22:45:07.751690] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-01T22:45:07.753919] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-01T22:45:07.756968] [INFO ] [MAIN ] Derivative Progress: 1471/1587 symbols completed. VPV took 1.2s. Estimated remaining: 48.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:07.757438] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:07.772183] [DEBUG] [MAIN ] VRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:07.772953] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34992 primary records. [2025-10-01T22:45:07.773075] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-01T22:45:07.794995] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-01T22:45:07.795345] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-01T22:45:07.811024] [INFO ] [MAIN ] Derivative Progress: 1472/1587 symbols completed. VRE took 1.2s. Estimated remaining: 48.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:07.815347] [DEBUG] [LOCAL ] VRTS: Loaded 9308 existing records from primary storage. [2025-10-01T22:45:07.815832] [INFO ] [MAIN ] VRTS: Loaded 9308 primary data records. [2025-10-01T22:45:07.815771] [DEBUG] [MAIN ] VRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:07.815936] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:07.816806] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-01T22:45:07.816909] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-01T22:45:07.960991] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-01T22:45:07.972958] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-01T22:45:07.981355] [INFO ] [MAIN ] Derivative Progress: 1473/1587 symbols completed. VRT took 1.4s. Estimated remaining: 47.6s. Rate: 143.8 symbols/min [2025-10-01T22:45:08.015098] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:08.213446] [DEBUG] [LOCAL ] VSCO: Loaded 52765 existing records from primary storage. [2025-10-01T22:45:08.214161] [INFO ] [MAIN ] VSCO: Loaded 52765 primary data records. [2025-10-01T22:45:08.584621] [DEBUG] [LOCAL ] VSH: Loaded 48344 existing records from primary storage. [2025-10-01T22:45:08.586161] [INFO ] [MAIN ] VSH: Loaded 48344 primary data records. [2025-10-01T22:45:08.747395] [DEBUG] [MAIN ] VRTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:08.764422] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9308 primary records. [2025-10-01T22:45:08.791822] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-01T22:45:08.966072] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-01T22:45:08.966324] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-01T22:45:08.968743] [INFO ] [MAIN ] Derivative Progress: 1474/1587 symbols completed. VRTS took 1.2s. Estimated remaining: 47.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:08.969806] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:08.989495] [DEBUG] [MAIN ] VSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:08.990407] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52765 primary records. [2025-10-01T22:45:08.990498] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-01T22:45:09.008457] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-01T22:45:09.008896] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-01T22:45:09.011465] [INFO ] [MAIN ] Derivative Progress: 1475/1587 symbols completed. VSCO took 1.2s. Estimated remaining: 46.7s. Rate: 143.8 symbols/min [2025-10-01T22:45:09.011815] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:09.030376] [DEBUG] [MAIN ] VSH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:09.031217] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48344 primary records. [2025-10-01T22:45:09.031334] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-01T22:45:09.048752] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-01T22:45:09.048881] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-01T22:45:09.051584] [INFO ] [MAIN ] Derivative Progress: 1476/1587 symbols completed. VSH took 1.0s. Estimated remaining: 46.3s. Rate: 143.9 symbols/min [2025-10-01T22:45:09.051860] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:09.115837] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-10-01T22:45:09.117214] [INFO ] [MAIN ] VST: Loaded 53718 primary data records. [2025-10-01T22:45:09.118006] [DEBUG] [LOCAL ] VSTS: Loaded 49026 existing records from primary storage. [2025-10-01T22:45:09.152711] [INFO ] [MAIN ] VSTS: Loaded 49026 primary data records. [2025-10-01T22:45:09.397171] [DEBUG] [LOCAL ] VTEX: Loaded 43194 existing records from primary storage. [2025-10-01T22:45:09.427201] [INFO ] [MAIN ] VTEX: Loaded 43194 primary data records. [2025-10-01T22:45:10.201364] [DEBUG] [MAIN ] VST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:10.204893] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53718 primary records. [2025-10-01T22:45:10.205031] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-01T22:45:10.233668] [DEBUG] [MAIN ] VSTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:10.235225] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49026 primary records. [2025-10-01T22:45:10.235445] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-01T22:45:10.236052] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-01T22:45:10.237177] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-01T22:45:10.246589] [INFO ] [MAIN ] Derivative Progress: 1477/1587 symbols completed. VST took 1.3s. Estimated remaining: 45.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:10.255068] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-01T22:45:10.255173] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-01T22:45:10.255260] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:10.257925] [INFO ] [MAIN ] Derivative Progress: 1478/1587 symbols completed. VSTS took 1.2s. Estimated remaining: 45.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:10.259591] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:10.275556] [DEBUG] [MAIN ] VTEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:10.276471] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43194 primary records. [2025-10-01T22:45:10.276610] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-01T22:45:10.297811] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-01T22:45:10.298155] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-01T22:45:10.300888] [INFO ] [MAIN ] Derivative Progress: 1479/1587 symbols completed. VTEX took 1.2s. Estimated remaining: 45.0s. Rate: 143.9 symbols/min [2025-10-01T22:45:10.301186] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:10.310292] [DEBUG] [LOCAL ] VTMX: Loaded 17524 existing records from primary storage. [2025-10-01T22:45:10.312121] [INFO ] [MAIN ] VTMX: Loaded 17524 primary data records. [2025-10-01T22:45:10.363538] [DEBUG] [LOCAL ] VTN: Loaded 7038 existing records from primary storage. [2025-10-01T22:45:10.377313] [INFO ] [MAIN ] VTN: Loaded 7038 primary data records. [2025-10-01T22:45:10.662558] [DEBUG] [LOCAL ] VTLE: Loaded 48471 existing records from primary storage. [2025-10-01T22:45:10.733835] [INFO ] [MAIN ] VTLE: Loaded 48471 primary data records. [2025-10-01T22:45:11.455518] [DEBUG] [MAIN ] VTMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:11.470252] [DEBUG] [MAIN ] VTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:11.471121] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7038 primary records. [2025-10-01T22:45:11.471237] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-01T22:45:11.469943] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17524 primary records. [2025-10-01T22:45:11.472389] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-01T22:45:11.513527] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-01T22:45:11.514271] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-01T22:45:11.517038] [INFO ] [MAIN ] Derivative Progress: 1480/1587 symbols completed. VTMX took 1.3s. Estimated remaining: 44.7s. Rate: 143.7 symbols/min [2025-10-01T22:45:11.518481] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:11.522336] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-01T22:45:11.523325] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-01T22:45:11.526240] [INFO ] [MAIN ] Derivative Progress: 1481/1587 symbols completed. VTN took 1.2s. Estimated remaining: 44.2s. Rate: 143.8 symbols/min [2025-10-01T22:45:11.540758] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:11.541515] [DEBUG] [MAIN ] VTLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:11.542623] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48471 primary records. [2025-10-01T22:45:11.542814] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-01T22:45:11.560739] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-01T22:45:11.565783] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-01T22:45:11.568950] [INFO ] [MAIN ] Derivative Progress: 1482/1587 symbols completed. VTLE took 1.3s. Estimated remaining: 43.8s. Rate: 143.9 symbols/min [2025-10-01T22:45:11.570780] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:11.580994] [DEBUG] [LOCAL ] VTOL: Loaded 19565 existing records from primary storage. [2025-10-01T22:45:11.581225] [INFO ] [MAIN ] VTOL: Loaded 19565 primary data records. [2025-10-01T22:45:11.854867] [DEBUG] [LOCAL ] VTS: Loaded 30516 existing records from primary storage. [2025-10-01T22:45:11.977026] [INFO ] [MAIN ] VTS: Loaded 30516 primary data records. [2025-10-01T22:45:11.977859] [DEBUG] [LOCAL ] VTR: Loaded 52809 existing records from primary storage. [2025-10-01T22:45:11.978251] [INFO ] [MAIN ] VTR: Loaded 52809 primary data records. [2025-10-01T22:45:12.665733] [DEBUG] [MAIN ] VTOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:12.666824] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19565 primary records. [2025-10-01T22:45:12.667159] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-01T22:45:12.689624] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-01T22:45:12.690273] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-01T22:45:12.706337] [INFO ] [MAIN ] Derivative Progress: 1483/1587 symbols completed. VTOL took 1.2s. Estimated remaining: 43.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:12.708129] [DEBUG] [MAIN ] VTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:12.709077] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52809 primary records. [2025-10-01T22:45:12.709851] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-01T22:45:12.731085] [DEBUG] [MAIN ] VTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:12.735499] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30516 primary records. [2025-10-01T22:45:12.735817] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-01T22:45:12.754498] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-01T22:45:12.756731] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-01T22:45:12.756907] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-01T22:45:12.756804] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-01T22:45:12.760174] [INFO ] [MAIN ] Derivative Progress: 1484/1587 symbols completed. VTR took 1.2s. Estimated remaining: 43.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:12.763186] [INFO ] [MAIN ] Derivative Progress: 1485/1587 symbols completed. VTS took 1.2s. Estimated remaining: 42.5s. Rate: 143.9 symbols/min [2025-10-01T22:45:12.763564] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:12.763847] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:12.763522] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:12.797932] [DEBUG] [LOCAL ] VVX: Loaded 23138 existing records from primary storage. [2025-10-01T22:45:12.806797] [INFO ] [MAIN ] VVX: Loaded 23138 primary data records. [2025-10-01T22:45:12.945053] [DEBUG] [LOCAL ] VVR: Loaded 31186 existing records from primary storage. [2025-10-01T22:45:12.945746] [INFO ] [MAIN ] VVR: Loaded 31186 primary data records. [2025-10-01T22:45:13.052815] [DEBUG] [LOCAL ] VVV: Loaded 50187 existing records from primary storage. [2025-10-01T22:45:13.070836] [INFO ] [MAIN ] VVV: Loaded 50187 primary data records. [2025-10-01T22:45:13.945388] [DEBUG] [MAIN ] VVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:13.947079] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23138 primary records. [2025-10-01T22:45:13.947428] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-01T22:45:13.965574] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-01T22:45:13.967020] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-01T22:45:13.970186] [INFO ] [MAIN ] Derivative Progress: 1486/1587 symbols completed. VVX took 1.2s. Estimated remaining: 42.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:13.970637] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:14.002831] [DEBUG] [MAIN ] VVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:14.003943] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31186 primary records. [2025-10-01T22:45:14.004314] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-01T22:45:14.002499] [DEBUG] [MAIN ] VVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:14.006015] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50187 primary records. [2025-10-01T22:45:14.006434] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-01T22:45:14.034761] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-01T22:45:14.044974] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-01T22:45:14.050944] [INFO ] [MAIN ] Derivative Progress: 1487/1587 symbols completed. VVR took 1.3s. Estimated remaining: 41.7s. Rate: 143.8 symbols/min [2025-10-01T22:45:14.051104] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-01T22:45:14.051770] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-01T22:45:14.051546] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:14.055417] [INFO ] [MAIN ] Derivative Progress: 1488/1587 symbols completed. VVV took 1.3s. Estimated remaining: 41.3s. Rate: 143.9 symbols/min [2025-10-01T22:45:14.056260] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:14.096204] [DEBUG] [LOCAL ] VYX: Loaded 48753 existing records from primary storage. [2025-10-01T22:45:14.096356] [INFO ] [MAIN ] VYX: Loaded 48753 primary data records. [2025-10-01T22:45:14.415794] [DEBUG] [LOCAL ] W: Loaded 53481 existing records from primary storage. [2025-10-01T22:45:14.416021] [INFO ] [MAIN ] W: Loaded 53481 primary data records. [2025-10-01T22:45:14.423995] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-01T22:45:14.424409] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-01T22:45:15.304823] [DEBUG] [MAIN ] VYX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:15.306535] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48753 primary records. [2025-10-01T22:45:15.306829] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-01T22:45:15.335868] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-01T22:45:15.344536] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-01T22:45:15.352186] [INFO ] [MAIN ] Derivative Progress: 1489/1587 symbols completed. VYX took 1.4s. Estimated remaining: 40.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:15.352941] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:15.352769] [DEBUG] [MAIN ] W: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:15.367919] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53481 primary records. [2025-10-01T22:45:15.368472] [DEBUG] [MAIN ] VZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:15.368759] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-01T22:45:15.369582] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-01T22:45:15.370172] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-01T22:45:15.401133] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-01T22:45:15.403419] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-01T22:45:15.408894] [INFO ] [MAIN ] Derivative Progress: 1490/1587 symbols completed. W took 1.4s. Estimated remaining: 40.5s. Rate: 143.7 symbols/min [2025-10-01T22:45:15.405982] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-01T22:45:15.409403] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-01T22:45:15.409303] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:15.412910] [INFO ] [MAIN ] Derivative Progress: 1491/1587 symbols completed. VZ took 1.4s. Estimated remaining: 40.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:15.413267] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:15.453243] [DEBUG] [LOCAL ] WAB: Loaded 44059 existing records from primary storage. [2025-10-01T22:45:15.453547] [INFO ] [MAIN ] WAB: Loaded 44059 primary data records. [2025-10-01T22:45:15.634697] [DEBUG] [LOCAL ] WAT: Loaded 35254 existing records from primary storage. [2025-10-01T22:45:15.635117] [INFO ] [MAIN ] WAT: Loaded 35254 primary data records. [2025-10-01T22:45:15.670554] [DEBUG] [LOCAL ] WAL: Loaded 45226 existing records from primary storage. [2025-10-01T22:45:15.687002] [INFO ] [MAIN ] WAL: Loaded 45226 primary data records. [2025-10-01T22:45:16.599348] [DEBUG] [MAIN ] WAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:16.600430] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44059 primary records. [2025-10-01T22:45:16.600842] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-01T22:45:16.620535] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-01T22:45:16.621860] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-01T22:45:16.625886] [INFO ] [MAIN ] Derivative Progress: 1492/1587 symbols completed. WAB took 1.3s. Estimated remaining: 39.7s. Rate: 143.6 symbols/min [2025-10-01T22:45:16.642821] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:16.643757] [DEBUG] [MAIN ] WAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:16.644899] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45226 primary records. [2025-10-01T22:45:16.658656] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-01T22:45:16.659678] [DEBUG] [MAIN ] WAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:16.661324] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35254 primary records. [2025-10-01T22:45:16.669966] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-01T22:45:16.678157] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-01T22:45:16.688486] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-01T22:45:16.694380] [INFO ] [MAIN ] Derivative Progress: 1493/1587 symbols completed. WAL took 1.3s. Estimated remaining: 39.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:16.694834] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:16.701216] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-01T22:45:16.704073] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-01T22:45:16.706905] [INFO ] [MAIN ] Derivative Progress: 1494/1587 symbols completed. WAT took 1.3s. Estimated remaining: 38.8s. Rate: 143.8 symbols/min [2025-10-01T22:45:16.707161] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:16.717337] [DEBUG] [LOCAL ] WBX: Loaded 11587 existing records from primary storage. [2025-10-01T22:45:16.717516] [INFO ] [MAIN ] WBX: Loaded 11587 primary data records. [2025-10-01T22:45:16.889775] [DEBUG] [LOCAL ] WBS: Loaded 48701 existing records from primary storage. [2025-10-01T22:45:16.940871] [INFO ] [MAIN ] WBS: Loaded 48701 primary data records. [2025-10-01T22:45:17.199288] [DEBUG] [LOCAL ] WCC: Loaded 39634 existing records from primary storage. [2025-10-01T22:45:17.213005] [INFO ] [MAIN ] WCC: Loaded 39634 primary data records. [2025-10-01T22:45:17.773706] [DEBUG] [MAIN ] WBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:17.775365] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 11587 primary records. [2025-10-01T22:45:17.775470] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-01T22:45:17.792150] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-01T22:45:17.792691] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-01T22:45:17.794931] [INFO ] [MAIN ] Derivative Progress: 1495/1587 symbols completed. WBX took 1.1s. Estimated remaining: 38.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:17.795230] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:17.813896] [DEBUG] [MAIN ] WBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:17.814594] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48701 primary records. [2025-10-01T22:45:17.814798] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-01T22:45:17.834130] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-01T22:45:17.834386] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-01T22:45:17.837208] [INFO ] [MAIN ] Derivative Progress: 1496/1587 symbols completed. WBS took 1.2s. Estimated remaining: 38.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:17.837367] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:17.853891] [DEBUG] [MAIN ] WCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:17.854619] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39634 primary records. [2025-10-01T22:45:17.854720] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-01T22:45:17.887016] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-01T22:45:17.887167] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-01T22:45:17.889948] [INFO ] [MAIN ] Derivative Progress: 1497/1587 symbols completed. WCC took 1.2s. Estimated remaining: 37.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:17.890257] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:17.901454] [DEBUG] [LOCAL ] WD: Loaded 23190 existing records from primary storage. [2025-10-01T22:45:17.901786] [INFO ] [MAIN ] WD: Loaded 23190 primary data records. [2025-10-01T22:45:18.029324] [DEBUG] [LOCAL ] WCN: Loaded 47968 existing records from primary storage. [2025-10-01T22:45:18.042319] [INFO ] [MAIN ] WCN: Loaded 47968 primary data records. [2025-10-01T22:45:18.042049] [DEBUG] [LOCAL ] WDH: Loaded 17463 existing records from primary storage. [2025-10-01T22:45:18.059606] [INFO ] [MAIN ] WDH: Loaded 17463 primary data records. [2025-10-01T22:45:18.983783] [DEBUG] [MAIN ] WD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:18.984787] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23190 primary records. [2025-10-01T22:45:18.985216] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-01T22:45:19.004393] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-01T22:45:19.004870] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-01T22:45:19.007067] [INFO ] [MAIN ] Derivative Progress: 1498/1587 symbols completed. WD took 1.2s. Estimated remaining: 37.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:19.027849] [DEBUG] [MAIN ] WCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:19.040556] [DEBUG] [MAIN ] WDH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:19.041284] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47968 primary records. [2025-10-01T22:45:19.041418] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-01T22:45:19.042080] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17463 primary records. [2025-10-01T22:45:19.042801] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-01T22:45:19.074412] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-01T22:45:19.074525] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-01T22:45:19.077320] [INFO ] [MAIN ] Derivative Progress: 1499/1587 symbols completed. WDH took 1.2s. Estimated remaining: 36.7s. Rate: 143.8 symbols/min [2025-10-01T22:45:19.073863] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-01T22:45:19.077458] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-01T22:45:19.080234] [INFO ] [MAIN ] Derivative Progress: 1500/1587 symbols completed. WCN took 1.3s. Estimated remaining: 36.3s. Rate: 143.9 symbols/min [2025-10-01T22:45:19.080736] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:19.080681] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:19.080861] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:19.090573] [DEBUG] [LOCAL ] WEA: Loaded 7284 existing records from primary storage. [2025-10-01T22:45:19.090795] [INFO ] [MAIN ] WEA: Loaded 7284 primary data records. [2025-10-01T22:45:19.221013] [DEBUG] [LOCAL ] WDI: Loaded 21082 existing records from primary storage. [2025-10-01T22:45:19.221213] [INFO ] [MAIN ] WDI: Loaded 21082 primary data records. [2025-10-01T22:45:19.580224] [DEBUG] [LOCAL ] WDS: Loaded 43297 existing records from primary storage. [2025-10-01T22:45:19.586344] [INFO ] [MAIN ] WDS: Loaded 43297 primary data records. [2025-10-01T22:45:20.212673] [DEBUG] [MAIN ] WEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:20.214256] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7284 primary records. [2025-10-01T22:45:20.214606] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-01T22:45:20.235572] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-01T22:45:20.236795] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-01T22:45:20.240998] [INFO ] [MAIN ] Derivative Progress: 1501/1587 symbols completed. WEA took 1.2s. Estimated remaining: 35.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:20.241502] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:20.256018] [DEBUG] [MAIN ] WDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:20.256866] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21082 primary records. [2025-10-01T22:45:20.257233] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-01T22:45:20.276727] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-01T22:45:20.277010] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-01T22:45:20.279876] [INFO ] [MAIN ] Derivative Progress: 1502/1587 symbols completed. WDI took 1.2s. Estimated remaining: 35.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:20.280313] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:20.294263] [DEBUG] [MAIN ] WDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:20.295789] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43297 primary records. [2025-10-01T22:45:20.296138] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-01T22:45:20.320049] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-01T22:45:20.329622] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-01T22:45:20.332566] [INFO ] [MAIN ] Derivative Progress: 1503/1587 symbols completed. WDS took 1.3s. Estimated remaining: 35.0s. Rate: 143.9 symbols/min [2025-10-01T22:45:20.332908] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:20.351368] [DEBUG] [LOCAL ] WEAV: Loaded 41883 existing records from primary storage. [2025-10-01T22:45:20.351572] [INFO ] [MAIN ] WEAV: Loaded 41883 primary data records. [2025-10-01T22:45:20.729357] [DEBUG] [LOCAL ] WEC: Loaded 52186 existing records from primary storage. [2025-10-01T22:45:20.729691] [INFO ] [MAIN ] WEC: Loaded 52186 primary data records. [2025-10-01T22:45:20.855104] [DEBUG] [LOCAL ] WELL: Loaded 52362 existing records from primary storage. [2025-10-01T22:45:20.868471] [INFO ] [MAIN ] WELL: Loaded 52362 primary data records. [2025-10-01T22:45:21.447899] [DEBUG] [MAIN ] WEAV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:21.449891] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 41883 primary records. [2025-10-01T22:45:21.450051] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-01T22:45:21.474633] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-01T22:45:21.475166] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-01T22:45:21.478229] [INFO ] [MAIN ] Derivative Progress: 1504/1587 symbols completed. WEAV took 1.2s. Estimated remaining: 34.7s. Rate: 143.7 symbols/min [2025-10-01T22:45:21.486576] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:21.492856] [DEBUG] [MAIN ] WEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:21.494204] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52186 primary records. [2025-10-01T22:45:21.494400] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-01T22:45:21.514545] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-01T22:45:21.514859] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-01T22:45:21.517321] [INFO ] [MAIN ] Derivative Progress: 1505/1587 symbols completed. WEC took 1.2s. Estimated remaining: 34.2s. Rate: 143.8 symbols/min [2025-10-01T22:45:21.517691] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:21.532636] [DEBUG] [MAIN ] WELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:21.533675] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52362 primary records. [2025-10-01T22:45:21.533804] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-01T22:45:21.554589] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-01T22:45:21.554735] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-01T22:45:21.557576] [INFO ] [MAIN ] Derivative Progress: 1506/1587 symbols completed. WELL took 1.2s. Estimated remaining: 33.8s. Rate: 143.9 symbols/min [2025-10-01T22:45:21.557942] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:21.594375] [DEBUG] [LOCAL ] WF: Loaded 10731 existing records from primary storage. [2025-10-01T22:45:21.594567] [INFO ] [MAIN ] WF: Loaded 10731 primary data records. [2025-10-01T22:45:21.731313] [DEBUG] [LOCAL ] WEX: Loaded 34563 existing records from primary storage. [2025-10-01T22:45:21.737102] [INFO ] [MAIN ] WEX: Loaded 34563 primary data records. [2025-10-01T22:45:21.720374] [DEBUG] [LOCAL ] WES: Loaded 48098 existing records from primary storage. [2025-10-01T22:45:21.747128] [INFO ] [MAIN ] WES: Loaded 48098 primary data records. [2025-10-01T22:45:22.709085] [DEBUG] [MAIN ] WF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:22.710246] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10731 primary records. [2025-10-01T22:45:22.723773] [DEBUG] [MAIN ] WES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:22.723400] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-01T22:45:22.725775] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48098 primary records. [2025-10-01T22:45:22.725957] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-01T22:45:22.759296] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-01T22:45:22.773671] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-01T22:45:22.774920] [DEBUG] [MAIN ] WEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:22.777275] [INFO ] [MAIN ] Derivative Progress: 1507/1587 symbols completed. WF took 1.2s. Estimated remaining: 33.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:22.778286] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 34563 primary records. [2025-10-01T22:45:22.778598] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-01T22:45:22.779279] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:22.779356] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-01T22:45:22.779604] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-01T22:45:22.783314] [INFO ] [MAIN ] Derivative Progress: 1508/1587 symbols completed. WES took 1.3s. Estimated remaining: 33.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:22.791759] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:22.801168] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-01T22:45:22.801484] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-01T22:45:22.804214] [INFO ] [MAIN ] Derivative Progress: 1509/1587 symbols completed. WEX took 1.3s. Estimated remaining: 32.5s. Rate: 143.9 symbols/min [2025-10-01T22:45:22.804470] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:22.825226] [DEBUG] [LOCAL ] WFG: Loaded 24756 existing records from primary storage. [2025-10-01T22:45:22.825463] [INFO ] [MAIN ] WFG: Loaded 24756 primary data records. [2025-10-01T22:45:23.055226] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-01T22:45:23.090470] [DEBUG] [LOCAL ] WGO: Loaded 38946 existing records from primary storage. [2025-10-01T22:45:23.107327] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-01T22:45:23.217756] [INFO ] [MAIN ] WGO: Loaded 38946 primary data records. [2025-10-01T22:45:23.961902] [DEBUG] [MAIN ] WFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:23.963403] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24756 primary records. [2025-10-01T22:45:23.964410] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-01T22:45:23.982093] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-01T22:45:23.982458] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-01T22:45:23.984582] [INFO ] [MAIN ] Derivative Progress: 1510/1587 symbols completed. WFG took 1.2s. Estimated remaining: 32.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:23.985794] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:24.005126] [DEBUG] [MAIN ] WFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:24.005918] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-01T22:45:24.006056] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-01T22:45:24.027096] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-01T22:45:24.039968] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-01T22:45:24.040234] [DEBUG] [MAIN ] WGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:24.042997] [INFO ] [MAIN ] Derivative Progress: 1511/1587 symbols completed. WFC took 1.3s. Estimated remaining: 31.7s. Rate: 143.8 symbols/min [2025-10-01T22:45:24.044043] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:24.043906] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 38946 primary records. [2025-10-01T22:45:24.044615] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-01T22:45:24.072089] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-01T22:45:24.072283] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-01T22:45:24.075076] [INFO ] [MAIN ] Derivative Progress: 1512/1587 symbols completed. WGO took 1.3s. Estimated remaining: 31.3s. Rate: 143.9 symbols/min [2025-10-01T22:45:24.075370] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:24.090339] [DEBUG] [LOCAL ] WH: Loaded 45457 existing records from primary storage. [2025-10-01T22:45:24.090628] [INFO ] [MAIN ] WH: Loaded 45457 primary data records. [2025-10-01T22:45:24.160122] [DEBUG] [LOCAL ] WHG: Loaded 3304 existing records from primary storage. [2025-10-01T22:45:24.186629] [INFO ] [MAIN ] WHG: Loaded 3304 primary data records. [2025-10-01T22:45:24.427599] [DEBUG] [LOCAL ] WHD: Loaded 40276 existing records from primary storage. [2025-10-01T22:45:24.572816] [INFO ] [MAIN ] WHD: Loaded 40276 primary data records. [2025-10-01T22:45:25.195126] [DEBUG] [MAIN ] WH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:25.197168] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45457 primary records. [2025-10-01T22:45:25.200318] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-01T22:45:25.217047] [DEBUG] [MAIN ] WHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:25.232459] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3304 primary records. [2025-10-01T22:45:25.233357] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-01T22:45:25.247089] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-01T22:45:25.256317] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-10-01T22:45:25.252857] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-01T22:45:25.260371] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-01T22:45:25.260268] [INFO ] [MAIN ] Derivative Progress: 1513/1587 symbols completed. WH took 1.3s. Estimated remaining: 30.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:25.264861] [INFO ] [MAIN ] Derivative Progress: 1514/1587 symbols completed. WHG took 1.2s. Estimated remaining: 30.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:25.278169] [DEBUG] [MAIN ] WHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:25.278887] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40276 primary records. [2025-10-01T22:45:25.278975] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-01T22:45:25.295573] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-01T22:45:25.295717] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-01T22:45:25.298776] [INFO ] [MAIN ] Derivative Progress: 1515/1587 symbols completed. WHD took 1.3s. Estimated remaining: 30.0s. Rate: 143.9 symbols/min [2025-10-01T22:45:25.299290] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:25.299234] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:25.299383] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:25.307759] [DEBUG] [LOCAL ] WIA: Loaded 4807 existing records from primary storage. [2025-10-01T22:45:25.307967] [INFO ] [MAIN ] WIA: Loaded 4807 primary data records. [2025-10-01T22:45:25.392935] [DEBUG] [LOCAL ] WINN: Loaded 11626 existing records from primary storage. [2025-10-01T22:45:25.412046] [INFO ] [MAIN ] WINN: Loaded 11626 primary data records. [2025-10-01T22:45:25.809817] [DEBUG] [LOCAL ] WHR: Loaded 48132 existing records from primary storage. [2025-10-01T22:45:25.841039] [INFO ] [MAIN ] WHR: Loaded 48132 primary data records. [2025-10-01T22:45:26.380178] [DEBUG] [MAIN ] WIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:26.382207] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4807 primary records. [2025-10-01T22:45:26.382560] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-01T22:45:26.414282] [DEBUG] [MAIN ] WINN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:45:26.416729] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11626 primary records. [2025-10-01T22:45:26.417172] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-01T22:45:26.421963] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-01T22:45:26.422122] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-01T22:45:26.424907] [INFO ] [MAIN ] Derivative Progress: 1516/1587 symbols completed. WIA took 1.1s. Estimated remaining: 29.6s. Rate: 143.7 symbols/min [2025-10-01T22:45:26.425118] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:26.443552] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-10-01T22:45:26.443823] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-01T22:45:26.446659] [INFO ] [MAIN ] Derivative Progress: 1517/1587 symbols completed. WINN took 1.1s. Estimated remaining: 29.2s. Rate: 143.8 symbols/min [2025-10-01T22:45:26.447022] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:26.464926] [DEBUG] [MAIN ] WHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:26.465912] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48132 primary records. [2025-10-01T22:45:26.466299] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-01T22:45:26.492119] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-01T22:45:26.492409] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-01T22:45:26.494900] [INFO ] [MAIN ] Derivative Progress: 1518/1587 symbols completed. WHR took 1.2s. Estimated remaining: 28.8s. Rate: 143.9 symbols/min [2025-10-01T22:45:26.495332] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:26.521368] [DEBUG] [LOCAL ] WIW: Loaded 20296 existing records from primary storage. [2025-10-01T22:45:26.521763] [INFO ] [MAIN ] WIW: Loaded 20296 primary data records. [2025-10-01T22:45:26.662523] [DEBUG] [LOCAL ] WIT: Loaded 52357 existing records from primary storage. [2025-10-01T22:45:26.681030] [INFO ] [MAIN ] WIT: Loaded 52357 primary data records. [2025-10-01T22:45:26.812041] [DEBUG] [LOCAL ] WK: Loaded 37163 existing records from primary storage. [2025-10-01T22:45:26.896462] [INFO ] [MAIN ] WK: Loaded 37163 primary data records. [2025-10-01T22:45:27.753300] [DEBUG] [MAIN ] WIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:27.755257] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20296 primary records. [2025-10-01T22:45:27.755705] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-01T22:45:27.783440] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-01T22:45:27.789039] [DEBUG] [MAIN ] WIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:27.789299] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-01T22:45:27.791745] [INFO ] [MAIN ] Derivative Progress: 1519/1587 symbols completed. WIW took 1.3s. Estimated remaining: 28.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:27.792683] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52357 primary records. [2025-10-01T22:45:27.793028] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-01T22:45:27.792955] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:27.814938] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-01T22:45:27.815187] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-01T22:45:27.818569] [INFO ] [MAIN ] Derivative Progress: 1520/1587 symbols completed. WIT took 1.4s. Estimated remaining: 28.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:27.827333] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:27.834026] [DEBUG] [MAIN ] WK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:27.834882] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37163 primary records. [2025-10-01T22:45:27.835046] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-01T22:45:27.863533] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-01T22:45:27.863723] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-01T22:45:27.866838] [INFO ] [MAIN ] Derivative Progress: 1521/1587 symbols completed. WK took 1.4s. Estimated remaining: 27.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:27.869969] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:27.894818] [DEBUG] [LOCAL ] WKC: Loaded 34861 existing records from primary storage. [2025-10-01T22:45:27.909059] [INFO ] [MAIN ] WKC: Loaded 34861 primary data records. [2025-10-01T22:45:27.908920] [DEBUG] [LOCAL ] WLKP: Loaded 6828 existing records from primary storage. [2025-10-01T22:45:27.909375] [INFO ] [MAIN ] WLKP: Loaded 6828 primary data records. [2025-10-01T22:45:28.153618] [DEBUG] [LOCAL ] WLK: Loaded 45534 existing records from primary storage. [2025-10-01T22:45:28.175357] [INFO ] [MAIN ] WLK: Loaded 45534 primary data records. [2025-10-01T22:45:28.961704] [DEBUG] [MAIN ] WKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:28.976402] [DEBUG] [MAIN ] WLKP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:28.976056] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34861 primary records. [2025-10-01T22:45:28.977464] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-01T22:45:28.977401] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6828 primary records. [2025-10-01T22:45:28.978135] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-01T22:45:29.013611] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-01T22:45:29.027075] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-01T22:45:29.029447] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-01T22:45:29.032734] [INFO ] [MAIN ] Derivative Progress: 1522/1587 symbols completed. WKC took 1.2s. Estimated remaining: 27.1s. Rate: 143.7 symbols/min [2025-10-01T22:45:29.033029] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:29.029803] [DEBUG] [MAIN ] WLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:29.033235] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-01T22:45:29.034248] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45534 primary records. [2025-10-01T22:45:29.034374] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-01T22:45:29.037822] [INFO ] [MAIN ] Derivative Progress: 1523/1587 symbols completed. WLKP took 1.2s. Estimated remaining: 26.7s. Rate: 143.8 symbols/min [2025-10-01T22:45:29.038400] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:29.055177] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-01T22:45:29.055323] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-01T22:45:29.058082] [INFO ] [MAIN ] Derivative Progress: 1524/1587 symbols completed. WLK took 1.2s. Estimated remaining: 26.3s. Rate: 143.9 symbols/min [2025-10-01T22:45:29.058480] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:29.097134] [DEBUG] [LOCAL ] WLY: Loaded 29680 existing records from primary storage. [2025-10-01T22:45:29.097379] [INFO ] [MAIN ] WLY: Loaded 29680 primary data records. [2025-10-01T22:45:29.508582] [DEBUG] [LOCAL ] WM: Loaded 50913 existing records from primary storage. [2025-10-01T22:45:29.522394] [INFO ] [MAIN ] WM: Loaded 50913 primary data records. [2025-10-01T22:45:29.524013] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-10-01T22:45:29.524338] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-10-01T22:45:30.226518] [DEBUG] [MAIN ] WLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:30.228610] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29680 primary records. [2025-10-01T22:45:30.228975] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-01T22:45:30.252478] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-01T22:45:30.252796] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-01T22:45:30.256137] [INFO ] [MAIN ] Derivative Progress: 1525/1587 symbols completed. WLY took 1.2s. Estimated remaining: 25.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:30.256777] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:30.277203] [DEBUG] [MAIN ] WM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:30.278140] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50913 primary records. [2025-10-01T22:45:30.278410] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-01T22:45:30.295498] [DEBUG] [MAIN ] WMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:30.296969] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-10-01T22:45:30.297309] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-01T22:45:30.330604] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-01T22:45:30.339874] [DEBUG] [LOCAL ] WMK: Loaded 14515 existing records from primary storage. [2025-10-01T22:45:30.338166] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-01T22:45:30.339114] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-01T22:45:30.342924] [INFO ] [MAIN ] WMK: Loaded 14515 primary data records. [2025-10-01T22:45:30.342751] [INFO ] [MAIN ] Derivative Progress: 1526/1587 symbols completed. WM took 1.3s. Estimated remaining: 25.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:30.343163] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:30.358254] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-01T22:45:30.383895] [INFO ] [MAIN ] Derivative Progress: 1527/1587 symbols completed. WMB took 1.3s. Estimated remaining: 25.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:30.405637] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:30.742508] [DEBUG] [LOCAL ] WMS: Loaded 39561 existing records from primary storage. [2025-10-01T22:45:30.743161] [INFO ] [MAIN ] WMS: Loaded 39561 primary data records. [2025-10-01T22:45:30.882363] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-01T22:45:30.882845] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-01T22:45:30.924094] [DEBUG] [MAIN ] WMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:30.959008] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14515 primary records. [2025-10-01T22:45:31.052560] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-01T22:45:31.263469] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-01T22:45:31.275333] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-01T22:45:31.294075] [INFO ] [MAIN ] Derivative Progress: 1528/1587 symbols completed. WMK took 1.0s. Estimated remaining: 24.6s. Rate: 143.7 symbols/min [2025-10-01T22:45:31.550006] [DEBUG] [MAIN ] WMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:31.552206] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39561 primary records. [2025-10-01T22:45:31.552401] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-01T22:45:31.574913] [DEBUG] [MAIN ] WMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:31.579057] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-01T22:45:31.579144] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-01T22:45:31.583599] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-01T22:45:31.583951] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-01T22:45:31.586344] [INFO ] [MAIN ] Derivative Progress: 1529/1587 symbols completed. WMS took 1.2s. Estimated remaining: 24.2s. Rate: 143.8 symbols/min [2025-10-01T22:45:31.603726] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-01T22:45:31.603855] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-01T22:45:31.606803] [INFO ] [MAIN ] Derivative Progress: 1530/1587 symbols completed. WMT took 1.2s. Estimated remaining: 23.8s. Rate: 143.9 symbols/min [2025-10-01T22:45:31.607332] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:31.607282] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:31.607457] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:31.684613] [DEBUG] [LOCAL ] WNC: Loaded 39363 existing records from primary storage. [2025-10-01T22:45:31.684867] [INFO ] [MAIN ] WNC: Loaded 39363 primary data records. [2025-10-01T22:45:31.685481] [DEBUG] [LOCAL ] WNS: Loaded 39903 existing records from primary storage. [2025-10-01T22:45:31.721295] [INFO ] [MAIN ] WNS: Loaded 39903 primary data records. [2025-10-01T22:45:31.837143] [DEBUG] [LOCAL ] WOLF: Loaded 53184 existing records from primary storage. [2025-10-01T22:45:31.867222] [INFO ] [MAIN ] WOLF: Loaded 53184 primary data records. [2025-10-01T22:45:32.749803] [DEBUG] [MAIN ] WNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:32.752182] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 39363 primary records. [2025-10-01T22:45:32.752933] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-01T22:45:32.752784] [DEBUG] [MAIN ] WNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:32.754417] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39903 primary records. [2025-10-01T22:45:32.767005] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-01T22:45:32.768120] [DEBUG] [MAIN ] WOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:32.778466] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53184 primary records. [2025-10-01T22:45:32.781383] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-01T22:45:32.785976] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-01T22:45:32.795752] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-01T22:45:32.820346] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-10-01T22:45:32.818559] [INFO ] [MAIN ] Derivative Progress: 1531/1587 symbols completed. WNC took 1.2s. Estimated remaining: 23.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:32.819244] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-01T22:45:32.820665] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-01T22:45:32.823677] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-01T22:45:32.823597] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:32.823990] [INFO ] [MAIN ] Derivative Progress: 1532/1587 symbols completed. WNS took 1.2s. Estimated remaining: 23.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:32.827167] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:32.827283] [INFO ] [MAIN ] Derivative Progress: 1533/1587 symbols completed. WOLF took 1.2s. Estimated remaining: 22.5s. Rate: 143.9 symbols/min [2025-10-01T22:45:32.827507] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:32.863697] [DEBUG] [LOCAL ] WOR: Loaded 24902 existing records from primary storage. [2025-10-01T22:45:32.863834] [INFO ] [MAIN ] WOR: Loaded 24902 primary data records. [2025-10-01T22:45:32.968951] [DEBUG] [LOCAL ] WOW: Loaded 30384 existing records from primary storage. [2025-10-01T22:45:32.980402] [INFO ] [MAIN ] WOW: Loaded 30384 primary data records. [2025-10-01T22:45:33.161965] [DEBUG] [LOCAL ] WPC: Loaded 48374 existing records from primary storage. [2025-10-01T22:45:33.222365] [INFO ] [MAIN ] WPC: Loaded 48374 primary data records. [2025-10-01T22:45:33.993560] [DEBUG] [MAIN ] WOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:33.995565] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24902 primary records. [2025-10-01T22:45:33.995859] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-01T22:45:34.014468] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-01T22:45:34.015222] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-01T22:45:34.025664] [INFO ] [MAIN ] Derivative Progress: 1534/1587 symbols completed. WOR took 1.2s. Estimated remaining: 22.1s. Rate: 143.7 symbols/min [2025-10-01T22:45:34.031852] [DEBUG] [MAIN ] WOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:34.032222] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:34.033016] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30384 primary records. [2025-10-01T22:45:34.033302] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-01T22:45:34.053337] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-01T22:45:34.066079] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-01T22:45:34.069040] [INFO ] [MAIN ] Derivative Progress: 1535/1587 symbols completed. WOW took 1.2s. Estimated remaining: 21.7s. Rate: 143.8 symbols/min [2025-10-01T22:45:34.069508] [DEBUG] [MAIN ] WPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:34.069620] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:34.070699] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48374 primary records. [2025-10-01T22:45:34.071023] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-01T22:45:34.094580] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-01T22:45:34.094759] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-01T22:45:34.097526] [INFO ] [MAIN ] Derivative Progress: 1536/1587 symbols completed. WPC took 1.3s. Estimated remaining: 21.3s. Rate: 143.9 symbols/min [2025-10-01T22:45:34.097866] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:34.151632] [DEBUG] [LOCAL ] WPM: Loaded 52726 existing records from primary storage. [2025-10-01T22:45:34.162050] [INFO ] [MAIN ] WPM: Loaded 52726 primary data records. [2025-10-01T22:45:34.163060] [DEBUG] [LOCAL ] WPP: Loaded 33916 existing records from primary storage. [2025-10-01T22:45:34.186313] [INFO ] [MAIN ] WPP: Loaded 33916 primary data records. [2025-10-01T22:45:34.663599] [DEBUG] [LOCAL ] WRB: Loaded 50568 existing records from primary storage. [2025-10-01T22:45:34.689079] [INFO ] [MAIN ] WRB: Loaded 50568 primary data records. [2025-10-01T22:45:35.270030] [DEBUG] [MAIN ] WPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:35.273947] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52726 primary records. [2025-10-01T22:45:35.275164] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-01T22:45:35.298799] [DEBUG] [MAIN ] WPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:35.309348] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-01T22:45:35.307715] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33916 primary records. [2025-10-01T22:45:35.309673] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-01T22:45:35.309939] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-01T22:45:35.312754] [INFO ] [MAIN ] Derivative Progress: 1537/1587 symbols completed. WPM took 1.3s. Estimated remaining: 20.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:35.313680] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:35.331244] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-01T22:45:35.331524] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-01T22:45:35.334044] [INFO ] [MAIN ] Derivative Progress: 1538/1587 symbols completed. WPP took 1.3s. Estimated remaining: 20.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:35.336957] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:35.351524] [DEBUG] [MAIN ] WRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:35.352317] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50568 primary records. [2025-10-01T22:45:35.352414] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-01T22:45:35.370228] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-01T22:45:35.370501] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-01T22:45:35.372867] [INFO ] [MAIN ] Derivative Progress: 1539/1587 symbols completed. WRB took 1.3s. Estimated remaining: 20.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:35.373114] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:35.408278] [DEBUG] [LOCAL ] WS: Loaded 24026 existing records from primary storage. [2025-10-01T22:45:35.408676] [INFO ] [MAIN ] WS: Loaded 24026 primary data records. [2025-10-01T22:45:35.547595] [DEBUG] [LOCAL ] WRBY: Loaded 50766 existing records from primary storage. [2025-10-01T22:45:35.548043] [INFO ] [MAIN ] WRBY: Loaded 50766 primary data records. [2025-10-01T22:45:35.781569] [DEBUG] [LOCAL ] WSM: Loaded 49645 existing records from primary storage. [2025-10-01T22:45:35.815179] [INFO ] [MAIN ] WSM: Loaded 49645 primary data records. [2025-10-01T22:45:36.601719] [DEBUG] [MAIN ] WS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:36.603607] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 24026 primary records. [2025-10-01T22:45:36.604315] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-01T22:45:36.627088] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-01T22:45:36.627347] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-01T22:45:36.630424] [INFO ] [MAIN ] Derivative Progress: 1540/1587 symbols completed. WS took 1.3s. Estimated remaining: 19.6s. Rate: 143.7 symbols/min [2025-10-01T22:45:36.644819] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:36.648809] [DEBUG] [MAIN ] WRBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:36.650430] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50766 primary records. [2025-10-01T22:45:36.650767] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-01T22:45:36.686303] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-01T22:45:36.684184] [DEBUG] [MAIN ] WSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:36.686602] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-01T22:45:36.690915] [INFO ] [MAIN ] Derivative Progress: 1541/1587 symbols completed. WRBY took 1.4s. Estimated remaining: 19.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:36.691987] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49645 primary records. [2025-10-01T22:45:36.692360] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-01T22:45:36.692567] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:36.719780] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-01T22:45:36.720168] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-01T22:45:36.723057] [INFO ] [MAIN ] Derivative Progress: 1542/1587 symbols completed. WSM took 1.3s. Estimated remaining: 18.8s. Rate: 143.8 symbols/min [2025-10-01T22:45:36.723403] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:36.735135] [DEBUG] [LOCAL ] WSO: Loaded 24720 existing records from primary storage. [2025-10-01T22:45:36.735302] [INFO ] [MAIN ] WSO: Loaded 24720 primary data records. [2025-10-01T22:45:36.884003] [DEBUG] [LOCAL ] WSR: Loaded 23003 existing records from primary storage. [2025-10-01T22:45:36.900837] [INFO ] [MAIN ] WSR: Loaded 23003 primary data records. [2025-10-01T22:45:37.212168] [DEBUG] [LOCAL ] WST: Loaded 37243 existing records from primary storage. [2025-10-01T22:45:37.232050] [INFO ] [MAIN ] WST: Loaded 37243 primary data records. [2025-10-01T22:45:37.844503] [DEBUG] [MAIN ] WSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:37.846038] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24720 primary records. [2025-10-01T22:45:37.846278] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-01T22:45:37.870098] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-01T22:45:37.870282] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-01T22:45:37.872605] [INFO ] [MAIN ] Derivative Progress: 1543/1587 symbols completed. WSO took 1.2s. Estimated remaining: 18.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:37.892912] [DEBUG] [MAIN ] WSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:37.896853] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23003 primary records. [2025-10-01T22:45:37.897227] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-01T22:45:37.920443] [DEBUG] [MAIN ] WST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:37.925890] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 37243 primary records. [2025-10-01T22:45:37.928748] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-01T22:45:37.929629] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-01T22:45:37.930305] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-01T22:45:37.932972] [INFO ] [MAIN ] Derivative Progress: 1544/1587 symbols completed. WSR took 1.2s. Estimated remaining: 17.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:37.950138] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-01T22:45:37.950333] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-01T22:45:37.954235] [INFO ] [MAIN ] Derivative Progress: 1545/1587 symbols completed. WST took 1.2s. Estimated remaining: 17.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:37.955110] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:37.955353] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:37.954992] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:38.030131] [DEBUG] [LOCAL ] WTI: Loaded 43964 existing records from primary storage. [2025-10-01T22:45:38.057116] [INFO ] [MAIN ] WTI: Loaded 43964 primary data records. [2025-10-01T22:45:38.077507] [DEBUG] [LOCAL ] WT: Loaded 47693 existing records from primary storage. [2025-10-01T22:45:38.078734] [DEBUG] [LOCAL ] WTRG: Loaded 50905 existing records from primary storage. [2025-10-01T22:45:38.084852] [INFO ] [MAIN ] WTRG: Loaded 50905 primary data records. [2025-10-01T22:45:38.085007] [INFO ] [MAIN ] WT: Loaded 47693 primary data records. [2025-10-01T22:45:39.250999] [DEBUG] [MAIN ] WTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:39.265308] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43964 primary records. [2025-10-01T22:45:39.267506] [DEBUG] [MAIN ] WTRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:39.267225] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-01T22:45:39.268618] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50905 primary records. [2025-10-01T22:45:39.269400] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-01T22:45:39.302934] [DEBUG] [MAIN ] WT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:39.308609] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47693 primary records. [2025-10-01T22:45:39.311084] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-01T22:45:39.316089] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-01T22:45:39.317776] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-01T22:45:39.318109] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-01T22:45:39.318493] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-01T22:45:39.320796] [INFO ] [MAIN ] Derivative Progress: 1546/1587 symbols completed. WTRG took 1.4s. Estimated remaining: 17.1s. Rate: 143.6 symbols/min [2025-10-01T22:45:39.334660] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:39.334965] [INFO ] [MAIN ] Derivative Progress: 1547/1587 symbols completed. WTI took 1.4s. Estimated remaining: 16.7s. Rate: 143.7 symbols/min [2025-10-01T22:45:39.336367] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:39.343165] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-01T22:45:39.343295] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-01T22:45:39.346537] [INFO ] [MAIN ] Derivative Progress: 1548/1587 symbols completed. WT took 1.4s. Estimated remaining: 16.3s. Rate: 143.8 symbols/min [2025-10-01T22:45:39.346802] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:39.364527] [DEBUG] [LOCAL ] WTS: Loaded 18134 existing records from primary storage. [2025-10-01T22:45:39.364793] [INFO ] [MAIN ] WTS: Loaded 18134 primary data records. [2025-10-01T22:45:39.577548] [DEBUG] [LOCAL ] WTTR: Loaded 44935 existing records from primary storage. [2025-10-01T22:45:39.621619] [INFO ] [MAIN ] WTTR: Loaded 44935 primary data records. [2025-10-01T22:45:39.869587] [DEBUG] [LOCAL ] WU: Loaded 53453 existing records from primary storage. [2025-10-01T22:45:39.893370] [INFO ] [MAIN ] WU: Loaded 53453 primary data records. [2025-10-01T22:45:40.526066] [DEBUG] [MAIN ] WTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:40.527183] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18134 primary records. [2025-10-01T22:45:40.527362] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-01T22:45:40.548784] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-10-01T22:45:40.549152] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-01T22:45:40.551558] [INFO ] [MAIN ] Derivative Progress: 1549/1587 symbols completed. WTS took 1.2s. Estimated remaining: 15.9s. Rate: 143.6 symbols/min [2025-10-01T22:45:40.551899] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:40.566717] [DEBUG] [MAIN ] WTTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:40.567704] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44935 primary records. [2025-10-01T22:45:40.567902] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-01T22:45:40.585572] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-01T22:45:40.586044] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-01T22:45:40.588446] [INFO ] [MAIN ] Derivative Progress: 1550/1587 symbols completed. WTTR took 1.3s. Estimated remaining: 15.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:40.588743] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:40.605974] [DEBUG] [MAIN ] WU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:40.606806] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53453 primary records. [2025-10-01T22:45:40.606927] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-01T22:45:40.634419] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-01T22:45:40.634739] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-01T22:45:40.637082] [INFO ] [MAIN ] Derivative Progress: 1551/1587 symbols completed. WU took 1.3s. Estimated remaining: 15.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:40.637438] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:40.672482] [DEBUG] [LOCAL ] WWW: Loaded 49139 existing records from primary storage. [2025-10-01T22:45:40.672921] [INFO ] [MAIN ] WWW: Loaded 49139 primary data records. [2025-10-01T22:45:40.797322] [DEBUG] [LOCAL ] WY: Loaded 53131 existing records from primary storage. [2025-10-01T22:45:40.829490] [INFO ] [MAIN ] WY: Loaded 53131 primary data records. [2025-10-01T22:45:40.829390] [DEBUG] [LOCAL ] XFLT: Loaded 29830 existing records from primary storage. [2025-10-01T22:45:40.829740] [INFO ] [MAIN ] XFLT: Loaded 29830 primary data records. [2025-10-01T22:45:41.753766] [DEBUG] [MAIN ] WWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:41.756029] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49139 primary records. [2025-10-01T22:45:41.770476] [DEBUG] [MAIN ] XFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:41.771489] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29830 primary records. [2025-10-01T22:45:41.771733] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-01T22:45:41.770611] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-01T22:45:41.811352] [DEBUG] [MAIN ] WY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:41.814375] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53131 primary records. [2025-10-01T22:45:41.814940] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-01T22:45:41.832283] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-01T22:45:41.832859] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-01T22:45:41.835986] [INFO ] [MAIN ] Derivative Progress: 1552/1587 symbols completed. WWW took 1.3s. Estimated remaining: 14.6s. Rate: 143.6 symbols/min [2025-10-01T22:45:41.836425] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:41.839276] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-01T22:45:41.842431] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-01T22:45:41.844845] [INFO ] [MAIN ] Derivative Progress: 1553/1587 symbols completed. XFLT took 1.2s. Estimated remaining: 14.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:41.845099] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:41.846464] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-01T22:45:41.846550] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-01T22:45:41.849474] [INFO ] [MAIN ] Derivative Progress: 1554/1587 symbols completed. WY took 1.3s. Estimated remaining: 13.8s. Rate: 143.8 symbols/min [2025-10-01T22:45:41.849723] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:41.908411] [DEBUG] [LOCAL ] XPER: Loaded 29760 existing records from primary storage. [2025-10-01T22:45:41.908609] [INFO ] [MAIN ] XPER: Loaded 29760 primary data records. [2025-10-01T22:45:42.060764] [DEBUG] [LOCAL ] XHR: Loaded 43695 existing records from primary storage. [2025-10-01T22:45:42.054441] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-01T22:45:42.071297] [INFO ] [MAIN ] XHR: Loaded 43695 primary data records. [2025-10-01T22:45:42.076679] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-01T22:45:42.993569] [DEBUG] [MAIN ] XPER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:42.994619] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29760 primary records. [2025-10-01T22:45:42.995822] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-01T22:45:43.042518] [DEBUG] [MAIN ] XHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:43.048894] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43695 primary records. [2025-10-01T22:45:43.049395] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-01T22:45:43.050045] [DEBUG] [MAIN ] XOM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:43.049528] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-01T22:45:43.052678] [INFO ] [MAIN ] Derivative Progress: 1555/1587 symbols completed. XPER took 1.2s. Estimated remaining: 13.4s. Rate: 143.6 symbols/min [2025-10-01T22:45:43.049755] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-01T22:45:43.052860] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:43.050889] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-01T22:45:43.053833] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-01T22:45:43.086455] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-01T22:45:43.087179] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-01T22:45:43.090009] [INFO ] [MAIN ] Derivative Progress: 1556/1587 symbols completed. XHR took 1.3s. Estimated remaining: 12.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:43.090459] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:43.093038] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-01T22:45:43.093141] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-01T22:45:43.096610] [INFO ] [MAIN ] Derivative Progress: 1557/1587 symbols completed. XOM took 1.3s. Estimated remaining: 12.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:43.097075] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:43.190757] [DEBUG] [LOCAL ] XPEV: Loaded 53636 existing records from primary storage. [2025-10-01T22:45:43.189363] [DEBUG] [LOCAL ] XPO: Loaded 47817 existing records from primary storage. [2025-10-01T22:45:43.191062] [INFO ] [MAIN ] XPEV: Loaded 53636 primary data records. [2025-10-01T22:45:43.191002] [INFO ] [MAIN ] XPO: Loaded 47817 primary data records. [2025-10-01T22:45:43.214592] [DEBUG] [LOCAL ] XPOF: Loaded 38055 existing records from primary storage. [2025-10-01T22:45:43.245011] [INFO ] [MAIN ] XPOF: Loaded 38055 primary data records. [2025-10-01T22:45:44.220138] [DEBUG] [MAIN ] XPEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:44.221295] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53636 primary records. [2025-10-01T22:45:44.221475] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-01T22:45:44.270432] [DEBUG] [MAIN ] XPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:44.272011] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47817 primary records. [2025-10-01T22:45:44.272127] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-01T22:45:44.270772] [DEBUG] [MAIN ] XPOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:44.272258] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-01T22:45:44.273861] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38055 primary records. [2025-10-01T22:45:44.273950] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-01T22:45:44.274006] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-01T22:45:44.276032] [INFO ] [MAIN ] Derivative Progress: 1558/1587 symbols completed. XPEV took 1.2s. Estimated remaining: 12.1s. Rate: 143.6 symbols/min [2025-10-01T22:45:44.306963] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-10-01T22:45:44.308608] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-01T22:45:44.312198] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-01T22:45:44.312114] [INFO ] [MAIN ] Derivative Progress: 1559/1587 symbols completed. XPO took 1.2s. Estimated remaining: 11.7s. Rate: 143.7 symbols/min [2025-10-01T22:45:44.312331] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-01T22:45:44.314882] [INFO ] [MAIN ] Derivative Progress: 1560/1587 symbols completed. XPOF took 1.2s. Estimated remaining: 11.3s. Rate: 143.8 symbols/min [2025-10-01T22:45:44.315512] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:44.315415] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:44.318703] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:44.390354] [DEBUG] [LOCAL ] XPRO: Loaded 45876 existing records from primary storage. [2025-10-01T22:45:44.391213] [INFO ] [MAIN ] XPRO: Loaded 45876 primary data records. [2025-10-01T22:45:44.391879] [DEBUG] [LOCAL ] XYF: Loaded 28441 existing records from primary storage. [2025-10-01T22:45:44.428897] [INFO ] [MAIN ] XYF: Loaded 28441 primary data records. [2025-10-01T22:45:44.482942] [DEBUG] [LOCAL ] XYL: Loaded 47951 existing records from primary storage. [2025-10-01T22:45:44.536524] [INFO ] [MAIN ] XYL: Loaded 47951 primary data records. [2025-10-01T22:45:45.483685] [DEBUG] [MAIN ] XPRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:45.485149] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45876 primary records. [2025-10-01T22:45:45.485252] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-01T22:45:45.519321] [DEBUG] [MAIN ] XYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:45.520773] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28441 primary records. [2025-10-01T22:45:45.533343] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-01T22:45:45.535836] [DEBUG] [MAIN ] XYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:45.537814] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47951 primary records. [2025-10-01T22:45:45.537039] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-01T22:45:45.549389] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-01T22:45:45.551419] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-01T22:45:45.553877] [INFO ] [MAIN ] Derivative Progress: 1561/1587 symbols completed. XPRO took 1.2s. Estimated remaining: 10.9s. Rate: 143.6 symbols/min [2025-10-01T22:45:45.554230] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:45.572134] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-01T22:45:45.572690] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-01T22:45:45.575456] [INFO ] [MAIN ] Derivative Progress: 1562/1587 symbols completed. XYF took 1.3s. Estimated remaining: 10.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:45.576774] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:45.581197] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-01T22:45:45.581305] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-01T22:45:45.584224] [INFO ] [MAIN ] Derivative Progress: 1563/1587 symbols completed. XYL took 1.3s. Estimated remaining: 10.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:45.584552] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:45.612947] [DEBUG] [LOCAL ] YALA: Loaded 37194 existing records from primary storage. [2025-10-01T22:45:45.613309] [INFO ] [MAIN ] YALA: Loaded 37194 primary data records. [2025-10-01T22:45:45.966059] [DEBUG] [LOCAL ] YELP: Loaded 45285 existing records from primary storage. [2025-10-01T22:45:45.967173] [INFO ] [MAIN ] YELP: Loaded 45285 primary data records. [2025-10-01T22:45:46.025920] [DEBUG] [LOCAL ] YETI: Loaded 52495 existing records from primary storage. [2025-10-01T22:45:46.036724] [INFO ] [MAIN ] YETI: Loaded 52495 primary data records. [2025-10-01T22:45:46.680526] [DEBUG] [MAIN ] YALA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:46.681605] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37194 primary records. [2025-10-01T22:45:46.681807] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-01T22:45:46.707382] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-01T22:45:46.707638] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-01T22:45:46.710284] [INFO ] [MAIN ] Derivative Progress: 1564/1587 symbols completed. YALA took 1.2s. Estimated remaining: 9.6s. Rate: 143.6 symbols/min [2025-10-01T22:45:46.710687] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:46.731935] [DEBUG] [MAIN ] YELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:46.733005] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45285 primary records. [2025-10-01T22:45:46.733254] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-01T22:45:46.753038] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-01T22:45:46.753209] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-01T22:45:46.755183] [INFO ] [MAIN ] Derivative Progress: 1565/1587 symbols completed. YELP took 1.2s. Estimated remaining: 9.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:46.755488] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:46.769313] [DEBUG] [MAIN ] YETI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:46.780613] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52495 primary records. [2025-10-01T22:45:46.780899] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-01T22:45:46.797376] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-01T22:45:46.797492] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-01T22:45:46.800261] [INFO ] [MAIN ] Derivative Progress: 1566/1587 symbols completed. YETI took 1.2s. Estimated remaining: 8.8s. Rate: 143.8 symbols/min [2025-10-01T22:45:46.800622] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:46.815160] [DEBUG] [LOCAL ] YEXT: Loaded 43075 existing records from primary storage. [2025-10-01T22:45:46.815434] [INFO ] [MAIN ] YEXT: Loaded 43075 primary data records. [2025-10-01T22:45:47.177880] [DEBUG] [LOCAL ] YMM: Loaded 52637 existing records from primary storage. [2025-10-01T22:45:47.220901] [INFO ] [MAIN ] YMM: Loaded 52637 primary data records. [2025-10-01T22:45:47.318355] [DEBUG] [LOCAL ] YOU: Loaded 49688 existing records from primary storage. [2025-10-01T22:45:47.319013] [INFO ] [MAIN ] YOU: Loaded 49688 primary data records. [2025-10-01T22:45:47.962031] [DEBUG] [MAIN ] YEXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:47.963677] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43075 primary records. [2025-10-01T22:45:47.964175] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-01T22:45:47.983216] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-01T22:45:47.984771] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-01T22:45:47.987497] [INFO ] [MAIN ] Derivative Progress: 1567/1587 symbols completed. YEXT took 1.3s. Estimated remaining: 8.4s. Rate: 143.6 symbols/min [2025-10-01T22:45:47.987772] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:48.008144] [DEBUG] [MAIN ] YMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:48.009071] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52637 primary records. [2025-10-01T22:45:48.009299] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-01T22:45:48.041787] [DEBUG] [MAIN ] YOU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:48.043495] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49688 primary records. [2025-10-01T22:45:48.044553] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-01T22:45:48.060326] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-01T22:45:48.061116] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-01T22:45:48.077059] [INFO ] [MAIN ] Derivative Progress: 1568/1587 symbols completed. YMM took 1.3s. Estimated remaining: 7.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:48.078122] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:48.082418] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-01T22:45:48.082588] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-01T22:45:48.084920] [INFO ] [MAIN ] Derivative Progress: 1569/1587 symbols completed. YOU took 1.3s. Estimated remaining: 7.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:48.085249] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:48.105385] [DEBUG] [LOCAL ] YPF: Loaded 50501 existing records from primary storage. [2025-10-01T22:45:48.110553] [INFO ] [MAIN ] YPF: Loaded 50501 primary data records. [2025-10-01T22:45:48.110862] [DEBUG] [LOCAL ] YRD: Loaded 12607 existing records from primary storage. [2025-10-01T22:45:48.111049] [INFO ] [MAIN ] YRD: Loaded 12607 primary data records. [2025-10-01T22:45:48.360608] [DEBUG] [LOCAL ] YSG: Loaded 25415 existing records from primary storage. [2025-10-01T22:45:48.377119] [INFO ] [MAIN ] YSG: Loaded 25415 primary data records. [2025-10-01T22:45:49.156431] [DEBUG] [MAIN ] YRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:49.170518] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12607 primary records. [2025-10-01T22:45:49.171580] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-01T22:45:49.172391] [DEBUG] [MAIN ] YPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:49.173986] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50501 primary records. [2025-10-01T22:45:49.174230] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-01T22:45:49.204271] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-01T22:45:49.205816] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-01T22:45:49.209466] [INFO ] [MAIN ] Derivative Progress: 1570/1587 symbols completed. YPF took 1.2s. Estimated remaining: 7.1s. Rate: 143.6 symbols/min [2025-10-01T22:45:49.211212] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-01T22:45:49.210613] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:49.211828] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-01T22:45:49.215543] [INFO ] [MAIN ] Derivative Progress: 1571/1587 symbols completed. YRD took 1.1s. Estimated remaining: 6.7s. Rate: 143.7 symbols/min [2025-10-01T22:45:49.215903] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:49.232169] [DEBUG] [MAIN ] YSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:49.233229] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25415 primary records. [2025-10-01T22:45:49.233300] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-01T22:45:49.251204] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-01T22:45:49.251484] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-01T22:45:49.253955] [INFO ] [MAIN ] Derivative Progress: 1572/1587 symbols completed. YSG took 1.2s. Estimated remaining: 6.3s. Rate: 143.8 symbols/min [2025-10-01T22:45:49.254174] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:49.342986] [DEBUG] [LOCAL ] YUMC: Loaded 52663 existing records from primary storage. [2025-10-01T22:45:49.343241] [INFO ] [MAIN ] YUMC: Loaded 52663 primary data records. [2025-10-01T22:45:49.349169] [DEBUG] [LOCAL ] YUM: Loaded 51188 existing records from primary storage. [2025-10-01T22:45:49.361903] [INFO ] [MAIN ] YUM: Loaded 51188 primary data records. [2025-10-01T22:45:49.511028] [DEBUG] [LOCAL ] ZBH: Loaded 51086 existing records from primary storage. [2025-10-01T22:45:49.549153] [INFO ] [MAIN ] ZBH: Loaded 51086 primary data records. [2025-10-01T22:45:50.411072] [DEBUG] [MAIN ] YUMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:50.412476] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52663 primary records. [2025-10-01T22:45:50.412709] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-01T22:45:50.443781] [DEBUG] [MAIN ] YUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:50.444834] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-01T22:45:50.445928] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-01T22:45:50.447785] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51188 primary records. [2025-10-01T22:45:50.450596] [INFO ] [MAIN ] Derivative Progress: 1573/1587 symbols completed. YUMC took 1.2s. Estimated remaining: 5.8s. Rate: 143.7 symbols/min [2025-10-01T22:45:50.451230] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-01T22:45:50.464619] [DEBUG] [MAIN ] ZBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:50.466119] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51086 primary records. [2025-10-01T22:45:50.466201] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-01T22:45:50.505153] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-01T22:45:50.505065] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-01T22:45:50.505312] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-01T22:45:50.505392] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-01T22:45:50.507936] [INFO ] [MAIN ] Derivative Progress: 1574/1587 symbols completed. YUM took 1.3s. Estimated remaining: 5.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:50.510789] [INFO ] [MAIN ] Derivative Progress: 1575/1587 symbols completed. ZBH took 1.3s. Estimated remaining: 5.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:50.511275] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:50.511386] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:50.512056] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:50.536102] [DEBUG] [LOCAL ] ZEPP: Loaded 17655 existing records from primary storage. [2025-10-01T22:45:50.536381] [INFO ] [MAIN ] ZEPP: Loaded 17655 primary data records. [2025-10-01T22:45:50.784283] [DEBUG] [LOCAL ] ZGN: Loaded 40685 existing records from primary storage. [2025-10-01T22:45:50.916220] [INFO ] [MAIN ] ZGN: Loaded 40685 primary data records. [2025-10-01T22:45:50.917580] [DEBUG] [LOCAL ] ZETA: Loaded 53597 existing records from primary storage. [2025-10-01T22:45:50.923095] [INFO ] [MAIN ] ZETA: Loaded 53597 primary data records. [2025-10-01T22:45:51.649460] [DEBUG] [MAIN ] ZEPP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-01T22:45:51.650976] [INFO ] [MAIN ] ZEPP: Generated 1793 derivative records from 17655 primary records. [2025-10-01T22:45:51.651245] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-01T22:45:51.670664] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1793 records). [2025-10-01T22:45:51.670975] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-01T22:45:51.673182] [INFO ] [MAIN ] Derivative Progress: 1576/1587 symbols completed. ZEPP took 1.2s. Estimated remaining: 4.6s. Rate: 143.7 symbols/min [2025-10-01T22:45:51.673905] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:51.693052] [DEBUG] [MAIN ] ZGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:51.694058] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40685 primary records. [2025-10-01T22:45:51.695100] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-01T22:45:51.732589] [DEBUG] [MAIN ] ZETA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:51.743309] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53597 primary records. [2025-10-01T22:45:51.744628] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-01T22:45:51.744782] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-01T22:45:51.745316] [DEBUG] [LOCAL ] ZH: Loaded 26456 existing records from primary storage. [2025-10-01T22:45:51.747685] [INFO ] [MAIN ] Derivative Progress: 1577/1587 symbols completed. ZGN took 1.2s. Estimated remaining: 4.2s. Rate: 143.7 symbols/min [2025-10-01T22:45:51.748016] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-01T22:45:51.748173] [INFO ] [MAIN ] ZH: Loaded 26456 primary data records. [2025-10-01T22:45:51.747887] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:51.891755] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-01T22:45:51.902727] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-01T22:45:51.910451] [INFO ] [MAIN ] Derivative Progress: 1578/1587 symbols completed. ZETA took 1.4s. Estimated remaining: 3.8s. Rate: 143.8 symbols/min [2025-10-01T22:45:51.915745] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:52.134358] [DEBUG] [LOCAL ] ZIP: Loaded 44097 existing records from primary storage. [2025-10-01T22:45:52.134721] [INFO ] [MAIN ] ZIP: Loaded 44097 primary data records. [2025-10-01T22:45:52.281992] [DEBUG] [LOCAL ] ZK: Loaded 39609 existing records from primary storage. [2025-10-01T22:45:52.295003] [INFO ] [MAIN ] ZK: Loaded 39609 primary data records. [2025-10-01T22:45:52.865354] [DEBUG] [MAIN ] ZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:52.866261] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26456 primary records. [2025-10-01T22:45:52.866588] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-01T22:45:52.886876] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-01T22:45:52.887779] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-01T22:45:52.889989] [INFO ] [MAIN ] Derivative Progress: 1579/1587 symbols completed. ZH took 1.2s. Estimated remaining: 3.3s. Rate: 143.7 symbols/min [2025-10-01T22:45:52.890724] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:52.913293] [DEBUG] [LOCAL ] ZKH: Loaded 7814 existing records from primary storage. [2025-10-01T22:45:52.918802] [INFO ] [MAIN ] ZKH: Loaded 7814 primary data records. [2025-10-01T22:45:52.924519] [DEBUG] [MAIN ] ZIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:52.946160] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44097 primary records. [2025-10-01T22:45:52.972511] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-01T22:45:53.041347] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-01T22:45:53.050192] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-01T22:45:53.053821] [INFO ] [MAIN ] Derivative Progress: 1580/1587 symbols completed. ZIP took 1.3s. Estimated remaining: 2.9s. Rate: 143.7 symbols/min [2025-10-01T22:45:53.070365] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:53.138174] [DEBUG] [MAIN ] ZK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:53.172789] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39609 primary records. [2025-10-01T22:45:53.172942] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-01T22:45:53.315945] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-01T22:45:53.316855] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-01T22:45:53.319824] [INFO ] [MAIN ] Derivative Progress: 1581/1587 symbols completed. ZK took 1.4s. Estimated remaining: 2.5s. Rate: 143.8 symbols/min [2025-10-01T22:45:53.320697] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:53.352978] [DEBUG] [LOCAL ] ZTR: Loaded 16679 existing records from primary storage. [2025-10-01T22:45:53.353349] [INFO ] [MAIN ] ZTR: Loaded 16679 primary data records. [2025-10-01T22:45:53.390560] [DEBUG] [MAIN ] ZKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:53.422604] [INFO ] [MAIN ] ZKH: Generated 1794 derivative records from 7814 primary records. [2025-10-01T22:45:53.428010] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-01T22:45:53.493960] [DEBUG] [LOCAL ] ZTO: Loaded 49877 existing records from primary storage. [2025-10-01T22:45:53.512522] [INFO ] [MAIN ] ZTO: Loaded 49877 primary data records. [2025-10-01T22:45:53.721875] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1794 records). [2025-10-01T22:45:53.731561] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-01T22:45:53.739260] [INFO ] [MAIN ] Derivative Progress: 1582/1587 symbols completed. ZKH took 0.8s. Estimated remaining: 2.1s. Rate: 143.8 symbols/min [2025-10-01T22:45:53.739523] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:54.197365] [DEBUG] [MAIN ] ZTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:54.198459] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16679 primary records. [2025-10-01T22:45:54.198617] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-01T22:45:54.233795] [DEBUG] [MAIN ] ZTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:54.235326] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49877 primary records. [2025-10-01T22:45:54.251515] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-01T22:45:54.252269] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-01T22:45:54.255809] [DEBUG] [LOCAL ] ZTS: Loaded 52994 existing records from primary storage. [2025-10-01T22:45:54.253190] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-01T22:45:54.256090] [INFO ] [MAIN ] ZTS: Loaded 52994 primary data records. [2025-10-01T22:45:54.259259] [INFO ] [MAIN ] Derivative Progress: 1583/1587 symbols completed. ZTR took 0.9s. Estimated remaining: 1.7s. Rate: 143.7 symbols/min [2025-10-01T22:45:54.259585] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:54.323302] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-01T22:45:54.365916] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-01T22:45:54.426223] [INFO ] [MAIN ] Derivative Progress: 1584/1587 symbols completed. ZTO took 1.4s. Estimated remaining: 1.3s. Rate: 143.8 symbols/min [2025-10-01T22:45:54.426695] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-01T22:45:54.678464] [DEBUG] [LOCAL ] ZVIA: Loaded 35420 existing records from primary storage. [2025-10-01T22:45:54.679511] [INFO ] [MAIN ] ZVIA: Loaded 35420 primary data records. [2025-10-01T22:45:54.858475] [DEBUG] [LOCAL ] ZWS: Loaded 42295 existing records from primary storage. [2025-10-01T22:45:54.863923] [INFO ] [MAIN ] ZWS: Loaded 42295 primary data records. [2025-10-01T22:45:55.274005] [DEBUG] [MAIN ] ZTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:55.410473] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 52994 primary records. [2025-10-01T22:45:55.410942] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-01T22:45:55.431296] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-01T22:45:55.432711] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-01T22:45:55.435045] [INFO ] [MAIN ] Derivative Progress: 1585/1587 symbols completed. ZTS took 1.7s. Estimated remaining: 0.8s. Rate: 143.7 symbols/min [2025-10-01T22:45:55.461142] [DEBUG] [MAIN ] ZVIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:55.462695] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35420 primary records. [2025-10-01T22:45:55.463017] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-01T22:45:55.480036] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-01T22:45:55.480250] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-01T22:45:55.482493] [INFO ] [MAIN ] Derivative Progress: 1586/1587 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.4s. Rate: 143.7 symbols/min [2025-10-01T22:45:55.497891] [DEBUG] [MAIN ] ZWS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-01T22:45:55.498537] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42295 primary records. [2025-10-01T22:45:55.498601] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-01T22:45:55.514165] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-01T22:45:55.514257] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-01T22:45:55.516772] [INFO ] [MAIN ] Derivative Progress: 1587/1587 symbols completed. ZWS took 1.1s. Estimated remaining: 0.0s. Rate: 143.8 symbols/min [2025-10-01T22:45:55.517906] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 2s [2025-10-01T22:45:55.518140] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1587/1587 symbols) [2025-10-01T22:45:56.107721] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1587/1587 @ 100.00%)' [2025-10-01T22:45:56.108196] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-01T22:45:56.108575] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-01T22:45:56.108975] [INFO ] [STATE ] Last completion updated: 2025-10-01T22:45:56.108696